Hi David,
Is there anythink we can do to speed up import product feeds via scripts I have imported over 1.8 million products and this took over four days.
I forgot to add brand to some of the feeds and now it is in its first day for re import.
My hardware is 1.8 xeon x2 cpus and 1 gig ram I was thinking of moving the databse to a dedicated server to see if this help any ideas so get thsi moving faster.
all the best
Darren
Hi Darren,
Remember the slowest [manual] part of importing - the feed registration - you only have to do once, although you will need to re-register those without a brand i'm afraid.
In terms of speed; firstly is to always use XML feeds in preference to CSV as they import much faster. Also, import via the command line scripts, which means you can get one feed importing whilst working on the registration for other feeds.
My preferred method however is to register all feeds, and then run import.php @ALL from the command line and leave the server to it until they're all done...
http://www.pricetapestry.com/node/7
Cheers,
David.