While importing a datafeed at tahe command line it said it inported over 600,000 products. It took 12hrs to complete the import. When finished I checked admin and it said 92981 products. When I clicked on the merchant it said 237601 product. I use the xml version of the datafeed. I tried downloading the csv version to see how many products are in the datafeed but I'm not able to download the complete file for some reason.
My site was moved to a semi dedicated server and all 687707 products were imported. Hopefully this will solve some of my performance problems.
Hi,
Wow - big feed... The usual reasons for products not being imported of course are a) duplication in the product name and b) one or more of the mandatory fields being invalid. During import, the actual count shown is the number of records processed, whereas the actual number imported is only updated when the import has finished.
Assuming that the import finished, there shouldn't be any difference between the number reported in the admin section and the total results when doing a merchant search, as it is (more or less) the same query that is used. Therefore, can you check that the imported time alongside the feed matches more or less when you think it finished, and that it is not actually the number of products previously imported for that merchant? It sounds like it may not actually of completed, which will explain a difference in the numbers.
As you are obviously working with very large feeds, MySQL performance may become an issue - there is a thread with discussion of optimal MySQL configuration for handling millions of products...
http://www.pricetapestry.com/node/732
Cheers,
David.