Hi David,
I have a feed which is 147 Mo in CSV and 175 Mo in XLS.
Obviously, I have to deal with it as it is.
The feeder has decided to use the same categorie "book" for about 140 000 products but forgot to add the XML node.
The XML import works fine. But the category display could not be used anymore.
As many readers are searching a book name or author, the feed is of some interest.
The CSV file contains (in some case) a subcategory (youth, thriller...) that I could use as the main category.
But when I import the file the server blows up.
Have you any idea to solve this?
regards
Hi David,
I have added a filter and records are sent by one hundred at a time.
Moreover I have played with php.ini to increase file size to 50 Mo, memory allocated per process to 128 MO and time out to 45 s.
So far so good, 25 000 records uploaded, 225 000 to go.
Fortunatly books are a more stable product than televisions, PCs...
Then I will reset php.ini.
regards,
John
Hi John,
That's a big feed, and if you are having import timeout problem first of all consider using CSV rather than XML feeds that can be used with the Slow Import Tool (/admin/ menu in your site). Ordinarily, that is sufficient to solve loading problems, if not, let me know and we can look at alternatives (such as inserting a 1 second sleep state very 100 (or so) products as described in this thread to reduce import time server load)
But regarding your main point, with all products being imported under the category Books, it sounds like there is a more appropriate sub-category field in the feed that could be registered as the category field. For XML, check for a field something like "CATEGORY/SUBCATEGORY", or in a CSV feed more likely to be just "subcategory" that would be more appropriate. In general, double check with the sample data displayed on Feed Registration Step 2 when mapping fields to select the most appropriate / lowest level value...
Cheers,
David.
--
PriceTapestry.com