What is this the average expected file size of uncompressed xml datafeeds?
One particular url that I have been given to an xml datafeed is in excess of 200mb?
Needless to say it throws a php timeout, which I am discussing with the site host.
Is there a file limit on what PT can import? I have play.com which is around 200mb (114,000 products) but stops at around 24,000 products and asks me to download import.php...
Robert
Hi Robert;
There is no hard coded limit on the size of feed. Did you mean it was asking you to download admin_import.php; which is the web based import script?
If so, then you will be having one of the timeout issues usually associated with trying to import via HTTP. Please see the following thread for discussion of the same problem and how to import by logging in to your server via Telnet or SSH and using the import.php script...
http://www.pricetapestry.com/node/109
If you are already using the command line let me know as it sounds like something else may be wrong in that case...
it imported the playcom via command line now... thanks david
I don't know if it is any use to you, but I presume the playcom feed is from buy.at?
If you scroll down to the very bottom of the "productfeeds" page in the log-in area, you have an option with all perfilliate feeds to download only certain categories (e.g. film, ps2 games etc..).
May be useful ??
Hi,
It really does vary quite considerably; depending mostly on how comprehensive the description field is.
200MB is a BIG feed, but not too far out of proportion if it contains getting on for 100,000 well described products as most feeds I use seem to work out at around 10MB per about 2000 products.