Hello,
I have a question about the following problem:
When importing an CSV file (automated or with the web app.) with like 24000 records only 5700 records are imported in the database from price tapestry. I test it with an online web server and on my local web server @ top speed, the results where exactly the same. No time out error occurs.
Feed 1 11811 total, imported 4304
Feed 2 24675 total, imported 5781
Feed 3 1479 total, imported 1121
This problem happens with all the feeds from one affiliate network.
This is the link to an feed in csv format (Tab, no quotes):
http://www.m4n.nl/_df?m=public_stream_csv&sep=tab1&valq=value1&enq=enq1&dfid=89&duid=8433
Is there a way to solve this problem?
Thanks in advance for some help.
Frank Hollander
The Netherlands
Hi David,
Thanks for your reply, and your script is great!!
What I did to solve the problem is quit simple: I changed the name and description in searchresults.php and products.php. (this is not the correct official way, but for me it works so far).
More records are imported into the database and accidental the search operations are on the description instead of the title, more results are found!
Maybe this information can be helpful for somebody else!
Kindly regards,
Frank.
Hello Frank,
In this situation, the reason is almost certainly because many of the records don't contain (or contain invalid) data. For a product to import, it must contain the minimum required fields (Product Name, Buy URL and Price), and further still the product name field must pass the normalisation filter which removes any dangerous or invalid characters from the text.
Further, the products must be unique, so what may be happening in the case of the sample feed is that if the "title" field was registered as the product name, only one of each group of products is being imported. I've looked at the feed, and there doesn't seem to be another column that can be combined with "title" to create a unique product name (the next field is the description). If there were a suitable field, you could add it using a "Text After" filter, but that doesn't look to be the case with this feed...
Hope this helps,
Cheers,
David.