Hi David,
one of my datafeeds contains about 15000 products.
After successfull registering the import process with the slow import tool does not stop at the end of the feed. Import goes on infinitely, and when I abort the process no products are imported.
Is there a thing I can do to stop import at the right time?
Regards
Roland
Hi David,
please review my website
{link saved}
The admin is open for you. You can get accesss without login.
The file is
DrJayscom.txt
the puma file imports over the regular import.
Let me know if you need something.
Regards
Roland
Hello Roland,
The feed now actually contains over 150,000 products so that would explain why the slow import tool appears to continue indefinitely as, the "out of" number shows the current number of the products in the database (just under 14000).
The first thing I would suggest is speeding up the Slow Import Tool by editing your config.advanced.php and changing lines 37-39 as follows:
$config_slowImportBlock = 1000;
$config_slowImportSleep = 0;That should complete the process far more quickly and you will be able to view the total number imported with the new larger feed.
However, if after the import it is still reporting only 13316 products then double-check the registration by re-registering the feed and making sure that the correct fields are registered for Product Name, Buy URL and Price which are the only fields checked for valid contents during import. If that all looks OK then it is most likely significant duplication in the feed which isn't unusual for clothing feeds; where, for example, the Product Name is something like "Jumper", but other fields in the field provide more resolution, such as Colour and Size. In this case, the solution is to use Text Before / Text After filters to combine those additional fields with the Product Name to create more unique Product Names.
When you add a Text After or Text Before filter, the text can include placeholders to pull-in the value of any other field in the feed, so let's say your feed has a field called "COLOUR" (as per the table shown in the example record on Feed Registration Step 1), you can include %COLOUR% in the text box on the configuration page for the filter, which will be replaced with the value of the COLOUR field for that record, e.g.
" %COLOUR%"
...without quotes, but note the SPACE at the start, which is important otherwise there would be no space between the product name and the value pulled in by the Text After filter!
Cheers,
David.
--
PriceTapestry.com
I see. This was up from the very first time, so I do think the feed contains only 14000 items. At this moment I am transferring the sites to another host, so I can not work on them. But afterwards I am back reporting you.
Thanks and regards
Roland
Hi David,
the registering result with the new file and the new host are the same as before. Now I have to look deeper into the file.
Thanks and Regards
Roland
Hi David,
I found that there are about 14000 unique products in the datafeed. The rest of the 160000 entries differ in regional, sizes, colours etc. added entries. That is what I do not want to display on my website, so I do not change and investigate more for this.
Thanks and Regards
Roland
Hi Roland,
That's a new one!
Can you confirm that other feeds on the same installation _do_ Slow Import OK?
If so, could you let me know the URL of the installation; how it is registered (field mapping on Feed Registration Step 2) and the filename of the feed and I will download the feed to my test server and see if I can recreate the situation. (I will remove your site details/URLs before publishing your reply)
Thanks,
David.
--
PriceTapestry.com