I'm currently in the process of uploading a merchant feed with 250K products, its taking ages (2.5 hours already!) is thin normal? what the best way to upload large feeds? I've uploaded it as XML (unzipped) I tried to upload it as zipped but the parser did not recognise the feed.
Any help would be appreciated.
Thanks
Anton
Thanks David that is helpful.
BTW, I'm trying to upload to the server, not importing yet.
Thanks again.
All the best!
Hi still having problems, with the import now.
you mentioned I can upload and then unzip as follows:
cd /yoursite/feeds
unzip feed.zip
what if the folder feeds resides on a subdomain?
Thanks,
All the best!
Hi,
I'm really having problems with registering/omporting large feeds.
As per the thread David pointed me to I changed the php.ini file to maximise download time and size of files but I still cant register large feeds, this is the error I'm getting:
Internet Explorer cannot display the webpage
Most likely causes:
You are not connected to the Internet.
The website is encountering problems.
There might be a typing error in the address.
What you can try:
Diagnose Connection Problems
More information
This problem can be caused by a variety of issues, including:
Internet connectivity has been lost.
The website is temporarily unavailable.
The Domain Name Server (DNS) is not reachable.
The Domain Name Server (DNS) does not have a listing for the website's domain.
If this is an HTTPS (secure) address, click Tools, click Internet Options, click Advanced, and check to be sure the SSL and TLS protocols are enabled under the security section.
For offline users
You can still view subscribed feeds and some recently viewed webpages.
To view subscribed feeds
Click the Favorites Center button , click Feeds, and then click the feed you want to view.
To view recently visited webpages (might not work on all pages)
Click Tools , and then click Work Offline.
Click the Favorites Center button , click History, and then click the page you want to view.
Hi,
In this case, you need to CD to /yoursite/feeds/ that corresponds to the location of your subdomain's folder on your server. For example, after logging in it might be something like:
cd sites/www.example.com/httpdocs/feeds/Hope this helps,
Cheers,
David.
Hi Anton,
Regarding your previous message; can you check my reply to your thread regarding importing by SSH...
http://www.pricetapestry.com/node/893
Large feeds are not ideally imported via the browser (for obvious reasons), so if we can get you working via the command line that is a much better solution...
Cheers,
David.
Hi David,
Okay, here's the deal...
I managed to unzip feeds using putty and also register and import the feeds using putty however while i said that it was done, nothing happened
this is the comand I used to import the feed:
cd www/online-shopping/scripts
php import.php pickabook.xml
Any tips?
thanks mate!
Has pickabook been registered successfully?
Again, if you could copy and paste the output from commands that will really help...
Thanks,
David.
pick abook wasn't registered at all. its still in the admin section waiting to be registered. Here's the output I got:
-bash-2.05b$ cd www/online-shopping/scripts
-bash-2.05b$ php import.php pickabook.xml
backfilling reviews...[done]
The problem is that feeds must be registered before importing.
Can you please email the link to your site, I will then download pickabook.xml and work out the command line registration command for you. You will then be able to import it via the command line...
Reply to your reg code or forum registration email is the easiest way to get me...
Cheers,
David.
Hello Anton,
Do you mean uploading to your server, or importing?
An unzipped XML file with 250,000 products is going to be huge; and depending on your connection speed it is not unreasonable for it to be still uploading after almost 3 hours.
Do you have command line (SSH or Telnet) access to your server? If so, one thing to do is upload the zipped version and then unzip the feed from the command line, for example, after uploading:
cd /yoursite/feedsunzip feed.zip
Better still is to download the feed directly to your server from the command line. To do this, have a look at the commands derived in the automation script guide, which you can type in manually to download the feed from the affiliate network or merchant:
http://www.pricetapestry.com/node/198
Another method is to write a PHP script to download files. There is lots of information, hints tips and discussion from other users about doing this...
http://www.pricetapestry.com/node/24
As you are working with such huge feeds, I would also recommend reading through the thread on timeout issues which you may encounter when trying to register or import...
http://www.pricetapestry.com/node/582
Hope this helps,
Cheers,
David.