You are here:  » Problem Importing Feeds

Support Forum



Problem Importing Feeds

Submitted by benoit on Sat, 2008-06-21 12:36 in

Hi David,

We have tried different solutions with no success and since you are usually able to provide the right answers, here are the error messages we get when importing feeds (there are 3 types of errors and I have provided feed size because I think they explain "ERROR 1".

Many thanks for your help
Ben

ERROR 1
importing delamaison.xml...[0/8958]
Fatal error: Allowed memory size of 33554432 bytes exhausted (tried to allocate 33554432 bytes) in /home/subteel/public_html/includes/MagicParser.php on line 2
Feed size = 21,94MB

importing discountmanga.xml...[0/4246]
Fatal error: Allowed memory size of 33554432 bytes exhausted (tried to allocate 38012064 bytes) in /home/subteel/public_html/includes/MagicParser.php on line 2
Feed size = 19,30MB

importing esoph.xml...[0/19476]
Fatal error: Allowed memory size of 33554432 bytes exhausted (tried to allocate 33554432 bytes) in /home/subteel/public_html/includes/MagicParser.php on line 2
Feed size = 22,56MB

importing journaux.xml...[0/9528]
Fatal error: Allowed memory size of 33554432 bytes exhausted (tried to allocate 29820928 bytes) in /home/subteel/public_html/includes/MagicParser.php on line 2
Feed size = 16,29MB

importing lutinrouge.xml...[0/12978]
Fatal error: Allowed memory size of 33554432 bytes exhausted (tried to allocate 27214340 bytes) in /home/subteel/public_html/includes/MagicParser.php on line 2
Feed size = 17,12 MB

importing maismoinscher.xml...[0/3751]
Fatal error: Allowed memory size of 33554432 bytes exhausted (tried to allocate 31219902 bytes) in /home/subteel/public_html/includes/MagicParser.php on line 2
Feed size = 18,31MB
importing masterprix.xml...[0/16339]
Fatal error: Allowed memory size of 33554432 bytes exhausted (tried to allocate 31170754 bytes) in /home/subteel/public_html/includes/MagicParser.php on line 2
Feed size = 29,21MB
importing silverlingerie.xml...[0/1290]
Fatal error: Allowed memory size of 33554432 bytes exhausted (tried to allocate 31097032 bytes) in /home/subteel/public_html/includes/MagicParser.php on line 2
17,61MB
importing starzik.xml...[0/9170]
Fatal error: Allowed memory size of 33554432 bytes exhausted (tried to allocate 24265460 bytes) in /home/subteel/public_html/includes/MagicParser.php on line 2
12 ,80 MB

ERROR 2
importing madeinsport.xml...[0/5084]You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near 'Neal replica marine-138743.html]&z=1]]' and file_name ='madeinsport.xml'' at line 1subteel@aaaaa.com [~/public_html/scripts]#
6,70 MB

ERROR 3 « NO RECORD »

subteel@aaa.com [~/public_html/scripts]# php import.php digitphoto.xml
subteel@aaa.com [~/public_html/scripts]# php import.php hilfiger.xml
subteel@aaa.com [~/public_html/scripts]# php import.php locafilm.xml
subteel@aaa.com [~/public_html/scripts]# php import.php texinfo.csv

Submitted by support on Sat, 2008-06-21 13:07

Hello Ben,

Could you perhaps have a look at one of the feeds from the command line - an out of memory error is consistent with the XML being corrupted, meaning that the parser is trying to read the entire file into memory without coming across closing elements.

This could happen, for example, if the files are zipped; or perhaps a transient error in the production of the feed has added some pre-amble, for example an error message, at the start of the file.

From the command line, you could view a feed, for example (where $ is your command prompt):

$cd ~/public_html/feeds
$more delamaison.xml

(then CTRL-C to exit more) ...and check that the file looks OK....

Cheers,
David.

Submitted by AD_Mega on Mon, 2008-08-18 08:16

I'm getting the same error on some of my datafeeds. I looked at the datafeed and it looks fine. No error message at the top. What else should I look for.

Submitted by support on Tue, 2008-08-19 09:02

Hi Adrian,

If you'd like to email me a link to one of the feeds that is causing a problem i'll download it to my test server and check it out for you...

Cheers,
David.

Submitted by AD_Mega on Thu, 2008-08-21 03:32

My old host was able to import the same feed.

Submitted by support on Thu, 2008-08-21 06:24

Hi Adrian,

It's possible that your old server was using an older version of PHP that did not enforce (or understand) character encoding within the underlying XML library.

It is always worth contacting the merchant to alert them to the encoding error (as highlighted when you browse to the feed using Firefox) but if that doesn't help let me know and I'll investigate ways to override the character encoding...

Cheers,
David.

Submitted by AD_Mega on Thu, 2008-08-21 06:30

I contacted the merchant but don't know when I'll get a response. I'm getting the error in 2 other feeds also.

Submitted by AD_Mega on Tue, 2008-08-26 03:49

I haven't gotten a response back from the merchant. I'm having the problem with 2 other datafeeds. I still have my old host and I'm able to import them on that server. I'm not sure whats different on the old host since I think it has the latest version oh php.

Submitted by support on Tue, 2008-08-26 07:38

Hi Adrian,

There is a hack that may work that involves forcing PHP's internal XML parser into a particular character set. Could you let me know what character set your site is using (the value in $config_charset) and i'll email you a "fixed" character set version of the parser which may help.

Failing that, there is one further hack that involves cleansing the data ourselves before passing it to the parser which may work...

Cheers,
David.

Submitted by AD_Mega on Tue, 2008-08-26 15:16

The charset is utf-8

Submitted by support on Wed, 2008-08-27 02:02

Thanks, Adrian - i'll follow up by email.

Cheers,
David.

Submitted by Deanh01 on Sat, 2009-01-24 16:21

Hi David
I also am having this problem with the clickbank xml feed that has been flattened. using utf-8"

Thank You
Dean

Submitted by Deanh01 on Mon, 2009-01-26 22:58

hi David
After flattening The clickbank feed and moving it to the feed folder I run into the problem of exhausted memory I have run the feed before but usually have this problem. So instead of 7994 products I only get 50. Is there a way around this?
Thank You
Dean

Submitted by support on Tue, 2009-01-27 11:03

Hi Dean,

That might imply the flatten function didn't work - perhaps there was a transient error with the source feed. Could you try it again (with a fresh download of the clickbank feed); and if the problem persists, if you could email me a link to your site and the flattened filename I'll download it to my test server and take a look...

Cheers,
David.

Submitted by hdesign on Thu, 2015-11-12 04:11

Hi Everybody,

I found this same error on exhausted memory size.

Here's how it was corrected on my end.

After the flatten.php is used to create clickbank.xml:

1. Copy clickbank.xml from the server to your PC

2. Open the file in notepad only. Around 16 MB for this file will take a short while to open.

3. File -> Save As -> File Name: clickbank.xml -> Save as type: Text Documents (*.txt) -> Encoding: UTF-8 (you may see your file as ANSI before this change)

4. Upload to your feeds folder and import

David

Submitted by support on Thu, 2015-11-12 08:33

Thanks David!

Cheers,
David.
--
PriceTapestry.com