Just Got PT however when i import a CJ CSV file I get 0 Products

Hi Matts, and welcome to the forum!

The requirements for a product to be imported are valid Product Name, Buy URL and Price fields, and that it is unique to that merchant (so a second instance of the same product from the same merchant would not be imported). However, in that case you would expect at least 1 record imported, so it is almost certainly down to one of the required fields being invalid for every record.

If the values of the required fields in the sample data displayed on Feed Registration Step 2 look OK, please could you let me know the URL of your installation and the filename of the feed that is not importing any products (I'll remove before publishing your reply) and I'll download the file from your feeds folder to my test server and check it out for you right away...

Cheers,
David.
--
PriceTapestry.com

hey I sent you a support email maybe you can give some advice?

Hi matts,

I just got your email; I'll check your feeds out on my test server and get back to you...

Cheers,
David.
--
PriceTapestry.com

I am having the same problem, feeds which previously worked fine in the past are now only importing 260 products instead of the 2600+ there is. I have tried deregistering, deleting, reuploading and nothing seems to be working.

Hi kimarie,

The issue above turned out to be unrelated to the feed; but rather down to a problem with the products table itself resulting from the MySQL installation defaulting to a table type other than MyISAM.

If you could let me know the URL of your installation and filename of the feed that has stopped working properly (I'll remove the details before publishing your reply) I download your feed to my test server and check it out right away for you...

Cheers,
David.
--
PriceTapestry.com

Hi,

The installation is - {link saved}

Problem feed is - {link saved}

Thanks

Hi kimarie,

I checked the feed, and it is currently corrupted with an invalid UTF-8 character sequence causing the parse to abort. I was able to make the feed import fully by using the ASCII cleansing version of Magic Parser but this sort of thing is generally a transient issue with the feed so what I would suggest would be to download the latest version and check the import again. If it's still only importing 260 products, let me know and I'll forward the cleansing version of Magic Parser for you to try...

Cheers,
David.
--
PriceTapestry.com

Hi,

Even less this time only 122!

Kimarie

Hi kimarie,

I'll forward the ASCII cleansing version of the parser to try...

Cheers,
David.
--
PriceTapestry.com

Hello David,

I am new to price tapestry and very excited i purchased it.

I have similar issue while importing feeds. The xml feed i downloaded have 2261 products but when i import, it only imported 4 products. I even used analyser.php and it also showed me that the feed file contains total of 4 products.

When i open the feed file in Notepad++ program I see lot of invalid ascii characters (such as EM, GS) mostly in the long description field starting from 5th product. If i manually remove the ascii character then the import works perfectly. I believe the version of MagicParser.php that i have breaks when it sees ascii character in the product line.
I have tried many different things such as changing $config_charset value to iso-8859-1, adding UTF8 Encode filters, but none of them helped me.

I believe ascii cleansing Magic Parser can be a solution in this case.
I'd appreciate any help resolving this issue

--Pankaj

Hello Pankaj,

Welcome to the forum and thank you for your comments!

I've emailed you a new version of the parser which I'm currently testing which includes an optional filter parameter for XML format strings. Once received, on Feed Registration Step 1 modify the auto-detected format string by appending one of

|ASCII
|UTF-8
|ISO-8859-1

For example, if the auto-detected format string is

xml|PRODUCTS/PRODUCT/

...to apply the ASCII filter, you would use:

xml|PRODUCTS/PRODUCT/|ASCII

Cheers,
David.
--
PriceTapestry.com

Thanks David, It worked perfectly.

I have two more questions:
#1) I have few big feed(> 500 MB) and they fails because of time-outs. I have tried to increase the memory_limit settings on my local PHP.ini file but still looks like i cannot increase more than what host provider has already setup. Is there a work-around? I am using shared host service.

#2) Since i need selected data from those feeds, I am also thinking of using web-service calls to limit the number of products. But web-services i am planning to consume return product information in pages. My idea is to loop around those pages and directly insert product records in PT tables. Can i expect some help in this regards?

--Pankaj

Hi David,

I just verified again and the import works fine but it looks like the new version of Magic Parser has removed all the ascii characters such as :, / from URL fields also. Requesting your help in this regards.

--Pankaj

Hi Pankaj,

I've just sent you an updated filtering version of Magic Parser allowing the full ASCII range.

Looping through an API to construct a feed is generally straight forward - beware of things like rate limitation and always ensure that use of an API is within its terms of use (for example Amazon require their API to be used live or near-live) but if you'd like to drop me an email with a few details I'll take a look and should be able to help you out under a Support Plus subscription, no problem!

Cheers,
David.
--
PriceTapestry.com