You are here:  » Webgains datafeed problem!

Webgains datafeed problem!

Submitted by Perce2 on Tue, 2022-03-29 05:55 in

Hi David,

have run into a problem with a new datafeed from Webgains.
The new feed is offered in two formats;

1.) Google Shopping (TSV)
2.) CSV

There is no option for compression.
I chose CSV and attempted a download from PT Admin and got "ERROR - MIN SIZE ABORT". It was set at just 10 bytes and Unzip set to "No".
Checked that the feed works by running it in a browser, downloaded fine.

After re-setting Unzip to "Yes", adding gzip into the feed download url I attempted another run and got the same results. Running the url from browser, it ran fine, but I noticed it downloaded as .tar.gz format.

Any suggestions?

Submitted by support on Tue, 2022-03-29 08:26


The first thing I would suggest (without zip option in the feed URL) would be to try the php handler by changing line 43 of config.advanced.php as follows;

  $config_automationHandler = "php";

If that works, double check that other feeds are OK. If not, there is a simple mod to override the handler for individual feeds based on the hostname - let me know if required.

If still no joy, revert to "auto" (which normally invokes the curl handler) and run the job again with minimum size abort disabled and then have a look at what (if anything) is actually downloaded. There is a possibility that it is downloading a small HTML document containing a meta refresh to the actual feed URL (agents such as wget/ curl don't follow this kind of redirection) and you may be able to see the actual feed URL in the document and use that directly.

A filename of tar.gz would indicate that there are multiple feeds in the download so there may be an option to select an individual feed. Ultimately of course, you just need a URL directly to the CSV feed on a per merchant basis...


Submitted by Perce2 on Tue, 2022-03-29 11:10

Hi David,

thanks for your suggestions, unfortunately still no joy.
With minimum size abort disabled it downloaded an empty csv file.

Any other ideas?

Submitted by Perce2 on Tue, 2022-03-29 12:09

Hi David,

and there's more...

Webgains provide a shortened verison of the feed url, I normally use the full version, but thought I'd try it anyway and it worked!

Not sure why that should make a dfference, hopefully I'm sorted now.

Thanks for your help,