You are here:  » Feed is empty


Feed is empty

Submitted by babrees on Mon, 2021-09-13 08:01 in

Hi David.

Hope you're keeping well! It's that time when I go through revamping my sites again! (Did I hear you groan ;) )

I'm adding a webgains feed.
Using Setup > Automation Tool.
Fetched a url from webgains for a pipe deliminated csv feed, not zipped
Entered it into the url and clicked Save and Run

It imports an empty file.

I downloaded the feed using same url to my desktop and it is definitely correct and produces a full csv.

Any ideas?

Cheers
Jill

Submitted by support on Mon, 2021-09-13 08:30

Hello Jill,

I know that your servers have been online for many years now this is almost certainly down to https SSL certificate validation, or more specifically that your server's OpenSSL installation does not have the necessary authority certificates to validate the connection. There are also newer versions of the SSL protocol not supported by older versions of OpenSSL.

If it is just certificate validation; it is possible to disable verification in the CURL automation tool handler so first make sure that you are using curl with line 43 of config.advanced.php as follows:

  $config_automationHandler = "curl";

Then edit includes/automation.php and search for the following line (varies by version)

    curl_setopt($ch,CURLOPT_FOLLOWLOCATION,TRUE);

...and REPLACE with:

    curl_setopt($ch,CURLOPT_FOLLOWLOCATION,TRUE);
    curl_setopt($ch,CURLOPT_SSL_VERIFYHOST,0);
    curl_setopt($ch,CURLOPT_SSL_VERIFYPEER,FALSE);

Hope this helps!

Cheers,
David.
--
PriceTapestry.com

Submitted by babrees on Mon, 2021-09-13 09:08

Sorry, I should have said that I had just downloaded and installed the latest PT version (I was on 16!)

Looked on the config-advanced.php file, but it does not have curl in it.

Revision 20/10A Copyright (c) 2005-2020 IAAI Software, All Rights Reserved
PHP Version 7.4.23
MySQL Version 5.7.35

---------
Jill

Submitted by support on Mon, 2021-09-13 09:32

Hi Jill,

Ah - it defaults to "auto" in later distribution; so you should have at line 43 of config.advanced.php:

  $config_automationHandler = "auto";

...REPLACE that with:

  $config_automationHandler = "curl";

If still no joy with certificate validation disabled i've just updated this comment which shows how to get extended error information if the transfer fails...

Cheers,
David.
--
PriceTapestry.com

Submitted by babrees on Mon, 2021-09-13 09:33

If it makes any difference, I'm using the free Let's Encrypt SSL

---------
Jill

Submitted by babrees on Mon, 2021-09-13 09:50

Made those changes and uploaded them, ran again, feed still empty no error messages? Should the error messages appear on the screen or should I be looking for them somewhere?

---------
Jill

Submitted by babrees on Mon, 2021-09-13 09:52

Sorry, I always post too quickly and then think of something to add! I don't know if it makes a difference, but the feeds that have been setup for a long time and already registered all update and import ok
---------
Jill

Submitted by support on Mon, 2021-09-13 10:01

Hi Jill,

If it is down to an error on the main Automation Tool page it would normally show ERROR - TRANSFER FAILED in the Status column alongside the job.

Does it actually say "OK", but the feed is empty?

Assuming the feed is an https it might be worth trying as just http (from your own computer as well to see if plain http is supported).

Validation of outbound https connections is unrelated to the https set-up of your own site...

Cheers,
David.
--
PriceTapestry.com

Submitted by babrees on Mon, 2021-09-13 12:07

Yes, it shows OK but feed is empty and there are no errors.

Just tried just http and file downloaded to my computer fine. Change the url on automation, same thing, says ok, feed empty, no errors

---------
Jill

Submitted by support on Mon, 2021-09-13 12:28

Hello Jill,

Just as a thought, try using the PHP handler by changing line 43 of config.advanced.php as follows;

  $config_automationHandler = "php";

On the off-chance that works; check your other feeds are all also OK with the PHP handler...

Cheers,
David.
--
PriceTapestry.com

Submitted by babrees on Mon, 2021-09-13 13:19

That did it!!

Thanks David. Do you know why would that have to be changed just for the webgains feed? I've used their feeds before with no problems

Cheers
---------
Jill

Submitted by support on Tue, 2021-09-14 07:38

I can't think of any obvious reason at all sorry, if it's not an https issue (since http works) as long as all your other feeds are working fine with the php handler no reason not to stick with that...

Cheers,
David.
--
PriceTapestry.com