Hi,
Remember that 500 internal error I got last week - it seemed to be a one-off due to an incorrect format string, but it's back - but only when using the Drop record (if not) code.
I've put the droprecordifnot code at the bottom of filter.php, and everything works fine - unless I use that particular filter. Even the "drop record" filter works.
Is there anything performance-wise that's likely to cause issues with this script? I've also added the sleep you suggested every 100 products when importing, but to no avail.
The error log shows the "premature end of script headers".
Thanks for your help, and email me if you want to have a poke around :)
Hi David, thanks for the email with the database correction - unfortunately it didn't solve the problem though.
Cheers
Hi Harvey,
Could you email me:
1) your modified copy of includes/filter.php (as an attachment)
2) a link to the feed that you are trying to import (i'll download it to my test server)
3) exactly how you have registered that feed (which fields for Name, Description) etc
4) what filters you have setup against the feed, and their configurations etc.
I'll then recreate the situation on my test server and take it from there...
Cheers,
David.
Forgot to mention, it does all work fine on a sheet with only 10 products. Thanks.
Hi David, thanks for your help on this.
I've upgraded quite significantly to a server that doesn't mind parsing 20k products, but it's still erroring - have dropped you an email, would appreciate it if you could take a look.
Thanks
Hi Harvey,
Will save David's fingers or hopefully, he can sort out the script problems, but I can give some advice on server issues.
I have recently upgraded to a dedicated server to get the best out of this script and also because in some respects, I was running out of room, even though I was on a business pro hosting.
Depending upon which host you are with, personally I am with one and one, but there will be in your cpanel, server settings, you can change the timeout from the default time, to a time that suits you.
Once you find that setting, you will need to see how far the time goes upto, I have put mine on 9999 or something like that, then 9/10 you will not have a problem.
Once you have that sorted, the next thing you need to worry about, is when feeds upload too fast, I've had some reasonably biggish ones, or what seemed to be before, upload within seconds and thats when you start getting paranoid about proper tracking.
The MAJOR tip, I will give you, is that find all the mod's you want as a permant feature of your websites, modify the script to your needs, and then upload to your domains. I have adjusted about 5 or 6 sites so far, and uploaded to about 10 sites with the modyfied feed with minimum editing, and I probaly still haven't gone through most of the mods.
Next thing for me is the skinning department, planing to take the weekend off, so I might find some time to try and have a play, as once you get the bug you soon find yourself either buying more domains, or bringing old domains into action, especially if you go on a dedicated server as you end up with more databases, more this that and the other so you go full throttle, especially now with I hate to say it the run up to Christmas.
Regards
Mark
Hi Mark, thanks for the comments.
I upgraded to a more powerful server - not dedicated, or even VPS, but limits are now sufficient to allow a 20k product feed in good time, so I'm happy with it.
I believe the problem occurred because the sleep() was only happening every 100 products imported - and because only about 0.5% of each feed was being imported, didn't happen at all.
Also, the server was configured to halt the script after 30s if no output was generated, so David sorted that out by printing progress every 100 products processed.
Run up to Christmas, tell me about it - can't wait, am in the gifts sector for one of my sites :)
Mark, are you on A4U? If not, join up it's a great affiliate community - www.affiliates4u.com/forums/ - see y'around!
Hi Harvey,
If you are using the filter to remove the vast majority of records from a feed it is possible that your MySQL server connection has timed out. Normally this is not a problem, but I have recently come across an installation where MySQL timed out but did not automatically re-connect as it is supposed to do.
I will send you an alternative version of includes/database.php that addresses this issue, and may help if this is what is causing this particular server error.
Cheers,
David.