Hi David
On a website we set up several years back using your first version of PT (which has run fine) has suddenly started causing problems on our server causing the MySql to grind to a halt and consequently effect our other sites not running non PT databases and email.
The message from Namesco reads:
Our monitoring system alerted us to your server this morning as its resource usage caused the server to unexpectedly restart. Looking at the current process lists it appears that the cause is a high volume of MySQL queries running on the server.
Looking at the log file it appears bing and yahoo were spidering at the same time. As I have no futher idea what may be causing the problem I have had to take the site offline to avoid further interuption to the rest of our business.
Do you have any idea or advice on what may have caused this?
Chris
Thanks David
I shall give that a go and see how we get on over the next couple of weeks. Bad timing as usual, as you know i've been completely rebuiding from the ground up with your latest version on a test site and was hoping to replace the old site in the near future.
Chris
Hi Chris,
If a multi-threaded crawl was taking place by 2 search engines at the same time; for a large site and particularly with related products enabled (which causes a product search to take place for every product page view) it is possible that that is the reason.
What I would suggest is temporarily disabling Related Products by changing line 10 of config.php as follows;
$config_useRelated = TRUE:...and then add the following to the end of your robots.txt:
User-agent: *Crawl-Delay: 2
That should significantly reduce server load during deep crawls, and if that does the trick then perhaps consider re-instating Related Products after a week or so; and if no further problems that would indicate that crawl-delay is sufficient...
Cheers,
David.
--
PriceTapestry.com