Greetings,
We recently migrated to a new dedicated server with the following specs:
8 processors - Intel(R) Xeon(R) CPU E3-1230 V2 @ 3.30GHz
8G RAM
SSD drives
We have our "slow import" set to:
$config_slowImportBlock = 15000;
$config_slowImportSleep = 1;
Any thoughts on what the "maximum" could be set to?
We ran multiple CRON jobs with millions of products in hundreds of data feeds - at once, and the server didn't even groan one bit.
Any thoughts would be appreciated.
Thanks!
:)
That's what we wanted to hear.
Thanks, David - you're the best!
Hi David,
One more question:
And then, slow import will work to all intents and purposes exactly like normal import...
Will the imports first go into a productstemp table like in the slow import?
Thanks!
Hi Convergence,
I just checked the latest version of scripts/import_slow.php that I have from you by email and can confirm that the temporary table (zero down time) code is all in place!
Cheers,
David.
--
PriceTapestry.com
Hi David,
Server sure didn't like that code, lol:
$config_slowImportBlock = PHP_INT_MAX;
$config_slowImportSleep = 0;1) Import stopped after the first merchant.
And
2) Slow Import from Admin times out.
Oops...
Hi Convergence,
There is some disparity over the availability of the PHP_INT_MAX constant, so instead, perhaps just try a definitely available, but very large normal value, e.g.;
$config_slowImportBlock = 10000000;
$config_slowImportSleep = 0;Cheers,
David.
--
PriceTapestry.com
Hi Convergence!
With your server specification as it is now, the sky is the limit, and if one were building a large Price Tapestry site on a dedi/VPS server of that specification from scratch, there would be no need to use the slow import script at all.
However, I know that you have "grown" into that server, with numerous modifications, and your import / CRON process, which includes accepting feeds via push from various networks, is working well, so I would not suggest changing anything - other than, exactly as you are asking, how to "max out" the slow import method. The answer is as follows - use:
$config_slowImportBlock = PHP_INT_MAX;$config_slowImportSleep = 0;
And then, slow import will work to all intents and purposes exactly like normal import...
Cheers,
David.
--
PriceTapestry.com