You are here:  » Import slowing down

Support Forum



Import slowing down

Submitted by daem0n on Thu, 2009-09-17 08:39 in

Hi David,

I know I bug you way too much but it's hard to replace your expertise ;)

I have a quick (hopefully) question for you. I've been automating my importing lately. At first it was taking about 30 mins to an hour...I'm not sure what it depended on but it varied a bit. This was for about 100,000 products from 25 feeds and almost 50 filters.

The strange thing is, it seems to be slowing down. Or at least that's what I think...or it's just going a lot slower than it used to be. Now it takes about 2.5 hours to import. This is using the @ALL parameter.

Does this seem normal to you or slow?

It's hard for me to tell because I'm only basing this off of my own results and thought you would have a better idea. I optimized the MySQL tables and it didn't seem to help. Is there anything else I can check?

Thanks a lot, -Joe

Submitted by support on Thu, 2009-09-17 08:44

That's understandable for 100K+ products.

If you're not on a dedicated server it is possible that your host identified the import process as relatively processor intensive and lowered it's "NICE" level (the priority that a server gives to a task) so as not to impact other processes running on the same server...

Cheers,
David.

Submitted by daem0n on Thu, 2009-09-17 08:56

I am on a dedicated server but it's possible that the system automatically maintains a level for the process to run at. I am allowed to alter the nice level so maybe I'll try some lower levels and see if it goes any faster. Thanks for the reply! I'll keep an eye on it :)