So we’ve put up store after store using the magento open source e-commerce platform. I’ve had magento 1.2.1.1 – 1.4.1.1 and none of them are worth a damn when you try to import products.
At this point I’m writing a new import process that will still handle all the EAV crap, and indexing etc… maybe even use the Mage structure, but it’s going to be faster.
For now here are a couple of things you can do to increase the import process.
1) Truncate all log files, doesn’t seem like it should be tied together but whatever.
2) Truncate table datatflow_batch_export and dataflow_batch_import
3) Truncate table report_event (this is the event log basically, so you will mostl likely have these in your var/reports folder also.
4) remove cache and session values from the system, locate in var/session/ and var/cache/
I’ll update when I’ve written some new code, it’s going to be for 1.3.2.4 and 1.4.1.1 so keep an eye out.