right now I am having about 7000 tables for individual stock and I use perl to do inserts, it's very slow. I would like to use copy or other bulk loading tool to load the daily raw gz data. but I need the split the file to per stock files first before I do bulk loading. I consider this a bit messy.
Are you committing each insert separately or doing them in batches using 'begin transaction' and 'commit'?
I have a database that I do inserts in from a text file. Doing a commit every 1000 transactions cut the time by over 90%. -- Mike Nolan
