are those 1 miilion files with the same format and need to load into one table? if so, have you considered to do some pre-processing? such as combine them to some adequaute number of bigger/huge files and then to load? 500kb is sort of too small.
↧