|
I could come up with a number of solutions written in C, which would be less file i/o intensive, than having a shell script splitting up a file.
Given that file i/o most likely will be the bottleneck here, you might considder a solution where the splitting of the file/spawning of threads, might be done in a different manner, at a slightly higher memory cost.
Now if you're working on a embeded system, where memory is sparse, then that might lead to a solution like this, but for any other implementation, I would turn to other solution patterns.
|