I have a large file that I need to split into workable pieces. (350 million records) The key is the second column value cannot overflow into the next file.
Reading and writing take way to long, split command does not work. anything else I can do?
example file with 10 records to be split into 3 output files:
aa,22,xxx
aa,22,xxx
aa,22,xxx
aa,22,xxx
aa,22,xxx
aa,23,xxx
aa,23,xxx
aa,23,xxx
aa,23,xxx
aa,24,xxx
output1:
aa,22,xxx
aa,22,xxx
aa,22,xxx
aa,22,xxx
aa,22,xxx
output2:
aa,23,xxx
aa,23,xxx
aa,23,xxx
aa,23,xxx
output3:
aa,24,xxx