I would like to split an input file on character count (ASCII is fine), combined with new lines as well. That is, every group of 10000 character should be seen as one record to be piped into the child process, but if that 10000th character does not happen to be at the end of line, the whole line should be included (and thus more that 10000 characters are provided). Each line should be considered as a single entity, which cannot be split.
Is that possible with GNU parallel (or possibly with a chain of other tools which might be useful)?
parallelto keep processing the chunks in parallel? Should I introduce an artificial boundary character to allow
parallelto split on?
split, I also think it should be
split -C 10k, and not
-b. Is that correct?