5,729 reputation
1138
bio website toggle.be/~ta
location Denmark
age 37
visits member for 2 years, 3 months
seen Jul 6 at 22:24

I'm trained in computer science engineering, but have a wide range of other interests as well.


Aug
25
awarded  Nice Answer
Aug
24
answered Get a list of directory names with find
Aug
24
reviewed Looks OK Incrementally backup FTP to local computer
Aug
24
comment How to merge chunks of text files in a directory to one or more files?
Just stick it in after the cat. To your second question, that depends on what you're trying to do, I think you should type it up as a new question, giving a good description of what you're trying to do.
Aug
23
revised Extracting lines by key from very large file
Removed inefficient example, and added some caution about the grep option
Aug
23
comment Extracting lines by key from very large file
Thank you for testing, I'll remove the piped option as it seems impractical inefficient.
Aug
23
revised How to merge chunks of text files in a directory to one or more files?
zip needs to be backgrounded if all the commands are running in the same terminal
Aug
23
comment How to merge chunks of text files in a directory to one or more files?
Fixed a bug in the named pipe usage.
Aug
23
revised How to merge chunks of text files in a directory to one or more files?
Bugfixed named pipe usage
Aug
23
comment Extracting lines by key from very large file
Could it be the second sed being very slow? Could you try with: ... | sed 's/^/NR==/' | awk -f - textfile at the end of the pipe.
Aug
23
answered reading entries from multiple files
Aug
23
revised How to merge chunks of text files in a directory to one or more files?
Cleaned up, and clearly separated the two examples
Aug
23
comment How to merge chunks of text files in a directory to one or more files?
Ah I thought that was what you wanted to do, I'll add an update with concatenation and zipping.
Aug
23
comment Extracting lines by key from very large file
Matching only on the key column should solve these issues. I've updated the answer.
Aug
23
revised Extracting lines by key from very large file
added 714 characters in body
Aug
23
comment How to merge chunks of text files in a directory to one or more files?
I would recommend sticking with the zip fname -@ which will add filenames on stdin to fname.zip. I added some better zip filename generation to the answer. Also see here for a similar question.
Aug
23
revised How to merge chunks of text files in a directory to one or more files?
Better filename generation
Aug
22
answered How to create multiple zips from a directory containing a million xml files?
Aug
22
answered Extracting lines by key from very large file
Aug
22
comment add directory to shell profile
PATH needs to be protected from parameter expansion, you can do this with curly braces, see update to answer.