Take the 2-minute tour ×
Unix & Linux Stack Exchange is a question and answer site for users of Linux, FreeBSD and other Un*x-like operating systems.. It's 100% free, no registration required.

This question already has an answer here:

I have 1000 csv files in a directory. I would like to concatenate them all together in order. They are named img_size_1.csv to approx img_size_1000.csv This answer is close but assumes a list file. Can this be done in a one-liner?

share|improve this question

marked as duplicate by terdon, slm, Anthon, Zelda, jasonwryan Feb 5 at 19:07

This question has been asked before and already has an answer. If those answers do not fully address your question, please ask a new question.

1  
I'm voting to close this as a dupe of the linked question. This is exactly the same issue, the OP just did not know how to use globbing/wildcards. –  terdon Feb 5 at 17:53
    
With zsh: < *.csv(n) > all.csv (n for numeric sort) –  Stéphane Chazelas Feb 5 at 20:13

2 Answers 2

Yes it can, with the unimaginatively named cat command:

$ cat *csv > all.csv

cat does what it says on the bottle, it conCATenates its input and prints to standard output. The command above will give an error if a file called all.csv already exists in the target directory:

$ cat *csv > all.csv
cat: all.csv: input file is output file

You can safely ignore that error, the contents of all.csv will be overwritten.

share|improve this answer
    
If the command is carried out more that once (so all.csv will exist), one may not wish to concatenate all.csv with the other .csv files. rm all.csv first? –  suspectus Feb 5 at 17:58
    
@terdon, thanks. Is there any way to affect the order in which the files are added to be sure that they will be processed in numeric order? Or by date? –  codecowboy Feb 5 at 18:02
    
@suspectus no, that is not needed. The > all.csv will truncate all.csv (empty it) before anything else is run (shell comands are run right-to-left). Therefore, all.csv will always be empty and you will not get the repetition you are thinking of. –  terdon Feb 5 at 18:02
    
@codecowboy by default, the glob (the *csv) is expanded in alphanumeric order so it should do that already. If not, please edit your question to explain exactly what your file names look like. Do you have both file_N.csv and fileN.csv? –  terdon Feb 5 at 18:04
1  
interestingly on OS X bash 3.2 the destination file is not overwritten first. If all.csv exists then do cat *.csv > all.csv the operation does not return and continues to add to all.csv until out of disk space. –  suspectus Feb 5 at 18:22
ls -1 *.csv | while read fn ; do cat "$fn" >> output.csv.file; done

If you want to concatenate them by alphabetic order :

ls -1 *.csv | sort | while read fn ; do cat "$fn" >> output.csv.file; done

If you want to concatenate them by time creation order :

ls -1t *.csv | while read fn ; do cat "$fn" >> output.csv.file; done
share|improve this answer
    
I fixed the quoting and format issues but this will break on files whose names contain newlines or backslashes and it will re-concatenate everything into the output file every time it is run, so you should make sure that output.csv does not exist before running it. Oh, and the sort in undeeded, ls with no options will already sort files alphabetically. –  terdon Feb 5 at 18:36
    
Thanks ! The sort just prevent any ls aliasing. –  Slyx Feb 5 at 22:01

Not the answer you're looking for? Browse other questions tagged or ask your own question.