Concatenate filename inside of CSV file for each line for multiple CSV files

Question

I have lots of CSV files and I need the filename of each specific CSV file in every line of each file.

Original file content of abc123.csv:

ColVal_1;ColVal_2;ColVal_3
ColVal_4;ColVal_5;ColVal_6

New file content:

ColVal_1;ColVal_3;ColVal_3;abc123.csv
ColVal_4;ColVal_5;ColVal_6;abc123.csv

All CSV files are in the same directory. I don't want to specify the name of each file.

Answer 1

Its much more simple, easier and faster with sed and xargs. Here sed uses in-place editing thus avoiding additional shell tools.

$ ls file{1..5}.txt|xargs -I% sed -i 's/$/;%/' %

And here is the output.

$ cat file{1..5}.txt
ColVal_1;ColVal_2;ColVal_3;file1.txt
ColVal_4;ColVal_5;ColVal_6;file1.txt
ColVal_1;ColVal_2;ColVal_3;file2.txt
ColVal_4;ColVal_5;ColVal_6;file2.txt
ColVal_1;ColVal_2;ColVal_3;file3.txt
ColVal_4;ColVal_5;ColVal_6;file3.txt
ColVal_1;ColVal_2;ColVal_3;file4.txt
ColVal_4;ColVal_5;ColVal_6;file4.txt
ColVal_1;ColVal_2;ColVal_3;file5.txt
ColVal_4;ColVal_5;ColVal_6;file5.txt

Answer 2

Using sed you can do something like,

for f in *.csv
do
 sed -i 's/$/ '"$f"'/' "$f"
done

Testing

Inside one of the directories, I created couple of csv files.

cat csv1.csv

this
is
first
csv
file

##Second CSV file

cat csv2.csv

this
is
second
csv
file

Now, I executed the above command that I had mentioned. After the execution of the command, the files look like below.

cat csv1.csv

this csv1.csv
is csv1.csv
first csv1.csv
csv csv1.csv
file csv1.csv

##Second CSV file

cat csv2.csv

this csv2.csv
is csv2.csv
second csv2.csv
csv csv2.csv
file csv2.csv

If you want semicolons you can just add it in the sed command before appending the file name. Change the sed command like below.

 sed -i 's/$/ '";$f"'/' "$f"

References

http://www.unix.com/unix-for-dummies-questions-and-answers/150545-merge-files-add-file-name-end-each-line.html

Answer 3

How about:-

for i in *.csv; do awk '{print $0 ";" FILENAME }' $i > ${i}.tmp ; mv ${i}.tmp ${i} ; done

You could avoid the mv if you have a later version of awk but this is probably more portable.

Answer 4

With perl:

$ perl -i.bak -ple '$_ .= ";"$ARGV' file.csv 
ColVal_1;ColVal_2;ColVal_3;file.csv
ColVal_4;ColVal_5;ColVal_6;file.csv

From perldoc -v '$ARGV':

$ARGV   Contains the name of the current file when reading from "<>".

You can use *.csv to process all files in current directory. -i.bak option edit all files inplace and create backup files with name *.csv.bak.