Unix & Linux Stack Exchange is a question and answer site for users of Linux, FreeBSD and other Un*x-like operating systems. It's 100% free, no registration required.

Sign up
Here's how it works:
  1. Anybody can ask a question
  2. Anybody can answer
  3. The best answers are voted up and rise to the top







Current awk script:

awk 'BEGIN{OFS=FS="|"} NR==FNR{a[$3]=$3;next}!($3 in a)' file1 file2

This does comparison based on array content. How to compare line by line and printing only that results.

share|improve this question
up vote 5 down vote accepted

If I understand you correctly, you want to print a line from file2 if the 3rd field is different to the corresponding entry in file1. If so, this should do it:

awk 'BEGIN{FS="|"} NR==FNR{a[$1,$2]=$3;next}(a[$1,$2]!=$3)' file1  file2

Yours wasn't working because you were taking $3 as the key for array a and $3 is not unique (both equator and globe are present in both files).

I agree with @drewbenn that both grep and join are simpler for this particular case, but here's a Perl way of doing the same thing:

perl -laF'\|' -ne '($k{$F[0].",".$F[1]}||=$F[2]) eq $F[2]||print;' file1  file2
share|improve this answer
You should use a[$1,$2] in case you get unfortunately similar fields like a|bc|d and ab|c|e – glenn jackman Sep 23 '13 at 13:00
@glennjackman good point, answer edited. – terdon Sep 23 '13 at 13:16

I think you want to use join (or grep -f) instead. But if you must use awk:

echo | awk '{system("join -v 2 file1 file2")}'

which is just an awk front-end to join -v 2 file1 file2. Similarly, of course, you can use grep -v -f file1 file2.

share|improve this answer
join is the tool for the job, but your awk solution is cheating. – jordanm Sep 23 '13 at 11:20

comm is the real tool for this job:

comm -13 file1 file2

If the input files are not already sorted:

comm -13 <(sort file1) <(sort file2)
share|improve this answer

Your Answer


By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.