Need help on shell script, I have 2 large files around 1.2 GB data, with key and values, I need to compare both files based on the key and store difference in the value in the third file and the unique one in file 1,
test1 marco;polo;angus test2 mike;zen;liza test3 tom;harry;alan test4 bob;june;janet
test1 polo;angus test2 mike test4 bob;janet
I would like to compare the first two columns of file1 with file2 (search through the entire contents of file2 in first two columns) if they match print the difference of values. Then search for the second line of file 1 and so on. Also keys unique in file 1 should be printed.
test1 marco test2 zen;liza test3 tom;harry;alan test4 june
The files I have are huge, containing about 100,000 lines, so I would like to make the execution fast.
This is running in shell script, using
1332239_44557576_CONTI Lased & Micro kjd $353.50_30062020_lsdf3_no-rule 343323H;343434311H;454656556H;343343432H
It is simple Text file, with this as key (
1332239_44557576_CONTI Lased & Micro kjd $353.50_30062020_lsdf3_no-rule) and these as values : (
File 2 will always be a subset of file 1, just need to find values(against key) which are not present in file 2 and unique ones in File 1.