Still having issues trying to remove lines in a LARGE file containing strings listed in another LARGE file.
grep -vwFf file1 file2 - FAILS due to memory exhaustion.
I have used:
comm -23 file1 file2
It works for sorted files and really large files - but it only works for removing duplicate lines - not removing lines containing a string.
The two large files I have are sorted so that the strings I am searching for are at the begining of every line:
AAAAA blah blah blah AAAAB blas blas blas CCCCC sdf sf sdf