I have around 100 66 Gigabyte huge "log.txt" (log1.txt,log2.txt,log3.txt and so on) files which I need to search for different Strings.
I have all 42.000 strings in a text file.
Right now, I'm using grep (
grep -F -f strings.txt log.txt) but it takes around 50 minutes to search one log.txt.
Do you know a faster way to search all files? After searching all 100 Files, a new set of 100 files will be generated for searching.