Search and sorts error logs based on a particular string

Question

1. How to search through all the errors.zip as well as from errors.log files filter by "Error" string and sort by date?

2. What about totals of errors?

requirement : here are 3 components are installed in my Linux server such as comp1,comp2 and comp3 . Each component has there own logs directory . Each logs directory contains below files Exception.log connection.log comp1.log as well as few *.zip files . I want to search them , order them based on date along with need to show the total number of error count.

error logs

2015-05-15 05:59:03,316 | 73002 | ERROR | JomaManagerThread RUNNING | Error clearing alarms to JOMA

Please let me know for additional information

Answer 1

Since you don't seem to need the filenames you can use -p to output the content of the zip files:

(for i in ./*.zip; do unzip -p "$i"; done; cat ./*.log) |
   grep -F ERROR | sort 

or if the files errors.zip are all over the place:

(find . -type f -name "*.zip" -exec unzip -p {} \;
 find . -type f -name "err*.log" -exec cat {} + ) |
   grep -F ERROR | sort

This does away with the zip file name and the particular content file name that unzip extracts, as well as the log file name. If you need that info I would write a python program for the task, that inserts the filename somewhere in each of the lines found (not before the date of course). You can use the standard zipfile module to process the contents of a zipfile without first extracting the files and have the program write to stdout for piping into sort