friends! I have a HUGE csv file and I need extract rows with headers where column called "data.status" equals "complete", then delete empty columns from it and write to another csv file. Can I achieve it with grep | sed | awk ? Thanks for answers!
EDIT 1. I create this csv from flattening about 60 000 json files and writing data from them to one csv. And I don't really know actual count of header and I can't even open it ( size of csv file about 1.5 Gb). But it has a lot of empty field and i want to delete them and make it more readable. As an example i have csv:
date.status, date.start, date.end, date.items
unsuccessful , 21-03-15, 25-03-15, some_item
complete,,,, item2
The output should looks like:
date.status, date.items
complete, item2
complete,21-03-15,,item3
in your input data: item2 has 2 non-empty fields, item3 has 3.