Tagged Questions
5
votes
1answer
128 views
How to remove all instances of a particular symbol from a text file?
I've got a huge (about half a GiB, impossible to use a usual text editor on) CSV file with fields enclosed in double quotes like "abc","def" but need a file without quotes (I am sure this is not going ...
6
votes
2answers
187 views
How to replace all percent-encoded UTF-8 substrings with plain UTF-8 text?
I've got a html file with a lot of %-encoded UTF-8 text in URLs.
For example "%D1%80%D0%B5%D1%81%D1%83%D1%80%D1%81%D1%8B" stands for "ресурсы" ("resources" in Russian).
The task is to replace all ...
4
votes
4answers
248 views
Look for English word in a file via terminal
How to find and print out English words contained in a file via linux command line?
Thanks
3
votes
2answers
988 views
AWK-Find maximum value in a row & print with header
I need to read a file, find the maximum value in each row, and print the ID of the row, the column the maximum value came from (sno#), and the value from the associated lc# column. If the maximum ...
3
votes
2answers
286 views
How to skip file in sed if it contains regex?
I currently use the following simplified command to remove trailing whitespace and add a newline at end of file where needed:
find . -type f -exec sed -i -e 's/[ \t]\+\(\r\?\)$/\1/;$a\' {} \+
As ...
30
votes
3answers
9k views
How to remove duplicate lines inside a text file?
A huge (up to 2 GiB) text file of mine contains about 100 exact duplicates of every line in it (useless in my case, as the file is a CSV-like data table).
What I need is to remove all the repetitions ...
9
votes
2answers
1k views
How can I find out how many lines a text file contains without viewing it?
How can I find how many lines a text file contains without opening the file in an editor or a viewer application? Is there a handy Unix console command to see the number?
