Sed is a command-line stream editor for filtering and transforming text.
5
votes
3answers
751 views
How can I instruct BSD sed to interpret escape sequences like \n and \t?
I have a sed replacement command that I would like to be compatible with BSD sed as well as GNU sed. Extended regular expressions are not an issue as I do not need them in this case. My primary ...
4
votes
2answers
3k views
Compare two file columns
I have long text files with space-delimited fields:
cat file1.txt
Id leng sal mon
25671 34343 56565 5565
44888 56565 45554 6868
23343 23423 26226 6224
77765 88688 87464 6848
66776 23343 63463 ...
2
votes
2answers
249 views
remove only specific text occurrences from string using sed
I have a text file that contains many rows of this sort of thing:
/*[17:51:27][1 ms]*/ UPDATE `country` SET `region_id` = '4' WHERE `country_id` = '36';
Is there a way that I can use sed to remove ...
3
votes
2answers
256 views
Parsing a text-file table and aggregating information
I have long text file with the following columns, space-delimited:
Id Pos Ref Var Cn SF:R1 SR He Ho NC
cm|371443199 22 G A R Pass:8 0 1 0 0
...
2
votes
1answer
189 views
Duplicate selected words with sed and replace it
I have to modify a document containing xml data; one modification I couldn't set up with sed.
I have to modify the following expressions from:
<Bild ...
4
votes
2answers
604 views
delete first line of file only if blank using sed
I have a solution for this in awk:
awk '{if (NR==1 && NF==0) next};1' somefile
but was unable to find one that worked in sed. E.g.,
sed -i.bak '/^$/{1,1d;}' somefile
ended up deleting ...
8
votes
3answers
742 views
How to sort the string which combined with string + numeric using bash script?
This is the data what I want to sort. But sort treats the numeric to string, the data it no sorted as I expected.
/home/files/profile1
/home/files/profile10
/home/files/profile11
...
3
votes
6answers
835 views
Text file look-up by column
I have a file in this format:
[#] OWNER_NAME NAME SIZE
[6] Robottinosino Software 200
[42] Robottinosino Ideas worth zero 188
[12] ...
3
votes
2answers
223 views
Change string occurrences in file while respecting DOS new line sequences
I use Visual Studio for my C# development while using Cygwin for some of the tasks that require scripting. Recently I wanted to change all occurrences of string AAA to BBB in my project's files. I ...
5
votes
5answers
358 views
resolve all ip addresses in command output using standard command line tools
I have several log files that contain a bunch of ip addresses. I would love to be able to pipe the data through a program that would match and resolve ip addresses.
I.E.
cat /var/log/somelogfile | ...
2
votes
4answers
399 views
shorten long lines in a log file
I keep a logfile of a program's output. The trouble is sometimes errors occur dumping very long lines of 7bit ascii data(encoded binary) I don't care to keep. These lines can be 200KB+ long before ...
1
vote
2answers
181 views
How to split vCards lines
Related to How to join vCards lines, vCard does a weird kind of line splitting: If a line contains more than 75 characters, insert a "CR, LF, space" sequence. Thus the following line:
...
-6
votes
1answer
171 views
sed and awk challenge [closed]
Here is a great challenge for someone to attack!
Is there a way to achieve the following using sed and/or awk. Please see myfile.txt below:
$cat myfile.txt:
entry
"entry-header"
entry-top
name
...
3
votes
4answers
468 views
Strip spaces after single capital letters with sed
I am writing a bash script to automatically generate some other files, and I have to format some strings a certain way. Specifically, the last problem I'm having is formatting a string that has ...
2
votes
3answers
637 views
Grepping several lines from Nmap output
I apologize in advance as this is a simple question.
So I'm attempting to scan a Class C to identify all mail servers by IP. The vast majority of IPs aren't mail servers. I'm trying to filter out the ...
2
votes
1answer
128 views
sed not working from sh file, but working from the command line
sed works from the command line, but does not work if put it in an sh file and execute it. I want to change a number in an existing file and direct it to a new file, so I tried this:
echo enter ...
2
votes
1answer
184 views
Replace “<?php print t('Blabla'); ?>” to be “Blabla”
Lets say in file.php, there is lots of php print text: <?php print t('Blabla'); ?>, <?php print t('Text Here'); ?>, etc.
What I need is to remove <?php print t(' and '); ?> of the ...
8
votes
2answers
2k views
How to replace a string with a string containing slash with sed?
i am looking for a way to replace a string in a file with a string that contains a slash by using sed.
connect="192.168.100.61/foo"
srcText="foo.bar=XPLACEHOLDERX"
echo $srcText | sed ...
4
votes
3answers
952 views
How can sed output be formatted like printf's formatted printing?
Can sed replace text with a string formatted like printf's formatted printing?
The following sed command replaces a line starting with the current value of "$domain" with several values specified in ...
2
votes
2answers
154 views
How do I ad an if statement (regarding punctuation in a word) to this bash script
I have this bash script
#!/bin/bash
cat $@ | while read line
do
for word in $line
do
echo $word | circling-the-square
# here's where i need to add the if statement:
...
1
vote
2answers
98 views
How to parse fields out of a text file and write them to another file
I have executed a database command and have generated an output file of the results.
Each field name starts with dbt_xxxxxx
Each field value is the value after the equal sign.
how can I parse the file ...
4
votes
3answers
236 views
How to parse a file to extract 3 digits numbers kept in a “group number”
I am a beginner, and trying to write a shell script to parse a text file that is extracted from a standardization pdf file. I would like for each test group (identified by Group 0, Group 1... to get ...
2
votes
2answers
250 views
Detect pattern repetition in a file
I want to make sure a file follows the following pattern:
... ... ... foo ... foo_KO ... ...
... bar ... ... ... ... bar_KO ...
The file is extremely long, so, in other words, I want to make sure ...
8
votes
4answers
2k views
Remove files older than 5 days in UNIX (date in file name, not timestamp)
I want to delete log files which are older than 5 days from a directory. But deletion should not be based on the timestamp of file. It should be based on the name of file. For Example todays date is ...
4
votes
2answers
198 views
Append line to many files
I want to add some text to over 200,000 files
I am trying this
find . -name *.txt -print | xargs -I % echo "hello world" >> %
But nothing is happening. When i run find . -name *.txt it work ...
5
votes
3answers
2k views
How to sed only that lines that contains given string?
INPUT:
Select ASDF 325 sdfg sdflk lk
Select TRG 46sdg rasdftz fsgs 45
Select ASDF 6ffg sdfg 4456 sdrg
OUTPUT:
Select ASDF 325 XXXX sdflk lk
Select TRG 46sdg rasdftz fsgs 45
Select ASDF 6ffg XXXX ...
1
vote
3answers
906 views
sed pattern matching
I recently asked someone at work about how to take the output of ipcs -qa and make it space delimited, so I can parse it/store it in the database for monitoring. He gave me this:
ipcs -qa | sed 's/ [ ...
1
vote
1answer
75 views
What happens for the last line when using N command with sed
Here is my sed command:
echo -e "AB\nCD\nEF\nGH" | sed 'N; D;'
It prints:
GH
while sed processing input line by line, what happens with the last line? (When after that sed saw End-Of-File)? I ...
4
votes
1answer
153 views
substituting third occurrence of a pattern using sed
Here is a sed command. I want to substitute third occurrence of 00 to 11
echo "0000000000000000" | sed -e 's/00/11/3'
The output is:
0000110000000000
But I thought output would be:
...
2
votes
2answers
526 views
regex replace text in xml file within node from the command line
I have an XML file and I would like to replace everything that is between the open and closing tag within multiple instances of the g:gtin node with nothing.
Is this possible from the command line, ...
19
votes
9answers
2k views
Addition with 'sed'
I am trying to perform a mathematical operation with sed, but it continues to treat my variables as strings. The input is of this kind:
$ echo 12 | sed 's/[0-9]*/&+3/'
$ 12+3
I'd like to have ...
2
votes
1answer
170 views
Is it a good idea to supplement shell script with perl purely for use of regex?
I'm looking for a simple way to utilize regex in a UNIX shell script where not every system will have perl extensions built into grep. What is really helpful about perl regex here is back/forward ...
4
votes
1answer
2k views
find & sed (search and replace)
I'm using the following command on my mac:
$find . -name “*.java” -exec sed -i ’s/foo/bar/g’ {} \;
and it seems to have no effect.
I have two files in the directory that end in .java, which both ...
5
votes
2answers
1k views
Is there a way to detect null bytes (␀, NUL, \0) in sed?
Related to another question, in order to fuzzily detect binary files, is there a way to detect ␀ bytes in sed?
3
votes
2answers
83 views
What is the usage of pattern before substitute command in sed
There is an example in this link about sed:
To delete the first number on all lines that start with a "#" use:
sed '/^#/ s/[0-9][0-9]*//'
What is the benefit of first pattern(/^#/)? It could be ...
9
votes
3answers
777 views
Substituting strings in a very large file
I have a very long series of urls with no separating character, in the same format as below:
http://example.comhttp://example.nethttp://example.orghttp://etc...
I want each URL to be on a new line. ...
3
votes
2answers
287 views
How to skip file in sed if it contains regex?
I currently use the following simplified command to remove trailing whitespace and add a newline at end of file where needed:
find . -type f -exec sed -i -e 's/[ \t]\+\(\r\?\)$/\1/;$a\' {} \+
As ...
1
vote
2answers
129 views
sed substitution matches too many inputs
This is my command:
echo "Test" | sed -f <(sed -e 's/.*/s,&,gI/' mydic)
The file mydic contains 2 columns delimited by commas (,)
a,AlphabetA
.
.
.
e,AlphabetE
.
.
...
3
votes
1answer
547 views
Substituting the first occurrence of a pattern in a line, for all the lines in a file with sed
Is it possible to do it in one liner?
I have an output like this:
"First line" - Description
" Second line" - Description
"Third line" - Description
" Fourth line" - Description
This input ...
0
votes
2answers
236 views
Removing a long string from php files - using grep and sed?
I have encountered some malware on my Linux server, and am trying to remove it from many php files.
I've tried endlessly with grep | sed and grep | tr and couldn't even erase a simple text string, ...
2
votes
1answer
523 views
Variable substitution into a sed script
After running this code
#!/bin/bash
rm -f myfile myfile-individual
echo "Greetings, foobar!" > myfile
MYSTRING="Jack"
cat myfile | sed 's:foobar:$MYSTRING:' > myfile-individual
we end up with ...
2
votes
2answers
333 views
Search and replace with sed
Last week I accidently externalized all my strings of my eclipse project. I need to revert this and my only hope is sed. I tried to create scripts but failed pathetically because I'm new with sed and ...
1
vote
2answers
272 views
How can I delete lines that has an empty first column?
INPUT:
CC2352345|m,safnlasndfmnyxdcvyxcvyxcv |klasjdf |3|lasdjflasdf| |2345567356
CC3543353|asdfasdffghntz |klasjdf |3|lsajdfl | ...
4
votes
2answers
373 views
Why does this awk command not play as well with find as sed does?
I am very much a newbie at Unix/Linux command line stuff, and mostly get to where I'm going by copying, pasting, and modifying code I find on the internet. Just mentioning that in hopes people will ...
2
votes
1answer
862 views
Swap two columns in a CSV using SED
I have a CSV file that contains 10 different fields (, is the deliminator). Example data:
student-id,last,first,hwk1,hwk2,hwk3,exam1,hwk4,hwk5,exam2
pts-avail,,,100,150,100,200,150,100,300
...
1
vote
1answer
672 views
Use AWK add new line if match exists
I have a file with the following format:
aaa@ bbb
bbb@ ccc& ddddd@ aaaf
ccc@ ddd& eee: abcd& dassda
The output should be:
aaaa@ bbb
bbb@ ccc&
ddddd@ aaaf
ccc@ ddd&
eee@ ...
3
votes
4answers
369 views
Replace whole line in a file from command-line
I have a text file which has some contents similar to this:
# General information about the project.
project = u'Py6S'
copyright = u'2012, Robin Wilson'
# The version info for the project you're ...
3
votes
3answers
2k views
How to insert a line into text document right before line containing some text in bash?
I have a variable say $strToInsert I have a file file.html I wonder how to find last appearence of </head> and insert a new line before line with it and fill it with $strToInsert contents?
...
1
vote
6answers
264 views
Print word that doesn't contain character
My file is in the following format:
this!,is!,another!,test,yes!
this!,is!,another!,column,yes!
no,not!,another!,column
My output should be:
test
column
no
It shouldn't contain the '!' ...
3
votes
2answers
473 views
simple script rotating table
I'm trying to write a simple script, that just rotates csv table.
I mean I have some file:
head1;head2;head3
field11;field12;field13
and so on.
All I want, just to make my file
...
