Tagged Questions
2
votes
5answers
57 views
Using sed to find and replace complex string (preferrably with regex)
I have a file with the following contents:
<username><![CDATA[name]]></username>
<password><![CDATA[password]]></password>
...
4
votes
3answers
128 views
Remove string from a particular field using awk/sed
I have a file (>80,000 lines) that looks likes this:
chr1 GTF2GFF chromosome 1 249213345 . . . ID=chr1;Name=chr1
chr1 GTF2GFF gene 11874 14408 . + . ...
1
vote
2answers
39 views
Trimming one part if equal to another part?
I use an e-mail quote attribution string like this:
On dd mmm yyyy hh:mm +hhmm, from info@example.org (Example Dot Org):
where info@example.org is the sender's e-mail address and Example Dot Org is ...
0
votes
1answer
30 views
Comment the if statement and the matching endif keyword
In vim, I can find the matching if statement and prepend the appropriate comment symbol. (e.g. %s/.alarm./#\0/g), but then I am left with dangling endifs that I have to find manually. I could simplify ...
4
votes
3answers
195 views
Delete XML node containing certain element
I want to remove all Placemarks from a KML file that contain the element <tessellate>. The following block should be wholly removed:
<Placemark>
...
1
vote
2answers
99 views
Regex and piped commands with sed
I'm finding really hard to use sed command, plus I can't seem to find well written tutorials.
Let me say that I worked with regular expression in other languages (Python, JavaScript, Java), so that ...
2
votes
3answers
181 views
awk, sed, grep, perl… which to print out in this case?
I have this syntax in a file (http response times from analog):
<thead><tr><th class="x">seconds</th><th class="R">reqs</th><th ...
2
votes
2answers
105 views
changing pattern by removing spaces?
file :
hi hello,new york, , ,brazil site ,brazil
january,month is feb , , ,indiana jones
task:
delete all horizontal space (spaces and tab) between any two comas (like , ,) if ...
4
votes
2answers
185 views
Why does this add spaces? echo “x ax” | sed 's/x\s*/x /'
I want to find a x, and replace the 0 or more following spaces (\s*) with just a single space.
echo "x ax" | sed 's/x\s*/x /'
For some reason, instead of replacing the spaces with the single space, ...
2
votes
2answers
322 views
extract last match from logfile till end
Using sed, grep, awk, or ruby, what's a simple way to find the last match of a string in a larger log file, and send every line following it (inclusive) to another file?
Example:
grep -A222 ...
1
vote
2answers
148 views
How can I find matches with sed (or similar) for configuration parameters?
I'm pretty good at using php's preg_match (and similar) commands, and I'm also pretty good with regular expressions, but I don't do very well with sed.
I have two shell scripts I'm working on and I'd ...
2
votes
2answers
443 views
Removing Color Codes From Output [duplicate]
Possible Duplicate:
Removing control chars (including console codes / colours) from script output
I'm working on a script to work alongside a program that I'm writing. What i'm trying to do ...
2
votes
1answer
960 views
sed special character replace not working in shell script
I want to write a script 'test.sh' that will take a user's input and replace all special characters with a '\' + the character. My script:
#!/bin/bash
echo 'input='"$1"
arg=`echo "$1" | sed ...
0
votes
1answer
262 views
Remove a block of lines between two patterns [duplicate]
Possible Duplicate:
Show only text between 2 matching pattern
In a bash script using sed how can I remove a block of lines beginning with -pattern a- and ending with -pattern b- where the ...
1
vote
4answers
346 views
Replace text between brackets
I'm using awk '{ gsub(/BAR|WIBBLE/, "FOO"); print }' to replace text in data like:
SOMETHING [BAR, WIBBLE]
SOMETHING [BAR]
This gives the desired result of:
SOMETHING [FOO, FOO]
SOMETHING [FOO]
...
2
votes
3answers
834 views
remove white space before delimiter with sed
I have data of the following format that I want to input into LibreOffice calc
data | num | num | num | num
For some reason Libreoffice does not think the string "3214 " is a number by ...
2
votes
4answers
350 views
Change currency format to generic number using sed
I am working on a large csv file with all coma separated entries. The entire document is composed of plain numbers, except for a few columns reflecting currencies that are formatted as text. For ...
2
votes
2answers
623 views
Replace the shortest match of a string pattern
I have this string:
update mytable set mycol=myvalue where mycol=yourvalue;
I need to convert it to:
insert into mytemp select * from mytable where mycol=youvalue;
I can accomplish it like this ...
2
votes
3answers
316 views
with sed, how can I replace word within a matching line?
I am trying to write a sed expression to detect lines similer to this:
s0:12345:respawn:/sbin/agetty -8 -s 115200 ttyS0 linux
and replace the "ttys0" with "something_else"
I do not want to detect ...
0
votes
5answers
2k views
(Mac Terminal) sed to parse JSON … what am I doing wrong?
In Mac Terminal, I'm trying to parse the "name" out of this JSON response:
{"created_at":"2012-08-27T20:04:27Z","deleted_at":null,"id":21462840,"item_type":"video","name":"CastingBy-v12
...
2
votes
2answers
253 views
Detect pattern repetition in a file
I want to make sure a file follows the following pattern:
... ... ... foo ... foo_KO ... ...
... bar ... ... ... ... bar_KO ...
The file is extremely long, so, in other words, I want to make sure ...
1
vote
3answers
967 views
sed pattern matching
I recently asked someone at work about how to take the output of ipcs -qa and make it space delimited, so I can parse it/store it in the database for monitoring. He gave me this:
ipcs -qa | sed 's/ [ ...
4
votes
1answer
157 views
substituting third occurrence of a pattern using sed
Here is a sed command. I want to substitute third occurrence of 00 to 11
echo "0000000000000000" | sed -e 's/00/11/3'
The output is:
0000110000000000
But I thought output would be:
...
2
votes
2answers
578 views
regex replace text in xml file within node from the command line
I have an XML file and I would like to replace everything that is between the open and closing tag within multiple instances of the g:gtin node with nothing.
Is this possible from the command line, ...
3
votes
2answers
83 views
What is the usage of pattern before substitute command in sed
There is an example in this link about sed:
To delete the first number on all lines that start with a "#" use:
sed '/^#/ s/[0-9][0-9]*//'
What is the benefit of first pattern(/^#/)? It could be ...
3
votes
1answer
613 views
Substituting the first occurrence of a pattern in a line, for all the lines in a file with sed
Is it possible to do it in one liner?
I have an output like this:
"First line" - Description
" Second line" - Description
"Third line" - Description
" Fourth line" - Description
This input ...
2
votes
2answers
729 views
Sed: replacing digits
I am trying to write some install scripts for when I install/upgrade Ubuntu. I'm having trouble with fixing logrotate.d:
/var/log/ufw.log
{
rotate 7
weekly
missingok
notifempty
compress
delaycompress
...
3
votes
5answers
318 views
changing pattern of a text file
A text file has contents something like
chair
table
pen
desk
Now i want it to be changed and stored in a variable say var as below
('chair','chair'),('table','table'),('pen','pen'),('desk','desk')
...
7
votes
4answers
4k views
How can I use sed to replace a multi-line string?
I've noticed that, if I add \n to a patter for a substitute using sed, it does not match. Example:
$ cat > alpha.txt
This is
a test
Please do not
be alarmed
$ sed -i'.original' 's/a test\nPlease ...
8
votes
6answers
778 views
Delete lines beginning with #
How do I delete lines beginning with a #, given that there can be whitespace on the left and right of the #?
# Master socket provides access to userdb information. It's typically
1
vote
1answer
427 views
reference problem in using sed
I'm trying to use sed command to find/replace a pattern in file.
It gives:
sed: -e expression #1, char 27: invalid reference \1 on `s' command's RHS
My command is:
sed ...
4
votes
2answers
1k views
How to search and replace multiple needles by one word via one expression?
Assume you have a text file:
foo fnord bar
bizz foo poit
And now I would want to replace both "foo" and "bar" into "narf".
I know I could use:
sed -e 's/foo/narf/g' -e 's/bar/narf/g' fileName
...
1
vote
2answers
285 views
pattern search and display the last occuring pattern?
I have a log file containing startup and shutdown times for everday.
I want to see the last pattern pattern for startup and shutdown(which is located at the end of the file being updated everyday).
...
1
vote
4answers
1k views
Replacing XML entity values with positive lookaround
I'm trying to do some pretty simple sedding of a file:
sed 's:(?<=<Type>)default(?=</Type>):super:' < myfile.xml
The concept's pretty simple, using positive lookaround, find the ...
5
votes
3answers
559 views
Regex & Sed/Perl: Match word that ISN'T preceded by another word
I'd like to use sed or perl to replace all occurrences of a word that doesn't have a certain word in front of it.
For example, I have a text file that contains a plot of a movie and I want to replace ...
3
votes
2answers
595 views
simple command to strip header and footer from a file
I want a simple little command to strip an XML-Header and Footer from a file:
<?xml version="1.0" encoding="UTF-8"?>
<conxml>
<MsgPain001>
...
6
votes
1answer
361 views
How do you save a complex regex for multiple reuse in sed?
In using sed, I often create rather complicated and intricate regexes that I need to match twice in a file. Is there a way for me to save this regex and just reference it twice?
Maybe something that ...
3
votes
3answers
168 views
What does . match?
In working with regular expressions, I have been told that a dot character . will match everything.
Except for newlines \n.
Are there any other exceptions? What about the NUL character \0, or the ...
4
votes
1answer
1k views
Substitute text with sed and keep part of the original text
I am trying to convert
<id>1</id>
<Name>ENTERPRISE RESOURCE PLANNING</Name>
to:
<column name="id">1</column>
<column name="Name">ENTERPRISE RESOURCE ...
4
votes
1answer
256 views
Are there zero-width assertions in sed?
Is it possible to make lookahead or lookbehind zero-width assertions in sed? I want to emulate Perl's (?=) and family.
My sed is not GNU sed version 4.0.
2
votes
1answer
141 views
sed one-liner to delete word-medial spaces
I have a text file that consists of some N ORMAL E NGLISH W ORDS in all-caps. Unfortunately, these words all have a space between the first and following letters, which is not acceptable. I tried ...
3
votes
2answers
4k views
sed one-liner to delete everything between a pair of brackets?
I am working with some text that is full of stuff between brackets [] that I don't want. Since I can delete the brackets myself, I don't need the one-liner to do that for me, but I do need a one-liner ...
6
votes
1answer
471 views
Why isn't sed greedy in this simple case?
$echo "foo 65 bar" | sed -n -e 's/.*\([0-9]\+\).*/\1/p'
5
Why is the output not 65? Shouldn't sed greedily match the [0-9]\+ part? How do I tell sed to match all of 65?
2
votes
2answers
482 views
sed, grep, or tr command that returns only Latin characters from a UTF-8 file
I am working with the text of the 300 tang poems, which unfortunately is a single file containing both Chinese and English. Since I am interested in 'extracting' the English, I hope to use sed, ...
6
votes
6answers
2k views
How can you combine all lines that end with a backslash character?
Using a common command line tool like sed or awk, is it possible to join all lines that end with a given character, like a backslash?
For example, given the file:
foo bar \
bash \
baz
dude \
happy
...
2
votes
3answers
273 views
sed one-liner to delete any line that begins with a digit
Pretend I am working with this file.
The beginning of the first visible line is obscured, so ignore that. 43 is the beginning of the next line, and that line would be deleted.
The next line (which ...
6
votes
3answers
698 views
Replacing Multiple blank lines with a single blank line in vim / sed
Question more or less says it all. I'm aware that /^$/d will remove all blank lines, but I can't see how to say 'replace two or more blank lines with a single blank line'
Any ideas?
3
votes
2answers
154 views
Why isn't this sed regex matching?
I've recently started learning sed. I did
$seq 10 | sed '/[^049]/d'
I was expecting
4
9
10
as output. But I got
4
9
Where am I making mistake in understanding this regex?
2
votes
3answers
502 views
Filtering paths to a specific depth
I'm using rsync and the flags -nPaAXz ~/ to check which files are going to be copied.
This is far too verbose to make any sense of.
How could I filter the output so I view the list of files/folders ...
3
votes
2answers
922 views
sed or tr one-liner to delete all numeric digits
So, I have this textfile, and it consists of mostly alphanumeric characters. It's a standard document. But since I copied it and pasted it from a PDF, there are page numbers in there. I don't much ...
