Sed is a command-line stream editor for filtering and transforming text.
5
votes
1answer
132 views
Confusion about sed and '>'
The following command works fine:
sed s/input/raw_input/ p.py >p2.py && mv p2.py p.py
However, the following command turns p.py into an empty file:
sed s/input/raw_input/ p.py >p.py
...
5
votes
2answers
230 views
How would I sort these directory names numerically?
I'm aware that I can somehow sort this output numerically (so cpu1/ follows cpu0/) ... I could probably get something to work eventually by splitting up the string various ways with awk, but is there ...
5
votes
1answer
828 views
Replacing multiple lines in sed or awk
I'm trying to use sed or awk to replace 5 lines in a smb file but I just don't have any idea how to deal with the newlines.
5
votes
3answers
379 views
How to embed a shell command into a sed expression?
I have a text file with the following format:
keyword value
keyword value
...
Where keyword is a single word and value is everything else until the end of line. I want to read the file from a shell ...
5
votes
3answers
303 views
Gedit or an other non-commandline editor with the ability to spell-check two languages at the same time
I'm searching for an editor with the ability to spell-check two languages at the same time (German and English). Gedit can't do it out of the box.
But I want to use Gedit. It should be possible by ...
5
votes
2answers
1k views
Is there a way to detect null bytes (␀, NUL, \0) in sed?
Related to another question, in order to fuzzily detect binary files, is there a way to detect ␀ bytes in sed?
5
votes
1answer
1k views
Differences between sed on Mac OSX and other “standard” sed?
I am having some issues in using an answer provided on this site for this question about a sed command to replace a blank line with two other lines of content, and it was brought up if the sed command ...
5
votes
1answer
3k views
Extracting a regex matched with 'sed' without printing the surrounding characters
To all the 'sed' doctors out there:
I have a seemingly trivial 'sed' question to which I have not been able to find
a solution.
How can you get 'sed' to exctract a regular expression it has matched ...
5
votes
2answers
267 views
Which sed version is not GNU sed 4.0?
I'm trying to figure out which version of sed that I've got on BusyBox 1.18.3. The --version output is cryptic.
$ sed --version
This is not GNU sed version 4.0
The following code is from the ...
5
votes
1answer
5k views
Return only the portion of a line after a matching pattern
So pulling open a file with cat and then using grep to get matching lines only gets me so far when I am working with the particular log set that I am dealing with. It need a way to match lines to a ...
5
votes
3answers
532 views
Regex & Sed/Perl: Match word that ISN'T preceded by another word
I'd like to use sed or perl to replace all occurrences of a word that doesn't have a certain word in front of it.
For example, I have a text file that contains a plot of a movie and I want to replace ...
5
votes
3answers
836 views
Sed to reverse two words
echo "AXIS2C_HOME=/usr/local/Axis2C" | sed 's/\(^AXIS2C_HOME=\) \(.*\)/ \2 \1/'
The output I am expecting is /usr/local/Axis2C AXIS2C_HOME=.
I can't figure out what I am doing wrong. :(
5
votes
3answers
750 views
How can I instruct BSD sed to interpret escape sequences like \n and \t?
I have a sed replacement command that I would like to be compatible with BSD sed as well as GNU sed. Extended regular expressions are not an issue as I do not need them in this case. My primary ...
5
votes
1answer
197 views
Is there an option to make sed fail if pattern not found?
I need to find and replace some patterns in some files, but I need it to return 1 or something if a pattern is not found.
Can I do this with sed alone or do I need to check whether the pattern exists ...
5
votes
1answer
390 views
Sed not working as intended
I would like to use this script with the intention of replacing all instances of the letter Q within a file with the contents of the file "question.txt". Instead what happens is that all the instances ...
4
votes
4answers
5k views
SED: insert something to the last line?
The command inserts a tag to the beginning of a file:
sed -i "1s/^/<?php /" file
How can I insert something to the end of each file with SED?
4
votes
3answers
308 views
Why does sed act differently depending on the output file?
If I run:
cat messages.txt | sed -e 's/a/a/g' > messages.txt
on one large file (2500+ lines) I find that the resulting file will only have about 900 lines after the command in cygwin and will ...
4
votes
5answers
173 views
Sed: extending a string of numbers to a certain number of digits by padding with zeros
I'm currently trying to modify an echoed string of alphanumeric characters by piping it to sed. The area I'm interested in modifying is a block of numbers, which I would like to make 8 characters long ...
4
votes
3answers
419 views
How do I delete all lines with “.png” in a file?
I've a list of urls of which some point to images:
http://s.thebrighttag.com/iframe?c=A5lqOqP
...
4
votes
4answers
111 views
sed how to substitute when string has “http://” in it?
I have a file xx that has the following contents:
@base_url = "http://dmstaffing-stage.herokuapp.com/"
I want to use sed to eliminate this line (replace with nothing). I have used this sed ...
4
votes
4answers
103 views
How to remove character and space from a string
Hello I have one file with output
Name : ABC
Name : CDE
Name : ZYS
I want to get the result
ABC
CDE
ZYS
How can i get it through SED command.
I have tried. sed s/'Name' but ...
4
votes
2answers
2k views
Compare two file columns
I have long text files with space-delimited fields:
cat file1.txt
Id leng sal mon
25671 34343 56565 5565
44888 56565 45554 6868
23343 23423 26226 6224
77765 88688 87464 6848
66776 23343 63463 ...
4
votes
2answers
197 views
Append line to many files
I want to add some text to over 200,000 files
I am trying this
find . -name *.txt -print | xargs -I % echo "hello world" >> %
But nothing is happening. When i run find . -name *.txt it work ...
4
votes
3answers
2k views
Adding a line of text to multiple files
So, I have a bunch of files in a directory, and I need to insert a line of text into each of them. They have essentially the following format:
<VirtualHost *:80>
ServerAdmin ...
4
votes
2answers
169 views
Why does this add spaces? echo “x ax” | sed 's/x\s*/x /'
I want to find a x, and replace the 0 or more following spaces (\s*) with just a single space.
echo "x ax" | sed 's/x\s*/x /'
For some reason, instead of replacing the spaces with the single space, ...
4
votes
5answers
9k views
Multiline pattern match using sed, awk or grep
Is it possible to do a multiline pattern match using sed, awk or grep? Take for example, I would like to get all the lines between { and }
So it should be able to match
1. {}
2. {.....}
3. ...
4
votes
3answers
144 views
Delete XML node containing certain element
I want to remove all Placemarks from a KML file that contain the element <tessellate>. The following block should be wholly removed:
<Placemark>
...
4
votes
3answers
226 views
sed convert 4 spaces to 2
How does one convert 4 spaces into 2 spaces with sed? Is it possible?
I found this but it converts tab to spaces:
sed -r ':f; s|^(\t*)\s{4}|\1\t|g; t f' file
4
votes
2answers
961 views
How to search and replace multiple needles by one word via one expression?
Assume you have a text file:
foo fnord bar
bizz foo poit
And now I would want to replace both "foo" and "bar" into "narf".
I know I could use:
sed -e 's/foo/narf/g' -e 's/bar/narf/g' fileName
...
4
votes
3answers
80 views
Why is sed giving me an error about an unterminated `s'?
I have a set of sed replacements in a bash script and am getting an error about an unterminated `s' command. Here's what the sed line looks like:
sed -n -e "s/TMPFOO1/$FOO1/" -e "s/TMPFOO2/$FOO2/" ...
4
votes
1answer
440 views
How is this sed command working?
I want to understand, how following sed command is working:
sed -nre "/jar$/ { x; d; }; /class$/ { x; p; }
Actually it is part of another command to find a particular class file from the given list ...
4
votes
4answers
1k views
Concatenate lines by first column (AWK or SED)
How can I use AWK in the following situation?
I want to concatenate lines that start with the same column. Only the first column is kept after the join (in this case aaa, www, hhh).
The file may be ...
4
votes
3answers
949 views
How can sed output be formatted like printf's formatted printing?
Can sed replace text with a string formatted like printf's formatted printing?
The following sed command replaces a line starting with the current value of "$domain" with several values specified in ...
4
votes
2answers
373 views
Why does this awk command not play as well with find as sed does?
I am very much a newbie at Unix/Linux command line stuff, and mostly get to where I'm going by copying, pasting, and modifying code I find on the internet. Just mentioning that in hopes people will ...
4
votes
6answers
2k views
How can I convert tab delimited data to comma delimited data?
I'm requesting a list of ec2 snapshots via amazon's ec2 command line tool:
ec2-describe-snapshots -H --hide-tags > snapshots.csv
The data looks something like this:
SnapshotId VolumeId ...
4
votes
4answers
529 views
How to echo an escaped string
How can I echo an escaped string that contains $ in Bourne Shell?
user@server:~$ cat test.sh
#!/bin/sh
echo $1
user@server:~$ ./test.sh \$sad\$test
$sad$test
I want it to return an escaped ...
4
votes
1answer
2k views
find & sed (search and replace)
I'm using the following command on my mac:
$find . -name “*.java” -exec sed -i ’s/foo/bar/g’ {} \;
and it seems to have no effect.
I have two files in the directory that end in .java, which both ...
4
votes
1answer
1k views
Substitute text with sed and keep part of the original text
I am trying to convert
<id>1</id>
<Name>ENTERPRISE RESOURCE PLANNING</Name>
to:
<column name="id">1</column>
<column name="Name">ENTERPRISE RESOURCE ...
4
votes
3answers
2k views
How do I grep without leading whitespaces?
I'm greping through a large codebase, and leading whitespaces and tabulation seem to be quite annoying. Is there any way to get rid of it?
grep -R "something" ./
E.g, instead of:
foo/bar.cpp: ...
4
votes
3answers
101 views
Remove string from a particular field using awk/sed
I have a file (>80,000 lines) that looks likes this:
chr1 GTF2GFF chromosome 1 249213345 . . . ID=chr1;Name=chr1
chr1 GTF2GFF gene 11874 14408 . + . ...
4
votes
4answers
777 views
Text between two tags
I wanna retrieve whatever is between these two tags – <tr> </tr> – from an html doc.
Now I don't have any specific html requirements that would warrant for an html parser. I just plain ...
4
votes
2answers
603 views
delete first line of file only if blank using sed
I have a solution for this in awk:
awk '{if (NR==1 && NF==0) next};1' somefile
but was unable to find one that worked in sed. E.g.,
sed -i.bak '/^$/{1,1d;}' somefile
ended up deleting ...
4
votes
3answers
236 views
How to parse a file to extract 3 digits numbers kept in a “group number”
I am a beginner, and trying to write a shell script to parse a text file that is extracted from a standardization pdf file. I would like for each test group (identified by Group 0, Group 1... to get ...
4
votes
3answers
3k views
Delete range of lines above pattern with sed (or awk)
I have the following code that will remove lines with the pattern banana and 2 lines after it:
sed '/banana/I,+2 d' file
So far, so good! But I need it to remove 2 lines before banana, but I can't ...
4
votes
3answers
1k views
How to get only filename using sed
How can I get only the filename using sed? I've this
out_file=$(echo $in_file|sed "s/\(.*\.\).*/\1mp4/g")
But I get the path too /root/video.mp4, and I want only video.mp4.
4
votes
4answers
1k views
How to perform a sed in-place substitution that only creates backups of files that were changed?
I ran the following to replace a term used in all files in the current working directory:
$ find . -type f -print0 | xargs -0 sed -i'.bup' -e's/Ms. Johnson/Mrs. Melbin/g'
This performed the word ...
4
votes
3answers
211 views
sed one-liner to replace word-medial capitals
I used OCR to turn some scans into plaintext, but unfortunately the letters 'fi' which are commonly joined in some fonts, got read in as capital W's. Now I need to replace all the W's with 'fi', and ...
4
votes
2answers
259 views
Passing parsed output of sed to find (in this direction)
Well, I think you can find dozens of questions on this platform how to pipe find output to sed, but I haven't found anything for the reverse direction so far. What I want to do is modify my input, and ...
4
votes
3answers
208 views
Print a line only if the next line does NOT contain a particular match
I am trying to search a log file for logged activities that did not complete. For example, I log a "Starting activity for ID 1234..." and if successful, the next line will be "Activity 1234 ...
4
votes
1answer
153 views
substituting third occurrence of a pattern using sed
Here is a sed command. I want to substitute third occurrence of 00 to 11
echo "0000000000000000" | sed -e 's/00/11/3'
The output is:
0000110000000000
But I thought output would be:
...
