Chains the standard streams of a series of commands
4
votes
4answers
209 views
How to send stderr to stdout with a pipe to another command?
I'm trying to capture all of the output of a build operation, and send it to myprogram. I seem to only be able to capture part of it. This is what I'm trying:
make clean && make ...
5
votes
3answers
220 views
Utility to buffer an unbounded amount of data in a pipeline?
Is there a utility that I can stick in a pipeline to decouple read and write speeds?
$ producer | buf | consumer
Basically, I want a utility buf that reads its input as fast as possible, storing it ...
4
votes
1answer
154 views
Repeatably generate a read error for testing?
I'm trying to test the error handling in some software, in particular what happens when an error occurs reading from a file or pipe. Is there a simple way to send a certain amount of data to stdout ...
4
votes
2answers
2k views
How to add a timestamp to each line of a logfile?
I have an external program which I can not edit. It writes its log to a file.
How do I add a timestamp to each line while the program writes to the logfile?
It does not write its output to stdout. ...
6
votes
2answers
924 views
bash: Piping for loop output prevents local variable modification
First off, sorry for the title. I'm not sure of the correct terminology so if anyone can improve upon it that would be good.
I am trying to write a simple bash function that takes, as it's arguments, ...
6
votes
1answer
525 views
How can I tell if the pipe buffer is full?
I am piping output from one program into some Perl I wrote. This is a long running process , sometimes days, so I want to find out where my bottlenecks are and try to open them up. I want to know if ...
8
votes
4answers
3k views
Difference between 2>&1 > output.log and 2>&1 | tee output.log
I wanted to know the difference between the following two commands
2>&1 > output.log
and
2>&1 | tee output.log
I saw one of my colleague use second option to redirect. I know ...
13
votes
2answers
2k views
How do I pass a list of files to grep
I am using find and getting a list of files I want to grep through. How do I pipe that list to grep?
1
vote
2answers
105 views
In tcsh how can I prepend 'cd ' to the output of a pipe?
As in, say I execute pwd to return the current directory and want to dump this in a script file so that I can come back, but I then need to prefix it with 'cd '?
2
votes
3answers
940 views
How to feed the results of date command into grep to filter results of another command
I need to use the result of a formatted date command (date +"%m/%d") as the grep filter to filter the results of another command that will display alerts on a system so that I only see alerts from the ...
14
votes
4answers
1k views
How to understand pipes
When I just used pipe in bash, I didn't think more about this. But when I read some C code example using system call pipe() together with fork(), I wonder how to understand pipes, including both ...
6
votes
2answers
405 views
Piping output from a segfaulting program
I have a script that calls a program (specifically, ttf2afm, part of tetex 3.0) that sometimes segfaults and sometimes doesn't. The information I need is always printed out before it segfaults, but ...
3
votes
2answers
493 views
Performance difference between stdin and command line argument
For some commands, it is possible to specify certain input as either stdin or a command line argument.
Specifically, suppose command can take stdin input and a filename as command line argument, and ...
14
votes
4answers
1k views
Process substitution and pipe
I was wondering how to understand the following:
Piping the stdout of a command into the stdin of another is a powerful
technique. But, what if you need to pipe the stdout of multiple
...
1
vote
3answers
475 views
Ls with spaces + variables
I want to do something like this, but it doesn't save the variable after the piping ends:
fs=( )
echo ${fs[@]}
ls -A1 |
while read f
do
echo ${fs[@]}
fs+=( "$f" )
echo ${fs[@]}
done
echo ...
4
votes
6answers
1k views
Using data read from a pipe instead than from a file in command options
Per man definition, this command gets the input from a file.
$ command -r FILENAME
Suppose that FILENAME is a file containing a list of filenames, as it was generated using ls > FILENAME.
How ...
0
votes
1answer
182 views
Is 'some_program <some_file' faster than 'cat some_file | some_program'? [duplicate]
Possible Duplicate:
Should I care about unnecessary cats?
Both would be functionally equivalent, but when using cat wouldn't it be slower because you have a process first reading the file ...
3
votes
2answers
708 views
Why is piped input okay to zenity, but <file malfunctions?
My question is as simple as what the zenity --text args say in the example... but what is causing this 100% CPU grab by the redirection?
...(and by the way, is this particular usage of < actually ...
2
votes
2answers
301 views
.DELETE_ON_ERROR behavior with make and pipelines
The .DELETE_ON_ERROR target will tell make to delete a target if a rule fails. But this doesn't work for pipelines, because the exit status value $? holds the value of the last program in the ...
1
vote
1answer
355 views
Pipe diff file into patch?
Is there a way to pipe the diff output into patch? The -i parameter is for specifying a diff file, but I just want to do it more dynamically, since I will be updating regularly against a directory ...
5
votes
2answers
500 views
redirection and pipeline
I was wondering about differences and relation between redirection and pipeline.
Is pipeline only used to connect
stdout output of a command to stdin
input of another command?
Is redirection only ...
17
votes
2answers
514 views
Should I care about unnecessary cats?
A lot of command-line utilities can take their input either from a pipe or as a filename argument. For long shell scripts, I find starting the chain off with a cat makes it more readable, especially ...
4
votes
2answers
264 views
Is it possible to follow a command (run repeatedly)? as one would follow a file using tail -f?
I have a script which produces a file 'Detail.out'. I know that the script is completed whenever the file contains a certain number of lines (roughly 21025). So I find myself sitting at the command ...
5
votes
3answers
3k views
How to process/pipe TCPDUMPs output in realtime
If I want to tcpdump DNS requests by clients (on an OpenWrt 10.04 router), then I
root@ROUTER:/etc# tcpdump -n -i br-lan dst port 53 2>&1
tcpdump: verbose output suppressed, use -v or ...
4
votes
2answers
838 views
Combine input from multiple files/pipes without clobbering lines or blocking?
Is there a tool that will take input from multiple files or pipes and write it to stdout, without blocking on reads, such that individual input lines come out intact? I basically want to multiplex a ...
2
votes
4answers
2k views
Passing pipeline value as parameter to xargs for use by eval echo
I have a text file that I'm using as a template, it looks like this:
Hostname : $HOSTNAME
Host Address : $HOSTADDRESS
My bash script sets two variables, HOSTNAME and HOSTADDRESS, reads the ...
4
votes
1answer
610 views
How to pipe the result of 'date' command to 'mv' command
I want to rename my file to the current timestamp.I know how to get the current timestamp("date +%s") but how can I pipe it to 'mv' command?
23
votes
10answers
5k views
Get exit status of process that's piped to another
I have two processes foo and bar, connected with a pipe:
$ foo | bar
bar always exits 0; I'm interested in the exit code of foo. Is there any way to get at it?
8
votes
5answers
2k views
How to pipe output from one process to another but only execute if the first has output?
How can I rewrite this command to only email if there is output from the mailq | grep?
mailq | egrep 'rejected|refused' -A 5 -B 5 | mail -s 'dd' email@email
Is this even possible on one line?
20
votes
3answers
13k views
How big is the pipe buffer?
As a comment in I'm confused as to why "| true" in a makefile has the same effect as "|| true" user cjm wrote:
Another reason to avoid | true is that if the command ...
5
votes
1answer
255 views
I'm confused as to why “| true” in a makefile has the same effect as “|| true”
I have a makefile where I'm stopping a service before removing a file. When it couldn't stop the service, it would break on error. This is clearly unwanted so I thought I'd add || true but missed a |. ...
4
votes
1answer
238 views
Is it possible to send a keyboard event to a background script that's expecting user interaction? (Using 'read')
Ex:
$read &
[1] 15139
[1]+ Stopped
$jobs -l
[1]+ 15139 Stopped (tty input) read
6
votes
2answers
1k views
Where do my ANSI escape codes go when I pipe to another process? Can I keep them?
I sometime want to pipe the color-coded output fror a process, eg. grep... but when I pipe it to another process, eg. sed, the color codes are lost...
Is the some way to keep thes codes intact ?
...
16
votes
4answers
6k views
What is the mknod command used for?
I just started using Ubuntu as my main OS and I wanted to learn about things I should not do, and learn by the bad things people have done in the past. I came across these email about horror stories ...
3
votes
2answers
371 views
find arcana: can't get pipe to work in -exec line
How do I pipe the results of a find through a sed to xform the stream, and then use that transformed stream as one of two arguments to a script? IE:
find turns up file1.tiff (among others)
sed ...
7
votes
2answers
2k views
/proc/PID/fd/X link number
In Linux, in /proc/PID/fd/X, the links for file descriptors that are pipes or sockets have a number, like:
l-wx------ 1 user user 64 Mar 24 00:05 1 -> pipe:[6839]
l-wx------ 1 user user 64 Mar 24 ...
4
votes
3answers
2k views
Why is my variable being localized in one 'while read' loop, but not in another seemingly similar loop
Why do I get different values for $x from the snippets below?
#!/bin/bash
x=1
echo fred>junk ; while read var ; do x=55 ; done <junk
echo x=$x
# x=55 .. I'd expect this result
x=1
cat ...
3
votes
1answer
411 views
Can splice()/tee() be made to work with sockets, and not merely pipes?
On Linux, the system calls splice(2) and tee(2) are used to transfer data between two file descriptors. One or both of the file descriptors must be a pipe, according to documentation. Why? Can this be ...
2
votes
2answers
347 views
stop pipe() opening stdin
I've currently got code that forks two processes. The first reads a http streaming radio and pushes the data down a pipe (opened with pipe() ) for the second process to read, decode and output to the ...
17
votes
3answers
3k views
Program that passes STDIN to STDOUT with color codes stripped?
I have a command that produces output in color, and I would like to pipe it into a file with the color codes stripped out. Is there a command that works like cat except that it strips color codes? I ...
4
votes
2answers
725 views
What is the MIME equivalent of uuencode for sendmail?
e.g., I've got files I want to send by sendmail but the receiving mailbox (for posting pictures to my blog) will not accept uuencode files a la
$uuencode file | sendmail user@domain
I'm guessing ...
4
votes
3answers
210 views
Correct textual name for <<
I've just come across the << command, used like so:
cat > outfile.txt <<EOF
Multi-line content
that will be written to outfile.txt
EOF
Now, I've no idea what this is called, but I'd ...
4
votes
3answers
308 views
Why does sed act differently depending on the output file?
If I run:
cat messages.txt | sed -e 's/a/a/g' > messages.txt
on one large file (2500+ lines) I find that the resulting file will only have about 900 lines after the command in cygwin and will ...
0
votes
2answers
1k views
Unix - Filter Commands
I want to know about the "filter-command" which are available in Unix.
I am confused regarding this:
What is the purpose of "Filter-Command" ?
Which are the Filter-commands available in Unix?
I ...
6
votes
3answers
3k views
Redirect stdout over ssh
I would like to run
something > file
on a remote system through ssh, but if I run
ssh host something > file
the redirection is executed locally as ssh etc > file
I've tried it with ' ...
14
votes
4answers
4k views
Can't pipe into diff?
I wanted to be clever and compare a remote file to a local file without downloading it. I can get the contents of the remote file by
ssh user@remote-host "cat path/file.name"
However, piping that ...
48
votes
8answers
12k views
Turn off buffering in pipe
I have a script which calls two commands:
long_running_command | print_progress
The long_running_command prints a progress but I'm unhappy with it. I'm using print_progress to make it more nice ...
