34

Per man definition, this command gets the input from a file.

$ command -r FILENAME

Suppose that FILENAME is a file containing a list of filenames, as it was generated using ls > FILENAME.

How can I, instead, feed the command with the result of ls directly? In my head something like this should be possible:

$ ls | command -r

But it doesn't, the output of ls doesn't get hooked as an argument. Output:

Usage: command -r FILENAME
error: -r option requires an argument

How could I obtain the desired effect?

1

5 Answers 5

50

This is dependent on the command. Some commands that read from a file expect that the file be a regular file, whose size is known in advance, and which can be read from any position and rewinded. This is unlikely if the contents of the file is a list of file names: then the command will probably be content with a pipe which it will just read sequentially from start to finish. There are several ways to feed data via a pipe to a command that expects a file name.

  • Many commands treat - as a special name, meaning to read from standard input rather than opening a file. This is a convention, not an obligation.

    ls | command -r -
    
  • Many unix variants provide special files in /dev that designate the standard descriptors. If /dev/stdin exists, opening it and reading from it is equivalent to reading from standard input; likewise /dev/fd/0 if it exists.

    ls | command -r /dev/stdin
    ls | command -r /dev/fd/0
    
  • If your shell is ksh, bash or zsh, you can make the shell deal with the business of allocating some file descriptor. The main advantage of this method is that it's not tied to standard input, so you can use standard input for something else, and you can use it more than once.

    command -r <(ls)
    
  • If the command expects the name to have a particular form (typically a particular extension), you can try to fool it with a symbolic link.

    ln -s /dev/fd/0 list.foo
    ls | command -r list.foo
    

    Or you can use a named pipe.

    mkfifo list.foo
    ls >list.foo &
    command -r list.foo
    

Note that generating a list of files with ls is problematic because ls tends to mangle file names when they contain unprintable characters. printf '%s\n' * is more reliable — it'll print every byte literally in file names. File names containing newlines will still cause trouble, but that's unavoidable if the command expects a list of file names separated by newlines.

4
  • In the example command -r <(ls) the process substitution isn't a parameter of the -r option, is it? I am trying to use this to specify a public key identity to ssh by extracting the public key from the agent: ssh -o IdentitiesOnly=true -i <(ssh-add -L | grep mykey) me@remotehost doesn't work because the anonymous file is gone before ssh is able to read it: Warning: Identity file /dev/fd/63 not accessible: No such file or directory. .
    – starfry
    Commented Jun 9, 2021 at 9:01
  • @starfry The process substitution results in a word like /dev/fd/42 which is a parameter of the -r option. Commented Jun 9, 2021 at 9:28
  • It does indeed... but when command tries to read /dev/fd/42 that file has already ceased to exist (I think, at least that's what I'm seeing).
    – starfry
    Commented Jun 9, 2021 at 9:34
  • 1
    @starfry The file exists as long as the ssh process is running. But ssh has a multi-process structure and maybe the original process closes the file before calling the subprocess. If that's what's happening, you may need to create a named temporary file. Commented Jun 9, 2021 at 9:52
6

It should be:

ls | xargs -n 1 command -r

Edit: for names with blank spaces:

ls | xargs -d '\n' -n 1 command -r
1
  • This could be problematic if command believes it has all the file names it will need on the command line all at once. Some versions of xargs will give command a few file names (10, it seems to me) at a time. Looks like GNU xargs gives everything all at once.
    – user732
    Commented Jul 19, 2011 at 20:39
2

Many commands accept - as a "filename" that means "use the standard input", but this convention is far from universal. Read the man page.

2

Actually, the only reliable solution that I know of that can handle all filenames, including those with a newline in them, is:

find . -maxdepth 1 -print0 | xargs -n 1 -0 command -r

The only non allowed character in the filename in this case is the null character, which isn't allowed in filenames anyway.

1

This should work for your purpose: ls | command -r /dev/stdin

0

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .