grep on interactive program

Question

I have an interactive shell-like program, that outputs a lot of irrelevant error messages, that confuse our customers. Each of these error messages are full-line messages starting with "%".

So the easy way to get rid of them would be something like this:

command | grep -v "^%[^\n]*$"

With command being the shell-like program.

But the problem with that is, that it only outputs anything to the user, after it received a newline. So when the user types anything into the program, there is no feedback of what they typed, until they press enter.

Is there a way to do something like this non-line based? I thought of programming a little something in Python, but on that machine (very slow embedded device) starting Python takes multiple seconds, which is not acceptable.

To add more clarity, I'll explain a bit more:

The program that this is about is not under my control, so I can't change what it does (otherwise I'd just get the program to stop outputting these error messages). The program is used to view or change settings on the device in a Cisco-Shell style. A typical user interaction might look like this:

linux-shell# command
% Error: some meaningless error
fake-cisco-shell# show status
Status report: status ok
% Error: some meaningless error
fake-cisco-shell# exit
linux-shell#

Every time the user presses a key, the letter that they typed appears on the screen as they type it, so that they can see what they typed, similar as on a regular bash shell.

Now if I do something like this:

command | grep -v "%[^\n]*\n"

Then the letters typed (and also the input prompt) will only show up after the user pressed enter and thus ended the line, because grep caches lines. So something like this ("<" = inputs from the user, ">" outputs from the program):

> fake-cisco-shell# 
< s
> s
< h
> h
< o
> o
< w
> w
< \n
> \n
> Result of the command\n
> fake-cisco-shell#

Now looks like this:

>(no output)
< s
< h
< o
< w
< \n
> fake-cisco-shell# show\n
> Result of the command\n

So as you see, it does not output each character on it's own when the program sends it, but instead waits for the next \n and only then grep forwards the content.

I am not sure grep can actually do what I want, so I am also open to suggestions to other programs.

Answer 1

grep is defined to match, and retain or discard, lines, so it has to read the whole line before doing the match; that can't accomplish what you want.

First you need to verify if command does this echoing of input chars one by one to a pipe. Standard C programs (and sometimes other programs using C stdio) by default use line-buffering when stdout is an 'interactive device' as defined by the implementation, but full-buffering otherwise, and pipe is usually not defined as interactive. Your command is already behaving unusually on a tty, but check it still does so on a pipe with command | dd bs=1.

If that doesn't work, you'll need a program that sets up a pseudo-tty (pty) for command, such as the stripped-down script suggested by Mark Plotnick.

If echoing to pipe does work on the command side, all you need is something on the right side of the pipe that doesn't wait for a full line. A simple C program can do it, something like:

#include <stdio.h>
int main (void) {
  setvbuf (stdout, NULL, _IONBF, 0);
  int c;
  while( (c = getchar()) != EOF ){
    int sel = c != '%';
    for( ; c != '\n' && c != EOF; c = getchar() ) 
      if( sel ) putchar (c);
    if( sel ) putchar ('\n');
  }
}

Or if you have bash -- which IMLE embedded devices tend NOT to -- try a script containing

IFS=$'\n'
while read -rn1 c; do y=true; [[ "$c" == "%" ]] && y=false;
  while ! [[ "$c" == "" ]]; do $y && printf "%c" "$c"; read -rn1 c || exit; done
  $y && printf "\n"; done

Answer 2

Start of line is done with ^ and end of line with $. The characters \n is not recognized. And end of line is never matched (by default).

So You should use something like grep -v "^%.*$".

Answer 3

sed has an unbuffered mode, so the following should work as well:

… | sed -u -r '/%[^\n]*\n/d'