Communities

Writing
Writing
Codidact Meta
Codidact Meta
The Great Outdoors
The Great Outdoors
Photography & Video
Photography & Video
Scientific Speculation
Scientific Speculation
Cooking
Cooking
Electrical Engineering
Electrical Engineering
Judaism
Judaism
Languages & Linguistics
Languages & Linguistics
Software Development
Software Development
Mathematics
Mathematics
Christianity
Christianity
Code Golf
Code Golf
Music
Music
Physics
Physics
Linux Systems
Linux Systems
Power Users
Power Users
Tabletop RPGs
Tabletop RPGs
Community Proposals
Community Proposals
tag:snake search within a tag
answers:0 unanswered questions
user:xxxx search by author id
score:0.5 posts with 0.5+ score
"snake oil" exact phrase
votes:4 posts with 4+ votes
created:<1w created < 1 week ago
post_type:xxxx type of post
Search help
Notifications
Mark all as read See all your notifications »
Q&A

Comments on How to overwrite each line of STDOUT with the next one?

Parent

How to overwrite each line of STDOUT with the next one?

+3
−0

I wrote a filter program to overwrite each line with the next one.

$ cat /usr/local/bin/ovr
#!/bin/sh

sed '2,$s/^/\x1B[1A\x1B[K/';

Here's the behavior:

$ echo | ovr

$ echo 'foo' | ovr
foo
$ echo -e 'foo\nbar' | ovr
bar
$ echo -e 'foo\nbar\nbaz' | ovr
baz
$ echo -e 'foo\nbar\nbaz' | ovr | wc -l
3

It is useful for example when compiling a large program, where you might not want to pollute your screen with so many lines. For example, in build systems like the Linux kerenl one, for each file that's compiled, one line goes to stdout, of the form CC some/file.o.

I usually compile it with make -j24 | ts -s, to know for how long it's been running, from which I can guess how much is remaining. But I don't really need to see all lines; just the last one. So I do the following.

$ time make -j24 | ts -s | ovr
00:00:04   CC      drivers/pinctrl/intel/pinctrl-sunrisepoint.o

The line will be updating all the time.

This program has a some flaw, which I'd like to fix.

If the line is long (longer than the terminal width), the overwriting doesn't work well, and only overwrites the part of the lines that has been written in the last "visual" line in the terminal.

For an 80-col terminal, this is an example:

$ echo -e '123456789q123456789w123456789e123456789r123456789t123456789y123456789u123456789i123456789o\nfoo' | ovr
123456789q123456789w123456789e123456789r123456789t123456789y123456789u123456789ifoo

How can this bug be fixed? Is it possible to fix it?

History
Why does this post require moderator attention?
You might want to add some details to your flag.
Why should this post be closed?

0 comment threads

Post
+4
−0

This other answer tries to truncate each line to make it fit the width of the terminal. It's hard to do this reliably because e.g. a tab character counts as one, but it looks like several spaces; on the other hand unprintable characters and escape sequences do not show at all.

My answer is a completely different approach. The idea is to print to the alternate screen. The alternate screen is used by less, vi, nano and many similar programs. When such program exits, there is no trace of its output.

The below script switches the terminal to the alternate screen and pipes its input there. Eventually it switches the terminal back. Then it prints (repeats) one last line to its stdout, this is the line that will remain.

#!/bin/sh
trap '' INT
enter() { setterm --linewrap off; tput smcup; } >/dev/tty
leave() { setterm --linewrap on; tput rmcup; } >/dev/tty
trap leave QUIT TERM
n="${1:-1}"
enter
lines="$(tee /dev/tty | tail -n "$n"; echo x)"
leave
printf '%s' "${lines%x}"

Notes:

  • The script uses at most one argument. If specified, the argument is passed to tail -n. This way you can get more than one last line in your normal screen. If not specified, 1 is used.

  • tput smcup and tput rmcup are responsible for entering and leaving the alternate screen respectively.

  • setterm --linewrap off tells the terminal not to wrap long lines. You may prefer not using setterm --linewrap off and setterm --linewrap on in the script. Delete them at will.

  • The last line(s) is printed (repeated) outside of the alternate screen in full, i.e. with wrapping.

  • Tools that read from the terminal (sudo asking for password, simple y/n prompts) should work in the alternate screen.

  • The script will not capture your input (like an answer to a y/n prompt) to print (repeat) it after leaving the alternate screen, even if the input is echoed inside the alternate screen and seems to belong to the last line(s).

  • Tools that print directly to the terminal (/dev/tty) or to their stdout (which happens to be the terminal) should work in the alternate screen, but such lines will not be among lines captured by the script and repeated after leaving the alternate screen. Inside the alternate screen such lines may seem out of sync with respect to stdout because only stdout is "delayed" and buffered around tee.

  • If you want, you can merge stderr with stdout and pipe the merged stream to the script: something 2>&1 | ovr. This way stdout and stderr will stay in sync.

  • The script works reasonably well when the pipeline gets interrupted with Ctrl+c.

  • Ctrl+z is somewhat troublesome because the script will stop without leaving the alternate screen. If you make it continue in the foreground (fg) then it will leave the alternate screen eventually like it normally would. If you kill it with SIGTERM (kill %%) then it will leave the alternate screen because of the trap.

History
Why does this post require moderator attention?
You might want to add some details to your flag.

4 comment threads

Where to call trap(1)? (3 comments)
Why set lines="" ? (2 comments)
Why `echo x`? (5 comments)
Redirecting shell functions or their contents (3 comments)
Why `echo x`?
alx‭ wrote 7 months ago

Why do you need the echo x trick? What happens without it?

I think this would be simpler:

...
lines="$(tee /dev/tty | tail -n "$n")"
leave
printf '%s\n' "$lines"

Am I missing anything?

Kamil Maciorowski‭ wrote 7 months ago · edited 7 months ago

$(…) removes all trailing newline characters; adding exactly one newline character when doing printf may or may not compensate this. By appending x and one newline character (this is what echo x does), allowing $(…) to remove this newline character and removing x "by hand" later, I capture all trailing newline characters coming from tail. And in case there is no trailing newline character, I do not add one.

Quasímodo‭ wrote 7 months ago

Wouldn't lines="$(tee /dev/tty | tail -n "$n")x" have the same effect?

alx‭ wrote 7 months ago

Thanks Kamil! Makes sense.

@quasimodo, no, that would have the same problems as my suggestion.

@Quasímodo The $(…) in your code would strip the trailing newlines I want to save. We need to append x before $(…) acts, only then x makes the trailing newline characters in fact non-trailing. Appending x after $(…) acts is too late.