I'm in the process of compressing a very large file (several TBs) with the following command, and it's been running for several days.
tar -I pigz -cf /path/to/compressed.tgz /dataset/to/compress
I'm slightly worried that I'll lose these days of progress over the smallest glitch.
For future reference, is there such a compression scheme/command available that allows one to resume where they've left-off? If not, is there an algorithmic reason for not being able to resume the compression where you've left off?