The tag has no wiki summary.

learn more… | top users | synonyms

8
votes
2answers
402 views

Create a gzip file of a predetermined size

I want to test an upload of files of content type application/x-gzip of various sizes ranging from 100 MB to 999 MB. How can go I about creating .gz files of these predetermined sizes? If I do dd ...
8
votes
3answers
527 views

How do I compress files in-place?

I have a machine with 90% hard-disk usage. I want to compress its 500+ log files into a smaller new file. However, the hard disk is too small to keep both the original files and the compressed ones. ...
1
vote
1answer
58 views

unpigz (and untar) to a specific directory

I know how to gunzip a file to a selected location. But when it comes to utilizing all CPU power, many consider pigz instead of gzip. So, the question is how do I unpigz (and untar) a *.tar.gz file ...
7
votes
2answers
333 views

How to store a large folder in a single file without compression

Sorry if this is a stupid question, but I want to take a 78gb folder and store it in a single file (for upload into a cloud service), as if I am compressing it in an archive, but I don't want any ...
-1
votes
1answer
47 views

Erratic behavior with gzip on unix

I am compressing log files daily and very recently I have been seeing some crazy results on the file type of the file after compression. Normally you would expect file filename.gz returning gzip ...
6
votes
6answers
2k views

How do I grep recursively through .gz files?

I am using a script to regularly download my gmail messages that compresses the raw .eml into .gz files. The script creates a folder for each day, and then compresses every message into its own file. ...
0
votes
2answers
125 views

Gzip file but excluding some directories|files and also append current date

I'm looking for a way to create a .tar.gz file from a directory but I have some doubts. I'm know that the command for create the file is: tar -zcvf /path/to/compressed/file.tar.gz /path/to/compress ...
1
vote
1answer
66 views

Handle compress command error messages on AIX

I am working on production issue and unable to reproduce error message for compress command. Current Solution We have case-esac block in shell wrapper that handles messages as follows; case "$MSG" ...
2
votes
3answers
234 views

How to compress the directory and its contents

How do I compress a directory and its contents in ksh on AIX for a file I do compress filename
2
votes
0answers
46 views

How do I layer compression on top of encryption on top of BtrFS, per-file?

BtrFS should support this really, but it doesn't. So ECryptFS looks like it will fill the gap. The only thing is, how would I layer compression on top of this? Reasons for compression on top of ...
4
votes
3answers
559 views

Unpack file compressed in .txz and .tar with one command

I have a file compressed in *.txz. After unpacking it I received a *.tar file. Is there any way to unpack it twice with one command? I mean unpack file (*.tar).txz with one command? For know I'm do ...
0
votes
0answers
55 views

Errors when installing Maldet on an Fedora 20 system, have had these before

I just installed maldetect-1.4.2 on a system(Fedora 20) and it gives this error when installing: gzip: stdin: unexpected end of file tar: Child returned status 1 tar: Error is not ...
12
votes
2answers
567 views

Fastest way of working out uncompressed size of large GZIPPED file

Once a file is gzipped, is there a way of quickly querying it to say what the uncompressed file size is (without decompressing it), especially in cases where the uncompressed file is > 4GB in size. ...
1
vote
1answer
26 views

Is there a difference between gunzip -c and gunzip in terms of system utilization?

Is there a difference between zcat/gunzip -c and gunzip apart from the obvious one that one outputs it to the terminal and the other decompresses it to a file? I'm looking from a CPU utilization ...
1
vote
1answer
91 views

How strong is the encryption of a zip file in Linux Mint

Zip encryption has had often a bad reputation of being weak, but some would argue that a zip file encrypted using certain algorithms (such as by using AES), together with strong password, is really ...
3
votes
2answers
137 views

Tell gzip/bzip2/7z/etc not to compress already-compressed files?

I'm tarring up /home, and piping it through bzip2. However, I've got lots of already-compressed files out there (.jpg, .mp4, .mkv, .webm, etc) which bzip2 shouldn't try to compress. Are there any ...
2
votes
1answer
70 views

Is there any size limit for the compress command?

Is there any particular size limit after which the compress command works? As I know for 0 byte file, the compress command does not work. But today I tried to compress a file of byte size 27 bytes ...
-2
votes
1answer
180 views

How to compress a single huge file (e.g. 200GB) file from command-line [closed]

I'd like to compress one huge file (~200GB) from the command line. no need for archiving its directory along with it, swift operation and high compression ratio preferred. What may be some good ways? ...
0
votes
2answers
96 views

How to zip folder content on Ubuntu without keep the folder structure(path)

How can I compress a directory content without compress the full path folder structure too. I am using this command to zip a folder content under var/www/ directory, but when I unzip the ...
0
votes
0answers
16 views

Gzip Mutliple files using single command [duplicate]

Want to Gzip my all the .csv files into a gzip file. I am using this command. gzip *.csv; Problem File contains '//' in its name that's why command is giving error. Error : - '//File.csv' is not ...
2
votes
1answer
265 views

cpio VS tar - what the best archive solution in order to compress hundred of directories to one file

I have hundreds of directories under /var/Recording, and each directory there will have subdirectories, including files, hard links and soft links. I want to compress all directories under ...
0
votes
0answers
23 views

What does “GLib-CRITICAL” error mean? [duplicate]

I'm trying to working with complearn, I installed complearn- toolkits , gui etc. from terminal window. Now I'm trying ncd (normalized compression distance) code samples to find similarity distance ...
1
vote
2answers
101 views

Unzip error, is recovery possible?

I compressed 4 separate folders with some wedding videos (!!) a few months ago. Today I tried to unzip them, and had no problem with the last 2, but the first 2 of them show an error: ...
7
votes
3answers
778 views

How to recompress 2 million gzip files without storing them twice?

I have about 2 million (60GiB) of gzipped small files and I would like to create a compressed archive containing all of them in an uncompressed version. Unfortunately, I cannot just uncompress them ...
0
votes
1answer
43 views

Why scp with compression takes longer than without compression

I was playing around and noticed that secure-copying with compression takes longer than without compression time scp -C ./test.sql user@vmware:/home/user real 0m42.758s user 0m40.455s sys ...
2
votes
1answer
43 views

Is it possible and how to merge identical files between different snapshots in a btrfs file system?

I regularly use btrfs's snapshot to backup the whole system, but it's redundant to have identical files between different snapshots. Commonly, for example, I took a snapshot of @ as ...
1
vote
1answer
93 views

How to check if SSH compression is enabled?

I am experiencing severe slowdown in Git checkouts from VM. I've been told that one of the reasons may be SSH compression (either enabled or disabled). How to check that is the state of compression ...
2
votes
1answer
46 views

Compress a tar file without extracting the content

Is it possible to compress a tar file such that I don't end up with an archive file in an other archive file but just an archive file containing my content fx. a tar.gz file? I don't want to extract ...
2
votes
2answers
275 views

Estimate compressibility of file

Is there a quick and dirty way of estimating gzip-compressibility of a file without having to fully compress it with gzip? I could, in bash, do bc <<<"scale=2;$(gzip -c file | wc -c)/$(wc ...
0
votes
1answer
730 views

Private VPN compression for faster internet

Background: I'm a student, and currently the WiFi connection at my school is very slow (dead slow). I have an 8Gb 4G data-plan, but even with that, I'm running short at the end of the month. I have ...
2
votes
1answer
256 views

Zip does not compress files when zipping

I have zipped a file recursively in a directory. But what I notice with these last few zips is that the files do not get compressed. adding: ...
3
votes
2answers
81 views

In what situation would a tarball (.tgz) be almost the same size as the original

I just tarballed a dump of some websites (configs, image directory, css directory, and site content (html files etc)) using tar czf sitedump.tgz backup_folder/. The original "backup_folder" was about ...
0
votes
2answers
101 views

Why don't the servers use 7z?

By default on a UNIX machine install, I can see the logs are rotated with gzip. Question: Why doesn't the UNIX world use by default 7z? It would be much more efficient than gzip.. I just compressed ...
6
votes
1answer
265 views

How should I combine many compressed files into one archive?

I have a few hundred .tar.xz files which are almost identical (they are daily database dumps, and the database changes slowly). I believe that due to the similarities in the uncompressed files, they ...
2
votes
1answer
432 views

How to compress a TMPFS folder?

I'm looking for a way to compress a tmpfs folder on the fly. I would like to use it for a local cache folder with a lot of data. I know there is a way to use Redis with eg LZF compression, but I ...
2
votes
1answer
49 views

Disk usage inside archives, like ncdu

I am a fond user of the ncdu utility to figure out how space is used within a directory. However, I have a use case where I am trying to choose which folders to backup and which folders not to ...
2
votes
1answer
65 views

How can I tell when a file was compressed?

I want to find out when my log files were compressed by logrotate because when I received them from cron in my email, the logs came in as text in the main body of the email instead. I did: ls -1la ...
3
votes
1answer
167 views

zfs-fuse: enabling compression has no effect

I installed on Debian Wheezy zfs-fuse file system and enabled compression gzip-9 on one dataset ("storage/backup"). When I check if the compression is enabled on this dataset, it shows YES: $: zfs ...
2
votes
1answer
37 views

appendable and greppable archive on CentOS to hold many log files (logrotate on steroids)

I have a bunch of applications on a CentOS 6.3 box, which generate daily logs (text files with a very similar content) in this vein: /data/logs/app/my-2014-06-29.log ...
5
votes
1answer
340 views

Command-line incremental backup tools

Which command line backup tool(s) has the best compression ratio? I want to backup my entire system, including media files, text files etc. I found this list on the Arch wiki site but I don't know ...
0
votes
2answers
830 views

Mount compressed tar file and update it

How do I mount a .tar.gz file, update it (add new files, edit files), and then unmount it such that changes are reflected in the original compressed file? I'm open to other compression formats if no ...
1
vote
1answer
109 views

Compress memory on low Ram VM

Is there a way to get out more out of your limited Ram on a VM? I have a VM running on a cloud hoster and try to optimize a quite low on RAM mashine. I heard, there is a way to compress parts in the ...
0
votes
2answers
374 views

How to install Uglify on Debian Sid

I have a question about how to install Uglify or Uglify2 on Debian. I'm also wondering whether I have to install Node.js as well. My main goal of asking this question is to minify all my CSS and .js ...
1
vote
1answer
183 views

Using `tac` on zipped files

tac unzipped.log | grep -m1 pattern works perfectly fine but I am not able to use the tac command on zipped files. tac zipped.gz | zgrep -m1 pattern returns nothing. Is there anyway to use tac ...
2
votes
0answers
52 views

Image set compression

Is there a good open source (not exclusive to Linux) for compression of a set of similar images? I have thousands of documents scanned but I do not access them often. The documents are forms, with ...
3
votes
2answers
1k views

Making tar split archives as it compresses?

I want to compress a file with tar but I'd like to know if its possible to do it while splitting the files. I know that in windows is possible to do this with winrar, I also know I can use split but ...
2
votes
1answer
94 views

Can p7zip create smaller zip files than winzip?

7-Zip for Windows creates smaller zip archives than WinZip, so presumably P7zip can create smaller zip archives than Zip in Linux. So how do I create zip files using P7zip in Linux?
18
votes
3answers
3k views

Does tar actually compress files, or just group them together?

I usually assumed that tar was a compression utility, but I am unsure, does it actually compress files, or is it just like an ISO file, a file to hold files?
38
votes
1answer
1k views

What happened to bzip1?

bzip2 had been a de facto standard for quite strong compression throughout many years already. I myself had typed the bzip2 command thousands of times already, which makes me wonder - what happened to ...
6
votes
1answer
217 views

How to specify additional parameters for GNU sort's --compress-program option?

sort --compress-program=/bin/gzip works fine, but how can I pass options down to the compression programm (e.g. --best or --fast)? sort --compress-program=/bin/gzip\ --best failes with the error ...