Questions tagged [gzip]

A data compression program. Originally a GNU utility it has been cloned by most Unix variants.

Filter by
Sorted by
Tagged with
-1
votes
0answers
9 views

Investigating User activity in EC2 instance

HI long story short I've got this task from my supervisor asking me to investigate a File that was created by an ex-employee in our administration/JumpBox EC2 box (debian) in his /tmp directory. For ...
1
vote
0answers
43 views

Correct/fix “gzip: stdin: unexpected end of file” in .gz file?

I use adb backup to backup my Android smartphone; and as noted in many posts, such as https://stackoverflow.com/questions/18533567/how-to-extract-or-unpack-an-ab-file-android-backup-file - I have ...
0
votes
2answers
41 views

What does gzip < my file.gzip > do?

I am playing around with Linux and came across gzip < my file.gzip >, and I wonder what it does. Can someone tell me what it does?
0
votes
1answer
34 views

How to extract a compressed tar using cpio to a particular directory location

I created the compressed tar file using the below command. find /app/jboss -not -name "*.err" -not -name "*.log" | cpio -o | gzip >/app/patchbkp/test/REDHAT_jboss-eap-7.2_18-Aug-...
0
votes
0answers
25 views

gzip -t output “gzip: filename.gz: extra field of X bytes ignored”

I have a bunch of .gz files I'm checking the integrity after data transfer with gzip -t -v file the output I'm getting is gzip: C2_CRRA200017850-1a_H3LJWDSXY_L1_2.fq.gz: extra field of 6 bytes ignored ...
0
votes
2answers
64 views

How do i gunzip to a particular folder?

I have .gz file like BIG5.gz. I want to gunzip this gz file to a BIG5 folder. This did not work: gunzip -c BIG5.gz > /BIG5
1
vote
2answers
79 views

Help in creating script

I am currently working on script with the following goals: Script will check every 15-minute if there is AppA.log4 in /logs directory. There are numerous apps in /logs directory, for example AppA....
1
vote
2answers
35 views

How to gzip specific files in a certain folder?

Good Day. I am creating a script that moves all 'logA' files in a certain folder and adds timestamp every 3 hours, afterwards it will be zipped. This is the base of the script: cd /logs mv *logA+...
0
votes
1answer
39 views

Why won't tar/gzip compress two similar large directories?

A long time ago, before I tried incremental and differential backups, I tried to tar/gzip several similar large (1 GB) directories, but they did not compress any better than tarring and gzipping each ...
0
votes
0answers
12 views

W3M freezes when rendering some pages

I get many websites not loading with either the following message: HTTP/1.1 200 OK HTTP/1.0 200 OK The loading process of the page gets frozen so I press Ctrl + C right away and then I get a parcial ...
0
votes
2answers
51 views

Another called script not going into background even given &

I have 2 scripts. I'm calling my script2 as sh scriptpath/script2.sh & inside script1 which compresses files using a combination of find, xargs and gzip commands on 16 files at a time. It is ...
0
votes
1answer
19 views

How to find files in the directory “/path/to/directory/” which contains information “SomeText” if they are in archives .gz?

I am using RHEL. How can I find files in the directory /path/to/directory/ which contain the string SomeText if those files are .gz archives?
1
vote
1answer
61 views

Rsyncing directory to a backup gzip file

Objective: The efficient backup and transfer of ~/dircontaininginnumeraltinyfiles/ to /mnt/server/backups/dir.tgz. My first thought was of course rsync and gzip. But I'm open to other routes as well. ...
0
votes
1answer
31 views

How can I completely zero out all free blocks (deleted files)

I'm making a backup of Raspbian (I know, this isn't the Raspberry Pi SE, but it's a Linux question and it probably isn't just Raspbian that has this problem and BTW, the size of the drive is 128GB). ...
0
votes
3answers
47 views

Compress a file into another file, with Gnu/Linux command line

I am trying to take a file containing text, named MyFile, and compress it into a file named MyFileComp, within the same directory. I have tried: gzip MyFile | touch MyFileComp gzip MyFile >> ...
1
vote
2answers
57 views

restoring hdd image using gzip throws error no space left on device

I created an image from a 256GB HDD using following command: dd if=/dev/sda bs=4M | pv -s 256G | gzip > /mnt/mydrive/img.gz later I tried to restore the image to another 512GB HDD on another ...
0
votes
2answers
39 views

How to create compressed archive split into multiple files while low on space

I'm to backup 7GB on 9GB drive. Means, I have about 2GB of empty space only. But tar related solutions require first - get everything into 1 file, next - split it. Is there any possibility to ...
0
votes
1answer
27 views

gzip multiples directory into archives in another directory

I want to back up each of the directories in /home, in separate .tar.gz files, to the /backup directory. Here an example. I know how to compress them. But not sure, how to send it in another directory....
0
votes
0answers
46 views

Stream multiple huge .tar.gz files into one file

I have a three .tar.gz files, and I need them all to be compressed into one .tar.gz file. After some googling I found the --concatenate option for tar, but that requires the files to be uncompressed ...
0
votes
1answer
26 views

unix uncompress multiple gz and save in particular directory

I have a directory with thousands of files .gz and I would like to uncompress and save the uncompressed files in a specific directory. I have tried but I can get it (beginner in this field). Thanks
31
votes
4answers
5k views

GZip doesn't produce the same compressed result on macOS vs Linux

I have a few thousand files that are individually GZip compressed (passing of course the -n flag so the output is deterministic). They then go into a Git repository. I just discovered that for 3 of ...
0
votes
1answer
355 views

Difference between gzip -d and zcat

I was wondering what the difference is when decompressing using gzip -d and zcat. Sometimes when I try gzip -d it says unknown suffix -- ignored. However, zcat works perfectly.
0
votes
1answer
346 views

Repair corrupted tar.gz file

Alright so I'm trying to extract a Google Takeout archive, extension is tar.gz and the file command says gzip compressed data. The archive is split into 11 tar.gz files. The 6th tar.gz file is ...
0
votes
0answers
63 views

zgrep with large pattern file

I do not know a lot about the underlying process that grep goes through and I am searching with a long pattern (863 members) in a large file 646.1 MB (zipped) and it is taking some time. I thought ...
0
votes
0answers
24 views

Anyway to provide hint to zgrep to search part of file for faster search results

Production logs file are huge in size and are stored in compressed format. I use the following to find specific log line zgrep searchString LargeLogFiles*.gz Typically this takes huge amount of ...
10
votes
2answers
1k views

Make grown extracted tar file small again

I packed and compressed a folder to a .tar.gz archive. After unpacking it was nearly twice as big. du -sh /path/to/old/folder = 263M du -sh /path/to/extracted/folder = 420M I searched a lot ...
6
votes
1answer
280 views

Is there a compression tool with an arbitrarily large dictionary?

I am looking for a compression tool with an arbitrarily large dictionary (and "block size"). Let me explain by way of examples. First let us create 32MB random data and then concatenate it to itself ...
0
votes
1answer
44 views

Need AIX command to extract a particular text file from a compressed file

I am looking for an AIX command to extract a particular text file from a compressed file. For example, my compressed file abc.gz contains millions of files with multiple sub directories. I need to ...
0
votes
1answer
120 views

How may I emulate the -R feature of “zip”, but in gzip and xz?

The program "zip" has a -R feature which allows one to zip all files with a certain name in a directory tree: zip -r v/s zip -R For example: zip -R bigfile "bigfile" Will zip all of the following: ...
0
votes
0answers
54 views

Command “wc -l” displays wrong count of lines, possibly because each line starts with a comma?

I have a czv.gz file and when issuing "less" command it looks like this COLUMN1,COLUMN2,COLUMN3 ,value1,value2,value3 ,value4,value5,value6 ... There are thousands of lines in a file but when I ...
2
votes
3answers
709 views

How to use zgrep to find out what line number or give some contextual info. surrounding a .gz file

In Debian you can use zgrep to grep through a gunzipped archive file. The reason for making a gunzip file is easy enough, files such as changelogs are vast which can be highly compressed. The issue is ...
1
vote
0answers
102 views

How does the tar flag --totals interact with the -z flag?

-z, --gzip filter the archive through gzip --totals[=SIGNAL] print total bytes after processing the archive; with an argument - print total bytes when this SIGNAL is delivered; Allowed ...
2
votes
1answer
2k views

Multithreaded xz, with gzip, pv, and pipes - is this the most efficient I can get?

I'm excited to learn that xz now supports multithreading: xz --threads=0 But now I want to utilise this as much as possible. For example, to recompress gzips as xz: gzip -d -k -c myfile.gz | pv | ...
0
votes
1answer
593 views

Can gzip compress application/octet-stream

Particularly in web, is it possible to compress application/octet-steam, I am serving video files from AWS to a web app and data transfer is very expensive at high scale
0
votes
1answer
235 views

“-bash: {}: No such file or directory” using find exec [duplicate]

I'm trying to run find . -name "binaries.tgz.*.gz" -exec gzip -d -k < {} \; (ultimately I'm trying to run find . -name "binaries.tgz.*.gz" -type f -exec gzip -d -k < {} \; | tar tzf - but I'm ...
1
vote
1answer
132 views

List contents of a tgz archive inside a gz archive

Bit of a weird one - I've got a honeypot running dionaea, which is a tool that consolidates any binaries that were uploaded to the device in single location (/data/dionaea/binaries). However, every ...
0
votes
0answers
150 views

Bash Script for Backing up/Gzip files with correct name

Having trouble forming a backup shell script for nested vm's There are multiple filenames (vm1, webserver, sshserver, etc.) with nothing in common other than .qcow2. I need to store just the ...
12
votes
5answers
3k views

Is gzip atomic?

Is gzip atomic? What happens if I stop the gzip process while it's in the middle of gzipping a file? If it's not atomic, and if I already pressed Ctrl+C on a gzip *.txt process, how do I safely ...
0
votes
0answers
32 views

Extracting a zipped archive (.gz) doesn't extract all of the files (GalliumOS)

Basically, I am installing PyCharm. And when i extract the tar.gz file, a JSON file and a txt file don't appear in the new extracted location. The files are also missing if I use ls to try to view ...
0
votes
0answers
61 views

In qemu using gzip return unexpected end of file gzip

When i download a file in /dev/sda1, and qemu -device file=/dev/sda1,format=raw to boot with it, gzip -d return unexpected end of file gzip. However, in my host machine, tar -xf it works fine. So ...
2
votes
1answer
119 views

Find exec - Why {} can't be used as the output file name? [duplicate]

I tried this command to compress all the css files in all subdirectories. find . -iname "*.css*" -exec gzip -c '{}' > '{}'.gz \; But it only creates a {}.gz file. I ended up using this: find . -...
1
vote
2answers
693 views

Extract gzip from data file

I'm looking for some guidance on how to get this gzip out of a data file. $ file cut6 cut6: data $ binwalk cut6 DECIMAL HEXADECIMAL DESCRIPTION ....................................... 1 ...
0
votes
2answers
322 views

Alternative of too much slow gzip -d command

I'm using an production server for loading large data set to Hadoop to access from Hive table. We are loading subscribers web browsing data of Telecom Sector. We've large number of .csv.gz file (File ...
3
votes
4answers
2k views

gzip compress a local folder and extract it to remote server

I am new to these commands. I am trying to gzip a local folder and unzip the same on the remote server. The thing is, gzipping and unzip must happen on the fly. I tried many and one of the closest I ...
0
votes
0answers
42 views

Tar files in groups by total size

I need to tar (and gzip) a long list of files but I need to do that in groups based on each group size. For example assume I have a list of 100 files, 1Mb each and I want to create archives that are ...
0
votes
2answers
124 views

How to know the real file type of files inside a zip or tar.gz file?

I have multiple .tar.gz and .zip files and I wanted to know the file types of files inside these files without extracting them. How can I achieve this. I can list the files of .tar.gz using the ...
0
votes
1answer
324 views

Writing a Shell script to tail and gzip a log file

I'm trying to make a script that can tail log files from a remote server to my local directory. tail -F is what I'm using but after piping it with gzip, nothing happens although a local copy of the ...
2
votes
4answers
773 views

Create archive (tar.gz, …) from file given via stdin

I would like to automatically create a compressed archive from a file given via stdin (or create the archive, if it doesn't exist yet), while specifying the file name that it's going to have inside ...
3
votes
1answer
68 views

Find files then move them and rename them at the same time?

Currently I use three steps to gzip some static assets and then use s3cmd to an S3 bucket (technically it's a Digital Ocean Spaces bucket). Here's what I do: $ find . -type f -name '*.css' | xargs -I{...
0
votes
3answers
3k views

How to find the string in the list of .gz files?

I have a list of folders in each folder I have around 600 .gz files which are automatically generated by the system every 15 min. I need to display the particular string which is repeated in that .gz ...

1
2 3 4 5
7