All Questions

Tagged with
Filter by
Sorted by
Tagged with
-1
votes
1answer
36 views

Choosing best directories to compress and save disk space

What's the best way to estimate the compression level that can be achieved for a directory without storing the compressed files? I have a large amount of directories and sub-directories with files ...
0
votes
1answer
22 views

Is there a way to create a (compressed) squashfs that contains an uncompressed file

We have a large file that needs to be uncompressed inside a compressed squashfs. Is this possible without patching mksquashfs? Something like this would be nice: $ mksquashfs existing_squash.sqsh ...
0
votes
0answers
30 views

Unzip files in loop

I have the following code which extracts numbers from netcdf files and every loop puts them in another netcdf file. mapfile Latitude < <(tr -s ' ' '\n' < final_ADCP_Saved.matLatitude.txt) #...
0
votes
1answer
132 views

tar + compress folder to tar.gz and removed the folder

by the following way we tar the folder presto-server-0.210 to file tar -czvf presto-server-archive.tar.gz presto-server-0.210 so after we tar the folder , folder still exists is it possible to use ...
0
votes
0answers
83 views

How can I copy sparse files from a ext4 file system to an exfat file system and keep the apparent size?

My issue is that I am trying to copy files from my Ubuntu linux system which uses a ext4 file system to a Sandisk 1TB USB card, which uses an exFat system. In the ext4 system, the entire directory ...
1
vote
1answer
25 views

Using terminal to zip unknown amount of packages with dynamic names

I am trying to figure out a solution for unix based systems (maxOS, Linux) to zip unknown amount of packages, ideally without requiring users to install any additional third party software. I have ...
2
votes
1answer
124 views

Best compression for operating system image

I have an Operating system image of size 2.5G. I have a device with a limited size. Thus I was looking for the best possible solution for providing the compression. Below are the commands and ...
3
votes
0answers
47 views

How to unpack a tag.gz file without having 2x free space?

I have about 1 million small files, that take up about 20 GB. I need to upload them to a host that only has 23 GB free space. I would prefer compressing the files locally to increase the transmission ...
2
votes
1answer
188 views

Easy way to change compression level of a zip file [duplicate]

On linux, is there an easy way to recompress a zip file (changing compression-level) with preserving as most meta-data as possible (timestamps etc.)?
1
vote
1answer
272 views

tar: compress text stdin and stdout [duplicate]

Using tar, is it possible to compress stdin text and have the compressed data appear in stdout? Example: $ echo "test" | tar c - <compressed blob here> I'm using macOS Mojave.
0
votes
3answers
518 views

Linux determine ZIP size without compression

I would like to make a ZIP file using zip command. Zip file would contain large number of directories containing large numbers of subdirectories, files etc. Is there any way to calculate final size ...
-1
votes
1answer
367 views

How to split a compressed file?

I have a 44GB 7z compressed file that I compressed with lzma2 and it took around 11 hours (original file is a text file of 285GB). 7z a -t7z Files.7z -m0=lzma2 -mx=9 -aoa So, what I want is to do is ...
-2
votes
1answer
184 views

compress specific folder(directory) from folder with tar [closed]

I am trying to use tar to compress the subdirectories /root/folder/folder{1..5} into a single compressed archive test1.tar.bz2. I'm using the following command: tar -cvjf test1.tar.bz2 root/folder/...
0
votes
0answers
45 views

How to backup and compress quick rotating files to a remote server

I have a server application creating log files and rotating these files based on size. The files are time stamped at creation. The application then deletes the oldest file when X number of files in ...
1
vote
1answer
653 views

Zlib Compression

I want to compress a file using Zlib (Best compression) i have googled a bit around and i have found a way to compress, but it isn't at the best compression level, I'd love to get some help OS ...
2
votes
0answers
2k views

btfs: Zstd vs lzo [closed]

Linux 4.14 added support for Zstandard (or Zstd) compression. Here is a summary of the algorithm taken from Facebook's project website: Zstandard is a real-time compression algorithm, providing ...
1
vote
1answer
1k views

Selectively extract files from a .zip archive from command line

Suppose I have a large zip file (>50GB) and I want to extract some files off of it from the command line. To get the files I run the command: unzip -l myfile.zip | grep "foo" which gives me a list ...
2
votes
2answers
562 views

Best way to compress a folder of small pre-compressed files (images)?

I have a folder containing approximate 50GB of images and video files (~35k files) that I'd like to compress into a single file for storage along side a database. Are there any compression options (or ...
3
votes
1answer
411 views

Can ncompress compress a file to 99.99% rate?

I'm using the old ncompress to create a backup file. And what I see is amazing: [root@centos6 home]# ll -l -b mytest* -rw-r--r--. 1 root root 1073741824 Mar 8 13:41 mytest.iso -rw-r--r--. 1 root ...
1
vote
1answer
81 views

How can I create a compressed archive consisting of the largest files from multiple directories?

I want to write a script which will create a single compressed-archive file consisting of the largest files above a certain threshold from multiple directories. For example, I would like to know how ...
1
vote
0answers
122 views

password protection for logrotate compression

Is password protection possible with logrotate while compressing in Linux? If yes would someone let me know how? /root/NewLog { missingok notifempty compress size 20k daily ...
0
votes
1answer
55 views

Logging to a new file for a continues running script

I have a script providing login continuously( like 2-3 pages in a second). I was using below one liner. sh myscript.sh > /home/user/mylog I am running another script to zip this file when it ...
2
votes
1answer
99 views

Putting m files in a directory into n tar files by size?

Does anyone know if it's possible to create n tar files (of roughly equal size) out of a larger collection of files in a directory, in such a way that they can be extracted individually? I was ...
1
vote
0answers
125 views

Enable cuda support in libbsc

I am interested in using libbsc in CUDA support. libbsc is basically used for compression in GPU (as well as CPU). As far as I tested, it is running in CPU (openmp) not in NVIDIA GPU (CUDA driver ...
1
vote
1answer
1k views

On the fly compression of read- and writeable folder (like Windows EFS)?

Is there a possibility to compress the contents of a directory in Unix (especially AIX) on the fly, while still being able to read and write in the directory? Like the Windows EFS encryption does?
6
votes
3answers
9k views

Linux + how to compress the old log files automatically

Under /var/log/httpd folder, files are created with huge capacity!!! What solution can I use in order to compress the old files automatically (can logrotate handle this)? If yes, how to configure ...
2
votes
1answer
251 views

linux unbuffered compression options

I'm working on a embedded system and due to persistent memory restrictions, I need to compress a log file "on the fly". My objective is to have a one liner inside a script, which would look like this:...
2
votes
2answers
668 views

Squashfs minimal compression?

I'd like to create a squashfs image of a directory, but it's a huge one and even minimal compression would be a big win. Is there a way to do something like mksquashfs -1?
1
vote
0answers
657 views

On-the-fly decompression

I have 44 TB worth of gzipped files that are 1.5 GB each when compressed or 2.0 GB when uncompressed. I have a tool that can read only uncompressed files. I would like to avoid the overhead of ...
-1
votes
1answer
231 views

Erratic behavior with gzip on unix

I am compressing log files daily and very recently I have been seeing some crazy results on the file type of the file after compression. Normally you would expect file filename.gz returning gzip ...
0
votes
0answers
20 views

Gzip Mutliple files using single command [duplicate]

Want to Gzip my all the .csv files into a gzip file. I am using this command. gzip *.csv; Problem File contains '//' in its name that's why command is giving error. Error : - '//File.csv' is not a ...
7
votes
2answers
7k views

Compress zip files with higher compression

I have a large number of zip files that were compressed using the zip command. I would like to recompress them with the -9 flag to improve the compression ratio. Does anyone know if that can be done ...
1
vote
2answers
1k views

File compression - how to implement in Linux

I would like to be able to compress certain files (that I need to keep, but use rarely) on disk. I noticed that chattr +c flags a file for compression, but it doesn't seem to actually compress files. ...
7
votes
1answer
9k views

How to make nemo support compressing files by context menu?

I use Cinnamon on ArchLinux and Nemo is it's default file manager. I've tried 3 GUI file archivers (p7zip with WxGTK, peazip & file-roller), but none of them add a "compress option" in the context ...
1
vote
1answer
15k views

Uncompress txt.gz files [closed]

Trying to uncompress txt.gz files on Linux. gzip, gunzip, unzip are not recognizing the file format. The archive is guaranteed to be not corrupted.
3
votes
1answer
10k views

Updating tar.gz daily only with changed files [duplicate]

Possible Duplicate: Add/update a file to an existing tar.gz archive? I have some game files I wish to update daily and they create a tar.gz of the folder, but instead of making a full tar.gz of ...
5
votes
3answers
6k views

Can the initramfs image use a compression format other than gzip?

Can the initramfs image be compressed by a method other than gzip, such as lzma?