Questions tagged [checksum]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0 votes
0 answers
29 views

Is there any tool to verify full checksum of a local Debian mirror repository?

We have a local server acting as local Debian mirror repository (for main contrib non-free). We used apt-mirror to sync it. Is there any way to run a routine full scrub or checksum validation for all ...
user avatar
0 votes
0 answers
132 views

what are the causes for "checksum does not match inode" HD problem, even if it says the inode check passed?

Root became RO after some minutes using the PC. On reboot it required manual fsck. Then this problem happened: it said the inode check passed fine ok, but said this problem: "checksum does not ...
user avatar
0 votes
1 answer
85 views

How can I create a checksum for a folder full of files that I am copying to another hard disk to verify it?

I am on a 2015 MacBook Pro and have just updated to OS 12.01 Monterey, and to zsh on terminal. I am able to create a checksum for individual files using shasum -a 256 (then drag in a file). However, I ...
user avatar
2 votes
0 answers
120 views

Compare zip file and extracted directory

What is the simplest way to compare a zip file and a directory that has been extracted from the zip file? I would like to delete the zip file if they are the same. Example. Need to check if Archive....
user avatar
  • 121
16 votes
1 answer
2k views

Splitting a small file into 512 byte segments changes it, but splitting it in 1k segments doesn't

So I'm trying to split a 64MB file FileCarve.001 into 512 byte segments (each block is 512 bytes long). I need to make sure the file has the same data when split into smaller files, so I cat all the ...
user avatar
-3 votes
1 answer
56 views

Difference between diff and sum utilities

We use diff for finding difference between two files. We use checksum utilities for finding hashes and compare them later. In this regards, I have some questions : Can we diff any type of file ? For ...
user avatar
1 vote
0 answers
119 views

Checksum or validate .tar file contents with directory in shell

Scenario: Using Linux shell to back up a directory of many sub files and compressing the data with ‘tar -cvpJf filename.tar /savedir/’. Goal: Using shell — checksum or validate the newly created ‘.tar’...
user avatar
3 votes
1 answer
505 views

Two supposedly same M4A files are giving different hash results. Why?

Two files containing same song, both in M4A format, output two different results when I calculate their hashes: md5sum f149e2d2a232a410fcf61627578c101a new.m4a ad26ed675342f0f45dcb5f9de9d586df old....
user avatar
  • 271
1 vote
0 answers
77 views

can md5sum check ignore some warnings?

When I run md5sum -c I get errors such as "No such file or directory". I only want checksum that did not match and ignore files that could not be read. --quiet gives me same result.
user avatar
3 votes
3 answers
924 views

How to show the incorrect checksum when the computed checksum did not match

Suppose I try to verify the checksum of a file using: echo '760382d5e8cdc5d0d079e8f754bce1136fbe1473be24bb885669b0e38fc56aa3 emacs-26.1.tar.gz' | \ sha256sum --check If the file is corrupt and the ...
user avatar
  • 1,802
0 votes
1 answer
90 views

Make sure two folders are identical on compressed zfs and ext4

Summary I have copied (rsync --archive) a folder from an ext4 filesystem to a zfs file system with compression on. Now, I'm trying to verify that both folders are identical so that I can safely delete ...
user avatar
  • 151
3 votes
1 answer
64 views

Checksum of binary changes after rsync-ing to remote machine [closed]

I'm attempting to copy a binary to a remote machine using rsync, however it appears to corrupt in some way, with both file and md5sum noting the files difference, rsync on the other hand does not ...
user avatar
  • 61
2 votes
2 answers
238 views

How to rename a file to its creation date and hash value combined in order to achieve unique filename?

I have bunch of .JPG, .NEF and .MOV files made with my Nikon DSLR, named as DSC_0001.JPG, DSC_0002.JPG and so on. After certain number is reached, new directory is made and number count restarted, ...
user avatar
  • 271
0 votes
1 answer
151 views

MD6 hash generation linux command for 128-bit, 256-bit, 512-bit MD6 hashes

there are multiple checksum commands in the GNU Core Utilities in most Linux distros for famous hashing algorithms like SHA2 or MD5, But I need a command for MD6 (message digest 6) checksum that can ...
user avatar
10 votes
5 answers
8k views

Why doesn't changing a file's name change its checksum?

As far as I know changing even a bit of a file, will change the whole checksum result, but when I change a file's name this does not affect its checksum (I've tried SHA-1, SHA-256 and MD5). Why? file ...
user avatar
1 vote
1 answer
145 views

MX Linux ISO checksum mismatch

I went to the MX Linux website and their "Direct Download" linked me to their Sourceforge downloads page. I selected the first option - MX-19.2_September_x64.iso then checked the download ...
user avatar
  • 13
0 votes
1 answer
59 views

Check installed packages + check effective deployement of packages [to detect problems caused by memory corruption]

My computer has a flawed memory stick for two years and I can't correct this (sticks aren't removable and computer cannot be changed : so it won't be the subject). Sometimes a content is corrupted ...
user avatar
  • 719
2 votes
1 answer
577 views

sha1sum reports that checksums do not match even though they are identical

Perhaps I'm doing something very stupid here, but Google hasn't been very helpful in resolving the problem. I have an archive of files I made for backup purposes. I've generated an SHA1 checksum file ...
user avatar
0 votes
0 answers
22 views

how to check if someone override a directory?

Lets say i have an existing directory and someone did cp -r over this and some files changed. I want to detect this change. How can i do it ? I thought of using md5 or some checksum calculator for ...
user avatar
0 votes
1 answer
111 views

Can GNU tar incremental backup use checksums?

According to GNU tar manual: Incremental dumps depend crucially on time stamps, so the results are unreliable if you modify a file's time stamps during dumping (e.g., with the `--atime-preserve=...
user avatar
  • 419
1 vote
0 answers
41 views

Is the output of `zfs send` deterministic?

My goal is to generate a single checksum for the entirety of a ZFS snapshot. If zfs send is deterministic (including across systems, meaning including on the system that receives the snapshot), then ...
user avatar
  • 1,226
0 votes
1 answer
182 views

Checksum during rsync questions

Simple questions, I hope. if I'm running checksum (as a -c flag) on rsync, like so - rsync -c --log-file="/location/logfile.txt" \ -e "ssh -p {port number}" {source} {destination} will detected ...
user avatar
  • 11
1 vote
0 answers
144 views

Checksum comparison file too large

I am trying to run a checksum comparison task on a large folder that I rsync from one Synology server to another. What I am trying to get is an output that shows me any differences between the ...
user avatar
  • 11
3 votes
0 answers
39 views

A_Parity_Error_?

Now this is odd: While copying a tarred directory over my LAN using ssh from a Fedora machine to a FreeBSD machine. I get: Uncorrectable parity/CRC error (All the disks are set with S.M.A.R.T – ...
user avatar
  • 31
2 votes
1 answer
613 views

Linux Live USB MD5 checksum integrity check failed for 5 files, are these files relevant?

When running manually the MD5 checksum integrity check from a USB Live Boot medium (Linux Mint 19), the command line shows "failed" for these 5 files: grub.cfg loopback.cfg chain.c32 isolinux.cfg ...
user avatar
1 vote
0 answers
23 views

Adding UDP checksum in IP layer after Xfrm transformation

I am doing a custom transformation of the packet using xfrm tables (IPv6). As part of the transformation, I am adding a UDP header (basically putting my data into an UDP a.k.a UDP encapsulation). The ...
user avatar
  • 11
0 votes
1 answer
84 views

How to calculate the checksum of a file's name?

I tried with openssl as it is very fast: openssl sha1 "$(basename "very_big_image.png")" But this just substitutes the actual file for check summing.
user avatar
2 votes
0 answers
155 views

Why do we need filesystem block checksum?

Each sector on the disk has its own ECC to detect (and can sometimes correct) data corruption. Yet some filesystems like Btrfs and ZFS provide checksum for each of their data block. Is it really ...
user avatar
  • 445
0 votes
2 answers
927 views

Count the sum of wc -l command output

i have a workspace tree like : /Directory /Dir1/file1, file2 /Dir2/file3, file4 /Dir3/file5, file6 ... I want to count the sum of the number of lines for each file in dir. I have this script,...
user avatar
0 votes
1 answer
1k views

Request file checksum from FTP server?

I am downloading some large files from a remote FTP server. Is it possible to request the server to send me checksums (e.g. sha256, or related variants) for the files in question?
user avatar
  • 1,477
0 votes
0 answers
177 views

How can I validate the integrity of a torrent retrieved through DHT?

I've just downloaded a dataset made available through BitTorrent and (at length) transferred it to my home PC. Now I want to validate that nothing's been corrupted along the way. Unfortunately, the ...
user avatar
  • 889
0 votes
1 answer
205 views

Need help to create a checksum file of a directory on linux

I backup my data to an external hard drive regularly, and in the past, some of the files ended up getting corrupted and I haven't noticed it until it was too late. So to prevent this, I would like to ...
user avatar
4 votes
2 answers
584 views

File Corruption between 2 HDD

I have a NAS running Ubuntu 16.04 LTS server i386 (kernel 4.4.211-0404211-generic). I use it with samba to share movies and music through my home network. I've tried to copy ~ 100 Go of data from an ...
user avatar
  • 41
3 votes
2 answers
2k views

How to verify checksum file of centos 8?

How to verify that the CHECKSUM file for the CentOS 8 ISO is real? Download check sum and key: $ wget https://www.centos.org/keys/RPM-GPG-KEY-CentOS-Official $ wget http://www.gtlib.gatech.edu/pub/...
user avatar
1 vote
2 answers
315 views

unmount SD card makes file checksum change

I have an SD card mounted by Lubuntu at /media/$USERNAME/COREELEC/ I need to copy a file from one directory to another and rename it. However if I check the md5sum (or sha512sum) after I unmount it ...
user avatar
  • 355
2 votes
2 answers
81 views

How to calculate n values in a column and the overall average?

I would really appreciate some help with this as I am relativity new to Linux. I'm using grep but I also want an average of all of my extracted values (irrespective of which column they are in) and ...
user avatar
  • 65
7 votes
1 answer
455 views

Can files compressed with bzip2 be relied upon to be deterministic (reproducible)?

I am trying to determine if there are any potential issues using bzip2 to compress files that need to be 100% reproducible. Specifically: can metadata (name / inode, lastmod date, etc) or anything ...
user avatar
4 votes
1 answer
402 views

What checksum algorithm is used by Version 5 Unix?

I can't figure out, what algorithm was used in Unix V5 and V6 for the sum command. At first, I thought that it is a simple sum of bytes modulus 2^16. However for a string "1111111111\n" repeated 320 ...
user avatar
1 vote
2 answers
164 views

Keeping two offline data sets in sync

Suppose that we have two replicas A and B of a large data set in locations that don't have a good Internet connection. As a rule of thumb, let's say it's possible to transfer metadata but not actual ...
user avatar
  • 111
0 votes
1 answer
2k views

How to disable TCP checksum validation on Linux?

For some reason, I want to disable TCP checksum validation on my Linux host. Is that possible to disable it?
user avatar
1 vote
1 answer
501 views

do I use sha256sum or sha256hmac for file checksum

I have a text file with stuff in it I want to checksum it and create a hash for later use to know if the file has changed, when used anywhere else which to use? sha256sum myfile or sha256hmac myfile
user avatar
  • 4,101
0 votes
1 answer
294 views

EXT4 CRC32C checksum algorithms are badly documented

So I'm making some kind of research on EXT4 checksums. I found this page and tried to calculate checksum by myself. I've started with Superblock since it is sounds pretty simple: "The entire ...
user avatar
2 votes
1 answer
212 views

Can "parchive" be used for block devices?

As explained on wikipedia and Arch linux wiki "Parchive"s can be used to generate additional data for a file, that can be used in verification and even to some degree for repair/recovery of said file ...
user avatar
2 votes
1 answer
657 views

Use pv with find -exec

I use the following command to verify ~700 GiB of backed-up files: $ find -type f -exec md5sum {} + | sort > ~/checksums This takes many hours, so I would like to integrate pv into the command to ...
user avatar
  • 3,311
14 votes
6 answers
9k views

Print SHA sums without "-" at the end?

Is it possible to have SHA sums print without the - appended to the end? $ echo test | sha1sum 4e1243bd22c66e76c2ba9eddc1f91394e57f9f83 - <--- this "-" dash/hyphen I know we can use awk and ...
user avatar
5 votes
1 answer
750 views

Is there a CLI utility to compute the same CRC as used in ZIP files?

# Create random file $ dd if=/dev/urandom /of=./test.dat bs=1K count=1 # Zip it $ zip test.zip test.dat # Dump contents for ZIP-computed CRC $ unzip -v test.zip Archive: test.zip Length ...
user avatar
  • 7,834
1 vote
1 answer
2k views

What happened to elfsign and elfverify?

In "Uninformed Research -- informative information for the uninformed." 2003 mentions a tool called elfsign and elfverify. This is a tool to checksum and sign an ELF binary. I can't find that tool in ...
user avatar
  • 22.4k
2 votes
1 answer
1k views

Why does crc32 say some of my files are 'BAD'?

I used crc32 to compare some files with a backup of them. Out of 3556 files, 11 were reported as 'BAD' as in the following example: 9be46354 ./9836Feeding_the_dog_.mpeg BAD 9be46354 != ...
user avatar
  • 3,311
1 vote
3 answers
195 views

Is it possible to search for a file using the checksum instead of the name? [duplicate]

Suppose I want to do a search to find out if I have a file that matches the sha256 generated from the file test1.txtusing the command: sha256sum -b test1.txt I get as output: ...
user avatar
  • 151
4 votes
6 answers
28k views

How to verify a checksum using one command line?

Suppose I type and run the following command: sha256sum ubuntu-18.04.1-desktop-amd64.iso After a delay, this outputs the following: 5748706937539418ee5707bd538c4f5eabae485d17aa49fb13ce2c9b70532433 ...
user avatar