Questions tagged [hashsum]
Questions related to hashes, hash values or hash codes that are returned by hash functions such as SHA-1.
278
questions
0
votes
1
answer
18
views
Using rsync to query the checksum of a remote file
Can we use rsync to simply get the checksum of a remote file, without transferring it?
This could be useful for verifying the integrity of remote files without using a lot of bandwidth, if you don't ...
- 911
0
votes
0
answers
236
views
Why is DM-Integrity so slow compared to BTRFS?
I want to detect silent corruption of block devices similar to how BTRFS does that for files. I'd even like to do that below BTRFS (and disable BTRFS's native checksumming) so that I can tweak more ...
- 260
0
votes
1
answer
53
views
How to calculate the checksum while writing random data to a disk?
I have a disk which is perhaps broken. I want to write random data to the disk and later verify the md5 checksum.
I write to the disk like this:
dd if=/dev/urandom of=/dev/sda bs=4M status=progress
...
- 779
1
vote
1
answer
62
views
md5sum of image and sd-card partition differ
I am creating an image of an sd-card partition (dd) and eventually the checksum (md5sum) of the image and the partition are not the same.
What am i doing wrong?
My sd card is inserted into an external ...
- 13
0
votes
1
answer
26
views
Extracting salt:hash from a text file
Currently, I don't seem to be able to find a script or guide online to find out how to extract the hash:salt into a text file.
For example
user,7,17,email,alis,,,b8e44d9a607d0c547294b24eac45399:...
0
votes
3
answers
185
views
How to associate a file to an hash code, and use it to find the file anywhere in the filesystem
I would like to create a tool (a shell script, or maybe a Python script) to generate and associate an hash code to a file, and then be able to use that hash to retrieve the file in the filesystem (...
- 327
0
votes
1
answer
129
views
Is MD5 still a viable solution for validating the integrity of files?
I read about the MD5 collision and that MD5 is not reliable anymore, however, I'm curious if that applies when we check the integrity of files. I've noticed that tools such as the FLAC/metaflac (Free ...
- 273
1
vote
1
answer
113
views
Calculate checksum for whole content of a device and add a progress bar
I want to make a shell script, that lets the user select a mounted device and calculate a checksum for the whole data on this device. I need the checksum to test if the device has been manipulated by ...
- 45
3
votes
2
answers
382
views
Wait until md5sum command is completed
#!/bin/bash
cd /path-to-directory
md5=$(find . -type f -exec md5sum {} \; | sort -k 2 | md5sum)
zenity --info \
--title= "Calculated checksum" \
--text= "$md5"
The process of a ...
- 45
0
votes
1
answer
29
views
tar archive and checksum empty
On a centos 7 I'm trying to arhive and do a checksum over a directory but at the end the files are empty.
localpath=/backup
name=$(date '+%Y-%m-%d')
tar cvzf $localpath/BackUp$name.tgz $localpath/...
1
vote
3
answers
214
views
How to set default root algorithm to sha512 on Linux?
I can see the content below in /etc/shadow. The root password's hash algorithm is md5, but the test user's is sha512:
root:$1$RjnJa1j6$.HbXUfxVzGSSAgSvz52Zm1:19251:0:99999:7:::
.
.
.
test:$6$...
- 11
3
votes
3
answers
790
views
How to create a hash / sha256sum in bash with more than one source / input and what is the best method?
Wanna create a hash of more than one source in bash.
I know that i can:
echo -n "STRING" | sha256sum
or
sha256sum [FILE]
What i need is:
STRING + FILE
FILE + FILE
STRING + STRING
STRING + ...
- 2,061
0
votes
5
answers
171
views
Extract hash from file name
When archiving certain data we encode the archive's sha1 HASH within the file name so as to determine the integrity of the archive.
I am trying to find a way to automate the integrity check by ...
- 1
0
votes
1
answer
824
views
How to make archive file with checksum like tar.md5 or tar.gz.md5?
How can I add checksum information to a TAR archive, as in
file.tar -> file.tar.md5 or
file.tar.gz -> file.tar.gz.md5
I have searched everywhere but there is no guide or app about it. I need ...
1
vote
1
answer
1k
views
How to compare hashes of files in bash script?
I am using sha256sum to check whether file has changed or not within the bash script. My idea is to first store the sha256sum in a *.sha256 file. Then if this is present then use this for sha256 ...
- 147
7
votes
3
answers
1k
views
How to show progress when checking checksums using sha256sum
How do I show the progress when when checking the SHA256 checksums of large files? When I do sha256sum -c SHA256SUMS where the file SHA256SUMS contains the checksum for a large file, there is no ...
- 2,334
1
vote
2
answers
300
views
Parallel md5sum on all *.txt files in directory
Trying to calculate md5 hash of all *.txt files in directory and store each in same filename but with extension replaced from .txt to .md5.
For file: foo.txt
i want to create file: foo.md5
with ...
- 131
0
votes
1
answer
109
views
inconsistent capitals in sha256
I've downloaded a windows 10 OS and tested the sha256, compared to what they report for English international 64 bit (left hand side):
[ ...
0
votes
0
answers
120
views
Estrange \n at the end of the file name when checking my md5 files
For a reason a do not understand when checking my md5 files, it fails because the name of the file have a \n at the end but the file name doesn't have this character. These are old files I have on my ...
0
votes
4
answers
212
views
Problems with replacing XML tag contents using sed
I have the following XML piece:
<value id="1" creatorId="0" creationTime="1639487132" expirationTime="1639573532">+380554446363</value>
<value id=...
0
votes
1
answer
478
views
Get hash from file while you copy or move it
Say I copy a file with pv, is there any way to also get any hash, like md5, sha1, etc without having to read origin twice? It has to work with big files or block devices.
Example command which does ...
- 175
0
votes
1
answer
376
views
How to diff folders and get verbose information?
I have 2 ~55 Gb folders (with many subfolders) that contain more than 1500 files per ~30 Mb.
I need to compare them and get information if some files are missing / new files persist or their hash is ...
- 37
0
votes
0
answers
161
views
mount device and md5sum is changed
If mount sdc2 partition using mount -t ext4 -o ro /dev/sdc2 /mnt/bob2 then try to write file tihi 1.txt with command (of course unsuccessfully):
touch /mnt/bob2/ tihi 1.txt
When I do md5sum /dev/sdc2/...
0
votes
1
answer
1k
views
Salt size in /etc/shadow
After user password change the size of salt decreased in RHEL/Centos 6, eg:
cat /etc/shadow
...
root:$6$FkMNsNxT$FW77....................nbL0......
bin:*:15422:0:99999:7:::
...
As you can see, ...
0
votes
0
answers
88
views
Need help for comparing checksums of files on remote servers
Algorithm:
Take md5sums of files/directories from all servers [Pick server-list and DIR-list from a file]
Compare md5sums of files from all servers with active-node [Active node can be any 1 node ...
- 51
3
votes
1
answer
578
views
Two supposedly same M4A files are giving different hash results. Why?
Two files containing same song, both in M4A format, output two different results when I calculate their hashes:
md5sum
f149e2d2a232a410fcf61627578c101a new.m4a
ad26ed675342f0f45dcb5f9de9d586df old....
- 291
0
votes
1
answer
283
views
Saving hashed string in a variable
I need to hash a string with SHA-512 algoithm. I have a salt also.
I'm trying in the script this:
inputHash=$( perl -e 'print crypt("${array[3]}","\${pass[0]}\$${pass[1]}\$") . &...
- 1
3
votes
3
answers
899
views
How can I parallelize command sha256sum or other hashing commands?
I want to parallelize hash calculation process because I have a very large amount of file counts and sizes.
When I see CPU usage of these commands, I get upset because they are only using one thread; ...
- 31
0
votes
2
answers
60
views
How does my linux OS make so quickly sign in process?
I have written this shell script to test sha-516 hash password string :
myhash='$6$nxIRLUXhRQlj$t29nGt1moX3KcuFZmRwUjdiS9pcLWpqKhAY0Y0bp2pqs3fPrnVAXKKbLfyZcvkkcwcbr2Abc8sBZBXI9UaguU.' #Which is ...
- 111
0
votes
0
answers
242
views
How to use rsync correctly to compare file hashes of two directories incl. subdirectories and interpret its output?
To check equality of a local and a remote directory I want to compare the hashes of all the files and did:
$ rsync -avcn /home/me-here/thisss/ me@other.server:/home/me-there/thisss/ > diffs.txt
...
- 153
1
vote
0
answers
270
views
can md5sum check ignore some warnings?
When I run md5sum -c I get errors such as "No such file or directory". I only want checksum that did not match and ignore files that could not be read. --quiet gives me same result.
- 21
0
votes
1
answer
301
views
md5sum error when trying to run on text file
I'm trying to run a simple md5sum algorithm, given that I was getting problems before I decided to change my TMP file to a local directory that has enough allocated space (export TMP=some/local/...
0
votes
1
answer
242
views
Need help calculate Salt
Can someone please help with calculating all possible salt values from password file? so I have this password file called file_1.txt that is salted and MD5 hashed and I want to prepare a rainbow table ...
-1
votes
1
answer
73
views
Salt bit required
I'm trying to figure out if we have in Unix password file N amount of account passwords, how many bits should be used for salt? I understand that most Unix used 56 bit password and some uses 12 bit ...
0
votes
0
answers
26
views
The download files has the same name, but different hashsum
I downloaded "testdisk-7.2-WIP.linux-x86_64.tar.bz2" from 2020 and 2021, they have the name and seems same version, but have different hashsums. Looking inside the packages, one is created ...
- 1
0
votes
1
answer
185
views
Linux SHA1 Time Complexity
Is time complexity of Linux SHA1 linear? That means that 2GB file is hashed twice longer than 1GB file?
- 103
1
vote
2
answers
894
views
SHA1 verification of external deb package before install
I have a .deb file and its SHA1 checksum information.
How do I check the .deb file's authenticity using this checksum before installing?
There's many entries on Google for "how to verify ...
- 13
0
votes
0
answers
36
views
How to create a deterministic tar.gz using tar? [duplicate]
I have followed following answer for Tar produces different files each time and Why does the PIGZ produce a different md5sum. My goal is to generate deterministic compressed file in tar.gz format (...
- 440
10
votes
1
answer
1k
views
Why is verifying downloads with MD5 hash considered insecure?
I have downloaded a Debian ISO with jigdo, the download has finished successfully, and printed the following message:
FINISHED --2021-01-22 11:57:20--
Total wall clock time: 4.3s
Downloaded: 9 files, ...
- 61.5k
-1
votes
2
answers
125
views
Shell Script to compute hash for every X bytes
I have a file of size 128KB, and would like to compute SHA256 hash for every 32KB. i.e
Hash 1 - Start of file - Start of file + 32KB
Hash 2 - 32KB - 64KB
Hash 3 - 64KB - 96KB
Hash 4 - 96KB - 128KB
I ...
- 1
1
vote
1
answer
431
views
How to verify integrity of software when the download provider doesn't publish hashes?
I noticed that certain software does not provide hash anymore nowadays.
E.g.
Zoom
https://zoom.us/download
wolf@linux:~$ ls -lh zoom_amd64.deb
-rw-rw-r-- 1 wolf wolf 44M Jan 1 00:00 zoom_amd64....
- 1,381
3
votes
2
answers
204
views
Concurrency of a find, hash val, and replace across large amount of rows
I have a bunch of files and for each row there is a unique value I'm trying to obscure with a hash.
However there are 3M rows across the files and a rough calculation of the time needed to complete ...
- 155
0
votes
1
answer
277
views
MD6 hash generation linux command for 128-bit, 256-bit, 512-bit MD6 hashes
there are multiple checksum commands in the GNU Core Utilities in most Linux distros for famous hashing algorithms like SHA2 or MD5, But I need a command for MD6 (message digest 6) checksum that can ...
- 153
1
vote
2
answers
179
views
Recreate folder structure using md5 hashes
Given a long list of md5 checksums and copies of these files, renamed and in different folder structures: How can I recreate or recover the original filesystem structure? Assuming no hash collisions.
...
- 11
0
votes
1
answer
152
views
Is the difference between md5, sha1 and sha256 sums the less important the larger the file?
I am compressing a number of files with size in the order of 5GB before sharing them.
On the one hand, I would like to provide a hash sum for the recipient to check the files' integrity. On the other ...
- 1,029
2
votes
1
answer
787
views
Hash-based filesystem?
Is there a hash-based filesystem, where:
There is a store of blocks (perhaps 512b, 4KB or 128KB) indexed by the hash of their contents.
Each block has a usage count. When it reaches zero, the block'...
- 723
0
votes
1
answer
1k
views
how to add md5sum value for csv file using awk
I have csv file as mentioned below format,
1,123-456,IND
2,234-567,US
3,345-678,AUS
4,333-444,SA
I don't want to use any loops, I want to generate md5sum value for each row using AWK command as ...
- 9
4
votes
3
answers
587
views
What command will give me a binary delta between two files and let me apply it?
I have two large files.
a.qcow2 is 16GB.
b.qcow2 is 17GB.
The first 16GB of b.qcow2 is 95% identical to a.qcow2.
What Linux commands will let me produce the delta between the two files? (Which ...
- 723
0
votes
3
answers
354
views
verify sha1sum and print directory & filename of corrupt files
I have a series of directories with sha1sums and md5sums files in. The format of these files is the usual hash space space filename, with one hash/file per line. I want to verify the files and print ...
- 3
9
votes
2
answers
3k
views
Why are end-of-file and end-of-input-signal treated differently by sha256sum?
I was trying to compute sha256 for a simple string, namely "abc". I found out that using sha256sum utility like this:
sha256sum file_with_string
gives results identical to:
sha256sum # ...
- 193