Questions tagged [hashsum]
Questions related to hashes, hash values or hash codes that are returned by hash functions such as SHA-1.
262
questions
1
vote
2
answers
39
views
Parallel md5sum on all *.txt files in directory
Trying to calculate md5 hash of all *.txt files in directory and store each in same filename but with extension replaced from .txt to .md5.
For file: foo.txt
i want to create file: foo.md5
with ...
- 111
0
votes
1
answer
38
views
inconsistent capitals in sha256
I've downloaded a windows 10 OS and tested the sha256, compared to what they report for English international 64 bit (left hand side):
[ ...
0
votes
0
answers
18
views
Estrange \n at the end of the file name when checking my md5 files
For a reason a do not understand when checking my md5 files, it fails because the name of the file have a \n at the end but the file name doesn't have this character. These are old files I have on my ...
0
votes
4
answers
142
views
Problems with replacing XML tag contents using sed
I have the following XML piece:
<value id="1" creatorId="0" creationTime="1639487132" expirationTime="1639573532">+380554446363</value>
<value id=...
0
votes
1
answer
75
views
Get hash from file while you copy or move it
Say I copy a file with pv, is there any way to also get any hash, like md5, sha1, etc without having to read origin twice? It has to work with big files or block devices.
Example command which does ...
- 169
0
votes
1
answer
83
views
How to diff folders and get verbose information?
I have 2 ~55 Gb folders (with many subfolders) that contain more than 1500 files per ~30 Mb.
I need to compare them and get information if some files are missing / new files persist or their hash is ...
- 47
0
votes
0
answers
46
views
mount device and md5sum is changed
If mount sdc2 partition using mount -t ext4 -o ro /dev/sdc2 /mnt/bob2 then try to write file tihi 1.txt with command (of course unsuccessfully):
touch /mnt/bob2/ tihi 1.txt
When I do md5sum /dev/sdc2/...
0
votes
1
answer
299
views
Salt size in /etc/shadow
After user password change the size of salt decreased in RHEL/Centos 6, eg:
cat /etc/shadow
...
root:$6$FkMNsNxT$FW77....................nbL0......
bin:*:15422:0:99999:7:::
...
As you can see, ...
0
votes
0
answers
80
views
Grub : verify another disk boot files before chainloading
Hardware : 1 hard disk + 1 USB key
Setup : new EFI install (secure boot enabled, Debian 11 OS)
Question : Is it possible to make a regular OS install on the hard disk and then use another device to ...
- 1
0
votes
0
answers
36
views
Need help for comparing checksums of files on remote servers
Algorithm:
Take md5sums of files/directories from all servers [Pick server-list and DIR-list from a file]
Compare md5sums of files from all servers with active-node [Active node can be any 1 node ...
- 51
3
votes
1
answer
505
views
Two supposedly same M4A files are giving different hash results. Why?
Two files containing same song, both in M4A format, output two different results when I calculate their hashes:
md5sum
f149e2d2a232a410fcf61627578c101a new.m4a
ad26ed675342f0f45dcb5f9de9d586df old....
- 271
0
votes
1
answer
85
views
Saving hashed string in a variable
I need to hash a string with SHA-512 algoithm. I have a salt also.
I'm trying in the script this:
inputHash=$( perl -e 'print crypt("${array[3]}","\${pass[0]}\$${pass[1]}\$") . &...
- 1
3
votes
3
answers
372
views
How can I parallelize command sha256sum or other hashing commands?
I want to parallelize hash calculation process because I have a very large amount of file counts and sizes.
When I see CPU usage of these commands, I get upset because they are only using one thread; ...
- 31
0
votes
2
answers
51
views
How does my linux OS make so quickly sign in process?
I have written this shell script to test sha-516 hash password string :
myhash='$6$nxIRLUXhRQlj$t29nGt1moX3KcuFZmRwUjdiS9pcLWpqKhAY0Y0bp2pqs3fPrnVAXKKbLfyZcvkkcwcbr2Abc8sBZBXI9UaguU.' #Which is ...
- 111
0
votes
0
answers
59
views
How to use rsync correctly to compare file hashes of two directories incl. subdirectories and interpret its output?
To check equality of a local and a remote directory I want to compare the hashes of all the files and did:
$ rsync -avcn /home/me-here/thisss/ me@other.server:/home/me-there/thisss/ > diffs.txt
...
- 151
1
vote
0
answers
77
views
can md5sum check ignore some warnings?
When I run md5sum -c I get errors such as "No such file or directory". I only want checksum that did not match and ignore files that could not be read. --quiet gives me same result.
- 21
0
votes
1
answer
105
views
md5sum error when trying to run on text file
I'm trying to run a simple md5sum algorithm, given that I was getting problems before I decided to change my TMP file to a local directory that has enough allocated space (export TMP=some/local/...
0
votes
1
answer
114
views
Need help calculate Salt
Can someone please help with calculating all possible salt values from password file? so I have this password file called file_1.txt that is salted and MD5 hashed and I want to prepare a rainbow table ...
-1
votes
1
answer
43
views
Salt bit required
I'm trying to figure out if we have in Unix password file N amount of account passwords, how many bits should be used for salt? I understand that most Unix used 56 bit password and some uses 12 bit ...
0
votes
0
answers
23
views
The download files has the same name, but different hashsum
I downloaded "testdisk-7.2-WIP.linux-x86_64.tar.bz2" from 2020 and 2021, they have the name and seems same version, but have different hashsums. Looking inside the packages, one is created ...
- 1
0
votes
1
answer
80
views
Linux SHA1 Time Complexity
Is time complexity of Linux SHA1 linear? That means that 2GB file is hashed twice longer than 1GB file?
1
vote
2
answers
429
views
SHA1 verification of external deb package before install
I have a .deb file and its SHA1 checksum information.
How do I check the .deb file's authenticity using this checksum before installing?
There's many entries on Google for "how to verify ...
- 13
0
votes
0
answers
36
views
How to create a deterministic tar.gz using tar? [duplicate]
I have followed following answer for Tar produces different files each time and Why does the PIGZ produce a different md5sum. My goal is to generate deterministic compressed file in tar.gz format (...
- 230
10
votes
1
answer
1k
views
Why is verifying downloads with MD5 hash considered insecure?
I have downloaded a Debian ISO with jigdo, the download has finished successfully, and printed the following message:
FINISHED --2021-01-22 11:57:20--
Total wall clock time: 4.3s
Downloaded: 9 files, ...
- 57.4k
-1
votes
2
answers
35
views
Shell Script to compute hash for every X bytes
I have a file of size 128KB, and would like to compute SHA256 hash for every 32KB. i.e
Hash 1 - Start of file - Start of file + 32KB
Hash 2 - 32KB - 64KB
Hash 3 - 64KB - 96KB
Hash 4 - 96KB - 128KB
I ...
- 1
1
vote
1
answer
272
views
How to verify integrity of software when the download provider doesn't publish hashes?
I noticed that certain software does not provide hash anymore nowadays.
E.g.
Zoom
https://zoom.us/download
wolf@linux:~$ ls -lh zoom_amd64.deb
-rw-rw-r-- 1 wolf wolf 44M Jan 1 00:00 zoom_amd64....
- 1,221
3
votes
2
answers
188
views
Concurrency of a find, hash val, and replace across large amount of rows
I have a bunch of files and for each row there is a unique value I'm trying to obscure with a hash.
However there are 3M rows across the files and a rough calculation of the time needed to complete ...
- 155
0
votes
1
answer
151
views
MD6 hash generation linux command for 128-bit, 256-bit, 512-bit MD6 hashes
there are multiple checksum commands in the GNU Core Utilities in most Linux distros for famous hashing algorithms like SHA2 or MD5, But I need a command for MD6 (message digest 6) checksum that can ...
- 153
1
vote
2
answers
81
views
Recreate folder structure using md5 hashes
Given a long list of md5 checksums and copies of these files, renamed and in different folder structures: How can I recreate or recover the original filesystem structure? Assuming no hash collisions.
...
- 11
0
votes
1
answer
90
views
Is the difference between md5, sha1 and sha256 sums the less important the larger the file?
I am compressing a number of files with size in the order of 5GB before sharing them.
On the one hand, I would like to provide a hash sum for the recipient to check the files' integrity. On the other ...
- 987
1
vote
1
answer
407
views
Hash-based filesystem?
Is there a hash-based filesystem, where:
There is a store of blocks (perhaps 512b, 4KB or 128KB) indexed by the hash of their contents.
Each block has a usage count. When it reaches zero, the block'...
- 579
0
votes
1
answer
506
views
how to add md5sum value for csv file using awk
I have csv file as mentioned below format,
1,123-456,IND
2,234-567,US
3,345-678,AUS
4,333-444,SA
I don't want to use any loops, I want to generate md5sum value for each row using AWK command as ...
- 9
2
votes
3
answers
358
views
What command will give me a binary delta between two files and let me apply it?
I have two large files.
a.qcow2 is 16GB.
b.qcow2 is 17GB.
The first 16GB of b.qcow2 is 95% identical to a.qcow2.
What Linux commands will let me produce the delta between the two files? (Which ...
- 579
0
votes
3
answers
212
views
verify sha1sum and print directory & filename of corrupt files
I have a series of directories with sha1sums and md5sums files in. The format of these files is the usual hash space space filename, with one hash/file per line. I want to verify the files and print ...
- 3
8
votes
2
answers
2k
views
Why are end-of-file and end-of-input-signal treated differently by sha256sum?
I was trying to compute sha256 for a simple string, namely "abc". I found out that using sha256sum utility like this:
sha256sum file_with_string
gives results identical to:
sha256sum # ...
- 191
1
vote
1
answer
145
views
MX Linux ISO checksum mismatch
I went to the MX Linux website and their "Direct Download" linked me to their Sourceforge downloads page. I selected the first option - MX-19.2_September_x64.iso then checked the download ...
- 13
-1
votes
2
answers
1k
views
How do I md5sum all files in /bin and sub directories and verify the hash using bash script?
I tried with
find /bin -type -f -exec md5sum {} + >>sum.md5
The /bin directory contains a variety of files types, but the above returns the checksums for only regular files. Is there any way ...
0
votes
1
answer
53
views
Hash sum via pipe, abort if no match
How can I verify a checksum of a file by piping it? e.g. I want to do something like
curl -sL https://example.org/maybe-safe-maybe-not.tar.gz | md5sum 8da7904f495f682c39fa505b6404f9d1 | tar xvzC /usr/...
- 734
1
vote
2
answers
87
views
How to implement string to array hash in perl?
I am trying to count occurrence of each word on particular line of input. Given example (what I am trying to achieve):
$./foo.pl
asd fgh
asd iop
zxc
asd: 1, 2
fgh: 1
iop: 2
zxc: 3
Just a program to ...
- 313
0
votes
1
answer
148
views
Help with regex with sed -i for a tampermonkey script
I'm writing a tampermonkey script, using git and jsdelivr to store and send it to the users.
For the jsdelivr to work correctly, i need to change the commit hash in the url.
// @require https:/...
0
votes
0
answers
22
views
how to check if someone override a directory?
Lets say i have an existing directory and someone did cp -r over this and some files changed. I want to detect this change. How can i do it ?
I thought of using md5 or some checksum calculator for ...
1
vote
1
answer
281
views
How to use openssl shake256 hash string into a specified length hash-string?
How to use openssl shake256 hash string to a specified length hash-string?
I use the following command to generate a shake256 hash string with the default length in Linux:
echo -n 28713 | openssl ...
- 11
0
votes
1
answer
97
views
How to append input to sha256sum
I want to type in sha256sum, then << cat, so that I can enter in some word and then receive the output as the hash. But I can't do this because it shows me no file called cat, or shows me a ...
- 1
0
votes
0
answers
25
views
Trying to use seek and skip, but md5 is different
I ran into an unexpected behavior when using dd.
I write this to myfile:
root@io-generator-app-0:/# dd if=/dev/urandom skip=10 of=/tmp/myfile bs=4k
Then using skip option again to write it to some ...
2
votes
1
answer
864
views
VirutalBox: apt download / hashing problem (APT Hash Sum Mismatch)
I'm trying to install docker with apt from the https://download.docker.com/linux/debian/ repo.
Unfortunately installation always fails with a hash mismatch warning. I have already tried everything ...
- 62
3
votes
1
answer
388
views
ConnMan: how to store password as hash?
We are looking for a way to get ConnMan to hash passwords (hashed on disk, i.e. not in plain text).
We are wondering if it is possible to enable such feature by compile-time definition or runtime ...
0
votes
1
answer
183
views
Checksum during rsync questions
Simple questions, I hope. if I'm running checksum (as a -c flag) on rsync, like so -
rsync -c --log-file="/location/logfile.txt" \
-e "ssh -p {port number}" {source} {destination}
will detected ...
- 11
1
vote
0
answers
144
views
Checksum comparison file too large
I am trying to run a checksum comparison task on a large folder that I rsync from one Synology server to another.
What I am trying to get is an output that shows me any differences between the ...
- 11
1
vote
0
answers
536
views
Fresh download kali-linux-2020.2a-rpi3-nexmon-64.img.xz chksum mismatch
The downloaded file is a different size to that on the Kali website:
https://www.offensive-security.com/kali-linux-arm-images/
Kali Linux RaspberryPi 2 (v1.2), 3 and 4 (64-Bit) Torrent 2020.2a ...
0
votes
2
answers
1k
views
How should I replace a value in JSON file with its md5 value using jq command?
I have a big log file containing a line as below example :
{"data_1":210,"target_number":1096748811,"extra_data":66}
{"data_1":0,"target_number":7130881445,"extra_data":56}
{"data_1":1712,"...
- 121