Questions tagged [hashsum]

Questions related to hashes, hash values or hash codes that are returned by hash functions such as SHA-1.

Filter by
Sorted by
Tagged with
1 vote
2 answers
39 views

Parallel md5sum on all *.txt files in directory

Trying to calculate md5 hash of all *.txt files in directory and store each in same filename but with extension replaced from .txt to .md5. For file: foo.txt i want to create file: foo.md5 with ...
user avatar
0 votes
1 answer
38 views

inconsistent capitals in sha256

I've downloaded a windows 10 OS and tested the sha256, compared to what they report for English international 64 bit (left hand side): [ ...
user avatar
0 votes
0 answers
18 views

Estrange \n at the end of the file name when checking my md5 files

For a reason a do not understand when checking my md5 files, it fails because the name of the file have a \n at the end but the file name doesn't have this character. These are old files I have on my ...
user avatar
0 votes
4 answers
142 views

Problems with replacing XML tag contents using sed

I have the following XML piece: <value id="1" creatorId="0" creationTime="1639487132" expirationTime="1639573532">+380554446363</value> <value id=...
user avatar
0 votes
1 answer
75 views

Get hash from file while you copy or move it

Say I copy a file with pv, is there any way to also get any hash, like md5, sha1, etc without having to read origin twice? It has to work with big files or block devices. Example command which does ...
user avatar
0 votes
1 answer
83 views

How to diff folders and get verbose information?

I have 2 ~55 Gb folders (with many subfolders) that contain more than 1500 files per ~30 Mb. I need to compare them and get information if some files are missing / new files persist or their hash is ...
user avatar
  • 47
0 votes
0 answers
46 views

mount device and md5sum is changed

If mount sdc2 partition using mount -t ext4 -o ro /dev/sdc2 /mnt/bob2 then try to write file tihi 1.txt with command (of course unsuccessfully): touch /mnt/bob2/ tihi 1.txt When I do md5sum /dev/sdc2/...
user avatar
0 votes
1 answer
299 views

Salt size in /etc/shadow

After user password change the size of salt decreased in RHEL/Centos 6, eg: cat /etc/shadow ... root:$6$FkMNsNxT$FW77....................nbL0...... bin:*:15422:0:99999:7::: ... As you can see, ...
user avatar
0 votes
0 answers
80 views

Grub : verify another disk boot files before chainloading

Hardware : 1 hard disk + 1 USB key Setup : new EFI install (secure boot enabled, Debian 11 OS) Question : Is it possible to make a regular OS install on the hard disk and then use another device to ...
user avatar
0 votes
0 answers
36 views

Need help for comparing checksums of files on remote servers

Algorithm: Take md5sums of files/directories from all servers [Pick server-list and DIR-list from a file] Compare md5sums of files from all servers with active-node [Active node can be any 1 node ...
user avatar
  • 51
3 votes
1 answer
505 views

Two supposedly same M4A files are giving different hash results. Why?

Two files containing same song, both in M4A format, output two different results when I calculate their hashes: md5sum f149e2d2a232a410fcf61627578c101a new.m4a ad26ed675342f0f45dcb5f9de9d586df old....
user avatar
  • 271
0 votes
1 answer
85 views

Saving hashed string in a variable

I need to hash a string with SHA-512 algoithm. I have a salt also. I'm trying in the script this: inputHash=$( perl -e 'print crypt("${array[3]}","\${pass[0]}\$${pass[1]}\$") . &...
user avatar
3 votes
3 answers
372 views

How can I parallelize command sha256sum or other hashing commands?

I want to parallelize hash calculation process because I have a very large amount of file counts and sizes. When I see CPU usage of these commands, I get upset because they are only using one thread; ...
user avatar
0 votes
2 answers
51 views

How does my linux OS make so quickly sign in process?

I have written this shell script to test sha-516 hash password string : myhash='$6$nxIRLUXhRQlj$t29nGt1moX3KcuFZmRwUjdiS9pcLWpqKhAY0Y0bp2pqs3fPrnVAXKKbLfyZcvkkcwcbr2Abc8sBZBXI9UaguU.' #Which is ...
user avatar
  • 111
0 votes
0 answers
59 views

How to use rsync correctly to compare file hashes of two directories incl. subdirectories and interpret its output?

To check equality of a local and a remote directory I want to compare the hashes of all the files and did: $ rsync -avcn /home/me-here/thisss/ me@other.server:/home/me-there/thisss/ > diffs.txt ...
user avatar
  • 151
1 vote
0 answers
77 views

can md5sum check ignore some warnings?

When I run md5sum -c I get errors such as "No such file or directory". I only want checksum that did not match and ignore files that could not be read. --quiet gives me same result.
user avatar
0 votes
1 answer
105 views

md5sum error when trying to run on text file

I'm trying to run a simple md5sum algorithm, given that I was getting problems before I decided to change my TMP file to a local directory that has enough allocated space (export TMP=some/local/...
user avatar
0 votes
1 answer
114 views

Need help calculate Salt

Can someone please help with calculating all possible salt values from password file? so I have this password file called file_1.txt that is salted and MD5 hashed and I want to prepare a rainbow table ...
user avatar
-1 votes
1 answer
43 views

Salt bit required

I'm trying to figure out if we have in Unix password file N amount of account passwords, how many bits should be used for salt? I understand that most Unix used 56 bit password and some uses 12 bit ...
user avatar
0 votes
0 answers
23 views

The download files has the same name, but different hashsum

I downloaded "testdisk-7.2-WIP.linux-x86_64.tar.bz2" from 2020 and 2021, they have the name and seems same version, but have different hashsums. Looking inside the packages, one is created ...
user avatar
  • 1
0 votes
1 answer
80 views

Linux SHA1 Time Complexity

Is time complexity of Linux SHA1 linear? That means that 2GB file is hashed twice longer than 1GB file?
user avatar
1 vote
2 answers
429 views

SHA1 verification of external deb package before install

I have a .deb file and its SHA1 checksum information. How do I check the .deb file's authenticity using this checksum before installing? There's many entries on Google for "how to verify ...
user avatar
  • 13
0 votes
0 answers
36 views

How to create a deterministic tar.gz using tar? [duplicate]

I have followed following answer for Tar produces different files each time and Why does the PIGZ produce a different md5sum. My goal is to generate deterministic compressed file in tar.gz format (...
user avatar
  • 230
10 votes
1 answer
1k views

Why is verifying downloads with MD5 hash considered insecure?

I have downloaded a Debian ISO with jigdo, the download has finished successfully, and printed the following message: FINISHED --2021-01-22 11:57:20-- Total wall clock time: 4.3s Downloaded: 9 files, ...
user avatar
  • 57.4k
-1 votes
2 answers
35 views

Shell Script to compute hash for every X bytes

I have a file of size 128KB, and would like to compute SHA256 hash for every 32KB. i.e Hash 1 - Start of file - Start of file + 32KB Hash 2 - 32KB - 64KB Hash 3 - 64KB - 96KB Hash 4 - 96KB - 128KB I ...
user avatar
  • 1
1 vote
1 answer
272 views

How to verify integrity of software when the download provider doesn't publish hashes?

I noticed that certain software does not provide hash anymore nowadays. E.g. Zoom https://zoom.us/download wolf@linux:~$ ls -lh zoom_amd64.deb -rw-rw-r-- 1 wolf wolf 44M Jan 1 00:00 zoom_amd64....
user avatar
  • 1,221
3 votes
2 answers
188 views

Concurrency of a find, hash val, and replace across large amount of rows

I have a bunch of files and for each row there is a unique value I'm trying to obscure with a hash. However there are 3M rows across the files and a rough calculation of the time needed to complete ...
user avatar
0 votes
1 answer
151 views

MD6 hash generation linux command for 128-bit, 256-bit, 512-bit MD6 hashes

there are multiple checksum commands in the GNU Core Utilities in most Linux distros for famous hashing algorithms like SHA2 or MD5, But I need a command for MD6 (message digest 6) checksum that can ...
user avatar
1 vote
2 answers
81 views

Recreate folder structure using md5 hashes

Given a long list of md5 checksums and copies of these files, renamed and in different folder structures: How can I recreate or recover the original filesystem structure? Assuming no hash collisions. ...
user avatar
  • 11
0 votes
1 answer
90 views

Is the difference between md5, sha1 and sha256 sums the less important the larger the file?

I am compressing a number of files with size in the order of 5GB before sharing them. On the one hand, I would like to provide a hash sum for the recipient to check the files' integrity. On the other ...
user avatar
1 vote
1 answer
407 views

Hash-based filesystem?

Is there a hash-based filesystem, where: There is a store of blocks (perhaps 512b, 4KB or 128KB) indexed by the hash of their contents. Each block has a usage count. When it reaches zero, the block'...
user avatar
  • 579
0 votes
1 answer
506 views

how to add md5sum value for csv file using awk

I have csv file as mentioned below format, 1,123-456,IND 2,234-567,US 3,345-678,AUS 4,333-444,SA I don't want to use any loops, I want to generate md5sum value for each row using AWK command as ...
user avatar
  • 9
2 votes
3 answers
358 views

What command will give me a binary delta between two files and let me apply it?

I have two large files. a.qcow2 is 16GB. b.qcow2 is 17GB. The first 16GB of b.qcow2 is 95% identical to a.qcow2. What Linux commands will let me produce the delta between the two files? (Which ...
user avatar
  • 579
0 votes
3 answers
212 views

verify sha1sum and print directory & filename of corrupt files

I have a series of directories with sha1sums and md5sums files in. The format of these files is the usual hash space space filename, with one hash/file per line. I want to verify the files and print ...
user avatar
  • 3
8 votes
2 answers
2k views

Why are end-of-file and end-of-input-signal treated differently by sha256sum?

I was trying to compute sha256 for a simple string, namely "abc". I found out that using sha256sum utility like this: sha256sum file_with_string gives results identical to: sha256sum # ...
user avatar
  • 191
1 vote
1 answer
145 views

MX Linux ISO checksum mismatch

I went to the MX Linux website and their "Direct Download" linked me to their Sourceforge downloads page. I selected the first option - MX-19.2_September_x64.iso then checked the download ...
user avatar
  • 13
-1 votes
2 answers
1k views

How do I md5sum all files in /bin and sub directories and verify the hash using bash script?

I tried with find /bin -type -f -exec md5sum {} + >>sum.md5 The /bin directory contains a variety of files types, but the above returns the checksums for only regular files. Is there any way ...
user avatar
0 votes
1 answer
53 views

Hash sum via pipe, abort if no match

How can I verify a checksum of a file by piping it? e.g. I want to do something like curl -sL https://example.org/maybe-safe-maybe-not.tar.gz | md5sum 8da7904f495f682c39fa505b6404f9d1 | tar xvzC /usr/...
user avatar
  • 734
1 vote
2 answers
87 views

How to implement string to array hash in perl?

I am trying to count occurrence of each word on particular line of input. Given example (what I am trying to achieve): $./foo.pl asd fgh asd iop zxc asd: 1, 2 fgh: 1 iop: 2 zxc: 3 Just a program to ...
user avatar
0 votes
1 answer
148 views

Help with regex with sed -i for a tampermonkey script

I'm writing a tampermonkey script, using git and jsdelivr to store and send it to the users. For the jsdelivr to work correctly, i need to change the commit hash in the url. // @require https:/...
user avatar
0 votes
0 answers
22 views

how to check if someone override a directory?

Lets say i have an existing directory and someone did cp -r over this and some files changed. I want to detect this change. How can i do it ? I thought of using md5 or some checksum calculator for ...
user avatar
1 vote
1 answer
281 views

How to use openssl shake256 hash string into a specified length hash-string?

How to use openssl shake256 hash string to a specified length hash-string? I use the following command to generate a shake256 hash string with the default length in Linux: echo -n 28713 | openssl ...
user avatar
  • 11
0 votes
1 answer
97 views

How to append input to sha256sum

I want to type in sha256sum, then << cat, so that I can enter in some word and then receive the output as the hash. But I can't do this because it shows me no file called cat, or shows me a ...
user avatar
0 votes
0 answers
25 views

Trying to use seek and skip, but md5 is different

I ran into an unexpected behavior when using dd. I write this to myfile: root@io-generator-app-0:/# dd if=/dev/urandom skip=10 of=/tmp/myfile bs=4k Then using skip option again to write it to some ...
user avatar
2 votes
1 answer
864 views

VirutalBox: apt download / hashing problem (APT Hash Sum Mismatch)

I'm trying to install docker with apt from the https://download.docker.com/linux/debian/ repo. Unfortunately installation always fails with a hash mismatch warning. I have already tried everything ...
user avatar
  • 62
3 votes
1 answer
388 views

ConnMan: how to store password as hash?

We are looking for a way to get ConnMan to hash passwords (hashed on disk, i.e. not in plain text). We are wondering if it is possible to enable such feature by compile-time definition or runtime ...
user avatar
0 votes
1 answer
183 views

Checksum during rsync questions

Simple questions, I hope. if I'm running checksum (as a -c flag) on rsync, like so - rsync -c --log-file="/location/logfile.txt" \ -e "ssh -p {port number}" {source} {destination} will detected ...
user avatar
  • 11
1 vote
0 answers
144 views

Checksum comparison file too large

I am trying to run a checksum comparison task on a large folder that I rsync from one Synology server to another. What I am trying to get is an output that shows me any differences between the ...
user avatar
  • 11
1 vote
0 answers
536 views

Fresh download kali-linux-2020.2a-rpi3-nexmon-64.img.xz chksum mismatch

The downloaded file is a different size to that on the Kali website: https://www.offensive-security.com/kali-linux-arm-images/ Kali Linux RaspberryPi 2 (v1.2), 3 and 4 (64-Bit) Torrent 2020.2a ...
user avatar
0 votes
2 answers
1k views

How should I replace a value in JSON file with its md5 value using jq command?

I have a big log file containing a line as below example : {"data_1":210,"target_number":1096748811,"extra_data":66} {"data_1":0,"target_number":7130881445,"extra_data":56} {"data_1":1712,"...
user avatar
  • 121

1
2 3 4 5 6