dd is a traditional utility for binary data copies

learn more… | top users | synonyms

0
votes
1answer
33 views

How to recover a node/content from a tarfile that's been overwritten

Disclaimer: I'm not very good at writing questions, and mine is a very specific scenario. So I'm just going to jump straight into the situation: I was browsing my filesystem, and somehow managed to ...
1
vote
1answer
51 views

Pretty print output of “kill -USR1”-ing dd

When dd is done it prints a three line summary about the number of read and written segments, the total size and average writing speed. While it does its work, dd is awfully quiet. Not too long ago ...
0
votes
1answer
86 views

USB key does not show up in /dev

We use a USB key system that are contain license files and are provided to unlock proprietary software that we used. The USB drives are small however and get lost easily, so I thought I'd clone them ...
4
votes
3answers
388 views

How do I DD over the network to an external HD?

I'm trying to clone a hard drive on my raspberry pi which is on the same network to an external harddrive of the computer I'm currently on. However I'm having issues piping the command correctly. I've ...
1
vote
2answers
75 views

Faster way to DD?

I am trying to DD a raw file to an SSD from a spin usb spin drive. I have tried compression (but it obviously has to expand before it can copy). I have watched the details of the arm7 gb ram device... ...
2
votes
1answer
246 views

How to fix BTRFS superblock error after resize/shrink (BTRFS: couldn't get super buffer head for bytenr 274877906944)

BTRFS RAID1 array with 2 500 GB hdds, no errors. This is the root filesystem, so there are 3 partitions on each drive: 1 = /boot (ext4), 2 = / (btrfs), 3 (swap) /boot is ext4 because upgrading the ...
11
votes
3answers
794 views

What does the two numbers mean respectively in dd's “a+b records” stats?

The first 2 lines in dd stats have the following format: a+b records in c+d records out Why 2 numeric values? What does this plus sign mean? It's usually a+0, but sometimes when I use bigger block ...
1
vote
1answer
84 views

How to prevent dd from freezing my system?

I want to fill the free space on my hard drive with a command like that : # dd if=/dev/zero of=z but it causes GNOME to freeze regularly for a few seconds. Even the mouse cursor is affected. How ...
0
votes
2answers
979 views

How to backup and restore to different hardware in Linux? [duplicate]

I am running Fedora 22 on a Dell Laptop. I plan on migrating to a desktop soon which will also run Fedora 22. What is the best way to go about backing up and restoring my laptop configuration to the ...
1
vote
1answer
38 views

Cloning and remounting sd card

I have a micro sd card that contains these partitions: Disk /dev/sdb: 29,7 GiB, 31914983424 bytes, 62333952 sectors Units: sectors of 1 * 512 = 512 bytes Sector size (logical/physical): 512 bytes / ...
0
votes
2answers
1k views

How to fix this I/O error on SD card?

EDIT: I tried with gparted, it didnt work. i found a SDFormatter, tool for windows that did the full erase. I have a SD card and want to install debian onto it. The dd process takes about 45 ...
1
vote
1answer
526 views

The dd command fails with an “Input/output” error while burning a USB stick

This question is somewhat related to the previous question I asked regarding the dd command, The dd command isn't appear to accomplish anything. I'm trying to burn the Ubuntu operating system ...
1
vote
3answers
86 views

The dd command isn't appear to accomplish anything [closed]

I'm currently trying to burn the Ubuntu operating system onto a USB flash drive of mine, so I can boot onto Ubuntu with my Chromebook. In order to do this, I executed the following dd command: sudo ...
2
votes
2answers
98 views

HDD cloning and non-matching checksums

I've been trying to clone a 1Tb HDD to a 1Tb SSD following the instructions here. I tried cloning it several times with both dd (painfully slow) and cat (far quicker) but when I came to do checksums ...
2
votes
1answer
143 views

Accidentally ejected sd card physically while dd

Full cat /proc/partitions + lsblk + fdisk -l output is here: http://pastebin.com/jYCCmwsU I just bought my new class10 16GB SDCard and I started to restore the Raspbian system for the Raspberry with ...
1
vote
2answers
323 views

HDD image file checksum does not match with device checksum

I have a 660297728 byte HDD image with MD5 hash f5a9d398e974617108d26c1654fe7bcb: root@T42# ls -l image -rw-rw-r-- 1 noc noc 660297728 Sep 29 19:00 image root@T42# md5sum image ...
0
votes
1answer
103 views

How can I zero the unused blocks on my filesystem in order to minimize the compressed disk image size? [duplicate]

If I dd my disk and compress the image with lzma or lzo the image is still big. The partition is 10GB used, 90GB available. But the image still around 20GB. I believe that is because I have copied ...
0
votes
1answer
91 views

change tape on the fly script

I have to write 17 Tb to tape: ssh some_host 'tar -cz /' | dd bs=20b of=/dev/tape of course 17 Tb doesn't fit to one tape so I need automatically change it when "no room" error occurs. I have ...
1
vote
2answers
72 views

How to redirect dd to pv? [duplicate]

This is my dd command which I need to modify: dd if=/tmp/nfs/image.dd of=/dev/sda bs=16k Now I would like to use pv to limit the speed of copying from NFS server. How can I achieve that? I know ...
1
vote
2answers
179 views

Can I mount a partition from a full drive image? [duplicate]

Note: While I agree that this question basically is a duplicate of the above question, I feel @alienth's answer (below) is more concise, so I suggest you take a look at it before going to the other ...
0
votes
2answers
144 views

Why is my dd slow when the blocksize is small?

According to articles on the web, mount with nobarrier will speed the disk up: Write small blocks of data to img (with barrier): SLOW # dd if=/dev/zero of=xfs.img bs=1024 count=20000 # mkfs.xfs ...
-1
votes
2answers
96 views

How do I Capture dd command output

I have a test script, which is used to estimate the filesize for a particular oracle export dumpfile. Content of the script is: mknod exp.pipe p dd if=exp.pipe of=/dev/null bs=1024 & exp ...
8
votes
5answers
1k views

How to ignore write errors while zeroing a disk?

Say you want to zero-out a failing hard disk. You want to overwrite as much as possible with zeros. What you don't want is: the process aborts on the first write-error. How to do that? AFAICS, plain ...
5
votes
2answers
111 views

Creating a large file with random content: short-cut by copying?

Assume I want to create a large encrypted drive stored in a file using cryptsetup, the first step is to create a random file, assume this should be of size 3T: dd if=/dev/urandom of=$FILE bs=1G ...
2
votes
2answers
590 views

restore dd cloned sd card (No space left on device)

I used this command sudo dd bs=4M if=/dev/sdb1 | gzip > /home/username/image`date +%d%m%y`.gz to clone my 32gb sd card (there was linux installed for odroid U3) now I have tried to restore it on ...
93
votes
19answers
16k views

What is the fastest way to send massive amounts of data between two computers?

This is a situation I am frequently in: I have a source server with a 320GB hard-drive inside of it, and 16GB of ram (exact specs available here, but as this is an issue I run into frequently on ...
1
vote
1answer
45 views

DD to a bigger partition

So I made a backup of /dev/sda1 (NTFS) using: sudo dd if=/dev/sda1 conv=sync,noerror bs=64K | gzip -c >/media/My\ Book/backup/Root20131215 In the meantime I increased the size of /dev/sda1 to ...
2
votes
1answer
351 views

Can I uncompress a zip file containing a disk image and then save that to an SD card all in one step?

I am under the following restrictions: I have a 1.0 GB .zip file on my computer which contains one file, a disk image of raspbian. When uncompressed, this file is 3.2 GB large and named ...
5
votes
2answers
729 views

Is it better to use cat, dd, pv or another procedure to copy a CD/DVD?

Background I'm copying some data CDs/DVDs to ISO files to use them later without the need of them in the drive. I'm looking on the Net for procedures and I found a lot: Use of cat to copy a ...
0
votes
0answers
48 views

testdisk foremost dd photorec after math help needed

Did i ask this question in the wrong place the first time? http://superuser.com/questions/957845/how-can-i-efficiently-view-validate-delete-1m-files-from-data-recovery I made such a long post about ...
0
votes
1answer
40 views

Broken disk size after incomplete dd operation

Once I was writing an ISO image into my USB disk using dd, I mistakenly pulled it out, and now it has only 10 MB of size. The correct size is 32 GB. Note that this smaller size is for the whole USB ...
1
vote
0answers
64 views

Write shrunken .img file to device file

I have a backup image of a device file /dev/sda3 that I created using: dd if=/dev/sda3 of=~/sda3.img. The image is very large, so I have re-sized it to remove empty space. My question is can I ...
2
votes
2answers
2k views

Interpreting dd Input/Output error

I tried to copy /dev/Storage/Storage (an LV under LVM) to an image file using a dd | pv | dd pipeline. dd reported an error, and I want to know whether dd finished copying my disk or stopped due to ...
0
votes
0answers
29 views

Backup full drive structure, skipping one partition content

I need to backup laptop drive. But in fact what matters is not data as in my data files kept on laptop but all systems, settings, lvm and in general whole disk structure - partitioning, UUIDs, LUKS ...
3
votes
3answers
332 views

Does dd copy everything, including all metadata and all “empty” blocks

Suddenly something was messed up with my partitions, or just one partition. I have a default Ubuntu installation, on a Kingston SSD, with the root file system encrypted with LUKS, (using AES I think). ...
3
votes
1answer
188 views

RAID mdadm virtual disk too small

sudo mdadm --build /dev/md0 --level=linear --raid-devices=3 /dev/loop0 /dev/sda1 /dev/sda2 After running the above command, /dev/md0 is smaller than /dev/loop0 + /dev/sda1 + /dev/sda2. Why is that ...
2
votes
1answer
71 views

using dd command for folder, but deleted items don't seem deleted [closed]

here is the image I used dd command to create a new floppy. First I tried it with a folder filled with naber.bin, test.bin, blabla.bin and boot.bin. And then i deleted all except boot.bin. ls -a ...
2
votes
3answers
346 views

How can I copy three partitions of my disk with a specific beginning and ending using dd?

Using the fdisk -l command I got the following answer: Device Boot Start End Blocks Id System /dev/sda1 * 2048 28266495 14132224 27 Hidden NTFS WinRE ...
24
votes
2answers
2k views

Patching a binary with dd

I have read this quote (below) several times, most recently here, and am continually puzzled at how dd can be used to patch anything let alone a compiler: The Unix system I used at school, 30 ...
3
votes
5answers
122 views

How one can re-read image with dd so it will match one you just wrote?

I have a ~1GB image that I'm writing to a 8GB SD card via the dd tool. I'd like to verify that it was written without corruption by reading it back and comparing its hash with original one. ...
1
vote
1answer
47 views

how to use dd to backup second linux hard drive from os x?

I have a MacBook with Linux installed on the primary hard drive. On an external USB 3.0 drive, I have OS X installed. The external drive has plenty of space so I would like to boot up OS X and make ...
4
votes
4answers
311 views

How can I convert two-valued text data to binary (bit-representation)

I have a text file with two (2) only possible characters (and maybe new lines \n). Example: ABBBAAAABBBBBABBABBBABBB (Size 24 bytes) How can I convert this to a binary file, meaning a bit ...
1
vote
0answers
41 views

osx - dd command behaving weirdly [duplicate]

I've been using dd for a couple of years now, most of the time successfully. I usually use it to dd Linux images to USB drives. My workflow doing so is as such: convert .iso image to a .img format ...
4
votes
1answer
111 views

How to write to an .img file with two different partitions?

I have been working on building a Linux based OS for Raspberry-pi using buildroot. I am generating the required empty .img file using "dd" and "fdisk" utilities. I am creating two empty partitions ...
4
votes
2answers
225 views

What is actually the speed reported by dd?

I always thought that when doing: dd if=/dev/sdx of=/dev/sdy the report which is displayed once the command finishes, such as: 79304319+0 records in 79304319+0 records out 40603811328 bytes (41 ...
1
vote
1answer
231 views

How to clone an MTPFS partition of a mounted Android phone?

Using mtpfs I've mounted a Samsung Galaxy S5 and I need to make an image of its root partition. I want to use dd or the like, but nothing seems to be able to detect/reference an MTP and/or FUSE ...
4
votes
1answer
108 views

Size difference between an iso file burnt to a cd and the file retrieved with dd

I have an iso file (foo.iso) that I burnt to a dvd with the command : growisofs -dvd-compat -Z /dev/cdrom=foo.iso I then tried the command dd if=/dev/cdrom of=foo2.iso However, foo2.iso is ...
1
vote
1answer
335 views

cant run dd command on android device

The main objective is to send a splited file to an android and join it back up with a .sh script, the file is splited to 5MB parts but its total size is unknown (trying to make an universal script), ...
1
vote
0answers
185 views

Making an ISO of MBR + X amounts of partitions

I am trying to make an ISO of a Windows Backup disc that I "burned" to my microSD card, which I did in desperation due to lack of HDD storage at the time. Now I want to get it out of there and onto ...
0
votes
1answer
71 views

Hard Disk Clone Image Size

I've created an image backup for HDDA (partition) from HostA and saved on HostB ssh -c blowfish user@ip-or-hostname "dd if=/dev/sda1 | gzip -1 -" | dd of=sda1.gz conv=sync,noerror The HDD size is ...