dd is a traditional utility for binary data copies

learn more… | top users | synonyms

7
votes
6answers
6k views

How do I suppress dd output?

I have a bash script that creates some file using dd. The problem is dd throws a great amount of output that is going to mess with the output of my script. Searching around I've found a solution: dd ...
4
votes
1answer
227 views

Write the same file multiple times to one file using dd

I am trying to create large dummy files on a drive using dd. I am currently doing this: #!/bin/bash writeFile(){ #$1 - destination directory/filename, $2 - source filepath $3 - blocksize, $4 - ...
3
votes
1answer
33 views

How to inspect the raw contents of a partition?

I'm trying to see the contents in raw bytes of a dummy partition /dev/sda3, which I've made to be 100MiB through gparted. I want to test writing and reading on that partition. Is there a tool that ...
9
votes
5answers
234 views

How to pad a file to a desired size?

I have a file that I want to pad until it reaches 16 MiB (16777216 bytes). Currently it is 16515072 bytes. The difference is 262144 bytes. How do I pad it? This doesn't seem to be working: cp ...
1
vote
4answers
70 views

Change only one bit in a file

I have to test a hash function and I want to change only a single bit of a specific file. I tried with the dd command. That works, but I can only change a whole byte and not just a bit. sudo dd ...
0
votes
0answers
19 views

What are the [internal] steps involved in making USB drive 'bootable'?

Whenever I have to install a new Linux distro, I create a bootable USB from the distro image using some specialized program like UNetBootin. Recently, I tried to do for Fedora using 'dd' command, but ...
2
votes
2answers
136 views

Multiple passes of wiping disk with `dd`

I want to use dd to overwrite a disk multiple times to destroy data beyond recovery. I know I could use dd if=/dev/zero/ of=/dev/sdx/ to do a pass with zeros, or dd if=/dev/null/ of=/dev/sdx/ to ...
3
votes
5answers
3k views

Fast Way to Randomize HD?

I've read about how to make hard drives secure for encryption, and one of the steps is to write random bits to the drive, in order to make the encrypted data indistinguishable from the rest of the ...
1
vote
0answers
71 views

USB Stick recognized but not mountable

I have a USB Stick which is recognized by my laptop but there is no partition to mount. The device is listed in /dev/ as sdb but no partition /dev/sdb1. fdisk -l also displays nothing about /dev/sdb. ...
2
votes
1answer
35 views

Syntax When Combining dd and pv

I am a linux newbie; so, sorry if this is obvious to you... sudo dd if=/dev/sda bs=64k | pv --size 1.5t | dd of=/dev/sdb Does the block size for dd go on the left side of this after the input as ...
1
vote
1answer
50 views

From a sparse file to a block device

I have a system image sparse file which actual size is only a few MBs but the "apparent size" is about 1GB. I'm trying to write it to a block device efficiently (without the holes). Here are some ...
19
votes
4answers
7k views

What does dd stand for?

I know very well what the command does, but man dd, info dd tell me: 'Convert and copy a file', as does GNU Coreutils. Google says its an abbreviation of everything between medicine and bad webchat ...
32
votes
3answers
5k views

When is dd suitable for copying data? (or, when are read() and write() partial)

Short version: In what circumstances is dd safe to use for copying data, safe meaning that there is no risk of corruption due to a partial read or write? Long version — preamble: dd is often used to ...
3
votes
2answers
3k views

Copy MBR and boot partition to a smaller disk

I'm using a 32GB SD card for my raspberry pi. I have successfully transferred the operating system (Archlinux ARM) to a usb harddrive. Which means that I only need the boot partition on the SD card. ...
1
vote
0answers
39 views

Overwritten superblock and dd backup files recovery

Good day, yesterday I tried to extend my swap partition ('cause suspend/hibernation didn't work) and I needed to decrease size of my debian linux disk (I don't ever remember if it was ext2/et3 or ...
0
votes
1answer
19 views

How to image certain portions of hard drive only

I have a failed hard drive which I need to extract data from. My dd kung fu is failing me right now. I know that the drive is failing at sector 60515007 to 60517093 (512b per sector), and multiple ...
4
votes
4answers
345 views

How to fill a file with a stream from /dev/urandom with a specified number of lines ?

I am trying to fill a file with a sequence of random 0 and 1s with a user-defined number of lines and number of characters per line. the first step is to get a random stream of 0 and 1s: cat ...
17
votes
4answers
5k views

Why does dd from /dev/random give different file sizes?

I am running the following command on an ubuntu system: dd if=/dev/random of=rand bs=1K count=2 However, every time I run it, I end up with a file of a different size. Why is this? How can I ...
2
votes
4answers
2k views

Why is writing SLOW on raw device, and FAST on filesystem (USB key)?

I have a USB key (PQI U822V-Speedy 32G) that I am trying to benchmark quick'n'dirty on Linux. I'm testing write bandwith. dd on raw partition I created a partition starting at sector 2048, then did ...
6
votes
3answers
1k views

Linux/GParted can see partition table but dd bs=512 count=1 can't

I have an MBR formatted sd card and when connect to a Linux machine (xubuntu 12.04) it can mount a partition and parse the file system (as can GParted). However, when I try to read the MBR from the ...
1
vote
1answer
42 views

How can I cross compile the dd linux tool for arm?

I need to cross-compile a full version of dd because my device only has a busybox one that doesn't support many options. Where do I get the source for it? I've been looking on the kernel repo online ...
8
votes
5answers
583 views

Why specify block size when copying devices of a finite size?

In online tutorials it is often suggested to use the following command to copy a CDROM to an iso image: $ dd if=/dev/dvd of=foobar.iso bs=2048 Why must the byte size be specified? I notice that in ...
0
votes
1answer
155 views

extract number of bytes out of a file

Is it possible to extract a few number of bytes out of a file using dd ? The file is located on a secondary drive. I apologize if this is a simple question however I'm no pro at command line.
1
vote
1answer
50 views

dd'ing SDD, decreasing write speed

My hard drive is a SanDisk SSD. The drive is new. I've booted into ArchLinux Live System, with the intention of preparing the hard drive for full disk encryption. I've noticed a significant drop of ...
4
votes
2answers
107 views

How to delete part of a binary file without copying

I need to delete the first 2 bytes of a 6MB file. However, this is an embedded Linux with only 32 Mbytes RAM and less than 1 MB free flash memory. I tried using dd, as: 1 - # dd bs=1 skip=2 ...
31
votes
7answers
21k views

Best way to remove bytes from the start of a file?

Today I had to remove the first 1131 bytes from an 800MB mixed text / binary file, a filtered subversion dump I'm hacking for a new repository. What's the best way to do this? To start with I tried ...
3
votes
0answers
46 views

Have I destroyed data on drive?

I stupidly ran the following command on an external ext4 USB disk, typing /dev/sdb instead of /dev/sda which was the new disk I was setting up: dd if=/dev/zero of=/dev/sda bs=512 count=100 These ...
4
votes
2answers
273 views

How to parallelize dd?

I'm currently having trouble with dd invoked with a sparse file as input (if) and a file as output (of) with conv=sparse. dd seems to be using one core of the CPU (Intel(R) Core(TM) i7-3632QM CPU @ ...
-1
votes
2answers
61 views

How to create a new partitioning table on SD card from the command line ? [closed]

I have tried to mount a SD card on Linux Mint, I have found the right device file and tried: mount -t vfat /dev/sdb /mnt/zauberportal ,but it failed and I tried some variations like different types of ...
1
vote
2answers
24 views

MBR and data on pendrive

I have a pendrive (/dev/sdd). I ran fdisk -l and that shows me the drive and its partitions. After that I did: dd if=/dev/zero of=/dev/sdd bs=512 count=1 I deleted the MBR (so the partitions ...
0
votes
2answers
30 views

Cloning a drive larger than your own

I made this nice backup system to turn drives into vdi's and put them on our network share. Then the next day my boss walks in with 20 new machines to replace our old ones, they have 2TB drives. How ...
1
vote
0answers
78 views

RedHat machine will not boot when video card is removed

I "inherited" RH 6.4 on a computer with an nVidia video card. I took the image and dd'd it to another computer that has the same hardware. By design, the second computer will be headless. This ...
0
votes
1answer
46 views

HD clone using LZ4 and DD fails

I've been cloning complete HDD images to restore OS crashes using DD and GZIP for a while now using dd if=/dev/sda | gzip > img.gz and gzip img.gz | dd of=/dev/sda This always working fine, but ...
3
votes
1answer
133 views

Why is dd so slow with a bs of 100M [closed]

I just tried to overwrite a fast ssd using dd. Using the ubuntu boot image I typed in: dd if=/dev/zero of=/dev/sda bs=100M error writing '/dev/sda': No space left on device blah blah 256 GB copied, ...
4
votes
3answers
3k views

Sending the output from 'dd' to awk/sed/grep

I'm trying to approximate the computer's write speed using dd: dd if=/dev/urandom of=/dev/null bs=1K count=10000 which gives the following output 10000+0 records in 10000+0 records out 10240000 ...
62
votes
10answers
40k views

How do I know if dd is still working?

I've not used dd all that much, but so far it's not failed me yet. Right now, I've had a dd going for over 12 hours - I'm writing an image back to the disk it came from - and I'm getting a little ...
5
votes
2answers
389 views

dd writes to CF with delay

I have an old 64MB CF card which I use in my laptop(kernel 2.6.38) with CardBus adapter. If I write a 64MB image to this CF card, then the write speed is more than 200MB/s: T42 ~ # fdisk -lu Disk ...
1
vote
1answer
35 views

Can the BS option cause data inconsistency with dd?

I have a laptop partition (truecrypt) backed up with dd since it's impossible to back it up with anything else but do a raw bit by bit copy like: dd if=/dev/sda of=imagefile.img I can of course ...
3
votes
3answers
76 views

Resuming a DD of an entire disk

I'm overwriting my hard drive with random data using the good old dd: dd if=/dev/urandom of=/dev/disk/by-uuid/etc bs=512 It's a 2TB array and my MacBook (running Linux, ok?) can only write data at ...
12
votes
2answers
539 views

Why does dd from /dev/urandom stops early? [duplicate]

On my current linux system (debian jessie amd64), I am getting different behavior for dd using /dev/urandom (/dev/random behavior is properly documented). If I naively want 1G of random data: $ dd ...
8
votes
2answers
9k views

How to use SSH to make a dd copy of disk A from host B and save on disk B?

I want to make remote backups from disk A at will using SSH from computer B. I want to save the backups to disk B. How can I do this? I've tried using $ ssh hostname@my.ip.add.ress "sudo dd ...
3
votes
3answers
163 views

How to inspect the contents of /dev/sdt?

I have what I hope is not a huge problem, but could end up being a very large problem. For some context, I mistakenly ran this command on my 27'' iMac: sudo dd if=ubuntu-rescue.img of=/dev/sdt ...
25
votes
5answers
22k views

Is it possible to mount a gzip compressed dd image on the fly?

I like create an image backup for the first time I'm backing up a system. After this first time I use rsync to do incremental backups. My usual image backup is as follows: Mount and zero out the ...
8
votes
2answers
7k views

Create file image container

I would like to create a 100GB file to use as a file-system. The file will be stored on an encrypted volume, so the file/file-system itself does not need to be (further) encrypted. Searching has ...
0
votes
0answers
41 views

Why dd reads from output device?

While dding a CentOS 7 x86_64 DVD image to a USB drive (sdb), I monitored the progress with iostat. It kept alternating between mostly writing to the USB drive: Device: tps kB_read/s ...
0
votes
1answer
72 views

What does “dd” stand for? [duplicate]

What does dd stand for? I've always referred to it colloquially as "Disk Destroyer", but what are the "official" words that make up the acronym/command? According to this link and this link it could ...
0
votes
1answer
100 views

Delete labelled partition non interactively with one command

I know about fdisk and parted, but I was not able to figure out an non interactive way to delete a labelled partition. I imagine something like <command> <action> /dev/disk/by-label/LABEL ...
3
votes
1answer
203 views

losetup /dev/loop0 disappears after some time

at the moment I do some tests with loop devices on Linux/Ubuntu. In a small test script I have the following commands: #!/bin/sh rm testfile.x dd if=/dev/zero of=testfile.x bs=1M count=1200 losetup ...
8
votes
3answers
153 views

How can `dd` be used to right-shift data blocks?

Consider a 100MB raw block device as a simple example. That is 204800 blocks of 512 bytes each for a total of 102760448 bytes. The challenge is to shift the first 98MB (200704 blocks) so there is a ...
1
vote
1answer
84 views

Can I use dd to quickly resilver a ZFS mirror disk?

My ZFS pool consists of two mirrored disks. I have two more disks which I plan to use for rotating offsite backups. The first backup disk was added to the zpool and has nearly completed resilvering. ...