Corruption is a state of a file, a filesystem, etc. where all its data and metadata are not consistent. This tag may be used to reference questions dealing with problems of data recovery after erroneous manipulations or unexpected shutdown.

learn more… | top users | synonyms

23
votes
5answers
7k views

Do journaling filesystems guarantee against corruption after a power failure?

I am asking this question on behalf of another user who raised the issue in the Ubuntu chat room. Do journaling filesystems guarantee that no corruption will occur if a power failure occurs? If this ...
18
votes
6answers
2k views

How to corrupt an archive file in a controlled way?

I wrote a function that checks for a corrupted archive using a CRC checksum. To test it, I just opened the archive and scrambled the content with a hex editor. The problem is that I do not believe ...
15
votes
1answer
749 views

create a corrupted FAT file system

I have an application which will search for a corrupted FAT file system and repair it. For testing the application I will need a corrupted file system. What is a good and reproducible way for ...
9
votes
3answers
570 views

Is there a risk of data corruption if suspended laptop runs out of battery?

I often tend to just put my laptop on suspend using xfce4-power-manager, and although usually the battery is sufficiently charged up until the next time (when I plug in the charger), sometimes I ...
8
votes
1answer
146 views

md raid5: translate md internal sector numbers to offsets

TL;DR summary: Translate an md sector number into offsets(s) within the /dev/mdX device, and how to investigate it with xfs_db. The sector number is from sh->sector in linux/drivers/md/raid5.c:...
7
votes
2answers
8k views

Is there a command line method by which I can check whether a downloaded file is complete or broken?

I'm writing a script that involves downloading and manipulating a file, and I want to ensure that the file is not incomplete (due to e.g. a dropped connection) before I work on it.
7
votes
5answers
12k views

How to recover a corrupted “tar.gz” file

I suddenly needed to recover an old tar.gz file, but as soon as I execute so: tar -zxvf filename.tar.gz I get this: gzip: stdin: invalid compressed data--format violated tar: Child returned ...
6
votes
3answers
28k views

How to check if a file is corrupt or not?

Are there any general solutions to check if a file is corrupt or not? For example, whether a video file is bad, or a compressed file is corrupt, etc.
6
votes
1answer
1k views

Subversion: how to determine when files became corrupt

I'm using Subversion just for private synchronization between a laptop and a desktop. Recently I discovered that several ASCII files and several binary files were corrupted. Instead of the expected ...
5
votes
3answers
720 views

File size of 60.0 PB is wrong. Can deleting it cause data loss?

While backing up some data (a 200 GB home directory) with rsync, I got an I/0 error for a particular file, after which rsync continued on "normally" with its backup. The problem source file showed as ...
5
votes
1answer
411 views

Problem on Linux NAND Root Filesystem

I'm have a JFFS2 root filesystem running on a large NAND device. Every once in a while, when I restart the computer, I get error messages about invalid ELF headers when /sbin/init or /bin/login try ...
4
votes
3answers
3k views

ReFS but for Linux

Microsoft is going to bring a "Resilient FileSystem" with Windows 8, but only for servers. I'd like that on a Linux desktop, but my search reveals no contender. There are so many filesystems for ...
4
votes
2answers
15k views

Short read while trying to open partition

On my personal home computer running Kubuntu Linux 13.04 I'm having trouble mounting a partition that is very dear to me. My backup policy is to perform a backup about monthly, so I do have a backup ...
4
votes
1answer
467 views

RAID6 scrubbing mismatch repair?

You can initiate a scrub of a mdadm array with echo 'check' > /sys/block/mdX/md/sync_action, and if a bad sector is found, it'll rewrite it automatically (from a mirror or from parity information ...
4
votes
1answer
447 views

Simulate bitrot/corrupt files (for BTRFS)

Is it possible to intentionally corrupt a file so that BTRFS will report a checksum error? I want to test a script that's supposed to find file names with checksum errors, but I don't have any corrupt ...
4
votes
1answer
92 views

What is using trillions of inodes on my almost empty server? [closed]

I have 18446744069923968593 inodes (which seem really too much) and much more problematic: I have 18446744069414835186 used so the system won't create any other file (even if the disk is almost empty)....
4
votes
0answers
203 views

Do ext(4?) filesystems intrinsically store newer data in a fashion that is more prone to corruption?

I recently had a corrupted ext4 filesystem throwing these errors: kubuntu@kubuntu:~$ sudo mount -t ext4 /dev/sdc2 c1 mount: wrong fs type, bad option, bad superblock on /dev/sdc2, missing codepage ...
3
votes
2answers
536 views

Static files give ever changing checksum value on Linux

When I cksum large files (150MB) they will often report different checksums on each call. $ cksum test3 1233504235 170213376 test3 $ cksum test3 825031809 170213376 test3 $ cksum test3 189847968 ...
3
votes
1answer
411 views

ZFS disabling sync writes on dataset

I have a freenas box that I use to back ESX VMs to but don't have a SLOG yet and thus speed is poor due to ESX pushing sync writes to the NFS store on my freenas box. If I created a separate ...
3
votes
0answers
575 views

Which file system (among XFS, BTRFS and EXT4 only) does provide the best data resilience to disk corruption? [closed]

Question: Given these three filesystems: XFS, BTRFS and EXT4, I'm wishing to know which does provide the best data resilience to data corruption in a setup without RAID. And, of course, why? ...
2
votes
4answers
448 views

Prevent file corruption

I have an application that write files into a specific directory at the FS. This system, under no circumstances, can lose a single written file. When I have some problem at the HD, like badblocks or ...
2
votes
5answers
24k views

SD card corrupt and stuck at 32MB, any way to fix it?

Using the Linux area since I'm using Linux apps and utilities. My phone crashed (several times) and managed to corrupt my microSD card. It no longer appears to have partitions and shows as 32MB ...
2
votes
2answers
1k views

ext4 corruption found in superblock, but filesystem can be mounted

After a crash, I've got an Ext4 filesystem (on an LVM LV) that gives the following error when running fsck.ext4 -nf: e2fsck 1.42.12 (29-Aug-2014) Corruption found in superblock. (blocks_count = 0). ...
2
votes
1answer
2k views

Finding corrupted files

I have a directory that have zillions of files. As soon as I try to copy this directory, I receive a message that a file could not be copied (corrupt ?) and the copy stops. Is there any command I ...
2
votes
2answers
125 views

Why can I rest assured that GNU Parted has not corrupted a single bit after shrinking my partition?

I shrunk my root partition and it seems nice. But I am thinking about overwriting now at least the most important files from the backup copy (external drive, rsync, weekly backup) in order to be sure ...
2
votes
2answers
759 views

Did `sudo init 6` cause my file system to be corrupted?

I was developing some code and had open qtcreator (software development IDE), gnome-terminal, and possibly firefox. I needed to restart to test something. So i restarted using sudo init 6. When my ...
2
votes
1answer
384 views

Recursively find and move corrupted PDFs

The Issue I was using python-skydrive to download files to my PC, and I accidentally corrupted a good amount of my PDF files. When I try to view them in Document Viewer, I get the following error ...
2
votes
1answer
87 views

Disappearance of files in all ext4 filesystems of a Debian server

Apparently the disappearance of files and directories occurred in all ext4 filesystems, including files and directories usually "read-only" in /var and /usr, like binaries installed for gcc, and ...
2
votes
0answers
149 views

DPKG Status Corrupted

My Ubuntu system has been giving me trouble whenever I try to install or uninstall or update software using apt-get. Whenever I run these commands it returns an error with regards my status file. The ...
2
votes
0answers
227 views

Disk filename corruption

Using QNX unix filesystem. The files once written with good file names in a good directory and partition get corrupted in their filenames. Some of the files remain in good shape in the same directory....
1
vote
1answer
770 views

Lost files copied to a USB ZIP drive on Ubuntu

I have a problem regarding copying of files using Ubuntu's copy feature. The problems goes on like this: I copy a specific folder to my ZIP drive by creating a new folder each day (Backup). Now copy ...
1
vote
2answers
196 views

Getting list of corrupted file from folder and its sub folder

I have following directory structure folder └── 01 ├── test1 └── abc.bz2 └── asd.bz2 ├── test2 └── 546.bz2 └── alsj.bz2 ├── test3 └── aewr.bz2 ...
1
vote
1answer
497 views

Files that do not exist, prevent me from deleting them, corrupted filesystem

Well... It's about on an OS X system (hfs+), but that's unix after all to. :p system has become unbootable, due to a filesystem error... fsck.hfsplus fails because .... ... ** Checking ...
1
vote
1answer
2k views

recover corrupted directory from ext3 partition

It's my mounted directory that I want to restore folder ostani. It contains many PHP, CSS, Javascript, etc. files. How can I access it? I use dd_rhelper to create an image and tried to fsck to repair ...
1
vote
1answer
43 views

How to explain this? Superblock corrupt in SSD

I got a file system corruption from a sudden power loss. During boot, it reported following error. error: unknown filesystem. Entering rescue mode... grub rescue> _" The board is an Intel ...
1
vote
1answer
57 views

What are btrfs generation_errs?

I have a btrfs file system that I've scrubbed a few times and found some errors. If I check the device status I see that I have generation_errs: $ sudo btrfs device stats /dev/nvme0n1p5 [/dev/...
1
vote
1answer
96 views

ddrescue image too large

3Tb HDD is corrupt. I tried using ddrescue to create an image and a logfile on another 3TB HDD (only one I had). I got a write error after about 2.7T (actual capacity of the 3TB). Image file and log ...
1
vote
1answer
355 views

find the cause of file corruption when copying files to a network share on an Ubuntu machine

I am copying files from my SD card to my Ubuntu server via Windows 7 using a network drive. The problem is that sometimes, 2 files out of 150, are corrupted during transfer. See here 2 example files ...
1
vote
2answers
781 views

Unzip error, is recovery possible?

I compressed 4 separate folders with some wedding videos (!!) a few months ago. Today I tried to unzip them, and had no problem with the last 2, but the first 2 of them show an error: ...
1
vote
1answer
251 views

Recovering Mojibaked Files

I have recently been encountering several broken files whose contents got thoroughly baked in conversions between UTF-8 and ISO-Latin-1. How can I repair these files? The process that created the ...
1
vote
1answer
67 views

apparmor: mysql permissions--with no recent changes

UPDATE: I now know my issue was database corruption, but discerning it was somewhat tricky--apparmor appeared to be the cause for longer than it should've. I didn't note when first posting that even ...
1
vote
0answers
279 views

Wrong inode: corrupted f2fs, fsck.f2fs cannot repair

A f2fs partition on my Android phone has recently become corrupted. It will still mount fine; however, I completely lost access to one directory (/data/media/0), which now shows as empty. Yet the disk ...
1
vote
0answers
11 views

How to recover data after memory module errors [duplicate]

My linux PC has suffered the occasional application crash, desktop crash, and kernal panic over the last few months. I also started noticing error dialogs on login, and some parts of the desktop do ...
1
vote
1answer
285 views

File corruption using rsync, multiple rsync processes, moved/renamed source file

I'm encountering some file corruption when using rsync (that is, the file contents do not match the source file). I can understand the file becoming corrupt if it is being written to while being ...
1
vote
0answers
76 views

Shared NTFS partition conflict, files written under Debian gone

I have a dual-boot W7-Debian Jessie on my laptop, and a NTFS partition initially left for sharing data between OS and keeping big files. With myself getting used to Linux, rebooting to windows became ...
1
vote
1answer
171 views

How can I determine the cause of CF card corruption?

I installed qnx in my CF card and made it bootable and it was working well. However, yesterday it stopped working while my system was running. Checking the filesystem revealed that it was corrupted. ...
1
vote
0answers
1k views

Recovering files from partitions at a corrupted SD card?

I got a problem with my SD card which had got Raspbian. Everything seemed to be ok while working with the raspberry. I inserted it to my laptop running Ubuntu 12.04.4 to fetch some files. It first ...
1
vote
3answers
86 views

How to delete unknown file that doesn't have proper permissions

My co-worker sent me a theme in a tar.gz file and I tried unzipping it using the archive manager GUI as I usually do for any kind of zipped file. However, it produced a corrupt file/directory that I ...
0
votes
1answer
2k views

Cannot format a corrupted 32Gb SD card

I cannot format a corrupted Sandisk SDHC ULTRA 32Gb micro card. So I used gparted in an Ubuntu system. I deleted the partition (/dev/sdf1), recreated it and formatted it in fat32. It still keeps its ...
0
votes
5answers
326 views

setuid (and other) permissions lost when copying / elsewhere - what to do?

I sort-of-cloned an existing Debian 7.x distro by copying the contents of the root filesystem (not the special dirs of course) to another HDD. I booted, things seem to run, but - I get some weird ...