Questions tagged [filesystems]

A filesystem is a way to organize and store computer files with their data.

528 questions with no upvoted or accepted answers
Filter by
Sorted by
Tagged with
9
votes
1answer
447 views

How to format & mount a large partition with 4k sector size in Freebsd?

gpart show -l: => 6 146239733 da0 GPT (558G) 6 10 - free - (40K) 16 128 1 (null) (512K) 144 262144 2 efi (1.0G) ...
7
votes
2answers
608 views

How do I layer compression on top of encryption on top of BtrFS, per-file?

BtrFS should support this really, but it doesn't. So ECryptFS looks like it will fill the gap. The only thing is, how would I layer compression on top of this? Reasons for compression on top of ...
6
votes
3answers
7k views

USB Media filesystem problem

My USB is not detected recently, I tried mount, fdisk, dd, gparted, mkfs.vfat :~# tail -f /var/log/syslog Oct 27 12:54:29 mohammad-Inspiron-N5110 kernel: [18843.105772] usb 3-2: New USB device ...
5
votes
1answer
2k views

Wrong inode: corrupted f2fs, fsck.f2fs cannot repair

A f2fs partition on my Android phone has recently become corrupted. It will still mount fine; however, I completely lost access to one directory (/data/media/0), which now shows as empty. Yet the disk ...
5
votes
0answers
1k views

Why are block sizes limited by page size in Linux?

In many (all?) file systems that Linux uses, including ext2/3/4, the maximum block size is the page size of the architecture Linux is running on, ie. 4KiB on x86. Why is there this limit? Might this ...
5
votes
0answers
535 views

Is there a way to show all flags in /proc/mounts?

Some filesystem flags seem to be hidden in /proc/mounts, depending on whether they are defined as defaults. Is there a way to show all flags in /proc/mounts, also including the default ones? And if ...
4
votes
0answers
30 views

How can I find what a process is trying to watch using strace, lsof, and fdinfo?

I have a process (the NewRelic infra agent) that is hung on a RHEL 7, xfs filesystem host. I'm thinking that it's trying to watch a file or maybe a socket that another process already has in use. ...
4
votes
0answers
103 views

Why do ext2 inodes only have 12 direct blocks?

I'm currently writing a hobby file-system for fun. I was wondering if anyone knows why or where I could get information on the design philosophy of ext2. Specifically, I was wondering why each inode ...
4
votes
0answers
224 views

Disable writeback cache throttling - tuning vm.dirty_ratio

I have a workload with extremely high write burst rates for short periods of times. The target disks are rather slow, but I have plenty of RAM and very tolerant to instantaneous data loss. I've ...
4
votes
0answers
297 views

Which filesystem will give me the best performance for both writing and reading small files?

My company developed an application that picks up (watches for) xml files of <10kb in size from a directory, reads it in sends the body as an api call to an external service and then moves the ...
4
votes
0answers
79 views

no such file or directory trying to list or remove file in btrfs

I have a file system mounted btrfs. I have one directory in particular, that I can't remove, because it's listed as non-empty. In that directory, there's one file, which I can see the name of, but ...
4
votes
0answers
300 views

Stress testing storage media — file vs block?

While looking for ways to stress an SDcard, I've noticed there are two ways one can approach this. One is to stress it by reading/writing blocks directly to the device file. For example: sudo ...
4
votes
0answers
929 views

How to interpret fdisk output?

How does one interpret fdisk -l output. I've included a sample output based on an image with my "best guesses", and then show the output based on the device which was used to create the image. ...
4
votes
0answers
3k views

Using dd on Mac OS: conv=fsync equivalent?

I'm running an experiment where I benchmark the speed of reading and writing with and without caching. On Linux, using 'conv=fsync' as an operand makes sure that the output file is entirely physically ...
4
votes
0answers
238 views

Problem copying a directory larger than 6 GB

I have a problem when I want copy a directory to a disk external, but the directory has size 6 GB. When try copy it, it gives me a error: " File too large", I give more information, that directory ...
4
votes
1answer
1k views

Symlink support with Windows/CIFS server, and linux client

I have a Win10 file server that is hosting content such as code repositories over a network share. I do all of my coding and development on Linux, primarily CentOS or Lubuntu, so I've come across the ...
4
votes
0answers
286 views

Replacing a running binary on read-only file system

I have a simple updater bash script, which replaces files by removing the incident old files and copying new files from an archive to the running embedded target root file system. This way, the script ...
4
votes
0answers
2k views

Disk I/O latency using /proc/vmstat file

How do I calculate disk read and write latency in Linux? Is it possible to do the calculation using /proc file system? I am using iostat and vmstat command. But I do not understand how the ...
4
votes
0answers
2k views

OverlayFS - How to make changes to upper filesystem persistent without unmounting?

I am using an USB drive to start a linux system which needs changes from time to time and also writes some logs. Flash drives tend to fail early if there are many write operations. That brought me to ...
4
votes
0answers
300 views

shared filesystem with offline access

I would like a shared filesystem with offline access. I have two machines. One is a light laptop with a small amount of SSD storage that I carry with me. The other is a stay-at-home computer with much ...
4
votes
1answer
814 views

What makes fsck so slow on big filesystems?

I have over a dozen of filesystems on my OpenBSD server with 12GB DDR3 and several 1.5TB HDDs. All filesystems themselves are generally between 8GB and 64GB in size. I've noticed that even by ...
4
votes
0answers
271 views

How does fsnotify setting affect system performance?

Occasionally a software package I install complains that the default fsnotify setting is far too low for decent performance. Intellij IDEA or crashplan are two examples. They suggest using fsnotify ...
4
votes
0answers
2k views

What options are there for tuning Linux file system caching?

What various types of caching are possible in the ext3 file system and how can their values be changed using system calls or other methods? I don't want to use commands or tools.
3
votes
0answers
68 views

Make one program use a special resolv.conf

I want to cheat a program to use a special /etc/resolv.conf file, that in turn will force it to use a nonstandard nameserver. The obvious solution is to recreate the whole filesystem except one file ...
3
votes
0answers
33 views

Portable, race-free equivalent of mv -T DIR1 DIR2?

It seems mv -T is a GNU extension to mv. Is there a robust way (race-free, portable, and otherwise without "gotchas") to do the equivalent of mv -T dir1 dir2? To be clear: I DO NOT want this to ...
3
votes
0answers
191 views

Failed writes after a while on mounted nfs volume

I have mounted an nfs drive on the machine. I can see it with the following command: $ df -aTh | grep nfs … unrelated volumes … 10.200.30.100:/export/pvc-70..1d nfs4 976M 2.0M 907M 1% /var/lib/...
3
votes
0answers
69 views

meaning of @ in (btrfs?) pathnames

I have noticed that Synology NAS devices preface many system-relevant links or directory names with the @ character. I've just noticed that the standard partitioning in openSUSE does the same when ...
3
votes
1answer
122 views

How can I re-partition a hard/ssd-drive without losing data?

When I got my notebook with a 512GB SSD, I reformatted it and installed Ubuntu. I've followed Ubuntu's suggestion to partition the drive, so I have it partitioned as follows: $ sudo parted -l Model: ...
3
votes
0answers
6k views

ext2fs_open2: Bad magic number in super-block

I'm trying to resize a Linux partition, but after tweaking a lot with this disk I don't know If I have totally corrupted it. Device Boot Start End Sectors Size Id Type /dev/sdd1 * ...
3
votes
0answers
562 views

ext4 mount: mount /dev/mmcblk0p2 on /SD failed: File exists?

If I try mounting the ext4 file system of /dev/mmcblk0p2 into the blank directories I just created: /SD and also /mnt/SD, then the command line answers with: mount: mount /dev/mmcblk0p2 on /SD failed:...
3
votes
0answers
173 views

Is the directory /apps/ a legacy of anything?

Several times, I have seen in (quite) big projects, software installations made under /apps/ First I thought it was a fantasy, refusing FHS normalisation. https://en.wikipedia.org/wiki/...
3
votes
0answers
76 views

Why can the permissions of /sys directories vary across systems?

I have a fresh install of Alpine Linux on my laptop, and I'm trying to read the battery information from /sys/class/power_supply/BAT0/uevent as a regular user (non root). The permissions on the ...
3
votes
0answers
100 views

zfs pool not available on boot after setting noatime and drive idle times with hd-idle / hdparm

At first, I set up my RHEL7-x64 to sleep the zfs drives using this,this, and this. I believe I tried hd-idle first, when the problems began. I had written a script idle_drives_enable to handle ...
3
votes
0answers
210 views

How to mount Atmel mass storage device with unknown FS

I'd like to mount an ATMEL mass storage device (USB) so I can access the data that was recorded to the medical device I was wearing. Below are the commands I've run and the corresponding outputs. ...
3
votes
0answers
5k views

are we going to get a linux module for APFS?

ExFAT doesn't support symbolic links on linux. My git repositories are getting corrupted if I use them on exfat removable media between linux and macOS. Is there any work going on to support APFS on ...
3
votes
1answer
156 views

Which file occupies block 123456789 on /dev/sda?

I would like to know which file occupies a given block on a blockdevice. The procedure should at least support ext4 on Encrypted LVM, but it would be delicious if it also explained how to do this for ...
3
votes
0answers
728 views

Disable caching for entire file system or disk?

I have a 1TB M.2 SSD drive that I use for regularly creating really large tarballs. It just has an ext4 file system on it at the moment. Is there some way I can tell the kernel not to cache data on ...
3
votes
0answers
89 views

How to approach planning a BSD file server's outward-facing file hierarchy

I'm migrating data on an informal home server to a new FreeNAS (FreeBSD 10) based file server running samba, and I'm stuck in trying to plan how to lay the data out, to give correct access to ...
3
votes
1answer
181 views

Filesystem which splits large files

I try to use the AmazonCloud-Storage using acd_cli to put my media files into the cloud. Unfortunately acd_cli don't work with large files. Therefore I'm search for a (virtual) filesystem which split ...
3
votes
0answers
1k views

Difference in space reserved for inodes in ext4 and XFS partitions

I am formatting a couple of 60G Logical Volumes (vg01-logs and vg01-monitoring) in one of our servers. These partitions will hold a large number of small files, so I want them with more than the ...
3
votes
0answers
2k views

How to mount ufs file system under Debian testing?

In order to mount my /dev/sda4 under /mnt/ufs_mount on Debian Testing , i have tried the following commands (it works fine under Debian Jessie): modprobe ufs mount -r -t ufs -o ufstype=ufs2 /dev/...
3
votes
0answers
179 views

How to stop Wine from assigning drive letters to mounted devices automatically?

Every time I attach a USB drive while or before running a Windows application with Wine, Wine notices it and adds a drive letter for it automatically. I would like to disable this feature in favour of ...
3
votes
0answers
842 views

FUSE Overlay filesystem for “too long filenames”

Is there FUSE overlay filesystem, that: * resolve on it's own "too long filenames" for underlying filesystem * otherwise (for filenames fitting into limits of underlying filesystem) just proxy 1:1 ? ...
3
votes
1answer
823 views

ext3 vs ext4 - same disk size, less usable disk space under ext4 comparing to ext3. why?

Files copied from ext3 filesystem do not fit on same size ext4 filesystem. How to reproduce: create two 1GB files, setup loop device for each, create filesystem one ext3, one ext4, mount, rsync ...
3
votes
0answers
1k views

EXT4 Journaling - Problem

Basically my root (/) ext4 partition keeps being mounted as read-only when I apply internal journaling feature. I understand that this should be default, but today I had been trying to apply external ...
3
votes
0answers
869 views

Mount LVM volume as external usb drive? CentOS 6

I'm trying to mount my old 2x500GB drives to the new server which has the same drive volume. Both have LVM structure but it's not working. root@server [/mnt/usb]# ls /dev/sd* /dev/sda /dev/sda2 /...
3
votes
0answers
103 views

Mapping a physical sector to a filename

I just finished using ddrescue to recover the contents of a failing hard drive. It was able to recover everything but two sectors. How do I figure out which files (if any) occupied those sectors? ...
3
votes
2answers
836 views

Unable to mount root filesystem rw with journal

Trying to understand the whole journalling setup and from what I've read and tried, it's eluding me somehow. The root filesystem is ext3. Examining it via tune2fs -l /dev/root shows that '...
3
votes
0answers
194 views

Problems with file system

I created a partition with EXT4 file system and when I'm writing in this partition frequently the Kernel return the following error: Jan 01 01:17:54 infobuffer360 kernel: r7:c0561280 Jan 01 01:17:54 ...
3
votes
0answers
1k views

No space left on device, with 320 GB free

I'm a bit lost. I have a 500 GB external hard drive with its original filesystem still in place. The last command (dd writing to a file within this filesystem) failed with "no space left on device". ...