Questions tagged [disk]
Questions about disk drives under the UNIX and Linux systems. See also the "filesystems" tag.
272
questions with no upvoted or accepted answers
5
votes
0
answers
4k
views
Cannot mount, read, write, or format SD Card
I can
read from my micro-sd card when it is in "lock" position
but things get very weird when I try "unlock" it: there is no way I can
fsck it, nor
mount it, nor
read it, nor..
format it!
I need ...
- 2,551
5
votes
0
answers
282
views
"leaky bucket" style disk io throttling using linux kernel
My goal is to prevent one kvm guest's disk i/o usage from negatively affecting other kvm guests on the same host. The host has one disk array - and separating guests onto different physical disks is ...
- 151
5
votes
0
answers
3k
views
Disk I/O latency using /proc/vmstat file
How do I calculate disk read and write latency in Linux?
Is it possible to do the calculation using /proc file system?
I am using iostat and vmstat command. But I do not understand how the ...
- 2,508
4
votes
0
answers
2k
views
NVMe errors diagnostics
I would like to understand why I get the below mails about S.M.A.R.T. of my new NVMe drive.
DMESG
$ dmesg --ctime | grep -i nvm
[Mon Aug 8 10:48:31 2022] nvme nvme0: pci function 0000:3d:00.0
[Mon ...
- 26.7k
4
votes
0
answers
51
views
Prevent hard drive from powering on when resuming from suspend to RAM
My laptop running Debian testing (Bullseye) has two hard drives: the first with the OS and my documents, and the second containing data that I use rarely. There is no link between these two drives (no ...
- 41
4
votes
0
answers
436
views
What is the difference between size and capacity in lshw?
I just came across an odd thing while looking at my disks with lshw. I have a 4 TB and a 6 TB disk. lshw shows the expected 6 TB for size but nearly 8 TB for capacity. The 4 TB disk has the same ...
- 510
4
votes
1
answer
2k
views
Disable writeback cache throttling - tuning vm.dirty_ratio
I have a workload with extremely high write burst rates for short periods of times. The target disks are rather slow, but I have plenty of RAM and very tolerant to instantaneous data loss.
I've ...
4
votes
0
answers
1k
views
The proper way to turn off an external sata encolsure?
I have an e-sata external enclosure with a port expander and 4 sata disks in it that I use for periodic backups. I have what I think is a sound method for powering it off, but not sure if it is the ...
- 14.5k
3
votes
0
answers
36
views
Minimizing disk usage with parallel calls to GCC
I am experimenting with testing GCC in parallel. My setup will run 96 tests before giving me the test report.
If I run these tests sequentially it will invoke GCC once, run the executable, gather ...
- 131
3
votes
2
answers
2k
views
How to mount this disk? (EBS)
I restored an EBS volume and attached it to a new EC2 instance. When I lsblk I can see it under the name /dev/nvme1n1.
More specifically the output of lsblk is:
NAME MAJ:MIN RM SIZE RO TYPE ...
- 1,225
3
votes
0
answers
739
views
QEMU shared folder performance problem
I've got a Windows 10 virtual machine running on Ubuntu 18.04 host (QEMU 2.11). I've created a shared folder with the command line parameters -netdev type=user,id=smb0,smb=/mnt/ntfs,restrict=on -...
- 156
3
votes
0
answers
839
views
/sys/block/sd*/device/timeout not accurate
The default value for the timeout file for SCSI disks is 30, supposedly meaning 30s. In my dmesg logs, I find that the system is waiting 180s before timing out. Setting timeout to various values ...
- 653
3
votes
0
answers
239
views
Root device has 2.9GB disk space free, but throws disk full errors
Here's some console output below to illustrate the problem. I was able to work around this by clearing out old packages which gave me 4.6GB free, but I wanted to pose this question here out of ...
- 593
3
votes
0
answers
252
views
Linux drive not being read anywhere
I installed Manjaro Linux on my new 128GB M.2 SSD. It was all working fine for a week or so. I was then deleting some large files (4+GB) from another 2TB HDD. Each of these deletions took about a ...
- 253
3
votes
0
answers
94
views
Looking for special files by minor number and major number
Is it possible to use find command (or anyone else) in order to look for special devices (like disks) passing minor/major number? I thought something like this:
find / -type c -minor 30 -major 29
...
3
votes
1
answer
2k
views
Best Filesystem to Merge Across Different Size/Speed Drives?
I tend to run Debian-based distros. My main desktop is running a new Asus server board (Tons of SATA ports) in a Cosmos II case (Tons of drive bays). I already have 4 extra drives in my computer and I ...
- 603
3
votes
0
answers
3k
views
Why is systemd-journald doing some massive disk writes?
For some reason my computer shut down recently. I have also fairly recently done a pacman -Syu to upgrade all the things.
However, now systemd-journald is doing a massive amount of disk writes - like ...
- 11.4k
3
votes
1
answer
1k
views
Why is the block size of a partition smaller than that of the underlying disk?
My understanding is that the block (in the phrase "block size") is like an IO buffer, or minimum IO size for a device. Since partitions are built on top of physical devices, how can they have blocks ...
- 255
3
votes
0
answers
288
views
monitoring block access to disk
I am looking for a way to monitor access to disk blocks, and to monitor the access as a bitmap of blocks.
I also need the capability to freeze (and queue) the device block access (and also to ...
- 1,387
3
votes
0
answers
3k
views
Very slow file operation
I recently rebuild a machine with Centos 5.8 with a brand new disk.
This machine is old and has been running 5.8 for a long period with no issues so the only thing which changed recently is the new ...
3
votes
0
answers
3k
views
How do I get ata-style IDs in /dev/disk/by-id to work for USB disks?
I have USB drive dock that I'm plugging SATA drives into. The way they show up in /dev/disk/by-id seems to be dependent on whether the drive has a partition table (usb if not, ata if yes). This makes ...
- 131
3
votes
1
answer
6k
views
disk or partition log history
Is there any way to find the disk status log or disk free space history.
How can I show the disk status of my partition table?
Scenario is I have to provide the status of the disk status which is ...
- 3,104
2
votes
0
answers
91
views
Is there a GUI linux application that shows per mounted disk i/o transfer rate in a graphic?
Is there a GUI linux application that shows per mounted disk i/o transfer rate in a graphic?
(Like gnome-system-monitor do for the swap mount but for each mounted drive)
I'm looking for an application ...
user330163
2
votes
0
answers
212
views
No space left on device despite there is a lot of space/inodes/filefd remaining
I'm running EKS worker nodes with EC2 on AWS. There are some nodes saying "No space left on device"; all the pods in those nodes can't create new files. All nodes have only 1 volume (/).
I ...
- 21
2
votes
0
answers
2k
views
What caused nvme QID timeout?
Sometimes I see the nvme error logs:
nvme nvme1: I/O 332 QID 1 timeout, aborting
nvme nvme1: Abort status: 0x0
nvme nvme1: I/O 332 QID 1 timeout, reset controller
nvme nvme1: I/O 0 QID 0 timeout, ...
- 697
2
votes
0
answers
130
views
I see the sizes of the files on a disk incorrectly
Running services are filling up disk space. I reboot it frees up disk space. How can I find files created by programs in disk space but not visible with the "du -ch /.[!.]* /disk1" command.
$...
- 31
2
votes
0
answers
202
views
How to check the accumulated data written by each process
I have pihole running on a single board computer and i'm trying to reduce as much as possible data being written to the sd card. I already have logs and pihole database running in a ramdisk but
awk '/...
- 21
2
votes
0
answers
299
views
How to detect changes to disk capacity in linux?
I'm working on a program that needs to monitor changes to the system mounts and the size of disks and partitions. While I found out the changes in mounts can be detected using epoll on /proc/mounts, ...
- 21
2
votes
1
answer
1k
views
How to free space in /tmp and then move that free space to /usr?
When I install Fedora, I was sure the space I gave to /usr was more than enough, but at the end, after I installed some development packages, I have used about 65%, which is unexpectedly much.
When I ...
- 121
2
votes
0
answers
742
views
Mount an existing partition without formatting
I've installed Arch Linux on /dev/sda2 and it is marked as boot.
But I have all my old files and documents in /dev/sda1 that is not accessible.
When I run sudo mount /dev/sda1 /mnt, there is an error:
...
- 21
2
votes
0
answers
2k
views
Trying to mount a Mac HFS+ encrypted disk
tl;dr I'm having trouble mounting a disk in Buster using hfsplus formatted under Mac OS Extended (Journaled, Encrypted) that was created under Catalina.
This was asked on the Pi exchange but they '...
user407154
2
votes
0
answers
605
views
USB SSD not mounted but cannot format (LUKS format)
I am trying to encrypt a USB SSD attached to my tiny server with LUKS.
The SSD is NOT mounted but still cannot format it.
(sda1 is my external drive)
sudo cryptsetup --verbose --verify-passphrase ...
- 21
2
votes
0
answers
264
views
Why do we need filesystem block checksum?
Each sector on the disk has its own ECC to detect (and can sometimes correct) data corruption.
Yet some filesystems like Btrfs and ZFS provide checksum for each of their data block. Is it really ...
- 445
2
votes
0
answers
311
views
Fast way to create virtual disks?
I want to create virtual 500GB ext4 disks on external usb disks and samba/nfs shares.
For test purposes, I first tried with a 1GB file using the following commands.
sudo dd if=/dev/zero of=/mnt/...
- 41
2
votes
0
answers
444
views
Partition Start and End Calculation
I was using the parted command and i was trying to create a new partition using the mkpart option. While i was doing this it asked for the partition start and end.
Now i believe i know what the ...
- 919
2
votes
0
answers
2k
views
Using udisksctl to power off external hard drive causes hard lock
I possess an external USB 3.0 hard drive which is connected to my notebook. Of course, I do not want to just tug the connector off when I'm done; rather, I want it to safely spin down as per good ...
- 131
2
votes
0
answers
145
views
Available disk space drops, while used space stays almost still
Recently I found out that on one of my servers (Ubuntu 16.04) I get significant drops on free disk space, at nights:
zooming to the last 1h (from right now):
one can see this happens abruptly. Just ...
- 251
2
votes
0
answers
2k
views
Disks aren't showing in /dev/sdX
I got a 2nd SSD installed in my system, and for some reason it's not showing up in /dev/sdX nor is it being shown as a mountable drive. The partitions and the disk exist, but for some reason Linux ...
user91679
2
votes
0
answers
48
views
Prompt user with email when Disk Usage is over 200GB
find . -printf "%u %s\n" | awk '{user[$1]+=$2}; END{ for( i in user) print i " " user[i]}'
Hi I have been using the above CMDline to look for each user's disk usage information. I would like to know ...
- 21
2
votes
0
answers
229
views
Receiving a lot of errors from /dev/sda
I have an Asus EeeBox PC - B204( original specs here: https://en.wikipedia.org/wiki/Asus_EeeBox_PC ) running Ubuntu 14.04.5 LTS;
The only thing changed was the original hdd to a Kingston V300 SSD;
...
2
votes
0
answers
514
views
Priority read and write files
Good day, I had a question that I could not find the answer. I tested my hard drive, mounted on /media/data using dd. Some simple scripts:
write:
echo "3" > /proc/sys/vm/drop_caches
for i in {1....
- 21
2
votes
1
answer
104
views
How can I differentiate disk I/O occured explicitly by a user and OS prefetching?
I am monitoring disk I/O usages of an application program (running on CentOS 7)
It uses lots of sequential disk I/Os where I expect that OS prefetching is something!
dstat shows how many disk I/Os ...
- 675
2
votes
0
answers
161
views
Use a "Friendly" Label on Drives or Partitions in FreeBSD
Maybe I am missing this and it's really simple, but I cannot figure out how to label a BSD disk.
I have looked at tunefs or gpart and even disklabel, however none do what I am looking for - I don't ...
- 988
2
votes
0
answers
206
views
unix c-shell : disk checking
im totally new in shell scripting. I have task to simplify an old c shell script. Basically, the script have 10 devices that using hp-ux and i want to check the disk space in each devices. my ...
- 43
2
votes
0
answers
292
views
GNOME Disks Sample Size
I'm trying to use GNOME Disks to test my disk performance and, according to my previous experience, I'd like to set the sample size to 8K, 16K and 32K. However, I see the minimal sample size in its ...
- 353
2
votes
0
answers
1k
views
LVM partition not mounting
There was a drive failure on a disk in a RAID1 configuration. I removed the bad disk and reconfigured the RAID1 to only use the good disk. When I reboot the machine there are missing LVM partitions.
...
- 21
2
votes
0
answers
495
views
View syscalls/kernel activity for I/O from a running process
I'd like to be able to view syscalls or kernel activity for a process...I'm not actually sure of the terminology I need here! Specifically I'm looking for the difference between I/O going to local ...
- 21
2
votes
0
answers
435
views
SMART extended offline test validity
Is it possible for the smartctl -t long /dev/sda to complete without error and still the drive fail?
How detrimental to the disk's life expectancy is running the test daily/weekly?
Thanks!
- 1,065
2
votes
1
answer
907
views
expanding boot, moving LUKS root
GPT > Partition2 > LUKS > btrfs
I need some additional space for my boot volume, so far I did:
Shrink my btrfs volume by 250MB. btrfs resize -250M /
Shrink the LUKS root volume cryptsetup ...
- 289
2
votes
0
answers
399
views
Block Devices & Partitions
I partitioned a microSD card (mmcblk1) into two partitions mmcblk1p1 and mmcblk1p2.
If use a dedicated card reader I am able to see the entire SD card and its partitions using various disk management ...
- 121