Questions tagged [storage]
Use this tag to refer to any kind of data retention device (RAM, flash, hard disks, magnetic tape, punch cards, etc.), its means of separating pieces of information (files, blocks, sectors, etc.) or how to record and retrieve them. This is a very broad topic so selecting other tags relating to the medium (hard-drive, cdrom, etc.) or the format used on it (fat, ntfs, ext, f2fs, etc.) may help to identify it further.
456
questions
1
vote
1
answer
20
views
LVM extend single disk clarification
I need an explanation or a confirmation of how LVM volume can be expanded.
Below here's the storage management that come from a single VM that has 1 physical disk, this one is split into sda1 as a ...
- 21
-1
votes
1
answer
74
views
what is "dd if=/dev/zero of=/storage2/test4.img bs=1M count=256" usage?
I would be thankful if someone can explain me what does following command exactly doing:
dd if=/dev/zero of=/storage2/test4.img bs=1M count=256
0
votes
0
answers
13
views
Conflict with multiple SDcard readers of the same brand connected at the same time
I have some Lexar UHS-II card readers (I believe the model is LRWM05U-7000), and when I connect more than one I realize some operations read/write from/to the wrong reader. Some apps do not even ...
0
votes
0
answers
12
views
replacing hot swap disk on same controller DL380
I have a DL380 G9 server with RAID card and a few RAID LD setups. IT has some unassigned drives too. These are on the same SAS controller.
I know that when disk fails I can remove it and plug in a &...
- 215
0
votes
0
answers
9
views
Will the data I backed up using "backups application" in ubuntu can be accessed from fedora if I remove ubuntu and install fedora?
I want to ask that, I backed up all the important files and folders using "backups application" in ubuntu .
And now I want to remove ubuntu and install fedora, will I be able to access the ...
1
vote
0
answers
85
views
How to resize /home partition to solve "No space left on device"?
When I tried to install some python packages with pip, I got [Errno 28] No space left on device. Can I add some free space from sdb to /home(or /)?
>> df -h
Filesystem Size Used Avail Use% ...
- 11
0
votes
1
answer
37
views
Is there a simple way to delete MRS partition in new external drive?
I just bought a 5TB external USB drive.
This is what lsblk shows for it:
% lsblk --output=NAME,FSTYPE,LABEL,SIZE /dev/sdd
NAME FSTYPE LABEL SIZE
sdd ...
- 14.2k
0
votes
1
answer
42
views
I can't specify DD to overwrite a usb 2.0 at its theoretical speed limit
I'm trying to learn about filesystem and i/o operations in practice, i mean, acting in a conscious way and my task is to overwrite a USB 2.0 flash drive with the dd command in a Linux. But as dd is ...
- 1
0
votes
1
answer
29
views
DRBD on top of Ceph
Would it be possible to have DRBD directly running inside a Ceph Pool?
I have a backup machine with files stored directly on disk. The offsite backup machine has Ceph installed and configured on all ...
- 350
3
votes
2
answers
343
views
Is SSD performance hindered by access to folder on SSD via symlink on conventional spinning rust HD?
I prefer to keep my OS and applications on one partition and /home/ on another.
I intend to replace the current / drive with an SSD, then symlink /home/myuser/.local/ to a directory on the SSD because ...
- 15.2k
0
votes
0
answers
27
views
Missing usable space on RAID5
I have 3 drives, 4TB each, in a RAID5 setup. Usable space is 7.24 TB, all good & checks out. I use 5.5Tb and it reports 600Gb left. Maths does not checkout. I get an external drive and I move 5....
- 101
2
votes
1
answer
841
views
Inaccessable partition with 477GB
I recently installed Linux on my computer and the intention was to have a dual boot but that failed and wiped my disk of the Windows boot which isn't a big deal. However, I now have the unusable space ...
1
vote
0
answers
99
views
USB not detected and can't perform actions on it
While installing ChromeOS Flex into a machine, the installation process froze and we had to stop the installation. Now, the USB is not recognized in any machine, no matter if Windows or Linux.
When ...
2
votes
1
answer
63
views
stratis file system creation failed bcuz log stripe unit is too large. mkfs.xfs: libxfs_device_zero write failed: no space left on device
I am studying for RHCSA with the book by Asghar Ghori. I use virtualbox 7 and RHEL 9 on my macbook. Currently I am in Chapter 14 about Stratis and doing the exercise to create and confirm a pool and ...
- 21
0
votes
0
answers
85
views
understanding fio test results - 90th percentiles benchmark - Latency --> avg/stdev?
What are the relationships in storage benchmarking with fio between the average(avg) and standard deviation (stdev) at latency?
Avg / stdev at latency is important for sequential or random test?
Most ...
0
votes
1
answer
68
views
Always mount everything with read/write permissions (Fedora)
In fedora, if I plug in a usb drive, I would like to have all read and write permissions by default. It doesn't matter what format, just anything plugged in is default read and write.
I would also ...
- 183
0
votes
0
answers
139
views
How to unbrick a USB device that I bricked with testdisk?
I have a old USB 3.0 Blue DataTraveller 64 GB that I somehow managed to brick with testdisk. It had a big ExFAT partition and a small FAT16 partition made through Ventoy.
A folders contents didn't ...
0
votes
1
answer
223
views
What is the impact of different Linux I/O APIs on performance benchmarking of NVMe SSDs? (libaio vs SPDK vs io_uring)
I am benchmarking NVMe SSDs on my Linux server, with the aim to achieve the IOPS, BW and Latency values as mentioned in the product specifications.
I'm using FIO as workload generator, and used libaio ...
2
votes
1
answer
103
views
I increased VM storage from Virtual Media Manager in VBox but it is not applied in VM
Here is how I increased the storage of the VM in the VBox interface:
I used Virtual Media Manager.
When I click Information:
Format: VDI
Storage details: Dynamically allocated
Using the suggestion, ...
- 23
1
vote
1
answer
220
views
Why doesn't my hard drive show up as a block device?
My external hard drives shows up on another machine, running Arch Linux, although on Debian 11 the device doesn't show up in fdisk or lsblk:
$ lsblk
NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT
...
- 13
4
votes
1
answer
192
views
Mounting a drive from an embedded device with bytes swapped
I have a device from about twenty years ago that uses an IDE hard drive as storage. I would like to keep using it, but it has a USB 1 interface that is extremely slow.
I can take out the hard drive ...
- 81
0
votes
1
answer
67
views
How to backup many large files to single compressed file on S3
I have an application that has many thousands of files totaling over 10TB.
I'd need to backup this data somewhere (probably to AWS S3).
I'd like to:
compress data being backed up
save the backup as a ...
- 3
0
votes
0
answers
47
views
My 2TB Hard drive stopped showing up
I have checked lsusb, sudo fdisk -i, and eventually even my boot menu. No matter what it does not show up. I can hear the drive's fan working so I know it is receiving power, and the USB port is ...
0
votes
2
answers
128
views
What is the difference between the file descriptor, open file description, and inode? [duplicate]
What is the correspondence/difference between file descriptors and open file descriptions?
What is the correspondence/difference between file descriptions and inodes?
0
votes
0
answers
50
views
How to best control variability in fio for a reliable filesystem benchmark?
for a work project, I am tasked to create a benchmarking tool to measure the read/write performance of a physical device, which acts much like a database server. Currently I am focused on the ...
0
votes
1
answer
59
views
Can I backup my machine by just doing "cp -R / /pathToSSD"
I want to completely backup my computer. I got a 1TB drive. Normally backing up is a whole process and I find it would be so easier to just copy the filesystem into the drive then in the event of my ...
1
vote
0
answers
144
views
Adding a 3rd device to 2-striped LVM to make 3-striped volume on Linux
Currently I have single 2TB harddrive without LVM, very soon will add a 2nd one making 2-striped volume. So I'm trying to plan for the future expansion where I'll need to add a 3rd one.
Hence the ...
- 11
0
votes
0
answers
67
views
data recovery issue using foremost tool
i am trying to recover data using foremost data recovery tool in my ubuntu os
foremost recovers most known file formats by default like png, jpg, pdf and others, but i mainly need to recover files ...
- 1
0
votes
1
answer
45
views
unable to recover lost data after deleting mount points in ubunu
i have mounted two partitions on /media folder:
so later, i could access them through GUI as a separated partitions like this
by mistake, i have deleted the following mounting points of those ...
- 1
2
votes
0
answers
438
views
SSD is recognized as HDD in Windows VM in kvm
im facing with a problem in windows vm,
im using ssd for the vm storage but is shown as HDD type in windows.
is there anyway that i can fix this problem?
i know about lun passthrough, but i dont know ...
- 63
0
votes
1
answer
36
views
cephadm set cluster_network
I have setup new cluster on single NIC using cephadm but i have added extra nic for replication cluster_network. This is what i did to configure cephadm but it didn't work.
$ ceph config set global ...
- 1,612
1
vote
0
answers
150
views
file system choice pitfalls on 100TB volume
I have an 84 disk powervault storage array, I have configured as a virtual (as opposed to linear) array, with the RAID method as ADAPT (versus linear array of raid-5 or raid-10. One volume spans the ...
- 5,205
4
votes
1
answer
310
views
Unexpected disk label
I have a USB with a disk-label and a file-system label.
I am wondering how to change the disk-label.
Everywhere I read that there is no disk-label. And that is what I though, but I seem to have one.
...
- 27k
0
votes
0
answers
29
views
Can I find a way to remove some system data from storage?
I really don't know what happened but everytime I powerwash (factory reset) it goes back to its limit. Is there any way to fix it?
- 1
0
votes
1
answer
159
views
is mount option "sync" valid for all filesystems
I want to have an script that automatically mounts all USB drives on insert (granted they have a block/filesystem that is a valid partition).
My questiosn is: is sync an option that can be applied to ...
- 764
0
votes
2
answers
407
views
Can I mount a local drive/directory to a remote Linux server?
I have a beefy HDD connected to my Linux laptop and I'd like to be able to mount it to my remote Linux server somehow.
How can I do that? What's the simplest way to do it?
- 441
0
votes
0
answers
105
views
iscsi targetcli - what is the rule for lun names?
This command works fine:
/iscsi/iqn.20...404/tpg1/luns> create /backstores/block/FG1_DATA00 lun00
Created LUN 0.
But this one no:
/iscsi/iqn.20...404/tpg1/luns> create /backstores/block/...
- 383
0
votes
1
answer
193
views
why is the internal storage mmc and not sd?
I’ve been researching the difference bewteen sd and mmc after noticing that openwrt (and other distributions) name the internal storage that contains the system as mmcblk and other disks that live in ...
- 103
0
votes
1
answer
1k
views
ceph storage MDSs report slow metadata IOs
I am playing with ceph storage in lab and i have single server so thought installing all service on single box, like MON, OSD, MDS etc.
I have create two disk using loopdevice (This server has SSDs ...
- 1,612
0
votes
0
answers
244
views
unbind pci device from kernel driver during early boot in initrd on a sles VM
I am running a SLES VM, and I need to unbind a PCI device to its kernel driver and later bind to UIO or VFIO to test my user-space driver. There are multiple of such PCI devices, and I want to unbind ...
- 101
1
vote
1
answer
429
views
Backup created with rsync takes up more space on external drive than on source
I am using rsync to make a backup of Ubuntu running on a Raspberry Pi. I exclude all the usual directories whose contents are only created after boot up anyway.
The rsync writes to a backup image that ...
- 361
0
votes
1
answer
403
views
How can i add up unused disk to existing partition folder
I have an unused 1TB HDD and I need to add it to my main storage /dev/sda3, how can I do this without modifying the files on that partition?
- 152
0
votes
2
answers
282
views
USB connection from display detected as storage device
I have an MSI Optix MAG245R 23.8" display. It features USB connections.
When I start up my Debian-based machine (BunsenLabs), I get warnings that say:
May 4 19:41:51 localname kernel: [ 240....
- 1,003
0
votes
0
answers
170
views
Using Raspberry Pi to emulate USB storage for files stored on NAS
Summary
I am looking to bridge a NAS file share to a FAT32 "USB Gadget" that can save/load files transparently to the NAS as if the host device was writing them to the USB Storage. Apologies ...
- 1
0
votes
1
answer
44
views
where in the FHS does command less store its buffers?
Using Kubuntu 20.04, which is running from an USB stick. Therefore there is a /cow overlay file system mounted on /. The USB stick has a total capacity of 32 GB, But to the cow overlay file system ...
- 111
2
votes
1
answer
373
views
In what case(s) will `--type mirror` continue to be a good choice / is not deprecated?
The man page of lvcreate says that the LV type mirror is legacy and lvconvert says "In most cases, the mirror type is deprecated and the raid1 type should be used. They are both implementations ...
- 294
1
vote
0
answers
182
views
Tool for converting an existing multi-disk LVM to be striped?
I have an existing LVM volume group of 3 disks (same size) with 4 linear LVs. I would like to convert the LVs to be striped across the disks to balance the load on the disks more evenly.
Shrinking the ...
- 294
0
votes
0
answers
139
views
The two SSDs have the same name by-id
There is a single-disk ZFS pool. Now I want to add another ssd to the pool and create a mirror.
zpool
pool: datapool
state: ONLINE
scan: scrub repaired 0B in 00:00:03 with 0 errors on Sun Feb 13 ...
- 1
0
votes
0
answers
474
views
Read/Write speed monitor of NFS
I would like to see the disk read/write speeds for a network attached storage drive mounted via NFS. I am copying large amounts of files from a local disk to the network attached drive.
running df -h ...
- 101
0
votes
1
answer
339
views
dd faster than it should be
When I run the command dd if=/dev/zero of=tmp.dat bs=1M count=1024 status=progress on a 500G HDD I get
833617920 bytes (834 MB, 795 MiB) copied, 1 s, 829 MB/s
1024+0 records in
1024+0 records out
...
