Questions tagged [zfs]
ZFS is a combined file system and logical volume manager designed by Sun Microsystems The features of ZFS include protection against data corruption, support for high storage capacities, efficient data compression, integration of the concepts of filesystem and volume management, snapshots and copy-on-write clones, continuous integrity checking and automatic repair, RAID-Z and native NFSv4 ACLs.. -Wikipedia
501
questions
0
votes
1
answer
20
views
Missing directory after move to a link
I have the following dir structure
zfs filesystem - /opt/test/tmp
zfs filesystem - /opt/data/
I have two directory links:
/opt/test2/_tmp -> /opt/test/tmp
/opt/test2/_tmp2 -> /opt/data
In /opt/...
- 701
0
votes
1
answer
42
views
How to mount a ZFS volume in FreeBSD for cloning
I am in the process of trying to clone a FreeBSD installation onto a new hard drive and need to mount it and then find the mount points in order to proceed with the cloning process.
The internal drive ...
- 447
0
votes
1
answer
20
views
During zpool scrub, does estimated completion time have a bug shows 0.01% at 10%?
I have a raidz2 on a quad of 250G drives in a USB enclosure on linux. Purely for backups. In fact I'm aware at least one drive has issues so it's a fun experiment. Naturally, it has started to hiccup -...
- 101
2
votes
0
answers
78
views
Forcing the failover to a hot spare in a degraded ZFS pool
I have a simple 5x1TB RAIDz1 configuration (tank? pool? vdev?), with a global spare assigned to it. One of the 5 drives in the array is listed in a FAULTED state (corrupted data), and the spare is ...
- 1,025
0
votes
1
answer
71
views
Lenovo USB-C "hybrid" dock connected during boot: Boot hangs and zpool does not get loaded
I am trying to make a Lenovo Thinkpad P52 work with an Lenovo USB-C Hybrid Dock (40AF, see docks to avoid ...) on Linux Mint 20.3 Una a.k.a. Ubuntu 20.04. What a ... journey ...
The laptop has its /...
- 405
0
votes
0
answers
30
views
ZFS dataset grew in size after send/receive
My old pool, zpool0, is on 8-disk raidz3. I am moving it to a new pool, zpool2, on 2-disk mirrored vdevs, because I can't expand my raidz3 pool. Having never used zfs send/receive, I transferred one ...
- 13
0
votes
1
answer
58
views
Expand 4TB storage drive that is at max capacity to 4 4TB drive RAID or ZFS, utilizing all 4 drives
I have a 4TB drive that is nearing max capacity and would like to move the data to a RAID or ZFS (the host OS is ProxMox 7.1).
I have 3 other identical (WD Blue) 4TB drives (I might be able to get 1 ...
- 101
1
vote
1
answer
50
views
Identifying the sources of mysterious IO that prevent ZFS disks from spinning down
I have a Debian system with an SSD as the primary drive and two spinning disks for bulk storage configured with a single mirrored vdev (and a single partition within it).
Those disks are loud, so I'd ...
- 111
2
votes
1
answer
71
views
Why is it necessary to run fsck regularly?
Some systems run fsck on every boot, after so many days, or after so many mounts. For example, in How often should I reboot Linux servers? - Server Fault they discuss a variety of strategies for doing ...
- 333
1
vote
1
answer
72
views
manjaro: ZFS pool does not load during boot (using zfs-import-cache/zfs-mount) but no problem when manually running zfs-import-cache
TLDR:
ZFS pool is not mounted/imported during boot even though zfs-import-cache/zfs-mount have been enabled
looking at lsmod/journalctl, the ZFS module has been loaded
no problem manually importing/...
- 1,689
1
vote
0
answers
94
views
Ubuntu 21.04: ZFS pool automount not working
setup: Ubuntu 21.04 (with latest updates). The problem happened even before 21.10 was out. I just never bothered fixing it until now.
zfs version is:
root@myserver:~# zfs --version
zfs-2.0.2-1ubuntu5....
- 1,689
3
votes
1
answer
342
views
Storage encryption on Linux desktop: LVM on LUKS or ZFS
I choose solution for storage encryption on Linux desktop. For years LVM on LUKS was a best option with superior performance and reliability. But ZFS on Linux actively develops new functions and now ...
- 141
2
votes
1
answer
275
views
CentOS 7: after reboot, zfs module won't load, no /dev/zfs
After 959 days a reboot was needed on the CentOS 7 system which has used ZFS flawlessly for the past years. I have run yum update once a month during that time.
The rebootet system is apparently ...
- 1,670
0
votes
0
answers
45
views
Migrate ubuntu off zfs
I'm running ubuntu 21.10 on a zfs drive for my desktop pc.
I'm having problems with docker and zfs (lots of docker bugs) so I need to move away from zfs.
I'm looking at moving to btrfs but not really ...
- 101
0
votes
1
answer
133
views
Growing a zpool raidz2 with larger disks?
I have Linux PC with RaidZ2 over 6 disks, 3T each. Disks is shared between several partitions; the zpool lays only on part 6 on each disk; other partitions are used for other purposes.
I am going to ...
0
votes
1
answer
493
views
ZFS send/recv full snapshot
I have been backing up my ZFS pool in Server A to Server B (backup server) via zfs send/recv, and using daily incremental snapshots.
Server B acts as a backup server, holding 2 pools to Server A and ...
0
votes
1
answer
138
views
ZFS - only one single disk/by-id for two nvm devices
I am trying to use best practices to setup a mirrored zfs pool on a ubuntu 20.04 server.
My hardware is 2x 1TB nvme in an external USB-C enclosure GEN2 SSD enclosure.
My issue is both disks seem to ...
- 3
0
votes
0
answers
78
views
how to add arch zfs rpo to pacman on arch linux
how to add arch zfs rpo to pacman on arch linux ?
on my arch linux am getting this error
❯ nocorrect sudo pacman -Syu
[sudo] password for beasly:
error: archzfs: signature from "ArchZFS Bot <...
- 304
0
votes
0
answers
10
views
Issue in boot due to slow controller
Im running ubuntu 20.04 on dell r740xd, One of the disk controller seem to present the disk(multipath disks used for openzfs pool) slow while the server is booting. If the server is boot from '...
- 335
0
votes
0
answers
13
views
How to live copy current running OS onto backup on zpool?
So I have this idea which would require a few techniques which I haven't used in quite a while. I would like to create an ZFS (SSD based) raidz2 which among other things will contain a live copy of ...
- 61
1
vote
1
answer
50
views
how can I dd ONLY last portion of drive that hasn't already been dev/zero'd
I regularly dd a drive to erase them for ZFS resilver, when something goes awry with read/write or checksum error, to put the drive back into service. Frequently, removing the partition table at the ...
- 678
3
votes
1
answer
384
views
Replace ZFS with dm-integrity and dm-raid
I recently had a lot of data destroyed from a ZFS bug when I updated my computer (may have been related to https://www.reddit.com/r/zfs/comments/ql0bro/ubuntu_2110_zfs_corruption_bug/ or some other ...
- 131
0
votes
1
answer
46
views
Issues sharing a portable encrypted ZFS-formatted drive between two Linux machines
I have two Linux (NixOS) machines that I would like to share an encrypted ZFS-formatted portable USB hard drive. I've gotten this to work fine for a single machine, but I may have destroyed the ZFS ...
- 1
0
votes
1
answer
102
views
Backing up a ZFS pool on a laptop
I have been happily using ZFS pools on laptops for a few years, doing backups on an external drive containing a second pool. But recently, I switched from macOS to Linux, and discovered ZFS on USB ...
- 231
0
votes
0
answers
183
views
How to debug a loop in systemd-shutdown / initrd ? (Arch Linux)
I've recently installed Arch Linux to a virtual disk, under a custom configuration for root on ZFS. This was in using some scripting I've put together for managing a multiboot configuration, with ...
- 146
0
votes
1
answer
72
views
Can I use virtual memory for ARC ZFS write cache?
I want to use virtual memory for ARC ZFS write cache, because it is troublesome for me to increase physical memory but I want fast writing to a DB in a ZFS.
$ free -h
total used ...
- 2,036
1
vote
2
answers
139
views
How do I make ZFS with ZIL SLOG consistent if the SLOG is lost?
I have a ZFS on a HDD with ZIL SLOG on an SSD.
If that's relevant, I have also a LARC cache on an SSD.
How can I reconfigure it to be sure that a failure of the SSDs won't cause data inconsistency (...
- 2,036
0
votes
0
answers
21
views
Is modifying a database on compressed ZFS slow?
Is modifying (mainly inserting new rows into tables with many indexes) a (PostgreSQL) database on a compressed ZFS slow (compared to an uncompressed ZFS)?
I used a slow HDD backed by SSDs. Ubuntu ...
- 2,036
0
votes
1
answer
340
views
Install zfsutils on debian bullseye on raspberry pi 4
I'm running into an error installing zfsutils on Pi OS 64-bit upgraded to debian bullseye.
sudo apt install zfsutils-linux
The following packages have unmet dependencies: zfsutils-linux : Depends: ...
- 111
0
votes
0
answers
157
views
Recover disk space lost by ZFS and Syncoid / Sanoid -- please help
Long-time reader, first-time poster here. Being new to Linux I've perhaps stupidly (given my level of expertise) allowed it to install with the ZFS file system. This seemed nice initially because it ...
user498013
1
vote
0
answers
205
views
ZFS on Linux: Can ZFS send a snapshot and receive a newer snapshot of the same dataset at the same time?
I have a production server P and a standby server S. Both are running Debian buster and OpenZFS / ZoL 2.1.0. P has only internal disks which provide ZFS storage for the O/S, the VMs and all other data....
- 2,191
0
votes
1
answer
985
views
Create ZFS partition on existing drive
I hear that ZFS has deduplication, so you can save the same file in multiple places but only use ~1 copy's worth of space. I've noticed I tend to end up with music/images/etc. in multiple places ...
- 219
1
vote
1
answer
32
views
Can ZFS snapshot names contain newlines? If yes, how to parse the output of zfs list -t snapshot?
The following question relates to ZFS on Linux (ZoL) / OpenZFS, as it is provided e.g. in Debian Buster and Debian Bullseye.
As the title says, I'd like to know whether ZFS snapshot names ...
- 2,191
0
votes
0
answers
65
views
Missing files on a ZFS dataset
I have a few mysteriously missing files on one of my ZFS datasets. An example:
$ ls -l
ls: cannot access 'cover.jpg': No such file or directory
ls: cannot access 'metadata.opf': No such file or ...
- 231
0
votes
0
answers
95
views
Solaris 10/ZFS: Can't change new disk label so I can attach to existing rpool
# uname -a
SunOS blade 5.10 Generic_147147-26 sun4v sparc SUNW,SPARC-Enterprise-T5220
Two new disks, first is c1t10d0:
# cfgadm -al |grep c1
c1 scsi-sas connected ...
- 1
0
votes
1
answer
44
views
What is the `/` command displayed by htop?
I’m running FreeBSD 12.1-RELEASE on my home server.
From time to time, the server’s HDDs thrash for hours on end, even though the server itself should be idle. (I have no cron jobs scheduled, and I ...
- 213
0
votes
1
answer
49
views
Recover disk space lost by ZFS after removing an image file dataset
I have 1TB drive running zfs on root using ubuntu 21.04. I was using less than 70GB for my system. I have created (truncated) an image file using 600GB. I used this image file for a different zfs ...
- 111
1
vote
0
answers
108
views
Horrific beginner mistake using OpenZFS
This was my first time using ZFS and I made a huge blunder.
I created my "server" zpool as per:
sudo zpool create -f server raidz2 /dev/sdb /dev/sdc /dev/sdd /dev/sde
Then, there was a ...
- 61
1
vote
1
answer
124
views
Recovering a ZFS pool after accidentally formatting a disk
I have a RAIDZ-1 pool with 5 disks on an Armbian (Buster) system.
Due to a bizarre glitch involving armbian-config over a faulty serial connection, one of the disks (sda) was repartitioned before the ...
- 13
1
vote
0
answers
87
views
Add unused partition `Solaris reserved 1` to mirrored zpool
I am running an Ubuntu 20.04 LTS server for data storage on a mirrored ZFS pool. The server has the following devices and their primary targeted usage:
/dev/sdc -> SSD INTEL SSDSC2BA10; Linux ...
- 11
3
votes
1
answer
63
views
zfs send performance
I'm having an odd performance issue when trying to backup my zfs filesystems.
I can tar the contents of a zfs filesystem at 100+ MB/s, but zfs send trickles the data at maybe 5 MB/s. The filesystem ...
- 701
0
votes
1
answer
46
views
Shrunk virtual disk file, now reported file size doesn't match
I originally had a single virtual disk file (.qcow2) of roughly 3.5 TiB and I decided to "group" all similar data on its own virtual disk file, for various reasons. Obviously that meant I ...
- 11
1
vote
3
answers
173
views
Get rid of default/root dataset in ZFS
I am new to ZFS and I am trying to know how it works. I created a pool using several disks named tank. Besides, it seems that a default dataset named after the pool was created. Nevertheless, I do not ...
- 367
0
votes
0
answers
62
views
Testing zfs scrubbing with sparse files
I want to play around with and test zfs a little, at the moment I want to test the scrubbing, live if possible. So I decided to create some sparse files in /zfs (similar to here):
$ for i in {0..3}; ...
- 161
0
votes
0
answers
47
views
How can I monitor whether disk activity is sychronous or asynchronous?
My Google-fu simply cannot find an answer to this.
If I have a process with heavy I/O activity, how can I check whether it's using asynchronous or synchronous writes?
(I want this information to ...
- 161
0
votes
0
answers
75
views
unable to detect filesystem after enabling zfs-native encryption on existing dataset
I wanted to encrypt existing dataset in ZFS pool using zfs-native encryption, however am unsuccessful to get the desired result.
I followed the given steps to create new dataset in existing Pool.
dd ...
0
votes
0
answers
50
views
Is there a way to access ZFS formatted USB stick in Linux?
I have a usb stick formatted in FreeBSD as ZFS which I want to mount, copy all data and reformat as ext4.
Is there a way to perform such things in Linux?
- 103
0
votes
0
answers
27
views
Persistent read/write/cksum errors on raidz2 even after replacing disks (Netapp DS4243)
I have a once-working, now degraded zfs pool configured as follows, which I have been attempting to repair for weeks now by replacing and re-replacing disks only to have the same problems on the same ...
- 11
2
votes
1
answer
402
views
Is there any advantage to using a hard-link on ZFS instead of relying upon deduplication when considering only disk space allocation?
If I want to create multiple instances of a file on a ZFS file system, is there any advantage to using a hard-link instead of relying upon deduplication as a method of preserving disk space?
This ...
- 2,145
0
votes
0
answers
16
views
What is stored in zfs dataset after create filesystem or volume?
I just wonder zfs structure.
I create normal zfs filesystem.
In case, 'test' filesystem in 'master' pool.
basic filesystem create
Although i only create filesystem, 'master/test' has occupied 88 Kbyte....
