Questions tagged [zfs]
ZFS is a combined file system and logical volume manager designed by Sun Microsystems The features of ZFS include protection against data corruption, support for high storage capacities, efficient data compression, integration of the concepts of filesystem and volume management, snapshots and copy-on-write clones, continuous integrity checking and automatic repair, RAID-Z and native NFSv4 ACLs.. -Wikipedia
606
questions
2
votes
1
answer
12
views
Storing large amount of small files in HDD pool
I have a Z6 HDD pool with 6 x 18T drives and a SLOG, LZ4 compression is enabled by default. Now I need to store large amount of small files and I'm worried about fragmentation.
The files:
70K files ...
- 177
1
vote
1
answer
24
views
Installing pot on FreeBSD: no such pool 'zroot'
According to the documentation of pot, the following has to be done to install it:
pkg install -y pot
pot init -v
I tried this, but ended up with the following error:
cannot create 'zroot/pot': no ...
- 203
1
vote
0
answers
21
views
How to replicate an entire disk using ZFS
I have 2 x 2TB disks (they are not equal). In the master I have my ZFS pool (rpool, where Proxmox is installed in). I'd like to clone/replicate the entire disk on the slave once a day.
How can I do?
- 341k
0
votes
1
answer
3k
views
Kernel-header packages I installed Debian are the wrong version
I was trying to install ZFS on Debian 11 and a prerequisite is to install the proper kernel headers. Every package I have tried to install has not worked. My kernel is 5.10.0-18-amd64, but these all ...
CommunityBot
- 1
0
votes
1
answer
29
views
zfs: Destroying snapshot frees way more than expected
Before:
$ zfs list -t snapshot -r rpool/DATA
NAME USED AVAIL REFER MOUNTPOINT
rpool/DATA@zfs-auto-snap_monthly-2023-10-01-0452 140G - 22.7T ...
- 341k
5
votes
1
answer
2k
views
How can I detect whether an "NMI watchdog: BUG: soft lockup" is a hardware or a software issue?
Soft Lockup
dmesg reports in my laptop, since quite some time now, NMI watchdog: BUG: soft lockup every time I try to use updatedb or firefox. Samples of what is reported posted at https://github.com/...
CommunityBot
- 1
10
votes
5
answers
19k
views
ZFS on Linux: cannot destroy snapshot, dataset is busy
I'm trying to delete a bunch of old ZFS snapshots but I get errors saying that the datasets are busy:
[root@pool-01 ~]# zfs list -t snapshot -o name -S creation | grep ^pool/nfs/public/mydir | xargs -...
- 341k
0
votes
0
answers
18
views
ZFS: Keyformat required for new encryption root
I am trying to create a filesystem in ZFS with the following command:
zfs create -o compression=on -o recordsize=1M -o encryption=on pool/dataset
I am unable to do so, since I receive the following ...
- 341k
24
votes
1
answer
2k
views
Why does ZFS scrub not complete?
First off let's start with what I'm running. This is a home media server running Ubuntu 16.10. I have one pool of mirrored 6 terabyte drives that are about half full. I built the system about a month ...
CommunityBot
- 1
9
votes
2
answers
6k
views
How does ZFS copy on write work for large files
Let's say I have a large file (8GB) called example.log on ZFS.
I do cp example.log example.bak to make a copy. Then I add or modify a few bytes in original file. What will happen?
Will ZFS copy the ...
- 15.9k
1
vote
1
answer
33
views
swap on zfs blocks system
Over the past few years I have had two laptops exhibiting the same behaviour.
One was fixed by re-installation.
The other is currently broken.
The issue is that as soon as the laptop starts swapping ...
- 1
7
votes
2
answers
2k
views
Does ZFS deduplicates across datasets or only inside a single dataset?
Does ZFS deduplicates across datasets or only inside a single dataset? In other words if I have two nearly identical volumes will they be deduplicated?
- 341k
1
vote
0
answers
39
views
ZFS error while mounting an encrypted partition
ZFS errors, I dont know why. Here are the step-by-step actions I took to attempt to mount the encrypted ZFS disk.
$ sudo zfs list
NAME USED AVAIL ...
- 22.9k
0
votes
1
answer
21
views
Adding a fresh zfs sub-dataset pri_zp/Z1/Z99-future to pri_zp/Z1, and resuming recursive replication to sec_zp/Z1
I have set up and replicated the OpenZFS dataset pri_zp/Z1 (with pri_zp/Z1/Z00-initial) to sec_zp/Z1 using a zfs send -R.
But then (months later) when I try to create (and replicate) a newer data set, ...
- 230
0
votes
0
answers
13
views
Virtual volume stored on a RAIDZ pool takes twice the amount of space as it should
I have a Proxmox server with 24 4T nvme drives. I have created a RAIDZ pool called Media3 which is about 84T in total usable space. I have setup a virtual host and added a second virtual disk to the ...
- 11
2
votes
1
answer
96
views
How to Remove a Large File from ZFS Snapshots and Reclaim Space?
I have a series of daily ZFS 100Mb snapshots of archive_zp/my_zfs, going back 100 days. At day 60 (between @ss59%ss60) I had added a 10 GiB sized archive_zp/my_zfs/BIG.iso file, that 10 GiB now ...
- 19
0
votes
1
answer
64
views
ZFS error for load-key
I've tried everything I know until I'm exhausted. Please, if you can help me, I need to access my project stored on my hard drive.
The command I used:
sudo zfs load-key rpool/ROOT/ubuntu_uy913x
And ...
- 150
0
votes
1
answer
142
views
Unable to mount encrypted ZFS filesystem after reboot
Key load error: Failed to open key material file: Input/Output Error.
Command: `mount -o zfsutil -t zfs rpool/ROOT/ubuntu_uy913 /root/`.
Message: `zfs_mount_at() failed: encryption key not loaded`.
`...
- 293
0
votes
0
answers
51
views
Unlocking only specific ZFS datasets at boot
I have the following datasets in a ZFS pool:
NAME USED AVAIL REFER MOUNTPOINT
rpool 3.68G 185G 192K none
rpool/FOO 3.43M 185G 192K none
...
- 11
1
vote
1
answer
2k
views
Mounting nested ZFS filesystems exported via NFS
I have a linux (ubuntu) server with a zfs pool containing nested fileystem.
E.g.:
zfs_pool/root_fs/fs1
zfs_pool/root_fs/fs2
zfs_pool/root_fs/fs3
I have enabled NFS sharing on the root filesystem (...
CommunityBot
- 1
1
vote
1
answer
27
views
Controller failure on ZFS pool
I am running ZFS on an old Sun Fire X4170M2 connected to Sun StorageTek 6140 expansion shelves (i.e. JBOD). We had a hardware failure this morning.
This is the current state of our pool:
pool: tww
...
- 785
4
votes
1
answer
227
views
Rescuing ZFS after Debian upgrade
So I had older Debian system which needed to be upgraded. I did dist-upgrade, but forgot I am running ZFS on a root partition. :/ Result: system won't boot again. Because I would need to manually ...
- 103k
0
votes
0
answers
19
views
How to set a quota on Logical Disk Space (logicalused) in ZFS?
I am currently using ZFS and need to set a quota on the logical disk space (logicalused) rather than the physical disk space used after compression. The quota and refquota properties in ZFS set a ...
- 216
5
votes
3
answers
14k
views
Debian: ZFS installation error: Module zfs not found in directory /lib/modules/4.19.0-14-amd64
I installed ZFS on Debian, but can not get it working.
I try to install zfs this way:
I added this to /etc/apt/sources.list :
deb http://deb.debian.org/debian/ buster main contrib non-free
deb http:...
- 247
2
votes
1
answer
3k
views
How can I change a ZFS mountpoint from legacy to be handled by ZFS
Currently using ZFS on ArchLinux. I have two datasets that I originally setup with legacy mountpoints:
# zfs get mountpoint tank/data/home
NAME PROPERTY VALUE SOURCE
tank/data/...
CommunityBot
- 1
7
votes
1
answer
2k
views
Btrfs/ZFS Network Replication
Is it possible to replicate a ZFS or Btrfs raid volume in real-time (or as close to as possible, network specs aside) over a network?
ZFF and Btrfs are ideal because of their CoW properties.
I'm ...
CommunityBot
- 1
3
votes
1
answer
2k
views
Does anyone know the way to undelete file on ZFS?
Is there any way to undelete file on ZFS.
I overwrote JPG file with the scanned image.
Unfortunately, I didn't take snapshot.
But ZFS uses the CoW mechanism, overwritten data may still alive, I think.
...
CommunityBot
- 1
1
vote
0
answers
29
views
Remove disk from raidz3-0 on zfs
I have a zfs pool that holds my backup. Every disk has only one partition.
~# zpool status backup_pool
pool: backup_pool
state: ONLINE
scan: resilvered 108K in 00:00:00 with 0 errors on Tue Jun ...
- 23
4
votes
2
answers
4k
views
ZFS Ubuntu 16.04 Replace drive with itself
I'm new to the ZFS filesystem. I was using a DrivePool in windows, but I wanted something that would correct errors on the fly as well as create and maintain snapshots. I was using BTRFS at one time; ...
- 1
0
votes
1
answer
59
views
Not able to use drbd over lustre zfs
I am running the below command to format the nvme drive to lustre with backfstype as zfs
mkfs.lustre --mdt --reformat --mgsnode=mgsmaster@tcp --backfstype=zfs --fsname=lustre mdtpool/mdt --index=0 /...
- 1,810
6
votes
1
answer
5k
views
Change the mount point of a ZFS dataset that's in use
How can I change the mount point for a ZFS pool/dataset that is currently in use? I don't mind if it doesn't change immediately and I need to reboot, but I can't work out how to do it:
$ zfs set ...
- 143
1
vote
0
answers
59
views
Deciding between raidz1, raidz2 and mdraid6 for JBOD Array
Have a new Linux server with a dual SAS attached 60 bay JBOD filled with 20TB (18.2 TiB) disks. I am definitely running ZFS but trying to figure out whether to use small raidz1's, bigger raidz2, or ...
- 75k
1
vote
1
answer
2k
views
Configure Grub for Arch Linux ZFS
Does anybody know how to configure Grub in such a way it can mount an Arch Linux installed on a ZFS system?
I have /dev/sda1 (boot partition) and /dev/sda2 (root partition). The ZFS system has one ...
CommunityBot
- 1
0
votes
0
answers
19
views
Boot strap a remote backup
I'm setting up an offsite backup of my NAS,(truenas scale if it is relevant), the remote system is being built on site so I don't have physical access to it yet, but I will travel to it soon.
I would ...
- 113
6
votes
2
answers
2k
views
How full is my ZFS pool? (not sure how to read command output)
I'm using ZFS on FreeBSD to store several TB of data.
If stored as non-dedup, about 25% of the raw data would be unique enough that compression helps but dedup is wasted.
The other 75% contains a ...
CommunityBot
- 1
0
votes
0
answers
84
views
How do I stop and close these processes listening on sunrpc port? Presumably for proper zfs operation
I have a zfs volume that is automounted at startup. Doing an lsof -i shows systemd pid 1 listening on the sunrpc port for tcp and udp. There's an rpc.mount and rpcbind that shows up as well during ...
- 731
3
votes
3
answers
7k
views
Solaris 11 and zfs, i don't understand space used
This is the situation.
Solaris11 virtual machine on VirtualBox as guest.
Virtual disk is 55GB
df report
Filesystem Size Used Available Capacity Mounted on
rpool/ROOT/solaris-8 55G ...
- 619
0
votes
0
answers
38
views
How to turn off Sanoid's snapshotting for a subtree of datasets?
I'd like to set up Sanoid to create snapshots of my system dataset, except for the Docker images under /var/lib/docker. I have the following two templates:
[template_system]
frequently = 0
...
- 845
0
votes
1
answer
112
views
Incus - Setting migration.stateful for stateful snapshots
I'm trying to get to grips with Incus, because it looks like it is a fork of Canonical's LXD, which I can run fairly easily on Debian 12 with a deb package, rather than using snaps.
I have it all set ...
- 2,279
1
vote
1
answer
195
views
How to access/import/mount a zfs file
I've asked my wordpress hosting provider to give me a snapshot of the server as I'm looking to migrate the site elsewhere. What I've been given is a .zfs file.
I was completely unaware of what zfs was ...
- 7,548
-2
votes
2
answers
678
views
How to convert ZFS to bcachefs on Linux Mint and Linux Mint Debian Edition LMDE?
2023-10-31, Bcachefs Merged Into The Linux 6.7 Kernel:
https://www.phoronix.com/news/Bcachefs-Merged-Linux-6.7
https://web.archive.org/web/20231103095158/https://www.phoronix.com/news/Bcachefs-Merged-...
- 177
1
vote
1
answer
143
views
ZFS dataset encryption on top of LUKS
There has been discussions about using ZFS on top of a LUKS-encrypted partition vs. using ZFS's native per-dataset encryption. However, they are always presented as either-or.
My question is about ...
- 845
1
vote
1
answer
552
views
Why does 'zfs scrub' write to disk every 5 seconds?
My NAS is running zfs and does a scrub now and then.
When it runs it read all data (as expected), but it also writes a litte during the run (around 0.5%):
Device rkB/s wkB/s %util
sda ...
- 36k
0
votes
0
answers
116
views
Installing Grub on btrfs /boot when root is on ZFS
I'd like to use Grub for booting my Linux system. The system has its root filesystem on a ZFS dataset, it has the usual EFI boot partition, and a btrfs partition that can be used as /boot. When the ...
- 845
9
votes
2
answers
29k
views
Restore ZFS Pool and storage data after a system re-install
I recently re-installed my host OS to Mint 19 64 bit, and am now trying to get all of my external drives back online.
I had a ZFS storage pool made up of 4 x 1 TB disks, and set them to allow 1 drive ...
- 3,030
0
votes
1
answer
126
views
ZFS remove password
I have an encrypted ZFS partition, but I'd like to remove the password not to type any password when booting. Is it possible, ideally without decrypting each file one by one? For instance what happens ...
- 226
2
votes
0
answers
100
views
zpool import error
I suffered a complete pool failure – the fan in the array chassis stopped working and all drives overheated. After cooling down, all drives checked out ok using seagate's seatools test utility and ...
- 875
0
votes
1
answer
165
views
Unable to remount/import ZFS Pool drive
I have got a 3TB WD HDD which I used zfs to create a pool using proxmox.
I was copying data to the drive before a power failure occurred. Now i am unable to remount or import the drive at all on my ...
0
votes
1
answer
49
views
Synchronous syscalls and uninterruptible sleep
My application entered uninteruptible sleep. The process is stuck at linkat.
❯ sudo cat /proc/1308028/syscall
265 0xffffffffffffff9c 0x7fbd9f32a120 0xffffffffffffff9c 0x7fbd9f395930 0x400 ...
- 22.9k
1
vote
0
answers
67
views
Access data from ZFS encrypted drive
I need to access data from the /home directory from an ZFS encrypted drive. The drive was previously set up with encryption on a Linux Mint system during the installation process.
I have two questions ...
- 21