Questions tagged [zfs]
ZFS is a combined file system and logical volume manager designed by Sun Microsystems The features of ZFS include protection against data corruption, support for high storage capacities, efficient data compression, integration of the concepts of filesystem and volume management, snapshots and copy-on-write clones, continuous integrity checking and automatic repair, RAID-Z and native NFSv4 ACLs.. -Wikipedia
606
questions
1
vote
1
answer
28
views
Storing large amount of small files in HDD pool
I have a Z6 HDD pool with 6 x 18T drives and a SLOG, LZ4 compression is enabled by default. Now I need to store large amount of small files and I'm worried about fragmentation.
The files:
70K files ...
- 121
1
vote
1
answer
27
views
Installing pot on FreeBSD: no such pool 'zroot'
According to the documentation of pot, the following has to be done to install it:
pkg install -y pot
pot init -v
I tried this, but ended up with the following error:
cannot create 'zroot/pot': no ...
- 111
1
vote
0
answers
21
views
How to replicate an entire disk using ZFS
I have 2 x 2TB disks (they are not equal). In the master I have my ZFS pool (rpool, where Proxmox is installed in). I'd like to clone/replicate the entire disk on the slave once a day.
How can I do?
- 111
0
votes
1
answer
29
views
zfs: Destroying snapshot frees way more than expected
Before:
$ zfs list -t snapshot -r rpool/DATA
NAME USED AVAIL REFER MOUNTPOINT
rpool/DATA@zfs-auto-snap_monthly-2023-10-01-0452 140G - 22.7T ...
- 36k
0
votes
0
answers
22
views
ZFS: Keyformat required for new encryption root
I am trying to create a filesystem in ZFS with the following command:
zfs create -o compression=on -o recordsize=1M -o encryption=on pool/dataset
I am unable to do so, since I receive the following ...
- 101
1
vote
1
answer
33
views
swap on zfs blocks system
Over the past few years I have had two laptops exhibiting the same behaviour.
One was fixed by re-installation.
The other is currently broken.
The issue is that as soon as the laptop starts swapping ...
- 36k
0
votes
1
answer
21
views
Adding a fresh zfs sub-dataset pri_zp/Z1/Z99-future to pri_zp/Z1, and resuming recursive replication to sec_zp/Z1
I have set up and replicated the OpenZFS dataset pri_zp/Z1 (with pri_zp/Z1/Z00-initial) to sec_zp/Z1 using a zfs send -R.
But then (months later) when I try to create (and replicate) a newer data set, ...
- 230
0
votes
0
answers
13
views
Virtual volume stored on a RAIDZ pool takes twice the amount of space as it should
I have a Proxmox server with 24 4T nvme drives. I have created a RAIDZ pool called Media3 which is about 84T in total usable space. I have setup a virtual host and added a second virtual disk to the ...
- 11
2
votes
1
answer
102
views
How to Remove a Large File from ZFS Snapshots and Reclaim Space?
I have a series of daily ZFS 100Mb snapshots of archive_zp/my_zfs, going back 100 days. At day 60 (between @ss59%ss60) I had added a 10 GiB sized archive_zp/my_zfs/BIG.iso file, that 10 GiB now ...
- 230
1
vote
0
answers
42
views
ZFS error while mounting an encrypted partition
ZFS errors, I dont know why. Here are the step-by-step actions I took to attempt to mount the encrypted ZFS disk.
$ sudo zfs list
NAME USED AVAIL ...
- 11
0
votes
1
answer
67
views
ZFS error for load-key
I've tried everything I know until I'm exhausted. Please, if you can help me, I need to access my project stored on my hard drive.
The command I used:
sudo zfs load-key rpool/ROOT/ubuntu_uy913x
And ...
- 11
0
votes
1
answer
159
views
Unable to mount encrypted ZFS filesystem after reboot
Key load error: Failed to open key material file: Input/Output Error.
Command: `mount -o zfsutil -t zfs rpool/ROOT/ubuntu_uy913 /root/`.
Message: `zfs_mount_at() failed: encryption key not loaded`.
`...
- 11
4
votes
1
answer
227
views
Rescuing ZFS after Debian upgrade
So I had older Debian system which needed to be upgraded. I did dist-upgrade, but forgot I am running ZFS on a root partition. :/ Result: system won't boot again. Because I would need to manually ...
- 75
1
vote
1
answer
29
views
Controller failure on ZFS pool
I am running ZFS on an old Sun Fire X4170M2 connected to Sun StorageTek 6140 expansion shelves (i.e. JBOD). We had a hardware failure this morning.
This is the current state of our pool:
pool: tww
...
0
votes
0
answers
20
views
How to set a quota on Logical Disk Space (logicalused) in ZFS?
I am currently using ZFS and need to set a quota on the logical disk space (logicalused) rather than the physical disk space used after compression. The quota and refquota properties in ZFS set a ...
- 216
1
vote
0
answers
29
views
Remove disk from raidz3-0 on zfs
I have a zfs pool that holds my backup. Every disk has only one partition.
~# zpool status backup_pool
pool: backup_pool
state: ONLINE
scan: resilvered 108K in 00:00:00 with 0 errors on Tue Jun ...
- 23
0
votes
1
answer
64
views
Not able to use drbd over lustre zfs
I am running the below command to format the nvme drive to lustre with backfstype as zfs
mkfs.lustre --mdt --reformat --mgsnode=mgsmaster@tcp --backfstype=zfs --fsname=lustre mdtpool/mdt --index=0 /...
1
vote
0
answers
61
views
Deciding between raidz1, raidz2 and mdraid6 for JBOD Array
Have a new Linux server with a dual SAS attached 60 bay JBOD filled with 20TB (18.2 TiB) disks. I am definitely running ZFS but trying to figure out whether to use small raidz1's, bigger raidz2, or ...
- 314
0
votes
0
answers
19
views
Boot strap a remote backup
I'm setting up an offsite backup of my NAS,(truenas scale if it is relevant), the remote system is being built on site so I don't have physical access to it yet, but I will travel to it soon.
I would ...
- 113
0
votes
0
answers
86
views
How do I stop and close these processes listening on sunrpc port? Presumably for proper zfs operation
I have a zfs volume that is automounted at startup. Doing an lsof -i shows systemd pid 1 listening on the sunrpc port for tcp and udp. There's an rpc.mount and rpcbind that shows up as well during ...
- 751
0
votes
0
answers
42
views
How to turn off Sanoid's snapshotting for a subtree of datasets?
I'd like to set up Sanoid to create snapshots of my system dataset, except for the Docker images under /var/lib/docker. I have the following two templates:
[template_system]
frequently = 0
...
- 845
1
vote
1
answer
279
views
How to access/import/mount a zfs file
I've asked my wordpress hosting provider to give me a snapshot of the server as I'm looking to migrate the site elsewhere. What I've been given is a .zfs file.
I was completely unaware of what zfs was ...
- 113
1
vote
1
answer
151
views
ZFS dataset encryption on top of LUKS
There has been discussions about using ZFS on top of a LUKS-encrypted partition vs. using ZFS's native per-dataset encryption. However, they are always presented as either-or.
My question is about ...
- 845
0
votes
0
answers
119
views
Installing Grub on btrfs /boot when root is on ZFS
I'd like to use Grub for booting my Linux system. The system has its root filesystem on a ZFS dataset, it has the usual EFI boot partition, and a btrfs partition that can be used as /boot. When the ...
- 845
0
votes
1
answer
115
views
Incus - Setting migration.stateful for stateful snapshots
I'm trying to get to grips with Incus, because it looks like it is a fork of Canonical's LXD, which I can run fairly easily on Debian 12 with a deb package, rather than using snaps.
I have it all set ...
- 2,279
0
votes
0
answers
54
views
Unlocking only specific ZFS datasets at boot
I have the following datasets in a ZFS pool:
NAME USED AVAIL REFER MOUNTPOINT
rpool 3.68G 185G 192K none
rpool/FOO 3.43M 185G 192K none
...
- 845
0
votes
1
answer
129
views
ZFS remove password
I have an encrypted ZFS partition, but I'd like to remove the password not to type any password when booting. Is it possible, ideally without decrypting each file one by one? For instance what happens ...
- 4,361
2
votes
0
answers
101
views
zpool import error
I suffered a complete pool failure – the fan in the array chassis stopped working and all drives overheated. After cooling down, all drives checked out ok using seagate's seatools test utility and ...
- 875
1
vote
0
answers
67
views
Access data from ZFS encrypted drive
I need to access data from the /home directory from an ZFS encrypted drive. The drive was previously set up with encryption on a Linux Mint system during the installation process.
I have two questions ...
- 21
4
votes
1
answer
167
views
Which filesystems support the C attribute?
On BTRFS filesystems you can disable CoW for a file using the C file attribute, like this:
chattr +C filename
I expected this to work on ZFS too, since it is also a CoW filesystem, but the attribute ...
- 201
0
votes
1
answer
50
views
Synchronous syscalls and uninterruptible sleep
My application entered uninteruptible sleep. The process is stuck at linkat.
❯ sudo cat /proc/1308028/syscall
265 0xffffffffffffff9c 0x7fbd9f32a120 0xffffffffffffff9c 0x7fbd9f395930 0x400 ...
- 101
1
vote
1
answer
145
views
ZFS which uses SAN (ISCSI/FC/NVMEoe...) as VDEV
Is it reasonable to use ISCSI/FC as a block device and use it as a vdev for ZFS?
Reasoning:
There is only so much disks (even with external enclosures) that you can put in one host. We are looking ...
- 111
0
votes
1
answer
27
views
Tried Replacing ZFS Drive which started then errored. Now I can't get it to restart after fixing the second disk it found
I have a disk in the following state:
zpool status
pool: data
state: DEGRADED
scan: resilvered 1.49G in 05:08:02 with 0 errors on Sat Jan 6 18:35:13 2024
config:
NAME ...
- 101
1
vote
0
answers
49
views
zfs releases space before destroying snapshots
I cleaned up today.
When I started my filesystem was 90% full. Now it is showing 87%:
Filesystem 1K-blocks Used Available Use% Mounted on
rpool/DATA 23201798016 20038152576 ...
- 36k
0
votes
0
answers
82
views
ZFS nested datasets shown in KDE dolphin as mounted NFS shares. How to keep visible only parent mounted share?
I have the ZFS pool called zdata on our server which is mounted at /mnt/zdata, and it is also shared with NFS, so clients can mount it.
The NFS share configured /etc/exports only for the parent ...
- 101
0
votes
1
answer
243
views
ZFS: Best Practices for Restructuring multiple pools with encrypted datasets at once
High Level Description
So I currently have a convoluted ZFS setup and want to restructure it, reusing some of the existing hardware.
I know that the recommended way of doing something like this is to ...
- 1
0
votes
0
answers
38
views
Permission Denied error when I try to open the image file stored on the ZFS disk accessed through sshfs from another machine
I would like to boot the FreeBSD 13.2 image file using Libvirt + virt-manager. I have stored the image on the external hard drive,"formatted" with ZFS while I'm using Devuan 5 installed on ...
- 549
2
votes
1
answer
1k
views
How can I encrypt a ZFS pool?
Preface: I used to run TrueNAS (SCALE) which is where I originally created the tank pool.
On Ubuntu Server, I'm trying to assign/change the key of a newly created pool but I am getting the error Key ...
- 2,083
0
votes
1
answer
51
views
Two system pools on 1 disk - 1 or 2 /boot directories and WTB grub?
I have a legacy root-on-zfs install that was once made by installing to an ext4 / with /boot on a separate ext4 partition, and then moving the contents of / to a ZFS pool.
I had various *BSD ...
- 254
0
votes
1
answer
414
views
Linux Mint Mate 21.2 ZFS rpool, bpool, and another one - in Caja Sidebar visible - How to get rid of it?
In installed an enrcypted Linux on an separate SSD. In the Install process i choose ZFS.
In Caja (1.26) i saw these Folder and wonder why i get this, so i just want to get rid of it, because i dont ...
0
votes
1
answer
167
views
Unable to remount/import ZFS Pool drive
I have got a 3TB WD HDD which I used zfs to create a pool using proxmox.
I was copying data to the drive before a power failure occurred. Now i am unable to remount or import the drive at all on my ...
0
votes
0
answers
80
views
How to do ZFS incremental backup to IBM TSM
I am going to set up a new zpool. I plan to use nested datasets to store individual files. For example I could have the following datasets:
tank
tank/homes/user1
tank/homes/user2
...
tank/shares/pub
...
- 554
0
votes
2
answers
733
views
Windows not reporting correct used and available disk space on Samba server with ZFS
I have a Samba server running ZFS in Linux.
It is a standard by-the-book install with no special configuration.
Each share is mapped to their own ZFS dataset, but not all datasets have their own ...
1
vote
1
answer
227
views
Creating swap for Debian across several SSD drives
I have my home server with Proxmox installed. During installation I created just a default swap partition of small size, but did not consider it necessary, since my server has 192GB of RAM installed. ...
- 13
0
votes
0
answers
227
views
nfs-server.service won't start, bad exportfs entry persists
I'm using Proxmox and ZFS. Previously, I had set up an NFS share using sharenfs, on a now removed zfs pool (panzer). Over a year has passed, and I'm trying to set up a new NFS share. When I run ...
- 101
1
vote
2
answers
346
views
How to know if files inside an encrypted ZFS dataset are actually encrypted or not?
When you make any change on a zfs dataset, changes are not applied to already existant data. So, if you find a ZFS dataset that says it has encyption ON, there is a way to check if an individual file ...
- 308
2
votes
0
answers
129
views
Samba does not show all ZFS snapshots
I am setting up a file server that uses Samba together with ZFS.
I have configured Samba such that it shows the ZFS snapshots under "Previous Versions" in Windows; following is an excerpt of ...
- 554
2
votes
1
answer
4k
views
How can I automatically unlock and mount a ZFS pool at boot?
I was wondering if it's possible to automatically decrypt and mount a ZFS pool and its datasets at boot. Currently, I have to unlock the pool manually by using the command # zfs load-key -a and then ...
- 2,083
0
votes
1
answer
87
views
Is it safe to use device name such as sda to create md and ZFS RAID array?
In md we can scan or assemble an array using UUID:
mdadm --assemble "/dev/md/raid5" --uuid "b9a09187:a1ac838f:b4e90395:d6293c19"
And in ZFS, we have a service for that purpose:
rc-...
- 455
1
vote
1
answer
897
views
ZFS Inode Consumption
I have a ZFS pool in raid Z1 that's around 90TB or so which acts as a PLEX server. I currently have ~300GB free. On average, most files are 70-80GB each.
If I copy smaller files, ~10GB, I have no ...
- 11