1

I am on OpenSuSE Tumbleweed and have the following disks:

  • /dev/sda1: /home (btrfs)
  • /dev/sdb1: /boot
  • /dev/sdb2: swap
  • /dev/sdb3: / (btrfs)

When I start my computer, systemd tries to mount my disks but times out. The system boots into recovery mode. When I try mounting /dev/sda1 to /mnt manually, that succeeds without a problem. However, if I do mount /dev/sda1 /home, the command succeeds, but nothing is mounted. In addition, systemd sometimes succeeds in mounting my disks after 10 minutes or so, but not always. If it does, I can just continue booting without a problem. The journal contains the following messages:

May 04 18:59:58 linux-499u systemd[1]: Started Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling.
May 04 19:00:18 linux-499u systemd[1]: dev-disk-by\x2duuid-daf78b04\x2d5d7c\x2d473a\x2dabf7\x2daaff0f33ed8c.device: Job dev-disk-by\x2duuid-daf78b04\x2d5d7c\x2d473a\x2dabf7\x2daaff0f33ed8c.device/start timed out.
May 04 19:00:18 linux-499u systemd[1]: Timed out waiting for device dev-disk-by\x2duuid-daf78b04\x2d5d7c\x2d473a\x2dabf7\x2daaff0f33ed8c.device.
May 04 19:00:18 linux-499u systemd[1]: Dependency failed for /dev/disk/by-uuid/daf78b04-5d7c-473a-abf7-aaff0f33ed8c.
May 04 19:00:18 linux-499u systemd[1]: Dependency failed for Swap.
May 04 19:00:18 linux-499u systemd[1]: swap.target: Job swap.target/start failed with result 'dependency'.
May 04 19:00:18 linux-499u systemd[1]: dev-disk-by\x2duuid-daf78b04\x2d5d7c\x2d473a\x2dabf7\x2daaff0f33ed8c.swap: Job dev-disk-by\x2duuid-daf78b04\x2d5d7c\x2d473a\x2dabf7\x2daaff0f33ed8c.swap/start failed with result 'dependency'.
May 04 19:00:18 linux-499u systemd[1]: dev-disk-by\x2duuid-daf78b04\x2d5d7c\x2d473a\x2dabf7\x2daaff0f33ed8c.device: Job dev-disk-by\x2duuid-daf78b04\x2d5d7c\x2d473a\x2dabf7\x2daaff0f33ed8c.device/start failed with result 'timeout'.
May 04 19:00:18 linux-499u systemd[1]: dev-disk-by\x2duuid-3b038204\x2dd88d\x2d4a1c\x2db754\x2d4a9a1743a854.device: Job dev-disk-by\x2duuid-3b038204\x2dd88d\x2d4a1c\x2db754\x2d4a9a1743a854.device/start timed out.
May 04 19:00:18 linux-499u systemd[1]: Timed out waiting for device dev-disk-by\x2duuid-3b038204\x2dd88d\x2d4a1c\x2db754\x2d4a9a1743a854.device.
May 04 19:00:18 linux-499u systemd[1]: Dependency failed for /home.
May 04 19:00:18 linux-499u systemd[1]: Dependency failed for Local File Systems.
May 04 19:00:18 linux-499u systemd[1]: local-fs.target: Job local-fs.target/start failed with result 'dependency'.
May 04 19:00:18 linux-499u systemd[1]: local-fs.target: Triggering OnFailure= dependencies.
May 04 19:00:18 linux-499u systemd[1]: home.mount: Job home.mount/start failed with result 'dependency'.
May 04 19:00:18 linux-499u systemd[1]: dev-disk-by\x2duuid-3b038204\x2dd88d\x2d4a1c\x2db754\x2d4a9a1743a854.device: Job dev-disk-by\x2duuid-3b038204\x2dd88d\x2d4a1c\x2db754\x2d4a9a1743a854.device/start failed with result 'timeout'.
May 04 19:00:18 linux-499u systemd[1]: dev-disk-by\x2duuid-a7d21263\x2dc328\x2d476d\x2db8f0\x2d93d73f1d57bb.device: Job dev-disk-by\x2duuid-a7d21263\x2dc328\x2d476d\x2db8f0\x2d93d73f1d57bb.device/start timed out.
May 04 19:00:18 linux-499u systemd[1]: Timed out waiting for device dev-disk-by\x2duuid-a7d21263\x2dc328\x2d476d\x2db8f0\x2d93d73f1d57bb.device.
May 04 19:00:18 linux-499u systemd[1]: Dependency failed for /tmp.
May 04 19:00:18 linux-499u systemd[1]: tmp.mount: Job tmp.mount/start failed with result 'dependency'.
May 04 19:00:18 linux-499u systemd[1]: Dependency failed for /srv.
May 04 19:00:18 linux-499u systemd[1]: srv.mount: Job srv.mount/start failed with result 'dependency'.
May 04 19:00:18 linux-499u systemd[1]: Dependency failed for /var/lib/pgsql.
May 04 19:00:18 linux-499u systemd[1]: var-lib-pgsql.mount: Job var-lib-pgsql.mount/start failed with result 'dependency'.
May 04 19:00:18 linux-499u systemd[1]: Dependency failed for /opt.
May 04 19:00:18 linux-499u systemd[1]: opt.mount: Job opt.mount/start failed with result 'dependency'.
May 04 19:00:18 linux-499u systemd[1]: Dependency failed for /var/lib/mysql.
May 04 19:00:18 linux-499u systemd[1]: var-lib-mysql.mount: Job var-lib-mysql.mount/start failed with result 'dependency'.
May 04 19:00:18 linux-499u systemd[1]: Dependency failed for /var/cache.
May 04 19:00:18 linux-499u systemd[1]: var-cache.mount: Job var-cache.mount/start failed with result 'dependency'.
May 04 19:00:18 linux-499u systemd[1]: Dependency failed for /var/spool.
May 04 19:00:18 linux-499u systemd[1]: var-spool.mount: Job var-spool.mount/start failed with result 'dependency'.
May 04 19:00:18 linux-499u systemd[1]: Dependency failed for /var/lib/mariadb.
May 04 19:00:18 linux-499u systemd[1]: var-lib-mariadb.mount: Job var-lib-mariadb.mount/start failed with result 'dependency'.
May 04 19:00:18 linux-499u systemd[1]: Dependency failed for /var/opt.
May 04 19:00:18 linux-499u systemd[1]: var-opt.mount: Job var-opt.mount/start failed with result 'dependency'.
May 04 19:00:18 linux-499u systemd[1]: Dependency failed for /var/lib/mailman.
May 04 19:00:18 linux-499u systemd[1]: var-lib-mailman.mount: Job var-lib-mailman.mount/start failed with result 'dependency'.
May 04 19:00:18 linux-499u systemd[1]: Dependency failed for /var/tmp.
May 04 19:00:18 linux-499u systemd[1]: var-tmp.mount: Job var-tmp.mount/start failed with result 'dependency'.
May 04 19:00:18 linux-499u systemd[1]: Dependency failed for /var/log.
May 04 19:00:18 linux-499u systemd[1]: Dependency failed for Update UTMP about System Boot/Shutdown.
May 04 19:00:18 linux-499u systemd[1]: Dependency failed for Update UTMP about System Runlevel Changes.
May 04 19:00:18 linux-499u systemd[1]: systemd-update-utmp-runlevel.service: Job systemd-update-utmp-runlevel.service/start failed with result 'dependency'.
May 04 19:00:18 linux-499u systemd[1]: systemd-update-utmp.service: Job systemd-update-utmp.service/start failed with result 'dependency'.
May 04 19:00:18 linux-499u systemd[1]: Dependency failed for Flush Journal to Persistent Storage.
May 04 19:00:18 linux-499u systemd[1]: systemd-journal-flush.service: Job systemd-journal-flush.service/start failed with result 'dependency'.
May 04 19:00:18 linux-499u systemd[1]: var-log.mount: Job var-log.mount/start failed with result 'dependency'.
May 04 19:00:18 linux-499u systemd[1]: Dependency failed for /usr/local.
May 04 19:00:18 linux-499u systemd[1]: usr-local.mount: Job usr-local.mount/start failed with result 'dependency'.
May 04 19:00:18 linux-499u systemd[1]: Dependency failed for /var/lib/machines.
May 04 19:00:18 linux-499u systemd[1]: var-lib-machines.mount: Job var-lib-machines.mount/start failed with result 'dependency'.
May 04 19:00:18 linux-499u systemd[1]: Dependency failed for /var/crash.
May 04 19:00:18 linux-499u systemd[1]: var-crash.mount: Job var-crash.mount/start failed with result 'dependency'.
May 04 19:00:18 linux-499u systemd[1]: Dependency failed for /var/lib/named.
May 04 19:00:18 linux-499u systemd[1]: var-lib-named.mount: Job var-lib-named.mount/start failed with result 'dependency'.
May 04 19:00:18 linux-499u systemd[1]: Dependency failed for /var/lib/libvirt/images.
May 04 19:00:18 linux-499u systemd[1]: var-lib-libvirt-images.mount: Job var-lib-libvirt-images.mount/start failed with result 'dependency'.
May 04 19:00:18 linux-499u systemd[1]: Dependency failed for /.snapshots.
May 04 19:00:18 linux-499u systemd[1]: \x2esnapshots.mount: Job \x2esnapshots.mount/start failed with result 'dependency'.
May 04 19:00:18 linux-499u systemd[1]: dev-disk-by\x2duuid-a7d21263\x2dc328\x2d476d\x2db8f0\x2d93d73f1d57bb.device: Job dev-disk-by\x2duuid-a7d21263\x2dc328\x2d476d\x2db8f0\x2d93d73f1d57bb.device/start failed with result 'timeout'.

/etc/fstab:

UUID=daf78b04-5d7c-473a-abf7-aaff0f33ed8c swap swap defaults 0 0
UUID=a7d21263-c328-476d-b8f0-93d73f1d57bb / btrfs defaults 0 0
UUID=3b038204-d88d-4a1c-b754-4a9a1743a854 /home                btrfs      defaults              0 0
UUID=a7d21263-c328-476d-b8f0-93d73f1d57bb /opt btrfs subvol=@/opt 0 0
UUID=a7d21263-c328-476d-b8f0-93d73f1d57bb /srv btrfs subvol=@/srv 0 0
UUID=a7d21263-c328-476d-b8f0-93d73f1d57bb /tmp btrfs subvol=@/tmp 0 0
UUID=a7d21263-c328-476d-b8f0-93d73f1d57bb /usr/local btrfs subvol=@/usr/local 0 0
UUID=a7d21263-c328-476d-b8f0-93d73f1d57bb /var/cache btrfs subvol=@/var/cache 0 0
UUID=a7d21263-c328-476d-b8f0-93d73f1d57bb /var/crash btrfs subvol=@/var/crash 0 0
UUID=a7d21263-c328-476d-b8f0-93d73f1d57bb /var/lib/libvirt/images btrfs subvol=@/var/lib/libvirt/images 0 0
UUID=a7d21263-c328-476d-b8f0-93d73f1d57bb /var/lib/machines btrfs subvol=@/var/lib/machines 0 0
UUID=a7d21263-c328-476d-b8f0-93d73f1d57bb /var/lib/mailman btrfs subvol=@/var/lib/mailman 0 0
UUID=a7d21263-c328-476d-b8f0-93d73f1d57bb /var/lib/mariadb btrfs subvol=@/var/lib/mariadb 0 0
UUID=a7d21263-c328-476d-b8f0-93d73f1d57bb /var/lib/mysql btrfs subvol=@/var/lib/mysql 0 0
UUID=a7d21263-c328-476d-b8f0-93d73f1d57bb /var/lib/named btrfs subvol=@/var/lib/named 0 0
UUID=a7d21263-c328-476d-b8f0-93d73f1d57bb /var/lib/pgsql btrfs subvol=@/var/lib/pgsql 0 0
UUID=a7d21263-c328-476d-b8f0-93d73f1d57bb /var/log btrfs subvol=@/var/log 0 0
UUID=a7d21263-c328-476d-b8f0-93d73f1d57bb /var/opt btrfs subvol=@/var/opt 0 0
UUID=a7d21263-c328-476d-b8f0-93d73f1d57bb /var/spool btrfs subvol=@/var/spool 0 0
UUID=a7d21263-c328-476d-b8f0-93d73f1d57bb /var/tmp btrfs subvol=@/var/tmp 0 0
UUID=a7d21263-c328-476d-b8f0-93d73f1d57bb /.snapshots btrfs subvol=@/.snapshots 0 0

systemctl status:

● linux-499u
    State: initializing
     Jobs: 13 queued
   Failed: 0 units
    Since: Fri 2018-05-04 18:58:47 CEST; 18min ago
   CGroup: /
           ├─init.scope
           │ └─1 /usr/lib/systemd/systemd --switched-root --system --deserialize 33
           └─system.slice
             ├─lvm2-lvmetad.service
             │ └─484 /usr/sbin/lvmetad -f
             ├─emergency.service
             │ ├─683 /usr/lib/systemd/systemd-sulogin-shell emergency
             │ ├─684 bash
             │ └─768 systemctl status
             ├─systemd-remount-fs.service
             │ ├─476 /usr/lib/systemd/systemd-remount-fs
             │ └─478 /usr/bin/mount / -o remount
             ├─systemd-journald.service
             │ └─465 /usr/lib/systemd/systemd-journald
             └─haveged.service
               └─562 /usr/sbin/haveged -w 1024 -v 0 -F

EDIT: As @okurz suggested, I looked at the stack of the mount process using cat /proc/<pid>/stack:

[<0>] wait_current_trans+0x9d/0xc0 [btrfs]
[<0>] start_transaction+0x328/0x420 [btrfs]
[<0>] merge_reloc_root+0x160/0x520 [btrfs]
[<0>] merge_reloc_roots+0x12c/0x220 [btrfs]
[<0>] btrfs_recover_relocation+0x295/0x430 [btrfs]
[<0>] btrfs_remount+0x45c/0x500 [btrfs]
[<0>] do_remount_sb+0xaf/0x1c0
[<0>] do_mount+0x665/0xc40
[<0>] SyS_mount+0x80/0xd0
[<0>] do_syscall_64+0x76/0x140
[<0>] entry_SYSCALL_64_after_hwframe+0x42/0xb7
[<0>] 0xffffffffffffffff

However, I honestly have no idea what recover relocation does or why it is stuck.

EDIT 2: After letting the computer run for a few hours, everything seems to work fine for now; however, I have already done that before, I don't know what is different about this time.

EDIT 3: After the computer worked again for some days, it started a btrfs balance in which it got stuck so I had to turn off its power. Now I'm back at square one.

  • Are the drives spinning disc HDDs, or SSDs? If they're spinning disks, they might be slow on startup and need more time before you try mounting them. – Mioriin May 4 '18 at 17:57
  • @Mioriin sda ist a HDD, sdb is an SSD – Lukor May 4 '18 at 17:58
  • 1
    That could be related to lists.opensuse.org/opensuse-factory/2018-05/msg00009.html . In any case in the above example you can debug further. As can be seen in the process tree is the systemctl status output the command 478 /usr/bin/mount / -o remount is running. You an check what is going on there by calling cat /proc/478/stack to see the stack trace of the kernel-space calls, if any. This might give an idea of where it is stuck … or just busy for a very long time. Might just work as a workaround to let the system settle in this state (can take multiple hours) and reboot again. – okurz May 6 '18 at 8:03

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.