System drops into single-user mode because LVM on multipath filesystems can't be mounted.

This document (000021296) is provided subject to the disclaimer at the end of this document.

Environment

SUSE Linux Enterprise Server 15 SP5

Situation

After upgrading from SLES 15 SP4 to SP5, if the installed lvm2 version is 2.03.16, with the previously working LVM and multipath filter/configurations unchanged, the machine may drop into single-user mode because LVM on top of multipath filesystems can't be mounted.
In order to boot into multiuser mode and mount such filesystems, it becomes necessary to activate the LVM volume groups and logical volumes on multipath devices manually with # vgchange -ay and/or alter the LVM filter for SAN MPIO devices as a workaround, otherwise SAN devices are filtered out during boot.

/var/log/messages logs the following messages during boot:

systemd[1]: dev-vg_name-lv_name.device: Job dev-vg_name-lv_name.device/start timed out.
systemd[1]: Timed out waiting for device /dev/vg_name/lv_name.
systemd[1]: Dependency failed for /mountpointX.
systemd[1]: mountpointX.mount: Job mountpointX.mount/start failed with result 'dependency'.
systemd[1]: dev-vg_name-lv_name.device: Job dev-vg_name-lv_name.device/start failed with result 'timeout'

Device-mapper may report:

device-mapper: table: 254:0: multipath: error getting device (-EBUSY)
device-mapper: ioctl: error adding target to table

And/or pvs output may contain:

pvs[2859] lvmcmdline.c:3043        Using md_component_checks auto use_full_md_check 0
pvs[2859] device_mapper/libdm-config.c:987      devices/multipath_wwids_file not found in config: defaulting to "/etc/multipath/wwids"
pvs[2859] device/dev-mpath.c:252        multipath wwids read 2 from /etc/multipath/wwids
pvs[2859] device_mapper/libdm-config.c:987      report/output_format not found in config: defaulting to "basic"

pvs[2859] device/dev-io.c:120      /dev/sdc: size is 578813952 sectors
pvs[2859] device/dev-io.c:466        Closed /dev/sdc
pvs[2859] device/dev-mpath.c:757        dev_is_mpath_component /dev/sdc naa.6000402001f457c54cd4fe0b00000000 in wwids file
pvs[2859] filters/filter-mpath.c:33        /dev/sdc: Skipping mpath component device

Resolution

Version 2.03.22-150500.7.9.1 of lvm2 fixes this problem. Please, execute zypper patch or zypper update lvm2-2.03.22-150500.7.9.1.

Cause

pvscan --cache <dev> is called by a udev rule at a time when the symlinks for <dev> may not all be created yet (by other udev rules.). An LVM filter specifying a disk path by-id (/dev/disk/by-id) matching any symlinks not created yet, may lead to non-active volume(s).

Status

Reported to Engineering

Disclaimer

This Support Knowledgebase provides a valuable tool for SUSE customers and parties interested in our products and solutions to acquire information, ideas and learn from one another. Materials are provided for informational, personal or non-commercial use within your organization and are presented "AS IS" WITHOUT WARRANTY OF ANY KIND.