LVM-activate RA with vg_access_mode=lvmlockd times out during stop operation with cbdaemon running

This document (000021069) is provided subject to the disclaimer at the end of this document.

Environment

SUSE Linux Enterprise High Availability Extension 15 all Service Packs

Situation

Pacemaker setup with lvmlockd and LVM-activate resource agent times out during stop operation despite high stop timeout value if cbdaemon service is running.

Resolution

Stop and disable cbdaemon on all cluster nodes with systemctl disable --now cbdaemon.service

Cause

With help of kprobes(kernel probes) it was discovered that apart from lvmlockd, task EventPipeline(from cbdaemon)
also calls device_open() (in fs/dlm/user.c) for the lockspace device:

lvmlockd-6795    [007] .N.1.   844.115122: myprobe: (dlm_put_lockspace+0x0/0x30 [dlm]) ls=0xffff994f91933000 ls_count=2 com="lvmlockd"
EventPipeline-3382    [003] ...1.   844.118281: myretprobe: (device_open+0x1a/0xc0 [dlm] <- dlm_find_lockspace_device) ret=0xffff994f91933000 com="EventPipeline"
lvmlockd-6795    [007] ...1.   845.115409: myretprobe: (device_open+0x1a/0xc0 [dlm] <- dlm_find_lockspace_device) ret=0xffff994f91933000 com="lvmlockd"
lvmlockd-6795    [007] ...1.   845.115510: myretprobe: (device_write+0x321/0x750 [dlm] <- dlm_find_lockspace_local) ret=0xffff994f91933000 com="lvmlockd"
lvmlockd-6795    [007] ...1.   845.115529: myprobe: (dlm_put_lockspace+0x0/0x30 [dlm]) ls=0xffff994f91933000 ls_count=4 com="lvmlockd"

Unlike lvmlockd daemon it never calls device_close() when LVM-activate invokes "vgchange --lockstop ${VG}"
which eventually leads to stop operation timeout.

Additional Information

cbdaemon/Carbon Black is a third party threat detection software.
For more information about virus/security software on SLES, please see following TIDs

TID 000019755 - Considerations when attempting to deploy 'antivirus' file-scanners and endpoint security modules
TID 000019608 - Is virus/malware protection software needed on a SUSE Linux Enterprise Server?

Disclaimer

This Support Knowledgebase provides a valuable tool for SUSE customers and parties interested in our products and solutions to acquire information, ideas and learn from one another. Materials are provided for informational, personal or non-commercial use within your organization and are presented "AS IS" WITHOUT WARRANTY OF ANY KIND.