Servers with SLES11 SP2 LTSS and kernel 3.0.101-0.7.29-default may appear to hang
This document (7017655) is provided subject to the disclaimer at the end of this document.
Environment
SUSE Linux Enterprise Server 11 Service Pack 2 (SLES 11 SP2)
Kernel 3.0.101-0.7.29-default
Kernel 3.0.101-0.7.29-default
Situation
Systems with SLES11 SP2 LTSS and kernel 3.0.101-0.7.29-default may appear to hang or are very slow.
In /var/log/messages the following messages will be printed (slightly edited for better readability).
kernel: [13445315.881356] BUG: soft lockup - CPU#16 stuck for 23s! [yyyyy:81602]
kernel: [13445315.881359] Modules linked in: joydev usbhid hid mptctl mptbase binfmt_misc edd nfs lockd fscache auth_rpcgss nfs_acl sunrpc 8021q garp stp llc bonding cpufreq_conservative cpufreq_userspace cpufreq_powersave pcc_cpufreq mperf microcode fuse loop i7core_edac ixgbe edac_core dca qlcnic netxen_nic ipv6 ipv6_lib iTCO_wdt hpwdt iTCO_vendor_support rtc_cmos hpilo mdio button sg serio_raw pcspkr acpi_power_meter sr_mod cdrom container ext3 jbd mbcache dm_mirror dm_region_hash dm_log linear uhci_hcd ehci_hcd usbcore usb_common thermal processor thermal_sys hwmon scsi_dh_alua scsi_dh_rdac scsi_dh_emc scsi_dh_hp_sw scsi_dh dm_snapshot dm_mod ata_generic ata_piix libata hpsa cciss scsi_mod
kernel: [13445315.881412] Supported: Yes
kernel: [13445315.881414] CPU 16
kernel: [13445315.881415] Modules linked in: joydev usbhid hid mptctl mptbase binfmt_misc edd nfs lockd fscache auth_rpcgss nfs_acl sunrpc 8021q garp stp llc bonding cpufreq_conservative cpufreq_userspace cpufreq_powersave pcc_cpufreq mperf microcode fuse loop i7core_edac ixgbe edac_core dca qlcnic netxen_nic ipv6 ipv6_lib iTCO_wdt hpwdt iTCO_vendor_support rtc_cmos hpilo mdio button sg serio_raw pcspkr acpi_power_meter sr_mod cdrom container ext3 jbd mbcache dm_mirror dm_region_hash dm_log linear uhci_hcd ehci_hcd usbcore usb_common thermal processor thermal_sys hwmon scsi_dh_alua scsi_dh_rdac scsi_dh_emc scsi_dh_hp_sw scsi_dh dm_snapshot dm_mod ata_generic ata_piix libata hpsa cciss scsi_mod
kernel: [13445315.881444] Supported: Yes
kernel: [13445315.881446]
kernel: [13445315.881448] Pid: 81602, comm: yyyyy Not tainted 3.0.101-0.7.29-default #1 HP ProLiant DL580 G7
kernel: [13445315.881452] RIP: 0010:[<ffffffff8144ae78>] [<ffffffff8144ae78>] _raw_spin_lock+0x18/0x20
kernel: [13445315.881461] RSP: 0018:ffff887ec2971bc0 EFLAGS: 00000216
kernel: [13445315.881463] RAX: 000000000000a71b RBX: 00000000fffffffe RCX: 0000000000000001
kernel: [13445315.881465] RDX: 000000000000a727 RSI: ffff887ebea19cc0 RDI: ffff887ebea19d1c
kernel: [13445315.881466] RBP: ffff887ec2971ce8 R08: 0000000000001000 R09: ffff887ebea47698
kernel: [13445315.881468] R10: 00000001c86ac631 R11: ffffffff810f42f0 R12: ffffffff8145376e
kernel: [13445315.881470] R13: 0000000000000282 R14: ffff88403f4701c0 R15: ffff887ec51210c0
kernel: [13445315.881472] FS: 00007f6b5916e720(0000) GS:ffff88803f980000(0000) knlGS:0000000000000000
kernel: [13445315.881474] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
kernel: [13445315.881476] CR2: 00007f6b59185000 CR3: 0000007ec5798000 CR4: 00000000000006e0
kernel: [13445315.881477] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
kernel: [13445315.881479] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
kernel: [13445315.881481] Process saposcol (pid: 81602, threadinfo ffff887ec2970000, task ffff887ec4acc180)
kernel: [13445315.881483] Stack:
kernel: [13445315.881492] ffffffff8116b3b2 000000014de77364 0000000000000000 ffff887ec2971ce8
kernel: [13445315.881501] 0000000000030000 ffff887ec723aa80 ffffffff8115eb57 ffff887ec723a980
kernel: [13445315.881507] ffffffffa046231e 00ff887ebea49b00 ffff887ec2971d78 ffff887ec2971ce8
kernel: [13445315.881513] Call Trace:
kernel: [13445315.881530] [<ffffffff8116b3b2>] dput+0x22/0x1a0
kernel: [13445315.881539] [<ffffffff8115eb57>] follow_managed+0x127/0x160
kernel: [13445315.881545] [<ffffffff8115fc29>] do_lookup+0xf9/0x3a0
kernel: [13445315.881551] [<ffffffff811628bc>] path_lookupat+0xbc/0x620
kernel: [13445315.881556] [<ffffffff81162e4f>] do_path_lookup+0x2f/0xd0
kernel: [13445315.881560] [<ffffffff81163c0f>] user_path_at_empty+0x9f/0xd0
kernel: [13445315.881566] [<ffffffff8117ffdb>] user_statfs+0x2b/0x60
kernel: [13445315.881570] [<ffffffff81180148>] sys_statfs+0x18/0x110
kernel: [13445315.881576] [<ffffffff81452d92>] system_call_fastpath+0x16/0x1b
kernel: [13445315.881584] [<00007f6b57efea87>] 0x7f6b57efea86
The highlighted entries are the important parts which need to match your entries.
In /var/log/messages the following messages will be printed (slightly edited for better readability).
kernel: [13445315.881356] BUG: soft lockup - CPU#16 stuck for 23s! [yyyyy:81602]
kernel: [13445315.881359] Modules linked in: joydev usbhid hid mptctl mptbase binfmt_misc edd nfs lockd fscache auth_rpcgss nfs_acl sunrpc 8021q garp stp llc bonding cpufreq_conservative cpufreq_userspace cpufreq_powersave pcc_cpufreq mperf microcode fuse loop i7core_edac ixgbe edac_core dca qlcnic netxen_nic ipv6 ipv6_lib iTCO_wdt hpwdt iTCO_vendor_support rtc_cmos hpilo mdio button sg serio_raw pcspkr acpi_power_meter sr_mod cdrom container ext3 jbd mbcache dm_mirror dm_region_hash dm_log linear uhci_hcd ehci_hcd usbcore usb_common thermal processor thermal_sys hwmon scsi_dh_alua scsi_dh_rdac scsi_dh_emc scsi_dh_hp_sw scsi_dh dm_snapshot dm_mod ata_generic ata_piix libata hpsa cciss scsi_mod
kernel: [13445315.881412] Supported: Yes
kernel: [13445315.881414] CPU 16
kernel: [13445315.881415] Modules linked in: joydev usbhid hid mptctl mptbase binfmt_misc edd nfs lockd fscache auth_rpcgss nfs_acl sunrpc 8021q garp stp llc bonding cpufreq_conservative cpufreq_userspace cpufreq_powersave pcc_cpufreq mperf microcode fuse loop i7core_edac ixgbe edac_core dca qlcnic netxen_nic ipv6 ipv6_lib iTCO_wdt hpwdt iTCO_vendor_support rtc_cmos hpilo mdio button sg serio_raw pcspkr acpi_power_meter sr_mod cdrom container ext3 jbd mbcache dm_mirror dm_region_hash dm_log linear uhci_hcd ehci_hcd usbcore usb_common thermal processor thermal_sys hwmon scsi_dh_alua scsi_dh_rdac scsi_dh_emc scsi_dh_hp_sw scsi_dh dm_snapshot dm_mod ata_generic ata_piix libata hpsa cciss scsi_mod
kernel: [13445315.881444] Supported: Yes
kernel: [13445315.881446]
kernel: [13445315.881448] Pid: 81602, comm: yyyyy Not tainted 3.0.101-0.7.29-default #1 HP ProLiant DL580 G7
kernel: [13445315.881452] RIP: 0010:[<ffffffff8144ae78>] [<ffffffff8144ae78>] _raw_spin_lock+0x18/0x20
kernel: [13445315.881461] RSP: 0018:ffff887ec2971bc0 EFLAGS: 00000216
kernel: [13445315.881463] RAX: 000000000000a71b RBX: 00000000fffffffe RCX: 0000000000000001
kernel: [13445315.881465] RDX: 000000000000a727 RSI: ffff887ebea19cc0 RDI: ffff887ebea19d1c
kernel: [13445315.881466] RBP: ffff887ec2971ce8 R08: 0000000000001000 R09: ffff887ebea47698
kernel: [13445315.881468] R10: 00000001c86ac631 R11: ffffffff810f42f0 R12: ffffffff8145376e
kernel: [13445315.881470] R13: 0000000000000282 R14: ffff88403f4701c0 R15: ffff887ec51210c0
kernel: [13445315.881472] FS: 00007f6b5916e720(0000) GS:ffff88803f980000(0000) knlGS:0000000000000000
kernel: [13445315.881474] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
kernel: [13445315.881476] CR2: 00007f6b59185000 CR3: 0000007ec5798000 CR4: 00000000000006e0
kernel: [13445315.881477] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
kernel: [13445315.881479] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
kernel: [13445315.881481] Process saposcol (pid: 81602, threadinfo ffff887ec2970000, task ffff887ec4acc180)
kernel: [13445315.881483] Stack:
kernel: [13445315.881492] ffffffff8116b3b2 000000014de77364 0000000000000000 ffff887ec2971ce8
kernel: [13445315.881501] 0000000000030000 ffff887ec723aa80 ffffffff8115eb57 ffff887ec723a980
kernel: [13445315.881507] ffffffffa046231e 00ff887ebea49b00 ffff887ec2971d78 ffff887ec2971ce8
kernel: [13445315.881513] Call Trace:
kernel: [13445315.881530] [<ffffffff8116b3b2>] dput+0x22/0x1a0
kernel: [13445315.881539] [<ffffffff8115eb57>] follow_managed+0x127/0x160
kernel: [13445315.881545] [<ffffffff8115fc29>] do_lookup+0xf9/0x3a0
kernel: [13445315.881551] [<ffffffff811628bc>] path_lookupat+0xbc/0x620
kernel: [13445315.881556] [<ffffffff81162e4f>] do_path_lookup+0x2f/0xd0
kernel: [13445315.881560] [<ffffffff81163c0f>] user_path_at_empty+0x9f/0xd0
kernel: [13445315.881566] [<ffffffff8117ffdb>] user_statfs+0x2b/0x60
kernel: [13445315.881570] [<ffffffff81180148>] sys_statfs+0x18/0x110
kernel: [13445315.881576] [<ffffffff81452d92>] system_call_fastpath+0x16/0x1b
kernel: [13445315.881584] [<00007f6b57efea87>] 0x7f6b57efea86
The highlighted entries are the important parts which need to match your entries.
Resolution
This is a known bug and has been fixed in the successor LTSS kernel 3.0.101-0.7.37-default.
Cause
Disclaimer
This Support Knowledgebase provides a valuable tool for SUSE customers and parties interested in our products and solutions to acquire information, ideas and learn from one another. Materials are provided for informational, personal or non-commercial use within your organization and are presented "AS IS" WITHOUT WARRANTY OF ANY KIND.
- Document ID:7017655
- Creation Date: 01-Jun-2016
- Modified Date:04-Oct-2022
-
- SUSE Linux Enterprise Server
For questions or concerns with the SUSE Knowledgebase please contact: tidfeedback[at]suse.com
