Tuned crashed with a python RuntimeError

This document (000019725) is provided subject to the disclaimer at the end of this document.

Environment

SUSE Linux Enterprise Server 12 for SAP Applications
SUSE Linux Enterprise Server 15 for SAP Applications

Situation

The tuned service is crashing during the boot process or after hotplug events.

In the system log (/var/log/messages or journalctl) messages like below are printed:

Sept 24 11:06:22 server01 systemd[1]: Starting sapconf... ...
Sept 24 11:06:22 server01 sapconf[12574]: Forwarding action to tuned-adm. ...
[...]
Sept 24 11:06:24 server01 tuned[12734]: Exception in thread Thread-2:
Sept 24 11:06:24 server01 tuned[12734]: Traceback (most recent call last):
Sept 24 11:06:24 server01 tuned[12734]:   File "/usr/lib64/python2.7/threading.py", line 801, in __bootstrap_inner
Sept 24 11:06:24 server01 tuned[12734]:     self.run() Sept 24 11:06:24 server01 tuned[12734]:   File "/usr/lib64/python2.7/threading.py", line 754, in run
Sept 24 11:06:24 server01 tuned[12734]:     self.__target(*self.__args, **self.__kwargs)
Sept 24 11:06:24 server01 tuned[12734]:   File "/usr/lib/python2.7/site-packages/tuned/daemon/daemon.py", line 89, in _thread_code
Sept 24 11:06:24 server01 tuned[12734]:     self._unit_manager.start_tuning()
Sept 24 11:06:24 server01 tuned[12734]:   File "/usr/lib/python2.7/site-packages/tuned/units/manager.py", line 81, in start_tuning
Sept 24 11:06:24 server01 tuned[12734]:     instance.apply_tuning()
Sept 24 11:06:24 server01 tuned[12734]:   File "/usr/lib/python2.7/site-packages/tuned/plugins/instance/instance.py", line 54, in apply_tuning
Sept 24 11:06:24 server01 tuned[12734]:     self._plugin.instance_apply_tuning(self)
Sept 24 11:06:24 server01 tuned[12734]:   File "/usr/lib/python2.7/site-packages/tuned/plugins/base.py", line 183, in instance_apply_tuning
Sept 24 11:06:24 server01 tuned[12734]:     self._instance_apply_static(instance)
Sept 24 11:06:24 server01 tuned[12734]:   File "/usr/lib/python2.7/site-packages/tuned/plugins/base.py", line 208, in _instance_apply_static
Sept 24 11:06:24 server01 tuned[12734]:     self._execute_all_device_commands(instance, instance.devices)
Sept 24 11:06:24 server01 tuned[12734]:   File "/usr/lib/python2.7/site-packages/tuned/plugins/base.py", line 318, in _execute_all_device_commands
Sept 24 11:06:24 server01 tuned[12734]:     for device in devices:
Sept 24 11:06:24 server01 tuned[12734]: RuntimeError: Set changed size during iteration

Resolution

So far this issue has been seen only in combination with sapconf (up to version 4).
If sapconf is running on the system a simple update to the latest version 5 and above will solve the problem.

I case the problem still exists please check the boot logs for "tuned" and "RuntimeError" entries like above. If such entries exists a SUSE Service Request should be opened to address the issue.

Cause

Tuned could run into a python RuntimeError in case of device flickering or hotplug events while it is processing though the list of devices.

Status

Reported to Engineering

Additional Information

Since version 5 sapconf is not longer using tuned.

Disclaimer

This Support Knowledgebase provides a valuable tool for SUSE customers and parties interested in our products and solutions to acquire information, ideas and learn from one another. Materials are provided for informational, personal or non-commercial use within your organization and are presented "AS IS" WITHOUT WARRANTY OF ANY KIND.