After upgrading from SES 6 to SES 7.1 "ceph orch ls" shows OSD service as unkown or not running

This document (000020667) is provided subject to the disclaimer at the end of this document.

Environment

SUSE Enterprise Storage 7.1

Situation

After upgrading from SES 6 to SES 7.1 the status of the OSD service is shown as per the following example:

NAME           PORTS        RUNNING REFRESHED AGE PLACEMENT
...
osd                              25 11m ago    -    <unmanaged>
osd.default                       0 -          3d   vm-el-iceberg-srv2;vm-el-iceberg-srv1;vm-el-iceberg-mon2;vm-el-iceberg-mon3;vm-el-iceberg-mon1

Resolution

Use the python script available from here to properly set the osdspec_affinity for the existing OSDs.

See the Additional Information section for details on the script usage.

Cause

The osdspec_affinity metadata entry required for cephadm to properly map OSDs to a service specification / drivegroup is only added during OSD creation from SES 7.X onwards, thus existing OSDs when upgrading from SES 6 do not have the required metadata entry.

Additional Information

After extracting the script, copy this to each of the OSD nodes then per node run it for each of the OSD IDs hosted on that node, either individually:

python3 set-osd-service-name.py <ins_osd_service_id> <ins_osd_id>

Or using the following command example (assuming the OSD service ID is "osd.default") for all OSDs hosted on the node:

for id in `ceph osd ls-tree $(hostname)`; do python3 set-osd-service-name.py osd.default $id; done

cephadm should automatically pick up the change and after a short while running "ceph orch ls --refresh" should (using the above example) properly show:

NAME PORTS RUNNING REFRESHED AGE PLACEMENT
...
osd.default 25 1s ago 3d vm-el-iceberg-srv2;vm-el-iceberg-srv1;vm-el-iceberg-mon2;vm-el-iceberg-mon3;vm-el-iceberg-mon1

Disclaimer

This Support Knowledgebase provides a valuable tool for SUSE customers and parties interested in our products and solutions to acquire information, ideas and learn from one another. Materials are provided for informational, personal or non-commercial use within your organization and are presented "AS IS" WITHOUT WARRANTY OF ANY KIND.