Setting SES5 Cluster Ratios

This document (7023290) is provided subject to the disclaimer at the end of this document.

Environment

SUSE Enterprise Storage 5 (SES5)

Situation

The cluster shows the total available space on mounted cephfs filesystems less than expected.

client:~ # df -h /cluster/cephfs/
Filesystem                                           Size  Used Avail Use% Mounted on
192.168.80.101,192.168.80.102,192.168.80.103:6789:/  117G   68G   49G  59% /cluster/cephfs

master:~ # ceph report | grep ratio
        "full_ratio": 0.750000,
        "backfillfull_ratio": 0.700000,
        "nearfull_ratio": 0.650000,

After a full cluster scenario, the full_ratio was set to a higher value for cluster recovery.

master:~ # ceph osd dump | grep ratio
full_ratio 0.97
backfillfull_ratio 0.9
nearfull_ratio 0.85

Resolution

Reset the cluster ratios to default values.

master:~ # ceph osd set-full-ratio 0.95
osd set-full-ratio 0.95

master:~ # ceph osd set-backfillfull-ratio 0.9
osd set-backfillfull-ratio 0.9

master:~ # ceph osd set-nearfull-ratio 0.85
osd set-nearfull-ratio 0.85

Cause

The cluster ratios should remain at default values and changed only temporarily.

Disclaimer

This Support Knowledgebase provides a valuable tool for SUSE customers and parties interested in our products and solutions to acquire information, ideas and learn from one another. Materials are provided for informational, personal or non-commercial use within your organization and are presented "AS IS" WITHOUT WARRANTY OF ANY KIND.