How to scale fluentd from rancher-logging app

This document (000021239) is provided subject to the disclaimer at the end of this document.

Environment

Rancher 2.6.x, Rancher 2.7.x

Situation

By default, fluentd in rancher-logging is deployed with only one replica. However, you might need to scale it up for different reasons, the biggest being performance issues. As the fluent-bit is a daemonset meaning it is deployed on every node on your cluster, this means that fluentd can have an issue keeping up with all the connections from different fluentbit pods [1].

Resolution

You can scale the statefulset rancher-logging-root-fluentd up as it controls the rancher-logging-root-fluentd pods. In the command below, please set the replicas to the number of replicas you want to scale to.

kubectl -n cattle-logging-system scale statefulset rancher-logging-root-fluentd --replicas=2

Additional Information

References:
[1] https://ranchermanager.docs.rancher.com/integrations-in-rancher/logging/logging-architecture

Disclaimer

This Support Knowledgebase provides a valuable tool for SUSE customers and parties interested in our products and solutions to acquire information, ideas and learn from one another. Materials are provided for informational, personal or non-commercial use within your organization and are presented "AS IS" WITHOUT WARRANTY OF ANY KIND.