Indepth HANA Cluster Debug Data Collection (PACEMAKER, SAP)

SUSE Linux Enterprise Server for SAP Applications

This document is aimed at interested Customers and SUSE Support. This is a living document, please do check for changes before applying or referring to it.

Assuming there are issues in the behavior of the pacemaker cluster in connection with HANA that are not obvious from an Error Message or covered in another TID the common question is "what Data to provide to enable SUSE Support to find a solution for my HANA Cluster Setup"
 

1) hb_report

Please provide an hb_report from the time of the incident with a time frame covering at least one hour before and one hour after.

Assuming the issue happened on

    November 25th. 2017 at 11:00
   
that would be then

    hb_report -u root -f "2017/11/25 10:00" -t "2017/11/25 12:00" /tmp/hana.case
   
the resulting file

    /tmp/hana.case.bz2
   
contains the necessary data from a cluster perspective. It the logfile configuration in corosync.conf was changed add the necessary  path to the logfile in the hb_report command as argument, otherwise the hb_report will be useless.

If ssh is available on the Servers there is no need to run hb_report on every node, as it will ssh to the other nodes and collect the data.

2) supportconfig

On all cluster nodes run
     
and provide the resulting file which will be in /var/log/

3) HANA Data
change to the SAP User

    su - <SID>adm
   
find the instance number of the SAP Instance and run on every node

    sapcontrol -nr <NR> -function GetProcessList >> /tmp/hana.$HOSTNAME

               (where NR is the Instance Number of the SAP Instance in question)
 
    hdbnsutil -sr_state >> /tmp/hana.$HOSTNAME
   
    HDBSettings.sh landscapeHostConfiguration.py --sapcontrol=1 >> /tmp/hana.$HOSTNAME; echo $? >> /tmp/hana.$HOSTNAME
   
    HDBSettings.sh systemReplicationStatus.py >> /tmp/hana.$HOSTNAME; echo $? >> /tmp/hana.$HOSTNAME

    HDB info >> /tmp/hana.$HOSTNAME

    HDBSettings.sh systemOverview.py >> /tmp/hana.$HOSTNAME   
   
provide the files

    /tmp/hana.$HOSTNAME
   
that will be created by this.

Expected Result, assuming it is a 2 Node Cluster, replace 2 with Number of Nodes in case the cluster has more nodes.

    1    hb_report from cluster   
    2    supportconfigs from each node
    2    hana.$HOSTNAME files from each node   

provide these files to the SUSE Support.
 

There are plans to implement this maybe into supportconfig at some stage for automatic collection.
Update:  supportutils-plugin-ha-sap RPM was released May 6, 2020 in updates channels. 

If one wanted to check also the SAP Hana Logs then

change to the SAP User

    su - <SID>adm
   
and then issue

         cdtrace

which takes one directly to the local HANA Logs.