Performance Monitoring

From HPC Wiki
Revision as of 14:20, 20 November 2024 by Alex-wiens-5f0c@uni-paderborn.de (talk | contribs)
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to navigation Jump to search


Performance monitoring can be done in the form of Performance profiling by the user or developer of an application or as a background service by the operator of an HPC cluster. Monitoring the performance on a cluster-level gives the operator insight into the stable operation, utilization and possible defects of the cluster. If the monitored data is available to the user, it can give insights into Job efficiency. The available Performance metrics are a trade-off between usefulness and interference with job execution.

Take a look at the Site-specific documentation to figure out if performance monitoring is available at your cluster.

The following list shows some performance monitoring solutions:

HPC-Admins that want to set up background monitoring can take a look at Background Performance Monitoring Considerations.


Individual metrics are typically collected with low level tools like:

  • Likwid
  • Perf
  • RAPL
  • ibstat
  • nvidia-smi, nvml
  • lctl, beegfs-sctl, mmpmon, nfsstat