Job efficiency

From HPC Wiki
Revision as of 12:25, 26 February 2024 by Alex-wiens-5f0c@uni-paderborn.de (talk | contribs) (Initial structure for job efficiency guide)
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to navigation Jump to search


Job efficiency describes how well a job makes use of the available resources. Efficiency can be viewed from the perspective of the time, that the resource is allocated, or the energy, that is consumed by the hardware during the job runtime, which usually depends on the first. Therefore, job efficiency is tied to the application performance in that an increase in performance (and decrease in runtime) usually leads to a better efficiency (lower runtime and/or lower energy consumption).

This guideline discusses basics about efficiency measurement, how to spot and mitigate common job efficiency pitfalls and performance engineering.

Efficiency measurement

Common job efficiency pitfalls

Resource oversubscription

Resource underutilization

Load imbalance

Filesystem access

Scaling

Performance expectation and reality