https://hpc-wiki.info/hpc/index.php?action=history&feed=atom&title=ClusterCockpit 2026-04-16T03:28:23Z Revision history for this page on the wiki MediaWiki 1.35.9 https://hpc-wiki.info/hpc/index.php?title=ClusterCockpit&diff=5199&oldid=prev 2025-09-04T15:04:23Z

<p>Increase cross article links</p> <table class="diff diff-contentalign-left diff-editfont-monospace" data-mw="interface"> <col class="diff-marker" /> <col class="diff-content" /> <col class="diff-marker" /> <col class="diff-content" /> <tr class="diff-title" lang="en"> <td colspan="2" style="background-color: #fff; color: #202122; text-align: center;">← Older revision</td> <td colspan="2" style="background-color: #fff; color: #202122; text-align: center;">Revision as of 15:04, 4 September 2025</td> </tr><tr><td colspan="2" class="diff-lineno" id="mw-diff-left-l21" >Line 21:</td> <td colspan="2" class="diff-lineno">Line 21:</td></tr> <tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>* Browse your running and completed jobs</div></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>* Browse your running and completed jobs</div></td></tr> <tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>* Analyze key metrics such as:</div></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>* Analyze key metrics such as:</div></td></tr> <tr><td class='diff-marker'>−</td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;"><div>** CPU load</div></td><td class='diff-marker'>+</td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div>** <ins class="diffchange diffchange-inline">[https://hpc-wiki.info/hpc/Performance_metrics#CPU_load </ins>CPU load<ins class="diffchange diffchange-inline">]</ins></div></td></tr> <tr><td class='diff-marker'>−</td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;"><div>** Memory bandwidth and usage</div></td><td class='diff-marker'>+</td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div>** <ins class="diffchange diffchange-inline">[https://hpc-wiki.info/hpc/Performance_metrics#Memory_bandwidth </ins>Memory bandwidth<ins class="diffchange diffchange-inline">] </ins>and <ins class="diffchange diffchange-inline">[https://hpc-wiki.info/hpc/Performance_metrics#Memory_usage </ins>usage<ins class="diffchange diffchange-inline">]</ins></div></td></tr> <tr><td class='diff-marker'>−</td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;"><div>** Floating-Point Operations per Second (FLOPS)</div></td><td class='diff-marker'>+</td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div>** <ins class="diffchange diffchange-inline">[https://hpc-wiki.info/hpc/Performance_metrics#Flops </ins>Floating-Point Operations per Second (FLOPS)<ins class="diffchange diffchange-inline">]</ins></div></td></tr> <tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>** GPU utilization (if available)</div></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>** GPU utilization (if available)</div></td></tr> <tr><td class='diff-marker'>−</td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;"><div>** Energy and power consumption (where supported)</div></td><td class='diff-marker'>+</td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div>** <ins class="diffchange diffchange-inline">[https://hpc-wiki.info/hpc/Performance_metrics#Power </ins>Energy and power consumption<ins class="diffchange diffchange-inline">] </ins>(where supported)</div></td></tr> <tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"></td></tr> <tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>* Identify performance issues such as:</div></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>* Identify performance issues such as:</div></td></tr> <tr><td class='diff-marker'>−</td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;"><div>** Underutilized CPU or GPU resources</div></td><td class='diff-marker'>+</td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div>** <ins class="diffchange diffchange-inline">[https://hpc-wiki.info/hpc/Job_efficiency#Resource_underutilization </ins>Underutilized CPU or GPU resources<ins class="diffchange diffchange-inline">]</ins></div></td></tr> <tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>** Memory bandwidth bottlenecks</div></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>** Memory bandwidth bottlenecks</div></td></tr> <tr><td class='diff-marker'>−</td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #ffe49c; vertical-align: top; white-space: pre-wrap;"><div>** Inefficient process pinning</div></td><td class='diff-marker'>+</td><td style="color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #a3d3ff; vertical-align: top; white-space: pre-wrap;"><div>** Inefficient <ins class="diffchange diffchange-inline">[https://hpc-wiki.info/hpc/Binding/Pinning </ins>process pinning<ins class="diffchange diffchange-inline">]</ins></div></td></tr> <tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"></td></tr> <tr><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>* Explore Roofline diagrams to visualize computational intensity and performance</div></td><td class='diff-marker'> </td><td style="background-color: #f8f9fa; color: #202122; font-size: 88%; border-style: solid; border-width: 1px 1px 1px 4px; border-radius: 0.33em; border-color: #eaecf0; vertical-align: top; white-space: pre-wrap;"><div>* Explore Roofline diagrams to visualize computational intensity and performance</div></td></tr> <!-- diff cache key hpc_wiki:diff::1.12:old-5191:rev-5199 --> </table>

Marc-andre-hermanns-bc32@rwth-aachen.de https://hpc-wiki.info/hpc/index.php?title=ClusterCockpit&diff=5191&oldid=prev 2025-05-30T14:06:40Z

<p>Creation of ClusterCockpit</p> <p><b>New page</b></p><div>ClusterCockpit is an open-source framework for job-specific and cluster-wide performance and energy monitoring in HPC environments.<br /> With this toolkit, users can analyze how their jobs utilize compute resources, spot inefficiencies, and optimize overall performance.<br /> <br /> Developed as a collaborative project led by the NHR center NHR@FAU, ClusterCockpit benefits from contributions from several other HPC centers.<br /> All components are released under the MIT license and freely available for use.<br /> <br /> == Technical background ==<br /> <br /> The solution is composed of several modular components, all implemented in Go (with the web frontend based on Svelte):<br /> <br /> * cc-backend: A REST and GraphQL API backend, which also provides the web interface. This is the core component of ClusterCockpit.<br /> * cc-metric-collector: A lightweight agent running on each compute node, responsible for collecting hardware performance and energy metrics (CPU load, memory usage, GPU utilization, power consumption, etc.) and forwarding them to the backend.<br /> * cc-metric-store: An in-memory timeseries cache for fast metric access and visualization.<br /> <br /> While ClusterCockpit can serve as a complete, integrated monitoring solution, its components are also designed for seamless integration with external systems.<br /> <br /> == User Interface Features ==<br /> <br /> The web interface provides a comprehensive set of tools for monitoring and analysis. Users can:<br /> <br /> * Browse your running and completed jobs<br /> * Analyze key metrics such as:<br /> ** CPU load<br /> ** Memory bandwidth and usage<br /> ** Floating-Point Operations per Second (FLOPS)<br /> ** GPU utilization (if available)<br /> ** Energy and power consumption (where supported)<br /> <br /> * Identify performance issues such as:<br /> ** Underutilized CPU or GPU resources<br /> ** Memory bandwidth bottlenecks<br /> ** Inefficient process pinning<br /> <br /> * Explore Roofline diagrams to visualize computational intensity and performance<br /> <br /> == Example Views ==<br /> <br /> === Job List View ===<br /> <br /> Browse all of your jobs.<br /> <br /> [[File:Clustercockpit_job_list.png|1000px]]<br /> <br /> === Detailed Job View ===<br /> <br /> See time-series plots for CPU load, memory usage, GPU utilization and other metrics.<br /> <br /> [[File:Clustercockpit_job_view.png|1000px]]<br /> <br /> == External Links ==<br /> <br /> * [https://clustercockpit.org ClusterCockpit Website]<br /> * [https://github.com/ClusterCockpit/ GitHub Repository]<br /> * [https://clustercockpit.org/docs/ Documentation]</div>

Robert-externbrink-21b8@ruhr-uni-bochum.de