Difference between revisions of "Getting Started"

From HPC Wiki
Jump to navigation Jump to search
Line 32: Line 32:
 
|colspan="2"| [[SLURM]]
 
|colspan="2"| [[SLURM]]
 
|}
 
|}
 +
 +
After this the application is executed when a set of nodes (computers) are allocated the your 'job' by the scheduler. Usually there is (optionally) Email notification on start/finish of jobs.
 +
 +
== Modules or How-To-Use-Software-Without-installing-everything-yourself ==
 +
A lot of applications rely on 3rd party software. The most basic beeing compilers, this software is usually loadable with the module system.

Revision as of 16:15, 20 December 2017

Most HPC Systems are unix-based environments with shell (commandline) access.

To log in, one usually uses ssh [1] to reach the respective Login Nodes (Computers reserved for the login of users).

IT Center - RWTH Aachen RRZE - FAU Erlangen ZIH - TU Dresden
cluster.rz.rwth-aachen.de cshpc.rrze.fau.de taurus.hrsk.tu-dresden.de

Once there, the user can interact with the system and run (very small) programs to generally test the system/software.

Schedulers or How-To-Run-Applications-on-a-supercomputer

To run any significant program or workload on a supercomputer, generally schedulers [2] are employed. Except from the above-mentioned Login Nodes there are usually far more Backend Nodes (Computers exclusively reserved for computing). The scheduler decides who gets how many of those for what time.

In order to run your application with that, you have to tell the Scheduler, what your application needs in term of

  • time
  • compute resources (how many cpus/sockets/nodes)
  • memory resources (how much RAM/storage)
  • how to actually execute your application

This ususally is done with a Jobscript. When you have this jobscript ready with the help of jobscript-examples, colleagues or the Support, you can submit it to the respective Batch-Scheduler.

IT Center - RWTH Aachen RRZE - Erlangen ZIH - Dresden
LSF SLURM

After this the application is executed when a set of nodes (computers) are allocated the your 'job' by the scheduler. Usually there is (optionally) Email notification on start/finish of jobs.

Modules or How-To-Use-Software-Without-installing-everything-yourself

A lot of applications rely on 3rd party software. The most basic beeing compilers, this software is usually loadable with the module system.