View source for Benchmarking & Scaling Tutorial/Automated Benchmarking JUBE

{{DISPLAYTITLE:Automated Benchmarking using JUBE}}<nowiki />
{{Syllabus Benchmarking & Scaling}}<nowiki />
__TOC__

== Introduction ==

The Jülich Benchmarking Environment is an application that helps you automate your workflow for system and application benchmarking.

JUBE allows you to define different steps of your workflow with dependencies between them.

One key advantage of using JUBE, as opposed to manually running an application in different configurations in a job script is that individual run configurations are automatically separated into separate workpackages with individual run directories, while common files and directories (like input files, preprocessing, etc.) can easily be integrated into the workflow.

Furthermore, application output (such as the runtime of the application) can easily be parsed and output in CSV or human-readable table format.

== Writing a minimal configuration ==

As JUBE executes each workpackage (step with concrete configuration) in its own sandbox, the benchmark configuration must specify a fileset that either copies or links files into the run directory.
Parameters have a separator defined (default is ',') that is used to tokenize the parameter string. Each token will be part of a separate configuration. In this example, the comma-separated list of tasks will result in the parameter <code>tasks</code> with one specific value in 15 different workpackages.

<syntaxhighlight lang="xml" line>
<?xml version="1.0" encoding="UTF-8"?>
<jube>
  <benchmark name="GROMACS" outpath="bench_run">
    <comment>A minimal JUBE config to run our GROMACS example</comment>

    <!-- Configuration -->
    <parameterset name="execute_pset">
      <parameter name="tasks">1,2,4,8,12,18,24,30,36,42,48,54,60,66,72</parameter>
      <!-- you could also compute the list using Python 
         <parameter name="tasks" mode="python">
           ",".join([str(x) for x in range(1,73) if (x % 6 == 0 and x > 10) or (x % 4 == 0 and x < 10) or x == 2 or x==1 ])
         </parameter>
      -->
    </parameterset>
    
    <!-- Input files -->
    <fileset name="gromacs_files">
      <link>MD_5NM_WATER.deff</link> <!-- link input file -->
    </fileset>

    <!-- Operation -->
    <step name="run">
      <use>execute_pset</use>  <!-- use parameterset -->
      <use>gromacs_files</use> <!-- use fileset -->
      <do>srun -n $ntasks gmx_mpi -quiet mdrun -deffnm MD_5NM_WATER -nsteps 10000 -ntomp 1 -pin on</do> <!-- start GROMACS -->
    </step>    
  </benchmark>
</jube>
</syntaxhighlight>

== Further information ==

* [https://apps.fz-juelich.de/jsc/jube/jube2/docu/index.html JUBE Documentation ]
* [https://www.youtube.com/watch?v=CTexZWKhF0I Video: Automated Benchmarking with JUBE ]
* [https://www.youtube.com/watch?v=pC5XZTILt1o Video: Jube by Example ]
* [https://www.youtube.com/watch?v=0u6uKMT79e8 Video: Application Benchmarking with JUBE: Lessons Learned ]
----
'''Next''': [[Benchmarking_%26_Scaling_Tutorial/Results | Plotting and Interpreting Results ]]

'''Previous''': [[Benchmarking_%26_Scaling_Tutorial/Automated_Benchmarking | Automated Benchmarking using a Job Script ]]