Submit batch jobs

Back to Main Page >> Simulation Meetings >> Simulation Computing Workshop 5-2023 or Simulation Page

How to Submit Batch Jobs for JLab Computing Cluser

Useful information about JLab computing can be found- here.

Batch system -- Auger :: It is a software that manages the batch farm. The auger commands should be found in the /site/bin directory of any CUE user's account.

• Step 1. Create a file (text or XML) which describes your job (one or many) (more info here).

For XML, the format is (which is an example with two similar jobs)

You can write a script for generating this file for many jobs or you can send an email to chandan@jlab.org for such a script.

slurm script for ifarm job submission::scripts

<Request> 
  <Email email="your-email@jlab.org" request="false" job="true"/>
  <Project name="moller12gev"/>
  <Track name="simulation"/>
  <Name name="job-name"/>
  <CPU core="4"/>
  <OS name="general"/>
  <Memory space="4000" unit="MB"/>
  <Command><![CDATA[
    pwd
    tar -zxvf default.tar.gz
    ./remoll runexample_ep.mac
  ]]></Command> 
  <Job> 
    <Input src="/path-to-your-input-file/runexample_ep.mac" dest="runexample_ep.mac"/>
    <Input src="/path-to-your-input-file/default.tar.gz" dest="default.tar.gz"/>
    <Output src="remollout.root" dest="/path-to-your-output-file/remollout_ep1.root"/>
    <Stdout dest="/path-to-your-output-file/log.out"/>
    <Stderr dest="/path-to-your-output-file/log.err"/>
  </Job> 

  <Job> 
    <Input src="/path-to-your-input-file/runexample_ep.mac" dest="runexample_ep.mac"/>
    <Input src="/path-to-your-input-file/default.tar.gz" dest="default.tar.gz"/>
    <Output src="remollout.root" dest="/path-to-your-output-file/remollout_ep2.root"/>
    <Stdout dest="/path-to-your-output-file/log2.out"/>
    <Stderr dest="/path-to-your-output-file/log2.err"/>
  </Job> 
</Request>

• Step 2: Create a workflow using swif : (more information here) Execute

/site/bin/swif create -workflow your-workflow-name

you can use this workflow for many batch jobs.

• Step 3: Add your job in the workflow

/site/bin/swif add-jsub -workflow test1 -script your-xml-filename

• Step 4: Run your batch job - execute the following command

/site/bin/swif run -workflow your-workflow-name

• Step 5: Check status of your batch jobs

/site/bin/swif status -workflow your-workflow-name

There may be some delay to display your job status as the process takes some time to update the jobsystem.