<html>
<head>
<meta http-equiv="content-type" content="text/html; charset=utf-8">
</head>
<body bgcolor="#FFFFFF" text="#000000">
<meta http-equiv="content-type" content="text/html; charset=utf-8">
Dear Scientific
Computing Users:<br>
<br>
We are pleased to
announce the production release of a new workflow software system
(SWIF) developed locally by the scientific computing group. SWIF,
the
"scientific workflow indefatigable factotum", originated
from the recognition of the necessity of providing a work-centric
data analysis environment in addition to the job-centric data
analysis platform at Jlab in order to improve the efficiency of
large data analysis in the 12 GeV era. Its key requirements and
specifications were the results of meetings and discussions among
active users, software coordinators from each experimental hall, and
developers. Its implementation was carried out by developers from
the
scientific computing group, and the whole system underwent a half
year long beta testing period with feedbacks and bug reports from
several helpful users. The main features of SWIF are:
<br>
<br>
1. Job grouping and
phased release. User jobs, either Auger jobs or SWIF jobs, can be
grouped into a named workflow which is released to the batch system
in multiple user defined phases.<br>
<br>
2. Tape savvy job
scheduling. The order of user jobs in a workflow can be rearranged
according to the input file locations on tapes to improve the
throughput of a workflow. <br>
<br>
3. Ease of job
modification, resubmission, recall and cancellation.<br>
<br>
4. Automatic
classification of job errors inside a workflow and automatic
resubmission of failed jobs if desired.<br>
<br>
5. Detailed job
metrics during and after a workflow.<br>
<br>
<br>
In addition, the
tape savvy scheduling algorithm has been integrated into the Auger
system. If a user submits many jobs with input files on many tapes,
the jobs can be reordered to achieve better throughput.<br>
<br>
The SWIF is
available as a single command at /site/bin/swif which has many
options. These options can be viewed either by using /site/bin/swif
–help or by consulting the SWIF document at
<a href="https://scicomp.jlab.org/docs/swif-cli">https://scicomp.jlab.org/docs/swif-cli</a>
.<br>
<br>
For more information
about SWIF, please check out <a
href="https://scicomp.jlab.org/docs/swif"><a class="moz-txt-link-freetext" href="https://scicomp.jlab.org/docs/swif">https://scicomp.jlab.org/docs/swif</a></a>
. Send any comment, feature request, and bug report to
<a href="mailto:scicomp@jlab.org">scicomp@jlab.org</a> or through
the Jlab ccpr system. Thank you very much.<br>
<br>
<br>
Sincerely,<br>
<br>
Your Scientific Computing Group.<br>
<title></title>
<meta name="generator" content="LibreOffice 4.4.2.2 (Linux)">
<style type="text/css">
@page { margin: 0.79in }
p { margin-bottom: 0.1in; line-height: 120% }
a:link { so-language: zxx }
</style>
<pre class="moz-signature" cols="72">--
################################################################
# Jie Chen
# Scientific Computing Group
# Jefferson Lab
# 12000 Jefferson Ave
# Newport News, VA 23606
# 757-269-5046
# <a class="moz-txt-link-abbreviated" href="mailto:chen@jlab.org">chen@jlab.org</a>
################################################################
</pre>
</body>
</html>