<html>
<head>
<meta content="text/html; charset=windows-1252"
http-equiv="Content-Type">
</head>
<body bgcolor="#FFFFFF" text="#000000">
<p>Dear Colleagues,</p>
<p><br>
</p>
<p>Recent changes in the JLab batch farm system required an update
to the launch scripts which were introduced during the last GlueX
software tutorial:</p>
<p><br>
</p>
<p><a class="moz-txt-link-freetext"
href="https://halldweb.jlab.org/doc-private/DocDB/ShowDocument?docid=3658">https://halldweb.jlab.org/doc-private/DocDB/ShowDocument?docid=3658</a></p>
<p><br>
</p>
<p>In particular, you have to svn update the following file:<br>
</p>
<p><br>
</p>
<p><a class="moz-txt-link-freetext"
href="https://halldsvn.jlab.org/repos/trunk/scripts/monitoring/launch/launch.py">https://halldsvn.jlab.org/repos/trunk/scripts/monitoring/launch/launch.py</a></p>
<p><br>
</p>
<p>The update will make sure that the directory for the log files
exists prior to registering the job to swif, which is a
requirement for the new scheduler slurm. <br>
</p>
<p><br>
</p>
<p>Please find more information about the changes below.</p>
<p><br>
</p>
<p>Best regards,</p>
<p>Alex</p>
<p><br>
</p>
<br>
<div class="moz-cite-prefix">On 2/11/2019 3:44 PM, Ying Chen wrote:<br>
</div>
<blockquote
cite="mid:DM5PR0901MB250479135AF1D44672ABF125D2640@DM5PR0901MB2504.namprd09.prod.outlook.com"
type="cite">
<meta http-equiv="Content-Type" content="text/html;
charset=windows-1252">
<style type="text/css" style="display:none;"> P {margin-top:0;margin-bottom:0;} </style>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif;
font-size: 12pt; color: rgb(0, 0, 0);">
Dear halld users,</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif;
font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif;
font-size: 12pt; color: rgb(0, 0, 0);">
Sorry for this later announcement on the change for our farm
cluster.</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif;
font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif;
font-size: 12pt; color: rgb(0, 0, 0);">
Since last week, we have quietly moved 20% swif jobs to our new
slurm cluster. <br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif;
font-size: 12pt; color: rgb(0, 0, 0);">
Some of the jobs failed on slurm due to the log directory
doesn't exist. <br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif;
font-size: 12pt; color: rgb(0, 0, 0);">
The error message will like this:</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif;
font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif;
font-size: 12pt; color: rgb(0, 0, 0);">
<pre><span>Status: FAILED (Job failed due to invalid stdour/stderr)</span></pre>
This is because auge-slurm will not manage (save, copy and trim
the log files) <br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif;
font-size: 12pt; color: rgb(0, 0, 0);">
the stdout and stderr for the job, instead of pass the location
to slurm so</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif;
font-size: 12pt; color: rgb(0, 0, 0);">
slurm will direct write the meesage to these files. This changes
will have a <br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif;
font-size: 12pt; color: rgb(0, 0, 0);">
good benefit because the log files will be available to user
after job starts.</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif;
font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif;
font-size: 12pt; color: rgb(0, 0, 0);">
By default, the job .out and .err files will under
/lustre/expphy/farm_out/<user>,
<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif;
font-size: 12pt; color: rgb(0, 0, 0);">
name pattern will be JOB_NAME-AUGER_JOB_ID-HOSTNAME.out and <br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif;
font-size: 12pt; color: rgb(0, 0, 0);">
JOB_NAME-AUGER_JOB_ID-HOSTNAME.err. Auger will create this
directory</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif;
font-size: 12pt; color: rgb(0, 0, 0);">
for any user who first time run a job on slurm. By if you use
<Stdout> and <br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif;
font-size: 12pt; color: rgb(0, 0, 0);">
<Stderr> tag to change the log file location, it is user's
responsibility to make</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif;
font-size: 12pt; color: rgb(0, 0, 0);">
sure the log directory exists, otherwise the job will fail with<span>
'invalid stdour/stderr'.</span></div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif;
font-size: 12pt; color: rgb(0, 0, 0);">
<span><br>
</span></div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif;
font-size: 12pt; color: rgb(0, 0, 0);">
<span>Please check this document for detailed information on
auger-slurm.<br>
</span></div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif;
font-size: 12pt; color: rgb(0, 0, 0);">
<span><br>
</span></div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif;
font-size: 12pt; color: rgb(0, 0, 0);">
<span></span><a moz-do-not-send="true"
href="https://scicomp.jlab.org/docs/auger_slurm"
id="LPlnk733655">https://scicomp.jlab.org/docs/auger_slurm</a><br>
</div>
<div
id="LPBorder_GTaHR0cHM6Ly9zY2ljb21wLmpsYWIub3JnL2RvY3MvYXVnZXJfc2x1cm0."
class="LPBorder332784" style="width: 100%; margin-top: 16px;
margin-bottom: 16px; position: relative; max-width: 800px;
min-width: 424px;" contenteditable="false">
<table id="LPContainer332784" role="presentation"
style="padding: 12px 36px 12px 12px; width: 100%;
border-width: 1px; border-style: solid; border-color: rgb(200,
200, 200); border-radius: 2px;">
<tbody>
<tr style="border-spacing: 0px;" valign="top">
<td style="width: 100%;">
<div id="LPTitle332784" style="font-size: 21px;
font-weight: 300; margin-right: 8px; font-family:
"wf_segoe-ui_light", "Segoe UI
Light", "Segoe WP Light", "Segoe
UI", "Segoe WP", Tahoma, Arial,
sans-serif; margin-bottom: 12px;">
<a moz-do-not-send="true" target="_blank"
id="LPUrlAnchor332784"
href="https://scicomp.jlab.org/docs/auger_slurm"
style="text-decoration: none;
color:var(--themePrimary);">Auger-Slurm (Beta test)
| JLab Scientific Computing</a></div>
<div id="LPDescription332784" style="font-size: 14px;
max-height: 100px; color: rgb(102, 102, 102);
font-family: "wf_segoe-ui_normal",
"Segoe UI", "Segoe WP", Tahoma,
Arial, sans-serif; margin-bottom: 12px; margin-right:
8px; overflow: hidden;">
The auger-slurm commands are installed under
/site/scicomp/auger-slurm/bin (will be linked to
/site/bin in the future) and can be accessed from
ifarm or any host ...</div>
<div id="LPMetadata332784" style="font-size: 14px;
font-weight: 400; color: rgb(166, 166, 166);
font-family: "wf_segoe-ui_normal",
"Segoe UI", "Segoe WP", Tahoma,
Arial, sans-serif;">
scicomp.jlab.org</div>
</td>
</tr>
</tbody>
</table>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif;
font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif;
font-size: 12pt; color: rgb(0, 0, 0);">
Let me (or Chris) know if you have any questions.</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif;
font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif;
font-size: 12pt; color: rgb(0, 0, 0);">
Thanks<br>
</div>
</blockquote>
<br>
</body>
</html>