<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=iso-8859-1">
<style type="text/css" style="display:none;"> P {margin-top:0;margin-bottom:0;} </style>
</head>
<body dir="ltr">
<div style="background-color: rgb(255, 255, 255); color: rgb(0, 0, 0);">
<p style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; margin: 0in;">
News and Notes for JLab Scientific Computing </p>
<p style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; margin: 0in;">
</p>
<p style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; margin: 0in;">
</p>
<p style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; margin: 0in;">
On Tuesday morning, October 15th, the batch controller for the farm will be upgraded to the latest version of Slurm (19.x). The change should be not be visible to end users. Jobs will continue to run during the upgrade. New farm job starts will be paused for
approximately an hour while the server is relocated to a more robust virtual machine and the database is upgraded. This upgrade is being done for bug fixes, updates,<span style="mso-spacerun:yes">
</span>and to enable new scheduling capabilities. Please let us know if these plans pose any scheduling problems. </p>
<p style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; margin: 0in;">
</p>
<p style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; margin: 0in;">
</p>
<p style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; margin: 0in;">
Starting this fall the following changes will be made to the scientific computing environment:</p>
<ul type="disc" style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; margin-left: 0.375in; unicode-bidi: embed; margin-top: 0in; margin-bottom: 0in;">
<li style="margin-top:0;margin-bottom:0;vertical-align:middle"><span>40 new farm nodes, each with 64 CPU threads and 256GB of memory, will be added to the farm. </span></li><li style="margin-top:0;margin-bottom:0;vertical-align:middle"><span>The farm will be upgraded to CentOS 7.7. This will be done in a series of steps and more information about how to use the CentOS 7.7 nodes and the AMD cpus will follow.
</span></li><li style="margin-top:0;margin-bottom:0;vertical-align:middle"><span>An addition ~6PB of space will be added to Lustre for /cache and /volatile to enable more online processing of data without making the round-trip to tape in as many cases.
</span></li><li style="margin-top:0;margin-bottom:0;vertical-align:middle"><span>back-end management machines will be upgraded to provide more robust services</span></li></ul>
<p style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; margin: 0in 0in 0in 0.375in;">
</p>
<p style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; margin: 0in 0in 0in 0.375in;">
</p>
<p style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; margin: 0in;">
A number of changes have been made to the experimental physics batch farm. This is a short summary of recent changes, mostly related to the integration of slurm into the compute environment.
</p>
<p style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; margin: 0in;">
</p>
<ul type="disc" style="margin-left: 0.375in; unicode-bidi: embed; margin-top: 0in; margin-bottom: 0in;">
<li style="margin-top: 0px; margin-bottom: 0px; vertical-align: middle;"><font face="Calibri, Arial, Helvetica, sans-serif"><span style="font-size: 12pt;">The Farm web page has been updated to show both
</span>physical<span style="font-size: 12pt;"> memory requested and physical memory allocated. This is useful to help understand whether the running jobs have optimized their use of memory and CPU resources.
</span></font><a href="https://scicomp.jlab.org/scicomp/index.html#/farmNodes" style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt;"><span>https://scicomp.jlab.org/scicomp/index.html#/farmNodes</span></a></li><li style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; margin-top: 0px; margin-bottom: 0px; vertical-align: middle;">
<span>Fair Share for the farm is now calculated using the </span><span style="font-style:italic">Fair Tree
</span><span>algorithm. The web pages have been updated to represent this visually at<span style="mso-spacerun:yes">
</span></span><a href="https://scicomp.jlab.org/scicomp/index.html#/fairshare" style=""><span>https://scicomp.jlab.org/scicomp/index.html#/fairshare</span></a></li><li style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; margin-top: 0px; margin-bottom: 0px; vertical-align: middle;">
<span style="font-family: Calibri, Helvetica, sans-serif;">Slurm command-line tools are now installed on all farm nodes. As an example, the "squeue" and "sprio" commands can be used to show job status from the command line. "sbatch" is used to submit a job.
</span></li><li style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; margin-top: 0px; margin-bottom: 0px; vertical-align: middle;">
<span><span style="font-family: Calibri, Helvetica, sans-serif; font-size: 12pt; font-variant-ligatures: common-ligatures; color: rgb(29, 28, 29); background-color: rgb(248, 248, 248); display: inline !important;">for those users who want to try out using Slurm
directly, the jlab slurm documentation is being developed at </span><span style="font-family: Slack-Lato, appleLogo, sans-serif; font-size: 15px; font-variant-ligatures: common-ligatures; color: rgb(29, 28, 29); background-color: rgb(248, 248, 248); display: inline !important;"><a href="https://scicomp.jlab.org/docs/farm_slurm_batch" id="LPlnk287962" style=""><span style="font-family: Calibri, Helvetica, sans-serif; font-size: 12pt;">https://scicomp.jlab.org/docs/farm_slurm_batch</span></a></span><br>
</span></li></ul>
<br>
</div>
</body>
</html>