<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=iso-8859-1">
<style type="text/css" style="display:none;"> P {margin-top:0;margin-bottom:0;} </style>
</head>
<body dir="ltr">
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);">
<span style="font-size: 12pt; color: rgb(6, 64, 12);"><b>Upcoming Changes to the Scientific Computing Environment</b></span></div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);">
<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);">
<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);">
On Tuesday Morning, October 26th the following changes will be made to the farm:</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);">
<ul>
<li>ifarm1801 will be patched from CentOS 7.7 to CentOS 7.9 and rebooted.<span></span></li><li>all farm13 nodes (but only farm13 nodes) will be patched from CentOS 7.7 to CentOS 7.9 and rebooted.</li><li><span style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt;">OSG tools will be updated on 7.9 nodes. </span><br>
</li></ul>
<div><br>
</div>
<div>Updates to 7.9 are prerequisites for CUDA and Open Science Grid tools. We are increasing the frequency of patching to improve cybersecurity and be more respond to the grid computing software updates.</div>
<div><br>
</div>
<div><br>
</div>
<div><br>
</div>
<div><span style="color: rgb(6, 64, 12);"><b>Recent Changes to the Scientific Computing Environment</b></span></div>
<div><br>
</div>
<div>
<ul>
<li><span><span style="margin:0px">On the October 19th Maintenace day, GPU enabled machines (the sciml nodes) were updated to CentOS 7.9 to support CUDA 11.4.2.</span></span></li><li><span><span style="margin:0px; font-size:12pt">JupyterHub was similarly updated to include CUDA 11.4.2, </span><span style="margin:0px"><span style="box-sizing:border-box; font-family:"Segoe UI",system-ui,"Apple Color Emoji","Segoe UI Emoji",sans-serif; font-size:12pt">Tensorflow
2.6.0, and </span><span style="box-sizing:border-box; font-family:"Segoe UI",system-ui,"Apple Color Emoji","Segoe UI Emoji",sans-serif; font-size:14px"><span style="box-sizing:border-box; font-size:12pt">Torch 1.9.1+cu111</span></span></span><span style="margin:0px; font-size:12pt"> </span></span></li></ul>
</div>
<div><br>
<span style="margin:0px"></span></div>
<div><br>
</div>
<div>If you experience any software incompatibilities in the transition from 7.7 to 7.9, please submit a ServiceNow request. Barring unseen issues, we anticipate incrementally rolling the rest of the farm to CentOS 7.9 over the next month. As we do, Slurm will
be updated to reflect the state of worker nodes as described in the next section. </div>
<div><b><i><u><br>
</u></i></b></div>
<div><br>
</div>
<div><span style="color: rgb(6, 64, 12);"><b>Slurm Specific Notes</b></span></div>
<div><br>
</div>
<div>Most batch jobs run in the production partition, which is the default. Information about other Slurm capabilities, including GPU and Jupyter Notebook use can be found online here: <a href="https://scicomp.jlab.org/docs/farmsDocHome" id="LPlnk394658">https://scicomp.jlab.org/docs/farmsDocHome</a></div>
<div><br>
</div>
<div>During this transition from CentOS 7.7 to 7.9 all nodes will remain in the production partition in Slurm. In the unlikely case that you need to limit your jobs to a particular set of nodes, you can submit using the "--constraint" flag and a feature (such
as centos77) as shown below. The features will be updated and can be examined using the "sinfo" command. For example, this shows the number of nodes in the production partition and their features:</div>
<div><br>
</div>
<div><br>
</div>
<div><span style="font-family:Consolas,Courier,monospace"></span><span style="font-family:Consolas,Courier,monospace">ifarm1901 ~ $ sinfo --partition=production -o "%8D %12P %f"</span>
<div><span style="font-family:Consolas,Courier,monospace">NODES PARTITION AVAIL_FEATURES</span></div>
<div><span style="font-family:Consolas,Courier,monospace">107 production* farm19,amd,centos77,general</span></div>
<div><span style="font-family:Consolas,Courier,monospace">82 production* farm14,centos77,general,xeon</span></div>
<div><span style="font-family:Consolas,Courier,monospace">40 production* farm16,centos77,general,xeon</span></div>
<div><span style="font-family:Consolas,Courier,monospace">16 production* farm13,centos77,general,xeon</span></div>
<span style="font-family:Consolas,Courier,monospace">81 production* farm18,centos77,general,xeon</span><span style="font-family:Consolas,Courier,monospace"></span><br>
</div>
</div>
</body>
</html>