<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<style type="text/css" style="display:none;"> P {margin-top:0;margin-bottom:0;} </style>
</head>
<body dir="ltr">
<div class="elementToProof" style="text-align: left; text-indent: 0px; margin: 1em 0px; font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 14pt; color: rgb(0, 0, 0);">
<b>July 16 Maintenance Day for Alma9</b></div>
<div class="elementToProof" style="text-align: left; text-indent: 0px; margin: 1em 0px; font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
The transition of the JLab compute farm from CentOS 7 to AlmaLinux 9 (EL9) has been completed. Next maintenance day two user-visible changes will made: </div>
<div class="elementToProof" style="text-align: left; text-indent: 0px; margin: 1em 0px; font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
First, The DNS alias ifarm.jlab.org will point to new EL9 nodes, ifarm2401 and ifarm2402. The ifarm7 nodes will be retired. </div>
<div class="elementToProof" style="text-align: left; text-indent: 0px; margin: 1em 0px; font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
Second, to complete the AlmaLinux migration in SLURM, we will be removing the <code>
el7</code> feature. <b><i>This may require modification to your SLURM job submissions</i></b>. Here is how to plan now for the change:</div>
<ol start="1" data-listchain="__List_Chain_479" style="text-align: left;">
<li style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0); display: block;">
<div style="margin: 1em 0px;"><b>Review SLURM Job Submission Scripts</b>:</div>
</li><ul>
<li style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<div style="margin: 0px;">Identify where the <code>el7</code> constraint is being specified in your SLURM job submission scripts. This is typically done using the
<code>-C</code> or <code>--constraint</code> flag followed by the constraint specification. For example:
<code>--constraints=el7|el9</code></div>
</li><li style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<div style="margin: 0px;">Remove the <code>el7</code> constraint from your job submission commands. If you have other constraints, adjust accordingly.</div>
</li></ul>
</ol>
<div style="text-align: left; text-indent: 0px; margin: 0px; font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
Failure to remove the <code>el7</code> constraint after maintenance day will result in failed job submissions. The resulting error will be similar to:</div>
<div style="text-align: left; text-indent: 0px; margin: 0px; font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div style="text-align: left; text-indent: 0px; margin: 0px; font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<code> Unable to allocate resources: Invalid feature specification</code></div>
<div id="Signature"><span style="font-size: 12pt; color: rgb(0, 0, 0);"><br>
</span></div>
<div id="Signature">
<div style="font-size: 12pt; color: rgb(0, 0, 0);"><br>
</div>
<div style="font-size: 12pt; color: rgb(0, 0, 0);"><br>
</div>
<div style="font-size: 14pt; color: rgb(0, 0, 0);"><b>Farm Lustre Status</b></div>
<div style="font-size: 14pt; color: rgb(0, 0, 0);"><b><br>
</b></div>
<div style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
The June issue with Lustre on the farm has been identified and stabilized. The cause was traced to a bug with Connect-X 3 InfiniBand card driver in older farm nodes that caused server crashes when both the old (lustre19) and new (lustre24) filesystems were
mounted. Planning is underway for a transition from the existing 5PB Lustre system to the new 11PB Lustre system that works around this issue. A schedule for this change will be announced once it is complete. </div>
<div style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
</div>
<div id="Signature"></div>
<div id="Signature"></div>
</body>
</html>