<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<style type="text/css" style="display:none;"> P {margin-top:0;margin-bottom:0;} </style>
</head>
<body dir="ltr">
<div style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
All ifarm changes that were scheduled for today's maintenance period are complete. The ifarm nodes have been restored to normal operation.</div>
<div style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
<br>
</div>
<div style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
Thank you for your patience.</div>
<div id="appendonsend"></div>
<hr style="display:inline-block;width:98%" tabindex="-1">
<div id="divRplyFwdMsg" dir="ltr"><font face="Calibri, sans-serif" style="font-size:11pt" color="#000000"><b>From:</b> Wesley Moore<br>
<b>Sent:</b> Monday, October 9, 2023 10:05 AM<br>
<b>To:</b> jlab-scicomp-briefs@jlab.org <jlab-scicomp-briefs@jlab.org><br>
<b>Subject:</b> ifarm Node Maintenance and Upcoming Changes</font>
<div> </div>
</div>
<style type="text/css" style="display:none">
<!--
p
{margin-top:0;
margin-bottom:0}
-->
</style>
<div dir="ltr">
<div class="x_elementToProof" style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<div style="box-sizing:border-box; font-size:14px">
<p><span style="font-family:Calibri; font-size:12pt">As you may have experienced in recent weeks, our ifarm nodes have been encountering multiple issues, primarily related to work disk caused by InfiniBand dropouts and memory fragmentation. These issues have
necessitated periodic reboots and other manual intervention to restore normal system operations.</span><br>
</p>
<p><span style="font-size:11.0pt"><span class="x_ContentPasted0" style="font-family:Calibri; font-size:12pt"></span></span></p>
<p><span style="font-size:11.0pt"><span class="x_ContentPasted0" style="font-family:Calibri; font-size:12pt"><br>
</span></span></p>
<p><span style="font-size:11.0pt"><span class="x_ContentPasted0" style="font-family:Calibri; font-size:12pt">Despite our best efforts, we have been unable to resolve these ongoing issues. Therefore on maintenance day, October 17th, we are scheduled to implement
additional hardware configuration changes aimed at addressing these issues effectively.</span></span></p>
<p><span style="font-size:11.0pt"><span class="x_ContentPasted0" style="font-family:Calibri; font-size:12pt"></span></span></p>
<p><span style="font-size:11.0pt"><span class="x_ContentPasted0" style="font-family:Calibri; font-size:12pt"><br>
</span></span></p>
<p><span style="font-size:11.0pt"><span class="x_ContentPasted0" style="font-family:Calibri; font-size:12pt">This change involves upgrading the InfiniBand cards, which will require a brief outage of the systems. We understand the importance of minimizing disruptions,
and as such, we will publish a schedule for this outage in advance to allow for proper planning.</span></span></p>
<p><span style="font-size:11.0pt"><span class="x_ContentPasted0" style="font-family:Calibri; font-size:12pt"></span></span></p>
<p><span style="font-size:11.0pt"><span class="x_ContentPasted0" style="font-family:Calibri; font-size:12pt"><br>
</span></span></p>
<p><span style="font-size:11.0pt"><span class="x_ContentPasted0" style="font-family:Calibri; font-size:12pt">In the interim, we will continue to perform reboots as necessary to maintain system operability. Wall warning messages will continue to be used for
immediate notifications of any required reboots, but we will also notify this mailing list to keep you informed about the ongoing status and updates.</span></span></p>
<p><span style="font-size:11.0pt"><span class="x_ContentPasted0" style="font-family:Calibri; font-size:12pt"></span></span></p>
<p><span style="font-size:11.0pt"><span class="x_ContentPasted0" style="font-family:Calibri; font-size:12pt"><br>
</span></span></p>
<p><span style="font-size:11.0pt"><span class="x_ContentPasted0" style="font-family:Calibri; font-size:12pt">We appreciate your patience and cooperation as we work to resolve these issues and improve the reliability of our ifarm nodes. If you have any questions
or concerns, please do not hesitate to reach out to our support team.</span></span></p>
<p><span style="font-size:11.0pt"><span class="x_ContentPasted0" style="font-family:Calibri; font-size:12pt"></span></span></p>
<p><span style="font-size:11.0pt"><span class="x_ContentPasted0" style="font-family:Calibri; font-size:12pt"><br>
</span></span></p>
<p><span style="font-size:11.0pt"><span class="x_ContentPasted0" style="font-family:Calibri; font-size:12pt">Thank you for your understanding.</span></span></p>
</div>
</div>
</div>
</body>
</html>