<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=Windows-1252">
<style type="text/css" style="display:none;"> P {margin-top:0;margin-bottom:0;} </style>
</head>
<body dir="ltr">
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div id="appendonsend"></div>
<hr tabindex="-1" style="display:inline-block; width:98%">
<div id="divRplyFwdMsg" dir="ltr"><font face="Calibri, sans-serif" color="#000000" style="font-size:11pt"><b>From:</b> Paul Letta <letta@jlab.org><br>
<b>Sent:</b> Wednesday, November 11, 2020 7:46 AM<br>
<b>To:</b> Ole Hansen <ole@jlab.org>; Brad Sawatzky <brads@jlab.org>; Stephen Wood <saw@jlab.org>; Sergey Boyarinov <boiarino@jlab.org>; Sergey Furletov <furletov@jlab.org>; Hovanes Egiyan <hovanes@jlab.org>; Nathan Baltzell <baltzell@jlab.org>; David Abbott
<abbottd@jlab.org>; Anthony Cuffe <cuffe@jlab.org>; Adam Carpenter <adamc@jlab.org>; Erik Werlau <werlau@jlab.org>; Kari Heffner <heffner@jlab.org>; Bobby Lawrence <robertl@jlab.org>; David Sheppard <sheppard@jlab.org>; unixadm@jlab.org <unixadm@jlab.org>;
secops@jlab.org <secops@jlab.org><br>
<b>Subject:</b> MAJOR changes to /site and /apps on central fileserver, Tuesday Nov 17 -- MUST READ !</font>
<div> </div>
</div>
<div lang="EN-US">
<div class="x_WordSection1">
<p class="x_MsoNormal" style="margin: 0in 0in 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;">
We will be making major changes to the file servers listed below on Tuesday, Nov 17, 2020</p>
<p class="x_MsoNormal" style="margin: 0in 0in 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;">
</p>
<p class="x_MsoNormal" style="margin: 0in 0in 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;">
Jlabsite:/site</p>
<p class="x_MsoNormal" style="margin: 0in 0in 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;">
Jlabapps:/appsroot</p>
<p class="x_MsoNormal" style="margin: 0in 0in 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;">
</p>
<p class="x_MsoNormal" style="margin: 0in 0in 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;">
If any of your machines mount these areas.. you need to act on this.</p>
<p class="x_MsoNormal" style="margin: 0in 0in 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;">
</p>
<p class="x_MsoNormal" style="margin: 0in 0in 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;">
Currently jlabsite and jlabapps are actually aliases that point to the same NetApp, cfs1a.jlab.org.</p>
<p class="x_MsoNormal" style="margin: 0in 0in 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;">
We are moving these areas to new virtual filers on new NetApp hardware. The IP addresses that both of these resolve to now, will change and will be different from each other.</p>
<p class="x_MsoNormal" style="margin: 0in 0in 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;">
</p>
<p class="x_MsoNormal" style="margin: 0in 0in 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;">
So – the IP addresses that jlabsite and jlabapps resolve to right now, will be changing. This has major implications for MOST linux machines at JLAB.</p>
<p class="x_MsoNormal" style="margin: 0in 0in 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;">
</p>
<p class="x_MsoNormal" style="margin: 0in 0in 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;">
We have published these to all JLAB machines via the automounter maps for many years.. therefore the number and location of machines that actually use them is impossible for us to know.</p>
<p class="x_MsoNormal" style="margin: 0in 0in 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;">
(mainly because many other exports share the same NetApp right now).</p>
<p class="x_MsoNormal" style="margin: 0in 0in 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;">
</p>
<p class="x_MsoNormal" style="margin: 0in 0in 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;">
Here is the general plan:</p>
<p class="x_MsoListParagraph" style="margin: 0in 0in 0.0001pt 0.5in; font-size: 11pt; font-family: Calibri, sans-serif;text-indent:-.25in; mso-list:l0 level1 lfo1">
<span style="font-family:Symbol"><span style="mso-list:Ignore">·<span style="font:7.0pt "Times New Roman"">
</span></span></span>Tuesday, 11/17 at 5PM – change exports of jlabsite:/site and jlabapps:/appsroot to Read Only for all hosts. This isn’t that big a change, as there are only handful of machines that have r/w access to it.</p>
<p class="x_MsoListParagraph" style="margin: 0in 0in 0.0001pt 0.5in; font-size: 11pt; font-family: Calibri, sans-serif;text-indent:-.25in; mso-list:l0 level1 lfo1">
<span style="font-family:Symbol"><span style="mso-list:Ignore">·<span style="font:7.0pt "Times New Roman"">
</span></span></span>Do a final incremental copy – this should take less than an hour.</p>
<p class="x_MsoListParagraph" style="margin: 0in 0in 0.0001pt 0.5in; font-size: 11pt; font-family: Calibri, sans-serif;text-indent:-.25in; mso-list:l0 level1 lfo1">
<span style="font-family:Symbol"><span style="mso-list:Ignore">·<span style="font:7.0pt "Times New Roman"">
</span></span></span>Change DNS so that jlabsite and jlabapps now point to their new IPs.</p>
<p class="x_MsoListParagraph" style="margin: 0in 0in 0.0001pt 0.5in; font-size: 11pt; font-family: Calibri, sans-serif;text-indent:-.25in; mso-list:l0 level1 lfo1">
<span style="font-family:Symbol"><span style="mso-list:Ignore">·<span style="font:7.0pt "Times New Roman"">
</span></span></span>Tuesday, 11/17 at about 6PM – start rebooting all Linux machines that we have controls over – including desktops.</p>
<p class="x_MsoListParagraph" style="margin: 0in 0in 0.0001pt 0.5in; font-size: 11pt; font-family: Calibri, sans-serif;text-indent:-.25in; mso-list:l0 level1 lfo1">
<span style="font-family:Symbol"><span style="mso-list:Ignore">·<span style="font:7.0pt "Times New Roman"">
</span></span></span>Tuesday, 11/17 at about 8PM – remove even the ReadOnly exports from the old filer’s IP address for jlabsite:/site and jlabapps:/appsroot.</p>
<p class="x_MsoNormal" style="margin: 0in 0in 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;">
</p>
<p class="x_MsoNormal" style="margin: 0in 0in 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;">
It’s very important that you plan to reboot Linux hosts that the IT division does not patch/reboot monthly.. If you reboot after 6PM but BEFORE 8PM.. they will likely go down and reboot just fine.</p>
<p class="x_MsoNormal" style="margin: 0in 0in 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;">
If you wait until the areas are no longer exported from the old IP… your machines will likely hang trying to unmount these areas, as they will be stale. In this case, usually a physical intervention is required (hard power cycle, or Alt-SysRq-B). This is
the situation that we are trying to avoid.</p>
<p class="x_MsoNormal" style="margin: 0in 0in 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;">
</p>
<p class="x_MsoNormal" style="margin: 0in 0in 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;">
For the Windows machines – windows servers (MIS) and desktops will cache the DNS entries of the old IP address – a reboot (After 6PM) will clear this.</p>
<p class="x_MsoNormal" style="margin: 0in 0in 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;">
</p>
<p class="x_MsoNormal" style="margin: 0in 0in 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;">
Let me know of any questions. </p>
<p class="x_MsoNormal" style="margin: 0in 0in 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;">
Thanks,</p>
<p class="x_MsoNormal" style="margin: 0in 0in 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;">
Paul Letta</p>
<p class="x_MsoNormal" style="margin: 0in 0in 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;">
<a href="mailto:letta@jlab.org">letta@jlab.org</a></p>
<p class="x_MsoNormal" style="margin: 0in 0in 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;">
</p>
</div>
</div>
</div>
</body>
</html>