[Halld-controls] Fw: Central Fileserver changes and impact to DB servers

[Hovanes Egiyan]

________________________________
From: Marty Wise <wise at jlab.org>
Sent: Wednesday, November 11, 2020 8:35 AM
To: Mark Ito <marki at jlab.org>; David Lawrence <davidl at jlab.org>; Nathan Baltzell <baltzell at jlab.org>; Brad Sawatzky <brads at jlab.org>; Hovanes Egiyan <hovanes at jlab.org>; Stephen Wood <saw at jlab.org>; Douglas Higinbotham <doug at jlab.org>
Cc: Kelvin Edwards <kelvin at jlab.org>; Paul Letta <letta at jlab.org>; Sherman White <srwhite at jlab.org>; Myung Bang <bangdm at jlab.org>; Jessica Perry <jperry at jlab.org>; Joel Watkins <jwatkins at jlab.org>; Matthew Sconyers <sconyers at jlab.org>
Subject: FW: Central Fileserver changes and impact to DB servers


All,



MySQL/MariaDB servers will ALL be rebooted next Tuesday evening in step 4 of the general plan provided below. The affected DB servers include:



·         halladb

·         hallbdb

·         clasdb (including central replicas, external server, etc)

·         hallcdb

·         hallddb (including central replicas, external server, etc)

·         qweakdb

·         jmysql



They will also be patched prior to the reboots.



We will be making major changes to the file servers listed below on Tuesday, Nov 17, 2020



Jlabsite:/site

Jlabapps:/appsroot



If any of your machines mount these areas.. you need to act on this.



Currently jlabsite and jlabapps are actually aliases that point to the same NetApp, cfs1a.jlab.org.

We are moving these areas to new virtual filers on new NetApp hardware.  The IP addresses that both of these resolve to now,  will  change and will be different from each other.



So – the IP addresses that jlabsite and jlabapps resolve to right now, will be changing.   This has major implications for MOST linux machines at JLAB.



We have published these to all JLAB machines via the automounter maps for many years.. therefore the number and location of machines that actually use them is impossible for us to know.

(mainly because many other exports share the same NetApp right now).



Here is the general plan:

1.       Tuesday, 11/17 at 5PM – change exports of jlabsite:/site and jlabapps:/appsroot to Read Only for all hosts.   This isn’t that big a change, as there are only handful of machines that have r/w access to it.

2.       Do a final incremental copy – this should take less than an hour.

3.       Change DNS so that jlabsite and jlabapps now point to their new IPs.

4.       Tuesday, 11/17 at about 6PM – start rebooting all Linux machines that we have controls over – including desktops.

5.       Tuesday, 11/17 at about 8PM – remove even the ReadOnly exports from the old filer’s IP address for jlabsite:/site and jlabapps:/appsroot.





Marty Wise

Jlab CST/CNI
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://mailman.jlab.org/pipermail/halld-controls/attachments/20201111/43ab57c2/attachment-0001.html>