[Halld-offline] Fwd: FW: Central Fileserver changes and impact to DB servers

[Mark Ito]

from CNI...

Read down the page a bit if you mount /site and/or /apps on your desktop 
machine at JLab. You may have to reboot it if CNI does not do a reboot 
for you.

-------- Forwarded Message --------
Subject: 	FW: Central Fileserver changes and impact to DB servers
Date: 	Wed, 11 Nov 2020 08:35:01 -0500
From: 	Marty Wise <wise at jlab.org>
To: 	Mark Ito <marki at jlab.org>, David Lawrence <davidl at jlab.org>, Nathan 
Baltzell <baltzell at jlab.org>, Brad Sawatzky <brads at jlab.org>, Hovanes 
Egiyan <hovanes at jlab.org>, Stephen Wood <saw at jlab.org>, Douglas 
Higinbotham <doug at jlab.org>
CC: 	Kelvin Edwards <kelvin at jlab.org>, Paul Letta <letta at jlab.org>, 
Sherman White <srwhite at jlab.org>, Myung Bang <bangdm at jlab.org>, Jessica 
Perry <jperry at jlab.org>, Joel Watkins <jwatkins at jlab.org>, Matthew 
Sconyers <sconyers at jlab.org>



All,

MySQL/MariaDB servers will ALL be rebooted next Tuesday evening in step 
4 of the general plan provided below. The affected DB servers include:

·halladb

·hallbdb

·clasdb (including central replicas, external server, etc)

·hallcdb

·hallddb (including central replicas, external server, etc)

·qweakdb

·jmysql

They will also be patched prior to the reboots.

We will be making major changes to the file servers listed below on 
Tuesday, Nov 17, 2020

Jlabsite:/site

Jlabapps:/appsroot

If any of your machines mount these areas.. you need to act on this.

Currently jlabsite and jlabapps are actually aliases that point to the 
same NetApp, cfs1a.jlab.org.

We are moving these areas to new virtual filers on new NetApp hardware. 
The IP addresses that both of these resolve to now,  will change and 
will be different from each other.

So – the IP addresses that jlabsite and jlabapps resolve to right now, 
will be changing.   This has major implications for MOST linux machines 
at JLAB.

We have published these to all JLAB machines via the automounter maps 
for many years.. therefore the number and location of machines that 
actually use them is impossible for us to know.

(mainly because many other exports share the same NetApp right now).

Here is the general plan:

1.Tuesday, 11/17 at 5PM – change exports of jlabsite:/site and 
jlabapps:/appsroot to Read Only for all hosts.   This isn’t that big a 
change, as there are only handful of machines that have r/w access to it.

2.Do a final incremental copy – this should take less than an hour.

3.Change DNS so that jlabsite and jlabapps now point to their new IPs.

4.Tuesday, 11/17 at about 6PM – start rebooting all Linux machines that 
we have controls over – including desktops.

5.Tuesday, 11/17 at about 8PM – remove even the ReadOnly exports from 
the old filer’s IP address for jlabsite:/site and jlabapps:/appsroot.

Marty Wise

Jlab CST/CNI

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://mailman.jlab.org/pipermail/halld-offline/attachments/20201111/934347d5/attachment.html>