[Ace] Shutdown/Recovery Plan for Tomorrow
Anthony Cuffe
cuffe at jlab.org
Mon Sep 26 13:08:41 EDT 2011
The following an outline
---------
Shutdown:
---------
7:00 - Oversee CHL Power Outage (Anthony)
7:30 - Shutdown Archivers (Chris S.)
8:15 - Shutdown Database and Non-Crical Equipment Room Nodes (done via shutdown script)
#Hostname #OS #Hardware #Fiefdom #Notable Applications #Comments
dbsrv1a #SunOS 5.10 #T2000 #sas #Oracle # Oracle Database
alarm1 #HP-UX #B2600 #ops #None # fanning 7619
alarm4 #HP-UX #B1000 #ops #None # fanning opscan - control room 7045
bklib1 #RHEL 4WS x86_64 #PE_R510 #sas #None # Tape Library Server - lib1
#bklib2 #RHEL 4WS x86_64 #PE_R510 #sas #None # Tape Library Server - lib2
bksrv #SunOS 5.10 #V240 #sas #None # Omniback Cell Manager
bksrv3 #SunOS 5.10 #V240 #sas #None # MYA backup server
cagwhla #RHEL 4WS i386 #PE_1425 #ops #Gateway # Hall A Gateway to OPS
cagwhlb #RHEL 4WS i386 #PE_1425 #ops #Gateway # Hall B Gateway to OPS
cagwhlc #RHEL 4WS i386 #PE_1425 #ops #Gateway # Hall C Gateway to OPS
cagwops #RHEL 4WS i386 #PE_1425 #ops #Gateway # OPS Gateway to HALLS
csmcws #SunOS 5.8 #V240 #sas #None # CiscoWorks Server
csml00 #RHEL 6WS i386 #PE_1950 #csm #NX # CSM General Login Server
csmls #RHEL 6WS i386 #PE_R610 #sas #None # CSM Syslog/Mail Server
csmnm0 #RHEL 4WS x86_64 #PE_2850 #sas #Apache2 Cacti Nagios IPHawk MySQL # cacti and iphawk
csmnm2 #RHEL 4WS i386 #PE_2950 #sas #Apache2 SmokePing DSView # smokeping and dsview
csmnnm #SunOS 5.10 #V240 #sas #None # Network Node Manager Server
csmsrv #HP-UX #B2600 #csm #None # lmclan 7801
csmweb #RHEL 6WS i386 #PE_1950 #csm #Apache2 # CSM WebServer
dbsrv3 #RHEL 4WS i386 #CSI #sas #MySQL BBSrv # Mysql Database Server
devbat0 #RHEL 4WS i386 #PE_2850 #dev #Qpage # DEV csu/Qpage Server
devh00 #HP-UX #B2600 #dev #None # MCC MC02B22 cnames - devlla8
devl00 #RHEL 6WS i386 #PE_R610 #dev #None # DEV csue compile host
devs00 #SunOS 5.10 #V210 #dev #None # DEV CSUE Compile Host
devsrv #HP-UX #B2600 #dev #MySQL #
devweb #RHEL 6WS i386 #PE_R610 #dev #Apache2 # DEV WebServer and jira server
dvlweb #RHEL 6WS i386 #PE_2850 #dev #Apache2 # DVL WebServer
fell00 #RHEL 6WS i386 #PE_R610 #fel #NX # FEL login server
felsrv1 #HP-UX #B2600 #fel #None # MCC MC02B24
felweb #RHEL 6WS i386 #PE_1950 #fel #Apache2 # FEL WebServer
opbat1 #HP-UX #B2600 #ops #None # bevins 7105
opfb1 #HP-UX #B2600 #ops #None # MCC rack
opsbat0 #RHEL 4WS i386 #PE_2850 #ops #Qpage # BAT Team Server
opsbat3 #RHEL 4WS i386 #PE_R610 #ops #RFReset # BAT Team Server
opscagw1 #RHEL 4WS i386 #PE_1425 #ops #Gateway # Hall Gateway
opsdvr1 #RHEL 6WS i386 #PW_T3500 #ops #Apache2 MySQL # OPS DVR machine. Located by MCC wall display.
opsh00 #HP-UX #B2600 #ops #None # MCC rack
opsl00 #RHEL 6WS i386 #PE_2950 #ops #NX # OPS csue/login host
opsl01 #RHEL 6WS i386 #PW_390 #ops #DTWall # OPS CR Operator console
opsl02 #RHEL 6WS i386 #PW_390 #ops #DTWall # OPS CR Operator console
opsl03 #RHEL 6WS i386 #PW_390 #ops #DTWall # OPS CR Operator console
opsl04 #RHEL 6WS i386 #PW_T3400 #ops #DTWall # OPS CR Operator console
opsl05 #RHEL 6WS i386 #PW_390 #ops #DTWall # OPS CR Crew Chief console
opsl06 #RHEL 6WS i386 #PW_390 #ops #DTWall # OPS PI console
opsl07 #RHEL 6WS i386 #PW_390 #ops #DTWall # OPS PI console
opsl08 #RHEL 6WS i386 #PW_T3400 #ops #DTWall # OPS PSS console
opsl09 #RHEL 6WS i386 #PW_T3400 #ops #DTWall # OPS CR Program Deputy
opsla0 #RHEL 4WS i386 #PE_2850 #ops #None # OPS Linux Alarms Server
opsla1 #RHEL 6WS i386 #PE_1950 #ops #caPutLog # OPS Linux Alarms Server
opsld1 #RHEL 6WS i386 #PW_390 #ops #None # OPS CR Display Machine
opslf1 #RHEL 6WS i386 #PW_T3400 #ops #None # Fishbowl Workstation 85/104
opslf2 #RHEL 6WS i386 #PW_T3400 #ops #None # Fishbowl Workstation 85/104
opslf3 #RHEL 6WS i386 #PW_T3400 #ops #None # Fishbowl Workstation 85/104
opslm #HP-UX #B2600 #ops #Apache2 # MCC rack
opsns2 #RHEL 4WS i386 #PE_1425 #ops #CADirServ # CA Nameserver DEV
opspsselog #RHEL 4WS i386 #PW_390 #sas #None # OPS PSS Elog computer
opsrv #HP-UX #B2600 #ops #None #
opss00 #SunOS 5.10 #V210 #ops #None # OPS CSUE Compile Host
opsweb #RHEL 6WS i386 #PE_1950 #ops #Apache2 MatlabLM # OPS WebServer
8:30 - Shutdown Equipment Room File Servers (manual shutdown)
csmfs #SunOS 5.10 #V240 #csm #ELogLoader # CSM FileServer
devfs #SunOS 5.10 #V240 #dev #ELogLoader DHCPD # DEV FileServer
eesfs #SunOS 5.10 #V240 #ees #ELogLoader # EES fileserver
felfs #SunOS 5.10 #V240 #fel #ELogLoader DHCPD # FEL fileserver
itsfs #SunOS 5.10 #V240 #its #ELogLoader DHCPD # ITS fileserver
opsfs #SunOS 5.10 #V240 #ops #ELogLoader DHCPD # OPS FileServer
---------
Recovery:
---------
1/ Recover File Servers
2/ Recover Database and Mya Systems
3/ Recover Equipment Room Systems in order of criticality
- gateways/CA nameserver
- webservers
- login nodes
- monitoring systems
- backup systems
4/ Recover Control Room Systems
5/ Recover Remaining Workstations affected by outage.
--
+-------------------------+
| Anthony Cuffe |
| voice : 757 269-6213 |
| e-mail : cuffe at jlab.org |
+-------------------------+
More information about the Ace
mailing list