[acs] iocin1 -- down, should I reboot?

[Gary Croke]

Kyle, Scott, thanks.

I commented out the old bunch length application, which had been re-enabled I don't know when.  I didn't think to check the restoration afterwards, sorry.


From: Scott Higgins <higgins at jlab.org>
Sent: Monday, July 15, 2024 9:55 AM
To: Daniel Moser <moser at jlab.org>; Gary Croke <gcroke at jlab.org>; acs at jlab.org; Kyle Hesse <hesse at jlab.org>
Subject: Re: iocin1 -- down, should I reboot?

Hi Gary,
Was the buncher commented out as part of your troubleshooting of iocin1 on Friday?
Scott
________________________________
From: acs <acs-bounces at jlab.org<mailto:acs-bounces at jlab.org>> on behalf of Kyle Hesse via acs <acs at jlab.org<mailto:acs at jlab.org>>
Sent: Monday, July 15, 2024 9:53 AM
To: Daniel Moser <moser at jlab.org<mailto:moser at jlab.org>>; Gary Croke <gcroke at jlab.org<mailto:gcroke at jlab.org>>; acs at jlab.org<mailto:acs at jlab.org> <acs at jlab.org<mailto:acs at jlab.org>>
Subject: Re: [acs] iocin1 -- down, should I reboot?

The buncher database and initialization are commented out in the startup file.

To support restoring this IOC without loading the buncher portion, I have disabled that portion of the Restore Set. To accommodate the laser testing, the buncher restore can be undone at a later date by the system owner.

Please conduct another restore: myRestore -ioc -R iocin1 -t '2024-07-12 11:35:20'
________________________________
From: Daniel Moser <moser at jlab.org<mailto:moser at jlab.org>>
Sent: Monday, July 15, 2024 9:42 AM
To: Kyle Hesse <hesse at jlab.org<mailto:hesse at jlab.org>>; Gary Croke <gcroke at jlab.org<mailto:gcroke at jlab.org>>; acs at jlab.org<mailto:acs at jlab.org> <acs at jlab.org<mailto:acs at jlab.org>>
Subject: Re: iocin1 -- down, should I reboot?

Restored.... thrice. First time from subopsl11, not on ops network. SSH'ed into opsl01 and did so from GUI w timestamp @2024-07-12 12:39. Did so again using command line prompt.

PVs related to buncher causing the failure?

Daniel
________________________________
From: Kyle Hesse <hesse at jlab.org<mailto:hesse at jlab.org>>
Sent: Monday, July 15, 2024 9:37 AM
To: Daniel Moser <moser at jlab.org<mailto:moser at jlab.org>>; Gary Croke <gcroke at jlab.org<mailto:gcroke at jlab.org>>; acs at jlab.org<mailto:acs at jlab.org> <acs at jlab.org<mailto:acs at jlab.org>>
Subject: Re: iocin1 -- down, should I reboot?

Thanks. I'm looking into the restore now.

Daniel, could you please complete a restore? There are PVs that require Crew Chief permission.

myRestore -ioc -R iocin1 -t '2024-07-12 11:35:20'
________________________________
From: Daniel Moser <moser at jlab.org<mailto:moser at jlab.org>>
Sent: Monday, July 15, 2024 9:27 AM
To: Kyle Hesse <hesse at jlab.org<mailto:hesse at jlab.org>>; Gary Croke <gcroke at jlab.org<mailto:gcroke at jlab.org>>; acs at jlab.org<mailto:acs at jlab.org> <acs at jlab.org<mailto:acs at jlab.org>>
Subject: Re: iocin1 -- down, should I reboot?

IOC's been hard rebooted. Auto-restore failed. As I was walking back to B87to send this appears another restore was attempted, not sure if auto or user, but also did not succeed.


________________________________
From: Kyle Hesse <hesse at jlab.org<mailto:hesse at jlab.org>>
Sent: Monday, July 15, 2024 9:18 AM
To: Daniel Moser <moser at jlab.org<mailto:moser at jlab.org>>; Gary Croke <gcroke at jlab.org<mailto:gcroke at jlab.org>>; acs at jlab.org<mailto:acs at jlab.org> <acs at jlab.org<mailto:acs at jlab.org>>
Subject: Re: iocin1 -- down, should I reboot?

Thanks Daniel. Looks like this URL can be used to toggle the Main Power.

http://vmeiocin1.acc.jlab.org/
________________________________
From: Daniel Moser <moser at jlab.org<mailto:moser at jlab.org>>
Sent: Monday, July 15, 2024 9:16 AM
To: Kyle Hesse <hesse at jlab.org<mailto:hesse at jlab.org>>; Gary Croke <gcroke at jlab.org<mailto:gcroke at jlab.org>>; acs at jlab.org<mailto:acs at jlab.org> <acs at jlab.org<mailto:acs at jlab.org>>
Subject: Re: iocin1 -- down, should I reboot?

Kyle,

I'll go give it a hard reboot right now.

Daniel
________________________________
From: Kyle Hesse <hesse at jlab.org<mailto:hesse at jlab.org>>
Sent: Monday, July 15, 2024 9:14 AM
To: Gary Croke <gcroke at jlab.org<mailto:gcroke at jlab.org>>; Daniel Moser <moser at jlab.org<mailto:moser at jlab.org>>; acs at jlab.org<mailto:acs at jlab.org> <acs at jlab.org<mailto:acs at jlab.org>>
Subject: Re: iocin1 -- down, should I reboot?

Hi Gary,

Looks like the IOC needs to be rebooted, it is unreachable via ping or the console. This IOC does have a Wiener Crate. Perhaps it can be rebooted remotely.

Kyle

[cid:image001.png at 01DAD69F.123BE430]
________________________________
From: acs <acs-bounces at jlab.org<mailto:acs-bounces at jlab.org>> on behalf of Gary Croke via acs <acs at jlab.org<mailto:acs at jlab.org>>
Sent: Monday, July 15, 2024 9:03 AM
To: acs at jlab.org<mailto:acs at jlab.org> <acs at jlab.org<mailto:acs at jlab.org>>
Subject: [acs] FW: iocin1 -- down, should I reboot?


Folks, is anyone available to take a look at iocin1 this morning?  I don't know any more than Daniel reports below at the moment.



From: Daniel Moser <moser at jlab.org<mailto:moser at jlab.org>>
Sent: Monday, July 15, 2024 8:43 AM
To: Gary Croke <gcroke at jlab.org<mailto:gcroke at jlab.org>>
Subject: iocin1 -- down, should I reboot?



Hey Gary,



Just got out of the CIS morning meeting. I noticed this morning that iocin1 appears down. True? Can it be rebooted and restored at this time? From CIS's meeting, sounds like they will want to continue with laser alignment, needing the laser controls and IOC, once the PSS shutters are removed. I'm on-site and can assist with recovering iocin1 as needed, just let me know.



Daniel
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://mailman.jlab.org/pipermail/acs/attachments/20240715/155910b4/attachment-0001.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image001.png
Type: image/png
Size: 143153 bytes
Desc: image001.png
URL: <https://mailman.jlab.org/pipermail/acs/attachments/20240715/155910b4/attachment-0001.png>