[Dsg-hallb_magnets] Solenoid - Sequence of pre-power up I and C checks

Mon Aug 28 19:33:34 EDT 2017

Ruben, 

Item 2 refers to QD #2 channels. 

Pablo 

From: "Ruben Fair" <rfair at jlab.org> 
To: "Pablo Campero" <campero at jlab.org> 
Cc: "dsg-hallb magnets" <dsg-hallb_magnets at jlab.org> 
Sent: Monday, August 28, 2017 5:57:04 PM 
Subject: Re: [Dsg-hallb_magnets] Solenoid - Sequence of pre-power up I and C checks 

Thank you Pablo and team. 

For the fast dump, if item 1 is QD#1 what is item 2? 

Regards 

Ruben 

On Aug 28, 2017, at 4:56 PM, Pablo Campero < campero at jlab.org > wrote: 

Hi Ruben, 

This afternoon was completed all interlock checks that can be completed before the Solenoid is cooled down. 
The following is a summary of the checks performed during the end of the last week (8/24/ and 8/25/2017) and today: 

Fast Dump: 
1.QD # 1 Channels interlocks. 
2.QD # 1 Channels interlocks. 
3. Test PLC Software comparators - 2nd threshold. 
4. Vapor Cooled Leads - Voltage drop. 
5. Load Cell 2nd threshold interlocks (Recently added in the checklist). 

Controlled Ramp Down 
6. Test PLC Software comparators - 1st thresholds. 
7.Load cell 1st thresholds interlocks. 

Two interlock checks were removed from the P005 procedure because this interlocks are not used for the Solenoid: 
1.EPICS Watchdog - Controlled ramp down (Not heartbeat signal available from EPICS to the PLC) 
2. Test ESR interlock - Warming alarm (No signal wired to the Solenoid controls, signal is only wired to the the Torus control) 

Completed 28/30 Interlock checks, 2 remaining checks to complete the P005 procedure: 
1.System Cable Interlock (Fast Dump) 
2.Liquid Helium Level - Lead reservoir (Fast Dump) 

Regards, 
Pablo 

From: "Ruben Fair" < rfair at jlab.org > 
To: "Pablo Campero" < campero at jlab.org > 
Cc: "dsg-hallb magnets" < dsg-hallb_magnets at jlab.org > 
Sent: Wednesday, August 23, 2017 5:27:08 PM 
Subject: Re: [Dsg-hallb_magnets] Solenoid - Sequence of pre-power up I and C checks 

Thank you very much Pablo and team. 

Probir will be starting on the QD tuning tomorrow. Then you will be able to complete the comparator checks. 

Have a good evening all. 

Regards 

Ruben 

On Aug 23, 2017, at 5:19 PM, Pablo Campero < campero at jlab.org > wrote: 

BQ_BEGIN

Hello Ruben, 

The following are the interlock checks completed today: 

Fast Dump: 
1.Magnet reservoir helium liquid level - For the test used dummy threshold in the hardware device, there is not helium probes connected right now. 

Controlled Ramp Down 
2.Test Fast DAQ communication Error 
3.Vacuum Interlock 
4.Helium pressure - Lead reservoir 
5.Helium pressure - Magnet reservoir 
6.Lead reservoir LHe liquid level lower (LL8620DP and LL8620SC) - Test performed with dummy values (Forced in PLC controller) since there is no helium level at this time. 
7.Magnet reservoir LHe liquid level lower (LL8670DP) - Used dummy values (Forced in PLC) since there is not helium. 
8. Magnet reservoir LHe liquid level lower (LL8670SC) - Used dummy values (Forced in PLC) since there is not helium probes connected right now. 
9. MPS Over current software interlock. 

Warnings alarms 
10. Tested PLC Rampdown failure warning. 
11. EPICS watchdog fail - Not used at this time, maybe we will need to removed from the procedure (further discussion required) 
12. ESR (End Station Refrigerator) signal - Not used in the solenoid controls, appears only as a Torus input signal (further discussion required). 

The remain check outs to complete with the 'P005 procedure' are related with the cryogenics interlocks, load cells, system cable and Quench detection units (Software and hardware comparators). 
Interlock/Warning checks that were found as not used or removed will need further discussion during the next meeting that will be held on 8/25/2017. 

Best Regards, 
Pablo 

From: "Pablo Campero" < campero at jlab.org > 
To: "Amrit Yegneswaran" < yeg at jlab.org > 
Cc: "dsg-hallb magnets" < dsg-hallb_magnets at jlab.org > 
Sent: Tuesday, August 22, 2017 9:57:30 PM 
Subject: Re: [Dsg-hallb_magnets] Solenoid - Sequence of pre-power up I and C checks 

Hello Amrit, 
the percentage of the completed tasks for the Pre-Power up interlock checks is 34 %. 
There is a total of 32 check, and so far 11 were completed. 

Best Regards, 
Pablo 

From: "Amrit Yegneswaran" < yeg at jlab.org > 
To: "Pablo Campero" < campero at jlab.org > 
Cc: "Ruben Fair" < rfair at jlab.org >, "dsg-hallb magnets" < dsg-hallb_magnets at jlab.org > 
Sent: Tuesday, August 22, 2017 8:09:42 PM 
Subject: Re: [Dsg-hallb_magnets] Solenoid - Sequence of pre-power up I and C checks 

thanks for the update pablo. 
what percentage of the interlock tests have been complete? 

From: "Pablo Campero" < campero at jlab.org > 
To: "Ruben Fair" < rfair at jlab.org > 
Cc: "dsg-hallb magnets" < dsg-hallb_magnets at jlab.org > 
Sent: Tuesday, August 22, 2017 7:54:48 PM 
Subject: Re: [Dsg-hallb_magnets] Solenoid - Sequence of pre-power up I and C checks 

Hi Ruben, 

Here is an updated of the Pre-Power up interlock checks completed today: 

Fast Dump interlocks 

1. Test Hard-wire Interlock Voltage Tap cable. 
2. Splices over temperature 
3.Vapor Cooled lead over temperature 

Controlled Ramp Down 

4. PLC Fast Dump Button (MPS EPICS screen) 
5. PLC hard coded current limit. 
6. UPS_ Battery low signal. 
7. .Vapor Cooled lead over temperature. 
8.Water Cooled lead over temperature. 

Checks will continue tomorrow. 

Regards, 
Pablo 

From: "Ruben Fair" < rfair at jlab.org > 
To: "Pablo Campero" < campero at jlab.org > 
Cc: "dsg-hallb magnets" < dsg-hallb_magnets at jlab.org > 
Sent: Monday, August 21, 2017 6:15:29 PM 
Subject: Re: [Dsg-hallb_magnets] Solenoid - Sequence of pre-power up I and C checks 

Thank you very much for the update Pablo. 

Have a good evening 

Regards 

Ruben 

On Aug 21, 2017, at 5:59 PM, Pablo Campero < campero at jlab.org > wrote: 

BQ_BEGIN

Hello Ruben, 

This afternoon was completed three interlock checks: 

1. Watchdog fail (Hardware) 
2. Supply Current lead water flow 
3. Return Current lead water flow 

So far all of them are worked without any problem. 

To proceed with the full test and clear all the fault/interlocks trips was required: 

1. Add a jumper for the Quench Detection #1 (channel 1 and 2 tripped at this time). Wire jumper connected at the SOE relay terminal block. 
2. Disable relay outputs for in cryocon 1 and cryocon 2. (Actual configured thresholds are: 8.5 and 10 K ) 
3. Turn on current lead water flows (Return and supply). 
4. Turn on liquid levels hardware controllers for Lead and Magnet reservoir. 
5. Verify wiring connection for the PSU (connected only Control power 110 V external power supply). 

After completed with the mentioned checkouts the PSU was turned off (pushed E-bottom), liquid levels hardware controllers was turned off, and also the s upply water valve for the current leads was closed. 
It will be need to turn on and enable all of them tomorrow to clear out all faults and continue with the test. 

Pablo 

From: "Ruben Fair" < rfair at jlab.org > 
To: "Pablo Campero Rojas" < campero at jlab.org > 
Cc: "dsg-hallb magnets" < dsg-hallb_magnets at jlab.org >, "Mark Todd" < mtodd at jlab.org >, "Sarin Philip" < philip at jlab.org >, "Onish Kumar" < okumar at jlab.org > 
Sent: Monday, August 21, 2017 2:40:03 PM 
Subject: Re: [Dsg-hallb_magnets] Solenoid - Sequence of pre-power up I and C checks 

Thank you. 

As discussed previously, you will have to 'jumper out' the interlocks which we cannot use right now - liquid levels for example. 

Regards 

Ruben 

From: "Pablo Campero Rojas" < campero at jlab.org > 
To: "dsg-hallb magnets" < dsg-hallb_magnets at jlab.org > 
Cc: "Mark Todd" < mtodd at jlab.org >, "Sarin Philip" < philip at jlab.org >, "Onish Kumar" < okumar at jlab.org > 
Sent: Monday, August 21, 2017 2:28:45 PM 
Subject: Re: [Dsg-hallb_magnets] Solenoid - Sequence of pre-power up I and C checks 

Ruben, 

We will start the checks this afternoon. 
With regards to Onish's email, first action is check and make sure that all interlocks faults are clear, that includes the hardware interlocks (liquid levels, cryocon units, lead water flow), this hardware interlocks also affects the Quench Det. status on the PS control module (status in remote control board) and the MPS D ump switch engages. 
I verified PLC side and it seems to be fine, there is no 'PLC Fast Dump interlocks' at this time. PLC relay outputs associate with the 'Fast dump interlocks' are clear. 

Best Regards, 
Pablo 

From: "Ruben Fair" < rfair at jlab.org > 
To: "Onish Kumar" < okumar at jlab.org > 
Cc: "Brian Eng" < beng at jlab.org >, "Pablo Campero Rojas" < campero at jlab.org >, "Probir Ghoshal" < ghoshal at jlab.org >, "Sarin Philip" < philip at jlab.org >, "Mark Todd" < mtodd at jlab.org > 
Sent: Monday, August 21, 2017 11:44:43 AM 
Subject: Re: [Dsg-hallb_magnets] Solenoid - Sequence of pre-power up I and C checks 

Thank you Onish and Mark. 

Pablo, Brian, 

Can you check all this out this afternoon - see Onish's note below. 

Regards 

Ruben 

From: "Onish Kumar" < okumar at jlab.org > 
To: "Ruben Fair" < rfair at jlab.org > 
Cc: "Brian Eng" < beng at jlab.org >, "Pablo Campero Rojas" < campero at jlab.org >, "Probir Ghoshal" < ghoshal at jlab.org >, "Sarin Philip" < philip at jlab.org >, "Mark Todd" < mtodd at jlab.org > 
Sent: Monday, August 21, 2017 11:41:07 AM 
Subject: Re: [Dsg-hallb_magnets] Solenoid - Sequence of pre-power up I and C checks 

Hi Ruben, 

We have finished our checklist today (see attachment). While working on our checklist we found that QD PLC inputs are not making contact. I think Pablo and Brian should check on their side if QD PLC relay's are good (Below is the list of interlock to check, PLC side). To make sure something is not wrong on our side we check the wiring and did continuity tests, and the test passed, hence I suspect issue on the PLC side. We did all of our test by taking connector X15 off and putting jumpers between pins A & H, and between pins J & K. 

List of interlock to check: 
1. Quench Det. Fast Ramp Down 
2. Fast Dischange 
3. Energy Dump Status 
4. Control PLC status. 

Please note all the interlocks mentioned above are in series, so if any one of them is not making contact then they will show-up as Quench Det. (on the PS control module) and the Dump switch engages. Let us know if you have any questions or concerns. 

Thanks, 
Onish 

-- 
Onish Kumar 
DC Power Systems Engineer 
Jefferson Lab, EES-DCP 
Email: okumar at jlab.org 
Phone: (757) 269-7852 

From: "Ruben Fair" < rfair at jlab.org > 
To: "Brian Eng" < beng at jlab.org > 
Cc: "Pablo Campero" < campero at jlab.org >, "Onish Kumar" < okumar at jlab.org >, "Probir Ghoshal" < ghoshal at jlab.org >, "Sarin Philip" < philip at jlab.org > 
Sent: Thursday, August 17, 2017 12:06:40 PM 
Subject: Re: [Dsg-hallb_magnets] Solenoid - Sequence of pre-power up I and C checks 

Ok 

Onish - we have to wait till you complete your work 

Ruben 

> On Aug 17, 2017, at 11:15 AM, Brian Eng < beng at jlab.org > wrote: 
> 
> Ruben, 
> 
> Pablo and I just went through the interlock checkout and I don't think there's any we can start early with. 
> 
> We either need the MPS to be operational (in order to have some current or to close the fast dump contactor) or to have all the interlocks cleared as the first step. 
> 
> Unless we change the procedure to not require all the interlocks to be cleared at the very least we'll have to wait for DC power to finish their MPS work before starting. 
> 
>> On Aug 17, 2017, at 9:34 AM, Pablo Campero < campero at jlab.org > wrote: 
>> 
>> Hello Ruben, 
>> 
>> Brian and I will start with the Pre-Power Up checks today. 
>> To complete with the full test for most of the 'Fast Dump- Hardware Interlock' checkouts is required to turn on the PSU to verified correct function of the dump switch and remote resets on the PSU. 
>> Will someone will be available to turn on the PSU after the replacement of the connector in the remote crate and re-tune of the QD units? 
>> 
>> Best Regards, 
>> Pablo 
>> 
>> From: "Ruben Fair" < rfair at jlab.org > 
>> To: "Onish Kumar" < okumar at jlab.org >, "Probir Ghoshal" < ghoshal at jlab.org >, "Pablo Campero Rojas" < campero at jlab.org >, "Brian Eng" < beng at jlab.org >, "Nicholas Sandoval" < sandoval at jlab.org > 
>> Cc: "George Biallas" < biallas at jlab.org >, "Scot Spiegel" < spiegel at jlab.org > 
>> Sent: Thursday, August 17, 2017 7:40:46 AM 
>> Subject: Solenoid - Sequence of pre-power up I and C checks 
>> 
>> Gentlemen, 
>> 
>> Some of the I and C checks for pre-power up will have to be carried out in sequence (e.g. anything to do with the QD units): 
>> 
>> 1. Replace connector on PSU remote control crate + complete both PSU check sheets - Onish (to be completed by Friday 18th Aug) 
>> 2. Re-tune QD units - Probir (by Thursday 24th Aug) - as Probir is out Mon-Wed next week) 
>> 3. Checks (including interlock checks) on QD units (by Friday 25th Aug) - Pablo/Brian/Nick - though of course you can make a start on the other checks 
>> 
>> As our cooling rate has increased (we are presently cooling at about 10 K/day), we won't have as much time as we initially thought so we should start as soon as possible. 
>> 
>> Regards 
>> 
>> Ruben 

_______________________________________________ 
Dsg-hallb_magnets mailing list 
Dsg-hallb_magnets at jlab.org 
https://mailman.jlab.org/mailman/listinfo/dsg-hallb_magnets 

_______________________________________________ 
Dsg-hallb_magnets mailing list 
Dsg-hallb_magnets at jlab.org 
https://mailman.jlab.org/mailman/listinfo/dsg-hallb_magnets 

_______________________________________________ 
Dsg-hallb_magnets mailing list 
Dsg-hallb_magnets at jlab.org 
https://mailman.jlab.org/mailman/listinfo/dsg-hallb_magnets 

BQ_END

BQ_END

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://mailman.jlab.org/pipermail/dsg-hallb_magnets/attachments/20170828/e8d46cd8/attachment-0001.html>