[BTeam] Fw: C100 Fault Summary Report
Jay Benesch
benesch at jlab.org
Thu Aug 27 08:23:26 EDT 2020
________________________________________
From: Tom Powers <powers at jlab.org>
Sent: Wednesday, August 26, 2020 5:33 PM
To: Adam Carpenter; Anna Shabalina Solopova; Christopher Tennant; Lasitha Vidyaratne; Clyde Mounts; Jay Benesch; Rahman, Md Monibor; Lester Richardson; Mike McCaughan; HyeKyoung Park; Shukui Zhang; Matthew Bickley
Subject: Re: C100 Fault Summary Report
Here is my analysis for more or less the same time period. Midnight 19 Aug to 2PM on 26 Aug.
Notable observations:
2L26-8 got turned down from 8 to 6 MV/m on the 23rd and seems to be behaving much better.
2L25 started having microphonics issues yesterday. Anna and I talked this morning and she mentioned 30 Hz which is present, and generally has been for a long time, but the trips all are full of 10 Hz (full string mode) vibrations. Cavity 6 was always the first to go so it may pay to turn it down a little and see if it helps. That being said it will may just shift trips to to another cavity. This cryomodule is one of the first three C100s and does not have the improved tuner pivot plate. It really needs to have waveguide dampers installed as well as something done on the tuner stacks during the long down. The following three coincidences occurred. 2L24 and 2L25 had microphonic trips within 1 second of each other at 8:16 on 26Aug, 2L25 and 2L26 hand similar coincident trips at 15:04 on 21Aug and at 06:21 on 25Aug.
1L24-6 started having 100ms Quenches (again) which are generally considered to be an end group quench. This problem has been coming and going at this operating gradient since last fall. It trips a lot for a few days then gets better for a week then starts tripping again. It should help a lot if it were turned down 0.5 MV/m.
0L04-1 has an odd trip that I have not figured out yet. What ever it is it is always the same and is not associated with a beam line vacuum outburst or anything else that I can see in the archiver.
The QNCH fault should be bypassed everywhere. There is a flaw in the algorithm which was identified at least 18 months ago. I have no idea how to check to see where it is masked and where it is not masked.
The data file is attached.
Tom
[cid:part1.8788AC58.E38D6F34 at jlab.org]
[cid:part2.329AFF13.4D5DF1DA at jlab.org]
[cid:part3.E47D0EC6.EE5A62AA at jlab.org]
[cid:part4.24D99B8F.E0D7C550 at jlab.org]
On 8/26/2020 6:10 AM, adamc at jlab.org<mailto:adamc at jlab.org> wrote:
Labeled Fault Summary
This report only consider labeled faults. Faults are only labeled if they pass basic validation checks. These checks may vary over time, but the two goals are roughly the following:
* The trip is "real" and did not occur during recovery from a previous trip (e.g., not in SEL mode).
* The trip's data acquisition is suitable for the model to process it.
Start: 2020-08-19 06:00:00
End: 2020-08-26 06:00:00
Report Links
Summary Report<https://accweb.acc.jlab.org/wfbrowser/reports/rf-label-summary?begin=2020-08-19+06:00:00&end=2020-08-26+06:00:00&timeline=separate&isLabeled=true&conf=0.0&confOp=>&location=0L04&location=1L07&location=1L22&location=1L23&location=1L24&location=1L25&location=1L26&location=2L22&location=2L23&location=2L24&location=2L25&location=2L26&heatmap=zone>
Faults By Zone
Zone Labeled Unlabeled Total
0L04 0 30 30
1L07 0 7 7
1L22 5 14 19
1L23 13 25 38
1L24 39 35 74
1L25 24 23 47
1L26 3 1 4
2L22 9 3 12
2L23 5 1 6
2L24 1 2 3
2L25 28 68 96
2L26 66 22 88
All 193 231 424
Labeled Faults By Zone
zone count fault_conf_mean fault_conf_std cav_conf_mean cav_conf_std
0L04 0 NaN NaN NaN NaN
1L07 0 NaN NaN NaN NaN
1L22 5 0.38 0.20 0.41 0.17
1L23 13 0.44 0.12 0.40 0.10
1L24 39 0.28 0.09 0.29 0.10
1L25 24 0.41 0.12 0.44 0.09
1L26 3 0.42 0.13 0.42 0.13
2L22 9 0.30 0.06 0.28 0.10
2L23 5 0.37 0.05 0.34 0.09
2L24 1 0.23 NaN 0.34 NaN
2L25 28 0.26 0.06 0.25 0.06
2L26 66 0.32 0.05 0.32 0.09
Faults By Cavity and Fault Type
zone cavity-label fault-label count fault_conf_mean fault_conf_std cav_conf_mean cav_conf_std
1L22 4 Microphonics 2 0.36 0.16 0.33 0.01
1L22 5 Microphonics 1 0.23 NaN 0.26 NaN
1L22 5 Quench_3ms 1 0.25 NaN 0.45 NaN
1L22 multiple Multi Cav turn off 1 0.69 NaN 0.69 NaN
1L23 1 Quench_3ms 5 0.39 0.02 0.39 0.02
1L23 3 Single Cav Turn off 4 0.54 0.07 0.43 0.04
1L23 4 Controls Fault 1 0.22 NaN 0.30 NaN
1L23 6 Single Cav Turn off 1 0.48 NaN 0.20 NaN
1L23 multiple Multi Cav turn off 2 0.48 0.23 0.48 0.23
1L24 1 Quench_3ms 1 0.19 NaN 0.34 NaN
1L24 1 Single Cav Turn off 1 0.27 NaN 0.23 NaN
1L24 3 Microphonics 2 0.27 0.03 0.32 0.02
1L24 4 Controls Fault 1 0.27 NaN 0.27 NaN
1L24 4 Microphonics 3 0.25 0.01 0.33 0.03
1L24 4 Single Cav Turn off 1 0.36 NaN 0.37 NaN
1L24 6 Controls Fault 8 0.24 0.03 0.23 0.03
1L24 6 Quench_100ms 2 0.28 0.06 0.36 0.05
1L24 6 Single Cav Turn off 14 0.25 0.02 0.26 0.04
1L24 8 E_Quench 5 0.33 0.03 0.30 0.01
1L24 multiple Multi Cav turn off 1 0.78 NaN 0.78 NaN
1L25 1 E_Quench 2 0.23 0.01 0.32 0.02
1L25 4 Single Cav Turn off 2 0.27 0.01 0.34 0.01
1L25 8 Single Cav Turn off 6 0.32 0.05 0.39 0.04
1L25 multiple Multi Cav turn off 14 0.50 0.07 0.50 0.07
1L26 4 Single Cav Turn off 1 0.33 NaN 0.33 NaN
1L26 multiple Multi Cav turn off 2 0.47 0.14 0.47 0.14
2L22 4 Microphonics 3 0.33 0.04 0.37 0.04
2L22 6 Single Cav Turn off 2 0.25 0.06 0.19 0.06
2L22 7 Single Cav Turn off 2 0.30 0.01 0.16 0.01
2L22 8 Microphonics 1 0.24 NaN 0.37 NaN
2L22 8 Single Cav Turn off 1 0.40 NaN 0.37 NaN
2L23 4 Microphonics 2 0.32 0.01 0.38 0.04
2L23 6 Single Cav Turn off 1 0.42 NaN 0.18 NaN
2L23 8 Microphonics 1 0.38 NaN 0.36 NaN
2L23 multiple Multi Cav turn off 1 0.40 NaN 0.40 NaN
2L24 4 Quench_3ms 1 0.23 NaN 0.34 NaN
2L25 3 Single Cav Turn off 1 0.30 NaN 0.28 NaN
2L25 4 Controls Fault 5 0.24 0.03 0.23 0.03
2L25 4 Microphonics 1 0.32 NaN 0.26 NaN
2L25 4 Single Cav Turn off 1 0.23 NaN 0.28 NaN
2L25 6 Controls Fault 1 0.20 NaN 0.21 NaN
2L25 6 Microphonics 3 0.24 0.03 0.24 0.03
2L25 8 Controls Fault 8 0.24 0.03 0.23 0.03
2L25 8 Microphonics 6 0.28 0.04 0.26 0.04
2L25 multiple Multi Cav turn off 2 0.38 0.17 0.38 0.17
2L26 1 Quench_3ms 1 0.27 NaN 0.41 NaN
2L26 2 Single Cav Turn off 19 0.36 0.05 0.30 0.04
2L26 4 Controls Fault 11 0.32 0.05 0.22 0.03
2L26 4 Microphonics 2 0.30 0.04 0.34 0.06
2L26 4 Single Cav Turn off 1 0.25 NaN 0.30 NaN
2L26 5 Controls Fault 4 0.32 0.02 0.23 0.10
2L26 6 Controls Fault 5 0.26 0.05 0.25 0.04
2L26 6 Single Cav Turn off 1 0.29 NaN 0.26 NaN
2L26 8 E_Quench 19 0.30 0.03 0.42 0.04
2L26 8 Single Cav Turn off 3 0.36 0.07 0.31 0.11
-------------- next part --------------
A non-text attachment was scrubbed...
Name: omjnainkfcjcchci.png
Type: image/png
Size: 30371 bytes
Desc: omjnainkfcjcchci.png
URL: <https://mailman.jlab.org/pipermail/bteam/attachments/20200827/f2d0f583/attachment-0004.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: hiogghbikjdmjmce.png
Type: image/png
Size: 51234 bytes
Desc: hiogghbikjdmjmce.png
URL: <https://mailman.jlab.org/pipermail/bteam/attachments/20200827/f2d0f583/attachment-0005.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: gjjlkjocmpjmklfo.png
Type: image/png
Size: 32253 bytes
Desc: gjjlkjocmpjmklfo.png
URL: <https://mailman.jlab.org/pipermail/bteam/attachments/20200827/f2d0f583/attachment-0006.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: fjlojndoekdihbdk.png
Type: image/png
Size: 40057 bytes
Desc: fjlojndoekdihbdk.png
URL: <https://mailman.jlab.org/pipermail/bteam/attachments/20200827/f2d0f583/attachment-0007.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: Faults_C100_Summer2020 8_19 to 8_26.xlsx
Type: application/vnd.openxmlformats-officedocument.spreadsheetml.sheet
Size: 860360 bytes
Desc: Faults_C100_Summer2020 8_19 to 8_26.xlsx
URL: <https://mailman.jlab.org/pipermail/bteam/attachments/20200827/f2d0f583/attachment-0001.xlsx>
More information about the BTeam
mailing list