<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=Windows-1252">
</head>
<body>
<div>
<div dir="ltr">reinjection chicane? </div>
</div>
<div id="ms-outlook-mobile-body-separator-line" dir="auto"><br>
</div>
<div id="ms-outlook-mobile-signature">Get <a href="https://aka.ms/o0ukef">Outlook for iOS</a></div>
<hr style="display:inline-block;width:98%" tabindex="-1">
<div id="divRplyFwdMsg" dir="ltr"><font face="Calibri, sans-serif" style="font-size:11pt" color="#000000"><b>From:</b> acg <acg-bounces@jlab.org> on behalf of Michele Joyce via acg <acg@jlab.org><br>
<b>Sent:</b> Sunday, May 18, 2025 1:28:37 PM<br>
<b>To:</b> Claire Jones <rebeccaj@jlab.org>; Gary Croke <gcroke@jlab.org>; Gary Croke via acg <acg@jlab.org><br>
<b>Subject:</b> Re: [acg] Machine instability and oscillations</font>
<div> </div>
</div>
<div>
<div>
<div dir="ltr">Thanks for the info.</div>
</div>
<div id="x_ms-outlook-mobile-body-separator-line" dir="auto"><br>
</div>
<div id="x_ms-outlook-mobile-signature">Get <a href="https://aka.ms/o0ukef">Outlook for iOS</a></div>
<hr tabindex="-1" style="display:inline-block; width:98%">
<div id="x_divRplyFwdMsg" dir="ltr"><font face="Calibri, sans-serif" color="#000000" style="font-size:11pt"><b>From:</b> Claire Jones <rebeccaj@jlab.org><br>
<b>Sent:</b> Sunday, May 18, 2025 1:26:51 PM<br>
<b>To:</b> Gary Croke <gcroke@jlab.org>; Gary Croke via acg <acg@jlab.org>; Michele Joyce <erb@jlab.org><br>
<b>Subject:</b> Re: Machine instability and oscillations</font>
<div> </div>
</div>
<style type="text/css" style="display:none">
<!--
p
{margin-top:0;
margin-bottom:0}
-->
</style>
<div dir="ltr">
<div style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
I haven't been following super closely but useful information:</div>
<div style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<br>
</div>
<div style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
The oscillation starts at 0R09 (with beam to 1R, orbit locks off, west arc box supplies off) and seems to pick up intensity in the recombiner after one pass. I don't think they've tested pass by pass to see if the intensity increases with
<i>every </i>pass.</div>
<div style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
They <i>may </i>have seen the oscillation on the 4D line, which crosses/shares vacuum with the recombiner, but that may be a red herring.</div>
<div id="x_x_appendonsend"></div>
<hr tabindex="-1" style="display:inline-block; width:98%">
<div id="x_x_divRplyFwdMsg" dir="ltr"><font face="Calibri, sans-serif" color="#000000" style="font-size:11pt"><b>From:</b> acg <acg-bounces@jlab.org> on behalf of Michele Joyce via acg <acg@jlab.org><br>
<b>Sent:</b> Sunday, May 18, 2025 12:48 PM<br>
<b>To:</b> Gary Croke <gcroke@jlab.org>; Gary Croke via acg <acg@jlab.org><br>
<b>Subject:</b> Re: [acg] Machine instability and oscillations</font>
<div> </div>
</div>
<div>
<div>
<div dir="ltr">We changed BPMS for the lock in the West Arcs….could that be an issue? </div>
</div>
<div id="x_x_x_ms-outlook-mobile-body-separator-line" dir="auto"><br>
</div>
<div id="x_x_x_ms-outlook-mobile-signature">Get <a href="https://aka.ms/o0ukef">Outlook for iOS</a></div>
<hr tabindex="-1" style="display:inline-block; width:98%">
<div id="x_x_x_divRplyFwdMsg" dir="ltr"><font face="Calibri, sans-serif" color="#000000" style="font-size:11pt"><b>From:</b> acg <acg-bounces@jlab.org> on behalf of Gary Croke via acg <acg@jlab.org><br>
<b>Sent:</b> Sunday, May 18, 2025 12:15:53 PM<br>
<b>To:</b> Gary Croke via acg <acg@jlab.org><br>
<b>Subject:</b> Re: [acg] Machine instability and oscillations</font>
<div> </div>
</div>
<style type="text/css" style="display:none">
<!--
p
{margin-top:0;
margin-bottom:0}
-->
</style>
<div dir="ltr">
<div class="x_x_x_x_elementToProof" style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
Hi All,</div>
<div class="x_x_x_x_elementToProof" style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<br>
</div>
<div class="x_x_x_x_elementToProof" style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
I hope everyone has had a nice weekend. It seems Ops is still struggling to find the source of machine instability with a roughly 80 second period. Some seem particularly paranoid about control system processes (a few examples copied below). I'm dubious,
but to perform our due diligence in support of Ops, please think carefully about systems and applications you are involved with, and whether there is anything, functioning correctly or misbehaving, that could contribute.</div>
<div class="x_x_x_x_elementToProof" style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<br>
</div>
<div class="x_x_x_x_elementToProof" style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
Thank you,</div>
<div class="x_x_x_x_elementToProof" style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<br>
</div>
<div class="x_x_x_x_elementToProof" style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
Gary</div>
<div class="x_x_x_x_elementToProof" style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<br>
</div>
<div class="x_x_x_x_elementToProof" style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<br>
</div>
<div class="x_x_x_x_elementToProof" style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<br>
</div>
<div class="x_x_x_x_elementToProof" style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<br>
</div>
<div class="x_x_x_x_elementToProof" style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<br>
</div>
<div class="x_x_x_x_elementToProof" style="text-align:left; text-indent:0px; background-color:rgb(255,255,255); margin:0px; font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(12,100,192)">
Hi Gary,</div>
<div style="text-align:left; text-indent:0px; background-color:rgb(255,255,255); margin:0px; font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(12,100,192)">
<br>
</div>
<div style="text-align:left; text-indent:0px; background-color:rgb(255,255,255); margin:0px; font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(12,100,192)">
Thanks. Maybe you are doing this but I am not asking you to look for oscillations in the archived data. Rather, search all applications and processes (all controls) that has ~80 s scan rate, PID loop, update rate, etc, similar to the example I sent you.</div>
<div style="text-align:left; text-indent:0px; background-color:rgb(255,255,255); margin:0px; font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(12,100,192)">
<br>
</div>
<div style="text-align:left; text-indent:0px; background-color:rgb(255,255,255); margin:0px; font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(12,100,192)">
It is enough to have the name of these, if any. Then we will take it from there.</div>
<div style="text-align:left; text-indent:0px; background-color:rgb(255,255,255); margin:0px; font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(12,100,192)">
<br>
</div>
<div style="text-align:left; text-indent:0px; background-color:rgb(255,255,255); margin:0px; font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(12,100,192)">
Yours,</div>
<div style="text-align:left; text-indent:0px; background-color:rgb(255,255,255); margin:0px; font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(12,100,192)">
Riad.</div>
<div class="x_x_x_x_elementToProof" style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<br>
</div>
<div class="x_x_x_x_elementToProof" style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<br>
</div>
<div id="x_x_x_x_appendonsend"></div>
<div style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(200,38,19)">
-------- Forwarded Message --------<br>
Subject: 80-second oscillation<br>
Date: Sat, 17 May 2025 09:53:06 -0400<br>
From: Stepan Stepanyan <stepanya@jlab.org><br>
To: Jay Benesch <benesch@jlab.org><br>
<br>
Hi Jey,<br>
<br>
I’m far from having any understanding of the cause of this 80-second<br>
oscillation, but I remember some reported issues with slow control<br>
response during startup. So, I wonder if communication delays—possibly<br>
in the feedback loops of some controls in IOCs—could be contributing to<br>
this unusual frequency.<br>
<br>
Regards,<br>
Stepan</div>
<div><br>
</div>
<div><br>
</div>
<div style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(12,136,42)">
Hi folks,<br>
<br>
While listening to the 8 AM meeting this morning and thinking about<br>
the 80s orbit oscillation, one question kept sticking with me: why<br>
don't orbit locks take out this oscillation? The PID locks should<br>
be fast enough to -- it is a slow oscillation. We could add PID<br>
locks in e.g. 1S/1E/2E that should take out most of them before<br>
the coupling in 2R.<br>
<br>
Is it feasible that orbit locks somewhere (in the injector?) are part<br>
of the problem? A mis-setting of some orbit lock PID setup might<br>
create something like this slow oscillation.<br>
<br>
In the larger picture, is there a list somewhere of what is being<br>
checked so we can systematically check off ideas and items? Maybe<br>
a thread in the BTLOG would be useful. Right now it seems that the<br>
information is in people's heads so some ideas are being revisited:<br>
<br>
<a href="https://logbooks.jlab.org/entry/4376279" id="OWA28377fe9-fbdc-8c8f-e04b-ed677fe3c69b" class="x_x_x_x_OWAAutoLink" title="https://logbooks.jlab.org/entry/4376279" data-linkindex="0" data-auth="NotApplicable" style="color:rgb(12,136,42); margin:0px; text-align:left">https://logbooks.jlab.org/entry/4376279</a><br>
<br>
Maybe the orbit lock idea is a revisit too and they were already checked.<br>
<br>
-Todd</div>
<div><br>
</div>
<div><br>
</div>
<div><br>
</div>
<div><br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<br>
</div>
<hr style="display:inline-block; width:98%">
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<b>From:</b> acg <acg-bounces@jlab.org> on behalf of Gary Croke via acg <acg@jlab.org><br>
<b>Sent:</b> Thursday, May 15, 2025 9:50 AM<br>
<b>To:</b> Gary Croke via acg <acg@jlab.org><br>
<b>Subject:</b> [acg] Machine instability and oscillations </div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<br>
</div>
<div style="direction:ltr; font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
Hi All,</div>
<div style="direction:ltr; font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<br>
</div>
<div style="direction:ltr; font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
Ops have been trying to track down the source of two different periodic instabilities in the machine. They believe they've tracked a 13 second one to 0L03 cavity 8. However there seems to also be an 80 second oscillation that they are still hunting.</div>
<div style="direction:ltr; font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<br>
</div>
<div style="direction:ltr; font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
If you can think of anything that could be the source of this, either in software or the systems you are familiar with, please bring it forward.</div>
<div style="direction:ltr; font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<br>
</div>
<div style="direction:ltr; font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
Thank you,</div>
<div style="direction:ltr; font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<br>
</div>
<div style="direction:ltr; font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
Gary</div>
<div style="direction:ltr; font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<br>
</div>
</div>
</div>
</div>
</div>
</body>
</html>