<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
</head>
<body>
<tt>Hi Aaron,<br>
<br>
<br>
thanks for the clarifications, the situation is clearer to me now.
Speaking of the first issue, it is quite clear that its random
values are related to the EPICS world (ie our EPOC IOC or the
EPICS client) because with GECO you only have no random values.
This is what I expected because our SY4527 and GECO are widely
used by all our customers and it has never happened that GECO /
SY4527 showed (or Sy4527) random values (especially for VSet /
Iset).<br>
<br>
In our test with EPICS and A7030TM we didn't find the problem, we
used your .opi files (Pablo sent them to me months ago) and
CSS-Studio to run them, the version we used was "cs-studio-4.5.0 -
win32.win32.x86_64 ". In out tests we inserted a register on the
EPICS IOC input and a register on the SY4527 input to check if
everything that arrived in the IOC input arrived equally in the
SY4527 input. We did not see random changes and everything was
fine (every in were correctly converted in output to SY4527), but
we noticed that some commands executed in the GUI did not arrive
in the IOC input (therefore inside the SY4527).<br>
<br>
I think the only way to solve the first point is that we have to
be able to reproduce the problem here, otherwise it is like
finding a "needle in a haystack". If the problem occurs without
load, we should identify the minimum number of cards showing the
problem. We used the latest firmware version in our Sy4527 but I
think this is the minor problem because we don't update the IOC in
the latest versions, so unless you're running a very old firmware
version, it shouldn't be a problem.<br>
<br>
I don't know if our version of cs-studio is the lastest or if it
is the same you are using, I think we should be aligned to
everything so we can reproduce all your tests and have the same
results, so please give me more details as you can, I would like
to understand and fix this issue as soon as possible (a set
parameter that change randomly is a severe bug that I don't want
to afflict our product!)<br>
<br>
<br>
Concerning the second issue, I'm quite convinced that it is an
hardware problem, so now I pass the load info you gave ne to my
colleagues and we we start our investigation. I have just a
question, when you loose a board, you sayd you need to reboot the
mainframe, have you tried to remove and re-inserte the board that
is lost by the GECO? If not, can you try? Our Sy4527 support live
insertion so this test gives us a good information on what is
happening and where.<br>
<br>
<br>
Best Regards,<br>
Alberto</tt><br>
<tt><span class="tlid-translation translation" lang="en"><span
title="" class=""></span></span></tt>
<p><br>
</p>
<div class="moz-cite-prefix">Il 27/01/2020 23:17, Aaron Brown ha
scritto:<br>
</div>
<blockquote type="cite"
cite="mid:BL0PR0901MB4579732479C0BDE19943F88EC10B0@BL0PR0901MB4579.namprd09.prod.outlook.com">
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
<style type="text/css" style="display:none;"> P {margin-top:0;margin-bottom:0;} </style>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif;
font-size: 12pt; color: rgb(0, 0, 0); background-color: rgb(255,
255, 255);">
<p style="margin: 0in 0in 8pt; line-height: 107%; font-size:
11pt; font-family: "Calibri", sans-serif">
Greetings Alberto,</p>
<p style="margin: 0in 0in 8pt; line-height: 107%; font-size:
11pt; font-family: "Calibri", sans-serif">
Thank you for getting back to us so quickly. As you saw in the
meeting minutes, GECO 2020 seems to be working well when the
EPICS service is disabled and there is no load connected to
any of the modules.</p>
<p style="margin: 0in 0in 8pt; line-height: 107%; font-size:
11pt; font-family: "Calibri", sans-serif">
A couple of points of clarification: </p>
<ul style="margin-bottom: 0in">
<li>The first issue, the random parameter changes, has only
been noticed when the EPICS service is enabled and no load
connected. As of this moment, we have not yet tested any of
the modules with the EPICS service enabled
<i>and</i> the load connected. </li>
<li>The second issue, the board disconnection, has been
observed when there is a load is connected to a module.
Additionally, the board that loses connection is not
necessarily the board that has the load connected. A couple
of times it was just a random board populated in the crate.</li>
</ul>
<br>
<p style="margin: 0in 0in 8pt; line-height: 107%; font-size:
11pt; font-family: "Calibri", sans-serif">
So, to the first issue, we would like to use the same EPICS
service that you use in order to rule out any issues with our
EPICS service.</p>
<p style="margin: 0in 0in 8pt; line-height: 107%; font-size:
11pt; font-family: "Calibri", sans-serif">
And to the second issue, the load we are using is 2 M<span
style="mso-bidi-font-family:
Calibri;mso-bidi-theme-font:minor-latin">Ω (mega-ohms) on
each of the 36 channels. For the board disconnection issue,
we were using only GECO 2020 to control and monitor the
boards. We are currently running additional tests with the
load connected and using only GECO 2020 to control and
monitor. I will let you know if we observe similar issues.</span></p>
<p style="margin: 0in 0in 8pt; line-height: 107%; font-size:
11pt; font-family: "Calibri", sans-serif">
<span style="mso-bidi-font-family:Calibri;mso-bidi-theme-font:
minor-latin">Also, are you able to tell us if we have all of
the most current firmware versions (for the crate CPU,
modules, and HiVoCS)?</span></p>
<p style="margin: 0in 0in 8pt; line-height: 107%; font-size:
11pt; font-family: "Calibri", sans-serif">
<span style="mso-bidi-font-family:Calibri;mso-bidi-theme-font:
minor-latin">I hope this is a little clearer than the
report. If you have any additional questions or concerns
please do not hesitate to email us.</span></p>
<p style="margin: 0in 0in 8pt; line-height: 107%; font-size:
11pt; font-family: "Calibri", sans-serif">
<o:p> </o:p></p>
<p style="margin: 0in 0in 8pt; line-height: 107%; font-size:
11pt; font-family: "Calibri", sans-serif">
<o:p>Warm Regards,</o:p></p>
<p style="margin: 0in 0in 8pt; line-height: 107%; font-size:
11pt; font-family: "Calibri", sans-serif">
<o:p>Aaron Brown<br>
</o:p></p>
</div>
<hr style="display:inline-block;width:98%" tabindex="-1">
<div id="divRplyFwdMsg" dir="ltr"><font style="font-size:11pt"
face="Calibri, sans-serif" color="#000000"><b>From:</b>
Alberto Lucchesi <a class="moz-txt-link-rfc2396E" href="mailto:a.lucchesi@caen.it"><a.lucchesi@caen.it></a><br>
<b>Sent:</b> Monday, January 27, 2020 9:40 AM<br>
<b>To:</b> Aaron Brown <a class="moz-txt-link-rfc2396E" href="mailto:ambrown@jlab.org"><ambrown@jlab.org></a>; dsg-hallc
controls <a class="moz-txt-link-rfc2396E" href="mailto:dsg-hallc_controls@jlab.org"><dsg-hallc_controls@jlab.org></a><br>
<b>Cc:</b> Greg Kibilko <a class="moz-txt-link-rfc2396E" href="mailto:greg@setechsales.com"><greg@setechsales.com></a>; Gianni
Di Maio <a class="moz-txt-link-rfc2396E" href="mailto:g.dimaio@caen.it"><g.dimaio@caen.it></a>; Nicola Paoli
<a class="moz-txt-link-rfc2396E" href="mailto:n.paoli@caen.it"><n.paoli@caen.it></a><br>
<b>Subject:</b> [EXTERNAL] Re: CAEN JLAB - EPICS control</font>
<div> </div>
</div>
<div><tt>Hello Aaron,<br>
<br>
<br>
I read your report and I'm happy that the new firmware fix the
latency issue, we verified it in our setup but we were waiting
for your feedback that was the most important.<br>
<br>
Obviously I'm sorry that you have other issues, unfortunately
we were not able to reproduce in our tests this is the main
reason why we already don't fix them<br>
<br>
I identified two main issues, the first is the random
parameter change, the second is the board disconnection.<br>
<br>
If I well understood both issues happens only when a load is
connected to a module and probably this is the reason why in
our tests we didn't reproduce the issues.<br>
<br>
I think we have to use the same load on our (to tell the truth
is yours) A7030TN to see the issue, so can you give us details
about the load?<br>
I noticed that from your first test (i.e. GECO and board
without load) that doesn't have problems and the one that have
issues (random parameters) two, let's say, "variables" are
changed, one was adding the load and the second the use of the
EPICS service. I would ask you if you could repeat the tests
(to see if random setting happens) connecting the load but
disabling the EPCIS service. This is very useful for us to
understand if the issue is on the firmware boards (because of
the load) or in the EPICS service. We'll do the same test here
but we need to know details about the load so if you for you
is not a problem to do this test it will speed-up our job.<br>
<br>
I wouldn't face the second issue because maybe it is related
to the first and in any case I prefer to put our effort to fix
one issue at a time.<br>
<br>
<br>
Best Regards,<br>
Alberto<br>
</tt>
<p><br>
</p>
<div class="x_moz-cite-prefix">Il 24/01/2020 15:27, Greg Kibilko
ha scritto:<br>
</div>
<blockquote type="cite"><font face="Times New Roman">Hello Aaron
and Everyone from DSG,<br>
<br>
Aaron, thank you again for providing us with the very clear
and concise report. In speaking with CAEN, I think the for
efficient way to resolve these issues is to simply put the
CAEN engineers and the DSG group on the same page by way of
this email.<br>
<br>
CAEN has received your notes regarding the status of EPICS
client control of the SY4527 mainframes and will provide a
very complete response to you via this email string. We
realize how critical this issue is and very much look
forward to working together with you to resolve it!<br>
<br>
Kind regards,<br>
Greg<br>
</font>
<div class="x_moz-forward-container"><br>
<br>
-------- Forwarded Message --------
<table class="x_moz-email-headers-table" cellspacing="0"
cellpadding="0" border="0">
<tbody>
<tr>
<th valign="BASELINE" nowrap="nowrap" align="RIGHT">Subject:
</th>
<td>CAEN Meeting Minutes</td>
</tr>
<tr>
<th valign="BASELINE" nowrap="nowrap" align="RIGHT">Date:
</th>
<td>Tue, 21 Jan 2020 20:38:14 +0000</td>
</tr>
<tr>
<th valign="BASELINE" nowrap="nowrap" align="RIGHT">From:
</th>
<td>Aaron Brown <a class="x_moz-txt-link-rfc2396E"
href="mailto:ambrown@jlab.org"
moz-do-not-send="true">
<ambrown@jlab.org></a></td>
</tr>
<tr>
<th valign="BASELINE" nowrap="nowrap" align="RIGHT">To:
</th>
<td>dsg-hallc controls <a
class="x_moz-txt-link-rfc2396E"
href="mailto:dsg-hallc_controls@jlab.org"
moz-do-not-send="true">
<dsg-hallc_controls@jlab.org></a>, Greg
Kibilko <a class="x_moz-txt-link-rfc2396E"
href="mailto:greg@setechsales.com"
moz-do-not-send="true">
<greg@setechsales.com></a></td>
</tr>
</tbody>
</table>
<br>
<br>
<style type="text/css" style="display:none">
<!--
p
{margin-top:0;
margin-bottom:0}
-->
</style>
<div>Good Afternoon All,</div>
<div><br>
</div>
<div>Attached please find the minutes from this afternoon's
meeting DSG had with Greg Kibilko.</div>
<div><br>
</div>
<div>Best regards,</div>
<div>Aaron Brown<br>
</div>
</div>
<br>
<div class="x_moz-signature">-- <br>
<b>Greg Kibilko</b><br>
<b>SETS - SE Technical Sales, Inc.</b><br>
112 Tyra Lane<br>
Townville, SC 29689<br>
P: (864) 356-2606<br>
<a
href="https://urldefense.proofpoint.com/v2/url?u=http-3A__www.caen.it_csite&d=DwMF-g&c=CJqEzB1piLOyyvZjb8YUQw&r=TkJUDpm1-rWCci4nhe47nw&m=0U_8C8X0PiElHY1_bwPkZamIHWd0fwv99Sbq6EJWomA&s=rzAhntsX7MJi7HGP_XcfB4YWvK5zE9wxq7wcO_fMY7o&e="
moz-do-not-send="true">CAEN Products</a><br>
<a
href="https://urldefense.proofpoint.com/v2/url?u=https-3A__caensys.com_products-2Dand-2Dsolutions_&d=DwMF-g&c=CJqEzB1piLOyyvZjb8YUQw&r=TkJUDpm1-rWCci4nhe47nw&m=0U_8C8X0PiElHY1_bwPkZamIHWd0fwv99Sbq6EJWomA&s=8igntKsub01EcgFNsD_kBWTpcl_SIp-jpAEREm3WsCs&e="
moz-do-not-send="true">CAEN SyS Products & Solutions</a><br>
<a
href="https://urldefense.proofpoint.com/v2/url?u=http-3A__www.ioxos.ch&d=DwMF-g&c=CJqEzB1piLOyyvZjb8YUQw&r=TkJUDpm1-rWCci4nhe47nw&m=0U_8C8X0PiElHY1_bwPkZamIHWd0fwv99Sbq6EJWomA&s=rrOQr7Z4dY4vEHgH8tMtFPutqpG7iOGkik3jO-0shNc&e="
moz-do-not-send="true">IOxOs Products</a><br>
</div>
</blockquote>
</div>
</blockquote>
</body>
</html>