<div dir="ltr">Thanks Nick<div><br></div><div>Ok I guess I have my work cut out for me then</div><div>I will report what I get</div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Mon, Jun 15, 2020 at 11:58 PM Nikolay Markov <<a href="mailto:markov@jlab.org">markov@jlab.org</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<div dir="ltr">
<div style="font-family:Calibri,Arial,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0);background-color:rgb(255,255,255)">
2 runs (5700, 5893) are here:</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0);background-color:rgb(255,255,255)">
/volatile/clas12/rg-k/production/pass0/v1_1.1.42/dst/recon/</div>
<div id="gmail-m_8782971388302658329appendonsend"></div>
<hr style="display:inline-block;width:98%">
<div id="gmail-m_8782971388302658329divRplyFwdMsg" dir="ltr"><font face="Calibri, sans-serif" style="font-size:11pt" color="#000000"><b>From:</b> Raffaella De Vita <<a href="mailto:Raffaella.Devita@ge.infn.it" target="_blank">Raffaella.Devita@ge.infn.it</a>><br>
<b>Sent:</b> Monday, June 15, 2020 5:55 PM<br>
<b>To:</b> Francois-Xavier Girod-Gard <<a href="mailto:fxgirod@jlab.org" target="_blank">fxgirod@jlab.org</a>><br>
<b>Cc:</b> Raffaella De Vita <<a href="mailto:Raffaella.Devita@ge.infn.it" target="_blank">Raffaella.Devita@ge.infn.it</a>>; Nikolay Markov <<a href="mailto:markov@jlab.org" target="_blank">markov@jlab.org</a>>; <a href="mailto:clas12_rgk@jlab.org" target="_blank">clas12_rgk@jlab.org</a> <<a href="mailto:clas12_rgk@jlab.org" target="_blank">clas12_rgk@jlab.org</a>>; Nathan Baltzell <<a href="mailto:baltzell@jlab.org" target="_blank">baltzell@jlab.org</a>><br>
<b>Subject:</b> Re: [EXTERNAL] Re: Trains examples</font>
<div> </div>
</div>
<div style="overflow-wrap: break-word;">Dear FX,
<div>I would assume that 10% of a full run would be sufficient to get a first estimate, i.e. ~25 DSTs files.</div>
<div>I would be good to run on RG-K DSTs: maybe Nick can point to the 4 runs that were cooked for the review.</div>
<div>Best regards,</div>
<div><span style="white-space:pre-wrap"></span>Raffaella<br>
<div><br>
<blockquote type="cite">
<div>On 15 Jun 2020, at 17:49, Francois-Xavier Girod <<a href="mailto:fxgirod@jlab.org" target="_blank">fxgirod@jlab.org</a>> wrote:</div>
<br>
<div>
<div dir="ltr">Dear Raffaella
<div><br>
</div>
<div>Yes I realize now that we need the correct reduction factors, it is no problem I can run on the DSTs instead</div>
<div>This is the information I have on the file location</div>
/cache/clas12/rg-a/production/recon/fall2018/torus-1/pass1/v0/dst/recon/<br>
/cache/clas12/rg-a/production/recon/fall2018/torus-1/pass1/v0/dst/recon/
<div><br>
</div>
<div>Do you have a suggestion many files I will need to process to get an accurate reduction factor?</div>
<div><br>
</div>
<div>Best regards</div>
<div>FX</div>
</div>
<br>
<div>
<div dir="ltr">On Mon, Jun 15, 2020 at 11:37 PM Raffaella De Vita <<a href="mailto:Raffaella.Devita@ge.infn.it" target="_blank">Raffaella.Devita@ge.infn.it</a>> wrote:<br>
</div>
<blockquote style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<div>Dear FX,
<div>If you have time, could you run on DSTs as well? It would be helpful because the reduction factors can then be compared with what Nick had from the standard wagons.</div>
<div>Thanks,</div>
<div><span style="white-space:pre-wrap"></span>Raffaella</div>
<div><br>
<div><br>
<blockquote type="cite">
<div>On 15 Jun 2020, at 12:24, Francois-Xavier Girod <<a href="mailto:fxgirod@jlab.org" target="_blank">fxgirod@jlab.org</a>> wrote:</div>
<br>
<div>
<div dir="ltr">Dear all
<div><br>
</div>
<div>Here is a summary of the tests I performed with the new exclusive reaction wagons</div>
<div><br>
</div>
<div>All deep exclusive wagons have Q2 > 0.8 GeV^2 and W > 1.8 GeV</div>
<div><br>
</div>
<div>RGA OUT sample was skimmed starting from skim4 (already has the condition of one e in the FD)</div>
<div>CPU usage for the new wagons compared to JpsiTCS (on clara machines)</div>
<div>
<div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal;font-size:12px;line-height:normal;font-family:"Andale Mono";color:rgb(47,255,18);background-color:rgb(0,0,0)">
<span style="font-variant-ligatures:no-common-ligatures">2020-06-14 22:13:46.433: Benchmark results:</span></div>
<div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal;font-size:12px;line-height:normal;font-family:"Andale Mono";color:rgb(47,255,18);background-color:rgb(0,0,0)">
<span style="font-variant-ligatures:no-common-ligatures">2020-06-14 22:13:46.433:
<span> </span>READER <span> </span>210369933 events<span>
</span>total time = 72775.73 s<span> </span>average event time =<span>
</span>0.35 ms</span></div>
<div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal;font-size:12px;line-height:normal;font-family:"Andale Mono";color:rgb(47,255,18);background-color:rgb(0,0,0)">
<span style="font-variant-ligatures:no-common-ligatures">2020-06-14 22:13:46.434:
<span> </span>JPSITCS<span> </span>210369933 events<span>
</span>total time = 33937.10 s<span> </span>average event time =<span>
</span>0.16 ms</span></div>
<div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal;font-size:12px;line-height:normal;font-family:"Andale Mono";color:rgb(47,255,18);background-color:rgb(0,0,0)">
<span style="font-variant-ligatures:no-common-ligatures">2020-06-14 22:13:46.434:
<span> </span>DVCSWagon<span> </span>210369933 events<span>
</span>total time = 27440.98 s<span> </span>average event time =<span>
</span>0.13 ms</span></div>
<div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal;font-size:12px;line-height:normal;font-family:"Andale Mono";color:rgb(47,255,18);background-color:rgb(0,0,0)">
<span style="font-variant-ligatures:no-common-ligatures">2020-06-14 22:13:46.434:
<span> </span>DVPi0PWagon<span> </span>210369933 events<span>
</span>total time = 33836.22 s<span> </span>average event time =<span>
</span>0.16 ms</span></div>
<div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal;font-size:12px;line-height:normal;font-family:"Andale Mono";color:rgb(47,255,18);background-color:rgb(0,0,0)">
<span style="font-variant-ligatures:no-common-ligatures">2020-06-14 22:13:46.434:
<span> </span>DVPipPimPWag <span> </span>210369933 events<span>
</span>total time = 25329.07 s<span> </span>average event time =<span>
</span>0.12 ms</span></div>
<div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal;font-size:12px;line-height:normal;font-family:"Andale Mono";color:rgb(47,255,18);background-color:rgb(0,0,0)">
<span style="font-variant-ligatures:no-common-ligatures">2020-06-14 22:13:46.434:
<span> </span>DVPipPimPi0P <span> </span>210369933 events<span>
</span>total time = 25733.89 s<span> </span>average event time =<span>
</span>0.12 ms</span></div>
<div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal;font-size:12px;line-height:normal;font-family:"Andale Mono";color:rgb(47,255,18);background-color:rgb(0,0,0)">
<span style="font-variant-ligatures:no-common-ligatures">2020-06-14 22:13:46.434:
<span> </span>DVKpKmPWagon <span> </span>210369933 events<span>
</span>total time = 25776.63 s<span> </span>average event time =<span>
</span>0.12 ms</span></div>
<div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal;font-size:12px;line-height:normal;font-family:"Andale Mono";color:rgb(47,255,18);background-color:rgb(0,0,0)">
<span style="font-variant-ligatures:no-common-ligatures">2020-06-14 22:13:46.434:
<span> </span>WRITER <span> </span>210369933 events<span>
</span>total time = 17867.52 s<span> </span>average event time =<span>
</span>0.08 ms</span></div>
<div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal;font-size:12px;line-height:normal;font-family:"Andale Mono";color:rgb(47,255,18);background-color:rgb(0,0,0)">
<span style="font-variant-ligatures:no-common-ligatures">2020-06-14 22:13:46.435:
<span> </span>TOTAL<span> </span>210369933 events<span>
</span>total time = 262697.14 s<span> </span>average event time =<span>
</span>1.25 ms</span></div>
<div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal;font-size:12px;line-height:normal;font-family:"Andale Mono";color:rgb(47,255,18);background-color:rgb(0,0,0)">
<span style="font-variant-ligatures:no-common-ligatures">2020-06-14 22:13:46.435: Average processing time<span>
</span>=<span> </span>0.38 ms</span></div>
<div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal;font-size:12px;line-height:normal;font-family:"Andale Mono";color:rgb(47,255,18);background-color:rgb(0,0,0)">
<span style="font-variant-ligatures:no-common-ligatures">2020-06-14 22:13:46.435: Total processing time<span>
</span>= 80223.88 s</span></div>
<div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal;font-size:12px;line-height:normal;font-family:"Andale Mono";color:rgb(47,255,18);background-color:rgb(0,0,0)">
<span style="font-variant-ligatures:no-common-ligatures">2020-06-14 22:13:46.435: Total orchestrator time<span>
</span>= 80521.07 s</span></div>
<div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal;font-size:12px;line-height:normal;font-family:"Andale Mono";color:rgb(47,255,18);background-color:rgb(0,0,0)">
<span style="font-variant-ligatures:no-common-ligatures">2020-06-14 22:13:46.435: Processing is complete.</span></div>
</div>
<div><br>
</div>
Reduction factors over skim4:
<div>JpsiTCS size reduction factor ~ 225</div>
<div>DVCS ~ 342</div>
<div>DVPi0P ~ 373</div>
<div>DVPipPimP ~ 754</div>
<div>DVPipPimPi0P ~ 677<br>
<div>DVKpKmP ~ 2068</div>
<div><br>
<div>RGA IN sample was skimmed from skim8 (already has the condition of e in FD and one proton)<br>
<div>CPU usage<br>
<div>
<div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal;font-size:12px;line-height:normal;font-family:"Andale Mono";color:rgb(47,255,18);background-color:rgb(0,0,0)">
<span style="font-variant-ligatures:no-common-ligatures">2020-06-15 09:05:28.440: Benchmark results:</span></div>
<div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal;font-size:12px;line-height:normal;font-family:"Andale Mono";color:rgb(47,255,18);background-color:rgb(0,0,0)">
<span style="font-variant-ligatures:no-common-ligatures">2020-06-15 09:05:28.440:
<span> </span>READER <span> </span>16489802 events<span>
</span>total time =<span> </span>6310.92 s<span> </span>average event time =<span>
</span>0.38 ms</span></div>
<div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal;font-size:12px;line-height:normal;font-family:"Andale Mono";color:rgb(47,255,18);background-color:rgb(0,0,0)">
<span style="font-variant-ligatures:no-common-ligatures">2020-06-15 09:05:28.441:
<span> </span>JPSITCS<span> </span>16489802 events<span>
</span>total time =<span> </span>2612.12 s<span> </span>average event time =<span>
</span>0.16 ms</span></div>
<div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal;font-size:12px;line-height:normal;font-family:"Andale Mono";color:rgb(47,255,18);background-color:rgb(0,0,0)">
<span style="font-variant-ligatures:no-common-ligatures">2020-06-15 09:05:28.441:
<span> </span>DVCSWagon<span> </span>16489802 events<span>
</span>total time =<span> </span>2391.67 s<span> </span>average event time =<span>
</span>0.15 ms</span></div>
<div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal;font-size:12px;line-height:normal;font-family:"Andale Mono";color:rgb(47,255,18);background-color:rgb(0,0,0)">
<span style="font-variant-ligatures:no-common-ligatures">2020-06-15 09:05:28.441:
<span> </span>DVPi0PWagon<span> </span>16489802 events<span>
</span>total time =<span> </span>4054.14 s<span> </span>average event time =<span>
</span>0.25 ms</span></div>
<div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal;font-size:12px;line-height:normal;font-family:"Andale Mono";color:rgb(47,255,18);background-color:rgb(0,0,0)">
<span style="font-variant-ligatures:no-common-ligatures">2020-06-15 09:05:28.442:
<span> </span>DVPipPimPWag <span> </span>16489802 events<span>
</span>total time =<span> </span>2046.81 s<span> </span>average event time =<span>
</span>0.12 ms</span></div>
<div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal;font-size:12px;line-height:normal;font-family:"Andale Mono";color:rgb(47,255,18);background-color:rgb(0,0,0)">
<span style="font-variant-ligatures:no-common-ligatures">2020-06-15 09:05:28.442:
<span> </span>DVPipPimPi0P <span> </span>16489802 events<span>
</span>total time =<span> </span>2184.76 s<span> </span>average event time =<span>
</span>0.13 ms</span></div>
<div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal;font-size:12px;line-height:normal;font-family:"Andale Mono";color:rgb(47,255,18);background-color:rgb(0,0,0)">
<span style="font-variant-ligatures:no-common-ligatures">2020-06-15 09:05:28.442:
<span> </span>DVKpKmPWagon <span> </span>16489802 events<span>
</span>total time =<span> </span>1979.42 s<span> </span>average event time =<span>
</span>0.12 ms</span></div>
<div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal;font-size:12px;line-height:normal;font-family:"Andale Mono";color:rgb(47,255,18);background-color:rgb(0,0,0)">
<span style="font-variant-ligatures:no-common-ligatures">2020-06-15 09:05:28.442:
<span> </span>WRITER <span> </span>16489802 events<span>
</span>total time =<span> </span>1649.79 s<span> </span>average event time =<span>
</span>0.10 ms</span></div>
<div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal;font-size:12px;line-height:normal;font-family:"Andale Mono";color:rgb(47,255,18);background-color:rgb(0,0,0)">
<span style="font-variant-ligatures:no-common-ligatures">2020-06-15 09:05:28.442:
<span> </span>TOTAL<span> </span>16489802 events<span>
</span>total time = 23229.64 s<span> </span>average event time =<span>
</span>1.41 ms</span></div>
<div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal;font-size:12px;line-height:normal;font-family:"Andale Mono";color:rgb(47,255,18);background-color:rgb(0,0,0)">
<span style="font-variant-ligatures:no-common-ligatures">2020-06-15 09:05:28.442: Average processing time<span>
</span>=<span> </span>0.43 ms</span></div>
<div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal;font-size:12px;line-height:normal;font-family:"Andale Mono";color:rgb(47,255,18);background-color:rgb(0,0,0)">
<span style="font-variant-ligatures:no-common-ligatures">2020-06-15 09:05:28.442: Total processing time<span>
</span>= 7151.69 s</span></div>
<div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal;font-size:12px;line-height:normal;font-family:"Andale Mono";color:rgb(47,255,18);background-color:rgb(0,0,0)">
<span style="font-variant-ligatures:no-common-ligatures">2020-06-15 09:05:28.442: Total orchestrator time<span>
</span>= 7650.04 s</span></div>
<div style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal;font-size:12px;line-height:normal;font-family:"Andale Mono";color:rgb(47,255,18);background-color:rgb(0,0,0)">
<span style="font-variant-ligatures:no-common-ligatures">2020-06-15 09:05:28.443: Processing is complete.</span></div>
<div><br>
</div>
Reduction factors over skim8:
<div>JpsiTCS size reduction factor ~ 53</div>
<div>DVCS ~ 51</div>
<div>DVPi0P ~ 50</div>
<div>DVPipPimP ~ 66</div>
<div>DVPipPimPi0P ~ 55<br>
<div>DVKpKmP ~ 100</div>
<div><br>
</div>
<div>Best regards</div>
<div>FX</div>
<div><br>
<div></div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</blockquote>
</div>
<br>
</div>
</div>
</blockquote>
</div>
</div>
</blockquote>
</div>
<br>
</div>
</div>
</div>
</blockquote></div>