<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=Windows-1252">
<style type="text/css" style="display:none;"><!-- P {margin-top:0;margin-bottom:0;} --></style>
</head>
<body dir="ltr">
<div id="divtagdefaultwrapper" style="font-size:12pt;color:#000000;font-family:Calibri,Helvetica,sans-serif;" dir="ltr">
<p style="margin-top:0;margin-bottom:0">Hello Tongtong,</p>
<p style="margin-top:0;margin-bottom:0"><br>
</p>
<p style="margin-top:0;margin-bottom:0">Thanks for that clarification. I would suggest a review of the plots which we are creating. I note that there's already been an effort to resolve some duplications, but we might want to consider pruning some more histograms,
or reducing the binning of some of them.</p>
<p style="margin-top:0;margin-bottom:0"><br>
</p>
<p style="margin-top:0;margin-bottom:0">Norman</p>
<br>
<br>
<div style="color: rgb(0, 0, 0);">
<hr tabindex="-1" style="display:inline-block;width:98%">
<div id="divRplyFwdMsg" dir="ltr"><font color="#000000" face="Calibri, sans-serif" style="font-size:11pt"><b>From:</b> Hps-analysis <hps-analysis-bounces@jlab.org> on behalf of Tongtong Cao <tongtongcao1@gmail.com><br>
<b>Sent:</b> Monday, August 5, 2019 1:30 PM<br>
<b>To:</b> Graf, Norman A. <ngraf@slac.stanford.edu><br>
<b>Cc:</b> hps-analysis@jlab.org <hps-analysis@jlab.org>; hps-software <hps-software@slac.stanford.edu><br>
<b>Subject:</b> Re: [Hps-analysis] Requests for data cooking</font>
<div> </div>
</div>
<div style="word-wrap:break-word; line-break:after-white-space">Hello Norman,
<div><br>
</div>
<div>Thanks for the note.</div>
<div>We always set memory request as 4G, and it works well.</div>
<div><br>
</div>
<div>The problem is not due to memory. Instead, there is a maximum heap limit for JVM of the batch machine. According to tests, the limit is about 2G.</div>
<div>If we can not increase the limit, we need to be careful about the heap usage when making codes.</div>
<div><br>
</div>
<div>Recently, we tried to add histograms into DQM for all different triggers. The heap usage is over the limit (2G). </div>
<div>So we have to temporarily shut down drivers for some triggers, and add them back after fixing the issue.</div>
<div><br>
</div>
<div>Best regards,</div>
<div>Tongtong</div>
<div><br>
</div>
<div>
<div>
<blockquote type="cite">
<div>On Aug 5, 2019, at 4:16 PM, Graf, Norman A. <<a class="OWAAutoLink" id="LPlnk437016" href="mailto:ngraf@slac.stanford.edu" previewremoved="true">ngraf@slac.stanford.edu</a>> wrote:</div>
<br class="x_Apple-interchange-newline">
<div>
<div id="x_divtagdefaultwrapper" style="font-style:normal; font-variant-caps:normal; font-weight:normal; letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none; font-size:12pt; font-family:Calibri,Helvetica,sans-serif" dir="ltr">
<div style="margin-top:0px; margin-bottom:0px">One thing to note is that job requests for large amounts of memory may restrict the available queues/machines the jobs will run on. Most likely not an issue at the moment, but something to watch out for.</div>
<div style="margin-top:0px; margin-bottom:0px"><br>
</div>
<div style="margin-top:0px; margin-bottom:0px">Norman</div>
<br>
<br>
<div style="">
<hr tabindex="-1" style="display:inline-block; width:633.078125px">
<div id="x_divRplyFwdMsg" dir="ltr"><font face="Calibri, sans-serif" style="font-size:11pt"><b>From:</b><span class="x_Apple-converted-space"> </span>Hps-analysis <<a class="OWAAutoLink" id="LPlnk5628" href="mailto:hps-analysis-bounces@jlab.org" previewremoved="true">hps-analysis-bounces@jlab.org</a>>
on behalf of Tongtong Cao <<a class="OWAAutoLink" id="LPlnk431621" href="mailto:tongtongcao1@gmail.com" previewremoved="true">tongtongcao1@gmail.com</a>><br>
<b>Sent:</b><span class="x_Apple-converted-space"> </span>Monday, August 5, 2019 11:41 AM<br>
<b>To:</b><span class="x_Apple-converted-space"> </span>Nathan Baltzell <<a class="OWAAutoLink" id="LPlnk906635" href="mailto:baltzell@jlab.org" previewremoved="true">baltzell@jlab.org</a>><br>
<b>Cc:</b><span class="x_Apple-converted-space"> </span><a class="OWAAutoLink" id="LPlnk342746" href="mailto:hps-analysis@jlab.org" previewremoved="true">hps-analysis@jlab.org</a><span class="x_Apple-converted-space"> </span><<a class="OWAAutoLink" id="LPlnk602797" href="mailto:hps-analysis@jlab.org" previewremoved="true">hps-analysis@jlab.org</a>>;
hps-software <<a class="OWAAutoLink" id="LPlnk584104" href="mailto:hps-software@slac.stanford.edu" previewremoved="true">hps-software@slac.stanford.edu</a>><br>
<b>Subject:</b><span class="x_Apple-converted-space"> </span>Re: [Hps-analysis] Requests for data cooking</font>
<div> </div>
</div>
<div class="x_BodyFragment"><font size="2"><span style="font-size:11pt">
<div class="x_PlainText">Hello Nathan,<br>
<br>
Thanks for the reminder.<br>
The memory request has been be specified as 4G. No problem for memory.<br>
<br>
-Tongtong<br>
<br>
<br>
> On Aug 5, 2019, at 1:49 PM, Nathan Baltzell <<a class="OWAAutoLink" id="LPlnk253585" href="mailto:baltzell@jlab.org" previewremoved="true">baltzell@jlab.org</a>> wrote:<br>
><span class="x_Apple-converted-space"> </span><br>
> Tongtong,<br>
><span class="x_Apple-converted-space"> </span><br>
> The memory request is (or at least should be) specified in your job submission setup.<br>
><span class="x_Apple-converted-space"> </span><br>
> -Nathan<br>
><span class="x_Apple-converted-space"> </span><br>
>> On Aug 5, 2019, at 12:20, Tongtong Cao <<a class="OWAAutoLink" id="LPlnk967730" href="mailto:tongtongcao1@gmail.com" previewremoved="true">tongtongcao1@gmail.com</a>> wrote:<br>
>><span class="x_Apple-converted-space"> </span><br>
>> Dear all,<br>
>><span class="x_Apple-converted-space"> </span><br>
>> Jobs for runs 10169 and 10170 triggered by hps_v10.cnf were submitted for cooking just now.<br>
>><span class="x_Apple-converted-space"> </span><br>
>> DQM histogram for runs 10136 and 10149, including separate plots for most of triggers, have been produced.<span class="x_Apple-converted-space"> </span><br>
>> You can browse them through<span class="x_Apple-converted-space"> </span><a class="x_OWAAutoLink" id="LPlnk404599" href="https://hpsweb.jlab.org/dqm/dqm.php" previewremoved="true">https://hpsweb.jlab.org/dqm/dqm.php</a><br>
>><span class="x_Apple-converted-space"> </span><br>
>> We will add plots for extra triggers if heap usage issue is fixed.<br>
>> There is a limit (seems ~2G) for the maximum heap size in the JLab batch machine. But the heap usage will be over the limit if too many DQM plots are included.<br>
>><span class="x_Apple-converted-space"> </span><br>
>> Best regards,<br>
>> Tongtong<br>
>><span class="x_Apple-converted-space"> </span><br>
>>> On Aug 2, 2019, at 12:53 PM, Tongtong Cao <<a class="OWAAutoLink" id="LPlnk680537" href="mailto:tongtongcao1@gmail.com" previewremoved="true">tongtongcao1@gmail.com</a>> wrote:<br>
>>><span class="x_Apple-converted-space"> </span><br>
>>> Dear all,<br>
>>><span class="x_Apple-converted-space"> </span><br>
>>> Jobs for runs 10136 and 10149 were submitted for cooking just now.<br>
>>><span class="x_Apple-converted-space"> </span><br>
>>> For DQM plots of cooked runs, you can browse through<span class="x_Apple-converted-space"> </span><a class="x_OWAAutoLink" id="LPlnk850266" href="https://hpsweb.jlab.org/dqm/dqm.php" previewremoved="true">https://hpsweb.jlab.org/dqm/dqm.php</a><br>
>>><span class="x_Apple-converted-space"> </span><br>
>>> Best regards,<br>
>>> Tongtong<br>
>>><span class="x_Apple-converted-space"> </span><br>
>>>> On Aug 1, 2019, at 11:04 AM, Tongtong Cao <<a class="OWAAutoLink" id="LPlnk516371" href="mailto:tongtongcao1@gmail.com" previewremoved="true">tongtongcao1@gmail.com</a>> wrote:<br>
>>>><span class="x_Apple-converted-space"> </span><br>
>>>> Dear all,<br>
>>>><span class="x_Apple-converted-space"> </span><br>
>>>> Since yesterday afternoon, we have been taking data with the trigger configuration of hps_v9_2.cnf<br>
>>>> Jobs for runs 10128, 10129 and 10130 were submitted for cooking just now.<span class="x_Apple-converted-space"> </span><br>
>>>><span class="x_Apple-converted-space"> </span><br>
>>>> Best regards,<br>
>>>> Tongtong<br>
>>>><span class="x_Apple-converted-space"> </span><br>
>>>>> On Jul 31, 2019, at 1:24 PM, Tongtong Cao <<a class="OWAAutoLink" id="LPlnk638407" href="mailto:tongtongcao1@gmail.com" previewremoved="true">tongtongcao1@gmail.com</a>> wrote:<br>
>>>>><span class="x_Apple-converted-space"> </span><br>
>>>>> Dear all,<br>
>>>>><span class="x_Apple-converted-space"> </span><br>
>>>>> Since yesterday afternoon, we have been taken runs triggered by various trigger configurations.<br>
>>>>> Jobs for runs 10096, 10097, 10101, 10103, 10104, 10115, 10117 and 10118 were submitted for cooking just now.<br>
>>>>><span class="x_Apple-converted-space"> </span><br>
>>>>> Run’s setup could be found at<span class="x_Apple-converted-space"> </span><a class="x_OWAAutoLink" id="LPlnk765592" href="https://urldefense.proofpoint.com/v2/url?u=https-3A__docs.google.com_spreadsheets_d_1Ru4weeIOqtcpebiXKxFGCbPXGWXZF-2DW2JAolHcpvIFU_edit-23gid-3D43855609&d=DwIFaQ&c=CJqEzB1piLOyyvZjb8YUQw&r=JaSEOiNc_6InrJmbYDvKU2tZqhhONpIkbyl_AUnkDSY&m=mgXu2Pooq94AeSMSPL4GcyXy44W-1STlfK_8v1NoCAw&s=mlQFbQT6g6VYshnHCe4XsxhIqaXSo4E5NnbzuhT5kV0&e=" previewremoved="true">https://urldefense.proofpoint.com/v2/url?u=https-3A__docs.google.com_spreadsheets_d_1Ru4weeIOqtcpebiXKxFGCbPXGWXZF-2DW2JAolHcpvIFU_edit-23gid-3D43855609&d=DwIFaQ&c=CJqEzB1piLOyyvZjb8YUQw&r=JaSEOiNc_6InrJmbYDvKU2tZqhhONpIkbyl_AUnkDSY&m=mgXu2Pooq94AeSMSPL4GcyXy44W-1STlfK_8v1NoCAw&s=mlQFbQT6g6VYshnHCe4XsxhIqaXSo4E5NnbzuhT5kV0&e=</a><span class="x_Apple-converted-space"> </span><br>
>>>>> Trigger configuration files could be found at /usr/clas12/release/1.4.0/parms/trigger/HPS/Run2019/ in the clondaq3 machine.<br>
>>>>><span class="x_Apple-converted-space"> </span><br>
>>>>> Best regards,<br>
>>>>> Tongtong<br>
>>>>><span class="x_Apple-converted-space"> </span><br>
>>>>>> On Jul 30, 2019, at 11:03 AM, Tongtong Cao <<a class="OWAAutoLink" id="LPlnk137746" href="mailto:tongtongcao1@gmail.com" previewremoved="true">tongtongcao1@gmail.com</a>> wrote:<br>
>>>>>><span class="x_Apple-converted-space"> </span><br>
>>>>>> Dear all,<br>
>>>>>><span class="x_Apple-converted-space"> </span><br>
>>>>>> More production runs with trigger hps_v9.cnf have been taken since yesterday.<br>
>>>>>> Jobs for runs 10084, 10085, 10089, 10090, 10091, and 10092 have been submitted for cooking.<br>
>>>>>><span class="x_Apple-converted-space"> </span><br>
>>>>>> As mentioned yesterday, DQM has been added into cooking processing.<br>
>>>>>> Cooking outputs are saved in /volatile/hallb/hps/data/run2019/ConcurrentCook<br>
>>>>>> Each run includes three folders to save outputs:<br>
>>>>>> 1) .slcio files from reconstruction is saved in /volatile/hallb/hps/data/run2019/ConcurrentCook/${run}/recon<br>
>>>>>> 2) .root files from DQM is saved in /volatile/hallb/hps/data/run2019/ConcurrentCook/${run}/dqm<br>
>>>>>> 3) .root files from<span class="x_Apple-converted-space"> </span><a class="OWAAutoLink" id="LPlnk976823" href="https://urldefense.proofpoint.com/v2/url?u=http-3A__make-5Froot.cc_&d=DwMFaQ&c=CJqEzB1piLOyyvZjb8YUQw&r=JaSEOiNc_6InrJmbYDvKU2tZqhhONpIkbyl_AUnkDSY&m=wlIGbnm_u-Rik4619akfx29iLxHVQbWtUhpdILBlxiE&s=0scit3XHBO3dH913Sy87tadZvocTJ4HuVgSAIrt-DS4&e=" previewremoved="true">Make_Root.cc</a><span class="x_Apple-converted-space"> </span>are
saved in /volatile/hallb/hps/data/run2019/ConcurrentCook/${run}/rootTree<br>
>>>>>> Additionally, log files are saved in /volatile/hallb/hps/data/run2019/ConcurrentCook/logs<br>
>>>>>><span class="x_Apple-converted-space"> </span><br>
>>>>>> Best regards,<br>
>>>>>> Tongtong<br>
>>>>>><span class="x_Apple-converted-space"> </span><br>
>>>>>>> On Jul 29, 2019, at 7:41 PM, Tongtong Cao <<a class="OWAAutoLink" id="LPlnk140369" href="mailto:tongtongcao1@gmail.com" previewremoved="true">tongtongcao1@gmail.com</a>> wrote:<br>
>>>>>>><span class="x_Apple-converted-space"> </span><br>
>>>>>>> /volatile/hallb/hps/data/run2019/ConcurrentCook/${run}/dqm<br>
>>>>>><span class="x_Apple-converted-space"> </span><br>
>>>>><span class="x_Apple-converted-space"> </span><br>
>>>><span class="x_Apple-converted-space"> </span><br>
>>><span class="x_Apple-converted-space"> </span><br>
>><span class="x_Apple-converted-space"> </span><br>
>> _______________________________________________<br>
>> Hps-analysis mailing list<br>
>><span class="x_Apple-converted-space"> </span><a class="OWAAutoLink" id="LPlnk12777" href="mailto:Hps-analysis@jlab.org" previewremoved="true">Hps-analysis@jlab.org</a><br>
>><span class="x_Apple-converted-space"> </span><a class="x_OWAAutoLink" id="LPlnk513860" href="https://mailman.jlab.org/mailman/listinfo/hps-analysis" previewremoved="true">https://mailman.jlab.org/mailman/listinfo/hps-analysis</a><br>
><span class="x_Apple-converted-space"> </span><br>
<br>
<br>
_______________________________________________<br>
Hps-analysis mailing list<br>
<a class="OWAAutoLink" id="LPlnk777289" href="mailto:Hps-analysis@jlab.org" previewremoved="true">Hps-analysis@jlab.org</a><br>
<a class="x_OWAAutoLink" id="LPlnk55258" href="https://mailman.jlab.org/mailman/listinfo/hps-analysis" previewremoved="true">https://mailman.jlab.org/mailman/listinfo/hps-analysis</a><br>
</div>
</span></font></div>
</div>
</div>
</div>
</blockquote>
</div>
<br>
</div>
</div>
</div>
</div>
</body>
</html>