<html><head><meta http-equiv="Content-Type" content="text/html; charset=utf-8"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class="">Hi Rafo,<div class=""><br class=""></div><div class="">I am confused.</div><div class="">In your file <span style="color: rgb(57, 200, 37); font-family: Menlo; font-size: 11px;" class="">mkdirs.sh</span>, the sub-folder “logs” is included besides “<span style="font-family: Menlo; font-size: 11px;" class=""><font color="#000000" class="">recon</font></span>” and “<span style="font-family: Menlo; font-size: 11px;" class=""><font color="#000000" class="">rootTree</font></span>".</div><div class="">So the sub-folder “logs” is created at the beginning of job running for each cooked run.</div><div class="">Actually, the sub-folder “logs” currently exists for each cooked run, but is empty. I think it confuses Norman at first.</div><div class=""><br class=""></div><div class="">Do you mean that a job still crashes even if a directory for log files is built at the beginning of job running?</div><div class=""><br class=""></div><div class="">Best regards,</div><div class="">Tongtong</div><div class=""><div><br class=""><blockquote type="cite" class=""><div class="">On Jul 22, 2019, at 7:50 PM, Rafayel Paremuzyan <<a href="mailto:rafopar@jlab.org" class="">rafopar@jlab.org</a>> wrote:</div><br class="Apple-interchange-newline"><div class="">
<meta http-equiv="Content-Type" content="text/html; charset=utf-8" class="">
<div text="#000000" bgcolor="#FFFFFF" class="">
Hi Tongtong,<br class="">
<br class="">
<blockquote type="cite" class="">
<div class=""><br class="">
</div>
<div class=""><font class="" face="Menlo"><span style="font-size: 11px;" class="">This bug in the job submission file will be fixed for future runs.</span></font></div>
</blockquote>
Please don't change that part of the code, it might brake job submission.<br class="">
<br class="">
Before starting the job, it checks if the directory for log files exists, and if not, it crashes without even staring the job.<br class="">
These directories are created inside the job, when job start.<br class="">
<br class="">
Instead it might be useful, to make another script that can move logs to appropriate directories, however
<br class="">
logs have Run and File number in the name, perhaps at least for now it is ok to leave it as it is now.<br class="">
<br class="">
Rafo<br class="">
<br class="">
<br class="">
<br class="">
<div class="moz-cite-prefix">On 7/22/19 5:59 PM, Tongtong Cao wrote:<br class="">
</div>
<blockquote type="cite" cite="mid:E60408A2-1F34-4D1C-A9F6-E55DDC2A7DE4@gmail.com" class="">
Hello Norman,
<div class=""><br class="">
</div>
<div class="">Thank you for the feedback.</div>
<div class="">Currently, all log files for all runs are in <span style="font-family: Menlo; font-size: 11px;" class="">/volatile/hallb/hps/data/run2019/ConcurrentCook/logs</span></div>
<div class=""><font class="" face="Menlo"><span style="font-size: 11px;" class="">I will let cook-processing be finished, and copy log files into the sub-folder “logs” each run.</span></font></div>
<div class=""><br class="">
</div>
<div class=""><font class="" face="Menlo"><span style="font-size: 11px;" class="">This bug in the job submission file will be fixed for future runs.</span></font></div>
<div class=""><font class="" face="Menlo"><span style="font-size: 11px;" class=""><br class="">
</span></font></div>
<div class=""><font class="" face="Menlo"><span style="font-size: 11px;" class="">Best regards,</span></font></div>
<div class=""><font class="" face="Menlo"><span style="font-size: 11px;" class="">Tongtong<br class="">
</span></font>
<div class=""><br class="">
<blockquote type="cite" class="">
<div class="">On Jul 22, 2019, at 4:57 PM, Graf, Norman A. <<a href="mailto:ngraf@slac.stanford.edu" class="" moz-do-not-send="true">ngraf@slac.stanford.edu</a>> wrote:</div>
<br class="Apple-interchange-newline">
<div class="">
<div id="divtagdefaultwrapper" dir="ltr" style="font-style: normal; font-variant-caps: normal;
font-weight: normal; letter-spacing: normal; text-align:
start; text-indent: 0px; text-transform: none;
white-space: normal; word-spacing: 0px;
-webkit-text-stroke-width: 0px; text-decoration: none;
font-size: 12pt; font-family: Calibri, Helvetica,
sans-serif;" class="">
<div style="margin-top: 0px; margin-bottom: 0px;" class="">Hello Tongtong,</div>
<div style="margin-top: 0px; margin-bottom: 0px;" class=""><br class="">
</div>
<div style="margin-top: 0px; margin-bottom: 0px;" class="">I'm seeing output files showing up in recon and rootTree, but nothing in log. Where are the log files being written to?</div>
<div style="margin-top: 0px; margin-bottom: 0px;" class=""><br class="">
</div>
<div style="margin-top: 0px; margin-bottom: 0px;" class="">Norman</div>
<br class="">
<br class="">
<div style="" class="">
<hr tabindex="-1" style="display: inline-block; width:
633.078125px;" class="">
<div id="divRplyFwdMsg" dir="ltr" class=""><font style="font-size: 11pt;" class="" face="Calibri,
sans-serif"><b class="">From:</b><span class="Apple-converted-space"> </span>Hps-analysis <<a href="mailto:hps-analysis-bounces@jlab.org" class="" moz-do-not-send="true">hps-analysis-bounces@jlab.org</a>>
on behalf of Tongtong Cao <<a href="mailto:tongtongcao1@gmail.com" class="" moz-do-not-send="true">tongtongcao1@gmail.com</a>><br class="">
<b class="">Sent:</b><span class="Apple-converted-space"> </span>Monday, July 22, 2019 8:21 AM<br class="">
<b class="">To:</b><span class="Apple-converted-space"> </span>hps-software <<a href="mailto:hps-software@slac.stanford.edu" class="" moz-do-not-send="true">hps-software@slac.stanford.edu</a>>;
<a href="mailto:hps-analysis@jlab.org" class="" moz-do-not-send="true">hps-analysis@jlab.org</a> <<a href="mailto:hps-analysis@jlab.org" class="" moz-do-not-send="true">hps-analysis@jlab.org</a>><br class="">
<b class="">Subject:</b><span class="Apple-converted-space"> </span>Re: [Hps-analysis] Requests for data cooking</font>
<div class=""> </div>
</div>
<div style="word-wrap: break-word; line-break:
after-white-space;" class="">
Dear all,
<div class=""><br class="">
</div>
<div class="">Yesterday, we got a lot of available runs.</div>
<div class="">I picked up most of runs from 9908 - 9929 for cooking.</div>
<div class="">The jobs has been submitted and been running.</div>
<div class=""><br class="">
</div>
<div class="">jar is up to date.</div>
<div class="">-d: <span style="color: rgb(202, 51,
35); font-family: Menlo; font-size: 13px;" class="">HPS-PhysicsRun2019-v1-4pt5</span></div>
<div class="">-x: <span style="color: rgb(202, 51,
35); font-family: Menlo; font-size: 13px;" class="">PhysicsRun2019_testRecon.lcsim</span></div>
<div class="">-R: <span style="color: rgb(202, 51,
35); font-family: Menlo; font-size: 13px;" class="">${run}</span></div>
<div class=""><br class="">
</div>
<div class="">Please let me know if you need extra runs or special requirements for setup.</div>
<div class=""><br class="">
</div>
<div class="">Best regards,</div>
<div class="">Tongtong</div>
<div class="">
<div class=""><br class="">
<blockquote type="cite" class="">
<div class="">On Jul 17, 2019, at 11:09 AM, Tongtong Cao <<a class="OWAAutoLink" id="LPlnk12218" href="mailto:tongtongcao1@gmail.com" previewremoved="true" moz-do-not-send="true">tongtongcao1@gmail.com</a>> wrote:</div>
<br class="x_Apple-interchange-newline">
<div class="">
<div style="word-wrap: break-word;" class="">
<div class="">Dear Colleagues,</div>
<div class=""><br class="">
</div>
<div class="">According to the run list in Run Spreadsheet 2019, I categorized runs (collected so far) as “Ecal Pedestal”, “SVT OFF” and “SVT ON” after dropping junk runs.</div>
<div class="">A table is attached.</div>
<div class=""><br class="">
</div>
<div class="">There are two steps for cooking:</div>
<div class=""> Step 1: Decoding and reconstruction using the up-to-date “<span style="font-family: Menlo; font-size:
11px;" class="">SNAPSHOT-bin.jar</span>"</div>
<div class=""> Parameter setup in the current jsub.xml:</div>
<div class=""> 1) -d (detector): <span style="color: rgb(202,
51, 35); font-family: Menlo;
font-size: 13px;" class="">HPS-PhysicsRun2019-v1-4pt5</span></div>
<div class=""> 2) -x (steering file): <span style="color: rgb(202, 51,
35); font-family: Menlo; font-size:
13px;" class="">PhysicsRun2019_testRecon.lcsim </span>for “SVT ON” runs,
and <span style="color:
rgb(202, 51, 35); font-family: Menlo;
font-size: 13px;" class="">PhysicsRun2019_NoSVT.lcsim </span>for “SVT OFF” runs</div>
<div class=""> 3) -R (run number): <span style="color: rgb(202,
51, 35); font-family: Menlo;
font-size: 13px;" class="">${run}</span> (run number of processed run)</div>
<div class=""> </div>
<div class=""> Step 2: Conversion from LCIO file into ROOT file using <span style="color: rgb(202, 51, 35);
font-family: Menlo; font-size: 13px;" class=""><a class="OWAAutoLink" id="LPlnk334887" href="https://urldefense.proofpoint.com/v2/url?u=http-3A__make-5Froot.cc_&d=DwMFaQ&c=CJqEzB1piLOyyvZjb8YUQw&r=JaSEOiNc_6InrJmbYDvKU2tZqhhONpIkbyl_AUnkDSY&m=imhV5FCWvlGLUemhiBv0sF-fTU-DjXMtsLWq0xoKhQU&s=7Zx7VM-macFh5pAaXncHKZJ5M87F2RhLyPR7rnF4xlk&e=" previewremoved="true" moz-do-not-send="true">Make_Root.cc/</a></span><span style="color: rgb(202, 51, 35);
font-family: Menlo; font-size: 13px;" class=""><a class="OWAAutoLink" id="LPlnk356521" href="https://urldefense.proofpoint.com/v2/url?u=http-3A__make-5Froot-5Fnosvt.cc_&d=DwMFaQ&c=CJqEzB1piLOyyvZjb8YUQw&r=JaSEOiNc_6InrJmbYDvKU2tZqhhONpIkbyl_AUnkDSY&m=imhV5FCWvlGLUemhiBv0sF-fTU-DjXMtsLWq0xoKhQU&s=DlZvvsHV9epdNTG1viDJzwRdRIMOmbDYOkyweGSUEuk&e=" previewremoved="true" moz-do-not-send="true">Make_Root_NoSVT.cc</a></span> for
convenience of C++ users</div>
<div class=""><br class="">
</div>
<div class="">Other setup in the current jsub.xml:</div>
<div class=""> # of processed files for a given run: all files if # < 15, 15 files (5 at first, 5 in the middle, and 5 at the end) if # >= 15</div>
<div class=""> Destination of output: /volatile/hallb/hps/data/run2019/ConcurrentCook/${run}; /volatile/hallb/hps/data/run2019/ConcurrentCookfail/${run} (if failed)</div>
<div class=""><br class="">
</div>
<div class="">To request a run/runs for data cooking, please provide run number(s) and special requests, like # of processed files or a list of processed files for a run, output storage for the long-term usage (the default “volatile" storage temporarily keep
output), etc.</div>
<div class=""><br class="">
</div>
<div class="">So far, runs 9569 (SVT OFF) and 9600 (SVT ON) have been cooked.</div>
<div class=""><br class="">
</div>
<div class="">ps: Please add notes for each run during shifts.</div>
<div class=""><br class="">
</div>
<div class="">Best regards,</div>
<div class="">Tongtong</div>
</div>
<span id="x_cid:F25A6EE9-01C1-4272-A9E2-886BC3A6374B@jlab.org" class=""><catagoriesOfRuns2019.xlsx></span></div>
</blockquote>
</div>
</div>
</div>
</div>
</div>
</div>
</blockquote>
</div>
<br class="">
</div>
<br class="">
<fieldset class="mimeAttachmentHeader"></fieldset>
<pre class="moz-quote-pre" wrap="">_______________________________________________
Hps-analysis mailing list
<a class="moz-txt-link-abbreviated" href="mailto:Hps-analysis@jlab.org">Hps-analysis@jlab.org</a>
<a class="moz-txt-link-freetext" href="https://mailman.jlab.org/mailman/listinfo/hps-analysis">https://mailman.jlab.org/mailman/listinfo/hps-analysis</a>
</pre>
</blockquote>
<br class="">
</div>
_______________________________________________<br class="">Hps-analysis mailing list<br class=""><a href="mailto:Hps-analysis@jlab.org" class="">Hps-analysis@jlab.org</a><br class="">https://mailman.jlab.org/mailman/listinfo/hps-analysis<br class=""></div></blockquote></div><br class=""></div></body></html>