<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
</head>
<body style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class="">
Hi Bradley and All,
<div class=""><br class="">
</div>
<div class="">Thanks Bradley for sending this around. Generally looks good, but I’m pretty sure we'd want RG-F to use a CCDB timestamp in all services in this YAML you’re referencing in this workflow:</div>
<div class=""><br class="">
</div>
<div class="">/work/clas12/byale/cooking/yaml/data_disentanglerTRUE.yaml</div>
<div class=""><br class="">
</div>
<div class="">Another issue is that you seem to be referencing a custom installation of coatjava and clara, rather than the standard ones in /group/clas12/packages.</div>
<div class=""><br class="">
</div>
<div class="">More minor points are that the trains don’t use CCDB at all, but whether the stock “calib" train is appropriate for BONuS is probably something to discuss with CALCOM, but I would presume it reasonable. We also talked about this in the chef’s
meeting on Tuesday, that BONuS doesn’t have any train wagons for the RTPC calibration, which is unfortunate but shouldn’t hold up this 10-files-per-run pass.</div>
<div class=""><br class="">
</div>
<div class="">-Nathan<br class="">
<div class=""><br class="">
</div>
<div class=""><br class="">
<div><br class="">
<blockquote type="cite" class="">
<div class="">On Oct 7, 2020, at 6:08 PM, Yale, Bradley <<a href="mailto:byale@wm.edu" class="">byale@wm.edu</a>> wrote:</div>
<br class="Apple-interchange-newline">
<div class="">
<div style="font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt;" class="">
Hi everyone,<br class="">
</div>
<div style="font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt;" class="">
<br class="">
</div>
<div style="font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt;" class="">
As requested by Nathan, here is the workflow .json to be submitted for "Part A: pass 0"; the full chain for the first 10 files for each "good" run (based on the spreadsheet). The request was to verify that everything is correct before launching the actual jobs:</div>
<div style="font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt;" class="">
<div class=""><br class="">
</div>
/work/clas12/byale/cooking/rgf-dmra-pass0v0-12389x427.json</div>
<div style="font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt;" class="">
<br class="">
</div>
<div style="font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt;" class="">
The config file used to make it:</div>
<div style="font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt;" class="">
/work/clas12/byale/cooking/pass0v0_10files.json</div>
<div style="font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt;" class="">
<br class="">
</div>
<div style="font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt;" class="">
The command:</div>
<div style="font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt;" class="">
module load workflow/dev<br class="">
</div>
<div style="font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt;" class="">
$CLAS12WFLOW/scripts/clas12-workflow.py --config pass0v0_10files.json --runs 12951,12950,12949,12948,12947,12946,12943,12942,12940,12939,12938,12937,12936,12935,12934,12933,12932,12931,12930,12928,12926,12925,12924,12923,12922,12921,12920,12919,12918,12915,12914,12913,12911,12910,12909,12908,12907,12905,12904,12903,12902,12901,12900,12899,12898,12897,12896,12894,12892,12890,12889,12888,12887,12885,12884,12883,12882,12881,12880,12879,12878,12877,12876,12875,12874,12873,12872,12871,12870,12868,12867,12866,12865,12863,12862,12860,12859,12858,12857,12856,12855,12853,12851,12850,12842,12841,12840,12839,12838,12837,12836,12835,12834,12833,12832,12831,12830,12829,12828,12827,12826,12825,12824,12821,12820,12819,12818,12817,12816,12809,12805,12804,12803,12802,12801,12800,12799,12796,12795,12794,12792,12791,12790,12789,12788,12787,12786,12785,12784,12783,12782,12780,12779,12778,12776,12775,12774,12773,12772,12771,12770,12769,12768,12767,12766,12764,12763,12762,12761,12760,12759,12757,12752,12751,12749,12748,12746,12744,12743,12742,12741,12740,12739,12738,12736,12735,12734,12733,12732,12731,12727,12726,12724,12723,12722,12721,12720,12719,12718,12715,12714,12713,12712,12711,12710,12709,12708,12707,12706,12705,12704,12703,12702,12701,12700,12699,12698,12697,12694,12693,12692,12686,12684,12683,12682,12680,12679,12678,12677,12676,12675,12674,12672,12671,12669,12668,12666,12665,12664,12663,12662,12659,12657,12656,12653,12652,12651,12650,12649,12648,12647,12646,12645,12644,12643,12642,12641,12640,12639,12638,12637,12636,12635,12634,12633,12631,12630,12629,12628,12627,12624,12620,12616,12615,12614,12610,12609,12607,12606,12605,12604,12603,12602,12601,12600,12599,12598,12597,12596,12595,12594,12593,12592,12591,12587,12586,12585,12584,12583,12582,12581,12580,12579,12578,12577,12576,12575,12573,12572,12570,12568,12567,12566,12565,12564,12563,12562,12560,12559,12558,12557,12556,12555,12554,12553,12552,12551,12550,12549,12548,12547,12546,12545,12544,12541,12540,12538,12537,12536,12535,12533,12532,12530,12529,12528,12527,12526,12525,12524,12523,12522,12521,12519,12517,12515,12514,12513,12512,12511,12510,12509,12508,12507,12506,12505,12504,12503,12490,12489,12488,12480,12479,12478,12477,12476,12475,12474,12473,12472,12471,12470,12468,12467,12465,12463,12461,12460,12459,12457,12456,12455,12454,12453,12452,12451,12450,12449,12448,12447,12443,12442,12441,12440,12439,12438,12437,12436,12434,12433,12432,12431,12430,12429,12428,12427,12426,12425,12424,12423,12422,12421,12420,12419,12417,12416,12415,12413,12412,12411,12410,12409,12408,12407,12406,12405,12404,12402,12401,12400,12399,12398,12397,12394,12393,12392,12391,12390,12389</div>
<div style="font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt;" class="">
<br class="">
</div>
<div style="font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt;" class="">
Please also verify that the recon and train yamls (paths in the config) are correct and up-to-date. I think that the RTPC still needs to be added to the train yaml, if the banks are now in the framework.</div>
<div style="font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt;" class="">
<br class="">
</div>
<div style="font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt;" class="">
-Bradley<br class="">
</div>
<div id="appendonsend" style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class="">
</div>
<hr tabindex="-1" style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; display: inline-block; width: 513.515625px;" class="">
<span style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; float: none; display: inline !important;" class=""></span>
<div id="divRplyFwdMsg" dir="ltr" style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class="">
<font face="Calibri, sans-serif" style="font-size: 11pt;" class=""><b class="">From:</b><span class="Apple-converted-space"> </span><a href="mailto:mhattawy@odu.edu" class="">mhattawy@odu.edu</a> <<a href="mailto:mohammad.hattawy@gmail.com" class="">mohammad.hattawy@gmail.com</a>><br class="">
<b class="">Sent:</b><span class="Apple-converted-space"> </span>Wednesday, October 7, 2020 11:11 AM<br class="">
<b class="">To:</b><span class="Apple-converted-space"> </span>Yale, Bradley <<a href="mailto:byale@wm.edu" class="">byale@wm.edu</a>><br class="">
<b class="">Cc:</b><span class="Apple-converted-space"> </span>Nathan Baltzell <<a href="mailto:baltzell@jlab.org" class="">baltzell@jlab.org</a>>; Marco Battaglieri <<a href="mailto:battagli@jlab.org" class="">battagli@jlab.org</a>>; Raffaella De Vita <<a href="mailto:devita@jlab.org" class="">devita@jlab.org</a>>;
markov <<a href="mailto:markov@jlab.org" class="">markov@jlab.org</a>>; Daniel Carman <<a href="mailto:carman@jlab.org" class="">carman@jlab.org</a>>; bonuslist <<a href="mailto:bonuslist@jlab.org" class="">bonuslist@jlab.org</a>>; Stepan Stepanyan <<a href="mailto:stepanya@jlab.org" class="">stepanya@jlab.org</a>><br class="">
<b class="">Subject:</b><span class="Apple-converted-space"> </span>Pass0 cooking for the RG-F Summer (Fall) Run</font>
<div class=""> </div>
</div>
<div style="caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;" class="">
<div dir="ltr" class="">
<div class="">Dear all,<span class="Apple-converted-space"> </span><br class="">
</div>
<div class=""> This is my call for RG-F cooking chef, Bradely Yale, to launch decoding and cooking the<span style="color: rgb(0, 0, 255);" class=""><b class="">summer data</b></span><span class="Apple-converted-space"> </span>with COATJAVA release 6.5.1.1
as following:<span class="Apple-converted-space"> </span><br class="">
</div>
<div class=""><br class="">
</div>
<div class=""><span style="color: rgb(0, 0, 255);" class=""><b class="">A. Pass0:<span class="Apple-converted-space"> </span><span style="" class="">2 and 10 GeV data, all runs from<span class="Apple-converted-space"> </span><span style="color: rgb(0, 0, 255);" class="">12389
to 12951.</span></span><br class="">
</b></span></div>
<div class=""> - Full chain (decoding +recon + trains) for the first 10 evio files for every good run (attached spreadsheet to this email).<span class="Apple-converted-space"> </span><b class="">429 runs, 4290 evio files</b><span class="Apple-converted-space"> </span>(out
of 43129 total evio files),<span class="Apple-converted-space"> </span><b class="">300M events</b>(out of 3.024B events).</div>
<div class=""> - Required disk space:<b class=""><span class="Apple-converted-space"> </span>7TB<span class="Apple-converted-space"> </span></b>for the decoded files, and<span class="Apple-converted-space"> </span><b class="">16TB</b><span class="Apple-converted-space"> </span>for
the reconstructed files.</div>
<div class=""> - Outputs: Both, --decDir and --outDir on /volatile.</div>
<div class=""> - Single workflow.<br class="">
</div>
<div class=""><br class="">
</div>
<div class=""><b class=""><span style="color: rgb(0, 0, 255);" class="">B. Full decoding + recon for the low energy data for RTCP calibration</span></b>:<span class="Apple-converted-space"> </span><br class="">
</div>
<div class=""> - Runs from<span class="Apple-converted-space"> </span><span style="color: rgb(0, 0, 255);" class=""><b class="">12389</b><span class="Apple-converted-space"> </span>to<span class="Apple-converted-space"> </span><b class="">12443</b></span>.<b class=""><span class="Apple-converted-space"> </span>49
runs.<span class="Apple-converted-space"> </span></b><b class="">1493 total evio files</b>.<span class="Apple-converted-space"> </span><b class="">296M events</b>.</div>
<div class=""> - Required disk space:<span class="Apple-converted-space"> </span><b class="">6.4TB<span class="Apple-converted-space"> </span></b>for the decoded files, and<span class="Apple-converted-space"> </span><b class="">15TB</b><span class="Apple-converted-space"> </span>for
the reconstructed files.<span class="Apple-converted-space"> </span><br class="">
</div>
<div class=""> - Outputs: --decDir on /cache and --outDir on /volatile.<br class="">
</div>
<div class=""> <span class="Apple-converted-space"> </span><br class="">
</div>
<div class=""><b class=""><span style="color: rgb(0, 0, 255);" class="">C. Full decoding of all the 10 GeV data as follows:</span></b></div>
<div class=""><b class=""><span style="color: rgb(0, 0, 255);" class=""> <span class="Apple-converted-space"> </span></span></b><span style="" class="">- First full decoding runs from<span class="Apple-converted-space"> </span><b class=""><span style="color: rgb(0, 0, 255);" class="">12488
to 12586.</span></b><span class="Apple-converted-space"> </span><b class="">516M events</b><span class="Apple-converted-space"> </span>with the FT in the trigger.<span class="Apple-converted-space"> </span><b class="">8749 evio files</b><span class="Apple-converted-space"> </span>in
total. 98 runs.</span></div>
<div class=""><span style="" class=""> - Then proceed with full decoding for the other high energy runs: runs from<span class="Apple-converted-space"> </span><span style="color: rgb(0, 0, 255);" class=""><b class="">12450 to 12480</b>,<span class="Apple-converted-space"> </span><b class="">12488<span class="Apple-converted-space"> </span></b><b class="">to
12951</b></span>.<span class="Apple-converted-space"> </span><b class="">32887 evio files</b>.<span class="Apple-converted-space"> </span><b class="">2212M events.</b><span class="Apple-converted-space"> </span><br class="">
</span></div>
<div class=""><span style="" class=""> - Required disk space:<span class="Apple-converted-space"> </span><b class="">59TB</b><span class="Apple-converted-space"> </span>for all the decoded files.<span class="Apple-converted-space"> </span><br class="">
</span></div>
<div class=""><span style="" class=""> - Outputs: to be written on /cache.</span></div>
<div class=""><span style="" class=""> - Note: No reconstruction here, FT will do skims and cooking themselves.<span class="Apple-converted-space"> </span><br class="">
</span></div>
<div class=""><br class="">
</div>
<div class=""><b class="">Note:<span class="Apple-converted-space"> </span></b>based on the results from workflow A data (pass-0), we may proceed with decoding the full data for the FT before launching the workflow B, or run them in parallel.<span class="Apple-converted-space"> </span><br class="">
</div>
<div class=""><b class="">Special request for FToF</b>: Full decoding and cooking of the two runs<span class="Apple-converted-space"> </span><b class=""><span style="color: rgb(0, 0, 255);" class="">11674 and 12478</span></b>.<br class="">
</div>
<div class=""><br class="">
</div>
<div class=""><br class="">
<div dir="ltr" class="">Best regards,<br class="">
Mohammad Hattawy.</div>
</div>
</div>
</div>
</div>
</blockquote>
</div>
<br class="">
</div>
</div>
</body>
</html>