<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<style type="text/css" style="display:none;"> P {margin-top:0;margin-bottom:0;} </style>
</head>
<body dir="ltr">
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
Hi everyone,<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
As requested by Nathan, here is the workflow .json to be submitted for "Part A: pass 0"; the full chain for the first 10 files for each "good" run (based on the spreadsheet). The request was to verify that everything is correct before launching the actual jobs:
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<div><br>
</div>
/work/clas12/byale/cooking/rgf-dmra-pass0v0-12389x427.json</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
The config file used to make it:</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
/work/clas12/byale/cooking/pass0v0_10files.json</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
The command:</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
module load workflow/dev<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
$CLAS12WFLOW/scripts/clas12-workflow.py --config pass0v0_10files.json --runs 12951,12950,12949,12948,12947,12946,12943,12942,12940,12939,12938,12937,12936,12935,12934,12933,12932,12931,12930,12928,12926,12925,12924,12923,12922,12921,12920,12919,12918,12915,12914,12913,12911,12910,12909,12908,12907,12905,12904,12903,12902,12901,12900,12899,12898,12897,12896,12894,12892,12890,12889,12888,12887,12885,12884,12883,12882,12881,12880,12879,12878,12877,12876,12875,12874,12873,12872,12871,12870,12868,12867,12866,12865,12863,12862,12860,12859,12858,12857,12856,12855,12853,12851,12850,12842,12841,12840,12839,12838,12837,12836,12835,12834,12833,12832,12831,12830,12829,12828,12827,12826,12825,12824,12821,12820,12819,12818,12817,12816,12809,12805,12804,12803,12802,12801,12800,12799,12796,12795,12794,12792,12791,12790,12789,12788,12787,12786,12785,12784,12783,12782,12780,12779,12778,12776,12775,12774,12773,12772,12771,12770,12769,12768,12767,12766,12764,12763,12762,12761,12760,12759,12757,12752,12751,12749,12748,12746,12744,12743,12742,12741,12740,12739,12738,12736,12735,12734,12733,12732,12731,12727,12726,12724,12723,12722,12721,12720,12719,12718,12715,12714,12713,12712,12711,12710,12709,12708,12707,12706,12705,12704,12703,12702,12701,12700,12699,12698,12697,12694,12693,12692,12686,12684,12683,12682,12680,12679,12678,12677,12676,12675,12674,12672,12671,12669,12668,12666,12665,12664,12663,12662,12659,12657,12656,12653,12652,12651,12650,12649,12648,12647,12646,12645,12644,12643,12642,12641,12640,12639,12638,12637,12636,12635,12634,12633,12631,12630,12629,12628,12627,12624,12620,12616,12615,12614,12610,12609,12607,12606,12605,12604,12603,12602,12601,12600,12599,12598,12597,12596,12595,12594,12593,12592,12591,12587,12586,12585,12584,12583,12582,12581,12580,12579,12578,12577,12576,12575,12573,12572,12570,12568,12567,12566,12565,12564,12563,12562,12560,12559,12558,12557,12556,12555,12554,12553,12552,12551,12550,12549,12548,12547,12546,12545,12544,12541,12540,12538,12537,12536,12535,12533,12532,12530,12529,12528,12527,12526,12525,12524,12523,12522,12521,12519,12517,12515,12514,12513,12512,12511,12510,12509,12508,12507,12506,12505,12504,12503,12490,12489,12488,12480,12479,12478,12477,12476,12475,12474,12473,12472,12471,12470,12468,12467,12465,12463,12461,12460,12459,12457,12456,12455,12454,12453,12452,12451,12450,12449,12448,12447,12443,12442,12441,12440,12439,12438,12437,12436,12434,12433,12432,12431,12430,12429,12428,12427,12426,12425,12424,12423,12422,12421,12420,12419,12417,12416,12415,12413,12412,12411,12410,12409,12408,12407,12406,12405,12404,12402,12401,12400,12399,12398,12397,12394,12393,12392,12391,12390,12389</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
Please also verify that the recon and train yamls (paths in the config) are correct and up-to-date. I think that the RTPC still needs to be added to the train yaml, if the banks are now in the framework.</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
-Bradley<br>
</div>
<div id="appendonsend"></div>
<hr style="display:inline-block;width:98%" tabindex="-1">
<div id="divRplyFwdMsg" dir="ltr"><font face="Calibri, sans-serif" style="font-size:11pt" color="#000000"><b>From:</b> mhattawy@odu.edu <mohammad.hattawy@gmail.com><br>
<b>Sent:</b> Wednesday, October 7, 2020 11:11 AM<br>
<b>To:</b> Yale, Bradley <byale@wm.edu><br>
<b>Cc:</b> Nathan Baltzell <baltzell@jlab.org>; Marco Battaglieri <battagli@jlab.org>; Raffaella De Vita <devita@jlab.org>; markov <markov@jlab.org>; Daniel Carman <carman@jlab.org>; bonuslist <bonuslist@jlab.org>; Stepan Stepanyan <stepanya@jlab.org><br>
<b>Subject:</b> Pass0 cooking for the RG-F Summer (Fall) Run</font>
<div> </div>
</div>
<div>
<div dir="ltr">
<div>Dear all, <br>
</div>
<div> This is my call for RG-F cooking chef, Bradely Yale, to launch decoding and cooking the
<span style="color:rgb(0,0,255)"><b>summer data</b></span> with COATJAVA release 6.5.1.1 as following:
<br>
</div>
<div><br>
</div>
<div><span style="color:rgb(0,0,255)"><b>A. Pass0: <span style="color:rgb(0,0,0)">
2 and 10 GeV data, all runs from <span style="color:rgb(0,0,255)">12389 to 12951.</span></span><br>
</b></span></div>
<div> - Full chain (decoding +recon + trains) for the first 10 evio files for every good run (attached spreadsheet to this email).
<b>429 runs, 4290 evio files</b> (out of 43129 total evio files), <b>300M events</b> (out of 3.024B events).</div>
<div> - Required disk space:<b> 7TB </b>for the decoded files, and <b>16TB</b> for the reconstructed files.</div>
<div> - Outputs: Both, --decDir and --outDir on /volatile.</div>
<div> - Single workflow.<br>
</div>
<div><br>
</div>
<div><b><span style="color:rgb(0,0,255)">B. Full decoding + recon for the low energy data for RTCP calibration</span></b>:
<br>
</div>
<div> - Runs from <span style="color:rgb(0,0,255)"><b>12389</b> to <b>12443</b></span>.<b> 49 runs.
</b><b>1493 total evio files</b>. <b>296M events</b>.</div>
<div> - Required disk space: <b>6.4TB </b>for the decoded files, and <b>15TB</b> for the reconstructed files.
<br>
</div>
<div> - Outputs: --decDir on /cache and --outDir on /volatile.<br>
</div>
<div> <br>
</div>
<div><b><span style="color:rgb(0,0,255)">C. Full decoding of all the 10 GeV data as follows:</span></b></div>
<div><b><span style="color:rgb(0,0,255)"> </span></b><span style="color:rgb(0,0,0)">- First full decoding runs from
<b><span style="color:rgb(0,0,255)">12488 to 12586.</span></b> <b>516M events</b> with the FT in the trigger.
<b>8749 evio files</b> in total. 98 runs.</span></div>
<div><span style="color:rgb(0,0,0)"> - Then proceed with full decoding for the other high energy runs: runs from
<span style="color:rgb(0,0,255)"><b>12450 to 12480</b>, <b>12488 </b><b>to 12951</b></span>.
<b>32887 evio files</b>. <b>2212M events.</b> <br>
</span></div>
<div><span style="color:rgb(0,0,0)"> - Required disk space: <b>59TB</b> for all the decoded files.
<br>
</span></div>
<div><span style="color:rgb(0,0,0)"> - Outputs: to be written on /cache.</span></div>
<div><span style="color:rgb(0,0,0)"> - Note: No reconstruction here, FT will do skims and cooking themselves.
<br>
</span></div>
<div><br>
</div>
<div><b>Note: </b>based on the results from workflow A data (pass-0), we may proceed with decoding the full data for the FT before launching the workflow B, or run them in parallel.
<br>
</div>
<div><b>Special request for FToF</b>: Full decoding and cooking of the two runs <b>
<span style="color:rgb(0,0,255)">11674 and 12478</span></b>.<br>
</div>
<div><br>
</div>
<div><br>
<div dir="ltr">Best regards,<br>
Mohammad Hattawy.<br>
</div>
</div>
</div>
</div>
</body>
</html>