<!DOCTYPE html><html><head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
  </head>
  <body>
    <p>Maybe you can run another quick test with the updated config file
      and launch_nersc.py script over the weekend?<br>
    </p>
    <p><br>
    </p>
    <p>I may have a new release on Monday.</p>
    <p><br>
    </p>
    <p><br>
    </p>
    <div class="moz-cite-prefix">On 6/28/24 13:04, Igal Jaegle wrote:<br>
    </div>
    <blockquote type="cite" cite="mid:BLAPR09MB7315A8408CE7E1EAF78D613AC2D02@BLAPR09MB7315.namprd09.prod.outlook.com">
      
      <style type="text/css" style="display:none;">P {margin-top:0;margin-bottom:0;}</style>
      <div class="elementToProof" style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
        No problem from my side. Just let me know when they are loaded
        so that I can start the production a day or two later.</div>
      <div class="elementToProof" style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
        <br>
      </div>
      <div class="elementToProof" style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
        tks ig.</div>
      <div class="elementToProof" style="font-family: Aptos, Aptos_EmbeddedFont, Aptos_MSFontService, Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
        <br>
      </div>
      <hr style="display:inline-block;width:98%" tabindex="-1">
      <div id="divRplyFwdMsg" dir="ltr"><font style="font-size:11pt" face="Calibri, sans-serif" color="#000000"><b>From:</b> Ilya
          Larin <a class="moz-txt-link-rfc2396E" href="mailto:ilarin@jlab.org"><ilarin@jlab.org></a><br>
          <b>Sent:</b> Friday, June 28, 2024 1:01 PM<br>
          <b>To:</b> Alexander Austregesilo <a class="moz-txt-link-rfc2396E" href="mailto:aaustreg@jlab.org"><aaustreg@jlab.org></a>;
          <a class="moz-txt-link-abbreviated" href="mailto:halld-cpp@jlab.org">halld-cpp@jlab.org</a> <a class="moz-txt-link-rfc2396E" href="mailto:halld-cpp@jlab.org"><halld-cpp@jlab.org></a>; Igal Jaegle
          <a class="moz-txt-link-rfc2396E" href="mailto:ijaegle@jlab.org"><ijaegle@jlab.org></a><br>
          <b>Cc:</b> Sean Dobbs <a class="moz-txt-link-rfc2396E" href="mailto:sdobbs@jlab.org"><sdobbs@jlab.org></a><br>
          <b>Subject:</b> Re: CPP REST production</font>
        <div> </div>
      </div>
      <style type="text/css" style="display:none">p
        {margin-top:0;
        margin-bottom:0}</style>
      <div dir="ltr">
        <div class="x_elementToProof" style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
          <br>
        </div>
        <div class="x_elementToProof" style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
          I have few more tables for dead counters if you think it would
          be good to update.</div>
        <div class="x_elementToProof" style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
          <br>
        </div>
        <div class="x_elementToProof" style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
           Ilya</div>
        <div class="x_elementToProof" style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
          <br>
        </div>
        <hr tabindex="-1" style="display:inline-block; width:98%">
        <div id="x_divRplyFwdMsg" dir="ltr"><font style="font-size:11pt" face="Calibri, sans-serif" color="#000000"><b>From:</b>
            Halld-cpp <a class="moz-txt-link-rfc2396E" href="mailto:halld-cpp-bounces@jlab.org"><halld-cpp-bounces@jlab.org></a> on behalf of
            Igal Jaegle via Halld-cpp <a class="moz-txt-link-rfc2396E" href="mailto:halld-cpp@jlab.org"><halld-cpp@jlab.org></a><br>
            <b>Sent:</b> Friday, June 28, 2024 13:00<br>
            <b>To:</b> Alexander Austregesilo <a class="moz-txt-link-rfc2396E" href="mailto:aaustreg@jlab.org"><aaustreg@jlab.org></a>;
            <a class="moz-txt-link-abbreviated" href="mailto:halld-cpp@jlab.org">halld-cpp@jlab.org</a> <a class="moz-txt-link-rfc2396E" href="mailto:halld-cpp@jlab.org"><halld-cpp@jlab.org></a><br>
            <b>Cc:</b> Sean Dobbs <a class="moz-txt-link-rfc2396E" href="mailto:sdobbs@jlab.org"><sdobbs@jlab.org></a><br>
            <b>Subject:</b> Re: [Halld-cpp] CPP REST production</font>
          <div> </div>
        </div>
        <style type="text/css" style="display:none">p
        {margin-top:0;
        margin-bottom:0}</style>
        <div dir="ltr">
          <div class="x_x_elementToProof" style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
            ok so I have the green light to start the production - ctof
            & ps evio skims?</div>
          <div class="x_x_elementToProof" style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
            <br>
          </div>
          <div class="x_x_elementToProof" style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
            tks ig.</div>
          <hr tabindex="-1" style="display:inline-block; width:98%">
          <div id="x_x_divRplyFwdMsg" dir="ltr"><font style="font-size:11pt" face="Calibri, sans-serif" color="#000000"><b>From:</b> Alexander Austregesilo
              <a class="moz-txt-link-rfc2396E" href="mailto:aaustreg@jlab.org"><aaustreg@jlab.org></a><br>
              <b>Sent:</b> Friday, June 28, 2024 12:15 PM<br>
              <b>To:</b> Igal Jaegle <a class="moz-txt-link-rfc2396E" href="mailto:ijaegle@jlab.org"><ijaegle@jlab.org></a>;
              <a class="moz-txt-link-abbreviated" href="mailto:halld-cpp@jlab.org">halld-cpp@jlab.org</a> <a class="moz-txt-link-rfc2396E" href="mailto:halld-cpp@jlab.org"><halld-cpp@jlab.org></a><br>
              <b>Cc:</b> Naomi Jarvis <a class="moz-txt-link-rfc2396E" href="mailto:nsj@cmu.edu"><nsj@cmu.edu></a>; Sean Dobbs
              <a class="moz-txt-link-rfc2396E" href="mailto:sdobbs@jlab.org"><sdobbs@jlab.org></a><br>
              <b>Subject:</b> Re: CPP REST production</font>
            <div> </div>
          </div>
          <div>
            <p>Excellent. Something must be wrong on my side with the
              sizes. When I list my directory I get this output, which
              seems consistent with you:<br>
            </p>
            <p><br>
            </p>
            <p>-rw-r--r-- 1 aaustreg halld   43688763 Jun 25 15:59
              converted_random.hddm<br>
              -rw-r--r-- 1 aaustreg halld 1244538131 Jun 25 15:59
              dana_rest.hddm<br>
              -rw-r--r-- 1 aaustreg halld   16751296 Jun 25 15:59
              hd_rawdata_101586_000.BCAL-LED.evio<br>
              -rw-r--r-- 1 aaustreg halld     322128 Jun 25 15:59
              hd_rawdata_101586_000.CCAL-LED.evio<br>
              -rw-r--r-- 1 aaustreg halld  237368676 Jun 25 15:59
              hd_rawdata_101586_000.cpp_2c.evio<br>
              -rw-r--r-- 1 aaustreg halld  814874380 Jun 25 15:59
              hd_rawdata_101586_000.ctof.evio<br>
              -rw-r--r-- 1 aaustreg halld     322128 Jun 25 15:59
              hd_rawdata_101586_000.DIRC-LED.evio<br>
              -rw-r--r-- 1 aaustreg halld   19690620 Jun 25 15:59
              hd_rawdata_101586_000.FCAL-LED.evio<br>
              -rw-r--r-- 1 aaustreg halld  110784828 Jun 25 15:59
              hd_rawdata_101586_000.npp_2g.evio<br>
              -rw-r--r-- 1 aaustreg halld  132611736 Jun 25 15:59
              hd_rawdata_101586_000.npp_2pi0.evio<br>
              -rw-r--r-- 1 aaustreg halld 2804807604 Jun 25 15:59
              hd_rawdata_101586_000.ps.evio<br>
              -rw-r--r-- 1 aaustreg halld  188496932 Jun 25 15:59
              hd_rawdata_101586_000.random.evio<br>
              -rw-r--r-- 1 aaustreg halld     314564 Jun 25 15:59
              hd_rawdata_101586_000.sync.evio<br>
              -rw-r--r-- 1 aaustreg halld   44638598 Jun 25 15:59
              hd_root.root<br>
              -rw-r--r-- 1 aaustreg halld       1329 Jun 27 14:59
              jana_recon_2022_05_ver01.config<br>
              -rw-r--r-- 1 aaustreg halld       1343 Jun 26 15:38
              jana_recon_2022_05_ver01.config~<br>
              -rw-r--r-- 1 aaustreg halld       7594 Jun 25 15:59
              syncskim.root<br>
              -rw-r--r-- 1 aaustreg halld       7370 Jun 25 15:59
              tree_bcal_hadronic_eff.root<br>
              -rw-r--r-- 1 aaustreg halld     130996 Jun 25 15:59
              tree_fcal_hadronic_eff.root<br>
              -rw-r--r-- 1 aaustreg halld   96654396 Jun 25 15:59
              tree_PSFlux.root<br>
              -rw-r--r-- 1 aaustreg halld    1063333 Jun 25 15:59
              tree_tof_eff.root<br>
              -rw-r--r-- 1 aaustreg halld   50428784 Jun 25 15:59
              tree_TPOL.root<br>
              -rw-r--r-- 1 aaustreg halld       8617 Jun 25 15:59
              tree_TS_scaler.root</p>
            <p><br>
            </p>
            <p>But when I ask the shell for the size of individual
              files, I get a different result:</p>
            <p><br>
            </p>
            <p>ls -s hd_rawdata_101586_000.ps.evio<br>
              1743356 hd_rawdata_101586_000.ps.evio</p>
            <p><br>
            </p>
            <p>That is super weird, but I don't think any of the lock
              fixes have anything to do with that. It is a difference
              between disk allocation and byte count.<br>
            </p>
            <p><br>
            </p>
            <p>From my side, I would just update the config file from
              teh group disk to get rid of the ctof and ps skims.</p>
            <p><br>
            </p>
            <p>I also noticed that you have tree_sc_eff.root as an
              output file in the launch_nersc.py script, even though it
              is not produced by the job. Maybe you want to update this
              list.<br>
            </p>
            <p><br>
            </p>
            <p><br>
            </p>
            <div class="x_x_x_moz-cite-prefix">On 6/28/24 00:09, Igal
              Jaegle wrote:<br>
            </div>
            <blockquote type="cite">
              <style type="text/css" style="display:none">p
        {margin-top:0;
        margin-bottom:0}</style>
              <div class="x_x_x_elementToProof" style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
                The second attempt worked, the job took slightly more
                than 3h with 100% success rate but the skims are almost
                all larger than the one produced locally. So, there is
                still an issue.</div>
              <div class="x_x_x_elementToProof" style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
                <br>
              </div>
              <div class="x_x_x_elementToProof" style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
                The files are on volatile and will be moved tomorrow on
                cache</div>
              <div class="x_x_x_elementToProof" style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
                <br>
              </div>
              <div class="x_x_x_elementToProof" style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
/volatile/halld/offsite_prod/RunPeriod-2022-05/recon/ver99-perl/RUN101586/</div>
              <div class="x_x_x_elementToProof" style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
                <br>
              </div>
              <div class="x_x_x_elementToProof" style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
                tks ig.</div>
              <div class="x_x_x_elementToProof" style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
                <br>
              </div>
              <div class="x_x_x_elementToProof" style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
                s -lrth
/volatile/halld/offsite_prod/RunPeriod-2022-05/recon/ver99-perl/RUN101586/FILE000/RUN101586/FILE000/</div>
              <div style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
                total 5.2G</div>
              <div style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
                -rw-r--r-- 1 gxproj4 halld  784 Jun 25 05:42
                tree_sc_eff.root</div>
              <div style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
                -rw-r--r-- 1 gxproj4 halld 315K Jun 27 22:13
                hd_rawdata_101586_000.CCAL-LED.evio</div>
              <div style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
                -rw-r--r-- 1 gxproj4 halld  16M Jun 27 22:13
                hd_rawdata_101586_000.BCAL-LED.evio</div>
              <div style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
                -rw-r--r-- 1 gxproj4 halld 7.5K Jun 27 22:13
                syncskim.root</div>
              <div style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
                -rw-r--r-- 1 gxproj4 halld 174K Jun 27 22:13
                job_info_101586_000.tgz</div>
              <div style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
                -rw-r--r-- 1 gxproj4 halld 227M Jun 27 22:14
                hd_rawdata_101586_000.cpp_2c.evio</div>
              <div style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
                -rw-r--r-- 1 gxproj4 halld 778M Jun 27 22:14
                hd_rawdata_101586_000.ctof.evio</div>
              <div style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
                -rw-r--r-- 1 gxproj4 halld  42M Jun 27 22:15
                converted_random_101586_000.hddm</div>
              <div style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
                -rw-r--r-- 1 gxproj4 halld  49M Jun 27 22:15
                tree_TPOL.root</div>
              <div style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
                -rw-r--r-- 1 gxproj4 halld 8.5K Jun 27 22:15
                tree_TS_scaler.root</div>
              <div style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
                -rw-r--r-- 1 gxproj4 halld 1.2G Jun 27 22:15
                dana_rest.hddm</div>
              <div style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
                -rw-r--r-- 1 gxproj4 halld  93M Jun 27 22:15
                tree_PSFlux.root</div>
              <div style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
                -rw-r--r-- 1 gxproj4 halld 129K Jun 27 22:15
                tree_fcal_hadronic_eff.root</div>
              <div style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
                -rw-r--r-- 1 gxproj4 halld 7.2K Jun 27 22:15
                tree_bcal_hadronic_eff.root</div>
              <div style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
                -rw-r--r-- 1 gxproj4 halld  37M Jun 27 22:15
                hd_root.root</div>
              <div style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
                -rw-r--r-- 1 gxproj4 halld 308K Jun 27 22:16
                hd_rawdata_101586_000.sync.evio</div>
              <div style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
                -rw-r--r-- 1 gxproj4 halld 315K Jun 27 22:16
                hd_rawdata_101586_000.DIRC-LED.evio</div>
              <div style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
                -rw-r--r-- 1 gxproj4 halld 127M Jun 27 22:18
                hd_rawdata_101586_000.npp_2pi0.evio</div>
              <div style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
                -rw-r--r-- 1 gxproj4 halld 106M Jun 27 22:18
                hd_rawdata_101586_000.npp_2g.evio</div>
              <div style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
                -rw-r--r-- 1 gxproj4 halld  19M Jun 27 22:18
                hd_rawdata_101586_000.FCAL-LED.evio</div>
              <div style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
                -rw-r--r-- 1 gxproj4 halld 180M Jun 27 22:21
                hd_rawdata_101586_000.random.evio</div>
              <div style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
                -rw-r--r-- 1 gxproj4 halld 2.7G Jun 27 22:21
                hd_rawdata_101586_000.ps.evio</div>
              <div style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
                -rw-r--r-- 1 gxproj4 halld 1.1M Jun 27 22:27
                tree_tof_eff.root</div>
              <hr tabindex="-1" style="display:inline-block; width:98%">
              <div id="x_x_x_divRplyFwdMsg" dir="ltr"><font style="font-size:11pt" face="Calibri, sans-serif" color="#000000"><b>From:</b> Igal Jaegle
                  <a class="x_x_x_moz-txt-link-rfc2396E" href="mailto:ijaegle@jlab.org" moz-do-not-send="true"><ijaegle@jlab.org></a><br>
                  <b>Sent:</b> Wednesday, June 26, 2024 10:38 AM<br>
                  <b>To:</b> Alexander Austregesilo <a class="x_x_x_moz-txt-link-rfc2396E" href="mailto:aaustreg@jlab.org" moz-do-not-send="true">
                    <aaustreg@jlab.org></a>; <a class="x_x_x_moz-txt-link-abbreviated moz-txt-link-freetext" href="mailto:halld-cpp@jlab.org" moz-do-not-send="true">
                    halld-cpp@jlab.org</a> <a class="x_x_x_moz-txt-link-rfc2396E" href="mailto:halld-cpp@jlab.org" moz-do-not-send="true">
                    <halld-cpp@jlab.org></a><br>
                  <b>Cc:</b> Naomi Jarvis <a class="x_x_x_moz-txt-link-rfc2396E" href="mailto:nsj@cmu.edu" moz-do-not-send="true">
                    <nsj@cmu.edu></a>; Sean Dobbs <a class="x_x_x_moz-txt-link-rfc2396E" href="mailto:sdobbs@jlab.org" moz-do-not-send="true">
                    <sdobbs@jlab.org></a><br>
                  <b>Subject:</b> Re: CPP REST production</font>
                <div> </div>
              </div>
              <style type="text/css" style="display:none">p
        {margin-top:0;
        margin-bottom:0}</style>
              <div dir="ltr">
                <div class="x_x_x_x_elementToProof" style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
                  PERLMUTTER is down due to a maintenance day. But
                  tomorrow I can grab the other logs.</div>
                <div class="x_x_x_x_elementToProof" style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
                  <br>
                </div>
                <div class="x_x_x_x_elementToProof" style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
                  tks ig.</div>
                <hr tabindex="-1" style="display:inline-block; width:98%">
                <div id="x_x_x_x_divRplyFwdMsg" dir="ltr"><font style="font-size:11pt" face="Calibri, sans-serif" color="#000000"><b>From:</b> Alexander Austregesilo
                    <a class="x_x_x_moz-txt-link-rfc2396E" href="mailto:aaustreg@jlab.org" moz-do-not-send="true"><aaustreg@jlab.org></a><br>
                    <b>Sent:</b> Wednesday, June 26, 2024 10:32 AM<br>
                    <b>To:</b> Igal Jaegle <a class="x_x_x_moz-txt-link-rfc2396E" href="mailto:ijaegle@jlab.org" moz-do-not-send="true">
                      <ijaegle@jlab.org></a>; <a class="x_x_x_moz-txt-link-abbreviated moz-txt-link-freetext" href="mailto:halld-cpp@jlab.org" moz-do-not-send="true">
                      halld-cpp@jlab.org</a> <a class="x_x_x_moz-txt-link-rfc2396E" href="mailto:halld-cpp@jlab.org" moz-do-not-send="true">
                      <halld-cpp@jlab.org></a><br>
                    <b>Cc:</b> Naomi Jarvis <a class="x_x_x_moz-txt-link-rfc2396E" href="mailto:nsj@cmu.edu" moz-do-not-send="true">
                      <nsj@cmu.edu></a>; Sean Dobbs <a class="x_x_x_moz-txt-link-rfc2396E" href="mailto:sdobbs@jlab.org" moz-do-not-send="true">
                      <sdobbs@jlab.org></a><br>
                    <b>Subject:</b> Re: CPP REST production</font>
                  <div> </div>
                </div>
                <div>
                  <p>Hi Igal,</p>
                  <p>This failure rate is pretty bad. Can you point me
                    to the log files of the failed jobs? The messages
                    you sent concerning root dictionaries and
                    ps_counts_thresholds are not fatal, they will not
                    cause a failures. You should still confirm with
                    Sasha if the ps_counts_thresholds are important.<br>
                  </p>
                  <p><br>
                  </p>
                  <p>The file
                    /work/halld/home/gxproj4/public/ForAlexAndSean/std.out
                    seems to be cut off. We may want to add this option
                    to the config file to remove the number of processed
                    events:</p>
                  <p><br>
                  </p>
                  <p>JANA:BATCH_MODE 1</p>
                  <p><br>
                  </p>
                  <p>You can find my output files here:
                    /work/halld2/home/aaustreg/Analysis/cpp/REST/</p>
                  <p>I don't have the logs, but all files were closed at
                    exactly the same time.</p>
                  <p><br>
                  </p>
                  <p>Cheers,</p>
                  <p>Alex<br>
                  </p>
                  <p><br>
                  </p>
                  <p><br>
                  </p>
                  <p><br>
                  </p>
                  <div class="x_x_x_x_x_moz-cite-prefix">On 6/26/24
                    08:59, Igal Jaegle wrote:<br>
                  </div>
                  <blockquote type="cite">
                    <style type="text/css" style="display:none">p
        {margin-top:0;
        margin-bottom:0}</style>
                    <div class="x_x_x_x_x_elementToProof" style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
                      Alex,</div>
                    <div class="x_x_x_x_x_elementToProof" style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
                      <br>
                    </div>
                    <div class="x_x_x_x_x_elementToProof" style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
                      Could you provide the path to your output files
                      and most importantly the logs?</div>
                    <div class="x_x_x_x_x_elementToProof" style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
                      <br>
                    </div>
                    <div class="x_x_x_x_x_elementToProof" style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
                      The results of the test on NERSC for the same run
                      are as follows</div>
                    <div class="x_x_x_x_x_elementToProof" style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
                      <br>
                    </div>
                    <div class="x_x_x_x_x_elementToProof" style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
                      108 evio files were cooked properly out of 126,
                      thus 15% failure rate which is way too much to
                      proceed with the cooking.</div>
                    <div class="x_x_x_x_x_elementToProof" style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
                      <br>
                    </div>
                    <div class="x_x_x_x_x_elementToProof" style="font-family:Aptos,Aptos_EmbeddedFont,Aptos_MSFontService,Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
                      tks ig.</div>
                    <hr tabindex="-1" style="display:inline-block; width:98%">
                    <div id="x_x_x_x_x_divRplyFwdMsg" dir="ltr"><font style="font-size:11pt" face="Calibri, sans-serif" color="#000000"><b>From:</b>
                        Alexander Austregesilo
                        <a class="x_x_x_x_x_moz-txt-link-rfc2396E" href="mailto:aaustreg@jlab.org" moz-do-not-send="true"><aaustreg@jlab.org></a><br>
                        <b>Sent:</b> Monday, June 24, 2024 6:06 PM<br>
                        <b>To:</b> <a class="x_x_x_x_x_moz-txt-link-abbreviated x_x_x_moz-txt-link-freetext moz-txt-link-freetext" href="mailto:halld-cpp@jlab.org" moz-do-not-send="true">
                          halld-cpp@jlab.org</a> <a class="x_x_x_x_x_moz-txt-link-rfc2396E" href="mailto:halld-cpp@jlab.org" moz-do-not-send="true">
                          <halld-cpp@jlab.org></a><br>
                        <b>Cc:</b> Naomi Jarvis <a class="x_x_x_x_x_moz-txt-link-rfc2396E" href="mailto:nsj@cmu.edu" moz-do-not-send="true">
                          <nsj@cmu.edu></a>; Igal Jaegle <a class="x_x_x_x_x_moz-txt-link-rfc2396E" href="mailto:ijaegle@jlab.org" moz-do-not-send="true">
                          <ijaegle@jlab.org></a>; Sean Dobbs <a class="x_x_x_x_x_moz-txt-link-rfc2396E" href="mailto:sdobbs@jlab.org" moz-do-not-send="true">
                          <sdobbs@jlab.org></a><br>
                        <b>Subject:</b> CPP REST production</font>
                      <div> </div>
                    </div>
                    <div class="x_x_x_x_x_BodyFragment"><font size="2"><span style="font-size:11pt">
                          <div class="x_x_x_x_x_PlainText">Dear
                            Colleagues,<br>
                            <br>
                            I processed one single file of a typical CPP
                            production run on Pb <br>
                            target. Here is a list of all files and
                            their sizes which will be <br>
                            produced suring the REST prodution:<br>
                            <br>
                            1.7G hd_rawdata_101586_000.ps.evio<br>
                            1.2G dana_rest.hddm<br>
                            495M hd_rawdata_101586_000.ctof.evio<br>
                            160M hd_rawdata_101586_000.cpp_2c.evio<br>
                            115M hd_rawdata_101586_000.random.evio<br>
                              93M tree_PSFlux.root<br>
                              90M hd_rawdata_101586_000.npp_2pi0.evio<br>
                              72M hd_rawdata_101586_000.npp_2g.evio<br>
                              49M tree_TPOL.root<br>
                              42M converted_random.hddm<br>
                              41M hd_root.root<br>
                              16M hd_rawdata_101586_000.FCAL-LED.evio<br>
                              13M hd_rawdata_101586_000.BCAL-LED.evio<br>
                            1.1M tree_tof_eff.root<br>
                            164K tree_fcal_hadronic_eff.root<br>
                            105K hd_rawdata_101586_000.DIRC-LED.evio<br>
                            105K hd_rawdata_101586_000.CCAL-LED.evio<br>
                              94K hd_rawdata_101586_000.sync.evio<br>
                              24K tree_TS_scaler.root<br>
                              24K tree_bcal_hadronic_eff.root<br>
                              24K syncskim.root<br>
                            <br>
                            The trigger skims for ps (with thick
                            converter) and ctof are quite <br>
                            large. Do we actually need them or were they
                            maybe already produced <br>
                            during the calibration stages?<br>
                            <br>
                            As far as I understand, Igal has started a
                            test of the REST production <br>
                            at NERSC. We are getting closer to launch!<br>
                            <br>
                            Cheers,<br>
                            <br>
                            Alex<br>
                            <br>
                            <br>
                            <br>
                            <br>
                            <br>
                            -- <br>
                            Alexander Austregesilo<br>
                            <br>
                            Staff Scientist - Experimental Nuclear
                            Physics<br>
                            Thomas Jefferson National Accelerator
                            Facility<br>
                            Newport News, VA<br>
                            <a class="x_x_x_x_x_moz-txt-link-abbreviated x_x_x_moz-txt-link-freetext moz-txt-link-freetext" href="mailto:aaustreg@jlab.org" moz-do-not-send="true">aaustreg@jlab.org</a><br>
                            (757) 269-6982<br>
                            <br>
                          </div>
                        </span></font></div>
                  </blockquote>
                  <pre class="x_x_x_x_x_moz-signature" cols="72">-- 
Alexander Austregesilo

Staff Scientist - Experimental Nuclear Physics
Thomas Jefferson National Accelerator Facility
Newport News, VA
<a class="x_x_x_x_x_moz-txt-link-abbreviated x_x_x_moz-txt-link-freetext moz-txt-link-freetext" href="mailto:aaustreg@jlab.org" moz-do-not-send="true">aaustreg@jlab.org</a>
(757) 269-6982
</pre>
                </div>
              </div>
            </blockquote>
            <pre class="x_x_x_moz-signature" cols="72">-- 
Alexander Austregesilo

Staff Scientist - Experimental Nuclear Physics
Thomas Jefferson National Accelerator Facility
Newport News, VA
<a class="x_x_x_moz-txt-link-abbreviated moz-txt-link-freetext" href="mailto:aaustreg@jlab.org" moz-do-not-send="true">aaustreg@jlab.org</a>
(757) 269-6982
</pre>
          </div>
        </div>
      </div>
    </blockquote>
    <pre class="moz-signature" cols="72">-- 
Alexander Austregesilo

Staff Scientist - Experimental Nuclear Physics
Thomas Jefferson National Accelerator Facility
Newport News, VA
<a class="moz-txt-link-abbreviated" href="mailto:aaustreg@jlab.org">aaustreg@jlab.org</a>
(757) 269-6982
</pre>
  </body>
</html>