[Halld-offline] Offline Software Meeting Minutes, November 13, 2013

Thu Nov 14 11:46:37 EST 2013

Folks,

Find the minuetes below and at 
https://halldweb1.jlab.org/wiki/index.php/GlueX_Offline_Meeting,_November_13,_2013 
.

   -- Mark
___________________________________________________________

GlueX Offline Meeting, November 13, 2013
Minutes

    Present:
      * CMU: Will Levine, Curtis Meyer
      * IU: Kei Moriya, Matt Shepherd
      * JLab: Mark Dalton, Mark Ito (chair), David Lawrence, Yi Qiang,
        Dmitry Romanov, Sascha Somov, Nathan Sparks, Simon Taylor, Elliott
        Wolin, Beni Zihlmann
      * MIT: Justin Stevens

Announcements

      * The Hall D Data Management Plan has been posted on the wiki
        [41]here.
      * There is a new release of sim-recon, [42]sim-recon-2013-10-17.
        Justin pointed out that this release has the disease of missing
        tracks in the backward direction. The precise plan to get out of
        this situation will be discussed in the coming days, offline.
      * New storage type at JLab: pass-through cache
           + This is writable disk space that is automatically backed up to
             the tape library. As the disk fills up, the oldest files (by
             access date) will be deleted, but those files are not lost
             forever. The user can request that any file be restored from
             the tape library. This restoration may displace other
             long-unaccessed files but...you get the idea.
      * [43]Requirements document for Data Flow Tools
           + The committee charged to come up with these requirements has
             done so. The next step is to write specifications from which
             coding can proceed. A working committee has been formed to do
             this: Jie Chen (chair), Johann Goetz, Vardan Guryjan, Mark
             Ito, Chris Larrieu, and Dennis Weygand. These requirements
             have been added as an appendix to the [44]computing document
             to be given to the Software Review II committee.

Software Review Planning

    Mark I. gave the report. Most of this information is collected in the
    [46]Software Review Planning wiki page.
      * We have a [47]final agenda from Rolf Ent.
      * We have a mostly complete [48]written document for the reviewers.
           + I contains various appendices covering workflow tools, the
             data management plan, and an analysis plan the Curtis wrote
             recently.
           + The draft would benefit from review from the working groups,
             especially the section on calibrations for the various
             detectors.
      * Drafts of all talks exist.
           + The official agenda and talks will be host on the [49]JLab
             Indico site.
      * Last Monday we had a meeting with Rolf. Talks from all of the Halls
        were reviewed.

Simulation and Reconstruction Job Failures

    Kei have a detailed look at studies he has done to isolate failures in
    our simulation and reconstruction. See [51]his slides for details.

    He classified failures of reconstruction into two classes:
     1. stopped: job did not run to completion
     2. unusable: output REST file either small or not readable

    He tried a variety of scenarios: isolating smeared, un-reconstructed
    events, with and without the preceding events in the file, isolating
    generated events (bggen output). He tried reproducing results in
    various configuration. Failures of all kinds occur indicating more than
    one problem is afflicting us.

    He provided links to some of the problem event samples and to scripts
    he used in his studies.

An SCons System for GlueX

    David presented his recent development of an SCons-based build system
    for sim-recon, calld SBMS. See [53]his slides for details.

    This is replacement for the GNU Make system we have using up to now.
    SCons is a Python-based system and as such allows scripting within its
    framework more naturally than for Make. The system is checked in on the
    trunk and lives side-by-side with the makefiles. Either scheme can be
    used.

    Some slide titles:
      * Build System Features
      * Make vs. SCons
      * Why switch?
      * Common Makefile/SConscript
      * Directory-level (dispatchers)
      * Times to compile and install all of sim-recon (and clean) on gluon4
      * How to use
      * Output
      * Telling scons to show you what it's doing
      * Change to installation directory Structure
      * Documentation
[54]https://halldweb1.jlab.org/wiki/index.php/SCons_Build_System

    Retrieved from
"https://halldweb1.jlab.org/wiki/index.php/GlueX_Offline_Meeting,_November_13,_2013"

References

   41. 
https://halldweb1.jlab.org/wiki/images/1/11/Data_Management_Plan_Hall_D_v2.pdf
   42. https://halldsvn.jlab.org/repos/tags/sim-recon-2013-10-17/RELEASE
   43. https://www.dropbox.com/s/n88rlj9kjjo14bz/workflowReq.pdf
   44. 
http://argus.phys.uregina.ca/cgi-bin/private/DocDB/ShowDocument?docid=2350
   46. https://halldweb1.jlab.org/wiki/index.php/2013_Software_Review
   47. 
https://www.dropbox.com/s/utaaxfvtisefm3d/12GeV_Software_Review_2013_v3.pdf
   48. 
http://argus.phys.uregina.ca/cgi-bin/private/DocDB/ShowDocument?docid=2350
   49. https://www.jlab.org/indico/
   51. 
https://halldweb1.jlab.org/talks/2013-4Q/2013-11-13-iu-minidatachallenge.pdf
   53. https://halldweb1.jlab.org/wiki/images/4/49/20131113_scons.pdf
   54. https://halldweb1.jlab.org/wiki/index.php/SCons_Build_System

-- 
Mark M. Ito, Jefferson Lab, (757)269-5295, marki at jlab.org