[Halld-offline] Data Challenge Meeting Minutes, August 27, 2012

[Mark M. Ito]

Folks,

Find the minutes at

 
https://halldweb1.jlab.org/wiki/index.php/GlueX_Data_Challenge_Meeting,_August_27,_2012

and below.

   -- Mark
_____

GlueX Data Challenge Meeting, August 27, 2012
Minutes

    Present:
      * CMU: Curtis Meyer
      * EVO: Matt Shepherd
      * FSU: Nathan Sparks
      * JLab: Mark Ito (chair), Elton Smith, Simon Taylor
      * UConn: Richard, [student?]

JLab Farm Mini Data Challenge

    Mark gave a snapshot of the current mini challenge. See his [17]wiki
    page for details.
      * The current set of jobs has been able to saturate the Hall D share
        of the farm, which is only about 4% at this point.
      * Richard will look into how much of the 35 kB per event is real raw
        data and how much is truth information.
      * Most of the analysis jobs (HD_ROOT) crashed due to the
        self-declared memory limit of 2 GB. Paul Mattione has checked in an
        option to cut-off reconstruction of high multiplicity events. This
        may help.
      * One of the next steps is to produce output data in REST format.
      * Richard asked about proceeding with a grid-based data challenge. We
        decided some time ago that we would pursue this, and re-endorsed
        that decision. Richard will propose a plan at the next meeting.
      * We discussed the idea of moving reconstructed data from the grid
        for storage on tape at JLab. Mark will look into current
        availability of tape resources. This would exercise the SRM
        facility that we plan to use.

CernVM

    Mark described a system, [18]CernVM, used by the LHC experiments, for
    mass distribution of experimental software in a platform-independent
    form. It involves a standard virtual machine and an exported file
    system so that end users (or grid nodes) need not build the software
    themselves. This was suggested as an option by one of the reviewers at
    the June Software Review.

    Mark and Richard both thought that this was probably overkill for us,
    despite that fact that it solves many of the problems that we encounter
    regularly. The overhead may not be worth it. The current plan is to
    continue to rely on locally installed versions in a central location,
    available publicly within each institution.

    Retrieved from
 
"https://halldweb1.jlab.org/wiki/index.php/GlueX_Data_Challenge_Meeting,_August_27,_2012"

References

   17. 
https://halldweb1.jlab.org/wiki/index.php/Mini_Data_Challenge_Status,_August_27,_2012
   18. http://cernvm.cern.ch/portal/