[Halld-offline] Data Challenge Meeting Minutes, October 8, 2012

[Mark M. Ito]

Challengers,

Find the minutes below and at 
https://halldweb1.jlab.org/wiki/index.php/GlueX_Data_Challenge_Meeting,_October_8,_2012#Minutes 
.

   -- Mark
_____

GlueX Data Challenge Meeting, October 8, 2012
Minutes

    Present:
      * CMU: Paul Mattione, Curtis Meyer
      * JLab: Mark Ito (chair), David Lawrence, Simon Taylor

JLab Farm Priority

    Paul asked if there was a special account. one that gets increased
    priority, that we could use, like the production accounts in CLAS (e.
    g., clasg13). Mark noted that those accounts are enhanced only relative
    to other CLAS users. There is still an overall allocation per Hall.
    Hall D's allocation is currently 4% no matter how we split it up
    internally.

    More broadly, Mark promised to research how the current scheme is
    executed in detail. His memory of these details are from the old LSF
    days.

JLab Farm Mini-Challenge Status

    Mark showed the [17]summary statistics from the now-completed
    mini-challenge which was producing REST formatted data. There is still
    a poor yield (79%) of output files produced by a job, and that in fact
    not all of those were complete. The outstanding memory issue has not
    been addressed, however.

Large, Usable Pythia Sample

    We discussed the idea, endorsed at the collaboration meeting, of making
    an effort to generate 2 billion Pythia events on some combination of
    our current resources. Mark [18]outlined some of the issues. We also
    discussed [19]Richard's recent email describing software changes he
    advocates before we get started. Some points from the discussion:
      * We need a standard software suite before starting. Practically that
        means putting in things that are not in the repository yet, and
        eliminating some things that are. We decided:
           + to put in the changes to REST format that Richard mentioned
           + to not wait for the changes to the HDDM format that he
             describes since the HDDM_s data will not be kept anyway (for
             the most part). We will have to run this argument by Richard.
           + to not include the new BCAL digitization scheme from David
      * We need to standardize the configuration files, command line
        arguments, and random number seed schemes across all production
        sites.
      * We will start at all three sites and see how things go, i. e., no
        per-site goal at first.
      * We thought that 2 billion events was indeed a reasonable total to
        shoot for.
      * We set two weeks (the next meeting) as a goal for being ready to
        start.
      * We enjoined Curtis to make a request to IT Division to increase our
        share of the farm to 50% from 4%. (He actually volunteered.)

    Retrieved from
"[20]https://halldweb1.jlab.org/wiki/index.php/GlueX_Data_Challenge_Mee
    ting,_October_8,_2012"

References

   17. 
https://halldweb1.jlab.org/wiki/index.php/Mini_Data_Challenge_Status,_October_8,_2012
   18. https://halldweb1.jlab.org/wiki/index.php/Large,_usable_Pythia_sample
   19. 
https://halldweb1.jlab.org/wiki/index.php/Software_improvements_from_Richard

-- 
Mark M. Ito
Jefferson Lab (www.jlab.org)
(757)269-5295