[Halld-offline] Offline Software Meeting Minutes, July 13, 2018

[Mark Ito]

Folks,

Please find the minutes here 
<https://halldweb.jlab.org/wiki/index.php/GlueX_Offline_Meeting,_July_13,_2018#Minutes> 
and below.

   -- Mark

____________________


    Minutes, GlueX Offline Meeting, July 13, 2018

Present:

  * *CMU: * Naomi Jarvis
  * *JLab: * Thomas Britton, Mark Ito (chair), Simon Taylor, Beni Zihlmann
  * *UConn: * Richard Jones
  * *Yerevan: * Hrach Marukyan

There is a recording of this meeting <https://bluejeans.com/s/MYEhg/> on 
the BlueJeans site. Use your JLab credentials to access it.


      Announcements

 1. *New sim-recon version: 2.27.0, new HDGeant4 version: 1.7.0, new
    version set: 2.37
    <https://mailman.jlab.org/pipermail/halld-offline/2018-July/003243.html>*.
    These updates were meant to provide a basis for HDGeant3 vs.
    HDGeant4 comparisons.
 2. *New sim-recon version: 2.27.0, new HDGeant4 version: 1.7.0, new
    version set: 2.37
    <https://mailman.jlab.org/pipermail/halld-offline/2018-July/003246.html>*.
    This version set is for simulation of Spring 2017 data and restores
    generation of CDC hits missing in the previous version. Simulation
    of bggen events using this version set will begin next week.
      * We agreed that, in the future, we should have a definite
        commitment by an individual to check that a large simulation
        launch is producing reasonable results.


      Review of minutes from the June 29 meeting

We went over the minutes from the last meeting 
<https://halldweb.jlab.org/wiki/index.php/GlueX_Offline_Meeting,_June_29,_2018#Minutes>. 


The reproducibility problem reported last time has been solved. Simon 
reported that it was caused by variation in the order of hits presented 
to tracking. It was solved by using "stable sort" to guarantee the same 
ordering of hits on each run of the reconstruction.

Beni reported another problem where (not reproducibly) a block of 40 
events can get lost upon input from an EVIO event source. This will get 
fixed in the re-write of the JANA package.


      Report from the HDGeant4 Meeting

Mark reviewed his notes 
<https://halldweb.jlab.org/wiki/index.php/HDGeant4_Meeting,_July_6,_2018#Notes> 
from the meeting on July 6. Please see the notes for details.

Since the meeting Thomas and Justin got together and decided on a set of 
nine single particle gun configurations (protons, π^− s, and photons at 
various angle/energy combinations) along with the standard signal Monte 
Carlo samples (ρ, φ, ω, π^0 ). A start at generating these samples has 
been made.


      Splitting up Sim-Recon

Last weekend, Mark announced a test build of the split system 
<https://mailman.jlab.org/pipermail/halld-offline/2018-July/003240.html>. 
He received feedback from one taker, Justin Stevens, who reported 
success with the build.

Richard asked about modification of the HDGeant4 build. Mark has already 
taken care of that, on a branch in the repository. The same story 
applies to gluex_root_analysis.

To transition from sim-recon (unified system) to halld_sim and 
halld_recon (split system), we will have to change several things at the 
same time (or nearly the same time). We agreed on the following schedule.

 1. Early Monday, July 16: deploy the new version of build_scripts as
    the default at JLab. This version supports both the unified and
    split systems and should require no changes by users.
 2. Close of business, Tuesday, July 17: deadline for pushes to the
    unified system. Changes not committed and pushed to the unified
    system will not make it to the split system. Also note that for the
    halld_sim directories, they must appear on the master branch as
    well. All existing from sim-recon will appear in halld_recon.
 3. Early morning Wednesday, July 18: default configuration at JLab
    changes to split system.


      MC Request Form

Thomas presented a new system for submitting requests for Monte Carlo to 
Thomas. Request come in via web form 
<https://halldweb.jlab.org/gluex_sim/SubmitSim.html>. He explains this 
new feature in his recent announcement of MCwrapper 1.15 
<https://mailman.jlab.org/pipermail/halld-offline/2018-July/003251.html>.

The system is backed up with a database. Requests are recorded and 
records of each individual job submitted are also kept. This will enable 
a richer variety of reports to users such as job status, resource usage, 
etc.


      New OSG production status monitor (aka more computing resources
      for GlueX)

Richard has rolled out a new web page 
<https://grendl.phys.uconn.edu/ganglia/?r=day&cs=&ce=&m=load_one&s=by+name&c=&tab=v&vn=Bosco+work+load&hide-hf=false> 
that monitors global job usage on the various university clusters 
available for running our OSG jobs. Since the collaboration meeting he 
has captured eight such clusters and has observed peaks of over 4000 
simultaneous jobs, excluding those running on the OSG proper. The system 
will automatically switch jobs from site to site if any particular site 
gets backed up or goes offline. We first discussed Richard's proposal 
for adding university clusters at the June 1 Offline Meeting 
<https://halldweb.jlab.org/wiki/index.php/GlueX_Offline_Meeting,_June_1,_2018#Request_for_University_Compute_Resources>. 


This is a significant new resource that can be accessed by GlueX OSG 
users with no special action other than specifying "wantjobrouter=true" 
in the job configuration. Other clusters may be added in the future.

Retrieved from 
"https://halldweb.jlab.org/wiki/index.php?title=GlueX_Offline_Meeting,_July_13,_2018&oldid=88238"

  * This page was last modified on 13 July 2018, at 16:11.

-- 
Mark Ito,marki at jlab.org, (757)269-5295

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://mailman.jlab.org/pipermail/halld-offline/attachments/20180713/4695bd2d/attachment.html>