[Halld-offline] Software Meeting Minutes, March 5, 2019
Mark Ito
marki at jlab.org
Wed Mar 6 17:10:10 EST 2019
Folks,
Please find the minutes below and here
<https://halldweb.jlab.org/wiki/index.php/GlueX_Software_Meeting,_March_5,_2019#Minutes>.
-- Mark\
_______________________________________
Minutes, GlueX Software Meeting, March 5, 2019
Present:
* *CMU: * Naomi Jarvis
* *JLab: * Shankar Adhikari, Alexander Austregesilo, Thomas Britton,
Eugene Chudakov, Mark Dalton, Sean Dobbs, Stuart Fegan, Mark Ito
(chair), David Lawrence, Justin Stevens, Simon Taylor, Beni Zihlmann
There is a recording of this meeting <https://bluejeans.com/s/21pkN/> on
the BlueJeans site. Use your JLab credentials to access it.
Announcements
1. Moving simple_email_list
<https://mailman.jlab.org/pipermail/halld-offline/2019-March/003544.html>.
The scripts are moving from Subversion to Git. Cron jobs run by the
gluex account should use /home/gluex/simple_email_list rather than
/group/halld/Software/scripts/simple_email_list to access the lists
and the script. (Reported by Mark)
2. Another way to provide feedback on wiki pages
<https://mailman.jlab.org/mailman/private/gluex-collaboration/2019-February/005115.html>.
You can use the "discussion" tab present on all wiki pages. The
email will be sent to the author(s). (Reported by Mark)
3. Did you submit a Project to MCwrapper-bot that you no longer need?
Or does your project have enough data that you don't care about the
outstanding data? You can now go to the dashboard and right click on
your project row to *Recall outstanding jobs* from a project. Or
*Declare the project completed.* Or *cancel the project.* All these
come with stipulation of ownership. (Reported by Thomas)
Review of minutes from the February 5 meeting
We went over the minutes
<https://halldweb.jlab.org/wiki/index.php/GlueX_Software_Meeting,_February_5,_2019#Minutes>.
* Thomas will be giving two talk on MCwrapper one in a general session
and one at the OSG user training session.
* David reported that batch 1 of the the Spring 2018 reconstruction
has gone through NERSC and batch 2 is in progress. We are limited by
the observed 2.5 Gb/s rate of transfer of the raw data out of the
Lab. Bryan Hess is looking at why this is less than the 10 Gb/s
bandwidth that is advertised. With the additional 9 M units we
received from Hall B, we have just enough allocation to finish the
run. Recall that we only received about 1/3 of our requested allocation.
* David and Chris Larrieu are looking at using an allocation at the
Pittsburgh Supercomputing Center. We will probably try to do a batch
on the JLab farm as well.
* Thomas has submitted a test, using XROOTD to stream random trigger
data to OSG nodes from a UConn server. We await the results.
* Edgar Fajardo of the OSG has advocated using StashCache to
distribute the random trigger data.
* David Lawrence will be speaking at the Machine Learning Lunch tomorrow.
o From the Slack channel #ml: Reminder that the ML Lunch Series
will meet tomorrow (Wednesday, 3/6) in CC F324-25 (assuming it's
available) from 12-1PM. David Lawrence will present recent work
on "Machine Learning for Particle Tracking". Look forward to
seeing everyone!
Report from the February 26 HDGeant4 Meeting
We went over the minutes
<https://halldweb.jlab.org/wiki/index.php/HDGeant4_Meeting,_February_26,_2019#Minutes>.
On Alex's ρ analysis, there were some comments:
* Thomas confirmed that the geometry used for HDG3 and HDG4 were the same.
* The start counter problem noted last time was fixed by Richard
Jones. Alex re-ran the comparisons and several of the plots look to
be in better agreement, however...
* The difference in efficiency as a function of energy persists.
Differences remain even if the comparison is done with no trigger
simulation cut.
* Sean believes the differences are due to shower energy and timing
problems when using HDG4.
Report from the SciComp Meeting on February 28
1. HOW2019 <https://indico.cern.ch/event/759388/timetable/#20190318> is
coming up.
2. Switch-over of the farm to 100% Slurm should be announced soon.
3. SciComp is interested in feedback on the Slurm experience.
Discussion/proposal for making transition to G4
We discussed the proposal Matt Shepherd sent to the Offline Email List
<https://mailman.jlab.org/pipermail/halld-offline/2019-March/003543.html>.
In essence it proposes that the collaboration support HDG3 for data up
to including Spring 2017, and support HDG4 for Spring 2018 data and
beyond. This will save having to tune both versions to match all of our
data sets.
* Mark I. thought that the proposal was reasonable.
* Justin also thought the proposal was reasonable.
* Eugene objected to the mechanism where mcsmear bombs when using
smearing constants inconsistent with the version of Geant used.
o Mark I. thought that bombing has the advantage of preventing the
naive user from making mistakes.
o Thomas pointed out that MCwrapper would have to pass errors of
this sort back to the user.
* There was a question about whether the HDDM output from HDG3 and
HDG4 records information about which program produced it. No one
knew for sure.
* Eugene gave an alternate proposal: he feels strongly that all
results, including those that we have completed, and in particular
the J/ψ analysis, should be analyzed using both HDG3 and HDG4. We
should not go forward and adopt HDG4 as the default until these
comparisons with full physics analyses are done and differences
understood.
* Justin proposed a compromise via modification of Matt's proposal:
1. Drop the wording about which versions of HDG3/4 are supported
for specific data sets.
2. Add that going forward HDG4 is the default. Comparative studies
between HDG3 and HDG4 are not discouraged and the ability to do
such studies should be maintained, but HDG4 is the default choice.
* Mark D. thought that tuning both versions is not really twice the
work. Once a system is worked out for one, it can be applied to the
other.
In the end Mark I. did not think that we had reached a consensus on any
of the proposals. He agreed to come up with compromise wording and send
it to the group. Thomas pointed out that we can discuss this further at
the HDGeant4 meeting.
[Added in press: after reviewing the discussion carefully, Mark was not
able to come up with a proposal about which, in his judgment, a
consensus could be formed. There is not enough middle ground.]
------------------------------------------------------------------------
Review of recent issues and pull requests
* David found and fixed a problem with the use of mutex in the CCAL
monitoring code. It will come in as a future pull request.
* Sean suspects there are some deep pathologies in the analysis
library, causing memory leaks and code crashes. This came up in the
discussion of halld_recon issue #111
<https://github.com/JeffersonLab/halld_recon/issues/111>.
* We noted that Dmitry has acknowledged Sean's report of a memory leak
in CCDB. See ccdb issue #61
<https://github.com/JeffersonLab/ccdb/issues/61>.
* Eugene made a feature request for a variable length list of floats
for user-defined uses in the HDDM generated event format. See
halld_sim issue #44
<https://github.com/JeffersonLab/halld_sim/issues/44>
* Eugene make a request for development of an C++ interface to the
HDDM event format to hide details of handling the HDDM format from
the event-generator developer. See halld_sim issue #43
<https://github.com/JeffersonLab/halld_sim/issues/43>.
Retrieved from
"https://halldweb.jlab.org/wiki/index.php?title=GlueX_Software_Meeting,_March_5,_2019&oldid=91697"
* This page was last modified on 6 March 2019, at 17:07.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://mailman.jlab.org/pipermail/halld-offline/attachments/20190306/3e8adaba/attachment.html>
More information about the Halld-offline
mailing list