[Halld-offline] to wait or not to wait

[Richard Jones]

Curtis,

Ok, let me propose the following.  Next offline meeting I will present the state of the conversion to the distilled SEST format (Simulated Event STorage format).  At that point we can decide whether it is completed and tested sufficiently well to go into production or not, or whether to proceed with the simulation hddm data model in its present state.

SEST will be what I call the simulated event storage format.  SEST becomes REST as soon as it has passed through dana and the hits information and simulation-truth elements are suppressed.  It will contain the simulated hitView structure (properly factorized into pure hits and pure truth tags) plus a hook for appending the REST structure (for people who want both hits and reconstructed results for studies) plus a small handful of other extended truth tags that have been introduced by David and Simon over the years, such as mcTrajectory, etc.  A tool will be provided to strip arbitrary SEST files down to bare hits.  Such "bare hits" files will also be valid SEST files, but missing the information contained in the extra structures.  The danahddm plugin will be able to read any SEST file and properly handle situations where various types of information are available or not, according to David's factory schema.

-Richard J.


On 10/10/2012 12:48 PM, Curtis A. Meyer wrote:
> Hi Richard -
>
>   if saving the intermediate storage requirements helps on the grid production, then there is a case for waiting.
> However, there is also a good case to be made for running the exact same version of the code at both
> Jefferson Lab and on the OSG for this data challenge, and I think that the need for the large sample
> is high enough, that I would feel better NOT waiting too long to start things.
>
>    That said, it felt like the changes that you need to make are substantial enough that they probably
> cannot be implemented and tested on a very short time scale. If the time scale is ~week, then I would
> say go for it, however, if is ~month, I would prefer to move forward ASAP.
>
>   My two cents ---  Curtis
>
> -------
> Prof. Curtis A. MeyerDepartment of Physics
> Phone: (412) 268-2745Carnegie Mellon University
> Fax:      (412) 681-0648  Pittsburgh, PA 15213
> curtis.meyer at cmu.edu <mailto:curtis.meyer at cmu.edu> http://www.curtismeyer.com/
>
>
>
>
>
> On Oct 10, 2012, at 12:29 PM, Richard Jones wrote:
>
>> Hello Paul,
>>
>> I saw this proposal in the minutes Mark circulated.  I am satisfied with it, and it means that production can proceed before I get all of these changes checked in and validated.  I am still hoping to get the changes in before I begin the grid production, since I am saving considerable volumes of the intermediate simulation output.  Do you agree with this?
>>
>> -Richard J.
>>
>>
>> On 10/9/2012 5:06 PM, Paul Mattione wrote:
>>> Hey Richard, I went ahead and modified the rest.xml file with the TOF uncertainties.
>>>
>>> At this stage are REST and HDDM ready for generating the large pythia sample?  I know that you also wanted to make some other changes to HDDM, such as separating the truth hits from the reconstructed ones.  But these should only affect the regular HDDM format, and not the REST one, right?  Although I suppose that if we wanted to save some % of the full data we'd want these other upgrades.  Should we make a tagged release and start without it anyway?
>>>
>>>  - Paul
>>>
>>> Begin forwarded message:
>>>
>>>> *From: *Hall-D.SVN.Repository at jlab.org <mailto:Hall-D.SVN.Repository at jlab.org>
>>>> *Date: *October 9, 2012 4:57:33 PM EDT
>>>> *To: *davidl at jlab.org <mailto:davidl at jlab.org>, brash at pcs.cnu.edu <mailto:brash at pcs.cnu.edu>, wolin at jlab.org <mailto:wolin at jlab.org>, zisis at uregina.ca <mailto:zisis at uregina.ca>, mashephe at indiana.edu <mailto:mashephe at indiana.edu>, remitche at indiana.edu <mailto:remitche at indiana.edu>, zihlmann at jlab.org <mailto:zihlmann at jlab.org>, somov at jlab.org <mailto:somov at jlab.org>, staylor at jlab.org <mailto:staylor at jlab.org>, kmoriya at indiana.edu <mailto:kmoriya at indiana.edu>, pmatt at jlab.org <mailto:pmatt at jlab.org>, leckey at jlab.org <mailto:leckey at jlab.org>
>>>> *Subject: **r9757 - trunk/sim-recon/src/libraries/HDDM*
>>>>
>>>> Author: pmatt
>>>> Date: 2012-10-09 16:57:33 -0400 (Tue, 09 Oct 2012)
>>>> New Revision: 9757
>>>>
>>>> Modified:
>>>>   trunk/sim-recon/src/libraries/HDDM/rest.xml
>>>> Log:
>>>> Added uncertainties to tofPoint, and added units to tofPoint and startHit.
>>>>
>>>>
>>>
>>
>

-------------- next part --------------
An HTML attachment was scrubbed...
URL: https://mailman.jlab.org/pipermail/halld-offline/attachments/20121010/845a21cd/attachment.html 
-------------- next part --------------
A non-text attachment was scrubbed...
Name: smime.p7s
Type: application/pkcs7-signature
Size: 3103 bytes
Desc: S/MIME Cryptographic Signature
Url : https://mailman.jlab.org/pipermail/halld-offline/attachments/20121010/845a21cd/attachment.bin