[Halld-offline] Fwd: 100x Slower MC Generation With version_4.0.0 Software

Fri Jan 25 17:38:44 EST 2019

Justin,

Yes, that was the decision at that time, but then as I looked into doing
this, I discovered this code in the hdgeant codebase that David had put in
to create the capability to dynamically compile and load the hdds library
from sources in ccdb at runtime. At that point, I stopped doing any further
work on this until hearing more about that project from David.

-Richard Jones

On Fri, Jan 25, 2019 at 5:22 PM Justin Stevens <jrsteven at jlab.org> wrote:

> I thought the discussion at the January 8th software meeting was that we
> should make the DIRC inactive in hdgeant3, so it wouldn’t cause these kinds
> of issues
> https://halldweb.jlab.org/wiki/index.php/GlueX_Software_Meeting,_January_8,_2019#Merging_the_DIRC_branches
> <https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fhalldweb.jlab.org%2Fwiki%2Findex.php%2FGlueX_Software_Meeting%2C_January_8%2C_2019%23Merging_the_DIRC_branches&data=02%7C01%7CHallD-Offline%40jlab.org%7Ce2e98f8e5cd2413f365108d68315e635%7Cb4d7ee1f4fb34f0690372b5b522042ab%7C1%7C0%7C636840527427359161&sdata=zrWBnCuOX5fPosIaizNtQY0yzoDLo%2Bq%2F9%2F1H0huLOyc%3D&reserved=0>
> .
>
> The suggestion was to use a run-dependent CCDB constant
> https://halldweb.jlab.org/cgi-bin/ccdb/versions?table=/DIRC/install_status
> <https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fhalldweb.jlab.org%2Fcgi-bin%2Fccdb%2Fversions%3Ftable%3D%2FDIRC%2Finstall_status&data=02%7C01%7CHallD-Offline%40jlab.org%7Ce2e98f8e5cd2413f365108d68315e635%7Cb4d7ee1f4fb34f0690372b5b522042ab%7C1%7C0%7C636840527427359161&sdata=jwHYgD0kI3d3zIdK6b9THJi4BXZnV466uQ1GCjrtGG0%3D&reserved=0> to
> determine at run time in hdgeant3 if the DIRC material should be included
> or not.  For install_status = 0 the DIRC should be excluded entirely, but
> for install_status = 1 the DIRC could be included as dead material (to see
> the effects on other subsystems) but should be inactive to not trace all
> the cherenkov photons (which is where the major computation slowdown comes
> from), since we will never simulate the DIRC with hdgeant3.
>
> Of course, if it’s possible to get the geometry from CCDB dynamically in
> hdgeant3 (like we can for hdgeant4) this would be ideal.
>
> -Justin
>
> On Jan 25, 2019, at 4:26 PM, Richard Jones <richard.t.jones at uconn.edu>
> wrote:
>
> Hello Jon,
>
> There is nothing at the moment. This is a good question to the offline
> software group. One idea might be for the master branch of hdds to contain
> the latest image of the detector, and then have various other named
> branches for earlier run periods, like spring_2017, fall_2018 and the like.
> How does that sound to you? Of course, David's solution where he builds the
> hdgeant geometry dynamically at runtime from sources in ccdb would be the
> most flexible, and would make these special branches unnecessary.
>
> -Richard
>
> On Fri, Jan 25, 2019 at 4:20 PM Jonathan Zarling <jzarling at iu.edu> wrote:
>
>> Ah ok, got it. So the hdds geometry includes the dirc regardless of run
>> number? Is there any documentation you can point me to for the various use
>> cases at present for hdgeant/hdgeant4 with this latest software?
>>
>> Jon
>>
>> On Fri, Jan 25, 2019 at 4:08 PM Richard Jones <rjones30 at gmail.com> wrote:
>>
>>> Hello Jon,
>>>
>>> Can you switch to using ccdb as your source for the geometry? The hdds
>>> text-file geometry now has the dirc in it, and I don't think that is what
>>> you want. For now and all times future, you want to use the run-dependent
>>> geometry from the ccdb, rather than the latest image from hdds, unless you
>>> have created your own private hdds branch for some study you are working on
>>> with a custom geometry.
>>>
>>> To use hdgeant (not hdgeant4) with ccdb geometry takes a bit of work at
>>> present, but at one point Dave Lawrence was working on a system for use
>>> with hdgeant that would dynamically compile and link the geometry package
>>> from the sources in ccdb at runtime, without having to extract the xml
>>> files by hand for the desired run number and build a custom hdgeant for a
>>> given run. I have cc'ed Dave on this email, as he might be able to update
>>> us on the status of that work. Dave, did that effort ever materialize?
>>>
>>> -Richard
>>>
>>> On Fri, Jan 25, 2019 at 3:53 PM Jonathan Zarling <jzarling at iu.edu>
>>> wrote:
>>>
>>>> Hi Richard et al,
>>>>
>>>> Looks like I am using the path $GLUEX_TOP/hdds/hdds-4.0.0/main_HDDS.xml
>>>> for $JANA_GEOMETRY_URL. I'm using run number 30300 as a test case.
>>>>
>>>>
>>>> Jon
>>>>
>>>> On Thu, Jan 24, 2019 at 5:20 PM Richard Jones <rjones30 at gmail.com>
>>>> wrote:
>>>>
>>>>> Hello Jon,
>>>>>
>>>>> What is your value of JANA_GEOMETRY_URL? What is your simulation run
>>>>> number?
>>>>>
>>>>> -Richard Jones
>>>>>
>>>>> On Thu, Jan 24, 2019 at 4:48 PM Jonathan Zarling <jzarling at iu.edu>
>>>>> wrote:
>>>>>
>>>>>> Hey gang,
>>>>>>
>>>>>> My MC jobs that I run locally at IU have gone from 5 minutes to run
>>>>>> to 10 hours when using software version "version_4.0.0". I'm running
>>>>>> geant3. Has anyone else tried working with this build yet?
>>>>>>
>>>>>> Possibly also related: during the geant step I get many warning
>>>>>> messages of the form: "Warning in savehits: unsaved hit information found
>>>>>> from sensitive volume XXXX, hit discarded". These blow up my logfiles to
>>>>>> ~hundreds of megabytes.
>>>>>>
>>>>>> I tried running with version_3.8 and version_3.9 too. These ran fast
>>>>>> and didn't produce the same warning messages.
>>>>>>
>>>>>> I experience this both with a photon gun and an omega->3pi simulation.
>>>>>>
>>>>>> Cheers,
>>>>>> Jon
>>>>>>
>>>>>> --
>>>>>> You received this message because you are subscribed to the Google
>>>>>> Groups "GlueX Software Help" group.
>>>>>> To unsubscribe from this group and stop receiving emails from it,
>>>>>> send an email to gluex-software+unsubscribe at googlegroups.com.
>>>>>> To post to this group, send email to gluex-software at googlegroups.com.
>>>>>> To view this discussion on the web visit
>>>>>> https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgroups.google.com%2Fd%2Fmsgid%2Fgluex-software%2FCACPp7wHuYrG6i6FakKik%252BT69Q9LxHv-aSJTvQbH_wHiwtBHcpw%2540mail.gmail.com&data=02%7C01%7CHallD-Offline%40jlab.org%7Ce2e98f8e5cd2413f365108d68315e635%7Cb4d7ee1f4fb34f0690372b5b522042ab%7C1%7C0%7C636840527427359161&sdata=Yw3WfyCN%2FdBgwkYDusKRpjs6xdtNxL6tLuWN%2BFW7pJw%3D&reserved=0
>>>>>> <https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgroups.google.com%2Fd%2Fmsgid%2Fgluex-software%2FCACPp7wHuYrG6i6FakKik%252BT69Q9LxHv-aSJTvQbH_wHiwtBHcpw%2540mail.gmail.com%3Futm_medium%3Demail%26utm_source%3Dfooter&data=02%7C01%7CHallD-Offline%40jlab.org%7Ce2e98f8e5cd2413f365108d68315e635%7Cb4d7ee1f4fb34f0690372b5b522042ab%7C1%7C0%7C636840527427359161&sdata=GR4WSubE0WTUmJkXNzYx97bZliRWJ%2FlOk7faOiK5Zv4%3D&reserved=0>
>>>>>> .
>>>>>> For more options, visit https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgroups.google.com%2Fd%2Foptout&data=02%7C01%7CHallD-Offline%40jlab.org%7Ce2e98f8e5cd2413f365108d68315e635%7Cb4d7ee1f4fb34f0690372b5b522042ab%7C1%7C0%7C636840527427359161&sdata=67HP5k61%2BRwAX80EmcpPBaEyoiPsbImzAc8ytqsnWcI%3D&reserved=0
>>>>>> <https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgroups.google.com%2Fd%2Foptout&data=02%7C01%7CHallD-Offline%40jlab.org%7Ce2e98f8e5cd2413f365108d68315e635%7Cb4d7ee1f4fb34f0690372b5b522042ab%7C1%7C0%7C636840527427359161&sdata=67HP5k61%2BRwAX80EmcpPBaEyoiPsbImzAc8ytqsnWcI%3D&reserved=0>
>>>>>> .
>>>>>>
>>>>>
>>>>> --
>>>>> You received this message because you are subscribed to the Google
>>>>> Groups "GlueX Software Help" group.
>>>>> To unsubscribe from this group and stop receiving emails from it, send
>>>>> an email to gluex-software+unsubscribe at googlegroups.com.
>>>>> To post to this group, send email to gluex-software at googlegroups.com.
>>>>> To view this discussion on the web visit
>>>>> https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgroups.google.com%2Fd%2Fmsgid%2Fgluex-software%2FCABfxa3RO%253D49egcVp0hsL%252BO9rZQY-9mJw2R1BYOp5KeQoD0%252BkPw%2540mail.gmail.com&data=02%7C01%7CHallD-Offline%40jlab.org%7Ce2e98f8e5cd2413f365108d68315e635%7Cb4d7ee1f4fb34f0690372b5b522042ab%7C1%7C0%7C636840527427369175&sdata=F9Se4%2BgN4pcyl5Ql2u4cCDAS6GAk2amyNOh6JtJM8MI%3D&reserved=0
>>>>> <https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgroups.google.com%2Fd%2Fmsgid%2Fgluex-software%2FCABfxa3RO%253D49egcVp0hsL%252BO9rZQY-9mJw2R1BYOp5KeQoD0%252BkPw%2540mail.gmail.com%3Futm_medium%3Demail%26utm_source%3Dfooter&data=02%7C01%7CHallD-Offline%40jlab.org%7Ce2e98f8e5cd2413f365108d68315e635%7Cb4d7ee1f4fb34f0690372b5b522042ab%7C1%7C0%7C636840527427369175&sdata=OOvUv3pOr4uF7Bo4d5Umj4U6q9XoF%2FBRmT%2BTGz61eXE%3D&reserved=0>
>>>>> .
>>>>> For more options, visit https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgroups.google.com%2Fd%2Foptout&data=02%7C01%7CHallD-Offline%40jlab.org%7Ce2e98f8e5cd2413f365108d68315e635%7Cb4d7ee1f4fb34f0690372b5b522042ab%7C1%7C0%7C636840527427369175&sdata=0WUJSeLSa71s1QYCXcmECJ2lNa5z9zFDm7IzD9%2BpQgo%3D&reserved=0
>>>>> <https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgroups.google.com%2Fd%2Foptout&data=02%7C01%7CHallD-Offline%40jlab.org%7Ce2e98f8e5cd2413f365108d68315e635%7Cb4d7ee1f4fb34f0690372b5b522042ab%7C1%7C0%7C636840527427369175&sdata=0WUJSeLSa71s1QYCXcmECJ2lNa5z9zFDm7IzD9%2BpQgo%3D&reserved=0>
>>>>> .
>>>>>
>>>> _______________________________________________
> Halld-offline mailing list
> Halld-offline at jlab.org
> https://mailman.jlab.org/mailman/listinfo/halld-offline
>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://mailman.jlab.org/pipermail/halld-offline/attachments/20190125/a3d83d50/attachment-0002.html>