[Halld-offline] [EXTERNAL] auxilliary data file needed for running with HADR=4

Richard Jones richard.t.jones at uconn.edu
Fri May 15 13:57:17 EDT 2020 

Colin, have you back-dated your lookups with some kind of calibdate type
specification.
-Richard

On Fri, May 15, 2020 at 1:56 PM Colin Gleason <gleasonc at jlab.org> wrote:

> *Message sent from a system outside of UConn.*
>
> Richard,
>
> Thanks for the information. My CCDB_CONNECTION is the standard GlueX one
> mysql://ccdb_user@hallddb.jlab.org/ccdb
> <https://urldefense.proofpoint.com/v2/url?u=https-3A__nam10.safelinks.protection.outlook.com_-3Furl-3Dhttp-253A-252F-252Fccdb-5Fuser-2540hallddb.jlab.org-252Fccdb-26data-3D02-257C01-257Crichard.t.jones-2540uconn.edu-257Cbc281fedbdd048fbeafc08d7f8f93aa4-257C17f1a87e2a254eaab9df9d439034b080-257C0-257C0-257C637251621642432402-26sdata-3Dxy08TH3nI1N8efncTZMQcbeH-252BUw2LaN-252B3ZKtxgeTbMI-253D-26reserved-3D0&d=DwIFaQ&c=CJqEzB1piLOyyvZjb8YUQw&r=Te_hCR4EUlJ6iCDYLJ8Viv2aDOR7D9ZZMoBAvf2H0M4&m=JljHSk5ccmZn8wH5--zwWlQbj_T59G1rEe1l3SjQeWU&s=w2UXhuH06eXIgkkGK61JenZysAjI7QuzjRz5kqIWf_c&e= >
>
> CCDB_CONNECTION=mysql://ccdb_user@hallddb.jlab.org/ccdb
> <https://urldefense.proofpoint.com/v2/url?u=https-3A__nam10.safelinks.protection.outlook.com_-3Furl-3Dhttp-253A-252F-252Fccdb-5Fuser-2540hallddb.jlab.org-252Fccdb-26data-3D02-257C01-257Crichard.t.jones-2540uconn.edu-257Cbc281fedbdd048fbeafc08d7f8f93aa4-257C17f1a87e2a254eaab9df9d439034b080-257C0-257C0-257C637251621642432402-26sdata-3Dxy08TH3nI1N8efncTZMQcbeH-252BUw2LaN-252B3ZKtxgeTbMI-253D-26reserved-3D0&d=DwIFaQ&c=CJqEzB1piLOyyvZjb8YUQw&r=Te_hCR4EUlJ6iCDYLJ8Viv2aDOR7D9ZZMoBAvf2H0M4&m=JljHSk5ccmZn8wH5--zwWlQbj_T59G1rEe1l3SjQeWU&s=w2UXhuH06eXIgkkGK61JenZysAjI7QuzjRz5kqIWf_c&e= >
>
> This is from the printenv statement of my environment and should be the
> most up to date version, right? Is there something going on under the hood
> that I'm missing?
>
> On Fri, May 15, 2020 at 1:51 PM Richard Jones <richard.t.jones at uconn.edu>
> wrote:
>
>> Colin and Thomas,
>>
>> This is a known problem. You need to use an updated version of the ccdb
>> geometry. Medium 11 is vacuum, defined as one of the elements of the
>> periodic table. No wonder fluka does not know its properties. I changed
>> vacuum to be defined as a mixture of hydrogen and nitrogen and updated the
>> ccdb a few weeks back. The fix was back-dated to all runs since 2016.
>> Please use an updated version of ccdb.
>>
>> -Richard
>>
>> On Fri, May 15, 2020 at 1:40 PM Colin Gleason <gleasonc at jlab.org> wrote:
>>
>>> *Message sent from a system outside of UConn.*
>>>
>>> I dumped the environments and they are located in this google doc:
>>>
>>>
>>> https://urldefense.proofpoint.com/v2/url?u=https-3A__docs.google.com_document_d_1VAbf8b9dhmzP0Ul0tgwmx5-2DBsXQyna7zlW6welDZlxA_edit-3Fusp-3Dsharing&d=DwIFaQ&c=CJqEzB1piLOyyvZjb8YUQw&r=Te_hCR4EUlJ6iCDYLJ8Viv2aDOR7D9ZZMoBAvf2H0M4&m=JljHSk5ccmZn8wH5--zwWlQbj_T59G1rEe1l3SjQeWU&s=MSvY5yDlXcPb89YSN5XpAYB1pMKSbrUJLwRjbo-s64U&e= 
>>> <https://urldefense.proofpoint.com/v2/url?u=https-3A__nam10.safelinks.protection.outlook.com_-3Furl-3Dhttps-253A-252F-252Furldefense.proofpoint.com-252Fv2-252Furl-253Fu-253Dhttps-2D3A-5F-5Fnam10.safelinks.protection.outlook.com-5F-2D3Furl-2D3Dhttps-2D253A-2D252F-2D252Fdocs.google.com-2D252Fdocument-2D252Fd-2D252F1VAbf8b9dhmzP0Ul0tgwmx5-2D2DBsXQyna7zlW6welDZlxA-2D252Fedit-2D253Fusp-2D253Dsharing-2D26data-2D3D02-2D257C01-2D257Crichard.t.jones-2D2540uconn.edu-2D257Cdf38f324a47d4c1f2feb08d7f8f70eff-2D257C17f1a87e2a254eaab9df9d439034b080-2D257C0-2D257C0-2D257C637251612309155975-2D26sdata-2D3D-2D252FVnrjMhc4DjZxFkEqWFQQoTAOQuKDmhXVveHpOzlxGI-2D253D-2D26reserved-2D3D0-2526d-253DDwMFaQ-2526c-253DCJqEzB1piLOyyvZjb8YUQw-2526r-253D-5Fp-5FZf1fP8D9GtGtaEgIPjViLbHJLGv-5FRV32KAKGtMbE-2526m-253DJt5DGYkn6UBnm7aaKn4QomtiJpeYlkhgLkhrYEJRDDY-2526s-253DZkkchbqMAM01RQcYE3H3Xuh5OPnJqh6q5WnW-2DOMntu8-2526e-253D-26data-3D02-257C01-257Crichard.t.jones-2540uconn.edu-257Cbc281fedbdd048fbeafc08d7f8f93aa4-257C17f1a87e2a254eaab9df9d439034b080-257C0-257C0-257C637251621642442399-26sdata-3DG-252FFkW54AwUgWs8-252BFCG30tImsUP1r-252B9ZV2nLksUkwX2A-253D-26reserved-3D0&d=DwIFaQ&c=CJqEzB1piLOyyvZjb8YUQw&r=Te_hCR4EUlJ6iCDYLJ8Viv2aDOR7D9ZZMoBAvf2H0M4&m=JljHSk5ccmZn8wH5--zwWlQbj_T59G1rEe1l3SjQeWU&s=y17G02N3N7PnFvdn52U3ri_5HICdbvQFWmhhc3ihi7g&e= >
>>>
>>> On Fri, May 15, 2020 at 12:49 PM Thomas Britton <tbritton at jlab.org>
>>> wrote:
>>>
>>>> Is there a material not found? Medium 11?
>>>>
>>>> Haven’t seen that before. Can you modify the MakeMC to dump your
>>>> environment right before the block of logging info. Compare interactive to
>>>> the one run on the farm. My guess is there is some small difference between
>>>> the two....
>>>>
>>>> Thomas Britton
>>>>
>>>> On May 15, 2020, at 12:45 PM, Colin Gleason <gleasonc at jlab.org> wrote:
>>>>
>>>> 
>>>> No crashes- it runs fine without any errors. Logs are located at
>>>> /volatile/halld/home/gleasonc/pippimeta/Simulation/2017-01_4.19_G3/HADR4_b/log.
>>>> Looking carefully at onne of the log files, I find:
>>>>>
>>>>>  settofg: RF reference plane set to    65.0000000     cm
>>>>>           10  events simulated
>>>>>           20  events simulated
>>>>>           30  events simulated
>>>>>           40  events simulated
>>>>>           50  events simulated
>>>>>           60  events simulated
>>>>>           70  events simulated
>>>>>           80  events simulated
>>>>>           90  events simulated
>>>>>          100  events simulated
>>>>>          200  events simulated
>>>>>  MICAP GTMED: GEANT Medium    11 not found ==> STOP
>>>>> RUNNING MCSMEAR
>>>>> 0
>>>>> 10000
>>>>
>>>> It looks like this is where things go wrong, as only ~250 of the ~2k
>>>> generated events are getting processed.
>>>>
>>>> This issue, or STOP, does not appear when I run interactively.  Running
>>>> interactively would show:
>>>>
>>>>> **** NUMBER OF EVENTS PROCESSED =     10000
>>>>>
>>>>>           **** RANDOM NUMBER GENERATOR AFTER LAST COMPLETE EVENT   2120846575
>>>>>   460615182
>>>>>
>>>>>           **** TIME TO PROCESS ONE EVENT IS =    0.0529 SECONDS
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>  MZEND.   Usage statistics for  2 dynamic stores.
>>>>>
>>>>>
>>>>>    Map of store  0 /GCBANK/
>>>>>
>>>>>    ------------------------
>>>>>
>>>>>
>>>>>    Division                                        Number of times
>>>>>
>>>>>               Kind                Max-size                Garb-coll.
>>>>>
>>>>>             Mode    Position      used   allowed   Wiped  user  auto
>>>>> Pushd Redcd
>>>>>
>>>>>
>>>>>     1 QDIV1    0 1      5203         0   4999968       0     0     0
>>>>>   0     0
>>>>>
>>>>>     2 QDIV2    1 1   2267094   1019031   4999968   10000     0     0
>>>>>   0     0
>>>>>
>>>>>    19 system   1 8   2341269     68180   4999968       0     0     0
>>>>>   0     0
>>>>>
>>>>>    20 Constant 1 2   4999968   2635035   4000000       0     0   141
>>>>> 150     0
>>>>>
>>>>>
>>>>>    Map of store  1 /PAWC/
>>>>>
>>>>>    ------------------------
>>>>>
>>>>>
>>>>>    Division                                        Number of times
>>>>>
>>>>>               Kind                Max-size                Garb-coll.
>>>>>
>>>>>             Mode    Position      used   allowed   Wiped  user  auto
>>>>> Pushd Redcd
>>>>>
>>>>>
>>>>>     1 QDIV1    0 1         2         0   4999585       0     0     0
>>>>>   0     0
>>>>>
>>>>>     2 QDIV2    1 1   4998185      1100   4999585       0     0     0
>>>>>   0     0
>>>>>
>>>>>    19 system   1 8   4998585       111   4999585       0     0     0
>>>>>   0     0
>>>>>
>>>>>    20 HIGZ     0 4   4998585         0   5000000       0     0     0
>>>>>   0     0
>>>>>
>>>>>  RZEND. called for RZFILE
>>>>>
>>>>>
>>>>>
>>>>>  ***** Normal exit from Hall D GEANT *****
>>>>>
>>>>>
>>>>>
>>>>> RUNNING MCSMEAR
>>>>>
>>>>> 2
>>>>>
>>>>> 10000
>>>>>
>>>>
>>>>
>>>> On Fri, May 15, 2020 at 12:34 PM Thomas Britton <tbritton at jlab.org>
>>>> wrote:
>>>>
>>>>> This is tough.  From MCwrapper’s POV it does nothing special when that
>>>>> card is in any given state.  Do you mean it crashes? We’ll need some stack
>>>>> traces.
>>>>>
>>>>>
>>>>>
>>>>> Thomas Britton
>>>>>
>>>>> Staff Scientist, Scientific Computing
>>>>>
>>>>> Jefferson Lab
>>>>>
>>>>>
>>>>>
>>>>> *From: *Colin Gleason <gleasonc at jlab.org>
>>>>> *Sent: *Friday, May 15, 2020 12:29 PM
>>>>> *To: *Richard Jones <richard.t.jones at uconn.edu>; Thomas Britton
>>>>> <tbritton at jlab.org>
>>>>> *Cc: *HallD Software Group <HallD-Offline at jlab.org>
>>>>> *Subject: *Re: [EXTERNAL] auxilliary data file needed for running
>>>>> with HADR=4
>>>>>
>>>>>
>>>>>
>>>>> Hi all,
>>>>>
>>>>>
>>>>>
>>>>> As a follow up to this and to keep a record for others, I can not get
>>>>> the HADR 4 option to work when submitting jobs to the ifarm via MCWrapper
>>>>> batch=2. I get a reasonable output when I run the job interactively, as
>>>>> seen above. I'm using the same environment, but I'm guessing somehow the
>>>>> correct file is not being found in batch mode. I do not see anything that
>>>>> stands out in the log files. Thomas, any suggestions or ideas on why
>>>>> MCWrapper does not recognize this file? My CERNLIB is located at
>>>>> /group/halld/Software/builds/Linux_CentOS7.7-x86_64-gcc4.8.5/cernlib/2005/lib.
>>>>>
>>>>>
>>>>>
>>>>> -Colin
>>>>>
>>>>>
>>>>>
>>>>> On Wed, May 13, 2020 at 9:48 AM Colin Gleason <gleasonc at jlab.org>
>>>>> wrote:
>>>>>
>>>>> Thanks for the information, Richard. Sure enough, I do not have
>>>>> $CERNLIB defined using the standard build. As a workaround to what Sean
>>>>> suggested, and since I am usig C shell, I added
>>>>>
>>>>>
>>>>>
>>>>> setenv CERNLIB
>>>>> /group/halld/Software/builds/Linux_CentOS7.7-x86_64-gcc4.8.5/cernlib/2005/lib
>>>>>
>>>>>
>>>>>
>>>>> to my setup_gluex.csh file that gets sourced when calling my
>>>>> environment. When I tested with 1k generated events, I got 89
>>>>> reconstructed. Before that, as in without flukaaf.dat, I was getting 8.
>>>>> This compares to the ~7% reconstructed events using HADR=1. I will rerun my
>>>>> simulation using this setup.
>>>>>
>>>>>
>>>>>
>>>>> -Ccolin
>>>>>
>>>>>
>>>>>
>>>>> On Wed, May 13, 2020 at 8:53 AM Richard Jones <
>>>>> richard.t.jones at uconn.edu> wrote:
>>>>>
>>>>> Colin and all,
>>>>>
>>>>>
>>>>>
>>>>> An input data file flukaaf.dat is a needed input file for running
>>>>> hdgeant with HADR=4. This file usually resides in $CERNLIB. If CERNLIB is
>>>>> defined on your system, then things should work. If not, then you should be
>>>>> sure to place a copy of flukaaf.dat in the directory from which you run
>>>>> hdgeant. A copy of this is found in the halld-sim repo in the halld
>>>>> software area, or on cvmfs, or on github at the link provided below. Take
>>>>> your pick, they should all be the same.
>>>>>
>>>>>
>>>>>
>>>>>    - /cvmfs/
>>>>>    oasis.opensciencegrid.org/gluex/group/halld/Software/builds/Linux_CentOS7-x86_64-gcc4.8.5-cntr/cernlib/2005/lib/flukaaf.dat
>>>>>    <https://urldefense.proofpoint.com/v2/url?u=https-3A__nam10.safelinks.protection.outlook.com_-3Furl-3Dhttps-253A-252F-252Furldefense.proofpoint.com-252Fv2-252Furl-253Fu-253Dhttps-2D3A-5F-5Fnam10.safelinks.protection.outlook.com-5F-2D3Furl-2D3Dhttps-2D253A-2D252F-2D252Furldefense.proofpoint.com-2D252Fv2-2D252Furl-2D253Fu-2D253Dhttp-2D2D3A-2D5F-2D5Foasis.opensciencegrid.org-2D5Fgluex-2D5Fgroup-2D5Fhalld-2D5FSoftware-2D5Fbuilds-2D5FLinux-2D2D5FCentOS7-2D2D2Dx86-2D2D5F64-2D2D2Dgcc4.8.5-2D2D2Dcntr-2D5Fcernlib-2D5F2005-2D5Flib-2D5Fflukaaf.dat-2D2526d-2D253DDwMFaQ-2D2526c-2D253DCJqEzB1piLOyyvZjb8YUQw-2D2526r-2D253D-2D5Fp-2D5FZf1fP8D9GtGtaEgIPjViLbHJLGv-2D5FRV32KAKGtMbE-2D2526m-2D253D2yyxB2SUMQDNM7BpmwdbEPaT6IB-2D2D5Cn9bHhxQqrrQKg-2D2526s-2D253D63gpT7ZWLQ0R-2D2DWa6hSh-2D2DzaVffpwWqaywCNXMmII8XB8-2D2526e-2D253D-2D26data-2D3D02-2D257C01-2D257Crichard.t.jones-2D2540uconn.edu-2D257Cdf38f324a47d4c1f2feb08d7f8f70eff-2D257C17f1a87e2a254eaab9df9d439034b080-2D257C0-2D257C0-2D257C637251612309155975-2D26sdata-2D3DymFaf91wg76i5zfjuF4IG3UFf8TFvRcJG-2D252F2Z3I5TUHo-2D253D-2D26reserved-2D3D0-2526d-253DDwMFaQ-2526c-253DCJqEzB1piLOyyvZjb8YUQw-2526r-253D-5Fp-5FZf1fP8D9GtGtaEgIPjViLbHJLGv-5FRV32KAKGtMbE-2526m-253DJt5DGYkn6UBnm7aaKn4QomtiJpeYlkhgLkhrYEJRDDY-2526s-253DIw81ro7omlGojsvsoW4h2aXqzP4QN2bGn-5FaOGkp-2DKPo-2526e-253D-26data-3D02-257C01-257Crichard.t.jones-2540uconn.edu-257Cbc281fedbdd048fbeafc08d7f8f93aa4-257C17f1a87e2a254eaab9df9d439034b080-257C0-257C0-257C637251621642442399-26sdata-3D4-252FE3INuVI-252BalKdO4qzDqAiu4Co4-252FUdB6ntEI73ed-252FEQ-253D-26reserved-3D0&d=DwIFaQ&c=CJqEzB1piLOyyvZjb8YUQw&r=Te_hCR4EUlJ6iCDYLJ8Viv2aDOR7D9ZZMoBAvf2H0M4&m=JljHSk5ccmZn8wH5--zwWlQbj_T59G1rEe1l3SjQeWU&s=i9BP-blPwzQxfk5W_RGZfJ20NOj_f3qoAo1yWF7hF_g&e= >
>>>>>    -
>>>>>    /u/group/halld/Software/builds/Linux_CentOS7-x86_64-gcc4.8.5/halld_sim/halld_sim-4.13.0/src/programs/Simulation/HDGeant/flukaaf.dat
>>>>>    -
>>>>>    https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_JeffersonLab_halld-5Fsim_blob_master_src_programs_Simulation_HDGeant_flukaaf.dat&d=DwIFaQ&c=CJqEzB1piLOyyvZjb8YUQw&r=Te_hCR4EUlJ6iCDYLJ8Viv2aDOR7D9ZZMoBAvf2H0M4&m=JljHSk5ccmZn8wH5--zwWlQbj_T59G1rEe1l3SjQeWU&s=9LmUbFKdruMyBOtF1AvMTuiUWdfzdbuS9WQf16qubhw&e= 
>>>>>    <https://urldefense.proofpoint.com/v2/url?u=https-3A__nam10.safelinks.protection.outlook.com_-3Furl-3Dhttps-253A-252F-252Furldefense.proofpoint.com-252Fv2-252Furl-253Fu-253Dhttps-2D3A-5F-5Fnam10.safelinks.protection.outlook.com-5F-2D3Furl-2D3Dhttps-2D253A-2D252F-2D252Furldefense.proofpoint.com-2D252Fv2-2D252Furl-2D253Fu-2D253Dhttps-2D2D3A-2D5F-2D5Fgithub.com-2D5FJeffersonLab-2D5Fhalld-2D2D5Fsim-2D5Fblob-2D5Fmaster-2D5Fsrc-2D5Fprograms-2D5FSimulation-2D5FHDGeant-2D5Fflukaaf.dat-2D2526d-2D253DDwMFaQ-2D2526c-2D253DCJqEzB1piLOyyvZjb8YUQw-2D2526r-2D253D-2D5Fp-2D5FZf1fP8D9GtGtaEgIPjViLbHJLGv-2D5FRV32KAKGtMbE-2D2526m-2D253D2yyxB2SUMQDNM7BpmwdbEPaT6IB-2D2D5Cn9bHhxQqrrQKg-2D2526s-2D253DS73Xf0DOqe72vg3PyfcLRlVQxN1qwLRuyhuySiXPaDU-2D2526e-2D253D-2D26data-2D3D02-2D257C01-2D257Crichard.t.jones-2D2540uconn.edu-2D257Cdf38f324a47d4c1f2feb08d7f8f70eff-2D257C17f1a87e2a254eaab9df9d439034b080-2D257C0-2D257C0-2D257C637251612309165971-2D26sdata-2D3DMPZkxeQDOT7m8wO0TNFRWPiO4eKPv3y13uYs0hS06c8-2D253D-2D26reserved-2D3D0-2526d-253DDwMFaQ-2526c-253DCJqEzB1piLOyyvZjb8YUQw-2526r-253D-5Fp-5FZf1fP8D9GtGtaEgIPjViLbHJLGv-5FRV32KAKGtMbE-2526m-253DJt5DGYkn6UBnm7aaKn4QomtiJpeYlkhgLkhrYEJRDDY-2526s-253DTPp-2D8YcvNmgwSJNfPMaOhdklQDLDCVqmfTX6JFQHnRM-2526e-253D-26data-3D02-257C01-257Crichard.t.jones-2540uconn.edu-257Cbc281fedbdd048fbeafc08d7f8f93aa4-257C17f1a87e2a254eaab9df9d439034b080-257C0-257C0-257C637251621642452393-26sdata-3DzmvYgFwO5chd4pkS9fRK4J10zPKmRKQ154aP7BB4gDM-253D-26reserved-3D0&d=DwIFaQ&c=CJqEzB1piLOyyvZjb8YUQw&r=Te_hCR4EUlJ6iCDYLJ8Viv2aDOR7D9ZZMoBAvf2H0M4&m=JljHSk5ccmZn8wH5--zwWlQbj_T59G1rEe1l3SjQeWU&s=lPCC9q4pPbrB33ejhHaSVbxBD69b3toZ7Qn4ZUNSEvg&e= >
>>>>>
>>>>> -Richard Jones
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> --
>>>>>
>>>>> Colin Gleason
>>>>>
>>>>> Postdoctoral Fellow
>>>>> Indiana University
>>>>> Department of Physics
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> --
>>>>>
>>>>> Colin Gleason
>>>>>
>>>>> Postdoctoral Fellow
>>>>> Indiana University
>>>>> Department of Physics
>>>>>
>>>>>
>>>>>
>>>>
>>>>
>>>> --
>>>> Colin Gleason
>>>> Postdoctoral Fellow
>>>> Indiana University
>>>> Department of Physics
>>>>
>>>>
>>>
>>> --
>>> Colin Gleason
>>> Postdoctoral Fellow
>>> Indiana University
>>> Department of Physics
>>>
>>
>
> --
> Colin Gleason
> Postdoctoral Fellow
> Indiana University
> Department of Physics
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://mailman.jlab.org/pipermail/halld-offline/attachments/20200515/a69ad190/attachment-0002.html>

More information about the Halld-offline mailing list