[clas12_rgk] [EXTERNAL] Re: Trains examples
Francois-Xavier Girod
fxgirod at jlab.org
Mon Jun 15 19:43:38 EDT 2020
Here are reduction factors I am getting on RGA DSTs
RGA IN
/cache/clas12/rg-a/production/recon/fall2018/torus-1/pass1/v0/dst/recon/005306
files from 00750-00754 to 01065-01069 = 46G
JpsiTCS output 529M reduction factor ~ 89
DVCS output 35M reduction factor 1346
DVPi0P output 36M reduction factor 1308
DVPipPimP output 28M reduction factor 1682
DVPipPimPi0 output 32M reduction factor 1472
DVKpKmP output 20M reduction factor 2355
CPU usage
2020-06-15 18:33:33.190: Benchmark results:
2020-06-15 18:33:33.191: READER 1028277 events total time
= 483.28
s average event time = 0.47 ms
2020-06-15 18:33:33.191: JPSITCS 1028277 events total time
= 181.13
s average event time = 0.18 ms
2020-06-15 18:33:33.191: DVCSWagon 1028277 events total time
= 139.45
s average event time = 0.14 ms
2020-06-15 18:33:33.191: DVPi0PWagon 1028277 events total time
= 141.74
s average event time = 0.14 ms
2020-06-15 18:33:33.192: DVPipPimPWag 1028277 events total time
= 138.85
s average event time = 0.14 ms
2020-06-15 18:33:33.192: DVPipPimPi0P 1028277 events total time
= 134.95
s average event time = 0.13 ms
2020-06-15 18:33:33.192: DVKpKmPWagon 1028277 events total time
= 136.88
s average event time = 0.13 ms
2020-06-15 18:33:33.192: WRITER 1028277 events total time
= 121.67
s average event time = 0.12 ms
2020-06-15 18:33:33.192: TOTAL 1028277 events total time
= 1477.95
s average event time = 1.44 ms
2020-06-15 18:33:33.192: Average processing time = 0.52 ms
2020-06-15 18:33:33.192: Total processing time = 536.28 s
2020-06-15 18:33:33.192: Total orchestrator time = 611.36 s
RGA OUT
/cache/clas12/rg-a/production/recon/fall2018/torus+1/pass1/v0/dst/recon/005569
files from 00750-00754 to 01065-01069 = 59G
JpsiTCS output 396M reduction factor ~ 152
DVCS output 71M reduction factor 851
DVPi0P output 66M reduction factor 915
DVPipPimP output 38M reduction factor 1590
DVPipPimPi0 output 42M reduction factor 1438
DVKpKmP output 21M reduction factor 2376
2020-06-15 19:30:36.122: Benchmark results:
2020-06-15 19:30:36.123: READER 1344572 events total time
= 612.98
s average event time = 0.46 ms
2020-06-15 19:30:36.123: JPSITCS 1344572 events total time
= 234.64
s average event time = 0.17 ms
2020-06-15 19:30:36.123: DVCSWagon 1344572 events total time
= 186.00
s average event time = 0.14 ms
2020-06-15 19:30:36.123: DVPi0PWagon 1344572 events total time
= 204.91
s average event time = 0.15 ms
2020-06-15 19:30:36.124: DVPipPimPWag 1344572 events total time
= 179.96
s average event time = 0.13 ms
2020-06-15 19:30:36.124: DVPipPimPi0P 1344572 events total time
= 182.30
s average event time = 0.14 ms
2020-06-15 19:30:36.124: DVKpKmPWagon 1344572 events total time
= 176.99
s average event time = 0.13 ms
2020-06-15 19:30:36.124: WRITER 1344572 events total time
= 160.96
s average event time = 0.12 ms
2020-06-15 19:30:36.124: TOTAL 1344572 events total time
= 1938.74
s average event time = 1.44 ms
2020-06-15 19:30:36.125: Average processing time = 0.51 ms
2020-06-15 19:30:36.125: Total processing time = 686.55 s
2020-06-15 19:30:36.125: Total orchestrator time = 775.42 s
2020-06-15 19:30:36.125: Processing is complete.
Best regards
FX
On Tue, Jun 16, 2020 at 12:01 AM Francois-Xavier Girod <fxgirod at jlab.org>
wrote:
> Thanks Nick
>
> Ok I guess I have my work cut out for me then
> I will report what I get
>
> On Mon, Jun 15, 2020 at 11:58 PM Nikolay Markov <markov at jlab.org> wrote:
>
>> 2 runs (5700, 5893) are here:
>> /volatile/clas12/rg-k/production/pass0/v1_1.1.42/dst/recon/
>> ------------------------------
>> *From:* Raffaella De Vita <Raffaella.Devita at ge.infn.it>
>> *Sent:* Monday, June 15, 2020 5:55 PM
>> *To:* Francois-Xavier Girod-Gard <fxgirod at jlab.org>
>> *Cc:* Raffaella De Vita <Raffaella.Devita at ge.infn.it>; Nikolay Markov <
>> markov at jlab.org>; clas12_rgk at jlab.org <clas12_rgk at jlab.org>; Nathan
>> Baltzell <baltzell at jlab.org>
>> *Subject:* Re: [EXTERNAL] Re: Trains examples
>>
>> Dear FX,
>> I would assume that 10% of a full run would be sufficient to get a first
>> estimate, i.e. ~25 DSTs files.
>> I would be good to run on RG-K DSTs: maybe Nick can point to the 4 runs
>> that were cooked for the review.
>> Best regards,
>> Raffaella
>>
>> On 15 Jun 2020, at 17:49, Francois-Xavier Girod <fxgirod at jlab.org> wrote:
>>
>> Dear Raffaella
>>
>> Yes I realize now that we need the correct reduction factors, it is no
>> problem I can run on the DSTs instead
>> This is the information I have on the file location
>> /cache/clas12/rg-a/production/recon/fall2018/torus-1/pass1/v0/dst/recon/
>> /cache/clas12/rg-a/production/recon/fall2018/torus-1/pass1/v0/dst/recon/
>>
>> Do you have a suggestion many files I will need to process to get an
>> accurate reduction factor?
>>
>> Best regards
>> FX
>>
>> On Mon, Jun 15, 2020 at 11:37 PM Raffaella De Vita <
>> Raffaella.Devita at ge.infn.it> wrote:
>>
>> Dear FX,
>> If you have time, could you run on DSTs as well? It would be helpful
>> because the reduction factors can then be compared with what Nick had from
>> the standard wagons.
>> Thanks,
>> Raffaella
>>
>>
>> On 15 Jun 2020, at 12:24, Francois-Xavier Girod <fxgirod at jlab.org> wrote:
>>
>> Dear all
>>
>> Here is a summary of the tests I performed with the new exclusive
>> reaction wagons
>>
>> All deep exclusive wagons have Q2 > 0.8 GeV^2 and W > 1.8 GeV
>>
>> RGA OUT sample was skimmed starting from skim4 (already has the condition
>> of one e in the FD)
>> CPU usage for the new wagons compared to JpsiTCS (on clara machines)
>> 2020-06-14 22:13:46.433: Benchmark results:
>> 2020-06-14 22:13:46.433: READER 210369933 events total time
>> = 72775.73 s average event time = 0.35 ms
>> 2020-06-14 22:13:46.434: JPSITCS 210369933 events total time
>> = 33937.10 s average event time = 0.16 ms
>> 2020-06-14 22:13:46.434: DVCSWagon 210369933 events total time
>> = 27440.98 s average event time = 0.13 ms
>> 2020-06-14 22:13:46.434: DVPi0PWagon 210369933 events total time
>> = 33836.22 s average event time = 0.16 ms
>> 2020-06-14 22:13:46.434: DVPipPimPWag 210369933 events total time
>> = 25329.07 s average event time = 0.12 ms
>> 2020-06-14 22:13:46.434: DVPipPimPi0P 210369933 events total time
>> = 25733.89 s average event time = 0.12 ms
>> 2020-06-14 22:13:46.434: DVKpKmPWagon 210369933 events total time
>> = 25776.63 s average event time = 0.12 ms
>> 2020-06-14 22:13:46.434: WRITER 210369933 events total time
>> = 17867.52 s average event time = 0.08 ms
>> 2020-06-14 22:13:46.435: TOTAL 210369933 events total time
>> = 262697.14 s average event time = 1.25 ms
>> 2020-06-14 22:13:46.435: Average processing time = 0.38 ms
>> 2020-06-14 22:13:46.435: Total processing time = 80223.88 s
>> 2020-06-14 22:13:46.435: Total orchestrator time = 80521.07 s
>> 2020-06-14 22:13:46.435: Processing is complete.
>>
>> Reduction factors over skim4:
>> JpsiTCS size reduction factor ~ 225
>> DVCS ~ 342
>> DVPi0P ~ 373
>> DVPipPimP ~ 754
>> DVPipPimPi0P ~ 677
>> DVKpKmP ~ 2068
>>
>> RGA IN sample was skimmed from skim8 (already has the condition of e in
>> FD and one proton)
>> CPU usage
>> 2020-06-15 09:05:28.440: Benchmark results:
>> 2020-06-15 09:05:28.440: READER 16489802 events total time =
>> 6310.92 s average event time = 0.38 ms
>> 2020-06-15 09:05:28.441: JPSITCS 16489802 events total time =
>> 2612.12 s average event time = 0.16 ms
>> 2020-06-15 09:05:28.441: DVCSWagon 16489802 events total time =
>> 2391.67 s average event time = 0.15 ms
>> 2020-06-15 09:05:28.441: DVPi0PWagon 16489802 events total time =
>> 4054.14 s average event time = 0.25 ms
>> 2020-06-15 09:05:28.442: DVPipPimPWag 16489802 events total time =
>> 2046.81 s average event time = 0.12 ms
>> 2020-06-15 09:05:28.442: DVPipPimPi0P 16489802 events total time =
>> 2184.76 s average event time = 0.13 ms
>> 2020-06-15 09:05:28.442: DVKpKmPWagon 16489802 events total time =
>> 1979.42 s average event time = 0.12 ms
>> 2020-06-15 09:05:28.442: WRITER 16489802 events total time =
>> 1649.79 s average event time = 0.10 ms
>> 2020-06-15 09:05:28.442: TOTAL 16489802 events total time
>> = 23229.64 s average event time = 1.41 ms
>> 2020-06-15 09:05:28.442: Average processing time = 0.43 ms
>> 2020-06-15 09:05:28.442: Total processing time = 7151.69 s
>> 2020-06-15 09:05:28.442: Total orchestrator time = 7650.04 s
>> 2020-06-15 09:05:28.443: Processing is complete.
>>
>> Reduction factors over skim8:
>> JpsiTCS size reduction factor ~ 53
>> DVCS ~ 51
>> DVPi0P ~ 50
>> DVPipPimP ~ 66
>> DVPipPimPi0P ~ 55
>> DVKpKmP ~ 100
>>
>> Best regards
>> FX
>>
>>
>>
>>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://mailman.jlab.org/pipermail/clas12_rgk/attachments/20200616/d213b84a/attachment-0001.html>
More information about the clas12_rgk
mailing list