<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
</head>
<body text="#000000" bgcolor="#FFFFFF">
Hi Jeremy, all<br>
<br>
maybe it is already not needed, but just in case file locations are
below<br>
<br>
======== Log output for today's runs Run 7796.20 ================ <br>
/lustre/expphy/work/hallb/hps/data/physrun2016/tpass1/logs/hps_007796.20_R3.9_J8_OS7.err<br>
2017-05-22 21:16:59 [INFO]
org.hps.conditions.database.AbstractConditionsObjectConverter
getData :: loading conditions set...<br>
id: 324<br>
name: svt_calibrations<br>
runStart: 4823<br>
runEnd: 999999<br>
tableName: svt_calibrations<br>
collectionId: 3<br>
updated: 2016-12-05 22:10:43.0<br>
created: 2015-04-20 02:01:55.0<br>
tag: eng_run<br>
createdBy: omoreno<br>
notes: Pedestals and noise generated using run 4823.<br>
<br>
<br>
June2016 log files for 7786.20 are not preserved, but 8054 which run
on Oct 2016 is below, <br>
same problem exists for 8054 as well.<br>
=========== Log from 8054.27 ==================<br>
/work/hallb/hps/data/physrun2016/pass0/logs/hps_008054.27_R3.9.err<br>
2017-05-22 21:16:59 [INFO]
org.hps.conditions.database.AbstractConditionsObjectConverter
getData :: loading conditions set...<br>
id: 324<br>
name: svt_calibrations<br>
runStart: 4823<br>
runEnd: 999999<br>
tableName: svt_calibrations<br>
collectionId: 3<br>
updated: 2016-12-05 22:10:43.0<br>
created: 2015-04-20 02:01:55.0<br>
tag: eng_run<br>
createdBy: omoreno<br>
notes: Pedestals and noise generated using run 4823.<br>
<br>
<br>
<div class="moz-cite-prefix">On 05/23/2017 08:50 PM, McCormick,
Jeremy I. wrote:<br>
</div>
<blockquote type="cite"
cite="mid:db10d395d8c541bcaaf2f8d346cbf5f5@exch13-mail04.win.slac.stanford.edu">
<meta name="Generator" content="Microsoft Word 14 (filtered
medium)">
<!--[if !mso]><style>v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style><![endif]-->
<style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman","serif";
color:black;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
p
{mso-style-priority:99;
mso-margin-top-alt:auto;
margin-right:0in;
mso-margin-bottom-alt:auto;
margin-left:0in;
font-size:12.0pt;
font-family:"Times New Roman","serif";
color:black;}
p.MsoAcetate, li.MsoAcetate, div.MsoAcetate
{mso-style-priority:99;
mso-style-link:"Balloon Text Char";
margin:0in;
margin-bottom:.0001pt;
font-size:8.0pt;
font-family:"Tahoma","sans-serif";
color:black;}
p.msonormal0, li.msonormal0, div.msonormal0
{mso-style-name:msonormal;
mso-style-priority:99;
mso-margin-top-alt:auto;
margin-right:0in;
mso-margin-bottom-alt:auto;
margin-left:0in;
font-size:12.0pt;
font-family:"Times New Roman","serif";
color:black;}
span.EmailStyle19
{mso-style-type:personal;
font-family:"Calibri","sans-serif";
color:#1F497D;}
span.EmailStyle20
{mso-style-type:personal-reply;
font-family:"Calibri","sans-serif";
color:#1F497D;}
span.BalloonTextChar
{mso-style-name:"Balloon Text Char";
mso-style-priority:99;
mso-style-link:"Balloon Text";
font-family:"Tahoma","sans-serif";
color:black;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
<div class="WordSection1">
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:windowtext">Rafo,
can you check in the log file for these jobs what is being
loaded for the ‘svt_calibrations’ conditions set and reply
with that information?<o:p></o:p></span></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:windowtext"><o:p> </o:p></span></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:windowtext">It
should be printed out during the job initialization.<o:p></o:p></span></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<div>
<div style="border:none;border-top:solid #B5C4DF
1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b><span
style="font-size:10.0pt;font-family:"Tahoma","sans-serif";color:windowtext">From:</span></b><span
style="font-size:10.0pt;font-family:"Tahoma","sans-serif";color:windowtext">
<a class="moz-txt-link-abbreviated" href="mailto:hps-software@slac.stanford.edu">hps-software@slac.stanford.edu</a>
[<a class="moz-txt-link-freetext" href="mailto:hps-software@slac.stanford.edu">mailto:hps-software@slac.stanford.edu</a>]
<b>On Behalf Of </b>Rafayel Paremuzyan<br>
<b>Sent:</b> Tuesday, May 23, 2017 4:34 PM<br>
<b>To:</b> Graf, Norman A.; Graham, Mathew Thomas<br>
<b>Cc:</b> Omar Moreno; <a class="moz-txt-link-abbreviated" href="mailto:hps-analysis@jlab.org">hps-analysis@jlab.org</a>;
hps-software<br>
<b>Subject:</b> Re: [Hps-analysis] Test pass1 Status<o:p></o:p></span></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal" style="margin-bottom:12.0pt">Hi All,<br>
<br>
Ok, outputs from Jun2016 recon, and the one from new recon are
different.<br>
Reminder that, I have used same jar file, same detector same
steering file.<br>
<br>
Attached figures represent comparison of 1st 20K events from
file 7796.20<br>
ECal data is almost identical, attached is the cluster_X
distribution comparison from two files.<br>
Blue is the June2016 recon file, and red is new recon file.<br>
<br>
SVT data is different, it has more 3D hits and more tracks.<br>
Which is probably causing it to run slower.<br>
<br>
Since both reconstructions use "Same" jar same steering files,
same geometry (v4-4),<br>
Then it is probably something has been changed in the
Database.<br>
<br>
Probably SVT experts who have modified the database since Jun
2016, can have a look into<br>
to see if there is something that can cause this.<br>
<br>
Rafo<br>
<br>
<o:p></o:p></p>
<div>
<p class="MsoNormal">On 05/22/2017 03:46 PM, Graf, Norman A.
wrote:<o:p></o:p></p>
</div>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Hello
Rafo,</span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">I
agree that the most concerning issue is the
non-reproducibility of the pass0 results.</span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Norman</span><o:p></o:p></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span><o:p></o:p></p>
<p class="MsoNormal"><a name="_MailEndCompose"
moz-do-not-send="true"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span><o:p></o:p></a></p>
<div>
<div style="border:none;border-top:solid #E1E1E1
1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:windowtext">From:</span></b><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:windowtext">
<a href="mailto:hps-software@slac.stanford.edu"
moz-do-not-send="true">hps-software@slac.stanford.edu</a>
[<a href="mailto:hps-software@slac.stanford.edu"
moz-do-not-send="true">mailto:hps-software@slac.stanford.edu</a>]
<b>On Behalf Of </b>Rafayel Paremuzyan<br>
<b>Sent:</b> Monday, May 22, 2017 12:25 PM<br>
<b>To:</b> Graham, Mathew Thomas <a
href="mailto:mgraham@slac.stanford.edu"
moz-do-not-send="true"><mgraham@slac.stanford.edu></a><br>
<b>Cc:</b> Omar Moreno <a
href="mailto:email@omarmoreno.net"
moz-do-not-send="true"><email@omarmoreno.net></a>;
<a href="mailto:hps-analysis@jlab.org"
moz-do-not-send="true">hps-analysis@jlab.org</a>;
hps-software <a
href="mailto:hps-software@slac.stanford.edu"
moz-do-not-send="true">
<hps-software@slac.stanford.edu></a><br>
<b>Subject:</b> Re: [Hps-analysis] Test pass1 Status</span><o:p></o:p></p>
</div>
</div>
<p class="MsoNormal"> <o:p></o:p></p>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal">….ARE the occupancies x2 higher???<o:p></o:p></p>
</blockquote>
<p class="MsoNormal" style="margin-bottom:12.0pt">This was
just a naive assumption, also I assumed the computing time
doesn't linearly depend on occupancies,<br>
I was more wondered, that I can not reproduce the code speed
that we had 6 months ago.<br>
<br>
Rafo<br>
<br>
<br>
<o:p></o:p></p>
<div>
<p class="MsoNormal">On 05/22/2017 03:19 PM, Graham, Mathew
Thomas wrote:<o:p></o:p></p>
</div>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<div>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"> <o:p></o:p></p>
<div>
<div>
<p class="MsoNormal">2.3 GeV data recon speed is x2
slower than the 1.05 data recon speed.<br>
This is concerning, but maybe there is a good
reason for that, i.e. might be hit occupancies are
high etc,<o:p></o:p></p>
</div>
</div>
</blockquote>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">….ARE the occupancies x2 higher???<o:p></o:p></p>
</div>
<p class="MsoNormal"><br>
<br>
<br>
<o:p></o:p></p>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<div>
<div>
<p class="MsoNormal"><br>
but the other thing, that seems puzzling, is recon
speed for 2.3 GeV data is now more than x2 slower<br>
using the same hps-java version, same detector,
same java version, as we did for pass0.<o:p></o:p></p>
</div>
</div>
</blockquote>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">Ok, that’s legit weird. <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<p class="MsoNormal"><br>
<br>
<br>
<o:p></o:p></p>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<div>
<div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><br>
Rafo<br>
<br>
<br>
<o:p></o:p></p>
<div>
<p class="MsoNormal">On 05/22/2017 03:10 PM,
Graham, Mathew Thomas wrote:<o:p></o:p></p>
</div>
<blockquote
style="margin-top:5.0pt;margin-bottom:5.0pt">
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">Sorry to ask a dumb
question…but I will anyway. <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">This is a “2.3 GeV vs 1.05
GeV” issue? Or an hps-java version issue? <o:p></o:p></p>
</div>
<p class="MsoNormal"> <o:p></o:p></p>
<div>
<blockquote
style="margin-top:5.0pt;margin-bottom:5.0pt">
<div>
<p class="MsoNormal">On May 22, 2017, at
12:05 PM, Omar Moreno <<a
href="mailto:email@omarmoreno.net"
moz-do-not-send="true">email@omarmoreno.net</a>>
wrote:<o:p></o:p></p>
</div>
<p class="MsoNormal"> <o:p></o:p></p>
<div>
<div>
<p class="MsoNormal">Jeremy has also
profiled the recon before so if Maurik
can't do it, I'm sure he can. <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
<div>
<p class="MsoNormal">On May 22, 2017
11:46 AM, "Rafayel Paremuzyan" <<a
href="mailto:rafopar@jlab.org"
moz-do-not-send="true">rafopar@jlab.org</a>>
wrote:<o:p></o:p></p>
<blockquote
style="border:none;border-left:solid
#CCCCCC 1.0pt;padding:0in 0in 0in
6.0pt;margin-left:4.8pt;margin-top:5.0pt;margin-right:0in;margin-bottom:5.0pt">
<p class="MsoNormal">Hi Alessandra and
all,<br>
<br>
Yes clearly I see that pattern as
well,<br>
going to the faster machine
(pumpkin1), as Maurik suggested,<br>
recon speed increased, but 2016
recon was about x2 slower than the
2015 recon speed.<br>
I also tried to with -Xms=4000m
-Xmx=4000m options, and without that
options,<br>
but I didn't notice noticeable speed
improvement.<br>
<br>
Another thing that is *concering* is
I run<br>
same jar on batch farms, centos6.
and centos7, and<br>
can't get same speed as we got
during the pass0.<br>
Note, jar is the same, detector is
the same, run number and file number
is the same.<br>
Difference is the time when it
started to tun (Oct 19 2016 vs May
21 2017)<br>
<br>
If someone is interested to look at
job log files<br>
The log file that I run yesterday:
/lustre/expphy/work/hallb/hps/data/physrun2016/tpass1/logs/hps_008054.27_pass0XML.err<br>
The log file that run on Oct 19 2016
for pass0
/lustre/expphy/work/hallb/hps/data/physrun2016/pass0/logs/hps_008054.27_R3.9.err<br>
<br>
I have never done profiling with
java.<br>
I know Maurik is in workshop, he
might not have time to do this,<br>
if someone else is set up doing
this, it will probably be useful.<br>
<br>
Also, I noticed /group/hps is full<br>
<br>
Has anyone recently put some data
there?<br>
<br>
Rafo <o:p></o:p></p>
<div>
<p class="MsoNormal"><br>
<br>
<br>
On 05/22/2017 04:04 AM, Alessandra
Filippi wrote:<o:p></o:p></p>
</div>
<blockquote
style="border:none;border-left:solid
#CCCCCC 1.0pt;padding:0in 0in 0in
6.0pt;margin-left:4.8pt;margin-top:5.0pt;margin-right:0in;margin-bottom:5.0pt">
<div>
<p class="MsoNormal"
style="margin-bottom:12.0pt">Hi
Maurik, Rafo and all,<br>
I think that the different Java
VM could impact on the absolute
speed comparing different
machines and jar versions
compiled in different times...
but I am running the same jar
(hps-java 3.10, compiled afresh
at slac on rhel6-64, jvm 1.7.0)
on 2015 and 2016 data, and the
factor ~2 of speed decrease for
newer data is striking
(whichever geometry version).<br>
About garbage collection, I
don't use any flag in
compilation, so it acts in
default mode in both cases.<br>
<br>
Are 2016 data affected by more
noisy hits that could extend the
reconstruction time over testing
all different strategies, to
your knowledge?<br>
cheers<br>
Alessandra<br>
<br>
<br>
<br>
<br>
<br>
<br>
On Sun, 21 May 2017, Maurik
Holtrop wrote:<o:p></o:p></p>
</div>
<blockquote
style="border:none;border-left:solid
#CCCCCC 1.0pt;padding:0in 0in 0in
6.0pt;margin-left:4.8pt;margin-top:5.0pt;margin-right:0in;margin-bottom:5.0pt">
<div>
<p class="MsoNormal">Hello Rafo,<br>
One thing that probably is
different between the last
time we ran with the 3.8 jar
and now<br>
is a different version of the
Java VM. It could well be that
the newer version of Java is<br>
not faster. Also, it is tricky
to compare Endeavour with the
Jlab farm computers. They are<br>
probably not equivalent in
speed. At UNH, Pumpkin has the
more modern processors,
whereas<br>
Endeavour is now ~5 years old.<br>
<br>
Best,<br>
Maurik<br>
<br>
On May 21, 2017, at 6:54
AM, Rafayel Paremuzyan <<a
href="mailto:rafopar@jlab.org" target="_blank" moz-do-not-send="true">rafopar@jlab.org</a>>
wrote:<br>
<br>
Hi Alessandra, Norman, all<br>
<br>
thank you for replay and your
tests.<br>
<br>
I tested both 2015 and 2016
data using v4-4 detector on
UNH computers.<br>
I have use 3.8 JAR (the jar
for 2015 pass6). 3.9 JAR (the
jar for 2016 pass0 recon),<br>
and the NEW jar v051717 (the
newest jar tag is v051717)<br>
<br>
Ok, I also noticed that recon
of 2015 data is faster that
2016 data.<br>
Also seems the new jar is 20%
slower than the 3.9 jar for
2016 data, and about 60%<br>
slower for 2015 data.<br>
now recon speed is about 2.55
EV/S for 2015 data, This is
too slow<br>
it cause more than 40h for a
single file.<br>
<br>
Ths is summary of code speeds
with different jar files<br>
V4-4 Detector, UNH
(endeavour), 5K events are
reconstructed<br>
<br>
Events per second<br>
Events per second<br>
Events per second<br>
<br>
3.8JAR (2015 recon jar)<br>
3.9JAR, 2016 pass0 recon jar<br>
v051717JAR, jar vor tpass1<br>
2015 Data 5772, file 20<br>
5.07<br>
5.19<br>
3.157<br>
2016 Data file 25<br>
<br>
3.11<br>
2.53<br>
<br>
*However* I looked into job
Wall times for pass0 recon.<br>
The recon speed is more than
7.4 Events/sec, which is about
x3 faster than with the<br>
new JAR.<br>
<br>
I again checked *same 3.9
jar*, which is slower again.<br>
I don't know why now the code
speed is so low!<br>
<br>
<br>
Norman, I have tried the
"-DdisableSvtAlignmentConstants",
but it didn't work<br>
<br>
=================The
command===============<br>
java -XX:+UseSerialGC -cp
hps-distribution-3.11-v051717-bin.jar<br>
org.hps.evio.EvioToLcio -x
/org/hps/steering/recon/PhysicsRun2016FullRecon.lcsim
-r<br>
-d
HPS-PhysicsRun2016-v5-3-fieldmap_globalAlign
-R 7796
-DoutputFile=out_7796_0<br>
-DdisableSvtAlignmentConstants
hps_007796.evio.25 -n 10000<br>
<br>
============The error
backtrache============<br>
2017-05-21 00:45:39 [CONFIG]
org.hps.evio.EvioToLcio parse
:: using steering<br>
resource
/org/hps/steering/recon/PhysicsRun2016FullRecon.lcsim<br>
2017-05-21 00:45:39 [CONFIG]
org.hps.evio.EvioToLcio parse
:: set max events to<br>
10000<br>
2017-05-21 00:45:48 [INFO]
org.hps.rundb.RunManager
<init> ::
ConnectionParameters {<br>
database: hps_run_db_v2,
hostname: <a
href="http://hpsdb.jlab.org/"
target="_blank"
moz-do-not-send="true">
hpsdb.jlab.org</a>,
password: darkphoton, port:
3306,<br>
user: hpsuser }<br>
2017-05-21 00:45:48 [CONFIG]
org.lcsim.job.JobControlManager
addVariableDefinition<br>
:: outputFile = out_7796_0<br>
2017-05-21 00:45:48 [CONFIG]
org.hps.evio.EvioToLcio parse
:: set steering variable:<br>
outputFile=out_7796_0<br>
2017-05-21 00:45:48 [SEVERE]
org.hps.evio.EvioToLcio parse
:: bad variable format:<br>
disableSvtAlignmentConstants<br>
java.lang.IllegalArgumentException: Bad variable format:<br>
disableSvtAlignmentConstants<br>
at
org.hps.evio.EvioToLcio.parse(EvioToLcio.java:393)<br>
at
org.hps.evio.EvioToLcio.main(EvioToLcio.java:97)<br>
<br>
Exception in thread "main"
java.lang.IllegalArgumentException:
Bad variable format:<br>
disableSvtAlignmentConstants<br>
at
org.hps.evio.EvioToLcio.parse(EvioToLcio.java:393)<br>
at
org.hps.evio.EvioToLcio.main(EvioToLcio.java:97)<br>
<br>
Rafo<br>
<br>
<br>
<br>
<br>
<br>
<br>
On 05/20/2017 06:17 AM,
Alessandra Filippi wrote:<br>
Hi Rafo, all,<br>
I also noticed that the
reconstruction for 2016 data
is about twice as<br>
slow as compared to 2015
(whichever geometry and
reconstruction<br>
version).<br>
This happens when I run
the aligned geometry as well
as the "current"<br>
one (v5.0), and the
geometry taken from the db as
well (the result is<br>
the same as v5.0). I did
not make any test with v4.4,
though - actually<br>
as far as svt alignment
is concerned it should be the
same as v5.0. Can<br>
you please try and make
the same short test with the
newest jar with<br>
v4.4?<br>
This happens to me both
with hps-java 5.10 and 5.11
(not the most<br>
updated one).<br>
<br>
I would be surprised if
it could be something
connected to the<br>
alignment, unless for
some reason new positions and
harder tracks<br>
trigger some long loops
in the reconstruction. But
this happens (to me)<br>
also with the<br>
standard geometry, so a
check with the one used with
pass0 (that should<br>
however be equivalent to
v5.0) could at least help to
rule out, or blame<br>
on, the alignment step.<br>
Thanks, cheers<br>
Alessandra<br>
<br>
<br>
ps. make also sure that
the correct fieldmap is called
in all the<br>
compact files - you
never know!<br>
<br>
<br>
<br>
On Fri, 19 May 2017,
Rafayel Paremuzyan wrote:<br>
<br>
Hi All,<br>
<br>
During the testing
the recon for test pass1,<br>
I noticed the
recon time is more than x2
longer wrt pass0<br>
recon time.<br>
<br>
To demonstrate it<br>
I submit 3 simple
jobs with 10K events to
reconstruct, with<br>
new pass1 xml<br>
file (this has the
new jar v051717, and the new
detector<br>
HPS-PhysicsRun2016-v5-3-fieldmap_globalAlign),<br>
and the old pass0
xml file (pass0 jar release
3.9, and the<br>
detector<br>
HPS-PhysicsRun2016-Nominal-v4-4-fieldmap)<br>
<br>
Below is a
printout from the jobs with a
new JAR, v051717,<br>
the average time<br>
for 1000 events is
more than 7 minutes<br>
===================== LOG from
the v051717 JAR<br>
==============================<br>
2017-05-19
09:36:51 [INFO]
org.lcsim.job.EventMarkerDriver<br>
process :: Event<br>
10614074 with
sequence 0<br>
2017-05-19
09:43:13 [INFO]
org.lcsim.job.EventMarkerDriver<br>
process :: Event<br>
10615074 with
sequence 1000<br>
2017-05-19
09:49:18 [INFO]
org.lcsim.job.EventMarkerDriver<br>
process :: Event<br>
10616074 with
sequence 2000<br>
2017-05-19
09:55:54 [INFO]
org.lcsim.job.EventMarkerDriver<br>
process :: Event<br>
10617074 with
sequence 3000<br>
2017-05-19
10:02:55 [INFO]
org.lcsim.job.EventMarkerDriver<br>
process :: Event<br>
10618074 with
sequence 4000<br>
2017-05-19
10:09:57 [INFO]
org.lcsim.job.EventMarkerDriver<br>
process :: Event<br>
10619074 with
sequence 5000<br>
2017-05-19
10:16:13 [INFO]
org.lcsim.job.EventMarkerDriver<br>
process :: Event<br>
10620074 with
sequence 6000<br>
2017-05-19
10:25:20 [INFO]
org.lcsim.job.EventMarkerDriver<br>
process :: Event<br>
10621074 with
sequence 7000<br>
2017-05-19
10:32:56 [INFO]
org.lcsim.job.EventMarkerDriver<br>
process :: Event<br>
10622074 with
sequence 8000<br>
2017-05-19
10:36:19 [WARNING]<br>
org.hps.recon.tracking.TrackerReconDriver<br>
process ::
Discarding track with bad
HelicalTrackHit<br>
(correction
distance<br>
0.000000, chisq
penalty 0.000000)<br>
2017-05-19
10:42:03 [INFO]
org.lcsim.job.EventMarkerDriver<br>
process :: Event<br>
10623074 with
sequence 9000<br>
2017-05-19
10:47:44 [INFO]
org.hps.evio.EvioToLcio run ::<br>
maxEvents 10000<br>
was reached<br>
2017-05-19
10:47:44 [INFO]
org.lcsim.job.EventMarkerDriver<br>
endOfData ::<br>
10000 events
processed in job.<br>
2017-05-19
10:47:44 [INFO]
org.hps.evio.EvioToLcio run ::<br>
Job finished<br>
successfully!<br>
<br>
<br>
And below is the
Job log info from the pass0
jar. The<br>
average time for
1000<br>
events is less
than 3 minutes<br>
===================== LOG from
the 3.9 release JAR<br>
==============================<br>
2017-05-19
13:19:46 [INFO]
org.lcsim.job.EventMarkerDriver<br>
process :: Event<br>
10614074 with
sequence 0<br>
2017-05-19
13:23:36 [INFO]
org.lcsim.job.EventMarkerDriver<br>
process :: Event<br>
10615074 with
sequence 1000<br>
2017-05-19
13:27:03 [INFO]
org.lcsim.job.EventMarkerDriver<br>
process :: Event<br>
10616074 with
sequence 2000<br>
2017-05-19
13:30:40 [INFO]
org.lcsim.job.EventMarkerDriver<br>
process :: Event<br>
10617074 with
sequence 3000<br>
2017-05-19
13:34:20 [INFO]
org.lcsim.job.EventMarkerDriver<br>
process :: Event<br>
10618074 with
sequence 4000<br>
2017-05-19
13:38:11 [INFO]
org.lcsim.job.EventMarkerDriver<br>
process :: Event<br>
10619074 with
sequence 5000<br>
2017-05-19
13:41:43 [INFO]
org.lcsim.job.EventMarkerDriver<br>
process :: Event<br>
10620074 with
sequence 6000<br>
2017-05-19
13:45:54 [WARNING]<br>
org.hps.recon.tracking.TrackerReconDriver<br>
process ::
Discarding track with bad
HelicalTrackHit<br>
(correction
distance<br>
0.000000, chisq
penalty 0.000000)<br>
2017-05-19
13:46:05 [INFO]
org.lcsim.job.EventMarkerDriver<br>
process :: Event<br>
10621074 with
sequence 7000<br>
2017-05-19
13:50:08 [INFO]
org.lcsim.job.EventMarkerDriver<br>
process :: Event<br>
10622074 with
sequence 8000<br>
2017-05-19
13:55:03 [INFO]
org.lcsim.job.EventMarkerDriver<br>
process :: Event<br>
10623074 with
sequence 9000<br>
2017-05-19
13:58:27 [INFO]
org.hps.evio.EvioToLcio run ::<br>
maxEvents 10000<br>
was reached<br>
2017-05-19
13:58:27 [INFO]
org.lcsim.job.EventMarkerDriver<br>
endOfData ::<br>
10000 events
processed in job.<br>
2017-05-19
13:58:27 [INFO]
org.hps.evio.EvioToLcio run ::<br>
Job finished<br>
successfully!<br>
<br>
I also tried to do
reconstruction by myself
interactively,<br>
but I am getting<br>
error below,<br>
<br>
The command<br>
/apps/scicomp/java/jdk1.7/bin/java
-XX:+UseSerialGC -cp<br>
hps-distribution-3.9-bin.jar
org.hps.evio.EvioToLcio -x<br>
/org/hps/steering/recon/PhysicsRun2016FullRecon.lcsim -r -d<br>
HPS-PhysicsRun2016-v5-3-fieldmap_globalAlign
-R 7796<br>
-DoutputFile=out_7796_0<br>
hps_007796.evio.0
-n 10000<br>
<br>
The Error
traceback<br>
017-05-19 14:58:44
[CONFIG]
org.hps.evio.EvioToLcio parse
::<br>
using steering<br>
resource<br>
/org/hps/steering/recon/PhysicsRun2016FullRecon.lcsim<br>
2017-05-19
14:58:44 [CONFIG]
org.hps.evio.EvioToLcio parse<br>
:: set max events<br>
to 10000<br>
2017-05-19
14:58:45 [CONFIG]<br>
org.lcsim.job.JobControlManager<br>
addVariableDefinition ::
outputFile = out_7796_0<br>
2017-05-19
14:58:45 [CONFIG]
org.hps.evio.EvioToLcio parse<br>
:: set steering<br>
variable:
outputFile=out_7796_0<br>
2017-05-19
14:58:45 [CONFIG]
org.lcsim.job.JobControlManager<br>
initializeLoop<br>
:: initializing
LCSim loop<br>
2017-05-19
14:58:45 [CONFIG]
org.lcsim.job.JobControlManager<br>
initializeLoop<br>
:: Event marker
printing disabled.<br>
2017-05-19
14:58:45 [INFO]<br>
org.hps.conditions.database.DatabaseConditionsManager<br>
resetInstance ::<br>
DatabaseConditionsManager
instance is reset<br>
Exception in
thread "main"
java.lang.UnsatisfiedLinkError:<br>
/u/apps/scicomp/java/jdk1.7.0_75/jre/lib/i386/xawt/libmawt.so:<br>
libXext.so.6:<br>
cannot open shared
object file: No such file or
directory<br>
at
java.lang.ClassLoader$NativeLibrary.load(Native<br>
Method)<br>
at<br>
java.lang.ClassLoader.loadLibrary1(ClassLoader.java:1965)<br>
at<br>
java.lang.ClassLoader.loadLibrary0(ClassLoader.java:1890)<br>
at<br>
java.lang.ClassLoader.loadLibrary(ClassLoader.java:1851)<br>
at
java.lang.Runtime.load0(Runtime.java:795)<br>
at
java.lang.System.load(System.java:1062)<br>
at
java.lang.ClassLoader$NativeLibrary.load(Native<br>
Method)<br>
at<br>
java.lang.ClassLoader.loadLibrary1(ClassLoader.java:1965)<br>
at<br>
java.lang.ClassLoader.loadLibrary0(ClassLoader.java:1890)<br>
at<br>
java.lang.ClassLoader.loadLibrary(ClassLoader.java:1872)<br>
at
java.lang.Runtime.loadLibrary0(Runtime.java:849)<br>
at
java.lang.System.loadLibrary(System.java:1088)<br>
at<br>
sun.security.action.LoadLibraryAction.run(LoadLibraryAction.java:67)<br>
at<br>
sun.security.action.LoadLibraryAction.run(LoadLibraryAction.java:47)<br>
at<br>
java.security.AccessController.doPrivileged(Native
Method)<br>
at<br>
java.awt.Toolkit.loadLibraries(Toolkit.java:1653)<br>
at
java.awt.Toolkit.<clinit>(Toolkit.java:1682)<br>
at
java.awt.Component.<clinit>(Component.java:595)<br>
at
org.lcsim.util.aida.AIDA.<init>(AIDA.java:68)<br>
at<br>
org.lcsim.util.aida.AIDA.defaultInstance(AIDA.java:53)<br>
at<br>
org.hps.evio.RfFitterDriver.<init>(RfFitterDriver.java:31)<br>
at<br>
sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native<br>
Method)<br>
atsun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAcce<br>
ssorImpl.java:57)<br>
atsun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstru<br>
ctorAccessorImpl.java:45)<br>
at<br>
java.lang.reflect.Constructor.newInstance(Constructor.java:526)<br>
at
java.lang.Class.newInstance(Class.java:379)<br>
at<br>
org.lcsim.job.JobControlManager.setupDrivers(JobControlManager.java:1199)
<br>
at<br>
org.hps.job.JobManager.setupDrivers(JobManager.java:82)<br>
at<br>
org.lcsim.job.JobControlManager.setup(JobControlManager.java:1052)<br>
at<br>
org.lcsim.job.JobControlManager.setup(JobControlManager.java:1110)<br>
at<br>
org.hps.evio.EvioToLcio.parse(EvioToLcio.java:407)<br>
at
org.hps.evio.EvioToLcio.main(EvioToLcio.java:97)<br>
<br>
<br>
<br>
I see this library
libXext.so.6: in /usr/lib64,
but not in<br>
/usr/lib,<br>
when I put
/usr/lib64 in my
LD_LIBRARY_PATH, then it<br>
complaines again
(see<br>
below)<br>
<br>
Exception in
thread "main"
java.lang.UnsatisfiedLinkError:<br>
/u/apps/scicomp/java/jdk1.7.0_75/jre/lib/i386/xawt/libmawt.so:<br>
libXext.so.6:<br>
wrong ELF class:
ELFCLASS64<br>
<br>
I would
appreciate, if I get some help
on running the<br>
reconstruction<br>
interactively,
then I could look more closely
into logs<br>
of the old, and
new JAR files.<br>
<br>
Rafo<br>
<br>
<br>
____________________________________________________________________________
<br>
<br>
Use REPLY-ALL to
reply to list<br>
<br>
To unsubscribe
from the HPS-SOFTWARE list,
click the<br>
following link:<br>
<a
href="https://urldefense.proofpoint.com/v2/url?u=https-3A__listserv.slac.stanford.edu_cgi-2Dbin"
target="_blank"
moz-do-not-send="true">https://urldefense.proofpoint.com/v2/url?u=https-3A__listserv.slac.stanford.edu_cgi-2Dbin</a>
<br>
_wa-3FSUBED1-3DHPS-2DSOFTWARE-26A-3D1&d=DwIDaQ&c=lz9TcOasaINaaC3U7FbMev2lsutwpI4--09aP8Lu
<br>
18s&r=0HDJrGO9TZQTE97J9Abt2A&m=xnbGP5VHYWRAQRWRksVgMnYvBkXWI4roLxztdJ0Tp9I&s=ppNYedSrn5DP
<br>
aIZZJgRZu8tBDeSjroqbj_PoevFoFpI&e=<br>
<br>
<br>
<br>
########################################################################<br>
Use REPLY-ALL to reply
to list<br>
<br>
To unsubscribe from the
HPS-SOFTWARE list, click the
following link:<br>
<a
href="https://urldefense.proofpoint.com/v2/url?u=https-3A__listserv.slac.stanford.edu_cgi-2Dbin"
target="_blank"
moz-do-not-send="true">https://urldefense.proofpoint.com/v2/url?u=https-3A__listserv.slac.stanford.edu_cgi-2Dbin</a>
<br>
_wa-3FSUBED1-3DHPS-2DSOFTWARE-26A-3D1&d=DwIDaQ&c=lz9TcOasaINaaC3U7FbMev2lsutwpI4--09aP8Lu
<br>
18s&r=0HDJrGO9TZQTE97J9Abt2A&m=xnbGP5VHYWRAQRWRksVgMnYvBkXWI4roLxztdJ0Tp9I&s=ppNYedSrn5DP
<br>
aIZZJgRZu8tBDeSjroqbj_PoevFoFpI&e=<br>
<br>
<br>
<br>
__________________________________________________________________________________________
<br>
<br>
Use REPLY-ALL to reply to list<br>
<br>
To unsubscribe from the
HPS-SOFTWARE list, click the
following link:<o:p></o:p></p>
</div>
<p class="MsoNormal"
style="margin-bottom:12.0pt"><a
href="https://urldefense.proofpoint.com/v2/url?u=https-3A__listserv.slac.stanford.edu_cgi-2Dbin_wa-3FSUBED1-3DHPS-2DSOFTWARE-26A-3D1&d=DwIDbA&c=lz9TcOasaINaaC3U7FbMev2lsutwpI4--09aP8Lu18s&r=0HDJrGO9TZQTE97J9Abt2A&m=nIEvNWJSNxvmECWKfMrVKMTZKNdym3zsAls7WG1fdfU&s=cI82nYRtYBzgLs1l5g3anHrSt0kPk4B98oUzllu5KfQ&e="
target="_blank"
moz-do-not-send="true">https://urldefense.proofpoint.com/v2/url?u=https-3A__listserv.slac.stanford.edu_cgi-2Dbin_wa-3FSUBED1-3DHPS-2DSOFTWARE-26A-3D1&d=DwIDbA&c=lz9TcOasaINaaC3U7FbMev2lsutwpI4--09aP8Lu18s&r=0HDJrGO9TZQTE97J9Abt2A&m=nIEvNWJSNxvmECWKfMrVKMTZKNdym3zsAls7WG1fdfU&s=cI82nYRtYBzgLs1l5g3anHrSt0kPk4B98oUzllu5KfQ&e=</a>
<br>
<br>
<br>
<br>
<o:p></o:p></p>
</blockquote>
<div>
<p class="MsoNormal"><br>
########################################################################<br>
Use REPLY-ALL to reply to list<br>
<br>
To unsubscribe from the
HPS-SOFTWARE list, click the
following link:<o:p></o:p></p>
</div>
<p class="MsoNormal"><a
href="https://urldefense.proofpoint.com/v2/url?u=https-3A__listserv.slac.stanford.edu_cgi-2Dbin_wa-3FSUBED1-3DHPS-2DSOFTWARE-26A-3D1&d=DwIDbA&c=lz9TcOasaINaaC3U7FbMev2lsutwpI4--09aP8Lu18s&r=0HDJrGO9TZQTE97J9Abt2A&m=nIEvNWJSNxvmECWKfMrVKMTZKNdym3zsAls7WG1fdfU&s=cI82nYRtYBzgLs1l5g3anHrSt0kPk4B98oUzllu5KfQ&e="
target="_blank"
moz-do-not-send="true">https://urldefense.proofpoint.com/v2/url?u=https-3A__listserv.slac.stanford.edu_cgi-2Dbin_wa-3FSUBED1-3DHPS-2DSOFTWARE-26A-3D1&d=DwIDbA&c=lz9TcOasaINaaC3U7FbMev2lsutwpI4--09aP8Lu18s&r=0HDJrGO9TZQTE97J9Abt2A&m=nIEvNWJSNxvmECWKfMrVKMTZKNdym3zsAls7WG1fdfU&s=cI82nYRtYBzgLs1l5g3anHrSt0kPk4B98oUzllu5KfQ&e=</a>
<o:p></o:p></p>
</blockquote>
<p class="MsoNormal"><br>
<br>
_______________________________________________<br>
Hps-analysis mailing list<br>
<a
href="mailto:Hps-analysis@jlab.org"
target="_blank"
moz-do-not-send="true">Hps-analysis@jlab.org</a><br>
<a
href="https://mailman.jlab.org/mailman/listinfo/hps-analysis"
target="_blank"
moz-do-not-send="true">https://mailman.jlab.org/mailman/listinfo/hps-analysis</a><o:p></o:p></p>
</blockquote>
</div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<p class="MsoNormal">_______________________________________________<br>
Hps-analysis mailing list<br>
<a href="mailto:Hps-analysis@jlab.org"
moz-do-not-send="true">Hps-analysis@jlab.org</a><br>
<a
href="https://mailman.jlab.org/mailman/listinfo/hps-analysis"
moz-do-not-send="true">https://mailman.jlab.org/mailman/listinfo/hps-analysis</a><o:p></o:p></p>
</div>
</blockquote>
</div>
<p class="MsoNormal" style="margin-bottom:12.0pt"> <o:p></o:p></p>
<div class="MsoNormal" style="text-align:center"
align="center">
<hr width="100%" size="3" align="center">
</div>
<p class="MsoNormal"
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">Use
REPLY-ALL to reply to list<o:p></o:p></p>
<p class="MsoNormal"
style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;text-align:center"
align="center">
To unsubscribe from the HPS-SOFTWARE list, click
the following link:<br>
<a
href="https://urldefense.proofpoint.com/v2/url?u=https-3A__listserv.slac.stanford.edu_cgi-2Dbin_wa-3FSUBED1-3DHPS-2DSOFTWARE-26A-3D1&d=DwMGaQ&c=lz9TcOasaINaaC3U7FbMev2lsutwpI4--09aP8Lu18s&r=0HDJrGO9TZQTE97J9Abt2A&m=yktqxWZIxrOJDj0GcxtXMdIm5S6CzoD5o_bfENc8yOA&s=9UGWhMTkreQfG7iEUol-dsVGExrJm-lRdRBfTmh68jU&e="
target="_blank" moz-do-not-send="true">https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=HPS-SOFTWARE&A=1</a>
<o:p></o:p></p>
</blockquote>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
</div>
</blockquote>
</div>
<p class="MsoNormal" style="margin-bottom:12.0pt"> <o:p></o:p></p>
<div class="MsoNormal" style="text-align:center"
align="center">
<hr width="100%" size="3" align="center">
</div>
<p>Use REPLY-ALL to reply to list<o:p></o:p></p>
<p style="text-align:center" align="center">To unsubscribe
from the HPS-SOFTWARE list, click the following link:<br>
<a
href="https://urldefense.proofpoint.com/v2/url?u=https-3A__listserv.slac.stanford.edu_cgi-2Dbin_wa-3FSUBED1-3DHPS-2DSOFTWARE-26A-3D1&d=DwMGaQ&c=lz9TcOasaINaaC3U7FbMev2lsutwpI4--09aP8Lu18s&r=0HDJrGO9TZQTE97J9Abt2A&m=7kpWnc-wAM7IOppfAzLDwv1CB_CV5cve1_5MyJdB9IY&s=0GGLvbF5XbRfWvwDkVU2SxAw54dILOaQOFxPQNW0cQc&e="
target="_blank" moz-do-not-send="true">https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=HPS-SOFTWARE&A=1</a>
<o:p></o:p></p>
</blockquote>
<p class="MsoNormal"> <o:p></o:p></p>
<p class="MsoNormal"><span style="color:windowtext"> </span><o:p></o:p></p>
<div class="MsoNormal" style="text-align:center"
align="center"><span style="color:windowtext">
<hr width="100%" size="3" align="center">
</span></div>
<p><span style="color:windowtext">Use REPLY-ALL to reply to
list</span><o:p></o:p></p>
<p style="text-align:center" align="center"><span
style="color:windowtext">To unsubscribe from the
HPS-SOFTWARE list, click the following link:<br>
<a
href="https://urldefense.proofpoint.com/v2/url?u=https-3A__listserv.slac.stanford.edu_cgi-2Dbin_wa-3FSUBED1-3DHPS-2DSOFTWARE-26A-3D1&d=DwMGaQ&c=lz9TcOasaINaaC3U7FbMev2lsutwpI4--09aP8Lu18s&r=0HDJrGO9TZQTE97J9Abt2A&m=wW_GlfxTzq-pRvKL4e2JZowusyO_SMM8OXCRlQaFoik&s=jhZ6FxoZc0hnA1vqR11SSFAZbByjK4jgRynt1CZ_YuY&e="
target="_blank" moz-do-not-send="true">https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=HPS-SOFTWARE&A=1</a>
</span><o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<div class="MsoNormal" style="text-align:center"
align="center">
<hr width="100%" size="2" align="center">
</div>
<p>Use REPLY-ALL to reply to list<o:p></o:p></p>
<p style="text-align:center" align="center">To unsubscribe
from the HPS-SOFTWARE list, click the following link:<br>
<a
href="https://urldefense.proofpoint.com/v2/url?u=https-3A__listserv.slac.stanford.edu_cgi-2Dbin_wa-3FSUBED1-3DHPS-2DSOFTWARE-26A-3D1&d=DwMGaQ&c=lz9TcOasaINaaC3U7FbMev2lsutwpI4--09aP8Lu18s&r=0HDJrGO9TZQTE97J9Abt2A&m=wW_GlfxTzq-pRvKL4e2JZowusyO_SMM8OXCRlQaFoik&s=jhZ6FxoZc0hnA1vqR11SSFAZbByjK4jgRynt1CZ_YuY&e="
target="_blank" moz-do-not-send="true">https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=HPS-SOFTWARE&A=1</a>
<o:p></o:p></p>
</blockquote>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><span style="color:windowtext"><o:p> </o:p></span></p>
<div class="MsoNormal" style="text-align:center" align="center"><span
style="color:windowtext">
<hr width="100%" size="2" align="center">
</span></div>
<p>Use REPLY-ALL to reply to list<o:p></o:p></p>
<p style="text-align:center" align="center">To unsubscribe from
the HPS-SOFTWARE list, click the following link:<br>
<a
href="https://urldefense.proofpoint.com/v2/url?u=https-3A__listserv.slac.stanford.edu_cgi-2Dbin_wa-3FSUBED1-3DHPS-2DSOFTWARE-26A-3D1&d=DwMGaQ&c=lz9TcOasaINaaC3U7FbMev2lsutwpI4--09aP8Lu18s&r=0HDJrGO9TZQTE97J9Abt2A&m=6lqOcXJmbYiPuKcddtiQT51KLN0Tp58smfMEYX8hF5s&s=MGmJ7tKKgs_xnrdW4wxEx1vVcS4RTcPoG4irf6T0jXg&e="
target="_blank" moz-do-not-send="true">https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=HPS-SOFTWARE&A=1</a>
<o:p></o:p></p>
</div>
</blockquote>
<br>
</body>
</html>