<html>
<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta name="Generator" content="Microsoft Word 14 (filtered medium)">
<!--[if !mso]><style>v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style><![endif]--><style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman","serif";
color:black;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
p
{mso-style-priority:99;
mso-margin-top-alt:auto;
margin-right:0in;
mso-margin-bottom-alt:auto;
margin-left:0in;
font-size:12.0pt;
font-family:"Times New Roman","serif";
color:black;}
p.MsoAcetate, li.MsoAcetate, div.MsoAcetate
{mso-style-priority:99;
mso-style-link:"Balloon Text Char";
margin:0in;
margin-bottom:.0001pt;
font-size:8.0pt;
font-family:"Tahoma","sans-serif";
color:black;}
p.msonormal0, li.msonormal0, div.msonormal0
{mso-style-name:msonormal;
mso-style-priority:99;
mso-margin-top-alt:auto;
margin-right:0in;
mso-margin-bottom-alt:auto;
margin-left:0in;
font-size:12.0pt;
font-family:"Times New Roman","serif";
color:black;}
span.EmailStyle19
{mso-style-type:personal;
font-family:"Calibri","sans-serif";
color:#1F497D;}
span.EmailStyle20
{mso-style-type:personal-reply;
font-family:"Calibri","sans-serif";
color:#1F497D;}
span.BalloonTextChar
{mso-style-name:"Balloon Text Char";
mso-style-priority:99;
mso-style-link:"Balloon Text";
font-family:"Tahoma","sans-serif";
color:black;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body bgcolor="white" lang="EN-US" link="blue" vlink="purple">
<div class="WordSection1">
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:windowtext">Do you have the log files handy for both jobs and could share them?<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:windowtext"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:windowtext">We can see which SVT condition sets it is loading there for that run to see if the differ.</span><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<div>
<div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif";color:windowtext">From:</span></b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif";color:windowtext"> hps-software@slac.stanford.edu [mailto:hps-software@slac.stanford.edu]
<b>On Behalf Of </b>Rafayel Paremuzyan<br>
<b>Sent:</b> Tuesday, May 23, 2017 4:34 PM<br>
<b>To:</b> Graf, Norman A.; Graham, Mathew Thomas<br>
<b>Cc:</b> Omar Moreno; hps-analysis@jlab.org; hps-software<br>
<b>Subject:</b> Re: [Hps-analysis] Test pass1 Status<o:p></o:p></span></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal" style="margin-bottom:12.0pt">Hi All,<br>
<br>
Ok, outputs from Jun2016 recon, and the one from new recon are different.<br>
Reminder that, I have used same jar file, same detector same steering file.<br>
<br>
Attached figures represent comparison of 1st 20K events from file 7796.20<br>
ECal data is almost identical, attached is the cluster_X distribution comparison from two files.<br>
Blue is the June2016 recon file, and red is new recon file.<br>
<br>
SVT data is different, it has more 3D hits and more tracks.<br>
Which is probably causing it to run slower.<br>
<br>
Since both reconstructions use "Same" jar same steering files, same geometry (v4-4),<br>
Then it is probably something has been changed in the Database.<br>
<br>
Probably SVT experts who have modified the database since Jun 2016, can have a look into<br>
to see if there is something that can cause this.<br>
<br>
Rafo<br>
<br>
<o:p></o:p></p>
<div>
<p class="MsoNormal">On 05/22/2017 03:46 PM, Graf, Norman A. wrote:<o:p></o:p></p>
</div>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Hello Rafo,</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">I agree that the most concerning issue is the non-reproducibility of the pass0 results.</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Norman</span><o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span><o:p></o:p></p>
<p class="MsoNormal"><a name="_MailEndCompose"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span><o:p></o:p></a></p>
<div>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:windowtext">From:</span></b><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:windowtext">
<a href="mailto:hps-software@slac.stanford.edu">hps-software@slac.stanford.edu</a> [<a href="mailto:hps-software@slac.stanford.edu">mailto:hps-software@slac.stanford.edu</a>]
<b>On Behalf Of </b>Rafayel Paremuzyan<br>
<b>Sent:</b> Monday, May 22, 2017 12:25 PM<br>
<b>To:</b> Graham, Mathew Thomas <a href="mailto:mgraham@slac.stanford.edu"><mgraham@slac.stanford.edu></a><br>
<b>Cc:</b> Omar Moreno <a href="mailto:email@omarmoreno.net"><email@omarmoreno.net></a>;
<a href="mailto:hps-analysis@jlab.org">hps-analysis@jlab.org</a>; hps-software <a href="mailto:hps-software@slac.stanford.edu">
<hps-software@slac.stanford.edu></a><br>
<b>Subject:</b> Re: [Hps-analysis] Test pass1 Status</span><o:p></o:p></p>
</div>
</div>
<p class="MsoNormal"> <o:p></o:p></p>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal">….ARE the occupancies x2 higher???<o:p></o:p></p>
</blockquote>
<p class="MsoNormal" style="margin-bottom:12.0pt">This was just a naive assumption, also I assumed the computing time doesn't linearly depend on occupancies,<br>
I was more wondered, that I can not reproduce the code speed that we had 6 months ago.<br>
<br>
Rafo<br>
<br>
<br>
<o:p></o:p></p>
<div>
<p class="MsoNormal">On 05/22/2017 03:19 PM, Graham, Mathew Thomas wrote:<o:p></o:p></p>
</div>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<div>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"> <o:p></o:p></p>
<div>
<div>
<p class="MsoNormal">2.3 GeV data recon speed is x2 slower than the 1.05 data recon speed.<br>
This is concerning, but maybe there is a good reason for that, i.e. might be hit occupancies are high etc,<o:p></o:p></p>
</div>
</div>
</blockquote>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">….ARE the occupancies x2 higher???<o:p></o:p></p>
</div>
<p class="MsoNormal"><br>
<br>
<br>
<o:p></o:p></p>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<div>
<div>
<p class="MsoNormal"><br>
but the other thing, that seems puzzling, is recon speed for 2.3 GeV data is now more than x2 slower<br>
using the same hps-java version, same detector, same java version, as we did for pass0.<o:p></o:p></p>
</div>
</div>
</blockquote>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">Ok, that’s legit weird. <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<p class="MsoNormal"><br>
<br>
<br>
<o:p></o:p></p>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<div>
<div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><br>
Rafo<br>
<br>
<br>
<o:p></o:p></p>
<div>
<p class="MsoNormal">On 05/22/2017 03:10 PM, Graham, Mathew Thomas wrote:<o:p></o:p></p>
</div>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">Sorry to ask a dumb question…but I will anyway. <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">This is a “2.3 GeV vs 1.05 GeV” issue? Or an hps-java version issue? <o:p></o:p></p>
</div>
<p class="MsoNormal"> <o:p></o:p></p>
<div>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<div>
<p class="MsoNormal">On May 22, 2017, at 12:05 PM, Omar Moreno <<a href="mailto:email@omarmoreno.net">email@omarmoreno.net</a>> wrote:<o:p></o:p></p>
</div>
<p class="MsoNormal"> <o:p></o:p></p>
<div>
<div>
<p class="MsoNormal">Jeremy has also profiled the recon before so if Maurik can't do it, I'm sure he can. <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
<div>
<p class="MsoNormal">On May 22, 2017 11:46 AM, "Rafayel Paremuzyan" <<a href="mailto:rafopar@jlab.org">rafopar@jlab.org</a>> wrote:<o:p></o:p></p>
<blockquote style="border:none;border-left:solid #CCCCCC 1.0pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-top:5.0pt;margin-right:0in;margin-bottom:5.0pt">
<p class="MsoNormal">Hi Alessandra and all,<br>
<br>
Yes clearly I see that pattern as well,<br>
going to the faster machine (pumpkin1), as Maurik suggested,<br>
recon speed increased, but 2016 recon was about x2 slower than the 2015 recon speed.<br>
I also tried to with -Xms=4000m -Xmx=4000m options, and without that options,<br>
but I didn't notice noticeable speed improvement.<br>
<br>
Another thing that is *concering* is I run<br>
same jar on batch farms, centos6. and centos7, and<br>
can't get same speed as we got during the pass0.<br>
Note, jar is the same, detector is the same, run number and file number is the same.<br>
Difference is the time when it started to tun (Oct 19 2016 vs May 21 2017)<br>
<br>
If someone is interested to look at job log files<br>
The log file that I run yesterday: /lustre/expphy/work/hallb/hps/data/physrun2016/tpass1/logs/hps_008054.27_pass0XML.err<br>
The log file that run on Oct 19 2016 for pass0 /lustre/expphy/work/hallb/hps/data/physrun2016/pass0/logs/hps_008054.27_R3.9.err<br>
<br>
I have never done profiling with java.<br>
I know Maurik is in workshop, he might not have time to do this,<br>
if someone else is set up doing this, it will probably be useful.<br>
<br>
Also, I noticed /group/hps is full<br>
<br>
Has anyone recently put some data there?<br>
<br>
Rafo <o:p></o:p></p>
<div>
<p class="MsoNormal"><br>
<br>
<br>
On 05/22/2017 04:04 AM, Alessandra Filippi wrote:<o:p></o:p></p>
</div>
<blockquote style="border:none;border-left:solid #CCCCCC 1.0pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-top:5.0pt;margin-right:0in;margin-bottom:5.0pt">
<div>
<p class="MsoNormal" style="margin-bottom:12.0pt">Hi Maurik, Rafo and all,<br>
I think that the different Java VM could impact on the absolute speed comparing different machines and jar versions compiled in different times... but I am running the same jar (hps-java 3.10, compiled afresh at slac on rhel6-64, jvm 1.7.0) on 2015 and 2016
data, and the factor ~2 of speed decrease for newer data is striking (whichever geometry version).<br>
About garbage collection, I don't use any flag in compilation, so it acts in default mode in both cases.<br>
<br>
Are 2016 data affected by more noisy hits that could extend the reconstruction time over testing all different strategies, to your knowledge?<br>
cheers<br>
Alessandra<br>
<br>
<br>
<br>
<br>
<br>
<br>
On Sun, 21 May 2017, Maurik Holtrop wrote:<o:p></o:p></p>
</div>
<blockquote style="border:none;border-left:solid #CCCCCC 1.0pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-top:5.0pt;margin-right:0in;margin-bottom:5.0pt">
<div>
<p class="MsoNormal">Hello Rafo,<br>
One thing that probably is different between the last time we ran with the 3.8 jar and now<br>
is a different version of the Java VM. It could well be that the newer version of Java is<br>
not faster. Also, it is tricky to compare Endeavour with the Jlab farm computers. They are<br>
probably not equivalent in speed. At UNH, Pumpkin has the more modern processors, whereas<br>
Endeavour is now ~5 years old.<br>
<br>
Best,<br>
Maurik<br>
<br>
On May 21, 2017, at 6:54 AM, Rafayel Paremuzyan <<a href="mailto:rafopar@jlab.org" target="_blank">rafopar@jlab.org</a>> wrote:<br>
<br>
Hi Alessandra, Norman, all<br>
<br>
thank you for replay and your tests.<br>
<br>
I tested both 2015 and 2016 data using v4-4 detector on UNH computers.<br>
I have use 3.8 JAR (the jar for 2015 pass6). 3.9 JAR (the jar for 2016 pass0 recon),<br>
and the NEW jar v051717 (the newest jar tag is v051717)<br>
<br>
Ok, I also noticed that recon of 2015 data is faster that 2016 data.<br>
Also seems the new jar is 20% slower than the 3.9 jar for 2016 data, and about 60%<br>
slower for 2015 data.<br>
now recon speed is about 2.55 EV/S for 2015 data, This is too slow<br>
it cause more than 40h for a single file.<br>
<br>
Ths is summary of code speeds with different jar files<br>
V4-4 Detector, UNH (endeavour), 5K events are reconstructed<br>
<br>
Events per second<br>
Events per second<br>
Events per second<br>
<br>
3.8JAR (2015 recon jar)<br>
3.9JAR, 2016 pass0 recon jar<br>
v051717JAR, jar vor tpass1<br>
2015 Data 5772, file 20<br>
5.07<br>
5.19<br>
3.157<br>
2016 Data file 25<br>
<br>
3.11<br>
2.53<br>
<br>
*However* I looked into job Wall times for pass0 recon.<br>
The recon speed is more than 7.4 Events/sec, which is about x3 faster than with the<br>
new JAR.<br>
<br>
I again checked *same 3.9 jar*, which is slower again.<br>
I don't know why now the code speed is so low!<br>
<br>
<br>
Norman, I have tried the "-DdisableSvtAlignmentConstants", but it didn't work<br>
<br>
=================The command===============<br>
java -XX:+UseSerialGC -cp hps-distribution-3.11-v051717-bin.jar<br>
org.hps.evio.EvioToLcio -x /org/hps/steering/recon/PhysicsRun2016FullRecon.lcsim -r<br>
-d HPS-PhysicsRun2016-v5-3-fieldmap_globalAlign -R 7796 -DoutputFile=out_7796_0<br>
-DdisableSvtAlignmentConstants hps_007796.evio.25 -n 10000<br>
<br>
============The error backtrache============<br>
2017-05-21 00:45:39 [CONFIG] org.hps.evio.EvioToLcio parse :: using steering<br>
resource /org/hps/steering/recon/PhysicsRun2016FullRecon.lcsim<br>
2017-05-21 00:45:39 [CONFIG] org.hps.evio.EvioToLcio parse :: set max events to<br>
10000<br>
2017-05-21 00:45:48 [INFO] org.hps.rundb.RunManager <init> :: ConnectionParameters {<br>
database: hps_run_db_v2, hostname: <a href="http://hpsdb.jlab.org/" target="_blank">
hpsdb.jlab.org</a>, password: darkphoton, port: 3306,<br>
user: hpsuser }<br>
2017-05-21 00:45:48 [CONFIG] org.lcsim.job.JobControlManager addVariableDefinition<br>
:: outputFile = out_7796_0<br>
2017-05-21 00:45:48 [CONFIG] org.hps.evio.EvioToLcio parse :: set steering variable:<br>
outputFile=out_7796_0<br>
2017-05-21 00:45:48 [SEVERE] org.hps.evio.EvioToLcio parse :: bad variable format:<br>
disableSvtAlignmentConstants<br>
java.lang.IllegalArgumentException: Bad variable format:<br>
disableSvtAlignmentConstants<br>
at org.hps.evio.EvioToLcio.parse(EvioToLcio.java:393)<br>
at org.hps.evio.EvioToLcio.main(EvioToLcio.java:97)<br>
<br>
Exception in thread "main" java.lang.IllegalArgumentException: Bad variable format:<br>
disableSvtAlignmentConstants<br>
at org.hps.evio.EvioToLcio.parse(EvioToLcio.java:393)<br>
at org.hps.evio.EvioToLcio.main(EvioToLcio.java:97)<br>
<br>
Rafo<br>
<br>
<br>
<br>
<br>
<br>
<br>
On 05/20/2017 06:17 AM, Alessandra Filippi wrote:<br>
Hi Rafo, all,<br>
I also noticed that the reconstruction for 2016 data is about twice as<br>
slow as compared to 2015 (whichever geometry and reconstruction<br>
version).<br>
This happens when I run the aligned geometry as well as the "current"<br>
one (v5.0), and the geometry taken from the db as well (the result is<br>
the same as v5.0). I did not make any test with v4.4, though - actually<br>
as far as svt alignment is concerned it should be the same as v5.0. Can<br>
you please try and make the same short test with the newest jar with<br>
v4.4?<br>
This happens to me both with hps-java 5.10 and 5.11 (not the most<br>
updated one).<br>
<br>
I would be surprised if it could be something connected to the<br>
alignment, unless for some reason new positions and harder tracks<br>
trigger some long loops in the reconstruction. But this happens (to me)<br>
also with the<br>
standard geometry, so a check with the one used with pass0 (that should<br>
however be equivalent to v5.0) could at least help to rule out, or blame<br>
on, the alignment step.<br>
Thanks, cheers<br>
Alessandra<br>
<br>
<br>
ps. make also sure that the correct fieldmap is called in all the<br>
compact files - you never know!<br>
<br>
<br>
<br>
On Fri, 19 May 2017, Rafayel Paremuzyan wrote:<br>
<br>
Hi All,<br>
<br>
During the testing the recon for test pass1,<br>
I noticed the recon time is more than x2 longer wrt pass0<br>
recon time.<br>
<br>
To demonstrate it<br>
I submit 3 simple jobs with 10K events to reconstruct, with<br>
new pass1 xml<br>
file (this has the new jar v051717, and the new detector<br>
HPS-PhysicsRun2016-v5-3-fieldmap_globalAlign),<br>
and the old pass0 xml file (pass0 jar release 3.9, and the<br>
detector<br>
HPS-PhysicsRun2016-Nominal-v4-4-fieldmap)<br>
<br>
Below is a printout from the jobs with a new JAR, v051717,<br>
the average time<br>
for 1000 events is more than 7 minutes<br>
===================== LOG from the v051717 JAR<br>
==============================<br>
2017-05-19 09:36:51 [INFO] org.lcsim.job.EventMarkerDriver<br>
process :: Event<br>
10614074 with sequence 0<br>
2017-05-19 09:43:13 [INFO] org.lcsim.job.EventMarkerDriver<br>
process :: Event<br>
10615074 with sequence 1000<br>
2017-05-19 09:49:18 [INFO] org.lcsim.job.EventMarkerDriver<br>
process :: Event<br>
10616074 with sequence 2000<br>
2017-05-19 09:55:54 [INFO] org.lcsim.job.EventMarkerDriver<br>
process :: Event<br>
10617074 with sequence 3000<br>
2017-05-19 10:02:55 [INFO] org.lcsim.job.EventMarkerDriver<br>
process :: Event<br>
10618074 with sequence 4000<br>
2017-05-19 10:09:57 [INFO] org.lcsim.job.EventMarkerDriver<br>
process :: Event<br>
10619074 with sequence 5000<br>
2017-05-19 10:16:13 [INFO] org.lcsim.job.EventMarkerDriver<br>
process :: Event<br>
10620074 with sequence 6000<br>
2017-05-19 10:25:20 [INFO] org.lcsim.job.EventMarkerDriver<br>
process :: Event<br>
10621074 with sequence 7000<br>
2017-05-19 10:32:56 [INFO] org.lcsim.job.EventMarkerDriver<br>
process :: Event<br>
10622074 with sequence 8000<br>
2017-05-19 10:36:19 [WARNING]<br>
org.hps.recon.tracking.TrackerReconDriver<br>
process :: Discarding track with bad HelicalTrackHit<br>
(correction distance<br>
0.000000, chisq penalty 0.000000)<br>
2017-05-19 10:42:03 [INFO] org.lcsim.job.EventMarkerDriver<br>
process :: Event<br>
10623074 with sequence 9000<br>
2017-05-19 10:47:44 [INFO] org.hps.evio.EvioToLcio run ::<br>
maxEvents 10000<br>
was reached<br>
2017-05-19 10:47:44 [INFO] org.lcsim.job.EventMarkerDriver<br>
endOfData ::<br>
10000 events processed in job.<br>
2017-05-19 10:47:44 [INFO] org.hps.evio.EvioToLcio run ::<br>
Job finished<br>
successfully!<br>
<br>
<br>
And below is the Job log info from the pass0 jar. The<br>
average time for 1000<br>
events is less than 3 minutes<br>
===================== LOG from the 3.9 release JAR<br>
==============================<br>
2017-05-19 13:19:46 [INFO] org.lcsim.job.EventMarkerDriver<br>
process :: Event<br>
10614074 with sequence 0<br>
2017-05-19 13:23:36 [INFO] org.lcsim.job.EventMarkerDriver<br>
process :: Event<br>
10615074 with sequence 1000<br>
2017-05-19 13:27:03 [INFO] org.lcsim.job.EventMarkerDriver<br>
process :: Event<br>
10616074 with sequence 2000<br>
2017-05-19 13:30:40 [INFO] org.lcsim.job.EventMarkerDriver<br>
process :: Event<br>
10617074 with sequence 3000<br>
2017-05-19 13:34:20 [INFO] org.lcsim.job.EventMarkerDriver<br>
process :: Event<br>
10618074 with sequence 4000<br>
2017-05-19 13:38:11 [INFO] org.lcsim.job.EventMarkerDriver<br>
process :: Event<br>
10619074 with sequence 5000<br>
2017-05-19 13:41:43 [INFO] org.lcsim.job.EventMarkerDriver<br>
process :: Event<br>
10620074 with sequence 6000<br>
2017-05-19 13:45:54 [WARNING]<br>
org.hps.recon.tracking.TrackerReconDriver<br>
process :: Discarding track with bad HelicalTrackHit<br>
(correction distance<br>
0.000000, chisq penalty 0.000000)<br>
2017-05-19 13:46:05 [INFO] org.lcsim.job.EventMarkerDriver<br>
process :: Event<br>
10621074 with sequence 7000<br>
2017-05-19 13:50:08 [INFO] org.lcsim.job.EventMarkerDriver<br>
process :: Event<br>
10622074 with sequence 8000<br>
2017-05-19 13:55:03 [INFO] org.lcsim.job.EventMarkerDriver<br>
process :: Event<br>
10623074 with sequence 9000<br>
2017-05-19 13:58:27 [INFO] org.hps.evio.EvioToLcio run ::<br>
maxEvents 10000<br>
was reached<br>
2017-05-19 13:58:27 [INFO] org.lcsim.job.EventMarkerDriver<br>
endOfData ::<br>
10000 events processed in job.<br>
2017-05-19 13:58:27 [INFO] org.hps.evio.EvioToLcio run ::<br>
Job finished<br>
successfully!<br>
<br>
I also tried to do reconstruction by myself interactively,<br>
but I am getting<br>
error below,<br>
<br>
The command<br>
/apps/scicomp/java/jdk1.7/bin/java -XX:+UseSerialGC -cp<br>
hps-distribution-3.9-bin.jar org.hps.evio.EvioToLcio -x<br>
/org/hps/steering/recon/PhysicsRun2016FullRecon.lcsim -r -d<br>
HPS-PhysicsRun2016-v5-3-fieldmap_globalAlign -R 7796<br>
-DoutputFile=out_7796_0<br>
hps_007796.evio.0 -n 10000<br>
<br>
The Error traceback<br>
017-05-19 14:58:44 [CONFIG] org.hps.evio.EvioToLcio parse ::<br>
using steering<br>
resource<br>
/org/hps/steering/recon/PhysicsRun2016FullRecon.lcsim<br>
2017-05-19 14:58:44 [CONFIG] org.hps.evio.EvioToLcio parse<br>
:: set max events<br>
to 10000<br>
2017-05-19 14:58:45 [CONFIG]<br>
org.lcsim.job.JobControlManager<br>
addVariableDefinition :: outputFile = out_7796_0<br>
2017-05-19 14:58:45 [CONFIG] org.hps.evio.EvioToLcio parse<br>
:: set steering<br>
variable: outputFile=out_7796_0<br>
2017-05-19 14:58:45 [CONFIG] org.lcsim.job.JobControlManager<br>
initializeLoop<br>
:: initializing LCSim loop<br>
2017-05-19 14:58:45 [CONFIG] org.lcsim.job.JobControlManager<br>
initializeLoop<br>
:: Event marker printing disabled.<br>
2017-05-19 14:58:45 [INFO]<br>
org.hps.conditions.database.DatabaseConditionsManager<br>
resetInstance ::<br>
DatabaseConditionsManager instance is reset<br>
Exception in thread "main" java.lang.UnsatisfiedLinkError:<br>
/u/apps/scicomp/java/jdk1.7.0_75/jre/lib/i386/xawt/libmawt.so:<br>
libXext.so.6:<br>
cannot open shared object file: No such file or directory<br>
at java.lang.ClassLoader$NativeLibrary.load(Native<br>
Method)<br>
at<br>
java.lang.ClassLoader.loadLibrary1(ClassLoader.java:1965)<br>
at<br>
java.lang.ClassLoader.loadLibrary0(ClassLoader.java:1890)<br>
at<br>
java.lang.ClassLoader.loadLibrary(ClassLoader.java:1851)<br>
at java.lang.Runtime.load0(Runtime.java:795)<br>
at java.lang.System.load(System.java:1062)<br>
at java.lang.ClassLoader$NativeLibrary.load(Native<br>
Method)<br>
at<br>
java.lang.ClassLoader.loadLibrary1(ClassLoader.java:1965)<br>
at<br>
java.lang.ClassLoader.loadLibrary0(ClassLoader.java:1890)<br>
at<br>
java.lang.ClassLoader.loadLibrary(ClassLoader.java:1872)<br>
at java.lang.Runtime.loadLibrary0(Runtime.java:849)<br>
at java.lang.System.loadLibrary(System.java:1088)<br>
at<br>
sun.security.action.LoadLibraryAction.run(LoadLibraryAction.java:67)<br>
at<br>
sun.security.action.LoadLibraryAction.run(LoadLibraryAction.java:47)<br>
at<br>
java.security.AccessController.doPrivileged(Native Method)<br>
at<br>
java.awt.Toolkit.loadLibraries(Toolkit.java:1653)<br>
at java.awt.Toolkit.<clinit>(Toolkit.java:1682)<br>
at java.awt.Component.<clinit>(Component.java:595)<br>
at org.lcsim.util.aida.AIDA.<init>(AIDA.java:68)<br>
at<br>
org.lcsim.util.aida.AIDA.defaultInstance(AIDA.java:53)<br>
at<br>
org.hps.evio.RfFitterDriver.<init>(RfFitterDriver.java:31)<br>
at<br>
sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native<br>
Method)<br>
atsun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAcce<br>
ssorImpl.java:57)<br>
atsun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstru<br>
ctorAccessorImpl.java:45)<br>
at<br>
java.lang.reflect.Constructor.newInstance(Constructor.java:526)<br>
at java.lang.Class.newInstance(Class.java:379)<br>
at<br>
org.lcsim.job.JobControlManager.setupDrivers(JobControlManager.java:1199) <br>
at<br>
org.hps.job.JobManager.setupDrivers(JobManager.java:82)<br>
at<br>
org.lcsim.job.JobControlManager.setup(JobControlManager.java:1052)<br>
at<br>
org.lcsim.job.JobControlManager.setup(JobControlManager.java:1110)<br>
at<br>
org.hps.evio.EvioToLcio.parse(EvioToLcio.java:407)<br>
at org.hps.evio.EvioToLcio.main(EvioToLcio.java:97)<br>
<br>
<br>
<br>
I see this library libXext.so.6: in /usr/lib64, but not in<br>
/usr/lib,<br>
when I put /usr/lib64 in my LD_LIBRARY_PATH, then it<br>
complaines again (see<br>
below)<br>
<br>
Exception in thread "main" java.lang.UnsatisfiedLinkError:<br>
/u/apps/scicomp/java/jdk1.7.0_75/jre/lib/i386/xawt/libmawt.so:<br>
libXext.so.6:<br>
wrong ELF class: ELFCLASS64<br>
<br>
I would appreciate, if I get some help on running the<br>
reconstruction<br>
interactively, then I could look more closely into logs<br>
of the old, and new JAR files.<br>
<br>
Rafo<br>
<br>
<br>
____________________________________________________________________________ <br>
<br>
Use REPLY-ALL to reply to list<br>
<br>
To unsubscribe from the HPS-SOFTWARE list, click the<br>
following link:<br>
<a href="https://urldefense.proofpoint.com/v2/url?u=https-3A__listserv.slac.stanford.edu_cgi-2Dbin" target="_blank">https://urldefense.proofpoint.com/v2/url?u=https-3A__listserv.slac.stanford.edu_cgi-2Dbin</a>
<br>
_wa-3FSUBED1-3DHPS-2DSOFTWARE-26A-3D1&d=DwIDaQ&c=lz9TcOasaINaaC3U7FbMev2lsutwpI4--09aP8Lu
<br>
18s&r=0HDJrGO9TZQTE97J9Abt2A&m=xnbGP5VHYWRAQRWRksVgMnYvBkXWI4roLxztdJ0Tp9I&s=ppNYedSrn5DP
<br>
aIZZJgRZu8tBDeSjroqbj_PoevFoFpI&e=<br>
<br>
<br>
<br>
########################################################################<br>
Use REPLY-ALL to reply to list<br>
<br>
To unsubscribe from the HPS-SOFTWARE list, click the following link:<br>
<a href="https://urldefense.proofpoint.com/v2/url?u=https-3A__listserv.slac.stanford.edu_cgi-2Dbin" target="_blank">https://urldefense.proofpoint.com/v2/url?u=https-3A__listserv.slac.stanford.edu_cgi-2Dbin</a>
<br>
_wa-3FSUBED1-3DHPS-2DSOFTWARE-26A-3D1&d=DwIDaQ&c=lz9TcOasaINaaC3U7FbMev2lsutwpI4--09aP8Lu
<br>
18s&r=0HDJrGO9TZQTE97J9Abt2A&m=xnbGP5VHYWRAQRWRksVgMnYvBkXWI4roLxztdJ0Tp9I&s=ppNYedSrn5DP
<br>
aIZZJgRZu8tBDeSjroqbj_PoevFoFpI&e=<br>
<br>
<br>
<br>
__________________________________________________________________________________________
<br>
<br>
Use REPLY-ALL to reply to list<br>
<br>
To unsubscribe from the HPS-SOFTWARE list, click the following link:<o:p></o:p></p>
</div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><a href="https://urldefense.proofpoint.com/v2/url?u=https-3A__listserv.slac.stanford.edu_cgi-2Dbin_wa-3FSUBED1-3DHPS-2DSOFTWARE-26A-3D1&d=DwIDbA&c=lz9TcOasaINaaC3U7FbMev2lsutwpI4--09aP8Lu18s&r=0HDJrGO9TZQTE97J9Abt2A&m=nIEvNWJSNxvmECWKfMrVKMTZKNdym3zsAls7WG1fdfU&s=cI82nYRtYBzgLs1l5g3anHrSt0kPk4B98oUzllu5KfQ&e=" target="_blank">https://urldefense.proofpoint.com/v2/url?u=https-3A__listserv.slac.stanford.edu_cgi-2Dbin_wa-3FSUBED1-3DHPS-2DSOFTWARE-26A-3D1&d=DwIDbA&c=lz9TcOasaINaaC3U7FbMev2lsutwpI4--09aP8Lu18s&r=0HDJrGO9TZQTE97J9Abt2A&m=nIEvNWJSNxvmECWKfMrVKMTZKNdym3zsAls7WG1fdfU&s=cI82nYRtYBzgLs1l5g3anHrSt0kPk4B98oUzllu5KfQ&e=</a>
<br>
<br>
<br>
<br>
<o:p></o:p></p>
</blockquote>
<div>
<p class="MsoNormal"><br>
########################################################################<br>
Use REPLY-ALL to reply to list<br>
<br>
To unsubscribe from the HPS-SOFTWARE list, click the following link:<o:p></o:p></p>
</div>
<p class="MsoNormal"><a href="https://urldefense.proofpoint.com/v2/url?u=https-3A__listserv.slac.stanford.edu_cgi-2Dbin_wa-3FSUBED1-3DHPS-2DSOFTWARE-26A-3D1&d=DwIDbA&c=lz9TcOasaINaaC3U7FbMev2lsutwpI4--09aP8Lu18s&r=0HDJrGO9TZQTE97J9Abt2A&m=nIEvNWJSNxvmECWKfMrVKMTZKNdym3zsAls7WG1fdfU&s=cI82nYRtYBzgLs1l5g3anHrSt0kPk4B98oUzllu5KfQ&e=" target="_blank">https://urldefense.proofpoint.com/v2/url?u=https-3A__listserv.slac.stanford.edu_cgi-2Dbin_wa-3FSUBED1-3DHPS-2DSOFTWARE-26A-3D1&d=DwIDbA&c=lz9TcOasaINaaC3U7FbMev2lsutwpI4--09aP8Lu18s&r=0HDJrGO9TZQTE97J9Abt2A&m=nIEvNWJSNxvmECWKfMrVKMTZKNdym3zsAls7WG1fdfU&s=cI82nYRtYBzgLs1l5g3anHrSt0kPk4B98oUzllu5KfQ&e=</a>
<o:p></o:p></p>
</blockquote>
<p class="MsoNormal"><br>
<br>
_______________________________________________<br>
Hps-analysis mailing list<br>
<a href="mailto:Hps-analysis@jlab.org" target="_blank">Hps-analysis@jlab.org</a><br>
<a href="https://mailman.jlab.org/mailman/listinfo/hps-analysis" target="_blank">https://mailman.jlab.org/mailman/listinfo/hps-analysis</a><o:p></o:p></p>
</blockquote>
</div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<p class="MsoNormal">_______________________________________________<br>
Hps-analysis mailing list<br>
<a href="mailto:Hps-analysis@jlab.org">Hps-analysis@jlab.org</a><br>
<a href="https://mailman.jlab.org/mailman/listinfo/hps-analysis">https://mailman.jlab.org/mailman/listinfo/hps-analysis</a><o:p></o:p></p>
</div>
</blockquote>
</div>
<p class="MsoNormal" style="margin-bottom:12.0pt"> <o:p></o:p></p>
<div class="MsoNormal" align="center" style="text-align:center">
<hr size="3" width="100%" align="center">
</div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">Use REPLY-ALL to reply to list<o:p></o:p></p>
<p class="MsoNormal" align="center" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;text-align:center">
To unsubscribe from the HPS-SOFTWARE list, click the following link:<br>
<a href="https://urldefense.proofpoint.com/v2/url?u=https-3A__listserv.slac.stanford.edu_cgi-2Dbin_wa-3FSUBED1-3DHPS-2DSOFTWARE-26A-3D1&d=DwMGaQ&c=lz9TcOasaINaaC3U7FbMev2lsutwpI4--09aP8Lu18s&r=0HDJrGO9TZQTE97J9Abt2A&m=yktqxWZIxrOJDj0GcxtXMdIm5S6CzoD5o_bfENc8yOA&s=9UGWhMTkreQfG7iEUol-dsVGExrJm-lRdRBfTmh68jU&e=" target="_blank">https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=HPS-SOFTWARE&A=1</a>
<o:p></o:p></p>
</blockquote>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
</div>
</blockquote>
</div>
<p class="MsoNormal" style="margin-bottom:12.0pt"> <o:p></o:p></p>
<div class="MsoNormal" align="center" style="text-align:center">
<hr size="3" width="100%" align="center">
</div>
<p>Use REPLY-ALL to reply to list<o:p></o:p></p>
<p align="center" style="text-align:center">To unsubscribe from the HPS-SOFTWARE list, click the following link:<br>
<a href="https://urldefense.proofpoint.com/v2/url?u=https-3A__listserv.slac.stanford.edu_cgi-2Dbin_wa-3FSUBED1-3DHPS-2DSOFTWARE-26A-3D1&d=DwMGaQ&c=lz9TcOasaINaaC3U7FbMev2lsutwpI4--09aP8Lu18s&r=0HDJrGO9TZQTE97J9Abt2A&m=7kpWnc-wAM7IOppfAzLDwv1CB_CV5cve1_5MyJdB9IY&s=0GGLvbF5XbRfWvwDkVU2SxAw54dILOaQOFxPQNW0cQc&e=" target="_blank">https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=HPS-SOFTWARE&A=1</a>
<o:p></o:p></p>
</blockquote>
<p class="MsoNormal"> <o:p></o:p></p>
<p class="MsoNormal"><span style="color:windowtext"> </span><o:p></o:p></p>
<div class="MsoNormal" align="center" style="text-align:center"><span style="color:windowtext">
<hr size="3" width="100%" align="center">
</span></div>
<p><span style="color:windowtext">Use REPLY-ALL to reply to list</span><o:p></o:p></p>
<p align="center" style="text-align:center"><span style="color:windowtext">To unsubscribe from the HPS-SOFTWARE list, click the following link:<br>
<a href="https://urldefense.proofpoint.com/v2/url?u=https-3A__listserv.slac.stanford.edu_cgi-2Dbin_wa-3FSUBED1-3DHPS-2DSOFTWARE-26A-3D1&d=DwMGaQ&c=lz9TcOasaINaaC3U7FbMev2lsutwpI4--09aP8Lu18s&r=0HDJrGO9TZQTE97J9Abt2A&m=wW_GlfxTzq-pRvKL4e2JZowusyO_SMM8OXCRlQaFoik&s=jhZ6FxoZc0hnA1vqR11SSFAZbByjK4jgRynt1CZ_YuY&e=" target="_blank">https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=HPS-SOFTWARE&A=1</a>
</span><o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<div class="MsoNormal" align="center" style="text-align:center">
<hr size="2" width="100%" align="center">
</div>
<p>Use REPLY-ALL to reply to list<o:p></o:p></p>
<p align="center" style="text-align:center">To unsubscribe from the HPS-SOFTWARE list, click the following link:<br>
<a href="https://urldefense.proofpoint.com/v2/url?u=https-3A__listserv.slac.stanford.edu_cgi-2Dbin_wa-3FSUBED1-3DHPS-2DSOFTWARE-26A-3D1&d=DwMGaQ&c=lz9TcOasaINaaC3U7FbMev2lsutwpI4--09aP8Lu18s&r=0HDJrGO9TZQTE97J9Abt2A&m=wW_GlfxTzq-pRvKL4e2JZowusyO_SMM8OXCRlQaFoik&s=jhZ6FxoZc0hnA1vqR11SSFAZbByjK4jgRynt1CZ_YuY&e=" target="_blank">https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=HPS-SOFTWARE&A=1</a>
<o:p></o:p></p>
</blockquote>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><span style="color:windowtext"><o:p> </o:p></span></p>
<div class="MsoNormal" align="center" style="text-align:center"><span style="color:windowtext">
<hr size="2" width="100%" align="center">
</span></div>
<p>Use REPLY-ALL to reply to list<o:p></o:p></p>
<p align="center" style="text-align:center">To unsubscribe from the HPS-SOFTWARE list, click the following link:<br>
<a href="https://urldefense.proofpoint.com/v2/url?u=https-3A__listserv.slac.stanford.edu_cgi-2Dbin_wa-3FSUBED1-3DHPS-2DSOFTWARE-26A-3D1&d=DwMGaQ&c=lz9TcOasaINaaC3U7FbMev2lsutwpI4--09aP8Lu18s&r=J4PP6Zl8IyGHpsqWaKegORCYw8hoCHePTw5O95a5lqQ&m=j6XMrHGLXJwpB5-uTCq1N9nVuspTSV7mFB8qIJ1M_pU&s=qoyeVOASUW4XcFjHaGUDv5i_eTV8oHsk8hSw2DH28OY&e=" target="_blank">https://listserv.slac.stanford.edu/cgi-bin/wa?SUBED1=HPS-SOFTWARE&A=1</a>
<o:p></o:p></p>
</div>
</body>
</html>