<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<style type="text/css" style="display:none;"><!-- P {margin-top:0;margin-bottom:0;} --></style>
</head>
<body dir="ltr">
<div id="divtagdefaultwrapper" style="font-size:12pt;color:#000000;font-family:Calibri,Helvetica,sans-serif;" dir="ltr">
<p style="margin-top:0;margin-bottom:0">Thanks Maurik and Miriam,</p>
<p style="margin-top:0;margin-bottom:0"><br>
</p>
<p style="margin-top:0;margin-bottom:0">I think only having the cut on unconstrained, and writing out other collections based on that, is a viable solution. As long as we trust the unconstrained chisq probabilities enough to do this, which I have never looked
at before yesterday. But, the question is do we?</p>
<p style="margin-top:0;margin-bottom:0"><br>
</p>
<p style="margin-top:0;margin-bottom:0">Matt Solt<br>
</p>
</div>
<hr style="display:inline-block;width:98%" tabindex="-1">
<div id="divRplyFwdMsg" dir="ltr"><font face="Calibri, sans-serif" style="font-size:11pt" color="#000000"><b>From:</b> Graham, Mathew Thomas <mgraham@slac.stanford.edu><br>
<b>Sent:</b> Thursday, January 31, 2019 9:24:03 AM<br>
<b>To:</b> Maurik Holtrop<br>
<b>Cc:</b> Solt, Matthew Reagan; Diamond, Miriam; hps-analysis@jlab.org; Graf, Norman A.<br>
<b>Subject:</b> Re: [Hps-analysis] Vertex Chisq Probability Cut?</font>
<div> </div>
</div>
<div class="" style="word-wrap:break-word; line-break:after-white-space">Great! Thanks Maurik. <br class="">
<div><br class="">
<blockquote type="cite" class="">
<div class="">On Jan 31, 2019, at 10:20 AM, maurik <<a href="mailto:maurik@physics.unh.edu" class="">maurik@physics.unh.edu</a>> wrote:</div>
<br class="x_Apple-interchange-newline">
<div class="">
<div class="" style="word-wrap:break-word; line-break:after-white-space">Matt, Norman,
<div class=""><br class="">
</div>
<div class="">I started iss398 branch and am testing the code right now. It seems to be passing the Integration tests.</div>
<div class=""><br class="">
</div>
<div class="">I will process an EVIO file locally and send it to Jlab or SLAC. Let me know where to put that at SLAC.</div>
<div class="">Should have it available at the end of the day for testing.</div>
<div class=""><br class="">
</div>
<div class="">Best,</div>
<div class=""><span class="x_Apple-tab-span" style="white-space:pre"></span>Maurik<br class="">
<div class=""><br class="">
<blockquote type="cite" class="">
<div class="">On Jan 31, 2019, at 12:06 PM, maurik <<a href="mailto:maurik@physics.unh.edu" class="">maurik@physics.unh.edu</a>> wrote:</div>
<br class="x_Apple-interchange-newline">
<div class="">
<div class="" style="word-wrap:break-word; line-break:after-white-space">Thanks Miriam! That is really helpful.
<div class=""><br class="">
</div>
<div class="">I am going to start an issue with a new branch, just to suggest how we could modify this part of the code so the chisquared check is ONLY on the UNCONSTRAINED vertexes. If it passes the unconstrained vertex, then all versions of constrained are
written out.</div>
<div class=""><br class="">
</div>
<div class="">- Maurik</div>
<div class=""><br class="">
<div class=""><br class="">
<blockquote type="cite" class="">
<div class="">On Jan 31, 2019, at 11:49 AM, Diamond, Miriam <<a href="mailto:mdiamond@slac.stanford.edu" class="">mdiamond@slac.stanford.edu</a>> wrote:</div>
<br class="x_Apple-interchange-newline">
<div class="">
<div id="x_divtagdefaultwrapper" dir="ltr" class="" style="font-style:normal; font-variant-caps:normal; font-weight:normal; letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none; font-size:12pt; font-family:Calibri,Helvetica,sans-serif">
<div class="" style="margin-top:0px; margin-bottom:0px">It is indeed part of the MOUSE cuts: <span class="" style="color:rgb(36,41,46); font-family:SFMono-Regular,Consolas,"Liberation Mono",Menlo,Courier,monospace; font-size:12px; white-space:pre; background-color:rgb(255,251,221)">MinVertexChisqProb</span>.
The cut value can be set via <a href="https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FJeffersonLab%2Fhps-java%2Fblob%2Fmaster%2Frecon%2Fsrc%2Fmain%2Fjava%2Forg%2Fhps%2Frecon%2Fparticle%2FReconParticleDriver.java%23L395&data=02%7C01%7Chps-analysis%40jlab.org%7Cb3cd4ad282304039b3d408d687a7950a%7Cb4d7ee1f4fb34f0690372b5b522042ab%7C1%7C0%7C636845551167773962&sdata=pSISbCwca%2FoIf7HQShd3BTdXryMjy%2FgbLWfAIPg%2FnMs%3D&reserved=0" originalSrc="https://github.com/JeffersonLab/hps-java/blob/master/recon/src/main/java/org/hps/recon/particle/ReconParticleDriver.java#L395" shash="ckoWXBjTlD9LgX0ysXAG1y3HJIdkVW/8wOWf9cmAkcc3TvdHFWXf+p4NjratKnz1tbs72qocdGcmFK6xXt32K2BuZV6NQVyeaEx/feXUNx5nmHtXBMuEhvzOEmSv5vf59O1VKKxRIDIL3BFKVjww8N66ZWrGwUQ2B+jGHkzqf9M=" originalsrc="https://github.com/JeffersonLab/hps-java/blob/master/recon/src/main/java/org/hps/recon/particle/ReconParticleDriver.java#L395" shash="YKl+RIA9LZCCT78XyepkkKgB1aYpNQR8nQxbb206jfco1N9CMBezHo0PM27QgTdVUb/VsEZfsDKsiTDeNhQtryRpZ5s3yjs+ocSQ6OOm/+QbCICjERZGX5OQPILPPSmvF6mfaWKM1rYe46JNUb8iiFAP9ZmOizbsjvNxa2HzQhM=" class="x_OWAAutoLink" id="LPlnk998093"></a></div>
<a href="https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FJeffersonLab%2Fhps-java%2Fblob%2Fmaster%2Frecon%2Fsrc%2Fmain%2Fjava%2Forg%2Fhps%2Frecon%2Fparticle%2FHpsReconParticleDriver.java%23L281&data=02%7C01%7Chps-analysis%40jlab.org%7Cb3cd4ad282304039b3d408d687a7950a%7Cb4d7ee1f4fb34f0690372b5b522042ab%7C1%7C0%7C636845551167773962&sdata=9JE5xWMgKLd8W5YjsFR0ptgyT1Jgirn0PEX6HIpYaT8%3D&reserved=0" originalSrc="https://github.com/JeffersonLab/hps-java/blob/master/recon/src/main/java/org/hps/recon/particle/HpsReconParticleDriver.java#L281" shash="IPEkddu+H3dDVNbO2qF9T1Q5Fw11D/U9vqoy4Xl2yyWpj0N56KO/xxDtz3rVwzgg4EPefFNXK2I5x6h1/DyZfSagd8FpmsbFY3JYjhV739FGbACM3w2yQT+zSitX9kVAaLmHA+1C3xP4Zs35Oj4DH+kIFgphkxzFoz6BMCL8hNc=" originalsrc="https://github.com/JeffersonLab/hps-java/blob/master/recon/src/main/java/org/hps/recon/particle/HpsReconParticleDriver.java#L281" shash="xvHdjPc+Ef16Ugzh7E02wBMNbxpJnvA3pnIngbzk8DnNsQEL94mNxcz8ybbFjs0vQu5nmQwJna1eCrdoOJZvGSSjlIBLPdiDJc4JC5difc3Y02YUIKNpwlcyz6TuTPJ3jmgRLfG3eceVmigsH03wME0tuQ9aMZarNbP84LOgZRM=" class="x_OWAAutoLink" id="LPlnk920184">https://github.com/JeffersonLab/hps-java/blob/master/recon/src/main/java/org/hps/recon/particle/HpsReconParticleDriver.java#L281</a> .;
you could essentially disable it by setting it to 0.
<div class=""><br class="">
<div class="">The cut is applied here: <a href="https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FJeffersonLab%2Fhps-java%2Fblob%2Fmaster%2Frecon%2Fsrc%2Fmain%2Fjava%2Forg%2Fhps%2Frecon%2Fparticle%2FHpsReconParticleDriver.java%23L626&data=02%7C01%7Chps-analysis%40jlab.org%7Cb3cd4ad282304039b3d408d687a7950a%7Cb4d7ee1f4fb34f0690372b5b522042ab%7C1%7C0%7C636845551167773962&sdata=CjDh7UUXPeAi16jEWSYLQKil5sFATGy7Mug6%2FP0JjGE%3D&reserved=0" originalSrc="https://github.com/JeffersonLab/hps-java/blob/master/recon/src/main/java/org/hps/recon/particle/HpsReconParticleDriver.java#L626" shash="Dr4KZKlk4EjsAvNBc+nybjlXEPfiCGNe7vHeQZyMxj/LFYgowgtI0+uZ5dv4zuUsOnmDmIEjJH8kXy0MnSKiLDSGB+AyPu5xAZ1TeZFnSDOwxXx50BfbWAh7t1HMN5+w/HCguby7Sb625IdiSZfm/8Hh2n1tXrQLug3V5/e8ccY=" originalsrc="https://github.com/JeffersonLab/hps-java/blob/master/recon/src/main/java/org/hps/recon/particle/HpsReconParticleDriver.java#L626" shash="xp0E6nBjAdAC1GePxwPth7k58TXgttQRJ64JISNT2s562zkPxakCanALpiHbpWb4jTBEgJX1DrywV+QWMfhKqPKZROpxCCdiJCl9xVrTrKzp6RwTNWaef9/fl5hdM838tlo84lxSl8oJlA14jZ+M9GDhOZRHe+Li6sPTCa4ZwMs=" class="x_OWAAutoLink" id="LPlnk866444">https://github.com/JeffersonLab/hps-java/blob/master/recon/src/main/java/org/hps/recon/particle/HpsReconParticleDriver.java#L626</a> </div>
<div class=""><br class="">
</div>
<div class="">There are no grave consequences to removing this cut, you'll just get more junk vertices in the lcio.<br class="">
<div class="" style="margin-top:0px; margin-bottom:0px"><br class="">
</div>
<div class="" style="margin-top:0px; margin-bottom:0px">-- Miriam</div>
<br class="">
</div>
</div>
</div>
<hr tabindex="-1" class="" style="font-family:Helvetica; font-size:14px; font-style:normal; font-variant-caps:normal; font-weight:normal; letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none; display:inline-block; width:918.25px">
<span class="" style="font-family:Helvetica; font-size:14px; font-style:normal; font-variant-caps:normal; font-weight:normal; letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none; float:none; display:inline!important"></span>
<div id="x_divRplyFwdMsg" dir="ltr" class="" style="font-family:Helvetica; font-size:14px; font-style:normal; font-variant-caps:normal; font-weight:normal; letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none">
<font face="Calibri, sans-serif" class="" style="font-size:11pt"><b class="">From:</b><span class="x_Apple-converted-space"> </span>Solt, Matthew Reagan <<a href="mailto:mrsolt@slac.stanford.edu" class="">mrsolt@slac.stanford.edu</a>><br class="">
<b class="">Sent:</b><span class="x_Apple-converted-space"> </span>Thursday, January 31, 2019 12:15:15 AM<br class="">
<b class="">To:</b><span class="x_Apple-converted-space"> </span><a href="mailto:hps-analysis@jlab.org" class="">hps-analysis@jlab.org</a><br class="">
<b class="">Cc:</b><span class="x_Apple-converted-space"> </span>Diamond, Miriam; Nelson, Timothy Knight; Graham, Mathew Thomas; Graf, Norman A.<br class="">
<b class="">Subject:</b><span class="x_Apple-converted-space"> </span>Vertex Chisq Probability Cut?</font>
<div class=""> </div>
</div>
<div dir="ltr" class="" style="font-family:Helvetica; font-size:14px; font-style:normal; font-variant-caps:normal; font-weight:normal; letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none">
<div id="x_x_divtagdefaultwrapper" dir="ltr" class="" style="font-size:12pt; font-family:Calibri,Helvetica,sans-serif">
<div class="" style="margin-top:0px; margin-bottom:0px">Hi all,</div>
<div class="" style="margin-top:0px; margin-bottom:0px"><br class="">
</div>
<div class="" style="margin-top:0px; margin-bottom:0px">Long email, executive summary: we should remove the vertex chisq probability cut in the reconstruction. Details below.<br class="">
</div>
<div class="" style="margin-top:0px; margin-bottom:0px"><br class="">
</div>
<div class="" style="margin-top:0px; margin-bottom:0px">There is a cut in the reconstruction on the vertex chisq probability, which I think is part of the MOUSE cuts, that is causing issues for displaced A's. Where has this cut been verified (specifically for
displaced A's)? Plots are attached that show the following story.</div>
<div class="" style="margin-top:0px; margin-bottom:0px"><br class="">
</div>
<div class="" style="margin-top:0px; margin-bottom:0px">There is currently a cut at 1.7e-16 for the current reconstruction which seems fine, except the distributions for the beamspot constrained and unconstrained probabilities look crazy, with bsc having a
significant number events at a probability of 0 and the unconstrained distributions have events closer to 1 (I didn't check target constrained). For the same vertex, the reconstruction can write an unconstrained vertex that passes the cut, but not a bsc that
doesn't pass the cut (which is definitely not what we want). This particularly effects high z events, including clean signal events, as bsc probability is highly anti-correlated with z. This is actually how I just noticed it today, while looking at displaced
A's which have very few reconstructed high z events. This effect is not noticeable in either data or MC because the it really only effects high z events (both good signal and background).</div>
<div class="" style="margin-top:0px; margin-bottom:0px"><br class="">
</div>
<div class="" style="margin-top:0px; margin-bottom:0px">What's worse is that apparently the tuple maker requires a vertex to have both a bsc and unconstrained collection, so if it doesn't have a bsc vertex it throws them both away even if the unconstrained
passes the cut (not true in the lcio). I first noticed it in the displaced A' tuples (which have the default cut of 0.00001, so even worse than the data reconstruction).</div>
<div class="" style="margin-top:0px; margin-bottom:0px"><br class="">
</div>
<div class="" style="margin-top:0px; margin-bottom:0px">What affect does this have on current pass4? It doesn't effect the core distributions much at all, which is why I didn't catch it yet. It only really affects high z signal and background (which is obviously
important). The unconstrained collection is probably ok in the lcio files, it's more just the beamspot constrained collection and the ntuples.</div>
<div class="" style="margin-top:0px; margin-bottom:0px"><br class="">
</div>
<div class="" style="margin-top:0px; margin-bottom:0px">So, why do the vertex chisq probability distributions look weird? I don't know, I haven't had time to dig that far. But since I don't think we understand this effect, and we are trying to compute our data
ASAP, we should remove the cut in the reconstruction for now. If there are consequences to removing this cut, someone should speak up (Tim, Miriam, Matt, Norman?).</div>
<div class="" style="margin-top:0px; margin-bottom:0px"><br class="">
</div>
<div class="" style="margin-top:0px; margin-bottom:0px">I hope I was clear, but I'm sure some of you will have questions. Also, if someone gets a chance, can someone verify these probability plots? Thanks.</div>
<div class="" style="margin-top:0px; margin-bottom:0px"><br class="">
</div>
<div class="" style="margin-top:0px; margin-bottom:0px">Matt Solt<br class="">
</div>
</div>
</div>
<span class="" style="font-family:Helvetica; font-size:14px; font-style:normal; font-variant-caps:normal; font-weight:normal; letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none; float:none; display:inline!important">_______________________________________________</span><br class="" style="font-family:Helvetica; font-size:14px; font-style:normal; font-variant-caps:normal; font-weight:normal; letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none">
<span class="" style="font-family:Helvetica; font-size:14px; font-style:normal; font-variant-caps:normal; font-weight:normal; letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none; float:none; display:inline!important">Hps-analysis
mailing list</span><br class="" style="font-family:Helvetica; font-size:14px; font-style:normal; font-variant-caps:normal; font-weight:normal; letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none">
<span class="" style="font-family:Helvetica; font-size:14px; font-style:normal; font-variant-caps:normal; font-weight:normal; letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none; float:none; display:inline!important"><a href="mailto:Hps-analysis@jlab.org" class="">Hps-analysis@jlab.org</a></span><br class="" style="font-family:Helvetica; font-size:14px; font-style:normal; font-variant-caps:normal; font-weight:normal; letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none">
<span class="" style="font-family:Helvetica; font-size:14px; font-style:normal; font-variant-caps:normal; font-weight:normal; letter-spacing:normal; text-align:start; text-indent:0px; text-transform:none; white-space:normal; word-spacing:0px; text-decoration:none; float:none; display:inline!important"><a href="https://mailman.jlab.org/mailman/listinfo/hps-analysis" class="">https://mailman.jlab.org/mailman/listinfo/hps-analysis</a></span></div>
</blockquote>
</div>
<br class="">
</div>
</div>
_______________________________________________<br class="">
Hps-analysis mailing list<br class="">
<a href="mailto:Hps-analysis@jlab.org" class="">Hps-analysis@jlab.org</a><br class="">
<a href="https://mailman.jlab.org/mailman/listinfo/hps-analysis" class="">https://mailman.jlab.org/mailman/listinfo/hps-analysis</a><br class="">
</div>
</blockquote>
</div>
<br class="">
</div>
</div>
_______________________________________________<br class="">
Hps-analysis mailing list<br class="">
<a href="mailto:Hps-analysis@jlab.org" class="">Hps-analysis@jlab.org</a><br class="">
https://mailman.jlab.org/mailman/listinfo/hps-analysis<br class="">
</div>
</blockquote>
</div>
<br class="">
</div>
</body>
</html>