<html><head><meta http-equiv="Content-Type" content="text/html charset=utf-8"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class=""><div class=""><br class=""></div><div class="">Hi All,</div><div class=""><br class=""></div><div class=""> Just as a quick follow up:</div><div class=""><br class=""></div><div class="">I’ve been discussing this today with several members of the DAQ group who also have been </div><div class="">discussing it among themselves. Graham H., Dave A., Carl T. and I have formed a preliminary</div><div class="">plan for investigation of this and are working closely to understand the problem. I will update</div><div class="">everyone via the e-log and these mailing lists as new information becomes available.</div><div class=""><br class=""></div><div class="">Regards,</div><div class="">-David</div><div class=""><br class=""></div><br class=""><div><blockquote type="cite" class=""><div class="">On Jan 6, 2017, at 8:10 AM, <a href="mailto:davidl@jlab.org" class="">davidl@jlab.org</a> wrote:</div><br class="Apple-interchange-newline"><div class=""><div id="center" style="color: rgb(85, 85, 85); font-family: 'Trebuchet MS', 'Helvetica Neue', Arial, Helvetica, sans-serif; font-size: 11px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=""><div id="main" class=""><article id="node-522652" class=" node-logentry node article ia-n clearfix" role="article"><header class="node-header"><h1 class="node-title" style="font-size: 1.6em;"><a href="https://logbooks.jlab.org/entry/3449814" rel="bookmark" style="text-decoration: none;" class="">Follow-up Re: Corrupted data</a></h1></header><div class="date-vitals"><div style="font-weight: bold; font-size: 9px; margin: 0.1em 0px;" class="">Lognumber<span class="Apple-converted-space"> </span><a href="https://logbooks.jlab.org/entry/3449814" class="lognumber" data-lognumber="3449814" style="text-decoration: none;">3449814</a>. Submitted by<span class="Apple-converted-space"> </span><a href="https://logbooks.jlab.org/user/davidl" style="text-decoration: none;" class="">davidl</a><span class="Apple-converted-space"> </span>on<span class="Apple-converted-space"> </span><time datetime="2017-01-06T08:07:01-0500" pubdate="pubdate" class="">Fri, 01/06/2017 - 08:07</time>.<span class="Apple-converted-space"> </span></div><table class="field-vitals" style="margin-top: 1em; margin-bottom: 1em; font-size: 9px;"><tbody class=""><tr class=""><th style="vertical-align: middle; text-align: left; width: 62.1875px; padding: 0.1em;" class="">Logbooks:</th><td style="vertical-align: middle; text-align: left; width: auto; padding: 0.1em;" class=""><a href="https://logbooks.jlab.org/book/hdlog" style="text-decoration: none;" class="">HDLOG</a></td></tr><tr class=""><th style="vertical-align: middle; text-align: left; width: 62.1875px; padding: 0.1em;" class="">References:</th><td style="vertical-align: middle; text-align: left; width: auto; padding: 0.1em;" class=""><a href="https://logbooks.jlab.org/entry/3447847" style="text-decoration: none;" class="">3447847 - Corrupted data</a></td></tr><tr class=""><th style="vertical-align: middle; text-align: left; width: 62.1875px; padding: 0.1em;" class="">Attached Files:</th><td style="vertical-align: middle; text-align: left; width: auto; padding: 0.1em;" class=""><div class=""><span class="file"><img class="file-icon" alt="Plain text icon" title="text/plain" src="x-msg://80/modules/file/icons/text-plain.png"><a href="https://logbooks.jlab.org/files/2017/01/3449814/good_files.txt" type="text/plain; length=243085" style="text-decoration: none;" class="">good_files.txt</a></span></div><div class=""><span class="file"><img class="file-icon" alt="Plain text icon" title="text/plain" src="x-msg://80/modules/file/icons/text-plain.png"><a href="https://logbooks.jlab.org/files/2017/01/3449814/bad_files.txt" type="text/plain; length=25925" style="text-decoration: none;" class="">bad_files.txt</a></span></div><div class=""><span class="file"><img class="file-icon" alt="Plain text icon" title="text/plain" src="x-msg://80/modules/file/icons/text-plain.png"><a href="https://logbooks.jlab.org/files/2017/01/3449814/bad_runs.txt" type="text/plain; length=343" style="text-decoration: none;" class="">bad_runs.txt</a></span></div></td></tr></tbody></table></div><div class="logentry node-content"><p class="">A larger survey of the files indicates this problem was present throughout the run. Even after the older EVIO 5.1 jar file was reinstated. A total of 425 out of 4410 files indicated some type of error while passing them through hdevio_scan. All corrupted files appeared on /gluonraid3/data3. Roughly half of the runs were written to the data3 partition and the other half to data4. Attached are the lists of "bad" files and "good" ones as well as a list of the runs that contain at least one bad file.</p><p class="">At this point only one file has been studied in detail which showed the corruption landing on the boundary of a 20 event block. The corruption seemed localized to the start of a single 20 event block so it is possible subsequent data may be recovered with modifications to the parsing code.</p><p class="">It may be worth noting that some runs (e.g. 22027) had many corrupted files (50/72) but they were not all in a contiguous block. Some of the "good" files in that run happened in between "bad" files.</p></div><div class="attachment-box"></div></article></div></div><span style="color: rgb(85, 85, 85); font-family: 'Trebuchet MS', 'Helvetica Neue', Arial, Helvetica, sans-serif; font-size: 11px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; display: inline !important; float: none;" class="">_______________________________________________</span><br style="color: rgb(85, 85, 85); font-family: 'Trebuchet MS', 'Helvetica Neue', Arial, Helvetica, sans-serif; font-size: 11px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=""><span style="color: rgb(85, 85, 85); font-family: 'Trebuchet MS', 'Helvetica Neue', Arial, Helvetica, sans-serif; font-size: 11px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; display: inline !important; float: none;" class="">Halld-online mailing list</span><br style="color: rgb(85, 85, 85); font-family: 'Trebuchet MS', 'Helvetica Neue', Arial, Helvetica, sans-serif; font-size: 11px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=""><a href="mailto:Halld-online@jlab.org" style="text-decoration: none; font-family: 'Trebuchet MS', 'Helvetica Neue', Arial, Helvetica, sans-serif; font-size: 11px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">Halld-online@jlab.org</a><br style="color: rgb(85, 85, 85); font-family: 'Trebuchet MS', 'Helvetica Neue', Arial, Helvetica, sans-serif; font-size: 11px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=""><a href="https://mailman.jlab.org/mailman/listinfo/halld-online" style="text-decoration: none; font-family: 'Trebuchet MS', 'Helvetica Neue', Arial, Helvetica, sans-serif; font-size: 11px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">https://mailman.jlab.org/mailman/listinfo/halld-online</a></div></blockquote></div><br class=""></body></html>