<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8" />
<style type="text/css">
<!--
html{color:#555555;}body{line-height:1.5;font-family:'Trebuchet MS','Helvetica Neue',Arial,Helvetica,sans-serif;font-size:87.5%;}h1{font-size:1.6em;}h2.field-label{display:inline-block;font-size:1em;padding-right:5px;min-width:10em;margin:0.3em;}.problem_report{line-height:1.5;max-width:60em;}fieldset.problem_report.resolved
legend{background-image:url(data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAABAAAAAQCAYAAAAf8/9hAAAACXBIWXMAAA7EAAAOxAGVKw4bAAAAy0lEQVQ4jWP8//8/AyWAiZACd3f3/xYWFrht+f//P1a84t3e/0obff4rbfT5D1GGXR0LuoEr3+/7X3W4n2gvwA0gVSOKAcqbfPGGpImJCU45JgYGBoa7fpsZ22wLSbadgYGBgRE9GrF55Vf2BYbHjx8zYjWB0ljAcAGGExkZ/0MtwuoCggmJEBh4AzBS4pMnT/7fuXOH4dKlSwwnT56EiwcGBv43MDBgMDExYdDX12eQkZGBhAlyiC5YsOA/AwMDUXjLli3/iYoFQgAA+pSxZrXofD0AAAAASUVORK5CYII=);background-repeat:no-repeat;padding-left:18px;}fieldset.problem_report.needs_attention
legend{background-image:url(data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAABAAAAAQCAYAAAAf8/9hAAAABmJLR0QA/wD/AP+gvaeTAAAA9ElEQVR42sWTvUoDQRSFv9wMKWxSBVmzdhZJIwTWv9pyLWxTpbE1kBeJPoLxBazzBgGFKNqlHXAhsITUw1y7sMpmjER0YJrDPWcO556BPzhjYPJjlhfT82LUpxcK6Lo5U0JMgcu56tXy7BQajeBDpkAcAEdz1W6uyrLdYieK2DMmKCArcqczpH/ddc0msy+OkyQJC4h3N0ynx+Q5ALtUNs5q5U+8e+R+VPFi4kjk3NZqd++qUK+TZVnYwSfAOyvejeLXt/2qVG/dYoG1dqseBNco27bs/wXKWhIDB8AhcFLAH4Bn4Al4AUqT7RVC++6mv/JVPwDi3VGzomYvyAAAAABJRU5ErkJggg==);background-repeat:no-repeat;padding-left:18px;}.problem_report div.field-items{display:inline-block;}div.date-vitals p{font-size:87.5%;}a{text-decoration:none;}.Readme a:link,.Readme a:visited,.Readme
a:active{color:red;}
-->
</style>
</head>
<body id="mimemail-body" class="elog-logentry-notify">
<div id="center">
<div id="main">
<style>
<!--/*--><![CDATA[/* ><!--*/
div.field-vitals{
margin: 0.5em 0;
}
div.field-vitals .field-type-taxonomy-term-reference {
margin: 0.1em 0;
}
article.comment {
padding-left: 10px;
}
article.comment.odd {
background-color: #EEEEEE;
}
article.comment.even {
background-color: #DDDDDD;
}
div.node-content.logentry table{
width: auto;
border-collapse: collapse;
border-spacing: 0;
border-width: 1px;
}
div.node-content.logentry th{
border: inherit;
}
div.node-content.logentry blockquote{
background-color: #FFFFFF;
}
div.node-content.logentry caption{
font-size: 1em;
font-weight: normal;
}
table.field-vitals{
margin-top: 1em;
margin-bottom: 1em;
font-size: 87.5%;
}
table.field-vitals th{
vertical-align: middle;
text-align: left;
width: 15%;
padding: 0.1em;
}
table.field-vitals td{
vertical-align: middle;
text-align: left;
width: auto;
padding: 0.1em;
}
table.field-vitals td li {
margin-left: 0;
list-style-type: none;
list-style-image: none;
}
table.downtime {
width: 30em;
margin-bottom: 1em;
border: 1px black dotted;
}
table.downtime th {
text-align: center;
}
table.downtime td {
text-align: center;
}
tr.caption th {
border-bottom: none;
}
table.downtime tfoot{
background-color:#EEEEEE;
}
div.field-name-body{
margin: 1em 0;
font-size: 110%;
}
div.date-vitals p{
margin: .1em 0;
}
article div.ctools-collapsible-container{
margin-left: -5px;
clear: both;
}
#comment-form{
margin-left: 5px;
border: graytext outset medium;
-moz-border-radius: 15px;
border-radius: 15px;
padding: 1em;
}
div.comments-form-box {
margin-top: 2em;
margin-bottom: 5em;
}
h3.comment-title {
/* display: none; */
}
p.author-datetime{
font-weight: bold;
}
/*--><!]]>*/
</style><article id="node-475891" class="node node-logentry article ia-n clearfix" role="article"><header class="node-header"><h1 class="node-title">
<a href="https://logbooks.jlab.org/entry/3403062" rel="bookmark">Missing tar files</a>
</h1>
</header><div class="date-vitals">
<p class="author-datetime">
Lognumber <a href="https://logbooks.jlab.org/entry/3403062" class="lognumber" data-lognumber="3403062">3403062</a>. Submitted by <a href="https://logbooks.jlab.org/user/davidl">davidl</a> on <time datetime="2016-04-26T09:12:34-0400" pubdate="pubdate">Tue, 04/26/2016 - 09:12</time>. </p>
<p class="last-update">
Last updated on <time datetime="2016-04-26T09:43:07-0400" pubdate="pubdate">Tue, 04/26/2016 - 09:43</time></p>
<table class="field-vitals"><tr><th>Logbooks: </th><td><a href="https://logbooks.jlab.org/book/hdlog">HDLOG</a></td></tr></table></div>
<div class="logentry node-content">
<p>NOTE: The information below refers only to some configuration files that are not critical for replay of the data. The primary archive of the information they contain is the RCDB. The tar files discussed are a secondary backup system. (Some of the information in them even has a tertiary and quaternary backups in the datastream itself and the elog). No physics data was lost!</p>
<p>----------------------------</p>
<p>DAQ/Trigger configuration files are packaged up into a single tar file for each run be copied to tape alongside the raw data for archiving purposes. It was noticed that several of these tar files fail to show up on the tape. A sampling survey of runs with >1M events showed roughly 30% of these are lost. Checking the logs indicates that the tar files are being created in the volatile directory and at least an attempt is made to create a hard link to them in the staging directory where they will be picked up by the jmigrate script and copied to tape. No error is recorded in making this link, but there are also no records indicating that the link is ever made in staging for those files that are missing (though the history is not complete).</p>
<p>The current belief is that the jmigrate script is deleting the empty directory from staging where the link to the tar file is about to be made by the stage_to_tape script so that the link fails. Sometimes the link is made first which accounts for those files that do get copied to tape. The two scripts involved are run via separate cron jobs every 10 minutes and so the timing of these operations will be roughly the same creating the race condition.</p>
<p>Adjustments are being made to the jmigrate script to address this issue for the future.</p>
<p>Tar files that still existed on both gluonraid1 and gluonraid2 but were not on tape as of this morning had appropriate directories and hard links created by so that they would be copied to tape. The list of these is:</p>
<p>gluonaid1<br />
-----------------<br />
Run010729/RunLog010729.tar<br />
Run011312/RunLog011312.tar<br />
Run011313/RunLog011313.tar<br />
Run011314/RunLog011314.tar<br />
Run011315/RunLog011315.tar<br />
Run011320/RunLog011320.tar<br />
Run011321/RunLog011321.tar<br />
Run011322/RunLog011322.tar<br />
Run011324/RunLog011324.tar<br />
Run011325/RunLog011325.tar<br />
Run011328/RunLog011328.tar<br />
Run011329/RunLog011329.tar<br />
Run011330/RunLog011330.tar<br />
Run011331/RunLog011331.tar<br />
Run011333/RunLog011333.tar<br />
Run011335/RunLog011335.tar<br />
Run011336/RunLog011336.tar<br />
Run011337/RunLog011337.tar<br />
Run011338/RunLog011338.tar<br />
Run011339/RunLog011339.tar<br />
Run011340/RunLog011340.tar<br />
Run011341/RunLog011341.tar<br />
Run011343/RunLog011343.tar<br />
Run011345/RunLog011345.tar<br />
Run011349/RunLog011349.tar<br />
Run011350/RunLog011350.tar<br />
Run011351/RunLog011351.tar<br />
Run011352/RunLog011352.tar<br />
Run011353/RunLog011353.tar<br />
Run011355/RunLog011355.tar<br />
Run011356/RunLog011356.tar<br />
Run011357/RunLog011357.tar<br />
Run011359/RunLog011359.tar<br />
Run011631/RunLog011631.tar<br />
Run011632/RunLog011632.tar<br />
Run011633/RunLog011633.tar<br />
Run011634/RunLog011634.tar<br />
Run011635/RunLog011635.tar<br />
Run011636/RunLog011636.tar<br />
Run011637/RunLog011637.tar<br />
Run011638/RunLog011638.tar<br />
Run011639/RunLog011639.tar<br />
Run011640/RunLog011640.tar<br />
Run011641/RunLog011641.tar</p>
<p>gluonraid2<br />
-----------------<br />
Run000214/RunLog000214.tar<br />
Run000215/RunLog000215.tar<br />
Run000216/RunLog000216.tar<br />
Run011253/RunLog011253.tar<br />
Run011254/RunLog011254.tar<br />
Run011255/RunLog011255.tar<br />
Run011256/RunLog011256.tar<br />
Run011258/RunLog011258.tar<br />
Run011259/RunLog011259.tar<br />
Run011368/RunLog011368.tar<br />
Run011369/RunLog011369.tar<br />
Run011370/RunLog011370.tar<br />
Run011373/RunLog011373.tar<br />
Run011374/RunLog011374.tar<br />
Run011375/RunLog011375.tar<br />
Run011377/RunLog011377.tar<br />
Run011378/RunLog011378.tar<br />
Run011379/RunLog011379.tar<br />
Run011380/RunLog011380.tar<br />
Run011381/RunLog011381.tar<br />
Run011426/RunLog011426.tar<br />
Run011427/RunLog011427.tar<br />
Run011428/RunLog011428.tar<br />
Run011556/RunLog011556.tar<br />
Run011557/RunLog011557.tar<br />
Run011558/RunLog011558.tar<br />
Run011605/RunLog011605.tar<br />
Run011606/RunLog011606.tar<br />
Run011608/RunLog011608.tar<br />
Run011610/RunLog011610.tar<br />
Run011611/RunLog011611.tar<br />
Run011612/RunLog011612.tar<br />
Run011613/RunLog011613.tar<br />
Run011614/RunLog011614.tar</p>
</div>
<div class="attachment-box">
</div>
</article> </div>
</div>
</body>
</html>