<html><head><meta http-equiv="Content-Type" content="text/html charset=utf-8"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class="">Dear BONuSites,<div class=""><br class=""></div><div class="">it looks like we have to decide the “final fate” of our beloved BONuS6 data. I’m not sure whether the 0.55 TB (see boldfaced below) is DSTs or another file format, but I am thinking that we probably want to move everything other than summary tables (i.e. the histograms that go into our various publications) into a safe, permanent but not necessarily easily accessible place (tapes, off-site HD, …). “Volatile” is imho NOT an acceptable place to move the data.</div><div class=""> </div><div class="">Please let me know what you think. (I have to say, though, that asking “Physics” to come up with an extra $25k to store data that cost 1000x that much to acquire is maybe not THAT unreasonable… but that’s just my private opinion).</div><div class=""><br class=""></div><div class="">- Sebastian<br class=""><div><br class=""><blockquote type="cite" class=""></blockquote></div></div><div><br class=""><blockquote type="cite" class=""><div class="">Begin forwarded message:</div><br class="Apple-interchange-newline"><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px;" class=""><span style="font-family: -webkit-system-font, Helvetica Neue, Helvetica, sans-serif; color:rgba(0, 0, 0, 1.0);" class=""><b class="">From: </b></span><span style="font-family: -webkit-system-font, Helvetica Neue, Helvetica, sans-serif;" class="">Harut Avakian <<a href="mailto:avakian@jlab.org" class="">avakian@jlab.org</a>><br class=""></span></div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px;" class=""><span style="font-family: -webkit-system-font, Helvetica Neue, Helvetica, sans-serif; color:rgba(0, 0, 0, 1.0);" class=""><b class="">Subject: </b></span><span style="font-family: -webkit-system-font, Helvetica Neue, Helvetica, sans-serif;" class=""><b class="">[Clas_offline] Fwd: ENP consumption of disk space under /work</b><br class=""></span></div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px;" class=""><span style="font-family: -webkit-system-font, Helvetica Neue, Helvetica, sans-serif; color:rgba(0, 0, 0, 1.0);" class=""><b class="">Date: </b></span><span style="font-family: -webkit-system-font, Helvetica Neue, Helvetica, sans-serif;" class="">June 1, 2017 at 11:01:24 AM EDT<br class=""></span></div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px;" class=""><span style="font-family: -webkit-system-font, Helvetica Neue, Helvetica, sans-serif; color:rgba(0, 0, 0, 1.0);" class=""><b class="">To: </b></span><span style="font-family: -webkit-system-font, Helvetica Neue, Helvetica, sans-serif;" class="">"<a href="mailto:clas_offline@jlab.org" class="">clas_offline@jlab.org</a>" <<a href="mailto:clas_offline@jlab.org" class="">clas_offline@jlab.org</a>><br class=""></span></div><br class=""><div class="">
<meta http-equiv="content-type" content="text/html; charset=utf-8" class="">
<div bgcolor="#FFFFFF" text="#000000" class=""><p class=""><br class="">
</p>
<div class="moz-forward-container"><br class="">
<br class=""><p class="">Dear All,</p><p class="">As you can see from the e-mail below, keeping all our work
disk space requires some additional funding.<br class="">
</p><p class="">Option 3 will inevitably impact on farm operations, removing of
~20% space from Lustre. </p><p class="">We can also choose something between options 1) and 3).<br class="">
</p><p class="">Please revise the content and move at least 75% of what is in
/work/clas to either /cache or /volatile? <br class="">
</p><p class="">The current Hall-B usage includes:<br class="">
</p><p class=""><b class="">550G hallb/bonus</b><br class="">
1.5T hallb/clase1<br class="">
3.6T hallb/clase1-6<br class="">
3.3T hallb/clase1dvcs<br class="">
2.8T hallb/clase1dvcs2<br class="">
987G hallb/clase1f<br class="">
1.8T hallb/clase2<br class="">
1.6G hallb/clase5<br class="">
413G hallb/clase6<br class="">
2.2T hallb/claseg1<br class="">
3.9T hallb/claseg1dvcs<br class="">
1.2T hallb/claseg3<br class="">
4.1T hallb/claseg4<br class="">
2.7T hallb/claseg5<br class="">
1.7T hallb/claseg6<br class="">
367G hallb/clas-farm-output<br class="">
734G hallb/clasg10<br class="">
601G hallb/clasg11<br class="">
8.1T hallb/clasg12<br class="">
2.4T hallb/clasg13<br class="">
2.4T hallb/clasg14<br class="">
28G hallb/clasg3<br class="">
5.8G hallb/clasg7<br class="">
269G hallb/clasg8<br class="">
1.2T hallb/clasg9<br class="">
1.3T hallb/clashps<br class="">
1.8T hallb/clas-production<br class="">
5.6T hallb/clas-production2<br class="">
1.4T hallb/clas-production3<br class="">
12T hallb/hps<br class="">
13T hallb/prad<br class="">
</p><p class=""><br class="">
</p><p class="">Regards,</p>
Harut<br class="">
<div class="moz-forward-container"><br class="">
P.S. Few times we had crashes and they may also happen in
future, so keeping important files in /work is not recommended.<br class="">
You can see the list of lost files in
/site/scicomp/lostfiles.txt and
/site/scicomp/lostfiles-jan-2017.txt<br class="">
<br class="">
<br class="">
<br class="">
-------- Forwarded Message --------
<table class="moz-email-headers-table" border="0" cellpadding="0" cellspacing="0">
<tbody class="">
<tr class="">
<th align="RIGHT" nowrap="nowrap" valign="BASELINE" class="">Subject:
</th>
<td class="">ENP consumption of disk space under /work</td>
</tr>
<tr class="">
<th align="RIGHT" nowrap="nowrap" valign="BASELINE" class="">Date:
</th>
<td class="">Wed, 31 May 2017 10:35:51 -0400</td>
</tr>
<tr class="">
<th align="RIGHT" nowrap="nowrap" valign="BASELINE" class="">From:
</th>
<td class="">Chip Watson <a moz-do-not-send="true" class="moz-txt-link-rfc2396E" href="mailto:watson@jlab.org"><watson@jlab.org></a></td>
</tr>
<tr class="">
<th align="RIGHT" nowrap="nowrap" valign="BASELINE" class="">To: </th>
<td class="">Sandy Philpott <a moz-do-not-send="true" class="moz-txt-link-rfc2396E" href="mailto:philpott@jlab.org"><philpott@jlab.org></a>,
Graham Heyes <a moz-do-not-send="true" class="moz-txt-link-rfc2396E" href="mailto:heyes@jlab.org"><heyes@jlab.org></a>,
Ole Hansen <a moz-do-not-send="true" class="moz-txt-link-rfc2396E" href="mailto:ole@jlab.org"><ole@jlab.org></a>,
Harut Avakian <a moz-do-not-send="true" class="moz-txt-link-rfc2396E" href="mailto:avakian@jlab.org"><avakian@jlab.org></a>,
Brad Sawatzky <a moz-do-not-send="true" class="moz-txt-link-rfc2396E" href="mailto:brads@jlab.org"><brads@jlab.org></a>,
Mark M. Ito <a moz-do-not-send="true" class="moz-txt-link-rfc2396E" href="mailto:marki@jlab.org"><marki@jlab.org></a></td>
</tr>
</tbody>
</table>
<br class="">
<br class="">
<pre class="">All,
As I have started on the procurement of the new /work file server, I
have discovered that Physics' use of /work has grown unrestrained over
the last year or two.
"Unrestrained" because there is no way under Lustre to restrain it
except via a very unfriendly Lustre quota system. As we leave some
quota headroom to accommodate large swings in usage for each hall for
cache and volatile, then /work continues to grow.
Total /work has now reached 260 TB, several times larger than I was
anticipating. This constitutes more than 25% of Physics' share of
Lustre, compared to LQCD which uses less than 5% of its disk space on
the un-managed /work.
It would cost Physics an extra $25K (total $35K - $40K) to treat the 260
TB as a requirement.
There are 3 paths forward:
(1) Physics cuts its use of /work by a factor of 4-5.
(2) Physics increases funding to $40K
(3) We pull a server out of Lustre, decreasing Physics' share of the
system, and use that as half of the new active-active pair, beefing it
up with SSDs and perhaps additional memory; this would actually shrink
Physics near term costs, but puts higher pressure on the file system for
the farm
The decision is clearly Physics', but I do need a VERY FAST response to
this question, as I need to move quickly now for LQCD's needs.
Hall D + GlueX, 96 TB
CLAS + CLAS12, 98 TB
Hall C, 35 TB
Hall A <unknown, still scanning>
Email, call (x7101), or drop by today 1:30-3:00 p.m. for discussion.
thanks,
Chip
</pre>
</div>
</div>
</div>
_______________________________________________<br class="">Clas_offline mailing list<br class=""><a href="mailto:Clas_offline@jlab.org" class="">Clas_offline@jlab.org</a><br class="">https://mailman.jlab.org/mailman/listinfo/clas_offline</div></blockquote></div><br class=""></body></html>