<html><body><div style="font-family: arial,helvetica,sans-serif; font-size: 12pt; color: #000000"><div><span style="font-family: "courier new",courier,monaco,monospace,sans-serif; font-size: 10pt;" data-mce-style="font-family: 'courier new',courier,monaco,monospace,sans-serif; font-size: 10pt;">Folks,</span><br></div><div><br data-mce-bogus="1"></div><div><span style="font-family: "courier new",courier,monaco,monospace,sans-serif; font-size: 10pt;" data-mce-style="font-family: 'courier new',courier,monaco,monospace,sans-serif; font-size: 10pt;">A general work disk has grown to unexpected size. Computer center wants us to shrink it. See messages below.</span><br data-mce-bogus="1"></div><div><span style="font-family: "courier new",courier,monaco,monospace,sans-serif; font-size: 10pt;" data-mce-style="font-family: 'courier new',courier,monaco,monospace,sans-serif; font-size: 10pt;">clasg9 is not the biggest offender. Out of almost 100 TB used by Hall B we have only 1.2 TB. However, we should keep the only thing which are used on a regular basis. Work disk is not meant to be used for the permanent storage and it is not backed up. </span><br data-mce-bogus="1"></div><div><span style="font-family: "courier new",courier,monaco,monospace,sans-serif; font-size: 10pt;" data-mce-style="font-family: 'courier new',courier,monaco,monospace,sans-serif; font-size: 10pt;">Here is the list of the directories there with ownership:</span><br data-mce-bogus="1"></div><div><br data-mce-bogus="1"></div><div></div><div></div><div><span style="font-family: "courier new",courier,monaco,monospace,sans-serif; font-size: 10pt;" data-mce-style="font-family: 'courier new',courier,monaco,monospace,sans-serif; font-size: 10pt;">-rw-r--r-- 1 6348 451 Nov 25 2016 76runs.list</span><br><span style="font-family: "courier new",courier,monaco,monospace,sans-serif; font-size: 10pt;" data-mce-style="font-family: 'courier new',courier,monaco,monospace,sans-serif; font-size: 10pt;">drwxrwsr-x 3 clasg9 4096 Jun 1 2010 TAG</span><br><span style="font-family: "courier new",courier,monaco,monospace,sans-serif; font-size: 10pt;" data-mce-style="font-family: 'courier new',courier,monaco,monospace,sans-serif; font-size: 10pt;">drwxr-sr-x 7 natalie 4096 Aug 6 2013 bin</span><br><span style="font-family: "courier new",courier,monaco,monospace,sans-serif; font-size: 10pt;" data-mce-style="font-family: 'courier new',courier,monaco,monospace,sans-serif; font-size: 10pt;">-rw-rw-r-- 1 clasg9 1361489920 Oct 17 2016 clasg9_g9a.tar</span><br><span style="font-family: "courier new",courier,monaco,monospace,sans-serif; font-size: 10pt;" data-mce-style="font-family: 'courier new',courier,monaco,monospace,sans-serif; font-size: 10pt;">drwxrwsr-x 3 clasg9 4096 Feb 15 00:49 clasweb_monitor</span><br><span style="font-family: "courier new",courier,monaco,monospace,sans-serif; font-size: 10pt;" data-mce-style="font-family: 'courier new',courier,monaco,monospace,sans-serif; font-size: 10pt;">drwxrwsr-x 4 clasg9 4096 Mar 10 2010 cooklinks</span><br><span style="font-family: "courier new",courier,monaco,monospace,sans-serif; font-size: 10pt;" data-mce-style="font-family: 'courier new',courier,monaco,monospace,sans-serif; font-size: 10pt;">drwxr-sr-x 2 crede 4096 Aug 16 2014 crede</span><br><span style="font-family: "courier new",courier,monaco,monospace,sans-serif; font-size: 10pt;" data-mce-style="font-family: 'courier new',courier,monaco,monospace,sans-serif; font-size: 10pt;">drwxrwsr-x 2 clasg9 4096 Oct 27 2011 dcalign</span><br><span style="font-family: "courier new",courier,monaco,monospace,sans-serif; font-size: 10pt;" data-mce-style="font-family: 'courier new',courier,monaco,monospace,sans-serif; font-size: 10pt;">drwxrwsr-x 3 dschott 4096 Jul 31 2014 dschott</span><br><span style="font-family: "courier new",courier,monaco,monospace,sans-serif; font-size: 10pt;" data-mce-style="font-family: 'courier new',courier,monaco,monospace,sans-serif; font-size: 10pt;">drwxr-sr-x 5 dugger 4096 May 26 10:54 dugger</span><br><span style="font-family: "courier new",courier,monaco,monospace,sans-serif; font-size: 10pt;" data-mce-style="font-family: 'courier new',courier,monaco,monospace,sans-serif; font-size: 10pt;">drwxr-s--- 2 fklein 4096 Apr 19 11:30 fklein</span><br><span style="font-family: "courier new",courier,monaco,monospace,sans-serif; font-size: 10pt;" data-mce-style="font-family: 'courier new',courier,monaco,monospace,sans-serif; font-size: 10pt;">drwxrwsr-x 3 clasg9 4096 Oct 19 2012 g9a</span><br><span style="font-family: "courier new",courier,monaco,monospace,sans-serif; font-size: 10pt;" data-mce-style="font-family: 'courier new',courier,monaco,monospace,sans-serif; font-size: 10pt;">drwxrwsr-x 3 clasg9 4096 Oct 21 2012 g9b</span><br><span style="font-family: "courier new",courier,monaco,monospace,sans-serif; font-size: 10pt;" data-mce-style="font-family: 'courier new',courier,monaco,monospace,sans-serif; font-size: 10pt;">-rwxr-xr-x 1 6890 474 Nov 8 2010 g9b_sub_script.pl</span><br><span style="font-family: "courier new",courier,monaco,monospace,sans-serif; font-size: 10pt;" data-mce-style="font-family: 'courier new',courier,monaco,monospace,sans-serif; font-size: 10pt;">drwxrwsr-x 8 clasg9 4096 Dec 4 2012 g9frost</span><br><span style="font-family: "courier new",courier,monaco,monospace,sans-serif; font-size: 10pt;" data-mce-style="font-family: 'courier new',courier,monaco,monospace,sans-serif; font-size: 10pt;">drwxr-sr-x 3 6659 4096 Jan 31 2011 mcandrew</span><br><span style="font-family: "courier new",courier,monaco,monospace,sans-serif; font-size: 10pt;" data-mce-style="font-family: 'courier new',courier,monaco,monospace,sans-serif; font-size: 10pt;">drwxrwsr-x 3 natalie 36864 May 4 10:43 natalie</span><br><span style="font-family: "courier new",courier,monaco,monospace,sans-serif; font-size: 10pt;" data-mce-style="font-family: 'courier new',courier,monaco,monospace,sans-serif; font-size: 10pt;">drwxrwsr-x 4 clasg9 4096 Aug 14 2014 pass1</span><br><span style="font-family: "courier new",courier,monaco,monospace,sans-serif; font-size: 10pt;" data-mce-style="font-family: 'courier new',courier,monaco,monospace,sans-serif; font-size: 10pt;">drwxr-sr-x 4 6890 4096 May 19 2010 previous_constants</span><br><span style="font-family: "courier new",courier,monaco,monospace,sans-serif; font-size: 10pt;" data-mce-style="font-family: 'courier new',courier,monaco,monospace,sans-serif; font-size: 10pt;">-rwxrwxrwx 1 clasg9 15539 Nov 11 2010 runs_g9b_pass0</span><br><span style="font-family: "courier new",courier,monaco,monospace,sans-serif; font-size: 10pt;" data-mce-style="font-family: 'courier new',courier,monaco,monospace,sans-serif; font-size: 10pt;">-rwxrwxrwx 1 6890 15563 Nov 8 2010 runs_g9b_pass0~</span><br><span style="font-family: "courier new",courier,monaco,monospace,sans-serif; font-size: 10pt;" data-mce-style="font-family: 'courier new',courier,monaco,monospace,sans-serif; font-size: 10pt;">drwxrwsrwx 2 clasg9 20480 Feb 15 01:14 sc_calib</span><br><span style="font-family: "courier new",courier,monaco,monospace,sans-serif; font-size: 10pt;" data-mce-style="font-family: 'courier new',courier,monaco,monospace,sans-serif; font-size: 10pt;">drwxr-sr-x 2 sfegan 73728 Feb 15 00:49 sfegan</span><br><span style="font-family: "courier new",courier,monaco,monospace,sans-serif; font-size: 10pt;" data-mce-style="font-family: 'courier new',courier,monaco,monospace,sans-serif; font-size: 10pt;">drwxrwsr-x 3 supark 4096 Aug 8 2012 skpark</span><br><span style="font-family: "courier new",courier,monaco,monospace,sans-serif; font-size: 10pt;" data-mce-style="font-family: 'courier new',courier,monaco,monospace,sans-serif; font-size: 10pt;">drwxr-sr-x 7 7216 4096 Jan 21 2016 yuqing</span><br><span style="font-family: "courier new",courier,monaco,monospace,sans-serif; font-size: 10pt;" data-mce-style="font-family: 'courier new',courier,monaco,monospace,sans-serif; font-size: 10pt;">drwxrwsr-x 8 clasg9 4096 Sep 19 2015 zana</span><br></div><div><span style="font-family: "courier new",courier,monaco,monospace,sans-serif; font-size: 10pt;" data-mce-style="font-family: 'courier new',courier,monaco,monospace,sans-serif; font-size: 10pt;"><br data-mce-bogus="1"></span></div><div><span style="font-family: "courier new",courier,monaco,monospace,sans-serif; font-size: 10pt;" data-mce-style="font-family: 'courier new',courier,monaco,monospace,sans-serif; font-size: 10pt;">Here is the space taken by these directories:</span></div><div><span style="font-family: "courier new",courier,monaco,monospace,sans-serif; font-size: 10pt;" data-mce-style="font-family: 'courier new',courier,monaco,monospace,sans-serif; font-size: 10pt;"><br>129K 76runs.list<br>6.9M TAG<br>191M bin<br>1.3G clasg9_g9a.tar<br>363M clasweb_monitor<br>137M cooklinks<br>4.0K crede<br>261K dcalign<br>1.6G dschott<br>4.2G dugger<br>1.9G fklein<br>2.8G g9a<br>148G g9b<br>129K g9b_sub_script.pl<br>578G g9frost<br>8.0K mcandrew<br>131G natalie<br>18G pass1<br>121G previous_constants<br>129K runs_g9b_pass0<br>129K runs_g9b_pass0~<br>53G sc_calib<br>34G sfegan<br>112M skpark<br>33G yuqing<br>4.7G zana</span></div><div><span style="font-family: "courier new",courier,monaco,monospace,sans-serif; font-size: 10pt;" data-mce-style="font-family: 'courier new',courier,monaco,monospace,sans-serif; font-size: 10pt;"><br><span style="font-family: "courier new",courier,monaco,monospace,sans-serif; font-size: 10pt;" data-mce-style="font-family: 'courier new',courier,monaco,monospace,sans-serif; font-size: 10pt;"> Most of the file were not used for ages.</span><br>Please review an let me know what is being used NOW and should be kept. Unclaimed files will be deleted.<br data-mce-bogus="1"></span></div><div><span style="font-family: "courier new",courier,monaco,monospace,sans-serif; font-size: 10pt;" data-mce-style="font-family: 'courier new',courier,monaco,monospace,sans-serif; font-size: 10pt;">If there is something that you don't use but plan to use in a distant future and it is not easily recreatable you may think of putting this on tape.<br data-mce-bogus="1"></span></div><div><span style="font-family: "courier new",courier,monaco,monospace,sans-serif; font-size: 10pt;" data-mce-style="font-family: 'courier new',courier,monaco,monospace,sans-serif; font-size: 10pt;">Please do it ASAP.<br data-mce-bogus="1"></span></div><div><span style="font-family: "courier new",courier,monaco,monospace,sans-serif; font-size: 10pt;" data-mce-style="font-family: 'courier new',courier,monaco,monospace,sans-serif; font-size: 10pt;"><br data-mce-bogus="1"></span></div><div><span style="font-family: "courier new",courier,monaco,monospace,sans-serif; font-size: 10pt;" data-mce-style="font-family: 'courier new',courier,monaco,monospace,sans-serif; font-size: 10pt;">Thanks,<br data-mce-bogus="1"></span></div><div><span style="font-family: "courier new",courier,monaco,monospace,sans-serif; font-size: 10pt;" data-mce-style="font-family: 'courier new',courier,monaco,monospace,sans-serif; font-size: 10pt;"><br data-mce-bogus="1"></span></div><div data-marker="__SIG_PRE__">-Eugene</div><div><br></div><hr id="zwchr" data-marker="__DIVIDER__"><div data-marker="__HEADERS__"><b>From: </b>"Harut Avagyan" <avakian@jlab.org><br><b>To: </b>"clas offline" <clas_offline@jlab.org><br><b>Sent: </b>Thursday, June 1, 2017 11:01:24 AM<br><b>Subject: </b>[Clas_offline] Fwd: ENP consumption of disk space under /work<br></div><div><br></div><div data-marker="__QUOTED_TEXT__"><p><br></p><div class="moz-forward-container"><br> <br><p>Dear All,</p><p>As you can see from the e-mail below, keeping all our work disk space requires some additional funding.<br></p><p>Option 3 will inevitably impact on farm operations, removing of ~20% space from Lustre.</p><p>We can also choose something between options 1) and 3).<br></p><p>Please revise the content and move at least 75% of what is in /work/clas to either /cache or /volatile? <br></p><p>The current Hall-B usage includes:<br></p><p>550G hallb/bonus<br> 1.5T hallb/clase1<br> 3.6T hallb/clase1-6<br> 3.3T hallb/clase1dvcs<br> 2.8T hallb/clase1dvcs2<br> 987G hallb/clase1f<br> 1.8T hallb/clase2<br> 1.6G hallb/clase5<br> 413G hallb/clase6<br> 2.2T hallb/claseg1<br> 3.9T hallb/claseg1dvcs<br> 1.2T hallb/claseg3<br> 4.1T hallb/claseg4<br> 2.7T hallb/claseg5<br> 1.7T hallb/claseg6<br> 367G hallb/clas-farm-output<br> 734G hallb/clasg10<br> 601G hallb/clasg11<br> 8.1T hallb/clasg12<br> 2.4T hallb/clasg13<br> 2.4T hallb/clasg14<br> 28G hallb/clasg3<br> 5.8G hallb/clasg7<br> 269G hallb/clasg8<br> 1.2T hallb/clasg9<br> 1.3T hallb/clashps<br> 1.8T hallb/clas-production<br> 5.6T hallb/clas-production2<br> 1.4T hallb/clas-production3<br> 12T hallb/hps<br> 13T hallb/prad<br></p><p><br></p><p>Regards,</p>Harut<br><div class="moz-forward-container"><br> P.S. Few times we had crashes and they may also happen in future, so keeping important files in /work is not recommended.<br> You can see the list of lost files in /site/scicomp/lostfiles.txt and /site/scicomp/lostfiles-jan-2017.txt<br> <br> <br> <br> -------- Forwarded Message --------<table class="moz-email-headers-table" cellspacing="0" cellpadding="0" border="0"><tbody><tr><th valign="BASELINE" align="RIGHT" nowrap="nowrap">Subject:</th><td>ENP consumption of disk space under /work</td></tr><tr><th valign="BASELINE" align="RIGHT" nowrap="nowrap">Date:</th><td>Wed, 31 May 2017 10:35:51 -0400</td></tr><tr><th valign="BASELINE" align="RIGHT" nowrap="nowrap">From:</th><td>Chip Watson <a class="moz-txt-link-rfc2396E" href="mailto:watson@jlab.org" target="_blank" data-mce-href="mailto:watson@jlab.org"><watson@jlab.org></a><br data-mce-bogus="1"></td></tr><tr><th valign="BASELINE" align="RIGHT" nowrap="nowrap">To:</th><td>Sandy Philpott <a class="moz-txt-link-rfc2396E" href="mailto:philpott@jlab.org" target="_blank" data-mce-href="mailto:philpott@jlab.org"><philpott@jlab.org></a>, Graham Heyes <a class="moz-txt-link-rfc2396E" href="mailto:heyes@jlab.org" target="_blank" data-mce-href="mailto:heyes@jlab.org"><heyes@jlab.org></a>, Ole Hansen <a class="moz-txt-link-rfc2396E" href="mailto:ole@jlab.org" target="_blank" data-mce-href="mailto:ole@jlab.org"><ole@jlab.org></a>, Harut Avakian <a class="moz-txt-link-rfc2396E" href="mailto:avakian@jlab.org" target="_blank" data-mce-href="mailto:avakian@jlab.org"><avakian@jlab.org></a>, Brad Sawatzky <a class="moz-txt-link-rfc2396E" href="mailto:brads@jlab.org" target="_blank" data-mce-href="mailto:brads@jlab.org"><brads@jlab.org></a>, Mark M. Ito <a class="moz-txt-link-rfc2396E" href="mailto:marki@jlab.org" target="_blank" data-mce-href="mailto:marki@jlab.org"><marki@jlab.org></a><br data-mce-bogus="1"></td></tr></tbody></table><br> <br><pre>All,
As I have started on the procurement of the new /work file server, I
have discovered that Physics' use of /work has grown unrestrained over
the last year or two.
"Unrestrained" because there is no way under Lustre to restrain it
except via a very unfriendly Lustre quota system. As we leave some
quota headroom to accommodate large swings in usage for each hall for
cache and volatile, then /work continues to grow.
Total /work has now reached 260 TB, several times larger than I was
anticipating. This constitutes more than 25% of Physics' share of
Lustre, compared to LQCD which uses less than 5% of its disk space on
the un-managed /work.
It would cost Physics an extra $25K (total $35K - $40K) to treat the 260
TB as a requirement.
There are 3 paths forward:
(1) Physics cuts its use of /work by a factor of 4-5.
(2) Physics increases funding to $40K
(3) We pull a server out of Lustre, decreasing Physics' share of the
system, and use that as half of the new active-active pair, beefing it
up with SSDs and perhaps additional memory; this would actually shrink
Physics near term costs, but puts higher pressure on the file system for
the farm
The decision is clearly Physics', but I do need a VERY FAST response to
this question, as I need to move quickly now for LQCD's needs.
Hall D + GlueX, 96 TB
CLAS + CLAS12, 98 TB
Hall C, 35 TB
Hall A <unknown, still scanning>
Email, call (x7101), or drop by today 1:30-3:00 p.m. for discussion.
thanks,
Chip
</pre></div></div><br>_______________________________________________<br>Clas_offline mailing list<br>Clas_offline@jlab.org<br>https://mailman.jlab.org/mailman/listinfo/clas_offline<br></div></div></body></html>