<html>
<head>
<meta content="text/html; charset=windows-1252"
http-equiv="Content-Type">
</head>
<body text="#000000" bgcolor="#FFFFFF">
Curtis,<br>
<br>
I think you are about right about the percentages.<br>
<br>
I think that everything we are running right now are things we have
discussed and decided on, so in that sense they make sense. The
concerning thing is our apparent low utilization of the exclusive
nodes.<br>
<br>
We have more data now; the days of completing a launch over all of
the data in a weekend may be behind us, especially since there will
always be other competing projects going on. The competition is
starting now because, hey, we have more data.<br>
<br>
-- Mark<br>
<br>
<div class="moz-cite-prefix">On 03/08/2016 04:17 PM, Curtis A. Meyer
wrote:<br>
</div>
<blockquote cite="mid:6D644048-D980-4395-8D84-1B35DF5960F3@cmu.edu"
type="cite">
<meta http-equiv="Content-Type" content="text/html;
charset=windows-1252">
Hi Mark,
<div class=""><br class="">
</div>
<div class=""> yes, it would be useful to have this in words. But
my interpretation</div>
<div class="">is that halld is currently using about 54% of the
farm. about 30% goes to</div>
<div class="">the gxproj accounts, and 24% is going to other
hall-d processes.</div>
<div class=""><br class="">
</div>
<div class=""> My understanding in discussions in early February
was that this was</div>
<div class="">about the time that halld would take over the farm,
so it looks like we </div>
<div class="">were right.</div>
<div class=""><br class="">
</div>
<div class=""> That said, we should try and determine what we
are running on the </div>
<div class="">farm right now, and see if some of it does not make
sense. We should</div>
<div class="">probably try to prioritize what we are doing.</div>
<div class=""><br class="">
</div>
<div class="">Curtis<br class="">
<div class="">
<span class="Apple-style-span" style="border-collapse:
separate; color: rgb(0, 0, 0); font-family: Helvetica;
font-style: normal; font-variant: normal; font-weight:
normal; letter-spacing: normal; line-height: normal;
orphans: 2; text-align: -webkit-auto; text-indent: 0px;
text-transform: none; white-space: normal; widows: 2;
word-spacing: 0px; -webkit-border-horizontal-spacing: 0px;
-webkit-border-vertical-spacing: 0px;
-webkit-text-decorations-in-effect: none;
-webkit-text-size-adjust: auto; -webkit-text-stroke-width:
0px; ">
<div class="">
<div class="">---------</div>
<div class="">Curtis A. Meyer<span class="Apple-tab-span" style="white-space: pre; "> </span>MCS Associate
Dean for Faculty and Graduate Affairs</div>
<div class="">Wean: (412) 268-2745<span class="Apple-tab-span" style="white-space: pre; "> </span>Professor
of Physics</div>
<div class="">Doherty: (412) 268-3090<span class="Apple-tab-span" style="white-space: pre; "> </span>Carnegie
Mellon University</div>
<div class="">Fax: (412) 681-0648<span class="Apple-tab-span" style="white-space: pre; "> </span>Pittsburgh,
PA 15213</div>
<div class=""><a moz-do-not-send="true"
href="mailto:curtis.meyer@cmu.edu" class="">curtis.meyer@cmu.edu</a><span class="Apple-tab-span" style="white-space: pre; "> </span><a class="moz-txt-link-freetext" href="http://www.curtismeyer.com/">http://www.curtismeyer.com/</a></div>
</div>
<div class=""><br class="">
</div>
</span><br class="Apple-interchange-newline">
</div>
<br class="">
<div>
<blockquote type="cite" class="">
<div class="">On Mar 8, 2016, at 3:45 PM, Mark Ito <<a
moz-do-not-send="true" href="mailto:marki@jlab.org"
class=""><a class="moz-txt-link-abbreviated" href="mailto:marki@jlab.org">marki@jlab.org</a></a>> wrote:</div>
<br class="Apple-interchange-newline">
<div class="">
<meta http-equiv="content-type" content="text/html;
charset=windows-1252" class="">
<div text="#000000" bgcolor="#FFFFFF" class=""> The latest
on the farm from Sandy Philpott, FYI.<br class="">
<div class="moz-forward-container"><br class="">
<br class="">
-------- Forwarded Message --------
<table class="moz-email-headers-table" border="0"
cellpadding="0" cellspacing="0">
<tbody class="">
<tr class="">
<th class="" nowrap="nowrap" valign="BASELINE"
align="RIGHT">Subject: </th>
<td class="">high Hall D farm utilization; need
to adjust</td>
</tr>
<tr class="">
<th class="" nowrap="nowrap" valign="BASELINE"
align="RIGHT">Date: </th>
<td class="">Tue, 8 Mar 2016 14:11:19 -0500
(EST)</td>
</tr>
<tr class="">
<th class="" nowrap="nowrap" valign="BASELINE"
align="RIGHT">From: </th>
<td class="">Sandy Philpott <a
moz-do-not-send="true"
class="moz-txt-link-rfc2396E"
href="mailto:philpott@jlab.org"><a class="moz-txt-link-rfc2396E" href="mailto:philpott@jlab.org"><philpott@jlab.org></a></a></td>
</tr>
<tr class="">
<th class="" nowrap="nowrap" valign="BASELINE"
align="RIGHT">To: </th>
<td class="">Mark Ito <a moz-do-not-send="true"
class="moz-txt-link-rfc2396E"
href="mailto:marki@jlab.org"><marki@jlab.org></a></td>
</tr>
<tr class="">
<th class="" nowrap="nowrap" valign="BASELINE"
align="RIGHT">CC: </th>
<td class="">Graham Heyes <a
moz-do-not-send="true"
class="moz-txt-link-rfc2396E"
href="mailto:heyes@jlab.org"><a class="moz-txt-link-rfc2396E" href="mailto:heyes@jlab.org"><heyes@jlab.org></a></a>,
Chip Watson <a moz-do-not-send="true"
class="moz-txt-link-rfc2396E"
href="mailto:watson@jlab.org"><watson@jlab.org></a></td>
</tr>
</tbody>
</table>
<br class="">
<br class="">
<pre class="">Hi Mark,
Following on the discussion this morning of the production gxproj accounts, here's the current usage
for them individually, and for Hall D overall:
--------
FairShare Information
Depth: 7 intervals Interval Length: 1:00:00:00 Decay Rate: 0.70
FSInterval % Target 0 1 2 3 4 5 6
FSWeight ------- ------- 1.0000 0.7000 0.4900 0.3430 0.2401 0.1681 0.1176
TotalUsage 100.00 ------- 91050.9 155705.8 163137.0 151037.6 127158.9 165079.1 182521.6
gxproj5 12.27 5.00+ 18.33 12.12 10.29 23.87 ------- ------- -------
gxproj4* 2.09 5.00+ 5.33 0.62 0.38 1.14 4.69 0.77 2.52
gxproj3 7.95 5.00+ 2.35 7.24 9.58 6.80 34.40 2.34 1.75
gxproj1 7.26 5.00+ 6.76 9.88 8.06 4.46 3.63 7.25 5.01
hallb* 0.24 10.00 0.33 0.12 0.05 0.14 0.10 1.24 0.30
theory 0.79 5.00 1.11 0.52 0.45 0.36 2.74 0.56 0.62
hallc 6.82 10.00 6.34 5.29 2.66 10.59 4.14 12.45 19.58
clas* 29.47 40.00 33.77 32.08 23.66 26.63 21.91 45.37 16.60
halld* 53.97 30.00 47.01 54.23 66.67 52.07 56.21 34.95 60.92
halla* 4.34 10.00 4.66 5.10 2.41 4.01 7.05 5.38 1.98
accelerator 4.37 5.00 6.77 2.66 4.11 6.21 7.85 0.05 -------
--------
So while gxproj4 is under its target (the serial jobs, yes?), gxproj5 and all of halld is well over.
Note that the fairshare settings are still set the same as the past several years:
A 10%, B 50%, C 10%, D 30%
and there are also lots of pending jobs by Accelerator and Theory guests.
This leads to the next important point -- with Hall D so much over its fairshare, and with
the resources configured heavily in Hall D's favor with the exclusive and multicore nodes,
and with the inefficiency of the many-core jobs, SciComp needs to make some adjustments to make
more resources available to the other halls and their serial jobs.
In that light, I'll be reconfiguring many nodes back to non-exclusive and away from the exclusive
and 12 core multicore queues. This will help use the farm and particularly farm14 nodes more efficiently.
I've copied Chip and Graham, so they're aware. Please check with Physics if adjustments should be made
to the 10/50/10/30 fairshare config. In the meantime, I'll reconfigure nodes to get back a bit closer
to this agreement; the other halls have noticed their long queue wait times. (Oldest farm jobs were
submitted Feb. 17).
Note that HPC has been paying back its debt to the farm over the last month, so all halls are
getting to take advantage of the farm's increased size. We can continue to run with this loan
payback for the near future.
Regards,
Sandy
</pre>
<br class="">
</div>
<br class="">
</div>
_______________________________________________<br
class="">
Halld-offline mailing list<br class="">
<a moz-do-not-send="true"
href="mailto:Halld-offline@jlab.org" class="">Halld-offline@jlab.org</a><br
class="">
<a class="moz-txt-link-freetext" href="https://mailman.jlab.org/mailman/listinfo/halld-offline">https://mailman.jlab.org/mailman/listinfo/halld-offline</a></div>
</blockquote>
</div>
<br class="">
</div>
</blockquote>
<br>
</body>
</html>