<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
</head>
<body style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class="">
FYI Everyone,
<div class=""><br class="">
</div>
<div class="">We've brought up memory efficiency of batch job requests at CLAS12 collaboration and software meetings in previous years. Lots of jobs requesting a lot more memory than they actually use can make the farm unnecessarily idle and significantly
reduce throughput for everyone.</div>
<div class=""><br class="">
</div>
<div class="">*** And now Scicomp has a larger initiative to improve farm efficiency, which includes contacting people running memory-inefficient jobs and potentially throttling their jobs if no action is taken. ***</div>
<div class=""><br class="">
</div>
<div class="">You can check metrics of your batch jobs at:</div>
<div class=""><br class="">
</div>
<div class=""><a href="https://scicomp.jlab.org" class="">https://scicomp.jlab.org</a> </div>
<div class=""><br class="">
</div>
<div class="">There's a search feature at 'Slurm Jobs' (left sidebar) -> 'Jobs Query' (top), and 'Recent Jobs' (top), and also 'Memory Efficiency' (top). </div>
<div class=""><br class="">
</div>
<div class="">Before launching a large number of new types of jobs, you can measure how much memory your jobs use. For example, by submitting a couple jobs and using that website, or by running your job interactively and checking in htop or ps or other system
utilities. And then set your SLURM/SWIF job memory request accordingly.</div>
<div class=""><br class="">
</div>
<div class="">Note, standard CLAS12 simulation jobs (gemc plus recon-util) require less than 1.7 GB of memory.</div>
<div class=""><br class="">
</div>
<div class="">-Nathan</div>
<div class=""><br class="">
</div>
<div class=""><br class="">
</div>
</body>
</html>