[Hallcsw] Disk usage under /home on cdaq cluster
Brad Sawatzky
brads at jlab.org
Tue Jan 23 14:17:06 EST 2018
And, since it came up in a recent conversation, note that you do /not/
need to do your offline analysis on the cdaq cluster (and probably
should not do so). You can access the data files through /cache and
take advantage of the ifarm (and farm) machines.
Here's a copy-paste from an email last month with a few more details.
When you get to the point where you want to run your jobs on the Farm
(and/or ifarm) you will need to use the following resources.
You should make sure you are in the 'c-comm2017' unix group.
Login to an ifarm machine and run 'groups'. You should see
'c-comm2017' towards the end of the list of group names.
If not, then email one of the following and request that
you be added:
brads at jlab.org, saw at jlab.org, jones at jlab.org
Your Farm jobs should be submitted using the Project name
c-comm2017
Your analysis ROOT file output should go here:
/volatile/hallc/comm2017/<your-username>/
** Read and understand how /volatile works here: **
https://scicomp.jlab.org/docs/volatile_disk_pool
** It is your responsibility to understand how the JLab **
** resources work. Ignore this and you may lose files **
Never copy CODA files to /home, /work, or /volatile. It impacts other
users and will make the IT group grumpy. Use commands like 'jcache'
to pull files from tape into '/cache/hallc/spring17/raw/', or
use a proper Farm job submission and that will be done for you
efficiently and automatically.
If they have not already done so, the spokespeople of the various
Commissioning experiments should probably request a
/work/hallc/eXXXXXX work directory space for their collaboration. (Do
not use /volatile, or /home for your analyzer code, etc. It does not
work efficiently at JLab's present scale and can impact other users.)
Feel free to ask me any questions you may have and I'll do my best to
support you.
All the best,
-- Brad
On Tue, 23 Jan 2018, Brad Sawatzky wrote:
> Hi folks,
>
> Disk using in the /home/cdaq directory has been increasing significantly
> over the last couple of weeks. If that directory fills, the experiment
> shuts down until we free space up again.
>
> I've found that a few people are writing ROOT files into that space
> and have contacted them directly, but it would be good for everyone
> to sanity check what they are do and make sure that they are writing
> output to an appropriate location.
>
> If you have a *.root file sitting under /home anywhere, it should be
> moved/deleted ASAP. Please review the information here:
> https://hallcweb.jlab.org/DocDB/0008/000868/001/Counting_House_TipsTricks-Jun2017.pdf
> and clean up your work space.
>
> If you have questions, don't hesitate to ask.
>
> -- Brad
>
--
Brad Sawatzky, PhD <brads at jlab.org> -<>- Jefferson Lab / Hall C / C111
Ph: 757-269-5947 -<>- Fax: 757-269-5235 -<>- Pager: brads-page at jlab.org
The most exciting phrase to hear in science, the one that heralds new
discoveries, is not "Eureka!" but "That's funny..." -- Isaac Asimov
More information about the Hallcsw
mailing list