[Hallcsw] Disk usage under /home on cdaq cluster

Brad Sawatzky brads at jlab.org
Tue Jan 23 14:17:06 EST 2018


And, since it came up in a recent conversation, note that you do /not/
need to do your offline analysis on the cdaq cluster (and probably
should not do so).  You can access the data files through /cache and
take advantage of the ifarm (and farm) machines.

Here's a copy-paste from an email last month with a few more details.

  When you get to the point where you want to run your jobs on the Farm
  (and/or ifarm) you will need to use the following resources.

  You should make sure you are in the 'c-comm2017' unix group.
  Login to an ifarm machine and run 'groups'.  You should see
  'c-comm2017' towards the end of the list of group names.
  If not, then email one of the following and request that
  you be added:
    brads at jlab.org, saw at jlab.org, jones at jlab.org

  Your Farm jobs should be submitted using the Project name
      c-comm2017

  Your analysis ROOT file output should go here:
    /volatile/hallc/comm2017/<your-username>/
    ** Read and understand how /volatile works here: **
      https://scicomp.jlab.org/docs/volatile_disk_pool
    ** It is your responsibility to understand how the JLab **
    ** resources work.  Ignore this and you may lose files  **

  Never copy CODA files to /home, /work, or /volatile.  It impacts other
  users and will make the IT group grumpy.  Use commands like 'jcache'
  to pull files from tape into '/cache/hallc/spring17/raw/', or
  use a proper Farm job submission and that will be done for you
  efficiently and automatically.

  If they have not already done so, the spokespeople of the various
  Commissioning experiments should probably request a
  /work/hallc/eXXXXXX work directory space for their collaboration.  (Do
  not use /volatile, or /home for your analyzer code, etc.  It does not
  work efficiently at JLab's present scale and can impact other users.)

  Feel free to ask me any questions you may have and I'll do my best to
  support you.

All the best,
-- Brad

On Tue, 23 Jan 2018, Brad Sawatzky wrote:

> Hi folks,
> 
> Disk using in the /home/cdaq directory has been increasing significantly
> over the last couple of weeks.  If that directory fills, the experiment
> shuts down until we free space up again.
> 
> I've found that a few people are writing ROOT files into that space
> and have contacted them directly, but it would be good for everyone
> to sanity check what they are do and make sure that they are writing
> output to an appropriate location.
> 
> If you have a *.root file sitting under /home anywhere, it should be
> moved/deleted ASAP.  Please review the information here:
>   https://hallcweb.jlab.org/DocDB/0008/000868/001/Counting_House_TipsTricks-Jun2017.pdf
> and clean up your work space.
> 
> If you have questions, don't hesitate to ask.
> 
> -- Brad
> 
-- 
Brad Sawatzky, PhD <brads at jlab.org>  -<>-  Jefferson Lab / Hall C / C111
Ph: 757-269-5947  -<>-  Fax: 757-269-5235  -<>- Pager: brads-page at jlab.org
The most exciting phrase to hear in science, the one that heralds new
  discoveries, is not "Eureka!" but "That's funny..."   -- Isaac Asimov


More information about the Hallcsw mailing list