[Halld-offline] more info on small files on the cache disk

Mark Ito marki at jlab.org
Thu Jul 1 13:30:41 EDT 2021


Folks,

At the last software meeting we discussed the problem of small files 
accumulating on the cache disk. I've generated a webpage with more info 
than the page I showed at the meeting. Find it at

https://halldweb.jlab.org/cache_small_files/cache_small_file_report.html

The links are to sub-reports, for the indicated user, showing the 50 
directories where that user has the greatest number of small files.

This is information only. What we do with these files is yet to be 
determined. Recall that the biggest problem for us is  that these files 
are not backed up to tape despite their existence on the write-through 
cache.

Note: this reports is still using the partial list, 12 million of 14 
million files total, that existed on cache about two weeks ago. (I am on 
my fourth or fifth try to get a complete list. Something or another 
always crashes.)

   -- Mark



More information about the Halld-offline mailing list