[Halld-offline] access to jlab-resident data-challenge data

[Zisis Papandreou]

Hi Richard and Mark:

the corruption/truncation is probably related to the disk becoming full.  Andrei and Irina lost many jobs due to this reason on Thursday, I believe.  Mark, my understanding is that the other halls have even smaller disks, but considering the kinds of things we are doing in Hall D is it unreasonable to ask for another 10 TB of volatile space?  Or, do we need to do better housecleaning?

Cheers, Zisis...

On 2013-01-05, at 10:49 AM, Richard Jones wrote:

> Hi Mark,
> 
> Of these files on /volatile, I see that there are ~750 that are truncated or corrupted in some way.  I am in the process of collecting all of the jobs (both at Jlab and UConn) that completed successfully and staging them on SRM.  When I am done, I will pass you a list so you can pull the lot to jlab and stick them into mss.  Instructions for accessing the files on SRM are on the wiki at the page below.
> 
> https://halldweb1.jlab.org/wiki/index.php/Using_the_Grid
> 
> -Richard J.
> 
> 
> On 1/3/2013 11:36 AM, Mark M. Ito wrote:
>> First let me stress that these are stop-gap instructions. I am still
>> trying to figure out the srm, etc....
>> 
>> There are about 19,000 rest format files at jlab in the directory
>> 
>>    /volatile/halld/home/marki/proj/dc_01/rest
>> 
>> for anyone who wants to take a look. This is about 900 million events
>> using 1.7 TB. Each file is about 100 MB. You must be on a farm or ifarm
>> node to see the disk.
>> 
>> Any member of the "halld" group should be able to read them. (If not,
>> let me know.)
>> 
>> Also note that all of these files have been backed-up to tape. So the
>> "volatile" thing is not as scary as it sounds.
>> 
> 
> 
> _______________________________________________
> Halld-offline mailing list
> Halld-offline at jlab.org
> https://mailman.jlab.org/mailman/listinfo/halld-offline


Dr. Zisis Papandreou
Professor of Physics, Ph.D, P.Phys.
---------------------------------------------------------
Department of Physics   
University of Regina	    
3737 Wascana Parkway
Regina, SK  S4S 0A2	 CANADA

Phone: (306) 585-5379
Fax: (306) 585-5659
Email:  zisis at uregina.ca
Website: http://kronos.phys.uregina.ca/~zisis/professional/



-------------- next part --------------
An HTML attachment was scrubbed...
URL: https://mailman.jlab.org/pipermail/halld-offline/attachments/20130105/535c7c45/attachment.html