[Halld-offline] distributing REST files from initial launch

[Shepherd, Matthew]

Hi all,

I'm interesting in copying the REST files from the initial launch back to Indiana for analysis.  In order to minimize load on disk/network coming out of the lab, I wanted to try to coordinate this with others who might be interested in having a copy of the data.

My initial plan is to copy this to the IU "data capacitor" which is a university managed 3.5 PB high throughput scratch drive that is mounted on a couple of our large centralized clusters.  It is configured as a globus endpoint so this copy should be easy.  A quick test last week showed 150 MB/s transfer from JLab.

Once it is here, then I could share with others.  Access to the data capacitor requires IU credentials.  There are two ways to get the files from here to another institution:

(1) I can request an affiliate account for a representative at an institution.  This requires submitting some forms, etc., but results in an account that has full access to IU systems.  Using this credential you can authenticate yourself and access files via the data capacitor globus endpoint.

(2) You can give me access to your globus endpoint and I can initiate the transfer using the web interface.  (This is probably easiest.)

Alternatively, if there is another institution who is interested in hosting and distributing the REST data, then I'd be happy to copy from there.

Thoughts?  How many are interested in getting a local copy of REST?

Matt

---------------------------------------------------------------------
Matthew Shepherd, Associate Professor
Department of Physics, Indiana University, Swain West 265
727 East Third Street, Bloomington, IN 47405

Office Phone:  +1 812 856 5808