[Halld-offline] advice on high speed file copies offsite

[Shepherd, Matthew]

Hi all,

Does anyone have suggestions for doing high speed
file copies offsite?

I consulted this page:

https://scicomp.jlab.org/docs/node/11

Which suggests to use the node:  globus.jlab.org

This node has real limited functionality.  I can't get rsync to
work and there is no tar to use with ssh.

I tried just:

scp -r

This works, but I'd like to know if I can go faster.
I'm getting speeds that are orders of magnitude below
the 10 Gbps pipe that is at JLab and also at my
end.  I'm sure there is other competing traffic, but
I think part of the problem might be the scp is poorly
optimized for coping many small files.

Any experience with this in the offline group?

Matt

---------------------------------------------------------------------
Matthew Shepherd, Associate Professor
Department of Physics, Indiana University, Swain West 265
727 East Third Street, Bloomington, IN 47405

Office Phone:  +1 812 856 5808