[Halld-offline] Fwd: Re: Data Challenge Meeting Minutes, January 31, 2014

[Mark Ito]

Richard,

We should discuss this at the DC meeting, but my personal view is that 
we are committed to SRM as our default solution and someone has to 
convince us that cost-benefit says we should switch.

SciComp is behind Globus Online because it is their go-to solution for 
LQCD users. My understanding is that requirements were developed with 
that community in mind, they have committed resources to supporting it, 
and they seem to be happy with the way it is working. Which is just 
fine, of course. It also means that it was a near certainty that they 
would offer it as a solution for us. Which is just fine too. :-)

   -- Mark

On 02/04/2014 10:56 PM, Richard Jones wrote:
> Mark,
>
> Hear-say by Review Panel members is not very useful to us, is it?  Is 
> that really any more than someone repeating what they heard?  What 
> would be genuinely helpful would be to be told what is better and 
> replaces SRM, that is ready to go on the grid, and we do not have to 
> go out and develop ourselves.  I am on the dcache listserve, and this 
> mailing list is lit up 24/7 with messages from tier-2 and tier-3 
> centers all over the globe who are actively running heavy workloads 
> through dcache, with SRM being the gateway for most of the traffic.
>
> I have heard people grouse about all sorts of tools (like Geant4 and 
> root) that everyone knows are the best choices around for what they 
> do, but can be frustrating nonetheless.  I know SRM is not 
> data-transport Nirvana, but we don't have the resources in GlueX to go 
> out and develop the next thing that is a super-SRM.  Wasting our time 
> trying to force Globus Online into this role is going to be a 
> rat-hole.  I have seen SRM do what we need it to do, so I guess I am 
> looking for a good reason to devote time to implementing something 
> else -- besides that so-and-so said we might find or invent something 
> better.
>
> -Richard J.
>
>
> On Tue, Feb 4, 2014 at 9:23 AM, Mark Ito <marki at jlab.org 
> <mailto:marki at jlab.org>> wrote:
>
>     From Sandy Philpott:
>
>
>     -------- Original Message --------
>     Subject: 	Re: [Halld-offline] Data Challenge Meeting Minutes,
>     January 31, 2014
>     Date: 	Mon, 3 Feb 2014 16:58:51 -0500 (EST)
>     From: 	Sandy Philpott <philpott at jlab.org> <mailto:philpott at jlab.org>
>     To: 	Mark Ito <marki at jlab.org> <mailto:marki at jlab.org>
>
>
>
>     Hi Mark,
>
>     As discussed...
>
>     IT/SciComp is ready for the Hall D data challenge. When we get your test
>     description details -- rates to/from tape, disk requirements, timeframe, etc,
>     we'll flip the farm nodes in HPC back to the farm, along with the 12s nodes
>     needed to get 2250 cores total in the cluster, so that Hall D will be able to
>     run 1250 cores with other jobs running.  The nodes to be moved from HPC will have
>     to drain jobs, which can take up to 48 hours.  We want to make sure you are
>     ready to run when we do it so that we don't waste CPUs sitting idle.
>
>     There's no SRM ability at JLab, and recall from the review that reviewers
>     suggested GlueX consider something besides SRM.  At one point in 2010 Curtis
>     had  firewall openings via our Cyber group for client tools installed
>     in user space on the ifarm nodes; check with Greg and company on that status
>     if still needed, as network configs for ifarms have undergone changed since then.
>
>     IT supports Globus Online for offsite data transfers using the site's 10 gigabit
>     pipe; info available athttps://scicomp.jlab.org/docs/?q=node/11  
>
>     Let us know when you're ready to run and what you need, then let the
>     node flipping and data challenge begin. I understand from today's discussion
>     you expect the timeframe to be sometime near the end of February.  Note that
>     the farm is currently almost idle at this point, so you shouldn't have any
>     trouble getting test jobs and prototypes started in the meantime.
>
>     Regards,
>     Sandy
>
>     ----- Original Message -----
>     From: "Mark Ito"<marki at jlab.org>  <mailto:marki at jlab.org>
>     To: "GlueX Offline Software Email List"<halld-offline at jlab.org>  <mailto:halld-offline at jlab.org>
>     Sent: Monday, February 3, 2014 1:05:43 PM
>     Subject: [Halld-offline] Data Challenge Meeting Minutes, January 31, 2014
>
>     ...
>
>     9. Is the JLab CC ready for us?
>     + Mark will talk to Sandy about our plans.
>     10. What ability will we have for SRM at Jefferson Lab?
>     + Mark will talk to Sandy about the status of the system.
>
>     ...
>
>
>
>
>     _______________________________________________
>     Halld-offline mailing list
>     Halld-offline at jlab.org <mailto:Halld-offline at jlab.org>
>     https://mailman.jlab.org/mailman/listinfo/halld-offline
>
>

-- 
Mark M. Ito, Jefferson Lab, marki at jlab.org, (757)269-5295

-------------- next part --------------
An HTML attachment was scrubbed...
URL: https://mailman.jlab.org/pipermail/halld-offline/attachments/20140205/4dc868a2/attachment-0001.html