[Halld-offline] Fwd: Data challenge requirements

[Richard Jones]

GlueX offline group,

In stating our goals for the next data challenge, we need to satisfy
whatever requirements are provided to us by the Jlab 12 GeV project.
 However, let's not forget that simulations on the OSG are an integral part
of our computing plan, and that to reach our scientific goals in the most
optimum way possible, we need an integrated system for offline processing
that includes both on-site and off-site computing.  Let's make sure that
our goals for the next data challenge are directed primarily by our own
internal criteria as a collaboration, and are not merely dictated to us by
the expectations of the lab.  Those should serve as a kind of lower bound
on what we expect to achieve.

-Richard J.


On Thu, Oct 31, 2013 at 9:40 AM, Mark Ito <marki at jlab.org> wrote:

>  Proposal from Graham and Chip, for your information and comment.
>
>
> -------- Original Message --------  Subject: Data challenge requirements  Date:
> Wed, 30 Oct 2013 13:05:59 -0400  From: Heyes Graham <heyes at jlab.org><heyes at jlab.org>  To:
> Ito Mark <marki at jlab.org> <marki at jlab.org>, Lawrence David
> <davidl at jlab.org> <davidl at jlab.org>, Weygand Dennis <weygand at jlab.org><weygand at jlab.org>,
> Veronique Ziegler <ziegler at jlab.org> <ziegler at jlab.org>  CC: Rolf Ent
> <ent at jlab.org> <ent at jlab.org>, Rossi Patrizia <rossi at jlab.org><rossi at jlab.org>,
> Watson Chip <watson at jlab.org> <watson at jlab.org>
>
> Dear Offline folks,
>  Chip and I had a discussion this morning about what is an acceptable
> scope and schedule for data challenge tests of your analysis frameworks.
> The definitive tests should be done at JLab using the systems on which the
> final analysis will be done, i.e. the ENP analysis cluster (Farm). The
> suggested scope and schedule is based upon the dates that you have given
> for the first major bumps in computing requirements, 5000 cores for GLUEX
> in Q2 of 2015 and 2400 for CLAS12 in Q2 of 2016:
>
>    - 10% of final scale 24 months in advance.
>    - 25% of final scale 18 months in advance.
>    - 50% of final scale 12 months in advance.
>
> Each test should last for 2-4 days depending upon how many problems are
> encountered. The larger scale tests will require significant resources
> which Chip proposes that he will loan to us from the LQCD clusters so as
> not to significantly disturb other Farm users. He proposes moving the
> resources to us on a Monday then moving them back to LQCD on a Friday
> giving us up to four work days for testing.
>
>  I spoke with Mark this morning and he agreed that this is a reasonable
> schedule and that GLUEX have already met the 24 month test requirement.
> However the 25% scale test will be due in the next few months.
>
>  Chip and I both think that this is a reasonable schedule and not
> difficult to meet. We would like you to consider it as you prepare
> presentations for the review.
>
>  Regards to all,
>  Graham
>
>
>
>
>
> _______________________________________________
> Halld-offline mailing list
> Halld-offline at jlab.org
> https://mailman.jlab.org/mailman/listinfo/halld-offline
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://mailman.jlab.org/pipermail/halld-offline/attachments/20131031/1739e9a0/attachment-0002.html>