[Halld-offline] SWIF requests

[Sean Dobbs]

Hi Offliners,

I've compiled the list of suggestions into the semi-arbitrarily ranked list
given below.  Please let me know if you have any additions or change in
rankings by close of business today.

Thanks,
Sean

===SWIF Suggestions===

1) Support for explicit dependencies between jobs.  A job would be allowed
to not start processing until either (1) a list of other jobs specified by
job name completed; or (2) a list of given URIs exist.

2) Allow: swif status -workflow my_flow -problems SWIF-USER-NON-ZERO
Such that only the details for the jobs with the given problems are printed.

3) Better formatting options for the status command.
E.g.: swif status -workflow my_flow -problems SWIF-USER-NON-ZERO -small_list

Instead of printing some details of each job, literally just list the
“name” fields.  That way it’s easier for me to find/parse the failed ones
and hop to the associated log files.

4) Be able to add user tags to a job after it’s already been submitted and
is running.

5) Add the option to run modify-jobs on jobs based on their auger status
(e.g. depend or pending...)

6) The addition of a “add-jobs” command, which would be to abstract away
the mechanics of checking if input files exist and looping over them for
job submission.

It would need to be paired with a configuration file, taken as an
argument.  I would suggest a simple key, value format in text or JSON.  A
(rough) example is given in:
https://github.com/NathanSparks/jobs/blob/master/config.txt
<https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_NathanSparks_jobs_blob_master_config.txt&d=CwMFaQ&c=yHlS04HhBraes5BQ9ueu5zKhE7rtNXt_d012z2PA6ws&r=y4ZD58I4nPR6tZqjerSGt-WlWVAhqa3FHDMXqQ_5aUc&m=3dDNm49qX8bbX0RhQo1-BmqyR0Cn7yGuZE0fOlmwvEM&s=ufv7Y1yja18xljOW_Bm7DprNeaqULGrNhPnNpZnyuzM&e=>




On Thu, Oct 13, 2016 at 3:38 PM Sean Dobbs <s-dobbs at northwestern.edu> wrote:

> Hi Offliners,
>
> I've been asked to provide Chris Larrieu with a prioritized list of
> enhancements to SWIF that we would like to have.  I'm going through my old
> notes on these matters, but this is a good chance to collect other ideas
> and let our needs be known. I'd like to send him the list early next week,
> so please send me any ideas you'd like added by noon on Monday.  I'll
> compile a list and send an email out before passing it on to Chris.
>
> Cheers,
> Sean
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://mailman.jlab.org/pipermail/halld-offline/attachments/20161017/5246a717/attachment-0002.html>