[Clas12_software] OSG submissions unsuspended

[Nathan Baltzell]

Dear Everyone,

The submit portal is ready for new submissions now.

There’s a few changes in place to be aware of:

1. Outputs will now appear at a new location, /volatile/clas12/osg2, to facilitate #3 below.  HIPO files at the old /volatile/clas12/osg will remain, deleted only by the standard /volatile auto-deletion mechanism.

2. For performance of both Lustre and the submit node, Lustre is no longer being used directly by the jobs, in favor of staging inputs and outputs.  This means there will currently be about a 1 hour delay between job success reporting and the files appearing on /volatile. That feedback delay will be addressed in the future.

3. For performance and maintainence of filesystems, the only outputs appearing on Lustre will be HIPO files and the top level nodeScript.sh, one per submission.  Logs will be retained on the submit node for diagnostics.

4. Output options are currently limited to DSTs only, until we get some mileage on the new setup.

And, just a note, the non-DST output and LUND input options should ideally be reserved for smaller tests, e.g. for generator development, while large-scale simulations should ideally use a generator supported by the portal and DST outputs only.  There will be a discussion at an upcoming Thursday at 11 software meeting.

For questions on any of these, we can use the Simulation topic at the forum: https://clas12.discourse.group/

Regards,
Mauri and Nathan


On Mar 19, 2021, at 11:35 AM, Maurizio Ungaro <ungaro at jlab.org<mailto:ungaro at jlab.org>> wrote:

Hi all,

The OSG submissions are suspended due to issues with lustre.

During this down time,  the OSG portal will be modified and /volatile will not be used directly anymore, but as a second stage of storing the output files.

An update will be sent when we’re ready to submit jobs again.

Sorry for the inconvenience,
Mauri





_______________________________________________
Clas12_software mailing list
Clas12_software at jlab.org<mailto:Clas12_software at jlab.org>
https://mailman.jlab.org/mailman/listinfo/clas12_software

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://mailman.jlab.org/pipermail/clas12_software/attachments/20210322/466374d2/attachment.html>