[G12] Question about farm running

Michael C. Kunkel mkunkel at jlab.org
Fri Feb 14 08:03:36 EST 2014


Greetings G12,

As per my discussion on GPP during the February 11th 2014 meeting, I had 
decided to run jobs on the farm as 2 jobs instead of one whole job. 
Meaning, the method I originally used ran GSIM, GPP, and A1C in one farm 
job. Now I created 2 job, 1st job runs GSIM then output a GSIM file the 
volatile. The second job pulls the GSIM file from the volatile and runs 
GPP, A1C and then my final Ntuple code.

When I run the job as a whole, the time consumed for 100K events is well 
over 48 hours, however if I split the jobs into 2 segments, as described 
above, the 1st segment uses 4 hours of time and the 2nd jobs take under 
3 hours for a total of 7 hours.

The downside to running 2 jobs on the farm is the wait for the jobs to 
load, twice the amount of wait time.

Has anyone encountered a farm issue like this before with any program 
and how was it resolved?

BR
MK


More information about the G12 mailing list