[Halld-offline] updated branch again: sim-recon-dc-2

Justin Stevens jrsteven at mit.edu
Tue Feb 25 08:59:33 EST 2014


Hi Data Challengers,

FYI, I used these tagged versions for a test on the MIT Openstack cluster of 100 jobs completed with 25K events each using the "standard" EM background that Kei and Paul have also used (10^7 g/s and +/- 200 ns gate).  With this configuration I don't see any crashes, but 2 jobs finish with a small REST output file size which only contains a fraction of the 25K events.  I think Paul also found this earlier where JANA reports that it processed the full number of events, but the REST file size is too small.  As a reminder these jobs are deployed with 8 parallel processes running on an 8-core blade which share 14GB of memory.  So they're not as sensitive to the memory spikes as some of the other tests we've seen.

One other thought on job length.  Since the EM background results in much more time spent in hdgeant, should we lower the number of events per job to keep the job length from getting too large?  These 25K event jobs take 6 hours here, but this will only go up if we extend the gate or up the rate for the EM background.

-Justin

On Feb 23, 2014, at 6:01 PM, Mark Ito wrote:

> correction, see below
> On 02/22/2014 09:18 PM, Mark Ito wrote:
>> Folks,
>> 
>> I changed the data challenge 2 sim-recon and hdds branches to get the
>> latest versions of everything, this time including src/libraries/TOF.
>> This will bring in Paul's recent changes to ameliorate the memory issues
>> we have been fighting with. The new hdds is necessary for the new TOF
>> geometry.
>> 
>> New tagged versions reflect the branch a week ago:
>> 
>> tags/hdds-dc-2.0
>> tags/hdds-dc-2.1
> that last line should have been: tags/sim-recon-dc-2.1
>> 
>> As before, the branch has not been tested yet, but the word should go
>> out whenever it changes. Let me know if you see weirdness.
>> 
>>    -- Mark
>> 
> 
> _______________________________________________
> Halld-offline mailing list
> Halld-offline at jlab.org
> https://mailman.jlab.org/mailman/listinfo/halld-offline




More information about the Halld-offline mailing list