[Halld-offline] Hall-D Computing plan and storage of simulated data.

[Graham Heyes]

Curtis,
	Chip asked for SpecInt numbers. This time around I am asking the questions and am asking for "time to process one event" normalized to out current generation 32-bit farm nodes. This should be much easier to measure/estimate. I have spreadsheets that can take those values and estimate performance in terms of standardized benchmarks and then estimate how many nodes we need.

	Regards to all,
		Graham

On Feb 11, 2011, at 3:27 PM, Curtis A. Meyer wrote:

> Thanks David -
> 
>    I concur with Richard that the grid infrastructure is critical and 
> needs to be placed
> into the plan somewhere. Also, in going through the numbers in the plan, 
> I did not
> fully understand all the SpecInt numbers that were there. It would be 
> useful to have a
> meeting where we go through these numbers before submitting the final 
> plan. I am
> sure that they are right, but I am just "slow".
> 
>   Curtis
> On 2/11/11 1:38 PM, David Lawrence wrote:
>> Hi All,
>> 
>> Just a follow up to the discussion at the meeting on Wednesday. I'd
>> mentioned that Mark had submitted the document I wrote up in 2008 when
>> filling out Chip's original spreadsheet. The document titled "12GeV
>> Computing Plan" is GlueX-doc-1431. As to the specific issue of storing
>> simulated data, it has this in the second paragraph on page 2:
>> 
>> "Hall-D currently plans to follow a computing model that stores very
>> little simulated data on tape. The expectation is that it would be
>> nearly as fast or faster to reproduce the data as it would be to read it
>> off of tape and reprocess it. The “DST” files produced by the simulation
>> are therefore only expected to need 10% of the disk space used for the
>> raw, simulated data that will exist only on the farm nodes."
>> 
>> This was not backed up by any hard numbers but I still suspect it is
>> true. This refers only to what is needed regarding JLab resources and
>> not what may be implemented outside of JLab (and JLab's budget). To my
>> knowledge this represents what is our current Computing Plan for Hall-D.
>> 
>> Regards,
>> -David
>> _______________________________________________
>> Halld-offline mailing list
>> Halld-offline at jlab.org
>> https://mailman.jlab.org/mailman/listinfo/halld-offline
>> 
> 
> 
> -- 
> Prof. Curtis A. Meyer		Department of Physics
> Phone:	(412) 268-2745		Carnegie Mellon University
> Fax:	(412) 681-0648		Pittsburgh PA 15213-3890
> cmeyer at ernest.phys.cmu.edu	http://www.curtismeyer.com/
> 
> 
> 
> _______________________________________________
> Halld-offline mailing list
> Halld-offline at jlab.org
> https://mailman.jlab.org/mailman/listinfo/halld-offline