[Lowq] Pass0 Cooking
Lamiaa El Fassi
elfassi at jlab.org
Tue Jun 1 18:12:19 EDT 2010
Hi All,
As an update of the Pass0 cooking. A total of 2183 jobs are done.
The current cooking status is:
Pending Jobs: 3086
Active Jobs: 103
Three types of the output files; hbook ntuples, ANAHIST and helicity files
are saved
respectively on paw, anaht and helcor subdirectory at the permanent claseg6
work
disk: /work/clas/claseg6/top_dir/pass0_v0.
However, the "CLASTOOL"ROOT, "H2"ROOT, BOS and LOG files are copied to the
auto-managed work disks and linked to the corresponding subdirectories of
the above
directory. You are all invited to look to these files and please let me know
if you
encounter anything wrong with any output formats.
Best regards,
Lamiaa
************************************************************
* Lamiaa El Fassi email: elfassi at jlab.org
* Research Associate @ Rutgers University
* Phone: (757) 269-7011 // Fax: (757) 269-5703
* Jefferson Lab., 12000 Jefferson Ave.
* Suite# 4, MS 12H3
* Newport News, VA. 23606
************************************************************
On Tue, May 25, 2010 at 9:13 AM, Lamiaa El Fassi <elfassi at jlab.org> wrote:
> Hi Hovanes and Stepan,
>
> Most probably I can't make today's meeting. I still don't know which hall I
> will be
> this morning and the phone availability! In case I can't make it, the
> status of
> the cooking until now:
>
> 5223 Pending Job
> 14 Active
> 67 Done
>
> The CSQL database table to monitor this cooking is: pass0_v0
>
> As I know, there is an ifarml64 node, so we can copy our software there and
>
> try to compile it, and then we can use it to launch a job to the 64bit farm
> nodes.
>
> Best regards,
>
> Lamiaa
>
> ************************************************************
> * Lamiaa El Fassi email: elfassi at jlab.org
> * Research Associate @ Rutgers University
> * Phone: (757) 269-7011 // Fax: (757) 269-5703
> * Jefferson Lab., 12000 Jefferson Ave.
> * Suite# 4, MS 12H3
> * Newport News, VA. 23606
> ************************************************************
>
>
> On Mon, May 24, 2010 at 4:24 PM, Hovanes Egiyan <hovanes.egiyan at gmail.com>wrote:
>
>> Eventually we need to utilize these 64bit nodes, but
>> we should finish this pass on 32 bits. It will take a study
>> to verify that we get identical results even if we get a
>> 32 bit code running on 64 bit machines.
>>
>> Hovanes.
>>
>>
>>
>> Stepan Stepanyan wrote:
>>
>>> Thanks Lamiaa,
>>>
>>> I am not an expert but I thought we can run 32-bit
>>> executable on 64-bit machines. Performance may
>>> not be optimal but it should work, is not it.
>>>
>>> Stepan
>>>
>>> Lamiaa El Fassi wrote:
>>>
>>>> Hi Hovanes and Stepan,
>>>> I canceled the last jobs and resubmitted just the first ten files of
>>>> each run.
>>>> The total pending jobs now is 5304. Some of the 796 runs are very short.
>>>> They ended without even reaching a total of ten files.
>>>> For the 64bit farm nodes, I think we need first to compile and test our
>>>> executable
>>>> in the 64bit machine instead of the 32bit one before launching a job on
>>>> these nodes.
>>>> Is it correct?
>>>> Thanks,
>>>> Lamiaa
>>>>
>>>> **********************************************************
>>>> * Lamiaa El Fassi email: elfassi at jlab.org <mailto:
>>>> elfassi at jlab.org>
>>>> * Research Associate @ Rutgers University * Phone: (757)
>>>> 269-7011 // Fax: (757) 269-5703 * Jefferson Lab., 12000
>>>> Jefferson Ave. * Suite# 4, MS 12H3
>>>> * Newport News, VA. 23606
>>>> ************************************************************
>>>>
>>>>
>>>> On Mon, May 24, 2010 at 12:43 PM, Stepan Stepanyan <stepanya at jlab.org<mailto:
>>>> stepanya at jlab.org>> wrote:
>>>>
>>>> Hi Lamiaa,
>>>>
>>>> Also, Dennis told me that we should make use of 64bit
>>>> farm as well. A lot more compute power there.
>>>>
>>>> Thanks, Stepan
>>>>
>>>>
>>>> Hovanes Egiyan wrote:
>>>>
>>>> Hi Lamiaa,
>>>>
>>>> If I told you to cook all files that was wrong. We need to
>>>> cancel all these jobs now. And after the jobs are canceled we
>>>> need to resubmit first ten file from each run.
>>>>
>>>> Hovanes.
>>>>
>>>>
>>>> Lamiaa El Fassi wrote:
>>>>
>>>> Hi Hovanes,
>>>> Yes, I am cooking all files (with A* extension) of each run.
>>>> I checked the pass0 cooking procedure email that you sent me
>>>> approximately a month ago and this is what I conclude from
>>>> it,
>>>> since I have already tested a few files from several runs
>>>> to do the
>>>> RF offset calibration. Did I miss something else?
>>>> Lamiaa
>>>>
>>>> ************************************************************
>>>> * Lamiaa El Fassi email: elfassi at jlab.org
>>>> <mailto:elfassi at jlab.org> <mailto:elfassi at jlab.org
>>>> <mailto:elfassi at jlab.org>>
>>>> * Research Associate @ Rutgers University *
>>>> Phone: (757) 269-7011 // Fax: (757) 269-5703
>>>> * Jefferson Lab., 12000 Jefferson Ave.
>>>> * Suite# 4, MS 12H3
>>>> * Newport News, VA. 23606
>>>> ************************************************************
>>>>
>>>>
>>>> On Mon, May 24, 2010 at 10:56 AM, Hovanes Egiyan
>>>> <hovanes.egiyan at gmail.com
>>>> <mailto:hovanes.egiyan at gmail.com>
>>>> <mailto:hovanes.egiyan at gmail.com
>>>> <mailto:hovanes.egiyan at gmail.com>>> wrote:
>>>>
>>>> Hi Lamiaa,
>>>>
>>>> I am a little confused about the number of files.
>>>> How come we have more than 796x10 files from 796 runs?
>>>> Are you cooking all files from each run ?
>>>>
>>>>
>>>> Hovanes.
>>>>
>>>>
>>>>
>>>>
>>>> On 05/24/2010 11:00 AM, Lamiaa El Fassi wrote:
>>>>
>>>> Hi Stepan,
>>>> Yes, the processed files are 25280. Thirty
>>>> three files are
>>>> already done, ten are active
>>>> and 25237 are still pending.
>>>> Best,
>>>> Lamiaa
>>>>
>>>>
>>>> ************************************************************
>>>> * Lamiaa El Fassi email:
>>>> elfassi at jlab.org <mailto:elfassi at jlab.org>
>>>> <mailto:elfassi at jlab.org <mailto:elfassi at jlab.org>>
>>>> * Research Associate @ Rutgers University
>>>> * Phone: (757) 269-7011 // Fax: (757) 269-5703
>>>> * Jefferson Lab., 12000 Jefferson
>>>> Ave. * Suite# 4, MS 12H3
>>>> * Newport News, VA. 23606
>>>>
>>>> ************************************************************
>>>>
>>>>
>>>> On Mon, May 24, 2010 at 6:06 AM, Stepan Stepanyan
>>>> <stepanya at jlab.org <mailto:stepanya at jlab.org>
>>>> <mailto:stepanya at jlab.org <mailto:stepanya at jlab.org>>>
>>>> wrote:
>>>>
>>>> Hi Lamiaa,
>>>>
>>>> Thanks a lot, great job.
>>>> How many files are you going to cook now, 25000?
>>>>
>>>> Stepan
>>>>
>>>> Lamiaa El Fassi wrote:
>>>>
>>>> Hi All,
>>>> I launched the pass0 cooking. A total of
>>>> 796 runs
>>>> (starting from a run 60752 till 61966)
>>>> and ~ 25000 files. The hbook ntuples,
>>>> ANAHIST and the
>>>> helicity_correction files will be
>>>> saved on the private claseg6 work disk,
>>>> however, the
>>>> remaining output files(*) will go to
>>>> the auto-deleted work disks and hence
>>>> linked to the
>>>> sub-directory to where they belong
>>>> on the claseg6 disk. None of these outputs
>>>> will be saved
>>>> on SILO since the purpose of
>>>> this cooking is to monitor the quality of
>>>> the calibration
>>>> on the whole running period.
>>>> The CSQL database table for this cooking is
>>>> "pass0_v0".
>>>> An example of this cooking
>>>> outputs exists on the
>>>> "/work/clas/claseg6/top_dir/pass0_v0/"
>>>> directory.
>>>> Best regards,
>>>> Lamiaa
>>>> (*) The remaining output files are:
>>>> * ROOT ntuples: produced by CLASTOOL and
>>>> saved on the
>>>> "ROOT" sub-directory
>>>> * ROOT ntuples: produced by h2root and
>>>> saved on the
>>>> "HROOT" sub-directory
>>>> * BOS files
>>>> * LOG files
>>>>
>>>> ************************************************************
>>>> * Lamiaa El Fassi email:
>>>> elfassi at jlab.org <mailto:elfassi at jlab.org>
>>>> <mailto:elfassi at jlab.org
>>>> <mailto:elfassi at jlab.org>> <mailto:elfassi at jlab.org
>>>> <mailto:elfassi at jlab.org>
>>>> <mailto:elfassi at jlab.org
>>>> <mailto:elfassi at jlab.org>>>
>>>>
>>>> * Research Associate @ Rutgers University
>>>> *
>>>> Phone: (757) 269-7011 // Fax: (757)
>>>> 269-5703 * Jefferson Lab.,
>>>> 12000 Jefferson Ave. *
>>>> Suite# 4, MS 12H3
>>>> * Newport News, VA. 23606
>>>>
>>>> ************************************************************
>>>>
>>>>
>>>>
>>>>
>>>>
>>>>
>>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: https://mailman.jlab.org/pipermail/lowq/attachments/20100601/3f74657d/attachment.html
More information about the Lowq
mailing list