[Eg6_analysis] Upcoming Pass0 Cooking
Lamiaa El Fassi
lamiomar at gmail.com
Mon Sep 13 16:24:08 EDT 2010
Hi Stepan,
I have implemented the last modification and tested a file clas_61695.A05.
Its output files are located at this directory:
/work/clas/claseg6/top_dir/pass0_v1/.
In this test, the CLASTOOL ROOT file was produced with the help of Hovanes.
Please look at those files and let me know if everything looks fine!
If so, that will be the setting for this cooking pass.
Best regards,
Lamiaa
************************************************************
* Lamiaa El Fassi email: elfassi at jlab.org
* Research Associate @ Rutgers University
* Phone: (757) 269-7011 // Fax: (757) 269-5703
* Jefferson Lab., 12000 Jefferson Ave.
* Suite# 4, MS 12H3
* Newport News, VA. 23606
************************************************************
On Sat, Sep 11, 2010 at 1:19 PM, Stepan Stepanyan <stepanya at jlab.org> wrote:
> Hi Lamiaa,
>
> Ntuple looks fine. I noticed we have raster variables in there
> that we do not use (it comes from eg1). There are also FCm and FCp
> variables that are =0 now. These
> Faradey cap readings for negative and positive heicities. Do we
> need them? We did not use FC for production runs at all.
> I removed all these variables. I made changes to
> seb_nt.inc and book_seb_nt.F to drop these variables.
> New files are in /work/clas/disk4/step/eg6/ana
>
> Could you also please add
> set licpb_nt_do -1;
> to your tcl to write out ICPB block of the ntuple. Now it has only
> ICHB part.
>
> Thanks, Stepan
>
> Lamiaa El Fassi wrote:
>
>> Hi Stepan,
>>
>> All the produced test files are located in the main directory
>> /work/clas/claseg6/top_dir/pass0_v1/ as follow:
>>
>> *Hbook ntuple : stored in paw sub-directory
>> ANAHIST hbook: stored in anaht sub-directory
>> helicity correction: stored in helcor sub-directory*
>>
>> *ROOT files : H2ROOT format linked to HROOT sub-directory*
>> *ROOT files : CLASTOOL format linked to ROOT sub-directory*
>> (corrupted because the missing
>> shared library in the 64 bit farm)
>> *BOS files : linked to BOS sub-directory
>> LOG files : **linked to LOG sub-directory*
>>
>> Best regards,
>>
>> Lamiaa
>>
>> ************************************************************
>> * Lamiaa El Fassi email: elfassi at jlab.org <mailto:
>> elfassi at jlab.org>
>> * Research Associate @ Rutgers University * Phone: (757)
>> 269-7011 // Fax: (757) 269-5703 * Jefferson Lab., 12000
>> Jefferson Ave. * Suite# 4, MS 12H3
>> * Newport News, VA. 23606
>> ************************************************************
>>
>>
>> On Sat, Sep 11, 2010 at 9:00 AM, Stepan Stepanyan <stepanya at jlab.org<mailto:
>> stepanya at jlab.org>> wrote:
>>
>> Hi Lamiaa,
>>
>> Thanks, I think we can have one bos file with "main" and "psnn".
>> Two neutrals with RTPC track "gmnn", is too big to combine and
>> "eps" events are in the main. For pass0 we will produce one bos file.
>> To do so, you should comment all outputs but the first one and change
>> "err(3)=0" to "err(1)=0" in user_xtra.F
>>
>> What about ntuple, it seems I cannot find ntuple files. Where are
>> they.
>>
>>
>> Stepan
>>
>> Lamiaa El Fassi wrote:
>>
>> Hi Stepan,
>>
>> The cooking tests that I did with the new banklist are done.
>> The output files of the two files clas_61695.A0[2,3] are
>> stored and/or linked to /work/clas/claseg6/top_dir/pass0_v1/.
>> I used the same name convention for the BOS files that I
>> mentioned earlier.
>>
>> Best,
>>
>> Lamiaa
>>
>> ************************************************************
>> * Lamiaa El Fassi email: elfassi at jlab.org
>> <mailto:elfassi at jlab.org> <mailto:elfassi at jlab.org
>> <mailto:elfassi at jlab.org>>
>>
>> * Research Associate @ Rutgers University * Phone:
>> (757) 269-7011 // Fax: (757) 269-5703 *
>> Jefferson Lab., 12000 Jefferson Ave. * Suite#
>> 4, MS 12H3
>> * Newport News, VA. 23606
>> ************************************************************
>>
>>
>> On Fri, Sep 10, 2010 at 3:35 PM, Stepan Stepanyan
>> <stepanya at jlab.org <mailto:stepanya at jlab.org>
>> <mailto:stepanya at jlab.org <mailto:stepanya at jlab.org>>> wrote:
>>
>> Hi Lamiaa,
>>
>> When you will try to make another test cooking of one file
>> to check output file lengths, please use attached tcl file.
>> I remove ECPC from banklist. We do not need it for pass0
>> cooking. If ectime calibrations will be needed we have cook
>> more files (more than 10) any way.
>>
>> Thanks, Stepan
>>
>>
>> On 9/9/10 5:10 PM, Lamiaa El Fassi wrote:
>>
>> Hi Stepan,
>>
>> I did some cooking tests with the new tcl file but
>> unfortunately
>> I am not getting
>> the outfile1 (negatively charged TB tracks) and
>> outfile2 (e +
>> pos. track) BOS files.
>> I got only outfile3 (pos. track + more than 2 neutral
>> tracks) and
>> outfile4 (RTPC track
>> + more than 2 neutral tracks). I tested two files of a
>> run 61695;
>> 05 and 10 with different
>> name conviention especially of their output BOS files.
>> You can
>> find those files at the link
>> directory /work/clas/claseg6/top_dir/pass0_v1/BOS/. The
>> name
>> convention of the latest
>> produced BOS files of "clas_61695.A10" stands for:
>>
>> [1] main_*.A0* corresponds to negatively charged TB tracks
>> [2] eps_*.A0* corresponds to a good electron and a
>> positively
>> charged particle
>> [3] psnn_*.A0* corresponds to a positively charged
>> track with at
>> least 2 neutrals
>> [4] gmnn_*.A0* corresponds to at least 1 track in RTPC
>> and at
>> least 2 neutrals
>> I will look to see what wrong with the BOS files
>> type [1] and [2].
>>
>> Best,
>>
>> Lamiaa
>>
>>
>> ************************************************************
>> * Lamiaa El Fassi email: elfassi at jlab.org
>> <mailto:elfassi at jlab.org>
>> <mailto:elfassi at jlab.org <mailto:elfassi at jlab.org>>
>> * Research Associate @ Rutgers University
>> * Phone: (757) 269-7011 // Fax: (757) 269-5703
>> * Jefferson Lab., 12000 Jefferson Ave.
>> * Suite# 4, MS 12H3
>> * Newport News, VA. 23606
>>
>> ************************************************************
>>
>>
>> On Wed, Sep 8, 2010 at 5:03 PM, Lamiaa El Fassi
>> <lamiomar at gmail.com <mailto:lamiomar at gmail.com>
>> <mailto:lamiomar at gmail.com <mailto:lamiomar at gmail.com>>>
>>
>> wrote:
>>
>> Hi Stepan,
>>
>> The 0.8 GB is the size of the first output which
>> correspond
>> to the negatively charged track.
>>
>>
>> Best,
>>
>> Lamiaa
>>
>>
>> ************************************************************
>> * Lamiaa El Fassi email:
>> elfassi at jlab.org <mailto:elfassi at jlab.org>
>> <mailto:elfassi at jlab.org <mailto:elfassi at jlab.org>>
>> * Research Associate @ Rutgers University
>> * Phone: (757) 269-7011 // Fax: (757) 269-5703
>> * Jefferson Lab., 12000 Jefferson
>> Ave. * Suite# 4, MS 12H3
>> * Newport News, VA. 23606
>>
>> ************************************************************
>>
>>
>> On Wed, Sep 8, 2010 at 12:46 PM, Stepan Stepanyan
>> <stepanya at jlab.org <mailto:stepanya at jlab.org>
>> <mailto:stepanya at jlab.org <mailto:stepanya at jlab.org>>> wrote:
>>
>> Hi Lamiaa,
>>
>> I resented the tcl. I did not remove HLS bank.
>> HLS should
>> stay. But other scaler banks that come with
>> scaler event thay
>> are written out independently.
>> When you quote 0.8Gb, is this for which type of
>> output,
>> electrons
>> only?
>>
>> Stepan
>>
>>
>> On 9/8/10 1:17 PM, Hovanes Egiyan wrote:
>>
>> Hi Stepan and Lamiaa,
>> I think we should keep the scaler banks BOS
>> HLS and
>> TRGS. They
>> will be needed if someone wants to do
>> normalization
>> or beam
>> asymmetry studies.
>> Hovanes.
>>
>>
>> Lamiaa El Fassi wrote:
>>
>> Hi Stepan,
>>
>> For some unknown reasons I just got
>> your email
>> today. What I received yesterday
>> was just your reply that no change is
>> needed to
>> the tcl file. Because of that I cooked
>> some files before and after Raphael's
>> modification to the gem package to test
>> my cooking
>> scripts and his changes. I was
>> planning to send
>> you an email to look at them before
>> seeing your latest email.
>>
>> Anyway I will recook some files with
>> the new tcl
>> file, but since the file that I got doesn't
>> reflect the change that you mentioned
>> in your
>> email. I will cite them here to make sure
>> is that what you mean:
>>
>> 1. List of the four output banknames:
>> (that
>> means you want to produce *four
>> separate* BOS files)
>>
>>
>> ----------------------------------------------------------------------------------------------
>>
>> setc outbanknames(1)
>> "HEADSH RFT
>>
>> ECPCSCRCTRPBTBIDCL01TBTRCC01CCPBSHHBSHPBDCPBECPB
>>
>> EVNTFBPMHEVTICHBPARTSCPBTBERECHBGGEOGCPBBMPREPICVERTMVRTTGBI";
>> outputfile outfile1 PROC1 2047;
>>
>> setc outbanknames(2)
>> "HEADSH RFT
>>
>> ECPCSCRCTRPBTBIDCL01TBTRCC01CCPBSHHBSHPBDCPBECPB
>>
>> EVNTFBPMHEVTICHBPARTSCPBTBERECHBGGEOGCPBBMPREPICVERTMVRTTGBI";
>> outputfile outfile2 PROC1 2047;
>>
>> setc outbanknames(3)
>> "HEADSH RFT
>>
>> ECPCSCRCTRPBTBIDCL01TBTRCC01CCPBSHHBSHPBDCPBECPB
>>
>> EVNTFBPMHEVTICHBPARTSCPBTBERECHBGGEOGCPBBMPREPICVERTMVRTTGBI";
>> outputfile outfile3 PROC1 2047;
>>
>> setc outbanknames(4)
>> "HEADSH RFT
>>
>> ECPCSCRCTRPBTBIDCL01TBTRCC01CCPBSHHBSHPBDCPBECPB
>>
>> EVNTFBPMHEVTICHBPARTSCPBTBERECHBGGEOGCPBBMPREPICVERTMVRTTGBI";
>> outputfile outfile4 PROC1 2047;
>>
>> --------------------------------------------------------------------------------------
>>
>>
>> Your removed 3 bosbanks: CALL, HLS ,
>> TRGS, and
>> added RFT TRPB
>>
>> In addition I removed TGEO, target
>> geometry bank
>> and RUNC; run control map information.
>> I am not sure if it is necessary to put
>> these two
>> bosbanks in the list (to be
>> confirmed!). I am
>> really wondering about the issue with the
>> outbanknames length that was not
>> solved. The length
>> that I have in my tcl file is really
>> the limit.
>> But even with your change (if I get it
>> correctly) and
>> without taking off my last two bosbanks
>> it may work!
>> For the change related to the runfile,
>> I will not
>> use it because we must specify it in
>> the tcl
>> file and add some related lines in the
>> cooking
>> scripts that I am using to get the
>> "runext" entries
>> of the CSQL table equal to the file
>> number of
>> each run.
>>
>> Based on the test that I did previously
>> the size
>> of the bos file is ~ 0.8 GB.
>>
>> Best,
>>
>> Lamiaa
>>
>> On Tue, Sep 7, 2010 at 7:40 AM, Stepan
>> Stepanyan
>> <stepanya at jlab.org
>> <mailto:stepanya at jlab.org> <mailto:stepanya at jlab.org
>> <mailto:stepanya at jlab.org>>
>> <mailto:stepanya at jlab.org
>> <mailto:stepanya at jlab.org>
>> <mailto:stepanya at jlab.org
>> <mailto:stepanya at jlab.org>>>> wrote:
>>
>> Hi Lamia,
>>
>> I made some changes to your tcl.
>> First bank
>> list is changed.
>> I remove some banks that are not
>> used any
>> more, like "CALL"
>> bank (raw TDCs for RF, old), instead
>> I put
>> "RFT " if some one
>> wants to have raw TDCs, new, pipeline.
>> I added TRPB, track R1
>> 3-vector/coordinate
>> bank. I remove
>> also scaler banks, I believe they
>> are written
>> out independently
>> for every scaler event. I commented
>> line "set
>> runfile 1", I do not
>> know what it does, I suspect it sets run
>> number #1??
>> I copied the same bank list for 3 other
>> outputs (now from 1 to 4),
>> for four outputs defined in
>> user_xtra.F. Could
>> you cook just one
>> file with this tcl to see what are
>> output
>> sizes are. If they are not
>> exceeding the limit of 2Gb, we may
>> not make
>> several outputs.
>>
>> Regards, Stepan
>>
>>
>> On 9/7/10 2:40 AM, Lamiaa El Fassi
>> wrote:
>>
>> Hi Stepan,
>>
>> I have copied your modified
>> routines and
>> built the new libraries
>> and executable.
>> The new packages reside now at:
>> ~/pass0_nect/.
>>
>> I would like to know after the new
>> modifications if we need to
>> revisit the tcl file and
>> change anything on it like
>> "set trigger_particle_s 22;"
>> instead of
>> "set trigger_particle_s 211;"
>> or anything else?
>>
>> Best regards,
>>
>> Lamiaa
>>
>> PS: I won't be able to attend
>> tomorrow's
>> meeting, I will be in my
>> way back to FermiLab.
>> I can call you later if there is
>> anything
>> that you want to
>> discuss with me.
>>
>>
>> ************************************************************
>> * Lamiaa El Fassi
>> email:
>> elfassi at jlab.org
>> <mailto:elfassi at jlab.org> <mailto:elfassi at jlab.org
>> <mailto:elfassi at jlab.org>>
>> <mailto:elfassi at jlab.org
>> <mailto:elfassi at jlab.org>
>> <mailto:elfassi at jlab.org
>> <mailto:elfassi at jlab.org>>>
>> * Research Associate @ Rutgers
>> University
>> * Phone: (757)
>> 269-7011 // Fax:
>> (757) 269-5703 *
>> Jefferson Lab., 12000 Jefferson
>> Ave. * Suite# 4,
>> MS 12H3
>> * Newport News, VA. 23606
>>
>> ************************************************************
>>
>>
>> On Mon, Sep 6, 2010 at 10:13 AM,
>> Stepan
>> Stepanyan
>> <stepanya at jlab.org
>> <mailto:stepanya at jlab.org> <mailto:stepanya at jlab.org
>> <mailto:stepanya at jlab.org>>
>> <mailto:stepanya at jlab.org
>> <mailto:stepanya at jlab.org>
>> <mailto:stepanya at jlab.org
>> <mailto:stepanya at jlab.org>>>> wrote:
>>
>> Lamiaa and Hovanes,
>>
>> I made few more changes in
>> seb, ana,
>> and user_ana.
>> Routines that I changed are in
>> corresponding directories at
>> /work/clas/disk4/step/eg6/
>>
>> Changes will allow to have
>> neutral
>> software trigger in SEB
>> (in addition to negative and
>> positive
>> triggers) and will enable
>> outputs for 2 or more
>> neutrals. As for
>> now for filling ntuple
>> (fill_seb_nt.F) we have
>> - a negatively charged track
>> - a positively charged track
>> with at
>> least 2 neutrals (in any
>> EC - IC combinations)
>> - at least 1 track in RTPC
>> and at
>> least 2 neutrals in (any
>> EC - IC combinations)
>> For writing bos files, I see
>> several
>> flags are set for
>> different outputs
>> - [1] a negatively charged
>> TB track
>> - [2] a good electron and a
>> positively
>> charged particle (I
>> made a change)
>> - [3] a positively charged
>> track with
>> at least 2 neutrals (in
>> any EC - IC combinations)
>> - [4] at least 1 track in
>> RTPC and at
>> least 2 neutrals in
>> (any EC - IC combinations)
>>
>> I do not think at this pass0
>> cooking
>> we need [2], [3], and
>> [4] as separate files.
>> If file size is not big to
>> fill 2.1Gb,
>> I would prefer to have
>> all these in one file, for now.
>>
>> Regards, Stepan
>>
>>
>> Lamiaa El Fassi wrote:
>>
>> Hi Stepan,
>>
>> The packages reside at:
>> ~claseg6/pass0_ect/
>>
>> Best,
>>
>> Lamiaa
>>
>> ************************************************************
>> * Lamiaa El Fassi
>> email: elfassi at jlab.org
>> <mailto:elfassi at jlab.org> <mailto:elfassi at jlab.org
>> <mailto:elfassi at jlab.org>>
>> <mailto:elfassi at jlab.org
>> <mailto:elfassi at jlab.org>
>> <mailto:elfassi at jlab.org
>> <mailto:elfassi at jlab.org>>>
>> <mailto:elfassi at jlab.org
>> <mailto:elfassi at jlab.org>
>> <mailto:elfassi at jlab.org
>> <mailto:elfassi at jlab.org>>
>> <mailto:elfassi at jlab.org
>> <mailto:elfassi at jlab.org>
>> <mailto:elfassi at jlab.org
>> <mailto:elfassi at jlab.org>>>>
>>
>> * Research Associate @
>> Rutgers
>> University *
>> Phone: (757) 269-7011
>> // Fax:
>> (757) 269-5703
>> *
>> Jefferson Lab., 12000 Jefferson
>> Ave. *
>> Suite# 4, MS 12H3
>> * Newport News, VA. 23606
>>
>> ************************************************************
>>
>>
>> On Sun, Sep 5, 2010 at
>> 7:24 PM,
>> Stepan Stepanyan
>> <stepanya at jlab.org
>> <mailto:stepanya at jlab.org> <mailto:stepanya at jlab.org
>> <mailto:stepanya at jlab.org>>
>> <mailto:stepanya at jlab.org
>> <mailto:stepanya at jlab.org>
>> <mailto:stepanya at jlab.org
>> <mailto:stepanya at jlab.org>>>
>> <mailto:stepanya at jlab.org
>> <mailto:stepanya at jlab.org>
>> <mailto:stepanya at jlab.org
>> <mailto:stepanya at jlab.org>>
>> <mailto:stepanya at jlab.org
>> <mailto:stepanya at jlab.org>
>> <mailto:stepanya at jlab.org
>> <mailto:stepanya at jlab.org>>>>> wrote:
>>
>> Hi Lamiaa,
>>
>> Could you please
>> remind me
>> where are packages
>> that you will build
>> executable
>> for the cooking.
>>
>> Thanks, Stepan
>>
>>
>> On 9/3/10 4:46 PM,
>> Lamiaa El
>> Fassi wrote:
>>
>> Hi Stepan and all,
>>
>> I would like to
>> set up the
>> strategy of the next
>> pass0 cooking
>> based on what we
>> have done
>> earlier
>> on the pass0_v0.
>>
>> 1. List of output
>> files
>> that have been produced:
>>
>> (i) HBOOK
>> files: SEB
>> ntuples and ANAHIST files
>> (ii) ROOT
>> files :
>> CLASTOOL & H2ROOT ntuples
>> (iii) BOS
>> files :
>> Bosbanks format
>> (iv)
>> Helicity_correction files
>> (v) LOG
>> files :
>> ASCII format
>>
>> In the previous
>> cooking,
>> *NONE* of these files was
>> saved on SILO.
>> The files (i) and
>> (iv) were
>> saved on the permanent
>> claseg6 work
>> disk. However,
>> all other
>> files were stored on the
>> auto-manageable
>> work
>> disk.
>>
>> In this cooking,
>> shall I
>> produce the same output
>> formats and save
>> them on the same
>> place?
>>
>> 2. Claseg6 work
>> disk: the
>> process of the same runs
>> list (total of
>> 796 runs) and ~
>> 10 files of
>> each run (still to be
>> confirmed) would amount
>> approximately 1.8
>> TB disk space on
>> the permanent
>> work area (based
>> on 1). For
>> the moment, 88% of a
>> claseg6 disk
>> space is in use
>> and it's
>> partitioned
>> as follow:
>>
>> (i) Previous
>> pass0_v0:
>> 1.8 TB
>> (ii) DC_CALIB
>> files : ~ 437 GB ! files
>> used on the DC
>> calibration by
>> Seema (iii) EC_CALIB files
>> : ~
>> 387 GB ! files used on EC_time
>> calibration by Bayram
>> (iv) ....Other
>> cooking
>> purpose covering... ~ 200 GB
>> Before
>> launching this
>> new pass I need to
>> clean some disk space,
>> so what shall I
>> do with the
>> previous cooking
>> outputs?
>> Please let me know if
>> you have any
>> unused data to
>> remove it.
>>
>> 3. Which farm
>> node shall we
>> use on this cooking;
>> 32 or 64 bit? I
>> was processing
>> recently
>> all the
>> calibration jobs in
>> the 64 bit farm nodes
>> without any
>> problem (at least
>> I didn't
>> hear any
>> complain from
>> anyone!).
>>
>> 4. I have updated
>> the icf
>> package with the new
>> modification that
>> FX did by adding
>> a correction
>> on the vertex
>> position. The
>> new source code reside at
>>
>> ~claseg6/pass0_ect/. I will
>> commit the
>> new changes to
>> the Eg6 CVS
>> branch. The latter
>> doesn't include all
>> the packages that
>> have been
>> modified like
>> seb, icf &
>> trk, is it possible to
>> tag also those
>> packages on the
>> Eg6 branch?
>>
>> Best regards,
>>
>> Lamiaa
>>
>>
>>
>> ************************************************************
>> * Lamiaa El
>> Fassi email:
>> elfassi at jlab.org
>> <mailto:elfassi at jlab.org>
>> <mailto:elfassi at jlab.org
>> <mailto:elfassi at jlab.org>>
>> <mailto:elfassi at jlab.org
>> <mailto:elfassi at jlab.org>
>> <mailto:elfassi at jlab.org
>> <mailto:elfassi at jlab.org>>>
>> <mailto:elfassi at jlab.org
>> <mailto:elfassi at jlab.org>
>> <mailto:elfassi at jlab.org
>> <mailto:elfassi at jlab.org>>
>> <mailto:elfassi at jlab.org
>> <mailto:elfassi at jlab.org>
>> <mailto:elfassi at jlab.org
>> <mailto:elfassi at jlab.org>>>>
>>
>> * Research
>> Associate @
>> Rutgers University
>> * Phone: (757)
>> 269-7011 // Fax: (757) 269-5703
>> *
>> Jefferson Lab., 12000 Jefferson
>> Ave. *
>> Suite# 4, MS 12H3
>> * Newport News,
>> VA. 23606
>>
>>
>> ************************************************************
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: https://mailman.jlab.org/pipermail/eg6_analysis/attachments/20100913/1e2cf142/attachment-0001.html
More information about the Eg6_analysis
mailing list