[Eg6_analysis] Pass1_v1 Readiness
Stepan Stepanyan
stepanya at jlab.org
Thu Apr 4 15:38:51 EDT 2013
Hello Lamiaa,
Great job!
Thanks a lot for all your efforts!
Regards, Stepan
On 4/4/13 3:35 PM, Lamiaa El Fassi wrote:
> Hi all,
>
> The cooking of 6 GeV data set was done this morning. It was nice that
> the cooking of different beam energy data was done in three weeks
> compared to a "Pass1_v0" which took more than two months.
> That of course due to the upgrade of the batch farm nodes.
> Currently, I am reprocessing about 1% jobs that failed in the first
> pass of 6 GeV data. Once that is done, and to simplify the analysis
> task, I will reprocess the files that had some issues with the
> helicity_cor array length in the SEB ntuple. This issue was discovered
> and fixed by the end of last week. For more details, please refer to
> today's meeting minute (this link
> <https://clasweb.jlab.org/rungroups/lowq/wiki/index.php/Meeting_on_April_4_at_10:00am>).
>
>
> Thank you,
>
> Lamiaa
>
>
> ************************************************************
> * Lamiaa El Fassi email: lamiaa11 at fnal.gov
> <mailto:lamiaa11 at fnal.gov>
> * Research Associate @ Rutgers University
> * Phone: (630) 840-4861
> * Fermilab, Aspen East #105
> * Batavia, IL. 60510
> ************************************************************
>
>
> On Mon, Mar 25, 2013 at 12:22 AM, Lamiaa El Fassi <lamiomar at gmail.com
> <mailto:lamiomar at gmail.com>> wrote:
>
> Hi all,
>
> As an update of the ongoing Pass1_v1 cooking status, the 5.7 data
> processing was
> done Friday morning. I realized after our last weekly meeting that
> I forgot processing
> eleven runs, which were taken in the second 5.7 GeV running
> period. The cooking of
> the 6 GeV dataset started Friday afternoon. Based on the batch
> farm processing rate
> over this weekend, I believe the 6 GeV cooking can be done in two
> weeks (if the auger
> traffic will not dramatically change)! In addition, I may need
> extra few days to process
> any crashed files which are missing in Silo.
>
> For a quick analysis check, the 6 GeV HROOT files are saved in
> volatile disk under the
> pass1_v1 directory, /volatile/clas/claseg6/pass1_v1/6gev/HROOT/.
> Please notify me if you
> notice any missing or bad files while checking this data or other
> datasets as well (except
> the files that I mentioned in the last weekly meeting linked here
> <https://clasweb.jlab.org/rungroups/lowq/wiki/index.php/Cooking_Notes>).
>
>
>
> Thank you,
>
> Lamiaa
>
> ************************************************************
> * Lamiaa El Fassi email: lamiaa11 at fnal.gov
> <mailto:lamiaa11 at fnal.gov>
> * Research Associate @ Rutgers University
> * Phone: (630) 840-4861 <tel:%28630%29%20840-4861>
> * Fermilab, Aspen East #105
> * Batavia, IL. 60510
> ************************************************************
>
>
> On Thu, Mar 21, 2013 at 12:10 PM, Lamiaa El Fassi
> <lamiomar at gmail.com <mailto:lamiomar at gmail.com>> wrote:
>
> Hi all,
>
> As a reference, I put all information about the Pass1_v1
> cooking in the cooking notes link:
> https://clasweb.jlab.org/rungroups/lowq/wiki/index.php/Cooking_Notes,
> that can be accessed
> from the main EG6 wiki page. For your convenience, I am
> linking also to these cooking notes
> the weekly minutes that may have some information about the
> ongoing cooking status.
>
>
> Best regards,
>
> Lamiaa
>
> ************************************************************
> * Lamiaa El Fassi email: lamiaa11 at fnal.gov
> <mailto:lamiaa11 at fnal.gov>
> * Research Associate @ Rutgers University
> * Phone: (630) 840-4861 <tel:%28630%29%20840-4861>
> * Fermilab, Aspen East #105
> * Batavia, IL. 60510
> ************************************************************
>
>
> On Mon, Mar 18, 2013 at 3:40 PM, Stepan Stepanyan
> <stepanya at jlab.org <mailto:stepanya at jlab.org>> wrote:
>
> Hello Lamiaa,
>
> Thanks for the update and putting all these together.
> Monitoring page looks good, very useful.
>
> Regards, Stepan
>
>
> On 3/18/13 4:56 AM, Lamiaa El Fassi wrote:
>> Hi All,
>>
>> I have updated the EG6 monitoring web-page with the link
>> of the ongoing
>> Pass1_v1 cooking of the 1.2 GeV dataset (this link
>> <http://www.jlab.org/Hall-B/secure/eg6/cooking/online_sql/monitor.html>).
>> As you will notice I
>> made some changes to the structure of our monitoring
>> page. Currently in
>> the top right frame you can pick from the cooking monitor
>> table either the
>> cooking passes or some of the processed calibration check
>> rounds (I removed
>> bunch of old calibration links). Once you click on any
>> pass in the first frame,
>> its name will be displayed in the second frame where you
>> can check the plots
>> of the monitoring variables.
>>
>> Up to now, roughly 75% of the 1.2 GeV cooking is done.
>> However, based on a
>> decision made this weekend, the real 1.2 GeV production
>> runlist is the one attached
>> (only 29 runs out of 117 that I sent earlier). Please
>> don't pay too much attention
>> to the fluctuation that you may see in these monitoring
>> plots outside the region from
>> 61448 to 61481 because all the rest of runs, according to
>> the RTPC experts, were
>> unstable (fluctuation of the RTPC HV..etc). In case you
>> prefer to show only the
>> production region in these plots, I can change them.
>> Please tell me your preferences?
>>
>> Once this cooking is done, I will process the Hydrogen
>> data (not "production" runs)
>> followed first by the 5.7 GeV dataset. By the way, since
>> I am saving the HRoot ntuples
>> on this volatile directory:
>> /volatile/clas/claseg6/pass1_v1/1p2gev/HROOT/, and in case
>> anyone will start looking to these data please let me
>> know if you will find any corrupted/bad
>> files to reprocess them.
>>
>> Thank you,
>>
>> Lamiaa
>>
>> ************************************************************
>> * Lamiaa El Fassi email: lamiaa11 at fnal.gov
>> <mailto:lamiaa11 at fnal.gov>
>> * Research Associate @ Rutgers University
>> * Phone: (630) 840-4861 <tel:%28630%29%20840-4861>
>> * Fermilab, Aspen East #105
>> * Batavia, IL. 60510
>> ************************************************************
>>
>>
>> On Thu, Mar 14, 2013 at 5:11 PM, Stepan Stepanyan
>> <stepanya at jlab.org <mailto:stepanya at jlab.org>> wrote:
>>
>> Hello Lamiaa,
>>
>> Seems to me everything is well planned. I think any
>> run we have
>> with production settings of RTPC (HV and gas) that
>> do not have
>> any obvious problem we should cook.
>> Personally I do not have preference for CLASTOOL
>> ntuples, if it
>> is not too much trouble for you I would prefer to
>> generate them.
>>
>> Thanks, Stepan
>>
>> On 3/14/13 5:31 PM, Lamiaa El Fassi wrote:
>>> Hi All,
>>>
>>> As a readiness of our next Pass1_v1 cooking, I would
>>> like to check with you some information before start
>>> processing the data.
>>> Like Pass1_v0, I will first process the 1.2 GeV
>>> data. Its run-list is attached. I have split this
>>> list into two to separate the special
>>> 1H runs from others. I am thinking to process the
>>> Hydrogen data afterwards to store it in Silo under
>>> the 1.2 GeV directory, like
>>> /mss/clas/eg6/production/pass1_v1/1p2gev/1H. In such
>>> case, it will be easy to jcache it if it's needed
>>> for any study. Do you think
>>> it's worthy to do that?
>>> All other data sets will be stored in Silo under
>>> directories tagged with the associated beam energy.
>>> I am attaching also the list
>>> of different dataset runs, which I previously used.
>>>
>>> In addition, please have a look to the attached tcl
>>> file and let me know if any modification is needed.
>>> As usual, all calibration banks
>>> are turned off, even the RTPC ones (TPC and TPCC).
>>> If you have any new preferences, I will be happy to
>>> change it!
>>>
>>> In this cooking, I am willing to produce the regular
>>> output files listed below:
>>> 1. SEB ntuples,
>>> 2. HROOT ntuples,
>>> 3. CLASTOOL ntuples, ! Not sure if it
>>> is still required!
>>> 4. BOS files
>>> 5. ANAHIST files
>>> 6. Helicity correction text files,
>>> 7. LOG files
>>>
>>> Due to the size of our 1.2 GeV data set, I can save
>>> its HROOT (Anahist/LOG for debugging) files in our
>>> permanent volatile disk.
>>> Hence, it will be easy to access and analyze the new
>>> processed data afterwards. However, this feature may
>>> not be possible for
>>> the other data sets (at least for the 6 GeV data!)
>>>
>>> Last but not least, the new processed data will be
>>> monitored in our CSQL web-page under a new
>>> table/bullet "Pass1_v1". The latter
>>> will be quite similar to the latest 1.2 GeV test
>>> table epass1_v11
>>> <http://www.jlab.org/Hall-B/secure/eg6/cooking/online_sql/monitor.html>.
>>>
>>> Please feel free to send me any comments or
>>> suggestions concerning the proposed cooking plan and
>>> tools.
>>>
>>> Best regards,
>>>
>>> Lamiaa
>>>
>>> ************************************************************
>>> * Lamiaa El Fassi email: lamiaa11 at fnal.gov
>>> <mailto:lamiaa11 at fnal.gov>
>>> * Research Associate @ Rutgers University
>>> * Phone: (630) 840-4861 <tel:%28630%29%20840-4861>
>>> * Fermilab, Aspen East #105
>>> * Batavia, IL. 60510
>>> ************************************************************
>>>
>>>
>>>
>>>
>>>
>>> _______________________________________________
>>> Eg6_analysis mailing list
>>> Eg6_analysis at jlab.org <mailto:Eg6_analysis at jlab.org>
>>> https://mailman.jlab.org/mailman/listinfo/eg6_analysis
>>
>> _______________________________________________
>> Eg6_analysis mailing list
>> Eg6_analysis at jlab.org <mailto:Eg6_analysis at jlab.org>
>> https://mailman.jlab.org/mailman/listinfo/eg6_analysis
>>
>>
>
>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: https://mailman.jlab.org/pipermail/eg6_analysis/attachments/20130404/c78f0501/attachment-0001.html
More information about the Eg6_analysis
mailing list