[Eg6_analysis] Pass1_v1 Readiness
Lamiaa El Fassi
lamiomar at gmail.com
Thu Apr 4 15:35:00 EDT 2013
Hi all,
The cooking of 6 GeV data set was done this morning. It was nice that the
cooking of different beam energy data was done in three weeks compared to a
"Pass1_v0" which took more than two months.
That of course due to the upgrade of the batch farm nodes.
Currently, I am reprocessing about 1% jobs that failed in the first pass of
6 GeV data. Once that is done, and to simplify the analysis task, I will
reprocess the files that had some issues with the helicity_cor array length
in the SEB ntuple. This issue was discovered and fixed by the end of last
week. For more details, please refer to today's meeting minute (this
link<https://clasweb.jlab.org/rungroups/lowq/wiki/index.php/Meeting_on_April_4_at_10:00am>).
Thank you,
Lamiaa
************************************************************
* Lamiaa El Fassi email: lamiaa11 at fnal.gov
* Research Associate @ Rutgers University
* Phone: (630) 840-4861
* Fermilab, Aspen East #105
* Batavia, IL. 60510
************************************************************
On Mon, Mar 25, 2013 at 12:22 AM, Lamiaa El Fassi <lamiomar at gmail.com>wrote:
> Hi all,
>
> As an update of the ongoing Pass1_v1 cooking status, the 5.7 data
> processing was
> done Friday morning. I realized after our last weekly meeting that I
> forgot processing
> eleven runs, which were taken in the second 5.7 GeV running period. The
> cooking of
> the 6 GeV dataset started Friday afternoon. Based on the batch farm
> processing rate
> over this weekend, I believe the 6 GeV cooking can be done in two weeks
> (if the auger
> traffic will not dramatically change)! In addition, I may need extra few
> days to process
> any crashed files which are missing in Silo.
>
> For a quick analysis check, the 6 GeV HROOT files are saved in volatile
> disk under the
> pass1_v1 directory, /volatile/clas/claseg6/pass1_v1/6gev/HROOT/. Please
> notify me if you
> notice any missing or bad files while checking this data or other datasets
> as well (except
> the files that I mentioned in the last weekly meeting linked here<https://clasweb.jlab.org/rungroups/lowq/wiki/index.php/Cooking_Notes>
> ).
>
>
> Thank you,
>
> Lamiaa
>
> ************************************************************
> * Lamiaa El Fassi email: lamiaa11 at fnal.gov
> * Research Associate @ Rutgers University
> * Phone: (630) 840-4861
> * Fermilab, Aspen East #105
> * Batavia, IL. 60510
> ************************************************************
>
>
> On Thu, Mar 21, 2013 at 12:10 PM, Lamiaa El Fassi <lamiomar at gmail.com>wrote:
>
>> Hi all,
>>
>> As a reference, I put all information about the Pass1_v1 cooking in the
>> cooking notes link:
>> https://clasweb.jlab.org/rungroups/lowq/wiki/index.php/Cooking_Notes,
>> that can be accessed
>> from the main EG6 wiki page. For your convenience, I am linking also to
>> these cooking notes
>> the weekly minutes that may have some information about the ongoing
>> cooking status.
>>
>>
>> Best regards,
>>
>> Lamiaa
>>
>> ************************************************************
>> * Lamiaa El Fassi email: lamiaa11 at fnal.gov
>> * Research Associate @ Rutgers University
>> * Phone: (630) 840-4861
>> * Fermilab, Aspen East #105
>> * Batavia, IL. 60510
>> ************************************************************
>>
>>
>> On Mon, Mar 18, 2013 at 3:40 PM, Stepan Stepanyan <stepanya at jlab.org>wrote:
>>
>>> Hello Lamiaa,
>>>
>>> Thanks for the update and putting all these together.
>>> Monitoring page looks good, very useful.
>>>
>>> Regards, Stepan
>>>
>>>
>>> On 3/18/13 4:56 AM, Lamiaa El Fassi wrote:
>>>
>>> Hi All,
>>>
>>> I have updated the EG6 monitoring web-page with the link of the ongoing
>>> Pass1_v1 cooking of the 1.2 GeV dataset (this link<http://www.jlab.org/Hall-B/secure/eg6/cooking/online_sql/monitor.html>).
>>> As you will notice I
>>> made some changes to the structure of our monitoring page. Currently in
>>> the top right frame you can pick from the cooking monitor table either
>>> the
>>> cooking passes or some of the processed calibration check rounds (I
>>> removed
>>> bunch of old calibration links). Once you click on any pass in the first
>>> frame,
>>> its name will be displayed in the second frame where you can check the
>>> plots
>>> of the monitoring variables.
>>>
>>> Up to now, roughly 75% of the 1.2 GeV cooking is done. However, based on
>>> a
>>> decision made this weekend, the real 1.2 GeV production runlist is the
>>> one attached
>>> (only 29 runs out of 117 that I sent earlier). Please don't pay too much
>>> attention
>>> to the fluctuation that you may see in these monitoring plots outside
>>> the region from
>>> 61448 to 61481 because all the rest of runs, according to the RTPC
>>> experts, were
>>> unstable (fluctuation of the RTPC HV..etc). In case you prefer to show
>>> only the
>>> production region in these plots, I can change them. Please tell me your
>>> preferences?
>>>
>>> Once this cooking is done, I will process the Hydrogen data (not
>>> "production" runs)
>>> followed first by the 5.7 GeV dataset. By the way, since I am saving the
>>> HRoot ntuples
>>> on this volatile directory:
>>> /volatile/clas/claseg6/pass1_v1/1p2gev/HROOT/, and in case
>>> anyone will start looking to these data please let me know if you will
>>> find any corrupted/bad
>>> files to reprocess them.
>>>
>>> Thank you,
>>>
>>> Lamiaa
>>>
>>> ************************************************************
>>> * Lamiaa El Fassi email: lamiaa11 at fnal.gov
>>> * Research Associate @ Rutgers University
>>> * Phone: (630) 840-4861
>>> * Fermilab, Aspen East #105
>>> * Batavia, IL. 60510
>>> ************************************************************
>>>
>>>
>>> On Thu, Mar 14, 2013 at 5:11 PM, Stepan Stepanyan <stepanya at jlab.org>
>>> wrote:
>>>
>>>> Hello Lamiaa,
>>>>
>>>> Seems to me everything is well planned. I think any run we have
>>>> with production settings of RTPC (HV and gas) that do not have
>>>> any obvious problem we should cook.
>>>> Personally I do not have preference for CLASTOOL ntuples, if it
>>>> is not too much trouble for you I would prefer to generate them.
>>>>
>>>> Thanks, Stepan
>>>>
>>>> On 3/14/13 5:31 PM, Lamiaa El Fassi wrote:
>>>>
>>>> Hi All,
>>>>
>>>> As a readiness of our next Pass1_v1 cooking, I would like to check with
>>>> you some information before start processing the data.
>>>> Like Pass1_v0, I will first process the 1.2 GeV data. Its run-list is
>>>> attached. I have split this list into two to separate the special
>>>> 1H runs from others. I am thinking to process the Hydrogen data
>>>> afterwards to store it in Silo under the 1.2 GeV directory, like
>>>> /mss/clas/eg6/production/pass1_v1/1p2gev/1H. In such case, it will be
>>>> easy to jcache it if it's needed for any study. Do you think
>>>> it's worthy to do that?
>>>> All other data sets will be stored in Silo under directories tagged
>>>> with the associated beam energy. I am attaching also the list
>>>> of different dataset runs, which I previously used.
>>>>
>>>> In addition, please have a look to the attached tcl file and let me
>>>> know if any modification is needed. As usual, all calibration banks
>>>> are turned off, even the RTPC ones (TPC and TPCC). If you have any new
>>>> preferences, I will be happy to change it!
>>>>
>>>> In this cooking, I am willing to produce the regular output files
>>>> listed below:
>>>> 1. SEB ntuples,
>>>> 2. HROOT ntuples,
>>>> 3. CLASTOOL ntuples, ! Not sure if it is still required!
>>>> 4. BOS files
>>>> 5. ANAHIST files
>>>> 6. Helicity correction text files,
>>>> 7. LOG files
>>>>
>>>> Due to the size of our 1.2 GeV data set, I can save its HROOT
>>>> (Anahist/LOG for debugging) files in our permanent volatile disk.
>>>> Hence, it will be easy to access and analyze the new processed data
>>>> afterwards. However, this feature may not be possible for
>>>> the other data sets (at least for the 6 GeV data!)
>>>>
>>>> Last but not least, the new processed data will be monitored in our
>>>> CSQL web-page under a new table/bullet "Pass1_v1". The latter
>>>> will be quite similar to the latest 1.2 GeV test table epass1_v11<http://www.jlab.org/Hall-B/secure/eg6/cooking/online_sql/monitor.html>
>>>> .
>>>>
>>>> Please feel free to send me any comments or suggestions concerning the
>>>> proposed cooking plan and tools.
>>>>
>>>> Best regards,
>>>>
>>>> Lamiaa
>>>>
>>>> ************************************************************
>>>> * Lamiaa El Fassi email: lamiaa11 at fnal.gov
>>>> * Research Associate @ Rutgers University
>>>> * Phone: (630) 840-4861
>>>> * Fermilab, Aspen East #105
>>>> * Batavia, IL. 60510
>>>> ************************************************************
>>>>
>>>>
>>>>
>>>>
>>>>
>>>> _______________________________________________
>>>> Eg6_analysis mailing listEg6_analysis at jlab.orghttps://mailman.jlab.org/mailman/listinfo/eg6_analysis
>>>>
>>>>
>>>> _______________________________________________
>>>> Eg6_analysis mailing list
>>>> Eg6_analysis at jlab.org
>>>> https://mailman.jlab.org/mailman/listinfo/eg6_analysis
>>>>
>>>>
>>>
>>>
>>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: https://mailman.jlab.org/pipermail/eg6_analysis/attachments/20130404/fbe1fa66/attachment.html
More information about the Eg6_analysis
mailing list