[g13] cooking g13 pass2

Thu Aug 19 19:28:09 EDT 2010

  Hi Ken,

It looks nice! However, regarding the banks, Franz wrote earlier that 
"the xx1 banks (except EC1) are intermediate banks and can be deleted". 
This would be the SC1, ST1, and STN1 banks. Perhaps we could remove them 
from the list?

Also, it may indeed be a good idea to wait with production until after 
the power outage on Saturday morning. Perhaps there is still some test 
to be run tomorrow?

Cheers,

     Pawel

On 8/19/2010 11:04 AM, Ken Livingston wrote:
> Dear All,
> This describes the output of pass2 cooking. Don't ask about the cooking
> unless you've checked this mail 1st or visited
> http://clasweb.jlab.org/rungroups/g13/wiki/index.php/Pass2_cooking
>
> I believe we're ready to go now with the cooking. Please read below and
> take this last chance to check the outputs from the cooking of
> /mss/clas/g13/data/clas_054392.A04. The "expansion factor" ie. ratio of
> new files on silo after cooking to raw data is 3.65.
>
> I intend to start pass2 properly tomorrow. Please let me know if you
> have any different opinion. I'll be submitting all the A01 files from
> 54010 55147 for starters, and then the remaining AXX files in that range.
>
> After endless discussions on the topic I only removed the banks that
> Franz suggested. The complete BANK list in alphabetical order is:
>
> "CL01" "DC0 " "DCPB" "DSTC" "EC  " "EC1 " "ECHB" "ECPB" "ECPC" "ECPI"
> "ECPO"
> "ECT " "EPIC" "EVNT" "GP_X" "GP_Y" "HBID" "HBTR" "HDPL" "HEAD" "HEVT"
> "MTRK"
> "MVRT" "PART" "RC26" "RFT " "SC  " "SC1 " "SCPB" "SCRC" "SCT " "ST1 "
> "STN1"
> "STPB" "STRE" "TACO" "TAGE" "TAGI" "TAGR" "TBER" "TBID" "TBTR" "TCT "
> "TDPL"
> "TESC" "TGBI" "TGPB" "TRL1" "TRPB" "VERT"
>
>
> The outputs are going to 2 places - the silo and to our clasg13 area on
> the work disks.
>
> Here are the outputs on the silo:
> /mss/clas/g13/production/pass2/v0/BOS/cooked_054392.A04.B00
> /mss/clas/g13/production/pass2/v0/BOS/cooked_054392.A04.B01
> /mss/clas/g13/production/pass2/v0/BOS/cooked_054392.A04.B02
> /mss/clas/g13/production/pass2/v0/PAW/nt_054392_04.hbook
> /mss/clas/g13/production/pass2/v0/TAR/skims_054392_A04.tar
>
> The content of the tar file
> /mss/clas/g13/production/pass2/v0/TAR/skims_054392_A04.tar is:
> ifarml6.kliv>  tar tvf
> /w/cache5202/clas/mss/clas/g13/production/pass2/v0/TAR/skims_054392_A04.tar
> drwxrwxr-x clasg13/clas      0 2010-08-19 07:55:54 1pos1neg1neut/
> -rw-r--r-- clasg13/clas   7821 2010-08-19 07:55:54 1pos1neg1neut/hists.root
> -rw-rw-r-- clasg13/clas     43 2010-08-19 07:55:54
> 1pos1neg1neut/filteroutputs.txt
> -rw-rw-r-- clasg13/clas 415688400 2010-08-19 07:55:54
> 1pos1neg1neut/1pos1neg1neut_054392.A04.B00
> drwxrwxr-x clasg13/clas         0 2010-08-19 08:00:24 2pos1neg/
> -rw-r--r-- clasg13/clas      7598 2010-08-19 08:00:24 2pos1neg/hists.root
> -rw-rw-r-- clasg13/clas        33 2010-08-19 08:00:24
> 2pos1neg/filteroutputs.txt
> -rw-rw-r-- clasg13/clas 325746000 2010-08-19 08:00:24
> 2pos1neg/2pos1neg_054392.A04.B00
> drwxrwxr-x clasg13/clas         0 2010-08-19 08:04:47 2pos2neg/
> -rw-r--r-- clasg13/clas      7596 2010-08-19 08:04:46 2pos2neg/hists.root
> -rw-rw-r-- clasg13/clas        33 2010-08-19 08:04:47
> 2pos2neg/filteroutputs.txt
> -rw-rw-r-- clasg13/clas  54190800 2010-08-19 08:04:46
> 2pos2neg/2pos2neg_054392.A04.B00
> -rw-r--r-- clasg13/clas   4138214 2010-08-19 08:12:10
> strange_k0fix_DST_054392.A04.root
> -rw-r--r-- clasg13/clas   1226211 2010-08-19 08:11:09
> strange_kplus_DST_054392.A04.root
> -rw-r--r-- clasg13/clas 181280488 2010-08-19 08:13:38 POL_054392_A04.root
> -rw-rw-r-- clasg13/clas     11516 2010-08-19 07:48:38 run_054392_A04.log
> -rw-r--r-- clasg13/clas  11534336 2010-08-19 07:48:38
> anahist_054392_A04.hbook
> -rw-rw-r-- clasg13/clas       419 2010-08-19 08:14:21
> slavamon_054392_A04.dat
> -rw-rw-r-- clasg13/clas     43639 2010-08-19 08:14:21
> slavamon_054392_A04_pp.dat
> -rw-r--r-- clasg13/clas      3913 2010-08-19 08:14:21
> slavamon_054392_A04.root
> -rw-rw-r-- clasg13/clas      5717 2010-08-19 08:16:00 job.err
> -rw-rw-r-- clasg13/clas     64109 2010-08-19 08:16:00 job.out
>
>
> ... and on the work disk
>
> /work/clas/clasg13/pass2/v0/AnaHistFiles/
> 11524608 anahist_054392_A04.hbook
>
> /work/clas/clasg13/pass2/v0/dariamon
> 396800 dariamon_054392_A04.root
>
> /work/clas/clasg13/pass2/v0/GFLUX
> 396800 gflux054392.a04.hbook.gz
>    20992 gflux54392_eb.a04.dat
>     2560 gflux54392_erg2.a04.dat
>     4096 gflux54392_erg.a04.dat
>     3072 gflux54392_tc.a04.dat
>
> /work/clas/clasg13/pass2/v0/LOGS
>    7168 run_054392_A04.err
> 12800 run_054392_A04.log
> 65536 run_054392_A04.out
>
> /work/clas/clasg13/pass2/v0/skims
> 4193280 strange_k0fix_DST_054392.A04.root
> 1312768 strange_kplus_DST_054392.A04.root
>
> /work/clas/clasg13/pass2/v0/skims/1pos1neg1neut
> 415415808 1pos1neg1neut_054392.A04.B00
>
> /work/clas/clasg13/pass2/v0/skims/2pos1neg
> 325581824 2pos1neg_054392.A04.B00
>
> /work/clas/clasg13/pass2/v0/2pos2neg
> 54221824 2pos2neg_054392.A04.B00
>
> /work/clas/clasg13/pass2/v0/slavamon
>    1536 slavamon_054392_A04.dat
>    5120 slavamon_054392_A04.root
>
> /work/clas/clasg13/pass2/v0/TRIP
> 3072 clas_054392.A04.trip
>
>
> And, based on the cooking of /mss/clas/g13/data/clas_054392.A04
> the total per cook job going onto the clasg13 work disk is ~813M.
> Most of that comes from Paul's 2 bigger skims which total ~740M
>
> There's 1.5T availble on /work/clas/clasg13. That's about enough for the
> skimmed output of about 30 runs, which is about isn't much! Paul, do you
> have a plan for these?
>
> The "expansion factor" ie ratio of new files on silo after cooking to
> raw data is 3.65, based on the cooking of /mss/clas/g13/data/clas_054392.A04
>
>
> Cheers,
> Ken
>
>
>
>
>