[g13] g13b Runs

[Ken Livingston]

Hi Nick,
I've resubmitted 54765 - 54789 as requested.

I've just written a script to get some lists of missing files for failed 
jobs etc.
There are 777 files with missing B files - ie job failed after user_ana 
completed, but before jputting all to silo.
I'll submit these tomorrow.

There 6472 where there were no B files - either because they weren't 
submitted or the job failed.
I'll submit these after the other jobs complete.

These lists are in
~clasg13/cookdir/missing_part_g13b
~clasg13/cookdir/missing_all_g13b


TRIP files. For the jobs which timed out the .tar files with trips, 
gflux etc didn't get to the silo.  The trips also get copied to 
/w/work/clasg13 before user_ana starts so some are there 
(/w/work/clasg13/pass2/v1/TRIP) However, this filled up because 
autodeletion running on ifarml4 stopped. (I think this machine is now 
gone?). The script is now running again on ifarml6. (do crobtab -l as 
clasg13 to see this).  If you're running on the cooked BOS files you can 
run sync as part of your job - this will generate the trip file for you. 
Like this:

 >sync -c -t -s10 cooked_*

will make a trip file using the name of the 1st cooked file with .trip 
appended.

Cheers,
Ken

ps. hope to work on the pol tables again tomorrow.





On 05/04/2011 08:33 PM, Nicholas Zachariou wrote:
> Hi Ken, Thanks for your email.
>
> I am actually using the cooked BOS files (not the skims) for my analysis since I am looking for events with one positive particle.... I was just taking a second look and it turns out that the lower photon energy bin and the last have a lot of the B02 files missing through out the runs ... (along with several skims that I need to retrieve the trip files from).
>
> Do we have an estimate when we will have g13b completely cooked (a few files missing here and there is fine, but entire runs reduce my statistic significantly, especially at the higher photon energy)?
>
> I remember that Chuck volunteered to resubmit for cooking failed jobs. Is this something that I need to talk to him?
>
> Thanks,
> -Nick
>
> On May 4, 2011, at 12:16 PM, Ken Livingston wrote:
>
>    
>> Hi Nick,
>>
>> Has a nice relaxing few days before going back to work.
>>
>> It looks like a load of jobs timed out. I think this happened after the BOS files went to the silo in most cases. I'll check up. If that is the case then it's easier and faster to run on the cooked files, but the script needs to be modified.
>>
>> The script was probabyl running on ifarml4, which seems to be gone. I'll have a look tomorrow morning.
>>
>> Cheers,
>> Ken
>>
>>
>> On 05/03/2011 05:37 PM, Nicholas Zachariou wrote:
>>      
>>> Hi Ken,
>>>
>>> How are you? Hope you returned back home safely.
>>>
>>> I was skimming data from the last two photon energy bins of g13b and found out that a lot of runs have most (if not all) of the files missing. Specifically, run ranges 54808-54864, and runs 54990, 54709, 54711, 54723 have more than 1/3 of their files missing and in most cases all of them. I was wondering if we could resubmit these. All the rest photon energy bins look pretty much complete (except a few files here and there), except the 1.3 phonon energy bins which I havent looked at yet.
>>>
>>> On a different note, clasg13 work disk is full. Paul mentioned something that the script that is responsible of deleting old files probably has the directory hard-wired and it is probably looking at a wrong directory. Is this something we could easily fix?
>>>
>>> On the meeting today we established that we could in principle recook the run range of bad ST calibration 54765 - 54789 (recalibration is already done), even though we wont gain too much from it. The idea is to add these runs with the ones that failed (see above)...
>>>
>>> Let me know what you think,
>>> Thanks,
>>> Nick
>>>        
>>
>> -- 
>> =======================================================
>> Ken Livingston
>>
>> Dept. of Physics&   Astronomy,        Tel: +44 141 330 6428
>> University of Glasgow,               Fax: +44 141 330 5889
>> Glasgow G12 8QQ.
>> Scotland. UK.
>> =======================================================
>>
>>      
>    


-- 
=======================================================
Ken Livingston

Dept. of Physics&  Astronomy,        Tel: +44 141 330 6428
University of Glasgow,               Fax: +44 141 330 5889
Glasgow G12 8QQ.
Scotland. UK.
=======================================================