[Halld-offline] [EXTERNAL] CCDB interruption today

Beni Zihlmann zihlmann at jlab.org
Wed Feb 19 16:51:13 EST 2020


worked a minute ago now it does not anymore

Error [1190]: in [MySQLDataProvider::GetAssignmentShort] Type table was 
not found: '/GEOMETRY/TRDGEM_HDDS.xml'
JANA ERROR>> Failed to get XML from Calib DB for 
/GEOMETRY/TRDGEM_HDDS.xml! Geometry info not available!!


On 2/19/20 4:02 PM, Mark Ito wrote:
> I should have said this explicitly: you can go ahead and start writing 
> new constants now.
>
> On 2/19/20 3:45 PM, Mark Ito wrote:
>> People,
>>
>> Marty has complete the restore from backup of the CCDB. Recall that 
>> any constants written between 3:45 am and a bit ago have been lost. 
>> This restoration appears to have propagated correctly to all replicas 
>> (e.g., hallddb-farm). Please let me know if you see problems using 
>> the CCDB from the MySQL servers.
>>
>> One note. There were a few active connections to the server when the 
>> restore was attempted. Those connections (about 20 of them) had to be 
>> terminated by hand. Most of these jobs probably went through without 
>> any bad effects, but some of them may have crashed and will have to 
>> be restarted.
>>
>>   -- Mark
>>
>> On 2/19/2020 3:09 PM, Mark Ito wrote:
>>> People,
>>>
>>> To make sure we restore all of the data from this incident we are 
>>> rolling back to a backup of the CCDB database done at 3:45 am this 
>>> morning. Please refrain from writing new constants to the CCDB until 
>>> this is done (on the master server, hallddb.jlab.org). Anything 
>>> written now will be lost. Marty Wise of the computer center is doing 
>>> the restore and should be done in an hour or so.
>>>
>>>   -- Mark
>>>
>>> On 2/19/2020 2:44 PM, Sean Dobbs wrote:
>>>> Hi Offliners,
>>>>
>>>> Due to the temporary disappearance of a CCDB table, jobs
>>>> reconstructing raw data that accessed the master CCDB would have
>>>> crashed from about 11 am - 2:30 pm today.  This should be fixed now.
>>>> Please let me know if you see any other problems.
>>>>
>>>> Cheers,
>>>> Sean
>>>> _______________________________________________
>>>> Halld-offline mailing list
>>>> Halld-offline at jlab.org
>>>> https://mailman.jlab.org/mailman/listinfo/halld-offline
>>> _______________________________________________
>>> Halld-offline mailing list
>>> Halld-offline at jlab.org
>>> https://mailman.jlab.org/mailman/listinfo/halld-offline
>> _______________________________________________
>> Halld-offline mailing list
>> Halld-offline at jlab.org
>> https://mailman.jlab.org/mailman/listinfo/halld-offline
> _______________________________________________
> Halld-offline mailing list
> Halld-offline at jlab.org
> https://mailman.jlab.org/mailman/listinfo/halld-offline

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://mailman.jlab.org/pipermail/halld-offline/attachments/20200219/68b3542a/attachment-0002.html>


More information about the Halld-offline mailing list