[Clas_offline] minutes from OLTWG meeting Nov 12, 2009
Stepan Stepanyan
stepanya at jlab.org
Mon Nov 16 22:24:36 EST 2009
Can we also get the attachment.
Thanks, Stepan
Eugene Pasyuk wrote:
> Thanks, Johann, this is useful.
>
> The good news is that over this period of time there was no overlap
> between changes in CVS and SVN.
>
> When did you do the sync between the two last time?
> We can generate a list of changes in CVS since then and update a few
> files in svn.
>
> -Eugene
>
> Johann Goetz wrote:
>
>> attached are a list of changes made to the SVN repository since
>> September 1st. It is too long to put in the email directly.
>> -Johann.
>>
>> On Fri, 2009-11-13 at 16:38 -0500, Stepan Stepanyan wrote:
>>
>>> Eugene,
>>>
>>> Interesting statistics. Do you have any thing similar for svn
>>> for the past 2 months?
>>>
>>> Stepan
>>>
>>> Eugene Pasyuk wrote:
>>>
>>>> Here are some statistics of cvs activity. I looked over the same period
>>>> of time from September 16 till today. All the information is from
>>>> commitlog file which keeps all commits done in repository since day one,
>>>> May 12, 1997. It has 42186 records total.
>>>>
>>>> So, since September 16 2009:
>>>>
>>>> Total number of commits 66.
>>>> The majority of the changes are for Current Run web page.
>>>>
>>>> There are 18 commits related to software.
>>>> Out of these 12 are in packages ported to svn.
>>>> Details for these 12:
>>>>
>>>> 1 commit in ClasTool. (Sep 28)
>>>>
>>>> 5 commits in packages/utilities/sync. (Oct 9) They were done in one day,
>>>> almost simultaneously. Can count as 1 commit.
>>>>
>>>> 5 commits in packages/eloss Sep30 Oct2 Oct22 Oct 23 Oct 29
>>>> There is ongoing development of this package for FROST target.
>>>>
>>>> 1 commit in packages/seb done yesterday.
>>>>
>>>> These are all changes over the last two months.
>>>>
>>>> -Eugene
>>>>
>>>>
>>>>
>>>>
>>>>
>>>> On Fri, 2009-11-13 at 09:03 +0100, Marco Ripani wrote:
>>>>
>>>>
>>>>> Hi Stepan,
>>>>> yes, it is necessary to put more efforts to fix everything and then take
>>>>> an action. More help is needed to port the missing packages and test
>>>>> that they build and work fine (there are still many, as we see from
>>>>> Eugene's new test).
>>>>> But currently there is also the problem of keeping CVS and SVN in sync
>>>>> for packages that have been ported (e.g. user_ana). Johann is doing that
>>>>> using scripts but he also has to do some manual adjustments. To avoid
>>>>> this, the sooner we start using packages in the new system, the better.
>>>>>
>>>>> Marco
>>>>>
>>>>> Stepan Stepanyan wrote:
>>>>>
>>>>>
>>>>>> Hi Marco,
>>>>>>
>>>>>> I am not sure how to read your email. What do you mean "freeze CVS
>>>>>> asap, not today".
>>>>>> At the software meeting couple of month ago I though we came to
>>>>>> agreement that we
>>>>>> will discuss cvs vs svn after some experience will be gained. Several
>>>>>> groups expressed
>>>>>> interest to test svn/scon (e1-dvcs, eg1-dvcs, frost ...). So far only
>>>>>> Eugene made an attempt
>>>>>> to use svn and scon and as I can see from his email he succeeded using
>>>>>> the staff that
>>>>>> was polished by g12 for about a year, but there are still things that
>>>>>> either missing or not
>>>>>> ready yet. Why not put more efforts to fix every thing and then take
>>>>>> an action?
>>>>>>
>>>>>> Stepan
>>>>>>
>>>>>> Marco Ripani wrote:
>>>>>>
>>>>>>
>>>>>>> Hi,
>>>>>>> need to freeze CVS but asap, not today. Need to first figure out what
>>>>>>> the best time is, with minimum impact on the other run groups, in
>>>>>>> particular due to the missing packages.
>>>>>>>
>>>>>>> Marco
>>>>>>>
>>>>>>> Johann Goetz wrote:
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>> Thursday, Nov 12, 2009: SCons Build System and CLAS 6 Software
>>>>>>>> 12:00 pm Eastern
>>>>>>>> Cebaf Center A-110
>>>>>>>> Call in information: Dial 1-877-643-6951
>>>>>>>> International access: 1-302-607-2017
>>>>>>>> Passcode: 24630562#
>>>>>>>>
>>>>>>>>
>>>>>>>> RPMs, yum, and all that (Maurizio)
>>>>>>>> * creating RPM (installable pre-compiled packages with dependency
>>>>>>>> tree) of the CLAS software is a great idea.
>>>>>>>> * these RPMs can served with a JLab yum server so that
>>>>>>>> installation on a Fedora or Red Hat (or CentOS) system could be
>>>>>>>> done with a line like:
>>>>>>>> yum install clas6-reconstruction clas6-generators etc...
>>>>>>>> * CLAS12 has already implemented this on several flavors of Linux
>>>>>>>> *
>>>>>>>> Eugene's Review of SCons Build System
>>>>>>>> * Generally favourable review. Eugene points out that there are
>>>>>>>> many packages missing that are needed.
>>>>>>>> * Many packages will have to copied over directories from CVS.
>>>>>>>> * sconstruct files will have to be made.
>>>>>>>> * gamecock (TOF calib program) has some problems
>>>>>>>> (ROOT/GUI
>>>>>>>> related)
>>>>>>>> * CLASTool should be fairly easy to get to work now that
>>>>>>>> ROOT dictionaries can be built properly.
>>>>>>>> From: Eugene Pasyuk <pasyuk at jlab.org>
>>>>>>>> To: CLAS Offline <clas_offline at jlab.org>
>>>>>>>> Subject: [Clas_offline] testing svn/scons
>>>>>>>> Date: Wed, 16 Sep 2009 10:29:31 -0400 (07:29 PDT)
>>>>>>>>
>>>>>>>> Hi all,
>>>>>>>>
>>>>>>>> I tried new software tools today on ifarm. Here are some first
>>>>>>>> impressions about this experience.
>>>>>>>>
>>>>>>>> I followed prescription given on the Wiki:
>>>>>>>> http://clasweb.jlab.org/wiki/index.php/Building_CLAS_libraries_with_SCons_on_ifarm
>>>>>>>>
>>>>>>>> It took 20 minutes get the entire source tree source from svn.
>>>>>>>> Then I tried to build. The very first attempt failed. I figured out
>>>>>>>> that
>>>>>>>> the problem was in suggested environment setup file. I modified a
>>>>>>>> couple
>>>>>>>> of lines in it (2 minutes to figure out and fix). After that I made a
>>>>>>>> second attempt to run scons. This time it worked. It took about 3
>>>>>>>> minutes to build all clas libraries and a just few executables by
>>>>>>>> default:
>>>>>>>> a1c countbos g12Anal gsim_bat tagraw view-kaon view-tag
>>>>>>>> bosdump g12skim skim user_ana view-st view-tracks
>>>>>>>>
>>>>>>>> Out of these only few (a1c, gsim_bat, countbos, bosdump, user_ana and
>>>>>>>> tagraw) are of interest to general CLAS user. The rest seem to be g12
>>>>>>>> specific.
>>>>>>>> After doing some archeology in sconstruct files for about a half an
>>>>>>>> hour
>>>>>>>> and making some modifications to them here and there (I have zero
>>>>>>>> knowledge of scons or python at the moment) I managed to build a few
>>>>>>>> more utilities, particularly DC calibration tools trk_mon, trk_mon_lite
>>>>>>>> and dc3. I failed to build start counter calibration code. I was
>>>>>>>> able to
>>>>>>>> build fdump. gflux would not build because of the compiler errors. I
>>>>>>>> wonder how g12 managed to build it in new build scheme from the source
>>>>>>>> in svn. ced would not build because of the compiler errors too.
>>>>>>>> TOF calibration source code is in svn, but it was not modified for
>>>>>>>> scons
>>>>>>>> at all. It was imported as is from cvs with all Makefiles which will
>>>>>>>> not
>>>>>>>> work because of the different tree structure. sc_mon is missing. As was
>>>>>>>> mentioned at the meeting ec timing calibration utilities are not
>>>>>>>> included as several other general purpose utilities. For some reason
>>>>>>>> gsim_int and gpp are not included.
>>>>>>>>
>>>>>>>> To summarize, I succeeded in building most of the libraries and a few
>>>>>>>> executables. Quite a few tools are missing (gsim_int, gpp, some
>>>>>>>> calibration tools). Some programs which build fine with make would not
>>>>>>>> build with scons (gflux, ced ...?) I don't know if those executables I
>>>>>>>> built are working, I had not had a chance to test them yet. I have not
>>>>>>>> tried to build any of the event generators with scons.
>>>>>>>> By the way, there are only three of them in svn, while we have more in
>>>>>>>> cvs.
>>>>>>>>
>>>>>>>> All in all, svn works just fine, apart from having different directory
>>>>>>>> structure. scons works for some pieces of the software and does not for
>>>>>>>> some
>>>>>>>> others. Perhaps it is not quite ready for the prime time yet. Some
>>>>>>>> essential
>>>>>>>> utilities are not working yet in new build. -Eugene
>>>>>>>>
>>>>>>>>
>>>>>>>> What We Should Do Now
>>>>>>>> * Hire some undergraduates to move packages from CVS to SVN and
>>>>>>>> add sconstruct files to build these packages.
>>>>>>>> * Armand Fraiser was a big help initially with the move to
>>>>>>>> SVN/SCons and he could continue to do so.
>>>>>>>> * There is some detailed help information already, it probably
>>>>>>>> needs a bit of reorganization on the wiki.
>>>>>>>> * Should we have a list of programs/libraries that should be
>>>>>>>> moved
>>>>>>>> from CVS to SVN (Armand already created an spreadsheet that has
>>>>>>>> some of this information. It will be sent to Craig and he will
>>>>>>>> look into it.
>>>>>>>> * We need to freeze CVS today.
>>>>>>>>
>>>>>>>> _______________________________________________
>>>>>>>> Clas_offline mailing list
>>>>>>>> Clas_offline at jlab.org
>>>>>>>> https://mailman.jlab.org/mailman/listinfo/clas_offline
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>> _______________________________________________
>>>> Clas_offline mailing list
>>>> Clas_offline at jlab.org
>>>> https://mailman.jlab.org/mailman/listinfo/clas_offline
>>>>
>>>>
>>> _______________________________________________
>>> Clas_offline mailing list
>>> Clas_offline at jlab.org
>>> https://mailman.jlab.org/mailman/listinfo/clas_offline
>>>
>>> ------------------------------------------------------------------------
>>>
>>> _______________________________________________
>>> Clas_offline mailing list
>>> Clas_offline at jlab.org
>>> https://mailman.jlab.org/mailman/listinfo/clas_offline
>>>
> _______________________________________________
> Clas_offline mailing list
> Clas_offline at jlab.org
> https://mailman.jlab.org/mailman/listinfo/clas_offline
>
More information about the Clas_offline
mailing list