[Solid_software] test singularity container with gemc

[Zhiwen Zhao]

Hi, All

Jlab scicomp has helped figure out how to run singularity farm job.
I have example scripts at
/volatile/halla/solid/sim/solid_gemc/PVDIS_LD2_JLAB_VERSION_1.3/pass6
It still use singularity-2.3.1 installed under /usr/bin/singularity

Jlab scicomp has installed singularity-2.3.1 and singularity-2.4 on 
ifarm1402 only for test
They can be used after run "module load singularity-2.4" or
"module load singularity-2.3.2"
You can stop using them by "module rm singularity-2.4" or
"module rm singularity-2.3.2"
They are not on farm nodes, so we can't run jobs yet.
singularity-2.4 can run singularity-2.3 images and has many new features 
and we should use it instead of 2.3

There is ongoing effort to build layered docker image
https://jleic-docdb.jlab.org/DocDB/0001/000150/001/Containers%20%2B%20JLEIC.pdf
It's basically working, but need some fine tuning.

Zhiwen

On 8/14/2017 6:14 PM, Zhiwen Zhao wrote:
> Hi, All
> 
> jlab ifarm and farm start to support singularity container and I made a 
> singularity container for gemc for you to test.
> Let's see if this can be a standard way to run simulation on any machine 
> for consistent result without need for installation
> container.
> 
> If you are new to container and singularity, read 
> http://singularity.lbl.gov/ and
> http://singularity.lbl.gov/faq
> 
> ==== test it on ifarm ========================
> ssh -X ifarm
> cd /group/solid/solid_svn/solid_gemc2
> singularity shell 
> /group/solid/apps/singularity_jlab_version_1.3_centos7_20170811.img
> (enter container. current dir, you home dir and your login script are 
> shared between the host and container)
> source /apps/jlab_root/setup
> setenv LD_LIBRARY_PATH ${GEMC}/source:${LD_LIBRARY_PATH}
> setenv SoLID_GEMC /group/solid/solid_svn/solid_gemc2
> setenv PATH ${SoLID_GEMC}/source/${GEMC_VERSION}:${PATH}
> cd script
> solid_gemc solid_SIDIS_He3_full.gcard
> exit (leave container)
> ==============================================
> Please don't submit any farm job yet as jlab scicomp is fixing a problem 
> running singularity farm job
> 
> ==== install singularity and test it on your machine ==========
> quick way to install singularity on linux
> 
> wget --no-check-certificate 
> https://github.com/singularityware/singularity/releases/download/2.3.1/singularity-2.3.1.tar.gz 
> 
> tar singularity-2.3.1.tar.gz
> cd singularity-2.3.1
> ./configure
> make dist
> rpmbuild -ta singularity-2.3.1.tar.gz
> sudo yum install 
> ~/rpmbuild/RPMS/x86_64/singularity-2.3.1-0.1.el7.centos.x86_64.rpm
> 
> for windows and mac
> http://singularity.lbl.gov/install-windows
> http://singularity.lbl.gov/install-mac
> 
> download the image
> scp 
> jlab_username at ftp.jlab.org:/group/solid/apps/singularity_jlab_version_1.3_centos7_20170811.img 
> ./
> then check out solid SVN
> do your test
> ================================================================
> 
> Please let me know any problem you see and any suggestion
> 
> Thanks
> 
> Zhiwen
> 
> 
> 
> _______________________________________________
> Solid_software mailing list
> Solid_software at jlab.org
> https://mailman.jlab.org/mailman/listinfo/solid_software