[Solid_software] test singularity container with gemc

[Zhiwen Zhao]

Hi, All

I update the instruction for testing container here
https://hallaweb.jlab.org/wiki/index.php/Solid_Software#on_container
container hasn't changed.

Zhiwen

On 11/1/2017 6:52 PM, Zhiwen Zhao wrote:
> Hi, All
> 
> Jlab scicomp has helped figure out how to run singularity farm job.
> I have example scripts at
> /volatile/halla/solid/sim/solid_gemc/PVDIS_LD2_JLAB_VERSION_1.3/pass6
> It still use singularity-2.3.1 installed under /usr/bin/singularity
> 
> Jlab scicomp has installed singularity-2.3.1 and singularity-2.4 on 
> ifarm1402 only for test
> They can be used after run "module load singularity-2.4" or
> "module load singularity-2.3.2"
> You can stop using them by "module rm singularity-2.4" or
> "module rm singularity-2.3.2"
> They are not on farm nodes, so we can't run jobs yet.
> singularity-2.4 can run singularity-2.3 images and has many new features 
> and we should use it instead of 2.3
> 
> There is ongoing effort to build layered docker image
> https://jleic-docdb.jlab.org/DocDB/0001/000150/001/Containers%20%2B%20JLEIC.pdf 
> 
> It's basically working, but need some fine tuning.
> 
> Zhiwen
> 
> On 8/14/2017 6:14 PM, Zhiwen Zhao wrote:
>> Hi, All
>>
>> jlab ifarm and farm start to support singularity container and I made 
>> a singularity container for gemc for you to test.
>> Let's see if this can be a standard way to run simulation on any 
>> machine for consistent result without need for installation
>> container.
>>
>> If you are new to container and singularity, read 
>> http://singularity.lbl.gov/ and
>> http://singularity.lbl.gov/faq
>>
>> ==== test it on ifarm ========================
>> ssh -X ifarm
>> cd /group/solid/solid_svn/solid_gemc2
>> singularity shell 
>> /group/solid/apps/singularity_jlab_version_1.3_centos7_20170811.img
>> (enter container. current dir, you home dir and your login script are 
>> shared between the host and container)
>> source /apps/jlab_root/setup
>> setenv LD_LIBRARY_PATH ${GEMC}/source:${LD_LIBRARY_PATH}
>> setenv SoLID_GEMC /group/solid/solid_svn/solid_gemc2
>> setenv PATH ${SoLID_GEMC}/source/${GEMC_VERSION}:${PATH}
>> cd script
>> solid_gemc solid_SIDIS_He3_full.gcard
>> exit (leave container)
>> ==============================================
>> Please don't submit any farm job yet as jlab scicomp is fixing a 
>> problem running singularity farm job
>>
>> ==== install singularity and test it on your machine ==========
>> quick way to install singularity on linux
>>
>> wget --no-check-certificate 
>> https://github.com/singularityware/singularity/releases/download/2.3.1/singularity-2.3.1.tar.gz 
>>
>> tar singularity-2.3.1.tar.gz
>> cd singularity-2.3.1
>> ./configure
>> make dist
>> rpmbuild -ta singularity-2.3.1.tar.gz
>> sudo yum install 
>> ~/rpmbuild/RPMS/x86_64/singularity-2.3.1-0.1.el7.centos.x86_64.rpm
>>
>> for windows and mac
>> http://singularity.lbl.gov/install-windows
>> http://singularity.lbl.gov/install-mac
>>
>> download the image
>> scp 
>> jlab_username at ftp.jlab.org:/group/solid/apps/singularity_jlab_version_1.3_centos7_20170811.img 
>> ./
>> then check out solid SVN
>> do your test
>> ================================================================
>>
>> Please let me know any problem you see and any suggestion
>>
>> Thanks
>>
>> Zhiwen
>>
>>
>>
>> _______________________________________________
>> Solid_software mailing list
>> Solid_software at jlab.org
>> https://mailman.jlab.org/mailman/listinfo/solid_software
> _______________________________________________
> Solid_software mailing list
> Solid_software at jlab.org
> https://mailman.jlab.org/mailman/listinfo/solid_software