<html><head><meta http-equiv="Content-Type" content="text/html charset=utf-8"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class="">Richard,<div class=""><br class=""></div><div class="">By default, Scons calculates a md5 checksum of the target file's contents to determine if it has changed.</div><div class="">This takes longer for larger target files, such is the case when debug symbols are turned on.</div><div class="">Also, it will clearly take longer the more plugins you have; you probably noticed it after more plugins were added to sim-recon.</div><div class=""><br class=""></div><div class="">David’s pull request which was merged today reduces the average size of target files substantially, which should speed up the md5 check.</div><div class=""><br class=""></div><div class="">The behavior of how scons decides to rebuild can be customized but it is not clear to me if we should modify it after David’s PR.</div><div class="">See the documentation on the Decider at</div><div class=""><a href="http://www.scons.org/doc/HTML/scons-user/ch06.html#idm139837621900832" class="">http://www.scons.org/doc/HTML/scons-user/ch06.html#idm139837621900832</a></div><div class=""><br class=""></div><div class="">-Nathan</div><div class=""><br class=""><div><blockquote type="cite" class=""><div class="">On Mar 23, 2017, at 2:05 PM, Richard Jones <<a href="mailto:richard.t.jones@uconn.edu" class="">richard.t.jones@uconn.edu</a>> wrote:</div><br class="Apple-interchange-newline"><div class=""><div dir="ltr" class="">Natthan,<div class=""><br class=""></div><div class="">How can it matter if I have debug on or off, if there is nothing to rebuild and nothing to do, just check that everything is up to date and return a "nothing to do" message? Up until a few weeks ago, this was very fast on my Centos 6 machine. Now it is about 20 minutes and pretty much saturates my io to the nfs server over that period. The process is "scons" (no compilers or ld or installers are ever invoked) so I cannot see what it is doing, except that it is deep in some python loop and reading very slowly through every .so and .o file in sim-recon.</div><div class=""><br class=""></div><div class="">-Richard J.</div></div><div class="gmail_extra"><br class=""><div class="gmail_quote">On Thu, Mar 23, 2017 at 10:13 AM, Nathan Sparks <span dir="ltr" class=""><<a href="mailto:nsparks@jlab.org" target="_blank" class="">nsparks@jlab.org</a>></span> wrote:<br class=""><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">Hi Richard,<br class="">
<br class="">
Here are some quick tests using sim-recon commit a5474aa on my (non-Farm) RHEL 7 machine, with a very light load:<br class="">
1. If I build with debug symbols off (8.5 min. w/ 8 threads) and then run “scons -j8 install DEBUG=0” in the src directory,<br class="">
it takes ~ 15 s for scons to report back that the “install” is up to date.<br class="">
<br class="">
2. If I rebuild with debug symbols on (19 min. w/ 8 threads) and then run “scons -j8 install” in the src directory,<br class="">
it takes ~ 1.5 min. to output that the installation is up to date.<br class="">
<br class="">
I having been doing my builds with DEBUG=0 for a long time now, so I am used to the quicker builds/checks.<br class="">
<br class="">
Maybe the longer time it takes to check a debug build in combination with a heavy system load can explain your observation.<br class="">
<br class="">
-Nathan<br class="">
<div class=""><div class="h5"><br class="">
> On Mar 23, 2017, at 7:23 AM, Richard Jones <<a href="mailto:richard.t.jones@uconn.edu" class="">richard.t.jones@uconn.edu</a>> wrote:<br class="">
><br class="">
> Hello all,<br class="">
><br class="">
> Did someone check in a change that might have caused this? A few weeks back, if I did "scons install" in sim-recon and there was nothing to do (no updates since last build) it would return with success and report up-to-date within less than 1 minute. Now it takes forever (I hit ctrl-C after 20 minutes) to discover that it has nothing to do.<br class="">
><br class="">
> -Richard J.<br class="">
</div></div>> ______________________________<wbr class="">_________________<br class="">
> Halld-offline mailing list<br class="">
> <a href="mailto:Halld-offline@jlab.org" class="">Halld-offline@jlab.org</a><br class="">
> <a href="https://mailman.jlab.org/mailman/listinfo/halld-offline" rel="noreferrer" target="_blank" class="">https://mailman.jlab.org/<wbr class="">mailman/listinfo/halld-offline</a><br class="">
<br class="">
</blockquote></div><br class=""></div>
</div></blockquote></div><br class=""></div></body></html>