<html>
<head>
<meta content="text/html; charset=utf-8" http-equiv="Content-Type">
</head>
<body text="#000000" bgcolor="#FFFFFF">
Hi Simon,<br>
<br>
You're right. This first version of benchmark tests is maybe not
really relevant.<br>
Currently, it requires exact reproduction of the reference result
(no statistical fluctuations are allowed). In principle, if we
explicitly set the random number seed, we should expect to get the
same output, but sometimes floating point operations are slightly
different between different platforms, each have their different
rounding errors.
<br>
<br>
As David Boersma suggested last week (thanks David <span
class="moz-smiley-s3"><span> ;-) </span></span>), the benchmark
code needs to be updated to reflect that. It should then not test
for exact equality, but instead do a statistical test and only
report failure if the discrepancy is statistically too large.<br>
<br>
I hope I could very soon provide a much more adapted version of
benchmark code on GitHub.<br>
<br>
In the meanwhile, you can directly run the benchmark tests located
in benchPET and benchSPECT folders and compare your results to those
mentioned here :
<a class="moz-txt-link-freetext" href="http://wiki.opengatecollaboration.org/index.php/PET_and_SPECT_benchmarks">http://wiki.opengatecollaboration.org/index.php/PET_and_SPECT_benchmarks</a><br>
<br>
Hope this helps,<br>
<br>
Cheers<br>
<br>
Albertine<br>
<br>
<div class="moz-cite-prefix">Le 27/04/2017 17:11, Kirchhof, Simon a
écrit :<br>
</div>
<blockquote cite="mid:1493305957778.86977@dkfz-heidelberg.de"
type="cite">
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<style type="text/css" style="display:none"><!--P{margin-top:0;margin-bottom:0;} --></style>
<p>Hi Gate users,</p>
<p><br>
</p>
<p>I have a fresh installation of Gate v8.0, together with:</p>
<p><br>
</p>
<p>- Geant4 version 10.03.p01</p>
<p>- ROOT version 06/08/06</p>
<p><br>
</p>
<p>My system is Ubuntu 16.04., gcc is version 5.4.0. I followed
the instruction on
<a moz-do-not-send="true"
href="http://wiki.opengatecollaboration.org/index.php/Validating_Installation">http://wiki.opengatecollaboration.org/index.php/Validating_Installation</a>
to validate my installation using "make test".
However, 5/7 of the benchmark tests fail, the log file is
attached. If you look on
</p>
<p><a moz-do-not-send="true"
href="http://my.cdash.org/index.php?project=GATE">http://my.cdash.org/index.php?project=GATE,</a> you
find that many of the nightly builds don't pass the tests
either. Hence my questions:</p>
<p><br>
</p>
<p>- Has anyone managed to pass all the tests with his Gate v8.0
installation?</p>
<p>- Or Is this a common problem?</p>
<p>- If not, how would I troubleshoot my installation?<br>
</p>
<p><br>
</p>
<p>Hoping for feedback,</p>
<p>Simon</p>
<p><br>
</p>
<p><br>
</p>
<div id="Signature">
<div name="divtagdefaultwrapper" style="margin:0px;
font-family:Calibri,Arial,Helvetica,sans-serif">
<p><font face="Arial,Helvetica,sans-serif">--</font></p>
<p><font face="Arial,Helvetica,sans-serif">Simon Kirchhof<br>
</font></p>
<p>Master Student<br>
</p>
<p><font face="Arial,Helvetica,sans-serif">Division of Medical
Physics in Radiation Oncology (E040)<br>
<br>
German Cancer Research Center (DKFZ)<br>
Foundation under Public Law<br>
Im Neuenheimer Feld 280<br>
69120 Heidelberg<br>
Germany<br>
Phone: +49 6221 42-2438</font></p>
</div>
</div>
<br>
<br>
<fieldset class="mimeAttachmentHeader"></fieldset>
<br>
<pre wrap="">_______________________________________________
Gate-users mailing list
<a class="moz-txt-link-abbreviated" href="mailto:Gate-users@lists.opengatecollaboration.org">Gate-users@lists.opengatecollaboration.org</a>
<a class="moz-txt-link-freetext" href="http://lists.opengatecollaboration.org/mailman/listinfo/gate-users">http://lists.opengatecollaboration.org/mailman/listinfo/gate-users</a></pre>
</blockquote>
<br>
</body>
</html>