[Gate-users] Gate v8.0 test/validation fails

[Albertine Dubois]

Hi Simon,

You're right. This first version of benchmark tests is maybe not really 
relevant.
Currently, it requires exact reproduction of the reference result (no 
statistical fluctuations are allowed). In principle, if we explicitly 
set the random number seed, we should expect to get the same output, but 
sometimes floating point operations are slightly different between 
different platforms, each have their different rounding errors.

As David Boersma suggested last week (thanks David ;-) ), the benchmark 
code needs to be updated to reflect that. It should then not test for 
exact equality, but instead do a statistical test and only report 
failure if the discrepancy is statistically too large.

I hope I could very soon provide a much more adapted version of 
benchmark code on GitHub.

In the meanwhile, you can directly run the benchmark tests located in 
benchPET and benchSPECT folders and compare your results to those 
mentioned here : 
http://wiki.opengatecollaboration.org/index.php/PET_and_SPECT_benchmarks

Hope this helps,

Cheers

Albertine

Le 27/04/2017 17:11, Kirchhof, Simon a écrit :
>
> Hi Gate users,
>
>
> I have a fresh installation of Gate v8.0, together with:
>
>
> - Geant4 version 10.03.p01
>
> - ROOT version 06/08/06
>
>
> My system is Ubuntu 16.04., gcc is version 5.4.0. I followed the 
> instruction on 
> http://wiki.opengatecollaboration.org/index.php/Validating_Installation to 
> validate my installation using "make test". However, 5/7 of the 
> benchmark tests fail, the log file is attached. If you look on
>
> http://my.cdash.org/index.php?project=GATE, 
> <http://my.cdash.org/index.php?project=GATE> you find that many of the 
> nightly builds don't pass the tests either. Hence my questions:
>
>
> - Has anyone managed to pass all the tests with his Gate v8.0 
> installation?
>
> - Or Is this a common problem?
>
> - If not, how would I troubleshoot my installation?
>
>
> Hoping for feedback,
>
> Simon
>
>
>
> --
>
> Simon Kirchhof
>
> Master Student
>
> Division of Medical Physics in Radiation Oncology (E040)
>
> German Cancer Research Center (DKFZ)
> Foundation under Public Law
> Im Neuenheimer Feld 280
> 69120 Heidelberg
> Germany
> Phone: +49 6221 42-2438
>
>
>
>
> _______________________________________________
> Gate-users mailing list
> Gate-users at lists.opengatecollaboration.org
> http://lists.opengatecollaboration.org/mailman/listinfo/gate-users

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.opengatecollaboration.org/mailman/private/gate-users/attachments/20170428/ec0241bb/attachment.html>