[Gate-users] benchmark

Wed May 23 18:26:39 CEST 2007

Hi,

I have similar results to Antigoni. I have run the SPECT benchmark 3 times
on my computer and obtained:

Percentage of photons whose last scattered event occured in collimator:
0.35%,0.36%,0.35%    Average=0.353%

Percentage of photons whose last scattered event occured in crystal:
6.43%,6.62%,6.62%    Average=6.56%

Similarly, all of the rest of my results agree reasonably well with the
benchmark values. One thing I have noticed: from the file
results_benchmark.pdf (in $GATEHOME/benchmarks/benchmark_SPECT), which
seems to be an example data from a single run of the benchmark, the data
'detected percentage of counts' is well out of the values given on the
Gate website or in the install guide (ie those expressed as VALUE +/- SD).
Maybe this shows that the errors given are a bit optimistic? I'm not sure.
At any rate, I am also curious if this is a problem.

Cheers,

Daniel

> Dear all,
> I would also like to take this opportunity to say that we are experiencing
> some disagreement between the optimal results suggested by Gate developers
> and the once obtained by myself (on a Mac Intel Duo platform) and by a
> colleague on a LINUX platform (don't remember the exact details). Our
> results agree with each other, but disagree with the suggested values. For
> example:
> * Percentage of photons whose last scattered event occured in collimator:
> 0.35% (benchmark value is 2.10%).
> * Percentage of photons whose last scattered event occured in crystal:
> 6.43% (benchmark value is 8.50%). I'm out by -24.38%!
>  etc.
> Some values agree well though, for example the number of detected counts.
> We tried running the same benchmark on different versions of gate with
> similar results.
>
> Should we worry? Is it something that occurs often, but is being
> overlooked?
>
> I'll appreciate any comments
>
> Antigoni
>
>>>> "Suhaili Zakaria" <suhailiz at gmail.com> 05/23/07 6:40 AM >>>
> Hi,
> Thanks for your help.
>
> I can run benchmark_spectra and benchmark_projections now.
> But the results obtained was different from the results showed in the
> manual.
> Is it allright, or something wrong somewhere?
> Followed are the messages:
>
> stolen:~/gate/gate_v3.0.0/benchmarks/benchmarkSPECT> ./benchmark_spectra
> gateSingles.dat
>
> Enter the lower energy threshold (MeV)
>
> 0.02
>
> Lower energy threshold is 0.020000 MeV
>
> Enter the upper energy threshold (MeV)
>
> 0.19
>
> Upper energy threshold is 0.190000 MeV
>
> Enter the number of energy windows
>
> 100
>
> Energy range will be divided into 100 energy windows
>
> Enter the number of scattering volume (max is 10)
>
> 6
>
> 6 scattering volumes will be considered
>
> Enter the first four letters of the scattering volume number 1
>
> shie
>
> Enter the first four letters of the scattering volume number 2
>
> coll
>
> Enter the first four letters of the scattering volume number 3
>
> comp
>
> Enter the first four letters of the scattering volume number 4
>
> tabl
>
> Enter the first four letters of the scattering volume number 5
>
> movs
>
> Enter the first four letters of the scattering volume number 6
>
> phan
>
> The scattering volumes that will be considered are the following:
>
> shie
>
> coll
>
> comp
>
> tabl
>
> movs
>
> phan
>
> Beginning of processing
> End of processing
>
>
>
> File fich_p correponds to the Unscattered spectrum
>
> File fich_c correponds to the photons which have scattered in the crystal
>
> File fich_t correponds to the total ernergy spectrum
>
> File fich_1 correspond to the photon whose last scatter interaction was
> in
> the shie volume
>
> File fich_2 correspond to the photon whose last scatter interaction was
> in
> the coll volume
>
> File fich_3 correspond to the photon whose last scatter interaction was
> in
> the comp volume
>
> File fich_4 correspond to the photon whose last scatter interaction was
> in
> the tabl volume
>
> File fich_5 correspond to the photon whose last scatter interaction was
> in
> the movs volume
>
> File fich_6 correspond to the photon whose last scatter interaction was
> in
> the phan volume
>
> File name fich_o1 corresponds to the first order scatter
>
> File name fich_o2 corresponds to the second order scatter
>
> File name fich_o3 corresponds to the third order scatter
>
> File name fich_o4 corresponds to the fourth order scatter
>
> File name fich_o5 corresponds to the scatter order greater than 4
>
> Number of counts for the total energy spectrum = 36041
>
> Number of counts for the Unscattered spectrum =12809
>
> Number of counts for the total scatter spectrum =23232
>
> Number of counts for the crystal scatter spectrum =2392
>
> Number of counts for the shie scatter spectrum = 1
>
> Number of counts for the coll scatter spectrum = 107
>
> Number of counts for the comp scatter spectrum = 456
>
> Number of counts for the tabl scatter spectrum = 1081
>
> Number of counts for the movs scatter spectrum = 5123
>
> Number of counts for the phan scatter spectrum = 0
>
> Number of counts for the order1 scatter spectrum = 11176
>
> Number of counts for the order2 scatter spectrum = 6120
>
> Number of counts for the order3 scatter spectrum = 3004
>
> Number of counts for the order4 scatter spectrum = 1500
>
> Number of counts for scatter orders greater than 4 spectrum = 1432
>
>
>
> ##########################################################################
>
>
>
> Number of detected counts from 0.020 to 0.190 MeV : 36041
>
> Unscattered events (percentage of total counts)= 35.54
>
> Scatter in the crystal (percentage of total counts) = 6.64
>
> Scatter in the shie volume (percentage of total scatter) = 0.00
>
> Scatter in the coll volume (percentage of total scatter) = 0.30
>
> Scatter in the comp volume (percentage of total scatter) = 1.27
>
> Scatter in the tabl volume (percentage of total scatter) = 3.00
>
> Scatter in the movs volume (percentage of total scatter) = 14.21
>
> Scatter in the phan volume (percentage of total scatter) = 0.00
>
> Scatter order1 (percentage of total scatter) = 48.11
>
> Scatter order2 (percentage of total scatter) = 26.34
>
> Scatter order3 (percentage of total scatter) = 12.93
>
> Scatter order4 (percentage of total scatter) = 6.46
>
> Scatter orders greater than 4 (percentage of total scatter) = 6.16
>
>
>
> ##########################################################################
>
>
> For benchmark_projections;
>
> stolen:~/gate/gate_v3.0.0/benchmarks/benchmarkSPECT>
> ./benchmark_projections
> gateSingles.dat
>
> Enter the number of rows and columns of the images to be created
>
> 128
>
> Image size is 128 x 128
>
> Enter the lower energy threshold (MeV)
>
> 0.02
>
> Lower energy threshold is 0.020000 MeV
>
> Enter the upper energy threshold (MeV)
>
> 0.19
>
> Upper energy threshold is 0.190000 MeV
>
> Enter the size of the pixels (mm)
>
> 0.904
>
> Pixels are 0.904000 mm x 0.904000 mm x
>
> Beginning of processing
>
> End of processing
>
>
> Number of detected events in the image of primary and scattered photons =
> 17619
>
> Number of primary events in the image of primary photons= 6201
>
> Number of scattered events  in the image of scattered photons = 11418
>
>
>
> File Total correponds to the image of primary and scattered photons
>
> File Primary correponds to the image of primary photons
>
> File Scatter correponds to the image of scattered photons
>
>
> Appreciate your reply and help.
> Many thanks,
> S
>
> On 5/19/07, Daniel Woodsworth <danieljw at phas.ubc.ca> wrote:
>>
>> Hi Suhaili,
>>
>> See below for ideas.
>>
>> Cheers,
>>
>> Daniel
>>
>> > Hi all,
>> > Can someone help me with these problems?
>> >
>> > When I tried to run benchmark macros (i.e. SPECTbench.mac and
>> > benchmarkPET.mac), these problems occur:
>> >
>> >      1.   There is no file for benchSPECT.root.
>> >
>> Are you sure you loaded root using root benchSPECT.root ? That tells
>> root
>> to 'mount' benchSPECT.root.
>> > When I typed root [0] .x benchSPECT.C
>> >
>> > I have this message: Error in <TFile::TFile> file does not exist
>> >
>> >                                  Error: illegal pointer to class
>> object
>> > Singles 0*0 133 benchSPECT.C:21
>> >
>> >
>> >
>> >    1. When tried to complie benchmark_spectra.c using:
>> >
>> > gcc -o benchmark_spectra benchmark_spectra.c –lm
>> >
>> > I got this message:
>> >
>> > benchmark_spectra.c: In function *:
>> >
>> > benchmark_spectra.c:768: error: missing terminating " character
>> >
>> > benchmark_spectra.c:769: error: * undeclared (first use in this
>> function)
>> >
>> > benchmark_spectra.c:769: error: (Each undeclared identifier is
>> reported
>> > only
>> > once
>> >
>> > benchmark_spectra.c:769: error: for each function it appears in.)
>> >
>> > benchmark_spectra.c:769: error: missing terminating " character
>> >
>> > benchmark_spectra.c:771: error: syntax error before * token
>> >
>> I had this exact same problem. If you open up benchmark_spectra.c in a
>> text editor and go to probably line 768 (but check to be sure) you
>> should
>> see that the line ends and then 769 is a new line. But it should be one
>> continuous piece of code. But the compiler is "seeing" a new line of
>> code,
>> which of course is nonsense. If you just delete out any spacing between
>> the two lines (but make sure to preserve the syntax) and recompile it
>> should work.
>>
>> >
>> >
>> >    1. Same goes with benchmark_spectra.c
>> >
>> > benchmark_projections.c: In function *:
>> >
>> > benchmark_projections.c:662: error: missing terminating " character
>> >
>> > benchmark_projections.c:663: error: * undeclared (first use in this
>> > function)
>> >
>> > benchmark_projections.c:663: error: (Each undeclared identifier is
>> > reported
>> > only once
>> >
>> > benchmark_projections.c:663: error: for each function it appears in.)
>> >
>> > benchmark_projections.c:663: error: syntax error before *
>> >
>> > benchmark_projections.c:663: error: stray * in program
>> >
>> > benchmark_projections.c:663: error: missing terminating " character
>> >
>> exactly the same problem and solution as for benchmark_spectra.c
>>
>> >
>> >
>> >    1. Does x. file.C file always appear after simulation runs? And how
>> to
>> >    convert .root file to .C file?
>> >
>> >
>> >    1. For benchmarkPET.mac, are there no files for benchmark_spectra.c
>> >    and benchmark_projections.c? Why?
>> >
>> >
>>
>> when I did this I just ran
>>
>> danieljw$ root benchSPECT.root
>>
>> root [0] .x benchSPECT.C
>>
>> it should work (just make sure you have appropriate files in your
>> working
>> directory)
>>
>>
>> > I really appreciate your help and explanation. Looking forward to your
>> > replies.
>> > Many thanks,
>> > S
>> >
>> > * *
>> > _______________________________________________
>> > Gate-users mailing list
>> > Gate-users at lists.healthgrid.org
>> > http://lists.healthgrid.org/mailman/listinfo/gate-users
>> >
>>
>>
>>
>
>
> The Institute of Cancer Research: Royal Cancer Hospital, a charitable
> Company Limited by Guarantee, Registered in England under Company No.
> 534147 with its Registered Office at 123 Old Brompton Road, London SW7
> 3RP.
>
> This e-mail message is confidential and for use by the addressee only.  If
> the message is received by anyone other than the addressee, please return
> the message to the sender by replying to it and then delete the message
> from your computer and network.
>