[Gate-users] writing output files

[Josh Knowland]

Hi Bryan – thanks a bunch, very good ideas.
I’m typically simulating gamma cameras, so singles are what I’m most interested in. I’ll try a ramdisk, though. That seems like it should speed up the sim.

-josh



From: Gate-users <gate-users-bounces at lists.opengatecollaboration.org> On Behalf Of Bryan McIntosh
Sent: Wednesday, January 6, 2021 8:26 AM
To: gate-users at lists.opengatecollaboration.org
Subject: Re: [Gate-users] writing output files

Hi Josh,

I did some benchmarking work in 2018 looking at the impact of the Spectre/Meltdown exploits on GATE simulation time; since those impacted I/O operations, I ran them on a RAM disk to remove my hard drive speed as a limiting factor. I've found that the following helps:

1) Remove hits or singles from the ROOT file output if you are simulating a PET system. In most simulations Hits aren't necessary, and if you are only using coincidences for creating projection data then you don't necessarily need the singles either. This also dramatically saves on disk space!

2) Since you have plenty of RAM, you can use a RAM disk as your output device. I used the guide at https://www.techrepublic.com/article/how-to-use-a-ramdisk-on-linux/, substituting 2 GB for whatever size of output data you needed. Once I created the RAM disk, I set my output path to it in the macro and everything worked seamlessly. This is a bit more dangerous since if the system crashes (unlikely) or if you lose power (depends on where you're located) you can lose some data, but it does offer a dramatic speed increase if you're running into storage speed limits.

I hope that this helps!

-Bryan McIntosh

On Wed, Jan 6, 2021 at 1:13 AM <gate-users-request at lists.opengatecollaboration.org<mailto:gate-users-request at lists.opengatecollaboration.org>> wrote:
Send Gate-users mailing list submissions to
        gate-users at lists.opengatecollaboration.org<mailto:gate-users at lists.opengatecollaboration.org>

To subscribe or unsubscribe via the World Wide Web, visit
        http://lists.opengatecollaboration.org/mailman/listinfo/gate-users
or, via email, send a message with subject or body 'help' to
        gate-users-request at lists.opengatecollaboration.org<mailto:gate-users-request at lists.opengatecollaboration.org>

You can reach the person managing the list at
        gate-users-owner at lists.opengatecollaboration.org<mailto:gate-users-owner at lists.opengatecollaboration.org>

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Gate-users digest..."


Today's Topics:

   1. writing output files (Josh Knowland)
   2. Re: output unit (David Sarrut)
   3. Re: Gate settings for Linac photon beam simulation (David Sarrut)


----------------------------------------------------------------------

Message: 1
Date: Tue, 5 Jan 2021 22:05:11 +0000
From: Josh Knowland <jknowland at lucernodynamics.com<mailto:jknowland at lucernodynamics.com>>
To: "gate-users at lists.opengatecollaboration.org<mailto:gate-users at lists.opengatecollaboration.org>"
        <gate-users at lists.opengatecollaboration.org<mailto:gate-users at lists.opengatecollaboration.org>>
Subject: [Gate-users] writing output files
Message-ID:
        <BN8PR15MB3283B4A09BD77A39BFE2ACABAFD10 at BN8PR15MB3283.namprd15.prod.outlook.com<mailto:BN8PR15MB3283B4A09BD77A39BFE2ACABAFD10 at BN8PR15MB3283.namprd15.prod.outlook.com>>

Content-Type: text/plain; charset="utf-8"

All -
I have noticed that running simulations is non-linear in terms of real-world time vs simulated time. For instance, simulating 100 seconds takes longer than 100x a 1-second simulation.

My guess is that this could be due to file IO and the significantly larger file sizes resulting from longer simulations. I searched through the mailing list and the source code, but I couldn't find anything about the timing of file IO. I'd prefer not to use the "setOutFileSizeLimit" flag if I don't have to.

Since the computer I run GATE on has plenty of RAM, is it possible to increase the time between file IO writes in order to speed up the overall simulation?

-Josh

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.opengatecollaboration.org/pipermail/gate-users/attachments/20210105/da88531c/attachment-0001.html>

------------------------------

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.opengatecollaboration.org/pipermail/gate-users/attachments/20210106/8a89db84/attachment-0001.html>