<div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr">Hi, <div><br></div><div>yes, Bryan is right, hits increase comp time and disk size, be sure you need it. There is now a "summary" output to print the number of hits, but that do not store the hits themselves. <a href="https://opengate.readthedocs.io/en/latest/data_output_management.html?highlight=summary#additional-output-summary">https://opengate.readthedocs.io/en/latest/data_output_management.html?highlight=summary#additional-output-summary</a></div><div><br></div><div>Some times ago, we tried to investigate the setOutFileSizeLimit, but it did not change anything. Nowadays, disks cache is really powerful, not fully sure that a ram disk will help (but I might be wrong). See here: <a href="https://github.com/OpenGATE/Gate/pull/339">https://github.com/OpenGATE/Gate/pull/339</a></div><div><br></div><div>David</div><div><br></div></div></div></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Wed, Jan 6, 2021 at 2:31 PM Josh Knowland <<a href="mailto:jknowland@lucernodynamics.com">jknowland@lucernodynamics.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-style:solid;border-left-color:rgb(204,204,204);padding-left:1ex">
<div lang="EN-US" style="word-wrap:break-word">
<div class="gmail-m_6834528282631085318WordSection1">
<p class="MsoNormal">Hi Bryan – thanks a bunch, very good ideas.<u></u><u></u></p>
<p class="MsoNormal">I’m typically simulating gamma cameras, so singles are what I’m most interested in. I’ll try a ramdisk, though. That seems like it should speed up the sim.<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">-josh<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<div style="border-style:solid none none;border-top-width:1pt;border-top-color:rgb(225,225,225);padding:3pt 0in 0in">
<p class="MsoNormal"><b>From:</b> Gate-users <<a href="mailto:gate-users-bounces@lists.opengatecollaboration.org" target="_blank">gate-users-bounces@lists.opengatecollaboration.org</a>>
<b>On Behalf Of </b>Bryan McIntosh<br>
<b>Sent:</b> Wednesday, January 6, 2021 8:26 AM<br>
<b>To:</b> <a href="mailto:gate-users@lists.opengatecollaboration.org" target="_blank">gate-users@lists.opengatecollaboration.org</a><br>
<b>Subject:</b> Re: [Gate-users] writing output files<u></u><u></u></p>
</div>
<p class="MsoNormal"><u></u> <u></u></p>
<div>
<div>
<div>
<div>
<p class="MsoNormal">Hi Josh,<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">I did some benchmarking work in 2018 looking at the impact of the Spectre/Meltdown exploits on GATE simulation time; since those impacted I/O operations, I ran them on a RAM disk to remove my hard drive speed as a limiting factor. I've
found that the following helps:<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">1) Remove hits or singles from the ROOT file output if you are simulating a PET system. In most simulations Hits aren't necessary, and if you are only using coincidences for creating projection data then you don't necessarily need the singles
either. This also dramatically saves on disk space!<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">2) Since you have plenty of RAM, you can use a RAM disk as your output device. I used the guide at <a href="https://www.techrepublic.com/article/how-to-use-a-ramdisk-on-linux/" target="_blank">https://www.techrepublic.com/article/how-to-use-a-ramdisk-on-linux/</a>,
substituting 2 GB for whatever size of output data you needed. Once I created the RAM disk, I set my output path to it in the macro and everything worked seamlessly. This is a bit more dangerous since if the system crashes (unlikely) or if you lose power (depends
on where you're located) you can lose some data, but it does offer a dramatic speed increase if you're running into storage speed limits.
<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">I hope that this helps!<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">-Bryan McIntosh<u></u><u></u></p>
</div>
<p class="MsoNormal"><u></u> <u></u></p>
<div>
<div>
<p class="MsoNormal">On Wed, Jan 6, 2021 at 1:13 AM <<a href="mailto:gate-users-request@lists.opengatecollaboration.org" target="_blank">gate-users-request@lists.opengatecollaboration.org</a>> wrote:<u></u><u></u></p>
</div>
<blockquote style="border-style:none none none solid;border-left-width:1pt;border-left-color:rgb(204,204,204);padding:0in 0in 0in 6pt;margin-left:4.8pt;margin-right:0in">
<p class="MsoNormal" style="margin-bottom:12pt">Send Gate-users mailing list submissions to<br>
<a href="mailto:gate-users@lists.opengatecollaboration.org" target="_blank">
gate-users@lists.opengatecollaboration.org</a><br>
<br>
To subscribe or unsubscribe via the World Wide Web, visit<br>
<a href="http://lists.opengatecollaboration.org/mailman/listinfo/gate-users" target="_blank">
http://lists.opengatecollaboration.org/mailman/listinfo/gate-users</a><br>
or, via email, send a message with subject or body 'help' to<br>
<a href="mailto:gate-users-request@lists.opengatecollaboration.org" target="_blank">
gate-users-request@lists.opengatecollaboration.org</a><br>
<br>
You can reach the person managing the list at<br>
<a href="mailto:gate-users-owner@lists.opengatecollaboration.org" target="_blank">
gate-users-owner@lists.opengatecollaboration.org</a><br>
<br>
When replying, please edit your Subject line so it is more specific<br>
than "Re: Contents of Gate-users digest..."<br>
<br>
<br>
Today's Topics:<br>
<br>
1. writing output files (Josh Knowland)<br>
2. Re: output unit (David Sarrut)<br>
3. Re: Gate settings for Linac photon beam simulation (David Sarrut)<br>
<br>
<br>
----------------------------------------------------------------------<br>
<br>
Message: 1<br>
Date: Tue, 5 Jan 2021 22:05:11 +0000<br>
From: Josh Knowland <<a href="mailto:jknowland@lucernodynamics.com" target="_blank">jknowland@lucernodynamics.com</a>><br>
To: "<a href="mailto:gate-users@lists.opengatecollaboration.org" target="_blank">gate-users@lists.opengatecollaboration.org</a>"<br>
<<a href="mailto:gate-users@lists.opengatecollaboration.org" target="_blank">gate-users@lists.opengatecollaboration.org</a>><br>
Subject: [Gate-users] writing output files<br>
Message-ID:<br>
<<a href="mailto:BN8PR15MB3283B4A09BD77A39BFE2ACABAFD10@BN8PR15MB3283.namprd15.prod.outlook.com" target="_blank">BN8PR15MB3283B4A09BD77A39BFE2ACABAFD10@BN8PR15MB3283.namprd15.prod.outlook.com</a>><br>
<br>
Content-Type: text/plain; charset="utf-8"<br>
<br>
All -<br>
I have noticed that running simulations is non-linear in terms of real-world time vs simulated time. For instance, simulating 100 seconds takes longer than 100x a 1-second simulation.<br>
<br>
My guess is that this could be due to file IO and the significantly larger file sizes resulting from longer simulations. I searched through the mailing list and the source code, but I couldn't find anything about the timing of file IO. I'd prefer not to use
the "setOutFileSizeLimit" flag if I don't have to.<br>
<br>
Since the computer I run GATE on has plenty of RAM, is it possible to increase the time between file IO writes in order to speed up the overall simulation?<br>
<br>
-Josh<br>
<br>
-------------- next part --------------<br>
An HTML attachment was scrubbed...<br>
URL: <<a href="http://lists.opengatecollaboration.org/pipermail/gate-users/attachments/20210105/da88531c/attachment-0001.html" target="_blank">http://lists.opengatecollaboration.org/pipermail/gate-users/attachments/20210105/da88531c/attachment-0001.html</a>><br>
<br>
------------------------------<br>
<br>
<u></u><u></u></p>
</blockquote>
</div>
</div>
</div>
</div>
</div>
</div>
_______________________________________________<br>
Gate-users mailing list<br>
<a href="mailto:Gate-users@lists.opengatecollaboration.org" target="_blank">Gate-users@lists.opengatecollaboration.org</a><br>
<a href="http://lists.opengatecollaboration.org/mailman/listinfo/gate-users" rel="noreferrer" target="_blank">http://lists.opengatecollaboration.org/mailman/listinfo/gate-users</a></blockquote></div><br clear="all"><div><br></div>-- <br><div dir="ltr" class="gmail_signature"><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr">David Sarrut, Phd<br>Directeur de recherche CNRS<br>CREATIS, UMR CNRS 5220, Inserm U1206<div>Centre de lutte contre le cancer Léon Bérard<br>28 rue Laënnec, 69373 Lyon cedex 08<br>Tel : 04 78 78 51 51 / 06 74 72 05 42<br><a href="http://www.creatis.insa-lyon.fr/~dsarrut" target="_blank">http://www.creatis.insa-lyon.fr/~dsarrut</a><br>_________________________________</div><div> "2 + 2 = 5, for extremely large values of 2"<br>_________________________________</div></div></div></div></div></div></div>