<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
span.EmailStyle18
{mso-style-type:personal-reply;
font-family:"Calibri",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri",sans-serif;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="blue" vlink="purple" style="word-wrap:break-word">
<div class="WordSection1">
<p class="MsoNormal">Hi David, thank you for your input.<o:p></o:p></p>
<p class="MsoNormal">You were correct. I just tried running test simulations with and without ram disk – no change in real world time.<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">This is running on a Microsoft Azure VM, so I don’t know what type of disk storage they are actually using.<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Josh<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b>From:</b> David Sarrut <David.Sarrut@creatis.insa-lyon.fr>
<br>
<b>Sent:</b> Wednesday, January 6, 2021 10:48 AM<br>
<b>To:</b> Josh Knowland <jknowland@lucernodynamics.com><br>
<b>Cc:</b> Bryan McIntosh <mcintoshster@gmail.com>; gate-users@lists.opengatecollaboration.org<br>
<b>Subject:</b> Re: [Gate-users] writing output files<o:p></o:p></p>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<div>
<div>
<div>
<p class="MsoNormal">Hi, <o:p></o:p></p>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">yes, Bryan is right, hits increase comp time and disk size, be sure you need it. There is now a "summary" output to print the number of hits, but that do not store the hits themselves. <a href="https://opengate.readthedocs.io/en/latest/data_output_management.html?highlight=summary#additional-output-summary">https://opengate.readthedocs.io/en/latest/data_output_management.html?highlight=summary#additional-output-summary</a><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">Some times ago, we tried to investigate the setOutFileSizeLimit, but it did not change anything. Nowadays, disks cache is really powerful, not fully sure that a ram disk will help (but I might be wrong). See here: <a href="https://github.com/OpenGATE/Gate/pull/339">https://github.com/OpenGATE/Gate/pull/339</a><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">David<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
</div>
</div>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<div>
<p class="MsoNormal">On Wed, Jan 6, 2021 at 2:31 PM Josh Knowland <<a href="mailto:jknowland@lucernodynamics.com">jknowland@lucernodynamics.com</a>> wrote:<o:p></o:p></p>
</div>
<blockquote style="border:none;border-left:solid #CCCCCC 1.0pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-right:0in">
<div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">Hi Bryan – thanks a bunch, very good ideas.<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">I’m typically simulating gamma cameras, so singles are what I’m most interested in. I’ll try a ramdisk, though. That seems like it should speed up the sim.<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">-josh<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><b>From:</b> Gate-users <<a href="mailto:gate-users-bounces@lists.opengatecollaboration.org" target="_blank">gate-users-bounces@lists.opengatecollaboration.org</a>>
<b>On Behalf Of </b>Bryan McIntosh<br>
<b>Sent:</b> Wednesday, January 6, 2021 8:26 AM<br>
<b>To:</b> <a href="mailto:gate-users@lists.opengatecollaboration.org" target="_blank">
gate-users@lists.opengatecollaboration.org</a><br>
<b>Subject:</b> Re: [Gate-users] writing output files<o:p></o:p></p>
</div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
<div>
<div>
<div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">Hi Josh,<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">I did some benchmarking work in 2018 looking at the impact of the Spectre/Meltdown exploits on GATE simulation time; since those impacted I/O operations, I ran them on a RAM disk
to remove my hard drive speed as a limiting factor. I've found that the following helps:<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">1) Remove hits or singles from the ROOT file output if you are simulating a PET system. In most simulations Hits aren't necessary, and if you are only using coincidences for creating
projection data then you don't necessarily need the singles either. This also dramatically saves on disk space!<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">2) Since you have plenty of RAM, you can use a RAM disk as your output device. I used the guide at <a href="https://www.techrepublic.com/article/how-to-use-a-ramdisk-on-linux/" target="_blank">https://www.techrepublic.com/article/how-to-use-a-ramdisk-on-linux/</a>,
substituting 2 GB for whatever size of output data you needed. Once I created the RAM disk, I set my output path to it in the macro and everything worked seamlessly. This is a bit more dangerous since if the system crashes (unlikely) or if you lose power (depends
on where you're located) you can lose some data, but it does offer a dramatic speed increase if you're running into storage speed limits.
<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">I hope that this helps!<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">-Bryan McIntosh<o:p></o:p></p>
</div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
<div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">On Wed, Jan 6, 2021 at 1:13 AM <<a href="mailto:gate-users-request@lists.opengatecollaboration.org" target="_blank">gate-users-request@lists.opengatecollaboration.org</a>> wrote:<o:p></o:p></p>
</div>
<blockquote style="border:none;border-left:solid #CCCCCC 1.0pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-top:5.0pt;margin-right:0in;margin-bottom:5.0pt">
<p class="MsoNormal" style="mso-margin-top-alt:auto;margin-bottom:12.0pt">Send Gate-users mailing list submissions to<br>
<a href="mailto:gate-users@lists.opengatecollaboration.org" target="_blank">
gate-users@lists.opengatecollaboration.org</a><br>
<br>
To subscribe or unsubscribe via the World Wide Web, visit<br>
<a href="http://lists.opengatecollaboration.org/mailman/listinfo/gate-users" target="_blank">
http://lists.opengatecollaboration.org/mailman/listinfo/gate-users</a><br>
or, via email, send a message with subject or body 'help' to<br>
<a href="mailto:gate-users-request@lists.opengatecollaboration.org" target="_blank">
gate-users-request@lists.opengatecollaboration.org</a><br>
<br>
You can reach the person managing the list at<br>
<a href="mailto:gate-users-owner@lists.opengatecollaboration.org" target="_blank">
gate-users-owner@lists.opengatecollaboration.org</a><br>
<br>
When replying, please edit your Subject line so it is more specific<br>
than "Re: Contents of Gate-users digest..."<br>
<br>
<br>
Today's Topics:<br>
<br>
1. writing output files (Josh Knowland)<br>
2. Re: output unit (David Sarrut)<br>
3. Re: Gate settings for Linac photon beam simulation (David Sarrut)<br>
<br>
<br>
----------------------------------------------------------------------<br>
<br>
Message: 1<br>
Date: Tue, 5 Jan 2021 22:05:11 +0000<br>
From: Josh Knowland <<a href="mailto:jknowland@lucernodynamics.com" target="_blank">jknowland@lucernodynamics.com</a>><br>
To: "<a href="mailto:gate-users@lists.opengatecollaboration.org" target="_blank">gate-users@lists.opengatecollaboration.org</a>"<br>
<<a href="mailto:gate-users@lists.opengatecollaboration.org" target="_blank">gate-users@lists.opengatecollaboration.org</a>><br>
Subject: [Gate-users] writing output files<br>
Message-ID:<br>
<<a href="mailto:BN8PR15MB3283B4A09BD77A39BFE2ACABAFD10@BN8PR15MB3283.namprd15.prod.outlook.com" target="_blank">BN8PR15MB3283B4A09BD77A39BFE2ACABAFD10@BN8PR15MB3283.namprd15.prod.outlook.com</a>><br>
<br>
Content-Type: text/plain; charset="utf-8"<br>
<br>
All -<br>
I have noticed that running simulations is non-linear in terms of real-world time vs simulated time. For instance, simulating 100 seconds takes longer than 100x a 1-second simulation.<br>
<br>
My guess is that this could be due to file IO and the significantly larger file sizes resulting from longer simulations. I searched through the mailing list and the source code, but I couldn't find anything about the timing of file IO. I'd prefer not to use
the "setOutFileSizeLimit" flag if I don't have to.<br>
<br>
Since the computer I run GATE on has plenty of RAM, is it possible to increase the time between file IO writes in order to speed up the overall simulation?<br>
<br>
-Josh<br>
<br>
-------------- next part --------------<br>
An HTML attachment was scrubbed...<br>
URL: <<a href="http://lists.opengatecollaboration.org/pipermail/gate-users/attachments/20210105/da88531c/attachment-0001.html" target="_blank">http://lists.opengatecollaboration.org/pipermail/gate-users/attachments/20210105/da88531c/attachment-0001.html</a>><br>
<br>
------------------------------<o:p></o:p></p>
</blockquote>
</div>
</div>
</div>
</div>
</div>
</div>
<p class="MsoNormal">_______________________________________________<br>
Gate-users mailing list<br>
<a href="mailto:Gate-users@lists.opengatecollaboration.org" target="_blank">Gate-users@lists.opengatecollaboration.org</a><br>
<a href="http://lists.opengatecollaboration.org/mailman/listinfo/gate-users" target="_blank">http://lists.opengatecollaboration.org/mailman/listinfo/gate-users</a><o:p></o:p></p>
</blockquote>
</div>
<p class="MsoNormal"><br clear="all">
<o:p></o:p></p>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<p class="MsoNormal">-- <o:p></o:p></p>
<div>
<div>
<div>
<div>
<div>
<div>
<p class="MsoNormal">David Sarrut, Phd<br>
Directeur de recherche CNRS<br>
CREATIS, UMR CNRS 5220, Inserm U1206<o:p></o:p></p>
<div>
<p class="MsoNormal">Centre de lutte contre le cancer Léon Bérard<br>
28 rue Laënnec, 69373 Lyon cedex 08<br>
Tel : 04 78 78 51 51 / 06 74 72 05 42<br>
<a href="http://www.creatis.insa-lyon.fr/~dsarrut" target="_blank">http://www.creatis.insa-lyon.fr/~dsarrut</a><br>
_________________________________<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> "2 + 2 = 5, for extremely large values of 2"<br>
_________________________________<o:p></o:p></p>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</body>
</html>