[Gate-users] Merging multiple root files

[Ida Häggström]

Dear Marcin,

thank you for your reply! Your response gave me something to work with, and
checking my own filesystem (I run CentOS 5 Linux) I fond that I have ext3.
Looking this up it seems the maximum file size is at least 16GB. I also run
my scripts on a cluster and there's no 1.9GB limitation there either. I
guess there's a built in 1.9GB limit in ROOT, just in case you work on a
FAT32 system. Do you know how to remove this limit in ROOT? I've found a
thread (http://root.cern.ch/root/roottalk/roottalk04/2028.html) where it is
suggested to use TTree::SetMaxTreeSize when creating a tree... Is this
something you can add somehow in your Gate-code?? Or add before compilation
of ROOT?
Thanks!
/Ida

2009/11/2 Marcin Balcerzyk <m.balcerzyk at pluri.ucm.es>

> Dear Ida.
>
> The probable thing is a local disk system limitation. All FAT-32 related
> systems have 1.8GB file size limit. Root is clever enough to create a
> series
> of files, which are separately sensible. If you want to merge them, then
> probably merging application does not recognize the divided files, not to
> mention that it cannot write a large file. Solution - on Windows use NTFS
> system, others - do not know. Note, that you may have a nice 64bit
> operating
> system and a lousy 32bit file system. My Red Hat Linux uses such small
> capacity file system. Other solution is to use network mounted drives to a
> computer that does not have such file size limitation.
>
> Marcin Balcerzyk
>
>
> -----Original Message-----
> From: gate-users-bounces at lists.healthgrid.org
> [mailto:gate-users-bounces at lists.healthgrid.org] On Behalf Of
> gate-users-request at lists.healthgrid.org
> Sent: Monday, November 02, 2009 12:00 PM
> To: gate-users at lists.healthgrid.org
> Subject: Gate-users Digest, Vol 42, Issue 1
>
> Send Gate-users mailing list submissions to
>        gate-users at lists.healthgrid.org
>
> To subscribe or unsubscribe via the World Wide Web, visit
>         http://lists.healthgrid.org/mailman/listinfo/gate-users
> or, via email, send a message with subject or body 'help' to
>        gate-users-request at lists.healthgrid.org
>
> You can reach the person managing the list at
>        gate-users-owner at lists.healthgrid.org
>
> When replying, please edit your Subject line so it is more specific
> than "Re: Contents of Gate-users digest..."
>
>
> Today's Topics:
>
>   1. Merging multiple root files (Ida H?ggstr?m)
>
>
> ----------------------------------------------------------------------
>
> Message: 1
> Date: Mon, 2 Nov 2009 09:38:02 +0100
> From: Ida H?ggstr?m <ida.haggstrom at radfys.umu.se>
> Subject: [Gate-users] Merging multiple root files
> To: gate-users <gate-users at lists.healthgrid.org>
> Message-ID:
>        <ff2bc2ff0911020038u595f1216kd7b8845b77c587f4 at mail.gmail.com>
> Content-Type: text/plain; charset="iso-8859-1"
>
> Hello!
>
> I have some problems with merging root files with filemerger after using
> jobsplitter. Sometimes it works, but for some files  I get the error "no
> latest_event_ID histogram - exit!" and no merged file of course.
>
> I think the problem is due to the fact that for some runs I get very large
> root files, so they are divided into many smaller ones. E.g. for two
> splitted files I get rootOut1_1, rootOut1, rootOut1_2 and rootOut2,
> rootOut2_1, rootOut2_2, as supposed to only rootOut1 and rootOut2. When
> using gjm it tries to merge rootOut1 and rootOut2, which I guess don't
> contain all information since they are only part of the files.
>
> Has anyone any experience with this, or knows how to merge these type of
> files? thanks!
> Ida
>
> PS. I saw similar posts from April 2008 (
> http://lists.healthgrid.org/archives/gate-users/2008-April/002647.html)
> and
> Oct 2007 (
> http://lists.healthgrid.org/archives/gate-users/2007-October/002110.html)
> but I could not get to any scripts or really use anything for myself.
> -------------- next part --------------
> An HTML attachment was scrubbed...
> URL:
> <
> http://lists.healthgrid.org/archives/gate-users/attachments/20091102/2213a4
> ae/attachment.html<http://lists.healthgrid.org/archives/gate-users/attachments/20091102/2213a4%0Aae/attachment.html>
> >
>
> ------------------------------
>
> _______________________________________________
> Gate-users mailing list
> Gate-users at lists.healthgrid.org
> http://lists.healthgrid.org/mailman/listinfo/gate-users
>
>
> End of Gate-users Digest, Vol 42, Issue 1
> *****************************************
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.opengatecollaboration.org/mailman/private/gate-users/attachments/20091103/2c031b3b/attachment.htm>