[Gate-users] filemerger...

[Park MinJae]

Dear Jan,

I uploaded root files on my web server...
http://mj.toti.us/temp/mj_root.tar.gz

there are merged file and two split files...

When I look at the files...event_id looks like be merged...
Counts said so...
but there is some difference on the numbers of each event_id with same
pattern...

I am not sure, but I guess filemerger did some correction on the event_id...

Thanks,
MJ

//=================================================
//  Park MinJae
//  SNU BME Ph.D. Candidate
//
//  DialTo:+82-17-711-7809
//  MailTo:MJ at ToTi.us
//
//  Make the Dream True...
//================================================= 
 

-----Original Message-----
From: Jan De Beenhouwer [mailto:jan.debeenhouwer at ugent.be] 
Sent: Wednesday, October 24, 2007 9:00 PM
To: Park MinJae
Cc: 'Users Gate'
Subject: RE: RE : RE: [Gate-users] filemerger...

On Wed, 2007-10-24 at 19:45 +0900, Park MinJae wrote:
> Dear Jan,
> 
> Even though ROOT recovered some keys...there is no problem with 
> processing root files and there are no missing data...
> 

"Key recovery" is an attempt to recover your data when the root file is
(partially) corrupted. This happens when the root file was not closed
properly for example. This means you are missing data.
 
> Now I figure out what the problem is...
> The problem is ROOT version...
> Filemerger works very good with root 5.14...even without fastMerge...
> Filemerger with root 5.12 works partially...such as with fastMerge 
> option on small root files...

The file merger should work with all of these root versions.

> 
> I think, latest_event_id is not related with filemerger or gate 
> simulation...

This is absolutely not the case. The ONLY reason of existence of the file
merger is the correction of eventIDs, which is completely dependent on the
latest_event_id in each root file. If you're not interested in eventIDs, you
can merge the root file in any way you like.


> 
> root files from benchmark do not have any entry in latest_event_id...
> but they can be merged...
> My simulation data which are over 600M can be merged well...
> They don't have any entity in latest_event_id...
> 

The eventIDs will not be corrected in this case. If GATE isn't saving the
latest_event_id, other cluster code in GATE might not be activated properly
either. The merger doesn't use a lot of memory and was tested with root
files of up to 12GB for various root versions.

> Ah...empty latest_event_id may be related with error on ASCII option...
> but I changed the job splitter source to work around it...
> 

Be careful changing code, as you may enable/disable other functionality.

Regards,

--
MScE Jan De Beenhouwer
Ghent University Hospital
IBITECH - MEDISIP
De Pintelaan 185
Block B - 5th floor
B-9000 Ghent
Tel. +32-9-240.43.26
Fax: +32-9-240.33.90
E-mail: <Jan.DeBeenhouwer at UGent.be>