hi, 

segmentation fault is seen in muidmooretpcreator in reconstruction jobs with release 17.0.0. 

i will extract log file and raw file. 

cheers, 
susumu 

+verbatim+
input file(s):
--------------------------------------------------------------------------------
stage_svcclass=atlcal
/castor/cern.ch/grid/atlas/tzero/prod1/perm/data11_7tev/physics_jettauetmiss/00180664/data11_7tev.00180664.physics_jettauetmiss.merge.raw/data11_7tev.00180664.physics_jettauetmiss.merge.raw._lb0516._sfo-11._0001.1


tier-0 transformation command run:
--------------------------------------------------------------------------------
source /afs/cern.ch/atlas/tzero/prod1/inst/projects/data11/setup/setuptrf.sh /afs/cern.ch/atlas/tzero/prod1/inst/projects/data11/patches/atlasproduction-17.0.0 atlasproduction-17.0.0 /afs/cern.ch/atlas/tzero/prod1/inst/projects/data11/setup/specialsetup_tier0.sh ; python -u `which reco_trf.py` --argdict=/afs/cern.ch/atlas/tzero/prod1/log1/10814/10814067_data11_7tev.00180664.physics_jettauetmiss.merge.raw.f374.recon.task._lb0516._sfo-11._0001.job.2//data11_7tev.00180664.physics_jettauetmiss.merge.raw.f374.recon.task._lb0516._sfo-11._0001.job.argdict.gpickle  &amp;&gt; data11_7tev.00180664.physics_jettauetmiss.merge.raw.f374.recon.task._lb0516._sfo-11._0001.job.tmp.log


ami configuration tag (more details):
--------------------------------------------------------------------------------
see http://ami.in2p3.fr:8080/opencms/opencms/ami/www/referencetables/ --&gt; configurationtag --&gt; interpret --&gt; f374


logfile location:
--------------------------------------------------------------------------------
stage_svcclass=t0merge
/castor/cern.ch/grid/atlas/tzero/prod1/temp/data11_7tev/physics_jettauetmiss/00180664/data11_7tev.00180664.physics_jettauetmiss.merge.raw.f374.recon.task.tmp.log/data11_7tev.00180664.physics_jettauetmiss.merge.raw.f374.recon.task._lb0516._sfo-11._0001.job.tmp.log.2


tail of the log file (300 lines):
--------------------------------------------------------------------------------
toolsvc.mboymuontrackbuilder                         info mboymuontrackbuilder::loadevent
athenaeventloopmgr                                   info   ===&gt;&gt;&gt;  done processing event #4450382, run #180664 56 events processed so far  &lt;&lt;&lt;===
athenaeventloopmgr                                   info   ===&gt;&gt;&gt;  start processing event #4444733, run #180664 56 events processed so far  &lt;&lt;&lt;===
iovsvctool                                           info 	condattrlistcollection[/sct/dcs/modtemp]: [1304270660000000000]   &lt;- removed
	condattrlistcollection[/lar/dcs/hv/barrel/i8]: [1304270660000000000]   &lt;- removed
	condattrlistcollection[/lar/dcs/hv/barrel/i16]: [1304270660000000000]   &lt;- removed

iovsvctool                                           info 
iovsvctool                                           info 
iovsvctool                                           info 
dataproxy                                         warning accessdata:  iconversionsvc ptr not set
toolsvc.mboymuontrackbuilder                         info mboymuontrackbuilder::loadevent
toolsvc.dcmathsegmentmaker                        warning found multiple sectors on input, cannot process data 
toolsvc.dcmathsegmentmaker                        warning  no mdt selected, returning 0 
toolsvc.dcmathsegmentmaker                        warning found multiple sectors on input, cannot process data 
toolsvc.dcmathsegmentmaker                        warning  no mdt selected, returning 0 
toolsvc.trigdecisiontool.navigation               warning getfeatureaccessors: feature of clid: 1334834594 and index: 1 not available. probably not recorded. navigation structure inconsistent. 
athenaeventloopmgr                                   info   ===&gt;&gt;&gt;  done processing event #4444733, run #180664 57 events processed so far  &lt;&lt;&lt;===
athenaeventloopmgr                                   info   ===&gt;&gt;&gt;  start processing event #4452223, run #180664 57 events processed so far  &lt;&lt;&lt;===
iovsvctool                                           info 
iovsvctool                                           info 
iovsvctool                                           info    condattrlistcollection[/sct/dcs/modtemp]: [1304270660000000000]  -&gt; removed
   condattrlistcollection[/lar/dcs/hv/barrel/i8]: [1304270660000000000]  -&gt; removed
   condattrlistcollection[/lar/dcs/hv/barrel/i16]: [1304270660000000000]  -&gt; removed

iovsvctool                                           info 
toolsvc.mboymuontrackbuilder                         info mboymuontrackbuilder::loadevent
toolsvc.dcmathsegmentmaker                        warning found multiple sectors on input, cannot process data 
toolsvc.dcmathsegmentmaker                        warning  no mdt selected, returning 0 
athenaeventloopmgr                                   info   ===&gt;&gt;&gt;  done processing event #4452223, run #180664 58 events processed so far  &lt;&lt;&lt;===
athenaeventloopmgr                                   info   ===&gt;&gt;&gt;  start processing event #4450987, run #180664 58 events processed so far  &lt;&lt;&lt;===
iovsvctool                                           info 	condattrlistcollection[/lar/dcs/hv/barrel/i8]: [1304270662000000000]   &lt;- removed
	condattrlistcollection[/lar/dcs/hv/barrel/i16]: [1304270662000000000]   &lt;- removed

iovsvctool                                           info 
iovsvctool                                           info 
iovsvctool                                           info 
dataproxy                                         warning accessdata:  iconversionsvc ptr not set
toolsvc.dcmathsegmentmaker                        warning found multiple sectors on input, cannot process data 
toolsvc.dcmathsegmentmaker                        warning  no mdt selected, returning 0 
athenaeventloopmgr                                   info   ===&gt;&gt;&gt;  done processing event #4450987, run #180664 59 events processed so far  &lt;&lt;&lt;===
athenaeventloopmgr                                   info   ===&gt;&gt;&gt;  start processing event #4451935, run #180664 59 events processed so far  &lt;&lt;&lt;===
iovsvctool                                           info 
iovsvctool                                           info 
iovsvctool                                           info 
iovsvctool                                           info 
toolsvc.dcmathsegmentmaker                        warning found multiple sectors on input, cannot process data 
toolsvc.dcmathsegmentmaker                        warning  no mdt selected, returning 0 
toolsvc.dcmathsegmentmaker                        warning found multiple sectors on input, cannot process data 
toolsvc.dcmathsegmentmaker                        warning  no mdt selected, returning 0 
toolsvc.dcmathsegmentmaker                        warning found multiple sectors on input, cannot process data 
toolsvc.dcmathsegmentmaker                        warning  no mdt selected, returning 0 
athenaeventloopmgr                                   info   ===&gt;&gt;&gt;  done processing event #4451935, run #180664 60 events processed so far  &lt;&lt;&lt;===
athenaeventloopmgr                                   info   ===&gt;&gt;&gt;  start processing event #4450555, run #180664 60 events processed so far  &lt;&lt;&lt;===
iovsvctool                                           info 	condattrlistcollection[/sct/dcs/modtemp]: [1304270661000000000]   &lt;- removed
	condattrlistcollection[/lar/dcs/hv/barrel/i8]: [1304270661000000000]   &lt;- removed
	condattrlistcollection[/lar/dcs/hv/barrel/i16]: [1304270661000000000]   &lt;- removed

iovsvctool                                           info 
iovsvctool                                           info 
iovsvctool                                           info 
dataproxy                                         warning accessdata:  iconversionsvc ptr not set
dataproxy                                         warning accessdata:  iconversionsvc ptr not set
toolsvc.dcmathsegmentmaker                        warning found multiple sectors on input, cannot process data 
toolsvc.dcmathsegmentmaker                        warning  no mdt selected, returning 0 
athenaeventloopmgr                                   info   ===&gt;&gt;&gt;  done processing event #4450555, run #180664 61 events processed so far  &lt;&lt;&lt;===
athenaeventloopmgr                                   info   ===&gt;&gt;&gt;  start processing event #4450627, run #180664 61 events processed so far  &lt;&lt;&lt;===
iovsvctool                                           info 
iovsvctool                                           info 
iovsvctool                                           info    condattrlistcollection[/sct/dcs/modtemp]: [1304270661000000000]  -&gt; removed
   condattrlistcollection[/lar/dcs/hv/barrel/i8]: [1304270661000000000]  -&gt; removed
   condattrlistcollection[/lar/dcs/hv/barrel/i16]: [1304270661000000000]  -&gt; removed

iovsvctool                                           info 
dataproxy                                         warning accessdata:  iconversionsvc ptr not set
dataproxy                                         warning accessdata:  iconversionsvc ptr not set
toolsvc.mboymuontrackbuilder                         info mboymuontrackbuilder::loadevent
toolsvc.muontrackquery                            warning  input track without measuredperigee
toolsvc.muontrackquery                            warning  input track without measuredperigee
toolsvc.muontrackquery                            warning  input track without measuredperigee
muidstandalonetpamcreator                         warning  caloenergy missing from extrapolated track
toolsvc.dcmathsegmentmaker                        warning found multiple sectors on input, cannot process data 
toolsvc.dcmathsegmentmaker                        warning  no mdt selected, returning 0 
athenaeventloopmgr                                   info   ===&gt;&gt;&gt;  done processing event #4450627, run #180664 62 events processed so far  &lt;&lt;&lt;===
athenaeventloopmgr                                   info   ===&gt;&gt;&gt;  start processing event #4451286, run #180664 62 events processed so far  &lt;&lt;&lt;===
iovsvctool                                           info 
iovsvctool                                           info 
iovsvctool                                           info 
iovsvctool                                           info 
dataproxy                                         warning accessdata:  iconversionsvc ptr not set
toolsvc.mboymuontrackbuilder                         info mboymuontrackbuilder::loadevent
toolsvc.dcmathsegmentmaker                        warning found multiple sectors on input, cannot process data 
toolsvc.dcmathsegmentmaker                        warning  no mdt selected, returning 0 
toolsvc.dcmathsegmentmaker                        warning found multiple sectors on input, cannot process data 
toolsvc.dcmathsegmentmaker                        warning  no mdt selected, returning 0 
toolsvc.dcmathsegmentmaker                        warning found multiple sectors on input, cannot process data 
toolsvc.dcmathsegmentmaker                        warning  no mdt selected, returning 0 
athenaeventloopmgr                                   info   ===&gt;&gt;&gt;  done processing event #4451286, run #180664 63 events processed so far  &lt;&lt;&lt;===
athenaeventloopmgr                                   info   ===&gt;&gt;&gt;  start processing event #4451339, run #180664 63 events processed so far  &lt;&lt;&lt;===
iovsvctool                                           info 
iovsvctool                                           info 
iovsvctool                                           info 
iovsvctool                                           info 
dataproxy                                         warning accessdata:  iconversionsvc ptr not set
toolsvc.mboymuontrackbuilder                         info mboymuontrackbuilder::loadevent
toolsvc.muonidhelper                              warning createparticle: no particle produced
-------------------------------------------------------------------------------------
core dump from coredumpsvc on lxbrb2711.cern.ch at sun may  8 17:26:31 2011

caught signal 11(segmentation fault). details: 
  errno = 0, code = 1 (address not mapped to object)
  pid   = 8, uid = 4293243332
  value = (284740, 0x45844)
  vmem = 1984.98 mb
  rss  = 1635.07 mb
  total-ram = 15929.1 mb
  free-ram  = 7585.15 mb
  buffer-ram= 636.059 mb
  total-swap= 20481.2 mb
  free-swap = 20385 mb
  addr  = 0x8

event counter: 64
eventid: [run,evt,lumi,time,bunchcross,detmask] = [180664,4451339,516,1304270661:985803445,139,0x1fffffffffff7]
last incident: athenaeventloopmgr:beginevent
current algorithm: muidmooretpcreator
algorithm stack: 
   athmasterseq
   athalgseq
   muidmooretpcreator
-------------------------------------------------------------------------------------

(pid=1089 ppid=1025) received fatal signal 11 (segmentation fault)
signal context:
  signo  = 11, errno = 0, code = 1 (address not mapped to object)
  pid    = 8, uid = -1723964
  value  = (284740, 0x45844)
  addr   = 0x8
  stack  = (2, 0, (nil))

  eip: 0023:e4a42834           eflags: 00210282
  eax: 410f67f8   ebx: e4a668f4   ecx: 171a6c3c   edx: 171a124c
  esi: 00000000   edi: 4e90d1b8   ebp: ffe5b3b8   esp: ffe5b340
   ds: 002b        es: 002b        fs: 0000        ss: 002b

  signal esp: ffe5b340  trap: 14/4  oldmask: 00000000   cr2: 00000008

  fpu:  control = ffff037f
        status  = ffff0020
        tag     = ffffffff
        ip      = 0010:dc22db58
        data    = 002b:166aa5d8
        state   = 00000020
    %fp0 = [4009:8800e861ea089b3c]
    %fp1 = [c00c:000000000000bb80]
    %fp2 = [8000:0000000000000000]
    %fp3 = [3ffd:d3b0e21f39759772]
    %fp4 = [4013:a313a70ea3cabc45]
    %fp5 = [0000:0000000000000000]
    %fp6 = [c008:70002bea9612ab49]
    %fp7 = [0000:0000000000000000]

stack trace:
 0xf3c0e3b0 _zn6athena9debugaids10stacktraceei + 0x60 [/afs/cern.ch/atlas/software/releases/17.0.0/atlascore/17.0.0/installarea/i686-slc5-gcc43-opt/lib/libcxxutils.so]
 0xf3c0f21f _zn6athena6signal9fataldumpeip7siginfopv + 0xff [/afs/cern.ch/atlas/software/releases/17.0.0/atlascore/17.0.0/installarea/i686-slc5-gcc43-opt/lib/libcxxutils.so]
 0xf3c0f531 _zn6athena6signal5fataleip7siginfopv + 0x181 [/afs/cern.ch/atlas/software/releases/17.0.0/atlascore/17.0.0/installarea/i686-slc5-gcc43-opt/lib/libcxxutils.so]
 0xf21bac96 _zn18coredumpsvchandler6actioneip7siginfopv + 0x106 [/afs/cern.ch/atlas/software/releases/17.0.0/atlascore/17.0.0/installarea/i686-slc5-gcc43-opt/lib/libathenaservices.so]
 0xffffe600 &lt;unknown function&gt;
 0xe4a42834 _zn18muidmooretpcreator7convertev + 0x354 [/afs/cern.ch/atlas/software/releases/17.0.0/atlasreconstruction/17.0.0/installarea/i686-slc5-gcc43-opt/lib/libmuidparticlecreator.so]
 0xe4a42abd _zn18muidmooretpcreator7executeev + 0x2d [/afs/cern.ch/atlas/software/releases/17.0.0/atlasreconstruction/17.0.0/installarea/i686-slc5-gcc43-opt/lib/libmuidparticlecreator.so]
 0xf4c249fd _zn9algorithm10sysexecuteev + 0x11d [/afs/cern.ch/atlas/software/releases/17.0.0/gaudi/v22r1p1/installarea/i686-slc5-gcc43-opt/lib/libgaudikernel.so]
 0xe744446b _zn12athsequencer7executeev + 0x25b [/afs/cern.ch/atlas/software/releases/17.0.0/atlascore/17.0.0/installarea/i686-slc5-gcc43-opt/lib/libgaudisequencer.so]
 0xf4c249fd _zn9algorithm10sysexecuteev + 0x11d [/afs/cern.ch/atlas/software/releases/17.0.0/gaudi/v22r1p1/installarea/i686-slc5-gcc43-opt/lib/libgaudikernel.so]
 0xe744446b _zn12athsequencer7executeev + 0x25b [/afs/cern.ch/atlas/software/releases/17.0.0/atlascore/17.0.0/installarea/i686-slc5-gcc43-opt/lib/libgaudisequencer.so]
 0xf4c249fd _zn9algorithm10sysexecuteev + 0x11d [/afs/cern.ch/atlas/software/releases/17.0.0/gaudi/v22r1p1/installarea/i686-slc5-gcc43-opt/lib/libgaudikernel.so]
 0xf21d30ff _zn18athenaeventloopmgr17executealgorithmsev + 0x6f [/afs/cern.ch/atlas/software/releases/17.0.0/atlascore/17.0.0/installarea/i686-slc5-gcc43-opt/lib/libathenaservices.so]
 0xf21d98ee _zn18athenaeventloopmgr12executeeventepv + 0x82e [/afs/cern.ch/atlas/software/releases/17.0.0/atlascore/17.0.0/installarea/i686-slc5-gcc43-opt/lib/libathenaservices.so]
 0xf21d85e2 _zn18athenaeventloopmgr9nexteventei + 0x8a2 [/afs/cern.ch/atlas/software/releases/17.0.0/atlascore/17.0.0/installarea/i686-slc5-gcc43-opt/lib/libathenaservices.so]
 0xf21d228b _zn18athenaeventloopmgr10executerunei + 0x1b [/afs/cern.ch/atlas/software/releases/17.0.0/atlascore/17.0.0/installarea/i686-slc5-gcc43-opt/lib/libathenaservices.so]
 0xf2835e49 _zn14applicationmgr10executerunei + 0x79 [/afs/cern.ch/atlas/software/releases/17.0.0/gaudi/v22r1p1/installarea/i686-slc5-gcc43-opt/lib/libgaudisvc.so]
 0xf312cf2d _zn12_global__n_1l11method_4295epvs0_rkst6vectoris0_sais0_ees0_ + 0xf312cf2d ï¿½/afs/cern.ch/atlas/software/releases/17.0.0/gaudi/v22r1p1/installarea/i686-slc5-gcc43-opt/lib/libgaudikerneldict.so]
 0xf5c03a57 _zn4root6cintex24method_stub_with_contextepns0_13stubcontext_tep8g__valuepkcp8g__parami + 0x157 [/afs/cern.ch/atlas/software/releases/17.0.0/lcgcmt/lcgcmt_60b/installarea/i686-slc5-gcc43-opt/lib/libcintex.so]
 0xf25c7034 &lt;unknown function&gt;
 0xf6ea7572 _zn4cint11g__callfunc7executeepv + 0xd2 [/afs/cern.ch/atlas/software/releases/17.0.0/lcgcmt/lcgcmt_60b/installarea/i686-slc5-gcc43-opt/lib/libcint.so]
 0xf7b8272c _zn6pyroot26trootobjectbyvalueexecutor7executeepn4cint11g__callfuncepv + 0x2c [/afs/cern.ch/atlas/software/releases/17.0.0/sw/lcg/app/releases/root/5.28.00b/i686-slc5-gcc43-opt/root/lib/libpyroot.so]
 0xf7b89104 _zn6pyroot13tmethodholderins_13tscopeadapterens_14tmemberadapteree8callsafeepv + 0x64 [/afs/cern.ch/atlas/software/releases/17.0.0/sw/lcg/app/releases/root/5.28.00b/i686-slc5-gcc43-opt/root/lib/libpyroot.so]
 0xf7b8929c _zn6pyroot13tmethodholderins_13tscopeadapterens_14tmemberadapteree7executeepv + 0x6c [/afs/cern.ch/atlas/software/releases/17.0.0/sw/lcg/app/releases/root/5.28.00b/i686-slc5-gcc43-opt/root/lib/libpyroot.so]
 0xf7b877c3 _zn6pyroot13tmethodholderins_13tscopeadapterens_14tmemberadaptereeclepns_11objectproxyep7_objects7_l + 0x153 [/afs/cern.ch/atlas/software/releases/17.0.0/sw/lcg/app/releases/root/5.28.00b/i686-slc5-gcc43-opt/root/lib/libpyroot.so]
 0xf7b8eafa _zn6pyroot12_global__n_17mp_callepns_11methodproxyep7_objects4_ + 0xf7b8eafa ï¿½/afs/cern.ch/atlas/software/releases/17.0.0/sw/lcg/app/releases/root/5.28.00b/i686-slc5-gcc43-opt/root/lib/libpyroot.so]
 0x0805d88c pyobject_call objects/abstract.c:2493 + 0x5c [/afs/cern.ch/atlas/software/releases/17.0.0/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080d969d do_call inlined at python/ceval.c:3773 in pyeval_evalframeex python/ceval.c:3968 + 0x2dfd [/afs/cern.ch/atlas/software/releases/17.0.0/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080ddc8c pyeval_evalcodeex python/ceval.c:3000 + 0x87c [/afs/cern.ch/atlas/software/releases/17.0.0/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080dc329 fast_function inlined at python/ceval.c:3771 in pyeval_evalframeex python/ceval.c:3846 + 0x5a89 [/afs/cern.ch/atlas/software/releases/17.0.0/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080ddc8c pyeval_evalcodeex python/ceval.c:3000 + 0x87c [/afs/cern.ch/atlas/software/releases/17.0.0/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080dddd3 pyeval_evalcode python/ceval.c:547 + 0x63 [/afs/cern.ch/atlas/software/releases/17.0.0/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080fe044 run_mod inlined at python/pythonrun.c:1325 in pyrun_fileexflags python/pythonrun.c:1339 + 0xb4 [/afs/cern.ch/atlas/software/releases/17.0.0/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080d4900 builtin_execfile python/bltinmodule.c:797 + 0x80d4900 [/afs/cern.ch/atlas/software/releases/17.0.0/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x081391bd pycfunction_call objects/methodobject.c:81 + 0x18d [/afs/cern.ch/atlas/software/releases/17.0.0/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080dbd09 call_function inlined at python/ceval.c:2412 in pyeval_evalframeex python/ceval.c:3750 + 0x5469 [/afs/cern.ch/atlas/software/releases/17.0.0/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080ddc8c pyeval_evalcodeex python/ceval.c:3000 + 0x87c [/afs/cern.ch/atlas/software/releases/17.0.0/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x08137caa function_call objects/funcobject.c:524 + 0x8137caa [/afs/cern.ch/atlas/software/releases/17.0.0/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x0805d88c pyobject_call objects/abstract.c:2493 + 0x5c [/afs/cern.ch/atlas/software/releases/17.0.0/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x08064935 instancemethod_call objects/classobject.c:2579 + 0x8064935 [/afs/cern.ch/atlas/software/releases/17.0.0/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x0805d88c pyobject_call objects/abstract.c:2493 + 0x5c [/afs/cern.ch/atlas/software/releases/17.0.0/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080b29e3 slot_tp_call objects/typeobject.c:5373 + 0x80b29e3 [/afs/cern.ch/atlas/software/releases/17.0.0/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x0805d88c pyobject_call objects/abstract.c:2493 + 0x5c [/afs/cern.ch/atlas/software/releases/17.0.0/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080d969d do_call inlined at python/ceval.c:3773 in pyeval_evalframeex python/ceval.c:3968 + 0x2dfd [/afs/cern.ch/atlas/software/releases/17.0.0/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080ddc8c pyeval_evalcodeex python/ceval.c:3000 + 0x87c [/afs/cern.ch/atlas/software/releases/17.0.0/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080dddd3 pyeval_evalcode python/ceval.c:547 + 0x63 [/afs/cern.ch/atlas/software/releases/17.0.0/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080fe044 run_mod inlined at python/pythonrun.c:1325 in pyrun_fileexflags python/pythonrun.c:1339 + 0xb4 [/afs/cern.ch/atlas/software/releases/17.0.0/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080d4900 builtin_execfile python/bltinmodule.c:797 + 0x80d4900 [/afs/cern.ch/atlas/software/releases/17.0.0/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x081391bd pycfunction_call objects/methodobject.c:81 + 0x18d [/afs/cern.ch/atlas/software/releases/17.0.0/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080dbd09 call_function inlined at python/ceval.c:2412 in pyeval_evalframeex python/ceval.c:3750 + 0x5469 [/afs/cern.ch/atlas/software/releases/17.0.0/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080ddc8c pyeval_evalcodeex python/ceval.c:3000 + 0x87c [/afs/cern.ch/atlas/software/releases/17.0.0/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x08137caa function_call objects/funcobject.c:524 + 0x8137caa [/afs/cern.ch/atlas/software/releases/17.0.0/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x0805d88c pyobject_call objects/abstract.c:2493 + 0x5c [/afs/cern.ch/atlas/software/releases/17.0.0/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x08064935 instancemethod_call objects/classobject.c:2579 + 0x8064935 [/afs/cern.ch/atlas/software/releases/17.0.0/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x0805d88c pyobject_call objects/abstract.c:2493 + 0x5c [/afs/cern.ch/atlas/software/releases/17.0.0/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080b29e3 slot_tp_call objects/typeobject.c:5373 + 0x80b29e3 [/afs/cern.ch/atlas/software/releases/17.0.0/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x0805d88c pyobject_call objects/abstract.c:2493 + 0x5c [/afs/cern.ch/atlas/software/releases/17.0.0/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080d969d do_call inlined at python/ceval.c:3773 in pyeval_evalframeex python/ceval.c:3968 + 0x2dfd [/afs/cern.ch/atlas/software/releases/17.0.0/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080ddc8c pyeval_evalcodeex python/ceval.c:3000 + 0x87c [/afs/cern.ch/atlas/software/releases/17.0.0/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080dddd3 pyeval_evalcode python/ceval.c:547 + 0x63 [/afs/cern.ch/atlas/software/releases/17.0.0/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080fe044 run_mod inlined at python/pythonrun.c:1325 in pyrun_fileexflags python/pythonrun.c:1339 + 0xb4 [/afs/cern.ch/atlas/software/releases/17.0.0/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080fe3a4 pyrun_simplefileexflags python/pythonrun.c:935 + 0x204 [/afs/cern.ch/atlas/software/releases/17.0.0/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080fe69a pyrun_anyfileexflags python/pythonrun.c:739 + 0x7a [/afs/cern.ch/atlas/software/releases/17.0.0/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x08058d46 py_main modules/main.c:572 + 0xc56 [/afs/cern.ch/atlas/software/releases/17.0.0/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x08057e42 main ./modules/python.c:24 + 0x32 [/afs/cern.ch/atlas/software/releases/17.0.0/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x005e4e9c __libc_start_main + 0xdc [/lib/libc.so.6]
 0x08057d51 _start + 0x8057d51 [/afs/cern.ch/atlas/software/releases/17.0.0/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
py:rawtoesd          info execution of rawtoesd complete with exit code -11.
py:rawtoesd         error transform received signal 11. exit code reset to athena exit code 8.
info: read 109 error categories from file /afs/cern.ch/atlas/software/releases/17.0.0/atlascore/17.0.0/installarea/share/atlas_error_categories.db
info: read 52 error patterns from file /afs/cern.ch/atlas/software/releases/17.0.0/atlascore/17.0.0/installarea/share/atlas_error_patterns.db
info: read 58 ignore patterns from file /afs/cern.ch/atlas/software/releases/17.0.0/atlascore/17.0.0/installarea/share/atlas_error_ignore.db
athenalogchecker start [rawtoesd log] wall-time: sun may  8 15:26:38 2011, vmem: 105.671875 mb, rss: 66.76171875 mb
py:rawtoesd          info scanning athena logfile rawtoesd.log assuming atlas release all,17.0.0 ...
py:rawtoesd          info athena initialise()...
py:rawtoesd          info athena execute()...
py:rawtoesd          info done scanning 21104 lines of file rawtoesd.log. summary:
py:rawtoesd          info    ignored : 0
py:rawtoesd          info    warnings: 312
py:rawtoesd          info    errors  : 0
py:rawtoesd          info    fatals  : 2
athenalogchecker stop [rawtoesd log] wall-time: sun may  8 15:26:40 2011, vmem: 105.671875 mb, rss: 66.76171875 mb
athenalogchecker report [rawtoesd log] wall-time: 00 hrs 00 mins 01 secs, cpu-time: 00 hrs 00 mins 01 secs, vmem: 0.0 mb, rss: 0.0 mb
py:rawtoesd          info jobtransform completed for rawtoesd with error code 60010 (exit code 6)
py:rawtoesd          info transform timer stop [rawtoesd] wall-time: sun may  8 15:26:40 2011, vmem: 105.671875 mb, rss: 66.78515625 mb
py:rawtoesd          info transform timer report [rawtoesd] wall-time: 00 hrs 16 mins 00 secs, cpu-time: 00 hrs 14 mins 58 secs, vmem: 0.7578125 mb, rss: 0.57421875 mb
===== job report produced by rawtoesd version patjobtransforms-00-03-35 =====
command=/afs/cern.ch/atlas/software/releases/17.0.0/atlasreconstruction/17.0.0/installarea/share/bin/reco_trf.py --argdict=/afs/cern.ch/atlas/tzero/prod1/log1/10814/10814067_data11_7tev.00180664.physics_jettauetmiss.merge.raw.f374.recon.task._lb0516._sfo-11._0001.job.2//data11_7tev.00180664.physics_jettauetmiss.merge.raw.f374.recon.task._lb0516._sfo-11._0001.job.argdict.gpickle
exitcode=6
errorcode=60010 (trf_segfault)
errorcategory=trf_segfault,	60010,	segmentation fault (2 times)
fatals=2
errors=0
warnings=3
writing jobinfo_rawtoesd.xml file...
esdok is  false
skipping esd-&gt;esd step...
skipping esd-&gt;aod step...
skipping esd-&gt;dpd step...
skipping aod-&gt;dpd step...
skipping aod-&gt;tag step...
skipping monitoring file merging step...
py:reco_trf          info jobtransform completed for reco_trf with error code 60010 (exit code 6)
py:rawtoesd          info transform timer stop [reco_trf] wall-time: sun may  8 15:26:40 2011, vmem: 105.671875 mb, rss: 66.7890625 mb
py:rawtoesd          info transform timer report [reco_trf] wall-time: 00 hrs 16 mins 00 secs, cpu-time: 00 hrs 14 mins 58 secs, vmem: 0.7578125 mb, rss: 0.58984375 mb
===== job report produced by recotrf =====
command=/afs/cern.ch/atlas/software/releases/17.0.0/atlasreconstruction/17.0.0/installarea/share/bin/reco_trf.py --argdict=/afs/cern.ch/atlas/tzero/prod1/log1/10814/10814067_data11_7tev.00180664.physics_jettauetmiss.merge.raw.f374.recon.task._lb0516._sfo-11._0001.job.2//data11_7tev.00180664.physics_jettauetmiss.merge.raw.f374.recon.task._lb0516._sfo-11._0001.job.argdict.gpickle
exitcode=6
errorcode=60010 (trf_segfault)
errorcategory=trf_segfault,	60010,	segmentation fault (2 times)
fatals=2
errors=0
warnings=3
errorinfo
  acronym=trf_segfault (60010) segmentation fault
  message=caught signal 11(segmentation fault). details:
  severity=fatal
  producer=rawtoesd
  stage=execute
errorinfo
  acronym=trf_segfault (60010) segmentation fault
  message=(pid=1089 ppid=1025) received fatal signal 11 (segmentation fault)
  severity=fatal
  producer=rawtoesd
  stage=execute
athacronym=an unknown exception occurred
athcode=8
rundiruseddisk=2076844850
rundiravailabledisk=140937273344
workdir=/pool/lsf/atlast0/138620698
athcode=8
rundiravailabledisk=140937527296
dbrelease=current
athacronym=an unknown exception occurred
-verbatim-