hi niels,

segfault in latest nightly. was fine in rel_1.

http://atlaspmb.cern.ch/rtt-mon/rttjob.php?nightly=rel_2&amp;build=devval&amp;cache=offline&amp;cmtconfig=i686-slc5-gcc43-opt&amp;package=muonrecconfigtests&amp;jobname=bs_all&amp;jobid=bs_all&amp;file=bs_all_log


memstatauditor                                       info memory usage has changed after  mdtrdotomdtprepdata 	execute method 	virtual size = 1610.77 mb 	resident set size = 1284.91 mb deltavsize = 0  mb 
memstatauditor                                       info memory usage has changed after  mboyrec 	execute method 	virtual size = 1610.77 mb 	resident set size = 1286.54 mb deltavsize = 0  mb 
-------------------------------------------------------------------------------------
core dump from coredumpsvc on lxbrb1220.cern.ch at tue mar  8 06:43:17 2011

caught signal 11(segmentation fault). details: 
  errno = 0, code = 2 (invalid permissions for mapped object)
  pid   = 2032596360, uid = 6102145
  value = (360, 0x168)
  vmem = 1610.77 mb
  rss  = 1286.95 mb
  total-ram = 15929.8 mb
  free-ram  = 3110.95 mb
  buffer-ram= 354.309 mb
  total-swap= 4094.55 mb
  free-swap = 4094.32 mb
  addr  = 0x7926f588

event counter: 2
eventid: [run,evt,lumi,time,bunchcross,detmask] = [122096,3800796,718,1246772791:995107520,1346,0x1c1fc3ffffff7]
last incident: athenaeventloopmgr:beginevent
current algorithm: moosegmentmaker
algorithm stack: 
   athmasterseq
   athalgseq
   moosegmentmaker
-------------------------------------------------------------------------------------

(pid=28625 ppid=27520) received fatal signal 11 (segmentation fault)
signal context:
  signo  = 11, errno = 0, code = 2 (invalid permissions for mapped object)
  pid    = 2032596360, uid = 6102145
  value  = (360, 0x168)
  addr   = 0x7926f588
  stack  = (2, 0, (nil))

  eip: 0023:7926f588           eflags: 00210282
  eax: 1a007690   ebx: 7917e6a4   ecx: e30c04cc   edx: 7926f7a8
  esi: c030329e   edi: 2f2b4548   ebp: ffe9d8f8   esp: ffe9d73c
   ds: 002b        es: 002b        fs: 0000        ss: 002b

  signal esp: ffe9d73c  trap: 14/21  oldmask: 00000000   cr2: 7926f588

  fpu:  control = ffff037f
        status  = ffff0020
        tag     = ffffffff
        ip      = 0010:7911a9b8
        data    = 002b:00000000
        state   = 00000020
    %fp0 = [8000:0000000000000000]
    %fp1 = [bff4:d000fe16f6d0cf15]
    %fp2 = [0000:0000000000000000]
    %fp3 = [bff1:7720bbb58264ac8d]
    %fp4 = [3ff9:4800941027c5b1e4]
    %fp5 = [bffd:4ff8057ccac0f43e]
    %fp6 = [c003:60006026f7188194]
    %fp7 = [c003:60006026f7188194]

stack trace:
 0x59de8270 athena::debugaids::stacktrace(int) + 0x60 [/afs/cern.ch/atlas/software/builds/nightlies/devval/atlascore/rel_2/installarea/i686-slc5-gcc43-opt/lib/libcxxutils.so]
 0x59de908f athena::signal::fataldump(int, siginfo*, void*) + 0xff [/afs/cern.ch/atlas/software/builds/nightlies/devval/atlascore/rel_2/installarea/i686-slc5-gcc43-opt/lib/libcxxutils.so]
 0x59de93a1 athena::signal::fatal(int, siginfo*, void*) + 0x181 [/afs/cern.ch/atlas/software/builds/nightlies/devval/atlascore/rel_2/installarea/i686-slc5-gcc43-opt/lib/libcxxutils.so]
 0x5e5835e6 coredumpsvchandler::action(int, siginfo*, void*) + 0x106 [/afs/cern.ch/atlas/software/builds/nightlies/devval/atlascore/rel_2/installarea/i686-slc5-gcc43-opt/lib/libathenaservices.so]
 0xffffe600 &lt;unknown function&gt;
 0x7926f588 _ztvn4muon17muoncosmictoftoole + 0x88 [/afs/cern.ch/atlas/software/builds/nightlies/devval/atlasreconstruction/rel_2/installarea/i686-slc5-gcc43-opt/lib/libmuoncosmictools.so]
 0x791304ca muon::dcmathsegmentmaker::find(hepgeom::point3d&lt;double&gt; const&amp;, hepgeom::vector3d&lt;double&gt; const&amp;, std::vector&lt;muon::mdtdriftcircleontrack const*, std::allocator&lt;muon::mdtdriftcircleontrack const*&gt; &gt; const&amp;, std::vector&lt;muon::muonclusterontrack const*, std::allocator&lt;muon::muonclusterontrack const*&gt; &gt; const&amp;, bool, double) + 0x187a [/afs/cern.ch/atlas/software/builds/nightlies/devval/atlasreconstruction/rel_2/installarea/i686-slc5-gcc43-opt/lib/libdcmathsegmentmaker.so]
 0x790b8525 muon::muonpatternsegmentmaker::find(muon::muonpatterncombination const&amp;) const + 0x205 [/afs/cern.ch/atlas/software/builds/nightlies/devval/atlasreconstruction/rel_2/installarea/i686-slc5-gcc43-opt/lib/libmuonpatternsegmentmaker.so]
 0x790b9b3c muon::muonpatternsegmentmaker::find(datavector&lt;muon::muonpatterncombination, datamodel_detail::nobase&gt; const&amp;) const + 0xac [/afs/cern.ch/atlas/software/builds/nightlies/devval/atlasreconstruction/rel_2/installarea/i686-slc5-gcc43-opt/lib/libmuonpatternsegmentmaker.so]
 0x6d9a53b4 muon::moosegmentcombinationfinder::findsegments(std::vector&lt;muon::muonprepdatacollection&lt;muon::mdtprepdata&gt; const*, std::allocator&lt;muon::muonprepdatacollection&lt;muon::mdtprepdata&gt; const*&gt; &gt; const&amp;, std::vector&lt;muon::muonprepdatacollection&lt;muon::cscprepdata&gt; const*, std::allocator&lt;muon::muonprepdatacollection&lt;muon::cscprepdata&gt; const*&gt; &gt; const&amp;, std::vector&lt;muon::muonprepdatacollection&lt;muon::tgcprepdata&gt; const*, std::allocator&lt;muon::muonprepdatacollection&lt;muon::tgcprepdata&gt; const*&gt; &gt; const&amp;, std::vector&lt;muon::muonprepdatacollection&lt;muon::rpcprepdata&gt; const*, std::allocator&lt;muon::muonprepdatacollection&lt;muon::rpcprepdata&gt; const*&gt; &gt; const&amp;) + 0x824 [/afs/cern.ch/atlas/software/builds/nightlies/devval/atlasreconstruction/rel_2/installarea/i686-slc5-gcc43-opt/lib/libmoosegmentcombinationfinder.so]
 0x6d97dcb9 moosegmentfinderalg::execute() + 0x149 [/afs/cern.ch/atlas/software/builds/nightlies/devval/atlasreconstruction/rel_2/installarea/i686-slc5-gcc43-opt/lib/libmoosegmentcombinationfinder.so]
 0x5929c54d algorithm::sysexecute() + 0x11d [/afs/cern.ch/atlas/software/builds/nightlies/devval/gaudi/rel_2/installarea/i686-slc5-gcc43-opt/lib/libgaudikernel.so]
 0x6af006a3 athsequencer::execute() + 0x2d3 [/afs/cern.ch/atlas/software/builds/nightlies/devval/atlascore/rel_2/installarea/i686-slc5-gcc43-opt/lib/libgaudisequencer.so]
 0x5929c54d algorithm::sysexecute() + 0x11d [/afs/cern.ch/atlas/software/builds/nightlies/devval/gaudi/rel_2/installarea/i686-slc5-gcc43-opt/lib/libgaudikernel.so]
 0x6af006a3 athsequencer::execute() + 0x2d3 [/afs/cern.ch/atlas/software/builds/nightlies/devval/atlascore/rel_2/installarea/i686-slc5-gcc43-opt/lib/libgaudisequencer.so]
 0x5929c54d algorithm::sysexecute() + 0x11d [/afs/cern.ch/atlas/software/builds/nightlies/devval/gaudi/rel_2/installarea/i686-slc5-gcc43-opt/lib/libgaudikernel.so]
 0x5e59d7ef athenaeventloopmgr::executealgorithms() + 0x6f [/afs/cern.ch/atlas/software/builds/nightlies/devval/atlascore/rel_2/installarea/i686-slc5-gcc43-opt/lib/libathenaservices.so]
 0x5e5a2e00 athenaeventloopmgr::executeevent(void*) + 0x930 [/afs/cern.ch/atlas/software/builds/nightlies/devval/atlascore/rel_2/installarea/i686-slc5-gcc43-opt/lib/libathenaservices.so]
 0x5e5a15a2 athenaeventloopmgr::nextevent(int) + 0x7b2 [/afs/cern.ch/atlas/software/builds/nightlies/devval/atlascore/rel_2/installarea/i686-slc5-gcc43-opt/lib/libathenaservices.so]
 0x5e59b31b athenaeventloopmgr::executerun(int) + 0x1b [/afs/cern.ch/atlas/software/builds/nightlies/devval/atlascore/rel_2/installarea/i686-slc5-gcc43-opt/lib/libathenaservices.so]
 0x5dd4f599 applicationmgr::executerun(int) + 0x79 [/afs/cern.ch/atlas/software/builds/nightlies/devval/gaudi/rel_2/installarea/i686-slc5-gcc43-opt/lib/libgaudisvc.so]
ï¿½0x5d469f0d _zn12_global__n_1l11method_4289epvs0_rkst6vectoris0_sais0_ees0_ dictionary_dict.cpp:0 + 0x5d469f0d [/afs/cern.ch/atlas/software/builds/nightlies/devval/gaudi/rel_2/installarea/i686-slc5-gcc43-opt/lib/libgaudikerneldict.so]
 0x5891ea17 root::cintex::method_stub_with_context(root::cintex::stubcontext_t*, g__value*, char const*, g__param*, int) + 0x157 [/afs/cern.ch/atlas/offline/external/lcgcmt/lcgcmt_60a/installarea/i686-slc5-gcc43-opt/lib/libcintex.so]
 0x5e1e4034 &lt;unknown function&gt;
 0x56194572 cint::g__callfunc::execute(void*) + 0xd2 [/afs/cern.ch/atlas/offline/external/lcgcmt/lcgcmt_60a/installarea/i686-slc5-gcc43-opt/lib/libcint.so]
 0x5598a72c pyroot::trootobjectbyvalueexecutor::execute(cint::g__callfunc*, void*) + 0x2c [/afs/cern.ch/sw/lcg/app/releases/root/5.28.00a/i686-slc5-gcc43-opt/root/lib/libpyroot.so]
 0x55991104 pyroot::tmethodholder&lt;pyroot::tscopeadapter, pyroot::tmemberadapter&gt;::callsafe(void*) + 0x64 [/afs/cern.ch/sw/lcg/app/releases/root/5.28.00a/i686-slc5-gcc43-opt/root/lib/libpyroot.so]
 0x5599129c pyroot::tmethodholder&lt;pyroot::tscopeadapter, pyroot::tmemberadapter&gt;::execute(void*) + 0x6c [/afs/cern.ch/sw/lcg/app/releases/root/5.28.00a/i686-slc5-gcc43-opt/root/lib/libpyroot.so]
 0x5598f7c3 pyroot::tmethodholder&lt;pyroot::tscopeadapter, pyroot::tmemberadapter&gt;::operator()(pyroot::objectproxy*, _object*, _object*, long) + 0x153 [/afs/cern.ch/sw/lcg/app/releases/root/5.28.00a/i686-slc5-gcc43-opt/root/lib/libpyroot.so]
ï¿½0x55996afa pyroot::(anonymous namespace)::mp_call(pyroot::methodproxy*, _object*, _object*) methodproxy.cxx:0 + 0x55996afa [/afs/cern.ch/sw/lcg/app/releases/root/5.28.00a/i686-slc5-gcc43-opt/root/lib/libpyroot.so]
 0x0805d88c pyobject_call /build/agaspar/work/python-2.6.5/objects/abstract.c:2493 + 0x5c [/afs/cern.ch/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080d969d do_call /build/agaspar/work/python-2.6.5/python/ceval.c:3968 + 0x2dfd [/afs/cern.ch/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080ddc8c pyeval_evalcodeex /build/agaspar/work/python-2.6.5/python/ceval.c:3000 + 0x87c [/afs/cern.ch/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080dc329 fast_function /build/agaspar/work/python-2.6.5/python/ceval.c:3846 + 0x5a89 [/afs/cern.ch/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080ddc8c pyeval_evalcodeex /build/agaspar/work/python-2.6.5/python/ceval.c:3000 + 0x87c [/afs/cern.ch/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080dddd3 pyeval_evalcode /build/agaspar/work/python-2.6.5/python/ceval.c:547 + 0x63 [/afs/cern.ch/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080fe044 run_mod /build/agaspar/work/python-2.6.5/python/pythonrun.c:1339 + 0xb4 [/afs/cern.ch/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080d4900 builtin_execfile /build/agaspar/work/python-2.6.5/python/bltinmodule.c:797 + 0x80d4900 [/afs/cern.ch/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x081391bd pycfunction_call /build/agaspar/work/python-2.6.5/objects/methodobject.c:81 + 0x18d [/afs/cern.ch/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080dbd09 call_function /build/agaspar/work/python-2.6.5/python/ceval.c:3750 + 0x5469 [/afs/cern.ch/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080ddc8c pyeval_evalcodeex /build/agaspar/work/python-2.6.5/python/ceval.c:3000 + 0x87c [/afs/cern.ch/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x08137caa function_call /build/agaspar/work/python-2.6.5/objects/funcobject.c:524 + 0x8137caa [/afs/cern.ch/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x0805d88c pyobject_call /build/agaspar/work/python-2.6.5/objects/abstract.c:2493 + 0x5c [/afs/cern.ch/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x08064935 instancemethod_call /build/agaspar/work/python-2.6.5/objects/classobject.c:2579 + 0x8064935 [/afs/cern.ch/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x0805d88c pyobject_call /build/agaspar/work/python-2.6.5/objects/abstract.c:2493 + 0x5c [/afs/cern.ch/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080b29e3 slot_tp_call /build/agaspar/work/python-2.6.5/objects/typeobject.c:5373 + 0x80b29e3 [/afs/cern.ch/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x0805d88c pyobject_call /build/agaspar/work/python-2.6.5/objects/abstract.c:2493 + 0x5c [/afs/cern.ch/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080d969d do_call /build/agaspar/work/python-2.6.5/python/ceval.c:3968 + 0x2dfd [/afs/cern.ch/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080ddc8c pyeval_evalcodeex /build/agaspar/work/python-2.6.5/python/ceval.c:3000 + 0x87c [/afs/cern.ch/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080dddd3 pyeval_evalcode /build/agaspar/work/python-2.6.5/python/ceval.c:547 + 0x63 [/afs/cern.ch/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080fe044 run_mod /build/agaspar/work/python-2.6.5/python/pythonrun.c:1339 + 0xb4 [/afs/cern.ch/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080d4900 builtin_execfile /build/agaspar/work/python-2.6.5/python/bltinmodule.c:797 + 0x80d4900 [/afs/cern.ch/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x081391bd pycfunction_call /build/agaspar/work/python-2.6.5/objects/methodobject.c:81 + 0x18d [/afs/cern.ch/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080dbd09 call_function /build/agaspar/work/python-2.6.5/python/ceval.c:3750 + 0x5469 [/afs/cern.ch/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080ddc8c pyeval_evalcodeex /build/agaspar/work/python-2.6.5/python/ceval.c:3000 + 0x87c [/afs/cern.ch/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x08137caa function_call /build/agaspar/work/python-2.6.5/objects/funcobject.c:524 + 0x8137caa [/afs/cern.ch/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x0805d88c pyobject_call /build/agaspar/work/python-2.6.5/objects/abstract.c:2493 + 0x5c [/afs/cern.ch/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x08064935 instancemethod_call /build/agaspar/work/python-2.6.5/objects/classobject.c:2579 + 0x8064935 [/afs/cern.ch/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x0805d88c pyobject_call /build/agaspar/work/python-2.6.5/objects/abstract.c:2493 + 0x5c [/afs/cern.ch/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080b29e3 slot_tp_call /build/agaspar/work/python-2.6.5/objects/typeobject.c:5373 + 0x80b29e3 [/afs/cern.ch/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x0805d88c pyobject_call /build/agaspar/work/python-2.6.5/objects/abstract.c:2493 + 0x5c [/afs/cern.ch/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080d969d do_call /build/agaspar/work/python-2.6.5/python/ceval.c:3968 + 0x2dfd [/afs/cern.ch/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080ddc8c pyeval_evalcodeex /build/agaspar/work/python-2.6.5/python/ceval.c:3000 + 0x87c [/afs/cern.ch/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080dddd3 pyeval_evalcode /build/agaspar/work/python-2.6.5/python/ceval.c:547 + 0x63 [/afs/cern.ch/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080fe044 run_mod /build/agaspar/work/python-2.6.5/python/pythonrun.c:1339 + 0xb4 [/afs/cern.ch/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080d4900 builtin_execfile /build/agaspar/work/python-2.6.5/python/bltinmodule.c:797 + 0x80d4900 [/afs/cern.ch/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x081391bd pycfunction_call /build/agaspar/work/python-2.6.5/objects/methodobject.c:81 + 0x18d [/afs/cern.ch/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080dbd09 call_function /build/agaspar/work/python-2.6.5/python/ceval.c:3750 + 0x5469 [/afs/cern.ch/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080ddc8c pyeval_evalcodeex /build/agaspar/work/python-2.6.5/python/ceval.c:3000 + 0x87c [/afs/cern.ch/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080dddd3 pyeval_evalcode /build/agaspar/work/python-2.6.5/python/ceval.c:547 + 0x63 [/afs/cern.ch/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080fe044 run_mod /build/agaspar/work/python-2.6.5/python/pythonrun.c:1339 + 0xb4 [/afs/cern.ch/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080fe3a4 pyrun_simplefileexflags /build/agaspar/work/python-2.6.5/python/pythonrun.c:935 + 0x204 [/afs/cern.ch/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080fe69a pyrun_anyfileexflags /build/agaspar/work/python-2.6.5/python/pythonrun.c:739 + 0x7a [/afs/cern.ch/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x08058d46 py_main /build/agaspar/work/python-2.6.5/modules/main.c:572 + 0xc56 [/afs/cern.ch/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x08057e42 main /build/agaspar/work/python-2.6.5/./modules/python.c:24 + 0x32 [/afs/cern.ch/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x0057de9c __libc_start_main + 0xdc [/lib/libc.so.6]
 0x08057d51 _start + 0x8057d51 [/afs/cern.ch/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
py:rawtoesd          info execution of rawtoesd complete with exit code -11.
py:rawtoesd         error transform received signal 11. exit code reset to athena exit code 8.
info: read 109 error categories from file /afs/cern.ch/atlas/software/builds/nightlies/devval/atlascore/rel_2/installarea/share/atlas_error_categories.db
info: read 52 error patterns from file /afs/cern.ch/atlas/software/builds/nightlies/devval/atlascore/rel_2/installarea/share/atlas_error_patterns.db
info: read 58 ignore patterns from file /afs/cern.ch/atlas/software/builds/nightlies/devval/atlascore/rel_2/installarea/share/atlas_error_ignore.db
athenalogchecker start [rawtoesd log] wall-time: tue mar  8 05:43:28 2011, vmem: 111.01953125 mb, rss: 64.66796875 mb
py:rawtoesd          info scanning athena logfile rawtoesd.log assuming atlas release all,rel_2 ...
py:rawtoesd          info athena initialise()...
py:rawtoesd          info athena execute()...
py:rawtoesd          info done scanning 11405 lines of file rawtoesd.log. summary:
py:rawtoesd          info    ignored : 0
py:rawtoesd          info    warnings: 147
py:rawtoesd          info    errors  : 6
py:rawtoesd          info    fatals  : 2
