rtt: 17.x.0-val (rel_4): fpe in l2histoprmvtx_idscan in jobs amitag_q121, amitag_q121_debug and amitag_q121_verbose

logfile snippet:
----------------
-------------------------------------------------------------------------------------
core dump from coredumpsvc on lxb9019.cern.ch at thu aug 18 21:30:24 2011

caught signal 8(floating point exception). details: 
  errno = 0, code = 7 (floating point invalid operation)
  pid   = 2099083398, uid = 1487436437
  value = (-7874581, 0xff87d7eb)
  vmem = 2700.67 mb
  rss  = 2281.34 mb
  total-ram = 15926.4 mb
  free-ram  = 84.3359 mb
  buffer-ram= 240.691 mb
  total-swap= 4094.55 mb
  free-swap = 4090.74 mb
  addr  = 0x7d1d7886

event counter: 1
eventid: [run,evt,lumi,time,bunchcross,detmask] = [105200,31961,10,0:0,203,0x0]
last incident: athenaeventloopmgr:beginevent
current algorithm: l2histoprmvtx_idscan
algorithm stack: 
   athmasterseq
   athalgseq
   trigsteer_l2
   l2histoprmvtx_idscan
-------------------------------------------------------------------------------------

(pid=22781 ppid=22685) received fatal signal 8 (floating point exception)
signal context:
  signo  = 8, errno = 0, code = 7 (floating point invalid operation)
  pid    = 2099083398, uid = 1487436437
  value  = (-7874581, 0xff87d7eb)
  addr   = 0x7d1d7886
  stack  = (2, 0, (nil))

  eip: 0023:7d1d7886           eflags: 00210292
  eax: b1725744   ebx: 7d21f2c0   ecx: 0000000c   edx: b1725740
  esi: 16cfc584   edi: ff87df78   ebp: ff87dbe8   esp: ff87daf0
   ds: 002b        es: 002b        fs: 0000        ss: 002b

  signal esp: ff87daf0  trap: 16/0  oldmask: 00000000   cr2: 00000000

  fpu:  control = ffff0372
        status  = ffffb8a1
        tag     = ffff7fff
        ip      = 0010:7d1d7879
        data    = 002b:ff87db38
        state   = 0000b8a1
    %fp0 = [0000:0000000000000000]
    %fp1 = [8000:0000000000000000]
    %fp2 = [bffc:100081f2fd7ce733]
    %fp3 = [bffe:880006d96f6af1e0]
    %fp4 = [bffe:880006d96f6af1e0]
    %fp5 = [400b:0000000000009d78]
    %fp6 = [3ffe:0000000000008000]
    %fp7 = [3fff:0000000000008000]

stack trace:
 0x5aeb31ba stacktrace ../src/sealdebug.cxx:736   + 0x7a [/afs/cern.ch/atlas/software/builds/nightlies/devval/atlascore/rel_4/installarea/i686-slc5-gcc43-dbg/lib/libcxxutils.so]
 0x5aeb1f18 fataldump ../src/sealsignal.cxx:1397   + 0x214 [/afs/cern.ch/atlas/software/builds/nightlies/devval/atlascore/rel_4/installarea/i686-slc5-gcc43-dbg/lib/libcxxutils.so]
 0x5aeb216e fatal ../src/sealsignal.cxx:898   + 0x1dc [/afs/cern.ch/atlas/software/builds/nightlies/devval/atlascore/rel_4/installarea/i686-slc5-gcc43-dbg/lib/libcxxutils.so]
 0x5d623d83 action ../src/coredumpsvc.cxx:90   + 0x152 [/afs/cern.ch/atlas/software/builds/nightlies/devval/atlascore/rel_4/installarea/i686-slc5-gcc43-dbg/lib/libathenaservices.so]
 0xffffe600 &lt;unknown function&gt;
 0x7d1d7886 findprmvtx ../src/trigt2histoprmvtx.cxx:592   + 0x9b2 [/afs/cern.ch/atlas/software/builds/nightlies/devval/atlastrigger/rel_4/installarea/i686-slc5-gcc43-dbg/lib/libtrigt2histoprmvtx.so]
 0x7d1dc2fb hltexecute ../src/trigt2histoprmvtx.cxx:814   + 0x16ad [/afs/cern.ch/atlas/software/builds/nightlies/devval/atlastrigger/rel_4/installarea/i686-slc5-gcc43-dbg/lib/libtrigt2histoprmvtx.so]
 0x5e0d11f7 plugin_processte ../src/fexalgo.cxx:84   + 0x67 [/afs/cern.ch/atlas/software/builds/nightlies/devval/atlastrigger/rel_4/installarea/i686-slc5-gcc43-dbg/lib/libtriginterfaceslib.so]
 0x5e0dad62 processtes ../src/tecreatealgo.cxx:106   + 0x334 [/afs/cern.ch/atlas/software/builds/nightlies/devval/atlastrigger/rel_4/installarea/i686-slc5-gcc43-dbg/lib/libtriginterfaceslib.so]
 0x5deea7c1 execute ../src/sequence.cxx:285   + 0xda5 [/afs/cern.ch/atlas/software/builds/nightlies/devval/atlastrigger/rel_4/installarea/i686-slc5-gcc43-dbg/lib/libtrigsteeringlib.so]
 0x5def5f47 execute ../src/signature.cxx:134   + 0x261 [/afs/cern.ch/atlas/software/builds/nightlies/devval/atlastrigger/rel_4/installarea/i686-slc5-gcc43-dbg/lib/libtrigsteeringlib.so]
 0x5df000cd executestep ../src/steeringchain.cxx:269   + 0x5eb [/afs/cern.ch/atlas/software/builds/nightlies/devval/atlastrigger/rel_4/installarea/i686-slc5-gcc43-dbg/lib/libtrigsteeringlib.so]
 0x5df0bd54 runchains ../src/trigsteer.cxx:724   + 0x6ce [/afs/cern.ch/atlas/software/builds/nightlies/devval/atlastrigger/rel_4/installarea/i686-slc5-gcc43-dbg/lib/libtrigsteeringlib.so]
 0x5df0ccd3 execute ../src/trigsteer.cxx:521   + 0xbed [/afs/cern.ch/atlas/software/builds/nightlies/devval/atlastrigger/rel_4/installarea/i686-slc5-gcc43-dbg/lib/libtrigsteeringlib.so]
 0x59aab588 sysexecute ../src/lib/algorithm.cpp:602   + 0x278 [/afs/cern.ch/atlas/software/builds/nightlies/devval/gaudi/rel_4/installarea/i686-slc5-gcc43-dbg/lib/libgaudikernel.so]
 0x68ec1ad8 execute ../src/athsequencer.cxx:157   + 0x25c [/afs/cern.ch/atlas/software/builds/nightlies/devval/atlascore/rel_4/installarea/i686-slc5-gcc43-dbg/lib/libgaudisequencer.so]
 0x59aab588 sysexecute ../src/lib/algorithm.cpp:602   + 0x278 [/afs/cern.ch/atlas/software/builds/nightlies/devval/gaudi/rel_4/installarea/i686-slc5-gcc43-dbg/lib/libgaudikernel.so]
 0x68ec1ad8 execute ../src/athsequencer.cxx:157   + 0x25c [/afs/cern.ch/atlas/software/builds/nightlies/devval/atlascore/rel_4/installarea/i686-slc5-gcc43-dbg/lib/libgaudisequencer.so]
 0x59aab588 sysexecute ../src/lib/algorithm.cpp:602   + 0x278 [/afs/cern.ch/atlas/software/builds/nightlies/devval/gaudi/rel_4/installarea/i686-slc5-gcc43-dbg/lib/libgaudikernel.so]
 0x5d59746d executealgorithms ../src/athenaeventloopmgr.cxx:595   + 0x8d [/afs/cern.ch/atlas/software/builds/nightlies/devval/atlascore/rel_4/installarea/i686-slc5-gcc43-dbg/lib/libathenaservices.so]
 0x5d5997b1 executeevent ../src/athenaeventloopmgr.cxx:682   + 0x7f3 [/afs/cern.ch/atlas/software/builds/nightlies/devval/atlascore/rel_4/installarea/i686-slc5-gcc43-dbg/lib/libathenaservices.so]
 0x5d59b44a nextevent ../src/athenaeventloopmgr.cxx:907   + 0xf58 [/afs/cern.ch/atlas/software/builds/nightlies/devval/atlascore/rel_4/installarea/i686-slc5-gcc43-dbg/lib/libathenaservices.so]
 0x5d597990 executerun ../src/athenaeventloopmgr.cxx:753   + 0x30 [/afs/cern.ch/atlas/software/builds/nightlies/devval/atlascore/rel_4/installarea/i686-slc5-gcc43-dbg/lib/libathenaservices.so]
 0x5ca92245 executerun ../src/applicationmgr/applicationmgr.cpp:866   + 0xab [/afs/cern.ch/atlas/software/builds/nightlies/devval/gaudi/rel_4/installarea/i686-slc5-gcc43-dbg/lib/libgaudisvc.so]
 0x5bdefbc3 method_4307 ../i686-slc5-gcc43-dbg/dict/gaudikernel/dictionary_dict.cpp:5751   + 0x5bdefbc3 [/afs/cern.ch/atlas/software/builds/nightlies/devval/gaudi/rel_4/installarea/i686-slc5-gcc43-dbg/lib/libgaudikerneldict.so]
 0x584d2aba method_stub_with_context /build/bellenot/spi/i686-slc5-gcc43-dbg/root/cint/cintex/src/cintfunctional.cxx:320   + 0x1c9 [/afs/cern.ch/atlas/offline/external/lcgcmt/lcgcmt_60c/installarea/i686-slc5-gcc43-dbg/lib/libcintex.so]
 0x5d001034 &lt;unknown function&gt;
 0x5623ff49 execute cint/cint/src/callfunc.cxx:440   + 0x18b [/afs/cern.ch/atlas/offline/external/lcgcmt/lcgcmt_60c/installarea/i686-slc5-gcc43-dbg/lib/libcint.so]
 0x558ef0b7 execint include/callfunc.h:98   + 0x2b [/afs/cern.ch/sw/lcg/app/releases/root/5.28.00e/i686-slc5-gcc43-dbg/root/lib/libpyroot.so]
 0x558ebf52 execute /build/bellenot/spi/i686-slc5-gcc43-dbg/root/bindings/pyroot/src/executors.cxx:229   + 0x24 [/afs/cern.ch/sw/lcg/app/releases/root/5.28.00e/i686-slc5-gcc43-dbg/root/lib/libpyroot.so]
 0x558f5cc6 callfast /build/bellenot/spi/i686-slc5-gcc43-dbg/root/bindings/pyroot/src/methodholder.cxx:94   + 0x4c [/afs/cern.ch/sw/lcg/app/releases/root/5.28.00e/i686-slc5-gcc43-dbg/root/lib/libpyroot.so]
 0x558f5e79 callsafe /build/bellenot/spi/i686-slc5-gcc43-dbg/root/bindings/pyroot/src/methodholder.cxx:118   + 0xa1 [/afs/cern.ch/sw/lcg/app/releases/root/5.28.00e/i686-slc5-gcc43-dbg/root/lib/libpyroot.so]
 0x558facd2 execute /build/bellenot/spi/i686-slc5-gcc43-dbg/root/bindings/pyroot/src/methodholder.cxx:627   + 0x104 [/afs/cern.ch/sw/lcg/app/releases/root/5.28.00e/i686-slc5-gcc43-dbg/root/lib/libpyroot.so]
 0x558f72bf operator() /build/bellenot/spi/i686-slc5-gcc43-dbg/root/bindings/pyroot/src/methodholder.cxx:690   + 0x23f [/afs/cern.ch/sw/lcg/app/releases/root/5.28.00e/i686-slc5-gcc43-dbg/root/lib/libpyroot.so]
 0x558fe100 mp_call /build/bellenot/spi/i686-slc5-gcc43-dbg/root/bindings/pyroot/src/methodproxy.cxx:476   + 0x558fe100 [/afs/cern.ch/sw/lcg/app/releases/root/5.28.00e/i686-slc5-gcc43-dbg/root/lib/libpyroot.so]
 0x0805d88c pyobject_call objects/abstract.c:2493   + 0x5c [/afs/cern.ch/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080d969d do_call inlined at python/ceval.c:3773 in pyeval_evalframeex python/ceval.c:3968   + 0x2dfd [/afs/cern.ch/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080ddc8c pyeval_evalcodeex python/ceval.c:3000   + 0x87c [/afs/cern.ch/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080dc329 fast_function inlined at python/ceval.c:3771 in pyeval_evalframeex python/ceval.c:3846   + 0x5a89 [/afs/cern.ch/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080ddc8c pyeval_evalcodeex python/ceval.c:3000   + 0x87c [/afs/cern.ch/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080dddd3 pyeval_evalcode python/ceval.c:547   + 0x63 [/afs/cern.ch/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080fe044 run_mod inlined at python/pythonrun.c:1325 in pyrun_fileexflags python/pythonrun.c:1339   + 0xb4 [/afs/cern.ch/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080d4900 builtin_execfile python/bltinmodule.c:797   + 0x80d4900 [/afs/cern.ch/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x081391bd pycfunction_call objects/methodobject.c:81   + 0x18d [/afs/cern.ch/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080dbd09 call_function inlined at python/ceval.c:2412 in pyeval_evalframeex python/ceval.c:3750   + 0x5469 [/afs/cern.ch/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080ddc8c pyeval_evalcodeex python/ceval.c:3000   + 0x87c [/afs/cern.ch/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x08137caa function_call objects/funcobject.c:524   + 0x8137caa [/afs/cern.ch/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x0805d88c pyobject_call objects/abstract.c:2493   + 0x5c [/afs/cern.ch/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x08064935 instancemethod_call objects/classobject.c:2579   + 0x8064935 [/afs/cern.ch/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x0805d88c pyobject_call objects/abstract.c:2493   + 0x5c [/afs/cern.ch/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080b29e3 slot_tp_call objects/typeobject.c:5373   + 0x80b29e3 [/afs/cern.ch/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x0805d88c pyobject_call objects/abstract.c:2493   + 0x5c [/afs/cern.ch/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080d969d do_call inlined at python/ceval.c:3773 in pyeval_evalframeex python/ceval.c:3968   + 0x2dfd [/afs/cern.ch/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080ddc8c pyeval_evalcodeex python/ceval.c:3000   + 0x87c [/afs/cern.ch/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080dddd3 pyeval_evalcode python/ceval.c:547   + 0x63 [/afs/cern.ch/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080fe044 run_mod inlined at python/pythonrun.c:1325 in pyrun_fileexflags python/pythonrun.c:1339   + 0xb4 [/afs/cern.ch/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080d4900 builtin_execfile python/bltinmodule.c:797   + 0x80d4900 [/afs/cern.ch/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x081391bd pycfunction_call objects/methodobject.c:81   + 0x18d [/afs/cern.ch/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080dbd09 call_function inlined at python/ceval.c:2412 in pyeval_evalframeex python/ceval.c:3750   + 0x5469 [/afs/cern.ch/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080ddc8c pyeval_evalcodeex python/ceval.c:3000   + 0x87c [/afs/cern.ch/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x08137caa function_call objects/funcobject.c:524   + 0x8137caa [/afs/cern.ch/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x0805d88c pyobject_call objects/abstract.c:2493   + 0x5c [/afs/cern.ch/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x08064935 instancemethod_call objects/classobject.c:2579   + 0x8064935 [/afs/cern.ch/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x0805d88c pyobject_call objects/abstract.c:2493   + 0x5c [/afs/cern.ch/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080b29e3 slot_tp_call objects/typeobject.c:5373   + 0x80b29e3 [/afs/cern.ch/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x0805d88c pyobject_call objects/abstract.c:2493   + 0x5c [/afs/cern.ch/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080d969d do_call inlined at python/ceval.c:3773 in pyeval_evalframeex python/ceval.c:3968   + 0x2dfd [/afs/cern.ch/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080ddc8c pyeval_evalcodeex python/ceval.c:3000   + 0x87c [/afs/cern.ch/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080dddd3 pyeval_evalcode python/ceval.c:547   + 0x63 [/afs/cern.ch/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080fe044 run_mod inlined at python/pythonrun.c:1325 in pyrun_fileexflags python/pythonrun.c:1339   + 0xb4 [/afs/cern.ch/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080fe3a4 pyrun_simplefileexflags python/pythonrun.c:935   + 0x204 [/afs/cern.ch/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080fe69a pyrun_anyfileexflags python/pythonrun.c:739   + 0x7a [/afs/cern.ch/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x08058d46 py_main modules/main.c:572   + 0xc56 [/afs/cern.ch/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x08057e42 main ./modules/python.c:24   + 0x32 [/afs/cern.ch/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x005fbe9c __libc_start_main  + 0xdc [/lib/libc.so.6]
 0x08057d51 _start ??:0   + 0x8057d51 [/afs/cern.ch/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
py:rawtoesd          info rawtoesd has completed running of athena with exit code -8.
py:rawtoesd         error athena received signal 8. exit code reset to athena exit code 8.

command:
--------
/afs/cern.ch/atlas/software/builds/nightlies/devval/atlasreconstruction/rel_4/installarea/share/bin/reco_trf.py --uploadtoami=1.0 ami=q121

logfile:
--------
https://atlasrtt.cern.ch/rtt/rel_4/devval/build/i686-slc5-gcc43-dbg/offline/recjobtransformtests/amitag_q121/amitag_q121_log

please consult:
---------------
https://twiki.cern.ch/twiki/bin/viewauth/atlas/recbuginvestigation

camille (valshift)