in run 00179804, 6 reconstruction jobs failed with the same crash : 

current algorithm: muontrackmonmanager
algorithm stack: 
   athmasterseq
   athalgseq
   muontrackmonmanager


details :
------------------------
sun apr 17 06:41:44 2011

tzex version is  $revision: 355621 $

&gt;&gt;&gt;&gt;&gt;  start of argdict 

{'--ignoreerrors': 'all',
 '--omitvalidation': 'all',
 'amitag': 'x113',
 'autoconfiguration': 'everything,conditionstag=comcond-es1p*-004-05',
 'inputbsfile': ['data11_7tev.00179804.express_express.daq.raw#data11_7tev.00179804.express_express.daq.raw._lb0335._sfo-10._0001.data'],
 'maxevents': -1,
 'outputaodfile': 'data11_7tev.00179804.express_express.recon.aod.x113#data11_7tev.00179804.express_express.recon.aod.x113._lb0335._sfo-10._0001',
 'outputesdfile': 'data11_7tev.00179804.express_express.recon.esd.x113#data11_7tev.00179804.express_express.recon.esd.x113._lb0335._sfo-10._0001',
 'outputhistfile': 'data11_7tev.00179804.express_express.recon.hist.x113#data11_7tev.00179804.express_express.recon.hist.x113._lb0335._sfo-10._0001',
 'outputntup_muoncalibfile': 'data11_7tev.00179804.express_express.recon.ntup_muoncalib.x113#data11_7tev.00179804.express_express.recon.ntup_muoncalib.x113._lb0335._sfo-10._0001',
 'outputntup_trigfile': 'data11_7tev.00179804.express_express.recon.ntup_trig.x113#data11_7tev.00179804.express_express.recon.ntup_trig.x113._lb0335._sfo-10._0001',
 'outputntup_trkvalidfile': 'data11_7tev.00179804.express_express.recon.ntup_trkvalid.x113#data11_7tev.00179804.express_express.recon.ntup_trkvalid.x113._lb0335._sfo-10._0001',
 'preexec': 'indetflags.usebeamconstraint.set_value_and_lock(false);from calotools.calonoiseflags import jobproperties;jobproperties.calonoiseflags.fixedluminosity.set_value_and_lock(1.45);aodflags.trackparticleslimmer=true;indetflags.selectsctintimehits=true'}
&lt;&lt;&lt;&lt;&lt;  end of argdict 


sun apr 17 06:41:44 2011


stagein

[('data11_7tev.00179804.express_express.daq.raw', 'data11_7tev.00179804.express_express.daq.raw._lb0335._sfo-10._0001.data', '/castor/cern.ch/grid/atlas/daq/merge/2011/00179804/express_express/data11_7tev.00179804.express_express.daq.raw._lb0335._sfo-10._0001.data', 'data11_7tev.00179804.express_express.daq.raw._lb0335._sfo-10._0001.data', 't0atlas', 'stagein', 'expraw')]


sun apr 17 06:41:44 2011


-----&gt;  staging in  data11_7tev.00179804.express_express.daq.raw._lb0335._sfo-10._0001.data

export stage_svcclass=t0atlas ; export stage_host=castoratlas ; umask 7 ;  rfcp /castor/cern.ch/grid/atlas/daq/merge/2011/00179804/express_express/data11_7tev.00179804.express_express.daq.raw._lb0335._sfo-10._0001.data data11_7tev.00179804.express_express.daq.raw._lb0335._sfo-10._0001.data
0 217795212 bytes in 3 seconds through eth0 (in) and local (out) (70896 kb/sec)
217795212 bytes in remote file

0 217795212 bytes in 3 seconds through eth0 (in) and local (out) (70896 kb/sec)
217795212 bytes in remote file

logging: connection succeeded
logging: executing...
insert into cpattempt (source,dest,retrynr,exitcode,erroracronym,startepoch,           endepoch,stdboth,filesize,server,transfertime,type,filetype,svcclass) values (:source,:dest,:retrynr,:exitcode,:eacro,:startepoch, :endepoch,:stdboth,          :filesize, :server, :transfertime, :type, :filetype, :svcclass)
{'retrynr': 1, 'svcclass': 't0atlas', 'eacro': 'ok', 'dest': 'data11_7tev.00179804.express_express.daq.raw._lb0335._sfo-10._0001.data', 'startepoch': 1303015304, 'endepoch': 1303015317, 'filesize': 217795212, 'server': '', 'source': '/castor/cern.ch/grid/atlas/daq/merge/2011/00179804/express_express/data11_7tev.00179804.express_express.daq.raw._lb0335._sfo-10._0001.data', 'transfertime': 3, 'stdboth': '217795212 bytes in 3 seconds through eth0 (in) and local (out) (70896 kb/sec)\n217795212 bytes in remote file\n\n', 'type': 'stagein', 'filetype': 'expraw', 'exitcode': 0}
logging: connection closed
ok 13366 13298 [(0, 1, '217795212 bytes in 3 seconds through eth0 (in) and local (out) (70896 kb/sec)\n217795212 bytes in remote file\n\n', 1303015304, 1303015317)]
staging in took  13 seconds ok

stagein succeeded

sun apr 17 06:41:57 2011


sun apr 17 06:41:58 2011


trans start

source /afs/cern.ch/atlas/tzero/prod1/inst/projects/data11/setup/setuptrf.sh /afs/cern.ch/atlas/tzero/prod1/inst/projects/data11/patches/atlasproduction-16.6.3.7 atlasproduction-16.6.3.7 /afs/cern.ch/atlas/tzero/prod1/inst/projects/data11/setup/specialsetup_tier0.sh ; python -u `which reco_trf.py` --argdict=/afs/cern.ch/atlas/tzero/prod1/log1/10294/10294603_data11_7tev.00179804.express_express.daq.raw.x113.recon.task._lb0335._sfo-10._0001.job.3//data11_7tev.00179804.express_express.daq.raw.x113.recon.task._lb0335._sfo-10._0001.job.argdict.gpickle  &amp;&gt; data11_7tev.00179804.express_express.daq.raw.x113.recon.task._lb0335._sfo-10._0001.job.tmp.log
created local authentication.xml file
created local dblookup.xml file
copied geometry db file from /afs/cern.ch/atlas/conditions/geomdb_tier0/geomdb/geomdb_sqlite
all done
unsetting frontier_server ...
setting coral_dblookup_path to  /pool/lsf/atlast0/133949831:/afs/cern.ch/atlas/software/releases/16.6.3/dbrelease/current/xmlconfig
setting coral_auth_path to  /pool/lsf/atlast0/133949831:/afs/cern.ch/atlas/tzero/prod1/inst/var/private:/afs/cern.ch/atlas/software/releases/16.6.3/dbrelease/current/xmlconfig:/afs/cern.ch/atlas/tzero/prod1/inst/var/private

trans end


sun apr 17 07:15:46 2011


tail of logfile 
&gt;&gt;&gt;
toolsvc.cscsegmvalalg                                info registering histogram: muboy_segm_qsumetagoodclusperlayer_ec with group: muon/muonsegmentmonitoring/endcapc/overview/convertedmboysegments/csc
toolsvc.cscsegmvalalg                                info registering histogram: muboy_segm_etaclusterstatus_ea with group: muon/muonsegmentmonitoring/endcapa/detail/convertedmboysegments/csc
toolsvc.cscsegmvalalg                                info registering histogram: muboy_segm_etaclusterstatus_ec with group: muon/muonsegmentmonitoring/endcapc/detail/convertedmboysegments/csc
toolsvc.cscsegmvalalg                                info registering histogram: muboy_segm_numetacluster_ea with group: muon/muonsegmentmonitoring/endcapa/detail/convertedmboysegments/csc
toolsvc.cscsegmvalalg                                info registering histogram: muboy_segm_numetacluster_ec with group: muon/muonsegmentmonitoring/endcapc/detail/convertedmboysegments/csc
toolsvc.cscsegmvalalg                                info registering histogram: muboy_segm_numgoodetacluster_ea with group: muon/muonsegmentmonitoring/endcapa/detail/convertedmboysegments/csc
toolsvc.cscsegmvalalg                                info registering histogram: muboy_segm_numgoodetacluster_ec with group: muon/muonsegmentmonitoring/endcapc/detail/convertedmboysegments/csc
toolsvc.cscsegmvalalg                                info registering histogram: muboy_segm_qsumetacluster_ea with group: muon/muonsegmentmonitoring/endcapa/detail/convertedmboysegments/csc
toolsvc.cscsegmvalalg                                info registering histogram: muboy_segm_qsumetacluster_ec with group: muon/muonsegmentmonitoring/endcapc/detail/convertedmboysegments/csc
toolsvc.cscsegmvalalg                                info registering histogram: muboy_segm_qsumgoodetacluster_ea with group: muon/muonsegmentmonitoring/endcapa/detail/convertedmboysegments/csc
toolsvc.cscsegmvalalg                                info registering histogram: muboy_segm_qsumgoodetacluster_ec with group: muon/muonsegmentmonitoring/endcapc/detail/convertedmboysegments/csc
toolsvc.cscsegmvalalg                                info registering histogram: muboy_segm_qsumphigoodclusperlayer_ea with group: muon/muonsegmentmonitoring/endcapa/overview/convertedmboysegments/csc
toolsvc.cscsegmvalalg                                info registering histogram: muboy_segm_qsumphigoodclusperlayer_ec with group: muon/muonsegmentmonitoring/endcapc/overview/convertedmboysegments/csc
toolsvc.cscsegmvalalg                                info registering histogram: muboy_segm_phiclusterstatus_ea with group: muon/muonsegmentmonitoring/endcapa/detail/convertedmboysegments/csc
toolsvc.cscsegmvalalg                                info registering histogram: muboy_segm_phiclusterstatus_ec with group: muon/muonsegmentmonitoring/endcapc/detail/convertedmboysegments/csc
toolsvc.cscsegmvalalg                                info registering histogram: muboy_segm_numphicluster_ea with group: muon/muonsegmentmonitoring/endcapa/detail/convertedmboysegments/csc
toolsvc.cscsegmvalalg                                info registering histogram: muboy_segm_numphicluster_ec with group: muon/muonsegmentmonitoring/endcapc/detail/convertedmboysegments/csc
toolsvc.cscsegmvalalg                                info registering histogram: muboy_segm_numgoodphicluster_ea with group: muon/muonsegmentmonitoring/endcapa/detail/convertedmboysegments/csc
toolsvc.cscsegmvalalg                                info registering histogram: muboy_segm_numgoodphicluster_ec with group: muon/muonsegmentmonitoring/endcapc/detail/convertedmboysegments/csc
toolsvc.cscsegmvalalg                                info registering histogram: muboy_segm_qsumphicluster_ea with group: muon/muonsegmentmonitoring/endcapa/detail/convertedmboysegments/csc
toolsvc.cscsegmvalalg                                info registering histogram: muboy_segm_qsumphicluster_ec with group: muon/muonsegmentmonitoring/endcapc/detail/convertedmboysegments/csc
toolsvc.cscsegmvalalg                                info registering histogram: muboy_segm_qsumgoodphicluster_ea with group: muon/muonsegmentmonitoring/endcapa/detail/convertedmboysegments/csc
toolsvc.cscsegmvalalg                                info registering histogram: muboy_segm_qsumgoodphicluster_ec with group: muon/muonsegmentmonitoring/endcapc/detail/convertedmboysegments/csc
toolsvc.cscsegmvalalg                                info registering histogram: muboy_segm_qsumgoodcluscorrelation_ea with group: muon/muonsegmentmonitoring/endcapa/detail/convertedmboysegments/csc
toolsvc.cscsegmvalalg                                info registering histogram: muboy_segm_qsumgoodcluscorrelation_ec with group: muon/muonsegmentmonitoring/endcapc/detail/convertedmboysegments/csc
toolsvc.cscsegmvalalg                                info registering histogram: moore_segm_numsegments_ea with group: muon/muonsegmentmonitoring/endcapa/overview/mooresegments/csc
toolsvc.cscsegmvalalg                                info registering histogram: moore_segm_numsegments_ec with group: muon/muonsegmentmonitoring/endcapc/overview/mooresegments/csc
toolsvc.cscsegmvalalg                                info registering histogram: moore_segm_numnclussegments_ea with group: muon/muonsegmentmonitoring/endcapa/detail/mooresegments/csc
toolsvc.cscsegmvalalg                                info registering histogram: moore_segm_numnclussegments_ec with group: muon/muonsegmentmonitoring/endcapc/detail/mooresegments/csc
toolsvc.cscsegmvalalg                                info registering histogram: moore_segm_efficiency_ea with group: muon/muonsegmentmonitoring/endcapa/overview/mooresegments/csc
toolsvc.cscsegmvalalg                                info registering histogram: moore_segm_efficiency_ec with group: muon/muonsegmentmonitoring/endcapc/overview/mooresegments/csc
toolsvc.cscsegmvalalg                                info registering histogram: moore_segm_qsumetagoodclusperlayer_ea with group: muon/muonsegmentmonitoring/endcapa/overview/mooresegments/csc
toolsvc.cscsegmvalalg                                info registering histogram: moore_segm_qsumetagoodclusperlayer_ec with group: muon/muonsegmentmonitoring/endcapc/overview/mooresegments/csc
toolsvc.cscsegmvalalg                                info registering histogram: moore_segm_etaclusterstatus_ea with group: muon/muonsegmentmonitoring/endcapa/detail/mooresegments/csc
toolsvc.cscsegmvalalg                                info registering histogram: moore_segm_etaclusterstatus_ec with group: muon/muonsegmentmonitoring/endcapc/detail/mooresegments/csc
toolsvc.cscsegmvalalg                                info registering histogram: moore_segm_numetacluster_ea with group: muon/muonsegmentmonitoring/endcapa/detail/mooresegments/csc
toolsvc.cscsegmvalalg                                info registering histogram: moore_segm_numetacluster_ec with group: muon/muonsegmentmonitoring/endcapc/detail/mooresegments/csc
toolsvc.cscsegmvalalg                                info registering histogram: moore_segm_numgoodetacluster_ea with group: muon/muonsegmentmonitoring/endcapa/detail/mooresegments/csc
toolsvc.cscsegmvalalg                                info registering histogram: moore_segm_numgoodetacluster_ec with group: muon/muonsegmentmonitoring/endcapc/detail/mooresegments/csc
toolsvc.cscsegmvalalg                                info registering histogram: moore_segm_qsumetacluster_ea with group: muon/muonsegmentmonitoring/endcapa/detail/mooresegments/csc
toolsvc.cscsegmvalalg                                info registering histogram: moore_segm_qsumetacluster_ec with group: muon/muonsegmentmonitoring/endcapc/detail/mooresegments/csc
toolsvc.cscsegmvalalg                                info registering histogram: moore_segm_qsumgoodetacluster_ea with group: muon/muonsegmentmonitoring/endcapa/detail/mooresegments/csc
toolsvc.cscsegmvalalg                                info registering histogram: moore_segm_qsumgoodetacluster_ec with group: muon/muonsegmentmonitoring/endcapc/detail/mooresegments/csc
toolsvc.cscsegmvalalg                                info registering histogram: moore_segm_qsumphigoodclusperlayer_ea with group: muon/muonsegmentmonitoring/endcapa/overview/mooresegments/csc
toolsvc.cscsegmvalalg                                info registering histogram: moore_segm_qsumphigoodclusperlayer_ec with group: muon/muonsegmentmonitoring/endcapc/overview/mooresegments/csc
toolsvc.cscsegmvalalg                                info registering histogram: moore_segm_phiclusterstatus_ea with group: muon/muonsegmentmonitoring/endcapa/detail/mooresegments/csc
toolsvc.cscsegmvalalg                                info registering histogram: moore_segm_phiclusterstatus_ec with group: muon/muonsegmentmonitoring/endcapc/detail/mooresegments/csc
toolsvc.cscsegmvalalg                                info registering histogram: moore_segm_numphicluster_ea with group: muon/muonsegmentmonitoring/endcapa/detail/mooresegments/csc
toolsvc.cscsegmvalalg                                info registering histogram: moore_segm_numphicluster_ec with group: muon/muonsegmentmonitoring/endcapc/detail/mooresegments/csc
toolsvc.cscsegmvalalg                                info registering histogram: moore_segm_numgoodphicluster_ea with group: muon/muonsegmentmonitoring/endcapa/detail/mooresegments/csc
toolsvc.cscsegmvalalg                                info registering histogram: moore_segm_numgoodphicluster_ec with group: muon/muonsegmentmonitoring/endcapc/detail/mooresegments/csc
toolsvc.cscsegmvalalg                                info registering histogram: moore_segm_qsumphicluster_ea with group: muon/muonsegmentmonitoring/endcapa/detail/mooresegments/csc
toolsvc.cscsegmvalalg                                info registering histogram: moore_segm_qsumphicluster_ec with group: muon/muonsegmentmonitoring/endcapc/detail/mooresegments/csc
toolsvc.cscsegmvalalg                                info registering histogram: moore_segm_qsumgoodphicluster_ea with group: muon/muonsegmentmonitoring/endcapa/detail/mooresegments/csc
toolsvc.cscsegmvalalg                                info registering histogram: moore_segm_qsumgoodphicluster_ec with group: muon/muonsegmentmonitoring/endcapc/detail/mooresegments/csc
toolsvc.cscsegmvalalg                                info registering histogram: moore_segm_qsumgoodcluscorrelation_ea with group: muon/muonsegmentmonitoring/endcapa/detail/mooresegments/csc
toolsvc.cscsegmvalalg                                info registering histogram: moore_segm_qsumgoodcluscorrelation_ec with group: muon/muonsegmentmonitoring/endcapc/detail/mooresegments/csc
toolsvc.eventcnvsupertool                         warning unknown identifier: unable to decode id, that is (4294952960)
toolsvc.eventcnvsupertool                         warning getsurface: could not get cnv tool. returning detelementsurface with id=.4294952960
-------------------------------------------------------------------------------------
core dump from coredumpsvc on lxbrl2520.cern.ch at sun apr 17 07:15:20 2011

caught signal 11(segmentation fault). details: 
  errno = 0, code = 1 (address not mapped to object)
  pid   = 16, uid = 1433273632
  value = (1552118599, 0x5c837347)
  vmem = 2559.21 mb
  rss  = 1936.44 mb
  total-ram = 15929.1 mb
  free-ram  = 1115.58 mb
  buffer-ram= 123.715 mb
  total-swap= 20481.2 mb
  free-swap = 20435.9 mb
  addr  = 0x10

event counter: 1
eventid: [run,evt,lumi,time,bunchcross,detmask] = [179804,10730244,335,1303006198:4858710,484,0x1fffffffffff7]
last incident: athenaeventloopmgr:beginevent
current algorithm: muontrackmonmanager
algorithm stack: 
   athmasterseq
   athalgseq
   muontrackmonmanager
-------------------------------------------------------------------------------------

(pid=22210 ppid=13019) received fatal signal 11 (segmentation fault)
signal context:
  signo  = 11, errno = 0, code = 1 (address not mapped to object)
  pid    = 16, uid = 1433273632
  value  = (1552118599, 0x5c837347)
  addr   = 0x10
  stack  = (2, 0, (nil))

  eip: 0023:6836174d           eflags: 00010292
  eax: 00000000   ebx: 683a0d9c   ecx: a846aaf8   edx: a846aaf8
  esi: 00000002   edi: ffe1f32c   ebp: ffe1f2a8   esp: ffe1f0a0
   ds: 002b        es: 002b        fs: 0000        ss: 002b

  signal esp: ffe1f0a0  trap: 14/4  oldmask: 00000000   cr2: 00000010

  fpu:  control = ffff037f
        status  = ffff0020
        tag     = ffffffff
        ip      = 0010:587e08a7
        data    = 002b:a82a6be4
        state   = 00000020
    %fp0 = [8000:0000000000000000]
    %fp1 = [bffe:a00071f22aa6ec70]
    %fp2 = [c009:4de7b9a848a58e89]
    %fp3 = [0000:0000000000000000]
    %fp4 = [4007:92804b204469ecac]
    %fp5 = [400b:70d0bc0de145e377]
    %fp6 = [400f:000000000000ad58]
    %fp7 = [401f:000000001c80eac0]

stack trace:
 0x5a3d5340 athena::debugaids::stacktrace(int) + 0x60 [/afs/cern.ch/atlas/software/releases/16.6.3/atlascore/16.6.3/installarea/i686-slc5-gcc43-opt/lib/libcxxutils.so]
 0x5a3d2f8f athena::signal::fataldump(int, siginfo*, void*) + 0xff [/afs/cern.ch/atlas/software/releases/16.6.3/atlascore/16.6.3/installarea/i686-slc5-gcc43-opt/lib/libcxxutils.so]
 0x5a3d32a1 athena::signal::fatal(int, siginfo*, void*) + 0x181 [/afs/cern.ch/atlas/software/releases/16.6.3/atlascore/16.6.3/installarea/i686-slc5-gcc43-opt/lib/libcxxutils.so]
 0x5a195a0e coredumpsvchandler::action(int, siginfo*, void*) + 0xce [/afs/cern.ch/atlas/software/releases/16.6.3/atlascore/16.6.3/installarea/i686-slc5-gcc43-opt/lib/libathenaservices.so]
 0xffffe600 &lt;unknown function&gt;
 0x6836174d muon::muonedmhelpertool::createdetailedtracksummary(trk::track const&amp;) const + 0x18d [/afs/cern.ch/atlas/software/releases/16.6.3/atlasreconstruction/16.6.3/installarea/i686-slc5-gcc43-opt/lib/libmuonrechelpertoolslib.so]
 0x7259fd71 muonselectedtracksmon::filldetailedtrksummaryhistograms(std::string, int) + 0x3b1 [/afs/cern.ch/atlas/software/releases/16.6.3/atlasanalysis/16.6.3/installarea/i686-slc5-gcc43-opt/lib/libmuontrackmonitoring.so]
 0x725a23cb muonselectedtracksmon::fillhistograms() + 0x50b [/afs/cern.ch/atlas/software/releases/16.6.3/atlasanalysis/16.6.3/installarea/i686-slc5-gcc43-opt/lib/libmuontrackmonitoring.so]
 0x668f97df managedmonitortoolbase::fillhists() + 0x4bf [/afs/cern.ch/atlas/software/releases/16.6.3/atlasevent/16.6.3/installarea/i686-slc5-gcc43-opt/lib/libathenamonitoringlib.so]
 0x668e5ae2 athenamonmanager::execute() + 0x592 [/afs/cern.ch/atlas/software/releases/16.6.3/atlasevent/16.6.3/installarea/i686-slc5-gcc43-opt/lib/libathenamonitoringlib.so]
 0x587ba51d algorithm::sysexecute() + 0x11d [/afs/cern.ch/atlas/software/releases/16.6.3/gaudi/v21r9p3a/installarea/i686-slc5-gcc43-opt/lib/libgaudikernel.so]
 0x6681b89b athsequencer::execute() + 0x25b [/afs/cern.ch/atlas/software/releases/16.6.3/atlascore/16.6.3/installarea/i686-slc5-gcc43-opt/lib/libgaudisequencer.so]
 0x587ba51d algorithm::sysexecute() + 0x11d [/afs/cern.ch/atlas/software/releases/16.6.3/gaudi/v21r9p3a/installarea/i686-slc5-gcc43-opt/lib/libgaudikernel.so]
 0x6681b89b athsequencer::execute() + 0x25b [/afs/cern.ch/atlas/software/releases/16.6.3/atlascore/16.6.3/installarea/i686-slc5-gcc43-opt/lib/libgaudisequencer.so]
 0x587ba51d algorithm::sysexecute() + 0x11d [/afs/cern.ch/atlas/software/releases/16.6.3/gaudi/v21r9p3a/installarea/i686-slc5-gcc43-opt/lib/libgaudikernel.so]
 0x5a1c453f athenaeventloopmgr::executealgorithms() + 0x6f [/afs/cern.ch/atlas/software/releases/16.6.3/atlascore/16.6.3/installarea/i686-slc5-gcc43-opt/lib/libathenaservices.so]
 0x5a1cad2e athenaeventloopmgr::executeevent(void*) + 0x83e [/afs/cern.ch/atlas/software/releases/16.6.3/atlascore/16.6.3/installarea/i686-slc5-gcc43-opt/lib/libathenaservices.so]
 0x5a1c9a12 athenaeventloopmgr::nextevent(int) + 0x8a2 [/afs/cern.ch/atlas/software/releases/16.6.3/atlascore/16.6.3/installarea/i686-slc5-gcc43-opt/lib/libathenaservices.so]
 0x5a1c36cb athenaeventloopmgr::executerun(int) + 0x1b [/afs/cern.ch/atlas/software/releases/16.6.3/atlascore/16.6.3/installarea/i686-slc5-gcc43-opt/lib/libathenaservices.so]
 0x599b7a49 applicationmgr::executerun(int) + 0x79 [/afs/cern.ch/atlas/software/releases/16.6.3/gaudi/v21r9p3a/installarea/i686-slc5-gcc43-opt/lib/libgaudisvc.so]
ï¿½0x590bc94d _zn12_global__n_1l11method_4267epvs0_rkst6vectoris0_sais0_ees0_ dictionary_dict.cpp:0 + 0x590bc94d [/afs/cern.ch/atlas/software/releases/16.6.3/gaudi/v21r9p3a/installarea/i686-slc5-gcc43-opt/lib/libgaudikerneldict.so]
 0x57fca437 root::cintex::method_stub_with_context(root::cintex::stubcontext_t*, g__value*, char const*, g__param*, int) + 0x157 [/afs/cern.ch/atlas/software/releases/16.6.3/detcommon/16.6.3/installarea/i686-slc5-gcc43-opt/lib/libcintex.so]
 0x59e36034 &lt;unknown function&gt;
 0x56135512 cint::g__callfunc::execute(void*) + 0xd2 [/afs/cern.ch/atlas/software/releases/16.6.3/detcommon/16.6.3/installarea/i686-slc5-gcc43-opt/lib/libcint.so]
 0x558c2cec pyroot::trootobjectbyvalueexecutor::execute(cint::g__callfunc*, void*) + 0x2c [/afs/cern.ch/atlas/software/releases/16.6.3/sw/lcg/app/releases/root/5.26.00e_python2.6/i686-slc5-gcc43-opt/root/lib/libpyroot.so]
 0x558c8c24 pyroot::tmethodholder&lt;pyroot::tscopeadapter, pyroot::tmemberadapter&gt;::callsafe(void*) + 0x64 [/afs/cern.ch/atlas/software/releases/16.6.3/sw/lcg/app/releases/root/5.26.00e_python2.6/i686-slc5-gcc43-opt/root/lib/libpyroot.so]
 0x558c8dbc pyroot::tmethodholder&lt;pyroot::tscopeadapter, pyroot::tmemberadapter&gt;::execute(void*) + 0x6c [/afs/cern.ch/atlas/software/releases/16.6.3/sw/lcg/app/releases/root/5.26.00e_python2.6/i686-slc5-gcc43-opt/root/lib/libpyroot.so]
 0x558c7a92 pyroot::tmethodholder&lt;pyroot::tscopeadapter, pyroot::tmemberadapter&gt;::operator()(pyroot::objectproxy*, _object*, _object*, long) + 0x112 [/afs/cern.ch/atlas/software/releases/16.6.3/sw/lcg/app/releases/root/5.26.00e_python2.6/i686-slc5-gcc43-opt/root/lib/libpyroot.so]
ï¿½0x558ce859 pyroot::(anonymous namespace)::mp_call(pyroot::methodproxy*, _object*, _object*) methodproxy.cxx:0 + 0x558ce859 [/afs/cern.ch/atlas/software/releases/16.6.3/sw/lcg/app/releases/root/5.26.00e_python2.6/i686-slc5-gcc43-opt/root/lib/libpyroot.so]
 0x0805d88c pyobject_call /build/agaspar/work/python-2.6.5/objects/abstract.c:2493 + 0x5c [/afs/cern.ch/atlas/software/releases/16.6.3/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080d969d do_call /build/agaspar/work/python-2.6.5/python/ceval.c:3968 + 0x2dfd [/afs/cern.ch/atlas/software/releases/16.6.3/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080ddc8c pyeval_evalcodeex /build/agaspar/work/python-2.6.5/python/ceval.c:3000 + 0x87c [/afs/cern.ch/atlas/software/releases/16.6.3/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080dc329 fast_function /build/agaspar/work/python-2.6.5/python/ceval.c:3846 + 0x5a89 [/afs/cern.ch/atlas/software/releases/16.6.3/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080ddc8c pyeval_evalcodeex /build/agaspar/work/python-2.6.5/python/ceval.c:3000 + 0x87c [/afs/cern.ch/atlas/software/releases/16.6.3/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080dddd3 pyeval_evalcode /build/agaspar/work/python-2.6.5/python/ceval.c:547 + 0x63 [/afs/cern.ch/atlas/software/releases/16.6.3/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080fe044 run_mod /build/agaspar/work/python-2.6.5/python/pythonrun.c:1339 + 0xb4 [/afs/cern.ch/atlas/software/releases/16.6.3/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080d4900 builtin_execfile /build/agaspar/work/python-2.6.5/python/bltinmodule.c:797 + 0x80d4900 [/afs/cern.ch/atlas/software/releases/16.6.3/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x081391bd pycfunction_call /build/agaspar/work/python-2.6.5/objects/methodobject.c:81 + 0x18d [/afs/cern.ch/atlas/software/releases/16.6.3/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080dbd09 call_function /build/agaspar/work/python-2.6.5/python/ceval.c:3750 + 0x5469 [/afs/cern.ch/atlas/software/releases/16.6.3/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080ddc8c pyeval_evalcodeex /build/agaspar/work/python-2.6.5/python/ceval.c:3000 + 0x87c [/afs/cern.ch/atlas/software/releases/16.6.3/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x08137caa function_call /build/agaspar/work/python-2.6.5/objects/funcobject.c:524 + 0x8137caa [/afs/cern.ch/atlas/software/releases/16.6.3/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x0805d88c pyobject_call /build/agaspar/work/python-2.6.5/objects/abstract.c:2493 + 0x5c [/afs/cern.ch/atlas/software/releases/16.6.3/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x08064935 instancemethod_call /build/agaspar/work/python-2.6.5/objects/classobject.c:2579 + 0x8064935 [/afs/cern.ch/atlas/software/releases/16.6.3/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x0805d88c pyobject_call /build/agaspar/work/python-2.6.5/objects/abstract.c:2493 + 0x5c [/afs/cern.ch/atlas/software/releases/16.6.3/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080b29e3 slot_tp_call /build/agaspar/work/python-2.6.5/objects/typeobject.c:5373 + 0x80b29e3 [/afs/cern.ch/atlas/software/releases/16.6.3/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x0805d88c pyobject_call /build/agaspar/work/python-2.6.5/objects/abstract.c:2493 + 0x5c [/afs/cern.ch/atlas/software/releases/16.6.3/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080d969d do_call /build/agaspar/work/python-2.6.5/python/ceval.c:3968 + 0x2dfd [/afs/cern.ch/atlas/software/releases/16.6.3/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080ddc8c pyeval_evalcodeex /build/agaspar/work/python-2.6.5/python/ceval.c:3000 + 0x87c [/afs/cern.ch/atlas/software/releases/16.6.3/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080dddd3 pyeval_evalcode /build/agaspar/work/python-2.6.5/python/ceval.c:547 + 0x63 [/afs/cern.ch/atlas/software/releases/16.6.3/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080fe044 run_mod /build/agaspar/work/python-2.6.5/python/pythonrun.c:1339 + 0xb4 [/afs/cern.ch/atlas/software/releases/16.6.3/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080d4900 builtin_execfile /build/agaspar/work/python-2.6.5/python/bltinmodule.c:797 + 0x80d4900 [/afs/cern.ch/atlas/software/releases/16.6.3/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x081391bd pycfunction_call /build/agaspar/work/python-2.6.5/objects/methodobject.c:81 + 0x18d [/afs/cern.ch/atlas/software/releases/16.6.3/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080dbd09 call_function /build/agaspar/work/python-2.6.5/python/ceval.c:3750 + 0x5469 [/afs/cern.ch/atlas/software/releases/16.6.3/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080ddc8c pyeval_evalcodeex /build/agaspar/work/python-2.6.5/python/ceval.c:3000 + 0x87c [/afs/cern.ch/atlas/software/releases/16.6.3/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x08137caa function_call /build/agaspar/work/python-2.6.5/objects/funcobject.c:524 + 0x8137caa [/afs/cern.ch/atlas/software/releases/16.6.3/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x0805d88c pyobject_call /build/agaspar/work/python-2.6.5/objects/abstract.c:2493 + 0x5c [/afs/cern.ch/atlas/software/releases/16.6.3/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x08064935 instancemethod_call /build/agaspar/work/python-2.6.5/objects/classobject.c:2579 + 0x8064935 [/afs/cern.ch/atlas/software/releases/16.6.3/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x0805d88c pyobject_call /build/agaspar/work/python-2.6.5/objects/abstract.c:2493 + 0x5c [/afs/cern.ch/atlas/software/releases/16.6.3/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080b29e3 slot_tp_call /build/agaspar/work/python-2.6.5/objects/typeobject.c:5373 + 0x80b29e3 [/afs/cern.ch/atlas/software/releases/16.6.3/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x0805d88c pyobject_call /build/agaspar/work/python-2.6.5/objects/abstract.c:2493 + 0x5c [/afs/cern.ch/atlas/software/releases/16.6.3/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080d969d do_call /build/agaspar/work/python-2.6.5/python/ceval.c:3968 + 0x2dfd [/afs/cern.ch/atlas/software/releases/16.6.3/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080ddc8c pyeval_evalcodeex /build/agaspar/work/python-2.6.5/python/ceval.c:3000 + 0x87c [/afs/cern.ch/atlas/software/releases/16.6.3/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080dddd3 pyeval_evalcode /build/agaspar/work/python-2.6.5/python/ceval.c:547 + 0x63 [/afs/cern.ch/atlas/software/releases/16.6.3/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080fe044 run_mod /build/agaspar/work/python-2.6.5/python/pythonrun.c:1339 + 0xb4 [/afs/cern.ch/atlas/software/releases/16.6.3/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080fe3a4 pyrun_simplefileexflags /build/agaspar/work/python-2.6.5/python/pythonrun.c:935 + 0x204 [/afs/cern.ch/atlas/software/releases/16.6.3/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x080fe69a pyrun_anyfileexflags /build/agaspar/work/python-2.6.5/python/pythonrun.c:739 + 0x7a [/afs/cern.ch/atlas/software/releases/16.6.3/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x08058d46 py_main /build/agaspar/work/python-2.6.5/modules/main.c:572 + 0xc56 [/afs/cern.ch/atlas/software/releases/16.6.3/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x08057e42 main /build/agaspar/work/python-2.6.5/./modules/python.c:24 + 0x32 [/afs/cern.ch/atlas/software/releases/16.6.3/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
 0x00139e9c __libc_start_main + 0xdc [/lib/libc.so.6]
 0x08057d51 _start + 0x8057d51 [/afs/cern.ch/atlas/software/releases/16.6.3/sw/lcg/external/python/2.6.5/i686-slc5-gcc43-opt/bin/python]
py:esdtoaod          info execution of esdtoaod complete with exit code -11.
py:esdtoaod         error transform received signal 11. exit code reset to athena exit code 8.
athenalogchecker start [esdtoaod log] wall-time: sun apr 17 05:15:34 2011, vmem: 112.12890625 mb, rss: 67.8125 mb
py:esdtoaod          info scanning athena logfile esdtoaod.log assuming atlas release all,16.6.3.7 ...
py:esdtoaod          info athena initialise()...
py:esdtoaod          info athena execute()...
py:esdtoaod          info done scanning 6302 lines of file esdtoaod.log. summary:
py:esdtoaod          info    ignored : 0
py:esdtoaod          info    warnings: 34
py:esdtoaod          info    errors  : 0
py:esdtoaod          info    fatals  : 2
athenalogchecker stop [esdtoaod log] wall-time: sun apr 17 05:15:34 2011, vmem: 112.12890625 mb, rss: 67.81640625 mb
athenalogchecker report [esdtoaod log] wall-time: 00 hrs 00 mins 00 secs, cpu-time: 00 hrs 00 mins 00 secs, vmem: 0.0 mb, rss: 0.00390625 mb
py:esdtoaod          info jobtransform completed for esdtoaod with error code 60010 (exit code 6)
py:esdtoaod          info transform timer stop [esdtoaod] wall-time: sun apr 17 05:15:34 2011, vmem: 112.12890625 mb, rss: 67.82421875 mb
py:esdtoaod          info transform timer report [esdtoaod] wall-time: 00 hrs 03 mins 59 secs, cpu-time: 00 hrs 02 mins 22 secs, vmem: 0.0 mb, rss: 0.10546875 mb
===== job report produced by esdtoaod version patjobtransforms-00-03-29 =====
command=/afs/cern.ch/atlas/software/releases/16.6.3/atlasproduction/16.6.3.7/installarea/share/bin/reco_trf.py --argdict=/afs/cern.ch/atlas/tzero/prod1/log1/10294/10294603_data11_7tev.00179804.express_express.daq.raw.x113.recon.task._lb0335._sfo-10._0001.job.3//data11_7tev.00179804.express_express.daq.raw.x113.recon.task._lb0335._sfo-10._0001.job.argdict.gpickle
exitcode=6
errorcode=60010 (trf_segfault)
errorcategory=trf_segfault,	60010,	segmentation fault (2 times)
fatals=2
errors=0
warnings=3
writing jobinfo_esdtoaod.xml file...
aodok is  false
skipping esd-&gt;dpd step...
skipping aod-&gt;dpd step...
skipping aod-&gt;tag step...
skipping monitoring file merging step...
py:reco_trf          info jobtransform completed for reco_trf with error code 60010 (exit code 6)
py:esdtoaod          info transform timer stop [reco_trf] wall-time: sun apr 17 05:15:34 2011, vmem: 112.29296875 mb, rss: 67.8984375 mb
py:esdtoaod          info transform timer report [reco_trf] wall-time: 00 hrs 33 mins 19 secs, cpu-time: 00 hrs 29 mins 30 secs, vmem: 0.8515625 mb, rss: 0.8828125 mb
===== job report produced by recotrf =====
command=/afs/cern.ch/atlas/software/releases/16.6.3/atlasproduction/16.6.3.7/installarea/share/bin/reco_trf.py --argdict=/afs/cern.ch/atlas/tzero/prod1/log1/10294/10294603_data11_7tev.00179804.express_express.daq.raw.x113.recon.task._lb0335._sfo-10._0001.job.3//data11_7tev.00179804.express_express.daq.raw.x113.recon.task._lb0335._sfo-10._0001.job.argdict.gpickle
exitcode=6
errorcode=60010 (trf_segfault)
errorcategory=trf_segfault,	60010,	segmentation fault (2 times)
fatals=2
errors=0
warnings=6
file data11_7tev.00179804.express_express.recon.esd.x113._lb0335._sfo-10._0001:
  guid=46545ab3-ad68-e011-ba19-0030486730e6
  metadata:
    amitag=x113
    beamtype=collisions
    filetype=esd
    autoconfiguration=['everything', 'conditionstag=comcond-es1p*-004-05']
    dataset=data11_7tev.00179804.express_express.recon.esd.x113
    maxevents=-1
    conditionstag=comcond-es1pst-004-05
    preexec=['indetflags.usebeamconstraint.set_value_and_lock(false);from calotools.calonoiseflags import jobproperties;jobproperties.calonoiseflags.fixedluminosity.set_value_and_lock(1.45);aodflags.trackparticleslimmer=true;indetflags.selectsctintimehits=true']
    geometryversion=atlas-geo-16-00-01
    events=167
    size=272226450
file data11_7tev.00179804.express_express.recon.ntup_muoncalib.x113._lb0335._sfo-10._0001:
  guid=c7bfd39b-3ef7-436a-825e-1505dca40daa
  metadata:
    amitag=x113
    beamtype=collisions
    filetype=ntup
    autoconfiguration=['everything', 'conditionstag=comcond-es1p*-004-05']
    dataset=data11_7tev.00179804.express_express.recon.ntup_muoncalib.x113
    maxevents=-1
    conditionstag=comcond-es1pst-004-05
    preexec=['indetflags.usebeamconstraint.set_value_and_lock(false);from calotools.calonoiseflags import jobproperties;jobproperties.calonoiseflags.fixedluminosity.set_value_and_lock(1.45);aodflags.trackparticleslimmer=true;indetflags.selectsctintimehits=true']
    geometryversion=atlas-geo-16-00-01
    events=167
    size=16800899
file data11_7tev.00179804.express_express.recon.ntup_trkvalid.x113._lb0335._sfo-10._0001:
  guid=7deec058-a9a3-44b8-b42d-e7d5cb199206
  metadata:
    amitag=x113
    beamtype=collisions
    filetype=ntup
    autoconfiguration=['everything', 'conditionstag=comcond-es1p*-004-05']
    dataset=data11_7tev.00179804.express_express.recon.ntup_trkvalid.x113
    maxevents=-1
    conditionstag=comcond-es1pst-004-05
    preexec=['indetflags.usebeamconstraint.set_value_and_lock(false);from calotools.calonoiseflags import jobproperties;jobproperties.calonoiseflags.fixedluminosity.set_value_and_lock(1.45);aodflags.trackparticleslimmer=true;indetflags.selectsctintimehits=true']
    geometryversion=atlas-geo-16-00-01
    events=167
    size=27378282
errorinfo
  acronym=trf_segfault (60010) segmentation fault
  message=caught signal 11(segmentation fault). details:
  severity=fatal
  producer=esdtoaod
  stage=execute
errorinfo
  acronym=trf_segfault (60010) segmentation fault
  message=(pid=22210 ppid=13019) received fatal signal 11 (segmentation fault)
  severity=fatal
  producer=esdtoaod
  stage=execute
athacronym=an unknown exception occurred
athcode=8
rundiruseddisk=605195890
rundiravailabledisk=263455834112
workdir=/pool/lsf/atlast0/133949831
athcode=0
rundiravailabledisk=263965159424
dbrelease=current
athacronym=successful run
rundiruseddisk=601527661
atlasrelease=16.6.3.7
workdir=/pool/lsf/atlast0/133949831
athcode=8
rundiravailabledisk=263456157696
dbrelease=current
athacronym=an unknown exception occurred
rundiruseddisk=604898802
atlasrelease=16.6.3.7
writing jobinfo_recotrf.xml file...
&lt;&lt;&lt;

ls workdir 
&gt;&gt;&gt;
total 591980
-rw-r--r-- 1 atlast0 zp        67 apr 17 07:15 10294603_data11_7tev.00179804.express_express.daq.raw.x113.recon.task._lb0335._sfo-10._0001.job.3.gpickle
-rw-r--r-- 1 atlast0 zp     37505 apr 17 07:15 10294603_data11_7tev.00179804.express_express.daq.raw.x113.recon.task._lb0335._sfo-10._0001.job.3.log
-rw-r--r-- 1 atlast0 zp     43751 apr 17 07:15 1303015155.133949831.out
-rw-r----- 1 atlast0 zp       125 apr 17 06:41 1303015155.133949831.out.ootw
-rw-r--r-- 1 atlast0 zp      3526 apr 17 07:15 athenasummary_esdtoaod.txt
-rw-r--r-- 1 atlast0 zp     38441 apr 17 07:09 athenasummary_rawtoesd.txt
-rw-r--r-- 1 atlast0 zp     10232 apr 17 07:10 athfile-21450.log.txt
-rw-r--r-- 1 atlast0 zp     10244 apr 17 07:11 athfile-21978.log.txt
-rw-r--r-- 1 atlast0 zp    856544 apr 17 07:11 athfile-cache.ascii
-rw-r--r-- 1 atlast0 zp         0 apr 17 07:09 atrndmgensvc.out
-rw-r--r-- 1 atlast0 zp      5433 apr 17 06:42 authentication.xml
-rw-r--r-- 1 atlast0 zp   4555219 apr 17 07:09 chrono_rawtoesd.txt
-rw-r----- 1 atlast0 zp 217795212 apr 17 06:41 data11_7tev.00179804.express_express.daq.raw._lb0335._sfo-10._0001.data
-rw-r--r-- 1 atlast0 zp   4949388 apr 17 07:15 data11_7tev.00179804.express_express.daq.raw.x113.recon.task._lb0335._sfo-10._0001.job.tmp.log
-rw-r--r-- 1 atlast0 zp 272226450 apr 17 07:09 data11_7tev.00179804.express_express.recon.esd.x113._lb0335._sfo-10._0001
-rw-r--r-- 1 atlast0 zp  16800899 apr 17 07:09 data11_7tev.00179804.express_express.recon.ntup_muoncalib.x113._lb0335._sfo-10._0001
-rw-r--r-- 1 atlast0 zp      1055 apr 17 07:12 data11_7tev.00179804.express_express.recon.ntup_trig.x113._lb0335._sfo-10._0001
-rw-r--r-- 1 atlast0 zp  27378282 apr 17 07:09 data11_7tev.00179804.express_express.recon.ntup_trkvalid.x113._lb0335._sfo-10._0001
-rw-r--r-- 1 atlast0 zp      4984 apr 17 06:42 dblookup.xml
-rw-r--r-- 1 atlast0 zp    211298 apr 17 07:15 dmesg_athena.txt
-rw-r--r-- 1 atlast0 zp    686179 apr 17 07:15 esdtoaod.log
-rw-r--r-- 1 atlast0 zp      1865 apr 17 07:11 esdtoaod_messagesvc_joboptions.py
-rwxr-xr-x 1 atlast0 zp       329 apr 17 07:11 esdtoaod_runathena
-rw-r--r-- 1 atlast0 zp    466191 apr 17 07:12 generated_amdb_simrec_pool
-rw-r--r-- 1 atlast0 zp  42110976 apr 17 06:42 geomdb_t0replica.sqlite
-rw-r--r-- 1 atlast0 zp      1630 apr 17 06:42 inputdictionary.pickle
-rw-r--r-- 1 atlast0 zp     44900 apr 17 07:15 jobinfo_esdtoaod.xml
-rw-r--r-- 1 atlast0 zp     36144 apr 17 07:11 jobinfo_rawtoesd.xml
-rw-r--r-- 1 atlast0 zp     44855 apr 17 07:15 jobinfo_recotrf.xml
-rw-r--r-- 1 atlast0 zp     44855 apr 17 07:15 jobinfo.xml
-rw-r--r-- 1 atlast0 zp     34198 apr 17 07:15 jobreport_esdtoaod.gpickle
-rw-r--r-- 1 atlast0 zp     50126 apr 17 07:15 jobreport_esdtoaod.pickle
-rw-r--r-- 1 atlast0 zp     38290 apr 17 07:15 jobreport_esdtoaod.txt
-rw-r--r-- 1 atlast0 zp      3032 apr 17 07:15 jobreport.gpickle
-rw-r--r-- 1 atlast0 zp     74569 apr 17 07:15 jobreport.pickle
-rw-r--r-- 1 atlast0 zp     35411 apr 17 07:11 jobreport_rawtoesd.gpickle
-rw-r--r-- 1 atlast0 zp     50464 apr 17 07:11 jobreport_rawtoesd.pickle
-rw-r--r-- 1 atlast0 zp     31410 apr 17 07:11 jobreport_rawtoesd.txt
-rw-r--r-- 1 atlast0 zp      3032 apr 17 07:15 jobreport_recotrf.gpickle
-rw-r--r-- 1 atlast0 zp     74569 apr 17 07:15 jobreport_recotrf.pickle
-rw-r--r-- 1 atlast0 zp     78205 apr 17 07:15 jobreport_recotrf.txt
-rw-r--r-- 1 atlast0 zp     78205 apr 17 07:15 jobreport.txt
-rwxr-xr-x 1 atlast0 zp       841 apr 17 07:11 last.esdtoaod
-rwxr-xr-x 1 atlast0 zp      1017 apr 17 06:42 last.rawtoesd
-rwxr-xr-x 1 atlast0 zp       173 apr 17 06:42 last.reco_trf
-rw-r--r-- 1 atlast0 zp       928 apr 17 07:11 last.runargs.gpickle
-rw-r--r-- 1 atlast0 zp      2293 apr 17 07:11 metadata_rawtoesd.xml
-rw-r--r-- 1 atlast0 zp   1397464 apr 17 07:15 monitoresd.root
-rw-r--r-- 1 atlast0 zp  10072502 apr 17 07:09 monitor.root
-rw-r--r-- 1 atlast0 zp    202858 apr 17 07:15 ntuple_esdtoaod.pmon.stream
-rw-r--r-- 1 atlast0 zp    229762 apr 17 07:09 ntuple_rawtoesd.pmon.gz
drwxr-xr-x 3 atlast0 zp      4096 apr 17 06:42 oradiag_atlast0
lrwxrwxrwx 1 atlast0 zp        57 apr 17 06:42 poolcond -&gt; /afs/cern.ch/atlas/conditions/poolcond/catalogue/poolcond
-rw-r--r-- 1 atlast0 zp       384 apr 17 07:09 poolfilecatalog.xml
-rw-r--r-- 1 atlast0 zp       384 apr 17 07:12 poolfilecatalog.xml.bak
-rw-r--r-- 1 atlast0 zp   4236064 apr 17 07:09 rawtoesd.log
-rw-r--r-- 1 atlast0 zp      1865 apr 17 06:42 rawtoesd_messagesvc_joboptions.py
-rwxr-xr-x 1 atlast0 zp       329 apr 17 06:42 rawtoesd_runathena
-rw-r--r-- 1 atlast0 zp       928 apr 17 07:11 runargs.esdtoaod.gpickle
-rw-r--r-- 1 atlast0 zp      1437 apr 17 07:11 runargs.esdtoaod.py
-rw-r--r-- 1 atlast0 zp      1122 apr 17 06:42 runargs.rawtoesd.gpickle
-rw-r--r-- 1 atlast0 zp      1597 apr 17 06:42 runargs.rawtoesd.py
drwxr-xr-x 2 atlast0 zp      4096 apr 17 07:12 tmp
-rw-r--r-- 1 atlast0 zp       853 apr 17 07:15 transformtimer_reco_trf.pickle
-rw-r--r-- 1 atlast0 zp      3549 apr 17 06:41 wrapper.py
&lt;&lt;&lt;
&gt;&gt;&gt;&gt;&gt;  start of trf jobreport ['prodsys' key]

{'athacronym': 'an unknown exception occurred',
 'athcode': '8',
 'jobinputs': [],
 'joboutputs': [{'guid': '46545ab3-ad68-e011-ba19-0030486730e6',
                 'checksum': none,
                 'dataset': 'data11_7tev.00179804.express_express.recon.esd.x113',
                 'events': 167l,
                 'lfn': 'data11_7tev.00179804.express_express.recon.esd.x113._lb0335._sfo-10._0001',
                 'more': {'metadata': {'amitag': 'x113',
                                       'autoconfiguration': ['everything',
                                                             'conditionstag=comcond-es1p*-004-05'],
                                       'beamtype': 'collisions',
                                       'conditionstag': 'comcond-es1pst-004-05',
                                       'filetype': 'esd',
                                       'geometryversion': 'atlas-geo-16-00-01',
                                       'maxevents': -1,
                                       'preexec': ['indetflags.usebeamconstraint.set_value_and_lock(false);from calotools.calonoiseflags import jobproperties;jobproperties.calonoiseflags.fixedluminosity.set_value_and_lock(1.45);aodflags.trackparticleslimmer=true;indetflags.selectsctintimehits=true']}},
                 'size': 272226450l},
                {'guid': 'c7bfd39b-3ef7-436a-825e-1505dca40daa',
                 'checksum': none,
                 'dataset': 'data11_7tev.00179804.express_express.recon.ntup_muoncalib.x113',
                 'events': 167l,
                 'lfn': 'data11_7tev.00179804.express_express.recon.ntup_muoncalib.x113._lb0335._sfo-10._0001',
                 'more': {'metadata': {'amitag': 'x113',
                                       'autoconfiguration': ['everything',
                                                             'conditionstag=comcond-es1p*-004-05'],
                                       'beamtype': 'collisions',
                                       'conditionstag': 'comcond-es1pst-004-05',
                                       'filetype': 'ntup',
                                       'geometryversion': 'atlas-geo-16-00-01',
                                       'maxevents': -1,
                                       'preexec': ['indetflags.usebeamconstraint.set_value_and_lock(false);from calotools.calonoiseflags import jobproperties;jobproperties.calonoiseflags.fixedluminosity.set_value_and_lock(1.45);aodflags.trackparticleslimmer=true;indetflags.selectsctintimehits=true']}},
                 'size': 16800899l},
                {'guid': '7deec058-a9a3-44b8-b42d-e7d5cb199206',
                 'checksum': none,
                 'dataset': 'data11_7tev.00179804.express_express.recon.ntup_trkvalid.x113',
                 'events': 167l,
                 'lfn': 'data11_7tev.00179804.express_express.recon.ntup_trkvalid.x113._lb0335._sfo-10._0001',
                 'more': {'metadata': {'amitag': 'x113',
                                       'autoconfiguration': ['everything',
                                                             'conditionstag=comcond-es1p*-004-05'],
                                       'beamtype': 'collisions',
                                       'conditionstag': 'comcond-es1pst-004-05',
                                       'filetype': 'ntup',
                                       'geometryversion': 'atlas-geo-16-00-01',
                                       'maxevents': -1,
                                       'preexec': ['indetflags.usebeamconstraint.set_value_and_lock(false);from calotools.calonoiseflags import jobproperties;jobproperties.calonoiseflags.fixedluminosity.set_value_and_lock(1.45);aodflags.trackparticleslimmer=true;indetflags.selectsctintimehits=true']}},
                 'size': 27378282l}],
 'more': {'machine': 'unknown'},
 'nevents': 167l,
 'trfacronym': 'trf_segfault',
 'trfcode': 60010,
 'trfexitcode': 6}
&lt;&lt;&lt;&lt;&lt;  end of trf jobreport 

[{'guid': 'c288f072-68b1-11e0-949b-0030486730e6',
  'checksum': 'ad:4e20161c',
  'dataset': 'data11_7tev.00179804.express_express.daq.raw.x113.recon.task.tmp.log',
  'events': 0,
  'lfn': 'data11_7tev.00179804.express_express.daq.raw.x113.recon.task._lb0335._sfo-10._0001.job.tmp.log',
  'size': 4949388l},
 {'guid': '46545ab3-ad68-e011-ba19-0030486730e6',
  'checksum': 'ad:423502b7',
  'dataset': 'data11_7tev.00179804.express_express.recon.esd.x113',
  'events': 167l,
  'lfn': 'data11_7tev.00179804.express_express.recon.esd.x113._lb0335._sfo-10._0001',
  'more': {'metadata': {'amitag': 'x113',
                        'autoconfiguration': ['everything',
                                              'conditionstag=comcond-es1p*-004-05'],
                        'beamtype': 'collisions',
                        'conditionstag': 'comcond-es1pst-004-05',
                        'filetype': 'esd',
                        'geometryversion': 'atlas-geo-16-00-01',
                        'maxevents': -1,
                        'preexec': ['indetflags.usebeamconstraint.set_value_and_lock(false);from calotools.calonoiseflags import jobproperties;jobproperties.calonoiseflags.fixedluminosity.set_value_and_lock(1.45);aodflags.trackparticleslimmer=true;indetflags.selectsctintimehits=true']}},
  'size': 272226450l},
 {'guid': 'c7bfd39b-3ef7-436a-825e-1505dca40daa',
  'checksum': 'ad:baa12828',
  'dataset': 'data11_7tev.00179804.express_express.recon.ntup_muoncalib.x113',
  'events': 167l,
  'lfn': 'data11_7tev.00179804.express_express.recon.ntup_muoncalib.x113._lb0335._sfo-10._0001',
  'more': {'metadata': {'amitag': 'x113',
                        'autoconfiguration': ['everything',
                                              'conditionstag=comcond-es1p*-004-05'],
                        'beamtype': 'collisions',
                        'conditionstag': 'comcond-es1pst-004-05',
                        'filetype': 'ntup',
                        'geometryversion': 'atlas-geo-16-00-01',
                        'maxevents': -1,
                        'preexec': ['indetflags.usebeamconstraint.set_value_and_lock(false);from calotools.calonoiseflags import jobproperties;jobproperties.calonoiseflags.fixedluminosity.set_value_and_lock(1.45);aodflags.trackparticleslimmer=true;indetflags.selectsctintimehits=true']}},
  'size': 16800899l},
 {'guid': '7deec058-a9a3-44b8-b42d-e7d5cb199206',
  'checksum': 'ad:e3b42c30',
  'dataset': 'data11_7tev.00179804.express_express.recon.ntup_trkvalid.x113',
  'events': 167l,
  'lfn': 'data11_7tev.00179804.express_express.recon.ntup_trkvalid.x113._lb0335._sfo-10._0001',
  'more': {'metadata': {'amitag': 'x113',
                        'autoconfiguration': ['everything',
                                              'conditionstag=comcond-es1p*-004-05'],
                        'beamtype': 'collisions',
                        'conditionstag': 'comcond-es1pst-004-05',
                        'filetype': 'ntup',
                        'geometryversion': 'atlas-geo-16-00-01',
                        'maxevents': -1,
                        'preexec': ['indetflags.usebeamconstraint.set_value_and_lock(false);from calotools.calonoiseflags import jobproperties;jobproperties.calonoiseflags.fixedluminosity.set_value_and_lock(1.45);aodflags.trackparticleslimmer=true;indetflags.selectsctintimehits=true']}},
  'size': 27378282l}]


sun apr 17 07:15:50 2011


stageout


sun apr 17 07:15:50 2011


---------------------------------------------------------------------------------------------------------------------------------------
staging out  data11_7tev.00179804.express_express.daq.raw.x113.recon.task.tmp.log # data11_7tev.00179804.express_express.daq.raw.x113.recon.task._lb0335._sfo-10._0001.job.tmp.log
---------------------------------------------------------------------------------------------------------------------------------------

warning no storage defined, will use default (asinds)
info resolved asinds into  [{'svcclass': 't0merge', 'type': 'castor', 'basepath': '/castor/cern.ch/grid/atlas/tzero/prod1/temp', 'fileclass': 'atlas_notape', 'stagehost': 'castoratlas', 'autodirstruct': '.1/.3/.2/d'}]

-----&gt;  staging out to  {'svcclass': 't0merge', 'type': 'castor', 'basepath': '/castor/cern.ch/grid/atlas/tzero/prod1/temp', 'fileclass': 'atlas_notape', 'stagehost': 'castoratlas', 'autodirstruct': '.1/.3/.2/d'}

getdest final storageinfo =  {'svcclass': 't0merge', 'type': 'castor', 'basepath': '/castor/cern.ch/grid/atlas/tzero/prod1/temp', 'fileclass': 'atlas_notape', 'stagehost': 'castoratlas', 'autodirstruct': '.1/.3/.2/d'} 

rfmkdir -p /castor/cern.ch/grid/atlas/tzero/prod1/temp/data11_7tev/express_express/00179804/data11_7tev.00179804.express_express.daq.raw.x113.recon.task.tmp.log ; nschclass atlas_notape /castor/cern.ch/grid/atlas/tzero/prod1/temp/data11_7tev/express_express/00179804/data11_7tev.00179804.express_express.daq.raw.x113.recon.task.tmp.log
sun apr 17 07:15:50 2011
0 mkdir() : file exists

export stage_svcclass=t0merge ; export stage_host=castoratlas ; umask 7 ;  rfcp data11_7tev.00179804.express_express.daq.raw.x113.recon.task._lb0335._sfo-10._0001.job.tmp.log /castor/cern.ch/grid/atlas/tzero/prod1/temp/data11_7tev/express_express/00179804/data11_7tev.00179804.express_express.daq.raw.x113.recon.task.tmp.log/data11_7tev.00179804.express_express.daq.raw.x113.recon.task._lb0335._sfo-10._0001.job.tmp.log.3
0 4949388 bytes in 0 seconds through local (in) and eth0 (out)
4949388 bytes in remote file

0 4949388 bytes in 0 seconds through local (in) and eth0 (out)
4949388 bytes in remote file

logging: connection succeeded
logging: executing...
insert into cpattempt (source,dest,retrynr,exitcode,erroracronym,startepoch,           endepoch,stdboth,filesize,server,transfertime,type,filetype,svcclass) values (:source,:dest,:retrynr,:exitcode,:eacro,:startepoch, :endepoch,:stdboth,          :filesize, :server, :transfertime, :type, :filetype, :svcclass)
{'retrynr': 1, 'svcclass': 't0merge', 'eacro': 'ok', 'dest': '/castor/cern.ch/grid/atlas/tzero/prod1/temp/data11_7tev/express_express/00179804/data11_7tev.00179804.express_express.daq.raw.x113.recon.task.tmp.log/data11_7tev.00179804.express_express.daq.raw.x113.recon.task._lb0335._sfo-10._0001.job.tmp.log.3', 'startepoch': 1303017352, 'endepoch': 1303017355, 'filesize': 4949388, 'server': '', 'source': 'data11_7tev.00179804.express_express.daq.raw.x113.recon.task._lb0335._sfo-10._0001.job.tmp.log', 'transfertime': 1, 'stdboth': '4949388 bytes in 0 seconds through local (in) and eth0 (out)\n4949388 bytes in remote file\n\n', 'type': 'stageout', 'filetype': 'log', 'exitcode': 0}
logging: connection closed

ok 4747 3007 [(0, 1, '4949388 bytes in 0 seconds through local (in) and eth0 (out)\n4949388 bytes in remote file\n\n', 1303017352, 1303017355)]

sun apr 17 07:15:55 2011


---------------------------------------------------------------------------------------------------------------------------------------
staging out  data11_7tev.00179804.express_express.recon.esd.x113 # data11_7tev.00179804.express_express.recon.esd.x113._lb0335._sfo-10._0001
---------------------------------------------------------------------------------------------------------------------------------------

warning no storage defined, will use default (asinds)
info resolved asinds into  [{'svcclass': 't0atlas', 'type': 'castor', 'basepath': '/castor/cern.ch/grid/atlas/tzero/prod1/perm', 'fileclass': 'atlas_notape', 'stagehost': 'castoratlas', 'autodirstruct': '.1/.3/.2/d'}]

-----&gt;  staging out to  {'svcclass': 't0atlas', 'type': 'castor', 'basepath': '/castor/cern.ch/grid/atlas/tzero/prod1/perm', 'fileclass': 'atlas_notape', 'stagehost': 'castoratlas', 'autodirstruct': '.1/.3/.2/d'}

getdest final storageinfo =  {'svcclass': 't0atlas', 'type': 'castor', 'basepath': '/castor/cern.ch/grid/atlas/tzero/prod1/perm', 'fileclass': 'atlas_notape', 'stagehost': 'castoratlas', 'autodirstruct': '.1/.3/.2/d'} 

rfmkdir -p /castor/cern.ch/grid/atlas/tzero/prod1/perm/data11_7tev/express_express/00179804/data11_7tev.00179804.express_express.recon.esd.x113 ; nschclass atlas_notape /castor/cern.ch/grid/atlas/tzero/prod1/perm/data11_7tev/express_express/00179804/data11_7tev.00179804.express_express.recon.esd.x113
sun apr 17 07:15:55 2011
0 mkdir() : file exists

export stage_svcclass=t0atlas ; export stage_host=castoratlas ; umask 7 ;  rfcp data11_7tev.00179804.express_express.recon.esd.x113._lb0335._sfo-10._0001 /castor/cern.ch/grid/atlas/tzero/prod1/perm/data11_7tev/express_express/00179804/data11_7tev.00179804.express_express.recon.esd.x113/data11_7tev.00179804.express_express.recon.esd.x113._lb0335._sfo-10._0001.3
0 272226450 bytes in 25 seconds through local (in) and eth0 (out) (10633 kb/sec)
272226450 bytes in remote file

0 272226450 bytes in 25 seconds through local (in) and eth0 (out) (10633 kb/sec)
272226450 bytes in remote file

logging: connection succeeded
logging: executing...
insert into cpattempt (source,dest,retrynr,exitcode,erroracronym,startepoch,           endepoch,stdboth,filesize,server,transfertime,type,filetype,svcclass) values (:source,:dest,:retrynr,:exitcode,:eacro,:startepoch, :endepoch,:stdboth,          :filesize, :server, :transfertime, :type, :filetype, :svcclass)
{'retrynr': 1, 'svcclass': 't0atlas', 'eacro': 'ok', 'dest': '/castor/cern.ch/grid/atlas/tzero/prod1/perm/data11_7tev/express_express/00179804/data11_7tev.00179804.express_express.recon.esd.x113/data11_7tev.00179804.express_express.recon.esd.x113._lb0335._sfo-10._0001.3', 'startepoch': 1303017355, 'endepoch': 1303017386, 'filesize': 272226450, 'server': '', 'source': 'data11_7tev.00179804.express_express.recon.esd.x113._lb0335._sfo-10._0001', 'transfertime': 25, 'stdboth': '272226450 bytes in 25 seconds through local (in) and eth0 (out) (10633 kb/sec)\n272226450 bytes in remote file\n\n', 'type': 'stageout', 'filetype': 'esd', 'exitcode': 0}
logging: connection closed

ok 30900 30690 [(0, 1, '272226450 bytes in 25 seconds through local (in) and eth0 (out) (10633 kb/sec)\n272226450 bytes in remote file\n\n', 1303017355, 1303017386)]

sun apr 17 07:16:26 2011


---------------------------------------------------------------------------------------------------------------------------------------
staging out  data11_7tev.00179804.express_express.recon.ntup_muoncalib.x113 # data11_7tev.00179804.express_express.recon.ntup_muoncalib.x113._lb0335._sfo-10._0001
---------------------------------------------------------------------------------------------------------------------------------------

warning no storage defined, will use default (asinds)
info resolved asinds into  [{'svcclass': 't0merge', 'type': 'castor', 'basepath': '/castor/cern.ch/grid/atlas/tzero/prod1/temp', 'fileclass': 'atlas_notape', 'stagehost': 'castoratlas', 'autodirstruct': '.1/.3/.2/d'}]

-----&gt;  staging out to  {'svcclass': 't0merge', 'type': 'castor', 'basepath': '/castor/cern.ch/grid/atlas/tzero/prod1/temp', 'fileclass': 'atlas_notape', 'stagehost': 'castoratlas', 'autodirstruct': '.1/.3/.2/d'}

getdest final storageinfo =  {'svcclass': 't0merge', 'type': 'castor', 'basepath': '/castor/cern.ch/grid/atlas/tzero/prod1/temp', 'fileclass': 'atlas_notape', 'stagehost': 'castoratlas', 'autodirstruct': '.1/.3/.2/d'} 

rfmkdir -p /castor/cern.ch/grid/atlas/tzero/prod1/temp/data11_7tev/express_express/00179804/data11_7tev.00179804.express_express.recon.ntup_muoncalib.x113 ; nschclass atlas_notape /castor/cern.ch/grid/atlas/tzero/prod1/temp/data11_7tev/express_express/00179804/data11_7tev.00179804.express_express.recon.ntup_muoncalib.x113
sun apr 17 07:16:26 2011
0 mkdir() : file exists

export stage_svcclass=t0merge ; export stage_host=castoratlas ; umask 7 ;  rfcp data11_7tev.00179804.express_express.recon.ntup_muoncalib.x113._lb0335._sfo-10._0001 /castor/cern.ch/grid/atlas/tzero/prod1/temp/data11_7tev/express_express/00179804/data11_7tev.00179804.express_express.recon.ntup_muoncalib.x113/data11_7tev.00179804.express_express.recon.ntup_muoncalib.x113._lb0335._sfo-10._0001.3
0 16800899 bytes in 0 seconds through local (in) and eth0 (out)
16800899 bytes in remote file

0 16800899 bytes in 0 seconds through local (in) and eth0 (out)
16800899 bytes in remote file

logging: connection succeeded
logging: executing...
insert into cpattempt (source,dest,retrynr,exitcode,erroracronym,startepoch,           endepoch,stdboth,filesize,server,transfertime,type,filetype,svcclass) values (:source,:dest,:retrynr,:exitcode,:eacro,:startepoch, :endepoch,:stdboth,          :filesize, :server, :transfertime, :type, :filetype, :svcclass)
{'retrynr': 1, 'svcclass': 't0merge', 'eacro': 'ok', 'dest': '/castor/cern.ch/grid/atlas/tzero/prod1/temp/data11_7tev/express_express/00179804/data11_7tev.00179804.express_express.recon.ntup_muoncalib.x113/data11_7tev.00179804.express_express.recon.ntup_muoncalib.x113._lb0335._sfo-10._0001.3', 'startepoch': 1303017386, 'endepoch': 1303017388, 'filesize': 16800899, 'server': '', 'source': 'data11_7tev.00179804.express_express.recon.ntup_muoncalib.x113._lb0335._sfo-10._0001', 'transfertime': 1, 'stdboth': '16800899 bytes in 0 seconds through local (in) and eth0 (out)\n16800899 bytes in remote file\n\n', 'type': 'stageout', 'filetype': 'ntup_muoncalib', 'exitcode': 0}
logging: connection closed

ok 2498 2354 [(0, 1, '16800899 bytes in 0 seconds through local (in) and eth0 (out)\n16800899 bytes in remote file\n\n', 1303017386, 1303017388)]

sun apr 17 07:16:28 2011


---------------------------------------------------------------------------------------------------------------------------------------
staging out  data11_7tev.00179804.express_express.recon.ntup_trkvalid.x113 # data11_7tev.00179804.express_express.recon.ntup_trkvalid.x113._lb0335._sfo-10._0001
---------------------------------------------------------------------------------------------------------------------------------------

warning no storage defined, will use default (asinds)
info resolved asinds into  [{'svcclass': 't0merge', 'type': 'castor', 'basepath': '/castor/cern.ch/grid/atlas/tzero/prod1/temp', 'fileclass': 'atlas_notape', 'stagehost': 'castoratlas', 'autodirstruct': '.1/.3/.2/d'}]

-----&gt;  staging out to  {'svcclass': 't0merge', 'type': 'castor', 'basepath': '/castor/cern.ch/grid/atlas/tzero/prod1/temp', 'fileclass': 'atlas_notape', 'stagehost': 'castoratlas', 'autodirstruct': '.1/.3/.2/d'}

getdest final storageinfo =  {'svcclass': 't0merge', 'type': 'castor', 'basepath': '/castor/cern.ch/grid/atlas/tzero/prod1/temp', 'fileclass': 'atlas_notape', 'stagehost': 'castoratlas', 'autodirstruct': '.1/.3/.2/d'} 

rfmkdir -p /castor/cern.ch/grid/atlas/tzero/prod1/temp/data11_7tev/express_express/00179804/data11_7tev.00179804.express_express.recon.ntup_trkvalid.x113 ; nschclass atlas_notape /castor/cern.ch/grid/atlas/tzero/prod1/temp/data11_7tev/express_express/00179804/data11_7tev.00179804.express_express.recon.ntup_trkvalid.x113
sun apr 17 07:16:28 2011
0 mkdir() : file exists

export stage_svcclass=t0merge ; export stage_host=castoratlas ; umask 7 ;  rfcp data11_7tev.00179804.express_express.recon.ntup_trkvalid.x113._lb0335._sfo-10._0001 /castor/cern.ch/grid/atlas/tzero/prod1/temp/data11_7tev/express_express/00179804/data11_7tev.00179804.express_express.recon.ntup_trkvalid.x113/data11_7tev.00179804.express_express.recon.ntup_trkvalid.x113._lb0335._sfo-10._0001.3
0 27378282 bytes in 1 seconds through local (in) and eth0 (out) (26736 kb/sec)
27378282 bytes in remote file

0 27378282 bytes in 1 seconds through local (in) and eth0 (out) (26736 kb/sec)
27378282 bytes in remote file

logging: connection succeeded
logging: executing...
insert into cpattempt (source,dest,retrynr,exitcode,erroracronym,startepoch,           endepoch,stdboth,filesize,server,transfertime,type,filetype,svcclass) values (:source,:dest,:retrynr,:exitcode,:eacro,:startepoch, :endepoch,:stdboth,          :filesize, :server, :transfertime, :type, :filetype, :svcclass)
{'retrynr': 1, 'svcclass': 't0merge', 'eacro': 'ok', 'dest': '/castor/cern.ch/grid/atlas/tzero/prod1/temp/data11_7tev/express_express/00179804/data11_7tev.00179804.express_express.recon.ntup_trkvalid.x113/data11_7tev.00179804.express_express.recon.ntup_trkvalid.x113._lb0335._sfo-10._0001.3', 'startepoch': 1303017388, 'endepoch': 1303017401, 'filesize': 27378282, 'server': '', 'source': 'data11_7tev.00179804.express_express.recon.ntup_trkvalid.x113._lb0335._sfo-10._0001', 'transfertime': 1, 'stdboth': '27378282 bytes in 1 seconds through local (in) and eth0 (out) (26736 kb/sec)\n27378282 bytes in remote file\n\n', 'type': 'stageout', 'filetype': 'ntup_trkvalid', 'exitcode': 0}
logging: connection closed

ok 13073 12902 [(0, 1, '27378282 bytes in 1 seconds through local (in) and eth0 (out) (26736 kb/sec)\n27378282 bytes in remote file\n\n', 1303017388, 1303017401)]

sun apr 17 07:16:41 2011

staging out took  51 seconds ok

stageout succeeded

transformation problem

report
{'prodsys': {'jobinputs': [],
             'joboutputs': [{'guid': 'c288f072-68b1-11e0-949b-0030486730e6',
                             'checksum': 'ad:4e20161c',
                             'dataset': 'data11_7tev.00179804.express_express.daq.raw.x113.recon.task.tmp.log',
                             'events': 0,
                             'lfn': 'data11_7tev.00179804.express_express.daq.raw.x113.recon.task._lb0335._sfo-10._0001.job.tmp.log.3',
                             'more': {'metadata': {},
                                      'surl': '/castor/cern.ch/grid/atlas/tzero/prod1/temp/data11_7tev/express_express/00179804/data11_7tev.00179804.express_express.daq.raw.x113.recon.task.tmp.log/data11_7tev.00179804.express_express.daq.raw.x113.recon.task._lb0335._sfo-10._0001.job.tmp.log.3'},
                             'size': 4949388l}],
             'more': {'num1': 0, 'num2': 0, 'txt1': ''},
  