View topic | Edit | WYSIWYGAttachPDF
r2 - 06 Jul 2010 - 16:50:50 - ElenaOliverGarciaYou are here: TWiki >  Main Web  >  TWikiUsers > ElenaOliverGarcia > ElenaOliverGarciaTest02

Test02

ATLAS demos at IFIC

I.- DQ2 examples

To access to ATLAS data is with DQ2 tool. Everything is fine very fine, don't be afraid.

Testing.....

I.1.- Exercice 1

Let's start :

$> ssh ui05
$> source /afs/ific.uv.es/project/atlas/software/ddm/DQ2Clients/setup.sh

 - Enabled current AFS IFIC GRID UI
 - Enabled Python 2.5
 - Configured local site
 - Enabled DQ2 Clients


 If you have not done so already, execute:

   voms-proxy-init -voms atlas


 Ready


$> voms-proxy-init -voms atlas
Cannot find file or dir: /afs/ific.uv.es/user/o/oliverg/.glite/vomses
Enter GRID pass phrase:
Your identity: /DC=es/DC=irisgrid/O=ific/CN=Elena.OliverGarcia
Creating temporary proxy ................................................. Done
Contacting  lcg-voms.cern.ch:15001 [/DC=ch/DC=cern/OU=computers/CN=lcg-voms.cern.ch] "atlas" Done
Creating proxy ..................................... Done
Your proxy is valid until Thu Jul  1 00:32:05 2010

$> dq2-ls 'data10_7TeV*merge*AOD*'
data10_7TeV.00153136.physics_MinBias.merge.AOD.r1239_p140/
data10_7TeV.00152772.physics_L1CaloEM.merge.AOD.f243_m435
data10_7TeV.00153159.physics_MinBias.merge.AOD.f249_m455
data10_7TeV.00152372.physics_MinBias.merge.AOD.f239_m427
data10_7TeV.00155073.physics_MuonswBeam.merge.AOD.f255_m471
data10_7TeV.00152166.physics_MinBias.merge.AOD.r1297_p161_tid143386_00
data10_7TeV.00152372.physics_RNDM.merge.AOD.f239_m427
data10_7TeV.00152933.debugrec_hltacc.merge.AOD.r1297_p157_tid135815_00
data10_7TeV.00155118.physics_MinBias.merge.AOD.r1299_p161_tid143339_00
data10_7TeV.00152489.express_express.merge.AOD.f241_m433
data10_7TeV.00152844.physics_CosmicCalo.merge.AOD.r1297_p161_tid143532_00
data10_7TeV.00152273.physics_L1Calo.merge.AOD.f238_m427
data10_7TeV.00152371.physics_MinBias.merge.AOD.f239_p115/
data10_7TeV.00152441.physics_RNDM.merge.AOD.r1297_p161_tid143556_00_sub07533178
data10_7TeV.00152160.physics_MinBias.merge.AOD.f235_m427
data10_7TeV.00153200.physics_MinBias.merge.AOD.f249_p126_tid126573_00
data10_7TeV.00152166.physics_MuonswBeam.merge.AOD.f235_m427
data10_7TeV.00152778.physics_RNDM.merge.AOD.f243_m435
data10_7TeV.00155221.physics_CosmicCalo.merge.AOD.x13_m486
data10_7TeV.00154808.physics_ZeroBias.merge.AOD.f255_m471
........

$>dq2-ls -f  'data10_7TeV.00153159.physics_L1CaloEM.merge.AOD.r1297_p161_tid143468_00'

data10_7TeV.00153159.physics_L1CaloEM.merge.AOD.r1297_p161_tid143468_00
[ ]     AOD.143468._000001.pool.root.3  6A6F2EB8-7868-DF11-BF3A-00A0D1E505FD   ad:412a0f85      350075984
[ ]     AOD.143468._000004.pool.root.1  AEF7C488-FF67-DF11-81A7-0026B937D629   ad:883afeaf      391100190
[ ]     AOD.143468._000002.pool.root.1  708AB47D-E467-DF11-B76B-0026B937D9B7   ad:3617c812      382584775
[ ]     AOD.143468._000005.pool.root.1  F2AF18EC-E267-DF11-A0B5-0024E87F9467   ad:61e36ce7      388281619
[ ]     AOD.143468._000003.pool.root.3  8461CE19-4D68-DF11-9D55-0026B935BBC5   ad:fb4af478      375165082
[ ]     AOD.143468._000006.pool.root.1  18B805AD-E867-DF11-BEE0-00A0D1E7FC44   ad:c0b78e57      233918635
total files: 6
local files: 0
total size: 2121126285
date: 2010-05-26 05:17:40

$>dq2-ls -r  'data10_7TeV.00153159.physics_L1CaloEM.merge.AOD.r1297_p161_tid143468_00'

data10_7TeV.00153159.physics_L1CaloEM.merge.AOD.r1297_p161_tid143468_00
 INCOMPLETE:
 COMPLETE:
   FZK-LCG2_DATADISK
   GRIF-LAL_DATADISK
   TRIUMF-LCG2_DATADISK
   NDGF-T1_DATADISK
   PIC_DATADISK
   RAL-LCG2_DATADISK
   TAIWAN-LCG2_DATADISK
   IN2P3-CC_DATADISK
   BNL-OSG2_DATADISK
   NIKHEF-ELPROD_DATADISK
   UKI-SCOTGRID-GLASGOW_DATADISK
   CERN-PROD_DATADISK
   RRC-KI_DATADISK
   AGLT2_DATADISK
   SLACXRD_DATADISK
   DESY-ZN_DATADISK
   MWT2_DATADISK
   IFIC-LCG2_DATADISK
   UKI-SOUTHGRID-RALPP_DATADISK
   WUPPERTALPROD_DATADISK
   WISC_DATADISK
   ILLINOISHEP_DATADISK
   INFN-MILANO-ATLASC_DATADISK

$> mkdir -p /tmp/oliverg
$> cd /tmp/oliverg
$> dq2-get -n 1 'data10_7TeV.00153159.physics_L1CaloEM.merge.AOD.r1297_p161_tid143468_00'
Querying DQ2 central catalogues to resolve datasetname data10_7TeV.00153159.physics_L1CaloEM.merge.AOD.r1297_p161_tid143468_00
Datasets found: 1
Generating random sample of datasets
data10_7TeV.00153159.physics_L1CaloEM.merge.AOD.r1297_p161_tid143468_00 1
data10_7TeV.00153159.physics_L1CaloEM.merge.AOD.r1297_p161_tid143468_00: Querying DQ2 central catalogues for replicas...
Querying DQ2 central catalogues for files in dataset...
data10_7TeV.00153159.physics_L1CaloEM.merge.AOD.r1297_p161_tid143468_00: Complete replica available
data10_7TeV.00153159.physics_L1CaloEM.merge.AOD.r1297_p161_tid143468_00: Using site IFIC-LCG2_DATADISK
data10_7TeV.00153159.physics_L1CaloEM.merge.AOD.r1297_p161_tid143468_00: Querying local file catalogue of site IFIC-LCG2_DATADISK...
data10_7TeV.00153159.physics_L1CaloEM.merge.AOD.r1297_p161_tid143468_00/AOD.143468._000004.pool.root.1: Getting SRM metadata for srm://srmv2.ific.uv.es:8443/srm/managerv2?SFN=/lustre/ific.uv.es/grid/atlas/atlasdatadisk/data10_7TeV/AOD/r1297_p161/data10_7TeV.00153159.physics_L1CaloEM.merge.AOD.r1297_p161_tid143468_00/AOD.143468._000004.pool.root.1
data10_7TeV.00153159.physics_L1CaloEM.merge.AOD.r1297_p161_tid143468_00/AOD.143468._000004.pool.root.1: is cached.
data10_7TeV.00153159.physics_L1CaloEM.merge.AOD.r1297_p161_tid143468_00/AOD.143468._000004.pool.root.1: Starting transfer: lcg-cp -v --vo atlas -b -D srmv2 srm://srmv2.ific.uv.es:8443/srm/managerv2?SFN=/lustre/ific.uv.es/grid/atlas/atlasdatadisk/data10_7TeV/AOD/r1297_p161/data10_7TeV.00153159.physics_L1CaloEM.merge.AOD.r1297_p161_tid143468_00/AOD.143468._000004.pool.root.1 file:///tmp/oliverg/data10_7TeV.00153159.physics_L1CaloEM.merge.AOD.r1297_p161_tid143468_00/AOD.143468._000004.pool.root.1
data10_7TeV.00153159.physics_L1CaloEM.merge.AOD.r1297_p161_tid143468_00/AOD.143468._000004.pool.root.1: 0/391100190 transferred
data10_7TeV.00153159.physics_L1CaloEM.merge.AOD.r1297_p161_tid143468_00/AOD.143468._000004.pool.root.1: 7340032/391100190 transferred
data10_7TeV.00153159.physics_L1CaloEM.merge.AOD.r1297_p161_tid143468_00/AOD.143468._000004.pool.root.1: 28311552/391100190 transferred
data10_7TeV.00153159.physics_L1CaloEM.merge.AOD.r1297_p161_tid143468_00/AOD.143468._000004.pool.root.1: 51380224/391100190 transferred
data10_7TeV.00153159.physics_L1CaloEM.merge.AOD.r1297_p161_tid143468_00/AOD.143468._000004.pool.root.1: 79691776/391100190 transferred
data10_7TeV.00153159.physics_L1CaloEM.merge.AOD.r1297_p161_tid143468_00/AOD.143468._000004.pool.root.1: 117440512/391100190 transferred
data10_7TeV.00153159.physics_L1CaloEM.merge.AOD.r1297_p161_tid143468_00/AOD.143468._000004.pool.root.1: 160432128/391100190 transferred
data10_7TeV.00153159.physics_L1CaloEM.merge.AOD.r1297_p161_tid143468_00/AOD.143468._000004.pool.root.1: 190840832/391100190 transferred
data10_7TeV.00153159.physics_L1CaloEM.merge.AOD.r1297_p161_tid143468_00/AOD.143468._000004.pool.root.1: 226492416/391100190 transferred
data10_7TeV.00153159.physics_L1CaloEM.merge.AOD.r1297_p161_tid143468_00/AOD.143468._000004.pool.root.1: 267386880/391100190 transferred
data10_7TeV.00153159.physics_L1CaloEM.merge.AOD.r1297_p161_tid143468_00/AOD.143468._000004.pool.root.1: 305135616/391100190 transferred
data10_7TeV.00153159.physics_L1CaloEM.merge.AOD.r1297_p161_tid143468_00/AOD.143468._000004.pool.root.1: 338690048/391100190 transferred
data10_7TeV.00153159.physics_L1CaloEM.merge.AOD.r1297_p161_tid143468_00/AOD.143468._000004.pool.root.1: 357564416/391100190 transferred
data10_7TeV.00153159.physics_L1CaloEM.merge.AOD.r1297_p161_tid143468_00/AOD.143468._000004.pool.root.1: 374341632/391100190 transferred
data10_7TeV.00153159.physics_L1CaloEM.merge.AOD.r1297_p161_tid143468_00/AOD.143468._000004.pool.root.1: 391100190/391100190 transferred
data10_7TeV.00153159.physics_L1CaloEM.merge.AOD.r1297_p161_tid143468_00/AOD.143468._000004.pool.root.1: validated
Finished

$> cd

II.- Athena starts

II.1.- Exercice 2:

Let's star.

$>source AthenaTestArea/15.3.1.6/cmthome/setup.sh -tag=AtlasProduction,15.3.1.6
$>cd $TestArea/PhysicsAnalysis/AnalysisCommon/UserAnalysis/run

II.- Ganga starts

II.1.- Exercice 3:

$> source  /afs/ific.uv.es/project/atlas/software/ganga/install/etc/setup-atlas.sh

Setting up Ganga 5.5.2 (sh,atlas)

$> export GANGA_CONFIG_PATH=GangaAtlas/Atlas.ini

$> ganga
*** Welcome to Ganga ***
Version: Ganga-5-5-2
Documentation and support: http://cern.ch/ganga
Type help() or help('index') for online help.

This is free software (GPL), and you are welcome to redistribute it
under certain conditions; type license() for details.

..............

For help visit the ATLAS Distributed Analysis Help eGroup:
  https://groups.cern.ch/group/hn-atlas-dist-analysis-help/



In [ ]:

submit a job


In [52]:j=Job()

In [53]:j.backend=LCG()

In [52]:j.submit()

Ganga.GPIDev.Lib.Job               : INFO     submitting job 14
Ganga.GPIDev.Lib.Job               : INFO     job 14 status changed to "submitting"
Ganga.GPIDev.Adapters              : INFO     submitting job 14 to LCG backend
Ganga.GPIDev.Lib.Job               : INFO     job 14 status changed to "submitted"
Ganga.GPIDev.Lib.Job               : INFO     job 14 status changed to "submitted"
Out[54]: 1

In [ ]: j2=j.copy()

In [ ]: j2.submit()

Ganga.GPIDev.Lib.Job               : INFO     submitting job 15
Ganga.GPIDev.Lib.Job               : INFO     job 15 status changed to "submitting"
Ganga.GPIDev.Adapters              : INFO     submitting job 15 to LCG backend
Ganga.GPIDev.Lib.Job               : INFO     job 15 status changed to "submitted"
Ganga.GPIDev.Lib.Job               : INFO     job 15 status changed to "submitted"
Out[54]: 1

several jobs after ...


In [ ]: jobs
Out[67]:
Registry Slice: jobs (5 objects)
--------------
    fqid |    status |      name | subjobs |    application |        backend |                             backend.actualCE
-----------------------------------------------------------------------------------------------------------------------------
     14 |   running |           |         |     Executable |            LCG |lcgce0.shef.ac.uk:2119/jobmanager-lcgpbs-atla
     15 | submitted |           |         |     Executable |            LCG |lcg-ce2.scinet.utoronto.ca:2119/jobmanager-lc
     16 | submitted |           |         |     Executable |            LCG |lcgce03.phy.bris.ac.uk:2119/jobmanager-lcgpbs
     17 | completed |           |         |     Executable |            LCG |    ce1-egee.srce.hr:2119/jobmanager-sge-prod
     18 |   running |           |         |     Executable |            LCG |ifaece02.pic.es:2119/jobmanager-lcgpbs-glong_


III.- Athena-Ganga job

III.1.- Exercice 4:

To submit athena job on grid with ganga

First, create python file:


j = Job()
j.application = Athena()
j.application.option_file = 'AnalysisSkeleton_topOptions.py'
j.application.max_events = -1
j.application.athena_compile = False
j.application.prepare()
j.splitter = DQ2JobSplitter()
j.splitter.numfiles=1
j.inputdata = DQ2Dataset()
j.inputdata.dataset="mc08.105200.T1_McAtNlo_Jimmy.merge.AOD.e357_s462_d150_r642_t53_tid105572_00"
j.outputdata=DQ2OutputDataset()
j.outputdata.outputdata=['AnalysisSkeleton.aan.root']
j.outputdata.location='IFIC-LCG2_SCRATCHDISK'
j.backend=LCG()
j.backend.requirements=AtlasLCGRequirements()
j.backend.requirements.cloud = 'ALL'
j.submit()


Second, ejecute the python file:


In [46]:execfile('gangajob.py')
GangaAtlas.Lib.Athena              : WARNING  New prepare() method has been called. The old prepare method is called now prepare_old()
GangaAtlas.Lib.Athena              : INFO     Found Working Directory /afs/ific.uv.es/user/o/oliverg/AthenaTestArea/15.3.1.6
GangaAtlas.Lib.Athena              : INFO     Found ATLAS Release 15.3.1
GangaAtlas.Lib.Athena              : INFO     Found ATLAS Production Release 15.3.1.6
GangaAtlas.Lib.Athena              : INFO     Found ATLAS Project AtlasProduction
GangaAtlas.Lib.Athena              : INFO     Found ATLAS CMTCONFIG i686-slc4-gcc34-opt
GangaAtlas.Lib.Athena              : INFO     Using run directory: PhysicsAnalysis/AnalysisCommon/UserAnalysis/run/
GangaAtlas.Lib.Athena              : INFO     Extracting athena run configuration ...
GangaAtlas.Lib.Athena              : INFO     Detected Athena run configuration: {'input': {}, 'other': {}, 'output': {'outAANT': [('AANTupleStream', 'AANT')], 'alloutputs': ['AnalysisSkeleton.aan.root']}}
GangaAtlas.Lib.Athena              : INFO     Creating /tmp/oliverg/sources.edee5593-b506-41a1-9f4c-177b751ee367.tar ...
GangaAtlas.Lib.Athena              : INFO     Option athena_compile=False. Adding InstallArea to /tmp/oliverg/sources.edee5593-b506-41a1-9f4c-177b751ee367.tar ...
Ganga.GPIDev.Lib.Job               : INFO     submitting job 19
Ganga.GPIDev.Lib.Job               : INFO     job 19 status changed to "submitting"
GangaAtlas.Lib.Athena              : WARNING  DQ2OutputDataset being used with 'ALL' cloud option. Restricting to a single cloud. Note this may not allow all data to be analysed.
GangaAtlas.Lib.Athena              : WARNING  'ES' cloud selected. Continuing job submission...
GangaAtlas.Lib.AtlasLCGRequirements: INFO     Downloading remote copy of CE-SE association file.
GangaAtlas.Lib.Athena              : INFO     Dataset mc08.105200.T1_McAtNlo_Jimmy.merge.AOD.e357_s462_d150_r642_t53_tid105572_00 contains 22 files in 85483019715 bytes
GangaAtlas.Lib.Athena              : INFO     Total num files=22, total file size=85483019715 bytes
GangaAtlas.Lib.ATLASDataset        : INFO     Dataset mc08.105200.T1_McAtNlo_Jimmy.merge.AOD.e357_s462_d150_r642_t53_tid105572_00 has 5 locations
GangaAtlas.Lib.ATLASDataset        : WARNING  Please be patient - waiting for site-index update at site IFIC-LCG2_MCDISK ...
GangaAtlas.Lib.Athena              : INFO     DQ2JobSplitter will attempt to create 22 subjobs using 1 files per subjob.
GangaAtlas.Lib.Athena              : INFO     Total files assigned to subjobs is 22
Ganga.GPIDev.Lib.Job               : INFO     job 18 status changed to "running"
Ganga.GPIDev.Lib.Job               : INFO     job 18 status changed to "completing"
Ganga.GPIDev.Lib.Job               : INFO     job 18 status changed to "completed"
Ganga.Lib.LCG                      : WARNING  preparing 22 subjobs ... it may take a while
Ganga.GPIDev.Lib.Job               : INFO     job 19.0 status changed to "submitting"
Ganga.GPIDev.Lib.Job               : INFO     job 19.1 status changed to "submitting"
Ganga.GPIDev.Lib.Job               : INFO     job 19.2 status changed to "submitting"
Ganga.GPIDev.Lib.Job               : INFO     job 19.3 status changed to "submitting"
Ganga.GPIDev.Lib.Job               : INFO     job 19.4 status changed to "submitting"
Ganga.GPIDev.Lib.Job               : INFO     job 19.5 status changed to "submitting"

........

Ganga.GPIDev.Lib.Job               : INFO     job 19.21 status changed to "submitting"
Ganga.Lib.LCG                      : WARNING  submitting 22 subjobs ... it may take a while
Ganga.GPIDev.Lib.Job               : INFO     job 19.0 status changed to "submitted"
Ganga.GPIDev.Lib.Job               : INFO     job 19.1 status changed to "submitted"
Ganga.GPIDev.Lib.Job               : INFO     job 19.2 status changed to "submitted"
Ganga.GPIDev.Lib.Job               : INFO     job 19.3 status changed to "submitted"

.........

Ganga.GPIDev.Lib.Job               : INFO     job 19.21 status changed to "submitted"
Ganga.GPIDev.Lib.Job               : INFO     job 19 status changed to "submitted"

Then, see the subjobs status:

In [42]:jobs(19).subjobs
Out[42]: 
Registry Slice: jobs(19).subjobs (22 objects)
--------------
    fqid |    status |      name | subjobs |    application |        backend |                             backend.actualCE 
-----------------------------------------------------------------------------------------------------------------------------
    19.0 | completed |           |         |         Athena |            LCG | ce03.ific.uv.es:2119/jobmanager-lcgpbs-short 
    19.1 | completed |           |         |         Athena |            LCG |  ce03.ific.uv.es:2119/jobmanager-lcgpbs-long 
    19.2 |   running |           |         |         Athena |            LCG |  ce03.ific.uv.es:2119/jobmanager-lcgpbs-long 
    19.3 |   running |           |         |         Athena |            LCG |  ce01.ific.uv.es:2119/jobmanager-lcgpbs-long 
    19.4 |   running |           |         |         Athena |            LCG | ce03.ific.uv.es:2119/jobmanager-lcgpbs-short 
    19.5 | completed |           |         |         Athena |            LCG | ce04.ific.uv.es:2119/jobmanager-lcgpbs-short 
    19.6 |   running |           |         |         Athena |            LCG |  ce01.ific.uv.es:2119/jobmanager-lcgpbs-long 
    19.7 | completed |           |         |         Athena |            LCG |  ce03.ific.uv.es:2119/jobmanager-lcgpbs-long 
    19.8 |   running |           |         |         Athena |            LCG | ce03.ific.uv.es:2119/jobmanager-lcgpbs-short 
    19.9 | completed |           |         |         Athena |            LCG |  ce04.ific.uv.es:2119/jobmanager-lcgpbs-long 
   19.10 | completed |           |         |         Athena |            LCG | ce04.ific.uv.es:2119/jobmanager-lcgpbs-short 

...........

Ganga.GPIDev.Lib.Job : INFO job 19.20 status changed to "completing" Ganga.GPIDev.Lib.Job : INFO job 19.20 status changed to "completed" Ganga.GPIDev.Lib.Job : INFO job 19 status changed to "completed"

In [16]:jobs(19).outputdata.datasetname Out[16]: user10.ElenaOliverGarcia.ganga.19.20100706/

In [18]:!dq2-ls -r $jobs(19).outputdata.datasetname user10.ElenaOliverGarcia.ganga.19.20100706.IFIC-LCG2_SCRATCHDISK: INCOMPLETE:

COMPLETE
IFIC-LCG2_SCRATCHDISK

Container name: user10.ElenaOliverGarcia.ganga.19.20100706/ Total datasets: 1 Summary: SITE / # COMPLETE / # INCOMPLETE / TOTAL ---------------------------------------------------------------- IFIC-LCG2_SCRATCHDISK 1 0 1

In [19]:!dq2-get -n 1 $jobs(19).outputdata.datasetname Querying DQ2 central catalogues to resolve datasetname user10.ElenaOliverGarcia.ganga.19.20100706/ Datasets found: 1 Generating random sample of datasets user10.ElenaOliverGarcia.ganga.19.20100706.IFIC-LCG2_SCRATCHDISK 1 user10.ElenaOliverGarcia.ganga.19.20100706.IFIC-LCG2_SCRATCHDISK: Querying DQ2 central catalogues for replicas... Querying DQ2 central catalogues for files in dataset... user10.ElenaOliverGarcia.ganga.19.20100706.IFIC-LCG2_SCRATCHDISK: Complete replica available user10.ElenaOliverGarcia.ganga.19.20100706.IFIC-LCG2_SCRATCHDISK: Using site IFIC-LCG2_SCRATCHDISK user10.ElenaOliverGarcia.ganga.19.20100706.IFIC-LCG2_SCRATCHDISK: Querying local file catalogue of site IFIC-LCG2_SCRATCHDISK... user10.ElenaOliverGarcia.ganga.19.20100706.IFIC-LCG2_SCRATCHDISK/user10.ElenaOliverGarcia.ganga.19.201007061452198943._00003.AnalysisSkeleton.aan.root: Getting SRM metadata for srm://srmv2.ific.uv.es:8443/srm/managerv2?SFN=/lustre/ific.uv.es/grid/atlas/atlasscratchdisk/user10/ElenaOliverGarcia/ganga/user10.ElenaOliverGarcia.ganga.19.20100706/user10.ElenaOliverGarcia.ganga.19.201007061452198943._00003.AnalysisSkeleton.aan.root user10.ElenaOliverGarcia.ganga.19.20100706.IFIC-LCG2_SCRATCHDISK/user10.ElenaOliverGarcia.ganga.19.201007061452198943._00003.AnalysisSkeleton.aan.root: is cached. user10.ElenaOliverGarcia.ganga.19.20100706.IFIC-LCG2_SCRATCHDISK/user10.ElenaOliverGarcia.ganga.19.201007061452198943._00003.AnalysisSkeleton.aan.root: Starting transfer: lcg-cp -v --vo atlas -b -D srmv2 srm://srmv2.ific.uv.es:8443/srm/managerv2?SFN=/lustre/ific.uv.es/grid/atlas/atlasscratchdisk/user10/ElenaOliverGarcia/ganga/user10.ElenaOliverGarcia.ganga.19.20100706/user10.ElenaOliverGarcia.ganga.19.201007061452198943._00003.AnalysisSkeleton.aan.root file:///afs/ific.uv.es/user/o/oliverg/AthenaTestArea/15.3.1.6/PhysicsAnalysis/AnalysisCommon/UserAnalysis/run/user10.ElenaOliverGarcia.ganga.19.20100706.IFIC-LCG2_SCRATCHDISK/user10.ElenaOliverGarcia.ganga.19.201007061452198943._00003.AnalysisSkeleton.aan.root user10.ElenaOliverGarcia.ganga.19.20100706.IFIC-LCG2_SCRATCHDISK/user10.ElenaOliverGarcia.ganga.19.201007061452198943._00003.AnalysisSkeleton.aan.root: 4116098/4116098 transferred user10.ElenaOliverGarcia.ganga.19.20100706.IFIC-LCG2_SCRATCHDISK/user10.ElenaOliverGarcia.ganga.19.201007061452198943._00003.AnalysisSkeleton.aan.root: validated Finished

In [25]:!root user10.ElenaOliverGarcia.ganga.19.20100706.IFIC-LCG2_SCRATCHDISK/user10.ElenaOliverGarcia.ganga.19.201007061452198943._00003.AnalysisSkeleton.aan.root ***************************************** * * * W E L C O M E to R O O T * * * * Version 5.22/00d 27 July 2009 * * * * You are welcome to visit our Web site * * http://root.cern.ch * * * *****************************************

ROOT 5.22/00d (branches/v5-22-00-patches@29532, Jul 27 2009, 18:35:00 on linux)

CINT/ROOT C/C++ Interpreter version 5.16.29, Jan 08, 2008 Type ? for help. Commands must be C++ statements. Enclose multiple statements between { }. root [0] Attaching file user10.ElenaOliverGarcia.ganga.19.20100706.IFIC-LCG2_SCRATCHDISK/user10.ElenaOliverGarcia.ganga.19.201007061452198943._00003.AnalysisSkeleton.aan.root as _file0... Warning in <TClass::TClass>: no dictionary for class AttributeListLayout? is available Warning in <TClass::TClass>: no dictionary for class pair<string,string> is available root [1] TBrowser yeah;

V.- Athena-Ganga job Panda backend

V.1.- Exercice 4:

To submit athena job on grid with Panda backend

The python file:


j = Job()
j.application = Athena()
j.application.option_file = 'AnalysisSkeleton_topOptions.py'
j.application.max_events = -1
j.application.athena_compile = False
j.application.prepare()
j.splitter = DQ2JobSplitter()
j.splitter.numfiles=1
j.inputdata = DQ2Dataset()
j.inputdata.dataset="mc08.105200.T1_McAtNlo_Jimmy.merge.AOD.e357_s462_d150_r642_t53_tid105572_00"
j.outputdata=DQ2OutputDataset()
j.backend=Panda()
j.backend.requirements= PandaRequirements()
j.backend.requirements.cloud='US'
j.submit()

To send the job:

In [42]: execfile('gangapanda.py')
GangaAtlas.Lib.Athena              : WARNING  New prepare() method has been called. The old prepare method is called now prepare_old()
GangaAtlas.Lib.Athena              : INFO     Found Working Directory /afs/ific.uv.es/user/o/oliverg/AthenaTestArea/15.3.1.6
GangaAtlas.Lib.Athena              : INFO     Found ATLAS Release 15.3.1
GangaAtlas.Lib.Athena              : INFO     Found ATLAS Production Release 15.3.1.6
GangaAtlas.Lib.Athena              : INFO     Found ATLAS Project AtlasProduction
GangaAtlas.Lib.Athena              : INFO     Found ATLAS CMTCONFIG i686-slc4-gcc34-opt
GangaAtlas.Lib.Athena              : INFO     Using run directory: PhysicsAnalysis/AnalysisCommon/UserAnalysis/run/
GangaAtlas.Lib.Athena              : INFO     Extracting athena run configuration ...
GangaAtlas.Lib.Athena              : INFO     Detected Athena run configuration: {'input': {}, 'other': {}, 'output': {'outAANT': [('AANTupleStream', 'AANT')], 'alloutputs': ['AnalysisSkeleton.aan.root']}}
GangaAtlas.Lib.Athena              : INFO     Creating /tmp/oliverg/sources.64943477-7ce7-4936-8326-327d27ae35eb.tar ...
GangaAtlas.Lib.Athena              : INFO     Option athena_compile=False. Adding InstallArea to /tmp/oliverg/sources.64943477-7ce7-4936-8326-327d27ae35eb.tar ...
Ganga.GPIDev.Lib.Job               : INFO     submitting job 21
Ganga.GPIDev.Lib.Job               : INFO     job 21 status changed to "submitting"
GangaAtlas.Lib.Athena              : INFO     Dataset mc08.105200.T1_McAtNlo_Jimmy.merge.AOD.e357_s462_d150_r642_t53_tid105572_00 contains 22 files in 85483019715 bytes
GangaAtlas.Lib.Athena              : INFO     Total num files=22, total file size=85483019715 bytes
GangaAtlas.Lib.ATLASDataset        : INFO     Dataset mc08.105200.T1_McAtNlo_Jimmy.merge.AOD.e357_s462_d150_r642_t53_tid105572_00 has 5 locations
GangaAtlas.Lib.ATLASDataset        : WARNING  Please be patient - waiting for site-index update at site MWT2_UC_MCDISK ...
GangaAtlas.Lib.Athena              : INFO     DQ2JobSplitter will attempt to create 22 subjobs using 1 files per subjob subject to a limit of 15032385536 Bytes per subjob.
GangaAtlas.Lib.Athena              : INFO     Total files assigned to subjobs is 22
Ganga.GPIDev.Lib.Job               : INFO     job 21.0 status changed to "submitting"
Ganga.GPIDev.Lib.Job               : INFO     job 21.1 status changed to "submitting"
Ganga.GPIDev.Lib.Job               : INFO     job 21.2 status changed to "submitting"
Ganga.GPIDev.Lib.Job               : INFO     job 21.3 status changed to "submitting"
Ganga.GPIDev.Lib.Job               : INFO     job 21.4 status changed to "submitting"
Ganga.GPIDev.Lib.Job               : INFO     job 21.5 status changed to "submitting"
Ganga.GPIDev.Lib.Job               : INFO     job 21.6 status changed to "submitting"
Ganga.GPIDev.Lib.Job               : INFO     job 21.7 status changed to "submitting"
Ganga.GPIDev.Lib.Job               : INFO     job 21.8 status changed to "submitting"
Ganga.GPIDev.Lib.Job               : INFO     job 21.9 status changed to "submitting"
Ganga.GPIDev.Lib.Job               : INFO     job 21.10 status changed to "submitting"
Ganga.GPIDev.Lib.Job               : INFO     job 21.11 status changed to "submitting"
Ganga.GPIDev.Lib.Job               : INFO     job 21.12 status changed to "submitting"
Ganga.GPIDev.Lib.Job               : INFO     job 21.13 status changed to "submitting"
Ganga.GPIDev.Lib.Job               : INFO     job 21.14 status changed to "submitting"
Ganga.GPIDev.Lib.Job               : INFO     job 21.15 status changed to "submitting"
Ganga.GPIDev.Lib.Job               : INFO     job 21.16 status changed to "submitting"
Ganga.GPIDev.Lib.Job               : INFO     job 21.17 status changed to "submitting"
Ganga.GPIDev.Lib.Job               : INFO     job 21.18 status changed to "submitting"
Ganga.GPIDev.Lib.Job               : INFO     job 21.19 status changed to "submitting"
Ganga.GPIDev.Lib.Job               : INFO     job 21.20 status changed to "submitting"
Ganga.GPIDev.Lib.Job               : INFO     job 21.21 status changed to "submitting"
Ganga.GPIDev.Lib.Job               : INFO     job 21.0 status changed to "submitted"
Ganga.GPIDev.Lib.Job               : INFO     job 21.1 status changed to "submitted"
Ganga.GPIDev.Lib.Job               : INFO     job 21.2 status changed to "submitted"
Ganga.GPIDev.Lib.Job               : INFO     job 21.3 status changed to "submitted"
Ganga.GPIDev.Lib.Job               : INFO     job 21.4 status changed to "submitted"
Ganga.GPIDev.Lib.Job               : INFO     job 21.5 status changed to "submitted"
Ganga.GPIDev.Lib.Job               : INFO     job 21.6 status changed to "submitted"
Ganga.GPIDev.Lib.Job               : INFO     job 21.7 status changed to "submitted"
Ganga.GPIDev.Lib.Job               : INFO     job 21.8 status changed to "submitted"
Ganga.GPIDev.Lib.Job               : INFO     job 21.9 status changed to "submitted"
Ganga.GPIDev.Lib.Job               : INFO     job 21.10 status changed to "submitted"
Ganga.GPIDev.Lib.Job               : INFO     job 21.11 status changed to "submitted"
Ganga.GPIDev.Lib.Job               : INFO     job 21.12 status changed to "submitted"
Ganga.GPIDev.Lib.Job               : INFO     job 21.13 status changed to "submitted"
Ganga.GPIDev.Lib.Job               : INFO     job 21.14 status changed to "submitted"
Ganga.GPIDev.Lib.Job               : INFO     job 21.15 status changed to "submitted"
Ganga.GPIDev.Lib.Job               : INFO     job 21.16 status changed to "submitted"
Ganga.GPIDev.Lib.Job               : INFO     job 21.17 status changed to "submitted"
Ganga.GPIDev.Lib.Job               : INFO     job 21.18 status changed to "submitted"
Ganga.GPIDev.Lib.Job               : INFO     job 21.19 status changed to "submitted"
Ganga.GPIDev.Lib.Job               : INFO     job 21.20 status changed to "submitted"
Ganga.GPIDev.Lib.Job               : INFO     job 21.21 status changed to "submitted"
Ganga.GPIDev.Lib.Job               : INFO     job 21 status changed to "submitted"


-- ElenaOliverGarcia - 6 Jul 2010

View topic | Edit |  | WYSIWYG | Attach | PDF | Raw View | Backlinks: Web, All Webs | History: r7 |r4 < r3 < r2 < r1 | More topic actions...
 
Powered by TWiki
This site is powered by the TWiki collaboration platformCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback