Upload
minya
View
42
Download
0
Embed Size (px)
DESCRIPTION
BDII Practicals. Claudio Cherubino INFN – Catania Third EELA Tutorial for Managers and Users Rio de Janeiro, 26-30 June 2006. Querying the Information System. lcg-infosites. lcg-info. In order to query directly the IS elements two high level tools are provided: - PowerPoint PPT Presentation
Citation preview
FP6−2004−Infrastructures−6-SSA-026409
www.eu-eela.org
E-infrastructure shared between Europe and Latin America
BDII Practicals
Claudio CherubinoINFN – CataniaThird EELA Tutorial for Managers and UsersRio de Janeiro, 26-30 June 2006
Third EELA Tutorial, Rio de Janeiro, 26-30 June 2006 2FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
Querying the Information System
• In order to query directly the IS elements two high level tools are provided:
• These tools should be enough for most common user needs and can be used to hide the complexity of raw LDAP queries.
lcg-infosites
lcg-info
Third EELA Tutorial, Rio de Janeiro, 26-30 June 2006 3FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
lcg-infosites - 1
This tool provides information related to Grid services:lcg-infosites --vo <your_vo> option –-is <your_bdii> • It’s mandatory to include the vo and the option.• The -- is option specifies the BDII you want to query. If not supplied, the BDII defined into the environment variable LCG_GFAL_INFOSYS will be used.
List of options:
closeSE Names of the CEs where the user’s VO is allowed to run together with their corresponding closest SEs
ce Number of CPUs, running and waiting jobs and names of the CEs
se SEs names together with the available and used space
lfc Name of the lfc Catalog for the user’s VO
all It groups all the features just described
help Prints all the available options and exit
Third EELA Tutorial, Rio de Janeiro, 26-30 June 2006 4FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
Exercise 1
Obtaining information about CE
Third EELA Tutorial, Rio de Janeiro, 26-30 June 2006 5FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
lcg-infosites - 2
****************************************************************
These are the related data for gilda: (in terms of queues and CPUs)
****************************************************************
#CPU Free Total Jobs Running Waiting ComputingElement
----------------------------------------------------------
6 6 0 0 0 grid004.iucc.ac.il:2119/jobmanager-lcgpbs-long
0 0 0 0 0 cn01.be.itu.edu.tr:2119/jobmanager-lcglsf-long
10 10 0 0 0 dgt01.ui.savba.sk:2119/jobmanager-lcgpbs-long
6 6 0 0 0 grid004.iucc.ac.il:2119/jobmanager-lcgpbs-short
0 0 0 0 0 cn01.be.itu.edu.tr:2119/jobmanager-lcglsf-short
10 10 0 0 0 dgt01.ui.savba.sk:2119/jobmanager-lcgpbs-short
16 16 0 0 0 grid010.ct.infn.it:2119/jobmanager-lcgpbs-long
10 10 0 0 0 grid011f.cnaf.infn.it:2119/jobmanager-lcgpbs-long
6 6 0 0 0 grid004.iucc.ac.il:2119/jobmanager-lcgpbs-infinite
16 16 0 0 0 grid010.ct.infn.it:2119/jobmanager-lcgpbs-short
10 10 0 0 0 grid011f.cnaf.infn.it:2119/jobmanager-lcgpbs-short
0 0 0 0 0 cn01.be.itu.edu.tr:2119/jobmanager-lcglsf-infinite
10 10 0 0 0 dgt01.ui.savba.sk:2119/jobmanager-lcgpbs-infinite
2 2 0 0 0 gildace.oact.inaf.it:2119/jobmanager-lcgpbs-long
10 10 0 0 0 gilda-ce-01.pd.infn.it:2119/jobmanager-lcgpbs-long
2 2 0 0 0 gildace.oact.inaf.it:2119/jobmanager-lcgpbs-short
10 10 0 0 0 gilda-ce-01.pd.infn.it:2119/jobmanager-lcgpbs-short
16 16 2 2 0 grid010.ct.infn.it:2119/jobmanager-lcgpbs-infinite
10 10 0 0 0 grid011f.cnaf.infn.it:2119/jobmanager-lcgpbs-infinite
2 2 0 0 0 gildace.oact.inaf.it:2119/jobmanager-lcgpbs-infinite
10 10 4 4 0 gilda-ce-01.pd.infn.it:2119/jobmanager-lcgpbs-infinite
To retrieve the status of all available CEs serving the GILDA VO:lcg-infosites –-vo gilda ce –-is eelatut04.eela.if.ufrj.br:2170
Third EELA Tutorial, Rio de Janeiro, 26-30 June 2006 6FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
Exercise 2
Obtaining information about SE
Third EELA Tutorial, Rio de Janeiro, 26-30 June 2006 7FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
lcg-infosites - 3
To retrieve the status of all available SEs serving the GILDA VO:lcg-infosites –-vo gilda se –-is eelatut04.eela.if.ufrj.br:2170
**************************************************************
These are the related data for gilda: (in terms of SE)
**************************************************************
Avail Space(Kb) Used Space(Kb) Type SEs
----------------------------------------------------------
912356296 51120 grid005.iucc.ac.il
143511344 2509092 cn02.be.itu.edu.tr
68930000 6200000 egee016.cnaf.infn.it
26700000 8010000 lxcde07.pd.infn.it
140742384 146535224 grid009.ct.infn.it
16160000000 410000000 aliserv6.ct.infn.it
108150932 3033064 gildase.oact.inaf.it
28071068 3088712 testbed005.cnaf.infn.it
348586904 447804 gilda-se-01.pd.infn.it
Third EELA Tutorial, Rio de Janeiro, 26-30 June 2006 8FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
Exercise 3
Listing the closeSE
Third EELA Tutorial, Rio de Janeiro, 26-30 June 2006 9FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
The closeSE feature shows the name of the CEs together with their corresponding closest SEs:lcg-infosites –-vo gilda closeSE
lcg-infosites - 4
Name of the CE: grid004.iucc.ac.il:2119/jobmanager-lcgpbs-long
Name of the close SE: grid005.iucc.ac.il
Name of the CE: cn01.be.itu.edu.tr:2119/jobmanager-lcglsf-long
Name of the close SE: cn02.be.itu.edu.tr
Name of the CE: grid004.iucc.ac.il:2119/jobmanager-lcgpbs-short
Name of the close SE: grid005.iucc.ac.il
Name of the CE: cn01.be.itu.edu.tr:2119/jobmanager-lcglsf-short
Name of the close SE: cn02.be.itu.edu.tr
Name of the CE: grid010.ct.infn.it:2119/jobmanager-lcgpbs-long
Name of the close SE: grid009.ct.infn.it
......
Third EELA Tutorial, Rio de Janeiro, 26-30 June 2006 10
FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
lcg-info
• This program allows the user to query, in a deeper way, the BDII. It requires the environmental variable LCG_GFAL_INFOSYS to be set to the value of the BDII to be queried, e.g. eelatut04.eela.if.ufrj.br:2170
• Prints the list of the CEs or SEs satisfying a given query along with a list of specified attributes.
• The query syntax is like this:
attr1 op1 valueN, ... attrN opN valueN– where attrN is an attribute name.– op is =, >= or <=, and the cuts are ANDed. – A combination of attribute is supported.– The cuts are comma-separated and spaces are not allowed.
SINCE THE LATEST GLUE-SCHEMA UPDATE ONLY “=“ OPERATOR IS SUPPORTED!
Third EELA Tutorial, Rio de Janeiro, 26-30 June 2006 11
FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
lcg-info options
--list-attrs Prints a list of attributes that can be queried.
--list-ce Lists the CEs which satisfy a query, or all the CEs if no query is given.
--list-se Lists the SEs which satisfy a query, or all the SEs if no query is given.
--query Restricts the output to the CEs (SEs) which satisfy the given query.
--bdii Allows to specify a BDII in the form <hostname>:<port>. If not given, the value of the environmental variable LCG_GFAL_INFOSYS is used. If that is not defined, the command returns an error.
--sed Print the output in a "sed-friendly" format.
--attrs Specifies the attributes whose values should be printed.
--vo Restricts the output to CEs or SEs where the given VO is authorized. Mandatory when VO-dependent attributes are queried upon.
Third EELA Tutorial, Rio de Janeiro, 26-30 June 2006 12
FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
Exercise 4
List all the “queryable” attributes
Third EELA Tutorial, Rio de Janeiro, 26-30 June 2006 13
FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
lcg-info examples - 1
To get the list of all the “queryable” attributes:
lcg-info --list-attrsAttribute name Glue object class Glue attribute name
MaxTime GlueCE GlueCEPolicyMaxWallClockTime
CEStatus GlueCE GlueCEStateStatus
TotalJobs GlueCE GlueCEStateTotalJobs
CEVOs GlueCE GlueCEAccessControlBaseRule
TotalCPUs GlueCE GlueCEInfoTotalCPUs
FreeCPUs GlueCE GlueCEStateFreeCPUs
CE GlueCE GlueCEUniqueID
WaitingJobs GlueCE GlueCEStateWaitingJobs
RunningJobs GlueCE GlueCEStateRunningJobs
CloseCE GlueCESEBindGroup GlueCESEBindGroupCEUniqueID
CloseSE GlueCESEBindGroup GlueCESEBindGroupSEUniqueID
SEVOs GlueSA GlueSAAccessControlBaseRule
UsedSpace GlueSA GlueSAStateUsedSpace
AvailableSpace GlueSA GlueSAStateAvailableSpace
Type GlueSE GlueSEType
SE GlueSE GlueSEUniqueID
Protocol GlueSEAccessProtocol GlueSEAccessProtocolType
ArchType GlueSL GlueSLArchitectureType
Processor GlueSubCluster GlueHostProcessorModel
OS GlueSubCluster GlueHostOperatingSystemName
Cluster GlueSubCluster GlueSubClusterUniqueID
Tag GlueSubCluster GlueHostApplicationSoftwareRunTimeEnvironment
Memory GlueSubCluster GlueHostMainMemoryRAMSize
OSVersion GlueSubCluster GlueHostOperatingSystemRelease
Third EELA Tutorial, Rio de Janeiro, 26-30 June 2006 14
FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
Exercise 5
Listing tags of installed softwares
Third EELA Tutorial, Rio de Janeiro, 26-30 June 2006 15
FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
lcg-info examples - 2
To discover which software is supported by the CEs:
lcg-info --list-ce --attrs Tag
- CE: gilda-ce-01.pd.infn.it:2119/jobmanager-lcgpbs-infinite
PBS
INFN
PADOVA
LCG-2
LCG-2_1_0
LCG-2_1_1
LCG-2_2_0
LCG-2_3_0
LCG-2_3_1
LCG-2_4_0
LCG-2_6_0
R-GMA
AFS
CMS-1.1.0
VIRGO-1.0
ATLAS-6.0.4
GATE-1.0.0-3
LHCb-1.1.1
IDL-5.4
CMSIM-125
ALICE-4.01.00
ALIEN-1.32.14
POVRAY-3.5
DEMTOOLS-1.0
CMKIN-VALID
CMKIN-1.1.0
CMSIM-VALID
CSOUND-4.13
MPICH
CMS-OSCAR-2.4.5
LHCb_dbase_common-v3r1
GEANT4-6
VLC-0.7.2
EGEODE-1.0
RASTER3D
SCILAB-2.6
G95-3.5.0
MAGIC-6.19
CODESA3D-1.0
OpenFOAM-1.2
SI00MeanPerCPU=450
SF00MeanPerCPU=300
VO-gilda-GKS05
Third EELA Tutorial, Rio de Janeiro, 26-30 June 2006 16
FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
Exercise 6
List all the CEs with their FreeCPUs and TotalJobs attributes
Third EELA Tutorial, Rio de Janeiro, 26-30 June 2006 17
FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
lcg-info examples - 3
To list only some attributes of the CEs:
lcg-info --list-ce --attrs ‘FreeCPUs,TotalJobs’
- CE: grid004.iucc.ac.il:2119/jobmanager-lcgpbs-long
- FreeCPUs 6
- TotalJobs 0
- CE: cn01.be.itu.edu.tr:2119/jobmanager-lcglsf-long
- FreeCPUs 0
- TotalJobs 0
- CE: dgt01.ui.savba.sk:2119/jobmanager-lcgpbs-long
- FreeCPUs 10
- TotalJobs 0
- CE: grid004.iucc.ac.il:2119/jobmanager-lcgpbs-short
- FreeCPUs 6
- TotalJobs 0
- CE: cn01.be.itu.edu.tr:2119/jobmanager-lcglsf-short
- FreeCPUs 0
- TotalJobs 0
Third EELA Tutorial, Rio de Janeiro, 26-30 June 2006 18
FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
Exercise 7
List FreeCPUs and TotalJobs attributes of all the CEs that have TotalCPUs = 10
Third EELA Tutorial, Rio de Janeiro, 26-30 June 2006 19
FP6−2004−Infrastructures−6-SSA-026409
E-infrastructure shared between Europe and Latin America
To get the list of all the CEs which satisfy a given query:
lcg-info --list-ce --attrs ‘FreeCPUs,TotalJobs’ --query ‘TotalCPUs=10’
lcg-info examples - 4
- CE: dgt01.ui.savba.sk:2119/jobmanager-lcgpbs-long
- FreeCPUs 10
- TotalJobs 0
- CE: dgt01.ui.savba.sk:2119/jobmanager-lcgpbs-short
- FreeCPUs 10
- TotalJobs 0
- CE: grid011f.cnaf.infn.it:2119/jobmanager-lcgpbs-long
- FreeCPUs 10
- TotalJobs 0
- CE: grid011f.cnaf.infn.it:2119/jobmanager-lcgpbs-short
- FreeCPUs 10
- TotalJobs 0
- CE: dgt01.ui.savba.sk:2119/jobmanager-lcgpbs-infinite
- FreeCPUs 10
- TotalJobs 0