View
304
Download
0
Category
Preview:
Citation preview
© 2009 IBM Corporation
CMG 2014Fernando Ferreira IBM ATS System z - zChampion – IBM Academy
15 Maio 2014
Conceitos e desafios dePlanejamento de capacidade em ambiente Parallel Sysplex
©201
3 I
BM
Corp
ora
tion
CMG 2014
Index
• Introdução
• z/OS
• Coupling Facility
• Conectividade
• Referencias
2
©201
3 I
BM
Corp
ora
tion
CMG 2014
Introdução
3
©201
3 I
BM
Corp
ora
tion
CMG 2014
Fatores de Performance
4
CF
CEC
� Velocidade de processador
� Tipo de request (sinc/assinc)
� Conectividade (CHPID,Subcanal )
Coupling facility
� Velocidade de processador
� Configuraçào (ded/shared)
� Carga
� Memória
Link
� Tipo deCF link
� Banda
� PATH Busy
Miscelaneous
� Duplexing
� Estruturas
� Distancia
©201
3 I
BM
Corp
ora
tion
CMG 2014
Coupling Facility
5
CF
Componentes
� Quantidade de CFs
� Tipo/Modelo CEC
� Numero/tipo de processadores
� Configuração (ded/shared)
� Memória
� Canais
� FlashExpress
� CBU
Fatores
� Numero de requests
� Tipos de estrutura
� Tipo de workload
� Configuração do CEC (CF)
� Nivel CFCC
� Configuração do CEC (z/OS)
� Topologia
� Duplexing
� Necessidade de recursos “spare”
©201
3 I
BM
Corp
ora
tion
CMG 2014
z/OS CEC
6
CF
Distancia
Componentes
� Capacidade
� Numero/tipo de processadores
� Memória
� Canais
Fatores
� Numero de requests
� Tipos de estrutura
� Tipo de workload
� Performance CF
� Distancia
� Topologia
� Tipo de lInks
� Duplexing
©201
3 I
BM
Corp
ora
tion
CMG 2014
Coupling Facility
7
©201
3 I
BM
Corp
ora
tion
CMG 2014
Topologia
CF 1CF 2
Sys B
Site ASite B
Sys 2
5k m
0k m
Sys 1
CF 3
©201
3 I
BM
Corp
ora
tion
CMG 2014
CF Duplexing
9
CF 1CF 2
Sys B
Site ASite B
Sys A
5k m
0k m
©201
3 I
BM
Corp
ora
tion
CMG 2014
Configuracão
©201
3 I
BM
Corp
ora
tion
CMG 2014
Arquitetura
©201
3 I
BM
Corp
ora
tion
CMG 2014
z/OS
12
©201
3 I
BM
Corp
ora
tion
CMG 2014
CPU x Service Time
0
5
10
15
20
25
30
35
40
45
1 3 5 7 9 11 13 15 17 19 21 23 25 27 29 31 33 35 37 39
Service Time
CP
U T
ime
Async
Sync
Sincrono x Assincrono - z/OS Heuristic Algoritm
13
Note 1 ; Escale used is only a comparison example
+10µ +33µX +21µX +??µ
©201
3 I
BM
Corp
ora
tion
CMG 2014
Sincrono x Assincrono – Nova opção (SYNCASYNC)
14
� z/OS V2.1, V1.13, V1.12
PARMLIB COPLEXX
SYNCASYNC SIMPLEX(DEFAULT) DUPLEX(32)
SYNCASYNC LOCKSIMPLEX (DEFAULT) LOCKDUPLEX(38)
or
SETXCF MODIFY,SYNCASYNC,LOCKSIMPLEX=38
CPU x Service Time - Sync/Async Threshold
0
10
20
30
40
50
60
70
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30
Service Time
CP
U T
ime
Async
Sync
CPU x Service Time - Sync/Async Threshold
0
10
20
30
40
50
60
70
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30
Service Time
CP
U T
ime Async
Sync
Threshold
D XCF,C
IXC357I 10.26.53 DISPLAY XCF 470
SYSTEM FERNAFE DATA
INTERVAL OPNOTIFY MAXMSG CLEANUP RETRY CLASSLEN
370 200 1000 10 10 835
SSUM ACTION SSUM INTERVAL SSUM LIMIT WEIGHT MEMSTALLTIME
ISOLATE 0 500 70 300
CFSTRHANGTIME
900
...
SYNC/ASYNC CONVERSION THRESHOLD -SOURCE- DEFAULT
SIMPLEX 26 PARMLIB IN USE
DUPLEX 30 PARMLIB 26
LOCK SIMPLEX 38 SETXCF IN USE
LOCK DUPLEX 26 SYSTEM IN USE
©201
3 I
BM
Corp
ora
tion
CMG 2014
Sincrono x Assincrono - RMF
STRUCTURE NAME = FNFLOCK TYPE = LOCK STATUS = ACTIVE
# REQ -------------- REQUESTS ------------- -------------- DELAYED REQUESTS -------------
SYSTEM TOTAL # % OF -SERV TIME(MIC)- REASON # % OF ---- AVG TIME(MIC) ----- EXTERNAL REQUEST
NAME AVG/SEC REQ ALL AVG STD_DEV REQ REQ /DEL STD_DEV /ALL CONTENTIONS
------------------------------------------------------------------------------------------------------------------------------
TOTAL 900M SYNC 5500K 100 5.0 5.0 NO SCH 250K 0.0 333.9 73.4 0.0 REQ TOTAL 43M
11349 ASYNC 0 0.0 85.0 11.2 PR WT 0 0.0 0.0 0.0 0.0 REQ DEFERRED 90K
CHNGD 250K 0.0 PR CMP 0 0.0 0.0 0.0 0.0 -CONT 90K
-FALSE CONT 39K
15
STRUCTURE NAME = FNFLOCK TYPE = LOCK STATUS = ACTIVE
# REQ -------------- REQUESTS ------------- -------------- DELAYED REQUESTS -------------
SYSTEM TOTAL # % OF -SERV TIME(MIC)- REASON # % OF ---- AVG TIME(MIC) ----- EXTERNAL REQUEST
NAME AVG/SEC REQ ALL AVG STD_DEV REQ REQ /DEL STD_DEV /ALL CONTENTIONS
------------------------------------------------------------------------------------------------------------------------------
TOTAL 900M SYNC 5500K 100 15.0 15.0 NO SCH 250K 0.0 333.9 73.4 0.0 REQ TOTAL 43M
11349 ASYNC 0 0.0 85.0 11.2 PR WT 0 0.0 0.0 0.0 0.0 REQ DEFERRED 90K
CHNGD 250K 0.0 PR CMP 0 0.0 0.0 0.0 0.0 -CONT 90K
-FALSE CONT 39K
Overhead (rough) = (Num Req * # service time / Interval RMF) * MIPS GCP (individual)
©201
3 I
BM
Corp
ora
tion
CMG 2014
16
12x InfiniBand
HCA2-O**
HCA2-C
I/O Drawer
ISC-3
ISC-3
ISC-3
ISC-3
zEC12, zBC12, z196, z114, z10
EC, z10 BC
IFB-MP
zBC12
ISC-3**
HCA2-O LR**
Up to 150 meters
Up to 10/100 km
.... ....
1x InfiniBand
Up to 10/100KM
Fanouts
HCA3-O* HCA3-O LR*
.... ....
12x InfiniBand
Up to 150 meters1x InfiniBand
Up to 10/100KM
* Not supported on z10**Carry forward only on zEC12/zBC12
zBC12/zEC12 Coupling Links
� Fanout, not I/O slot, used for
InfiniBand
� ICB-4 – No longer supported
� ETR – No longer supported
� All coupling links support STP
� Sysplex Coexistence – zEC12,
z196, z114, z10 EC and BC only
zEC12
©201
3 I
BM
Corp
ora
tion
CMG 2014
Type Throughput Distance Fanout Cabling
12x InfiniBand 6 GBps 150 metersHCA2-OHCA3-O
50µ MM (OM3) fiber
1x InfiniBand 5 or 2.5 Gbps 10 kmHCA2-O LR*HCA3-O LR
9µ SM fiber
InfiniBand coupling links
HCA3-O LR fanout for 1x InfiniBand coupling links
� CHPID type – CIB
– Four ports per feature
– Fiber optic cabling
– Link sharing between multiple Sysplexes
– Up to 10 km without repeaters, RPQ 8P2263 or 8P2340 is required for 20 km support
– Up to 100 km are also possible using Dense Wavelength Division Multiplexors (DWDMs), going over 100 km requires RPQ 8P2263 or 8P2340
– Supports connectivity to HCA2-O LR
– Link data rate server-to-server 5 Gbps
– Link data rate with DWDM; 2.5 or 5 Gbps
CHPID / Subchannel Options
– 7 subchannels per CHPID (default)
– Option to define 32 or 7 subchannels
– Default changed from 32 to 7 for zEC12
HCA3-O fanout for 12x InfiniBand coupling links
• CHPID type – CIB
– Two ports per feature
– Fiber optic cabling – 150 meters
– Supports connectivity to HCA2-O
– Link data rate of 6 GBps
Two protocols (IFB & IFB3)
1. 12x IFB = HCA3-O to HCA2-O
2. 12x IFB3 = HCA3-O to HCA3-O (see below)
• 12x IFB3 service times designed to be 40% faster than 12x IFB
12x IFB3 protocol activation requirements
– Maximum of four CHPIDs per HCA3-O port
• If more than four CHIPDs are defined per port, links will run at normal 12x IFB service times
• IFB3 protocol activated as long as 4 CHPIDs or less are
defined. No configuration settings required.
©201
3 I
BM
Corp
ora
tion
CMG 2014
Coupling Links Subchannel
� Best practice ���� CFSU < 30%
( #Requests Sync x Service TimeSync) + (#Requests Sync x Service TimeSync) CFSU = --------------------------------------------------------------------------------------------------------------
#Subcanais
CF 1
Sys A
12x InfiniBand
10µ
CFSU = (0,1 * 10) / 7 � 14,3%
100k req/sCF 1
Sys A
10µ + 60µ (6 km)
CFSU = (0,1 * 70) / 7 � 100%
100k req/s
1x InfiniBand
CFSU = (0,1 * 70) / 32 � 21,9%
©201
3 I
BM
Corp
ora
tion
CMG 2014
Relatório RMF subcanais e PATH Busy
19
1 C O U P L I N G F A C I L I T Y A C T I V I T Y
PAGE 41
z/OS V1R12 SYSPLEX SYSPLEXF START 08/03/2014-13.00.00 INTERVAL 001.00.00
RPT VERSION V1R12 RMF END 08/03/2014-14.00.00 CYCLE 05.000 SECONDS
------------------------------------------------------------------------------------------------------------------------------
COUPLING FACILITY NAME = CF01
------------------------------------------------------------------------------------------------------------------------------
SUBCHANNEL ACTIVITY
------------------------------------------------------------------------------------------------------------------------------
# REQ ----------- REQUESTS ----------- ------------------ DELAYED REQUESTS --------------
SYSTEM TOTAL -- CF LINKS -- PTH # -SERVICE TIME(MIC)- # % OF ------ AVG TIME(MIC) ------
NAME AVG/SEC TYPE GEN USE BUSY REQ AVG STD_DEV REQ REQ /DEL STD_DEV /ALL
MVSA 3247K CIB 8 8 310K SYNC 2689K 12.6 2.2 LIST/CACHE 0 0.0 0.0 0.0 0.0
963.7 SUBCH 56 56 ASYNC 527803 175.8 1463 LOCK 0 0.0 0.0 0.0 0.0
CHANGED 0 INCLUDED IN ASYNC TOTAL 0 0.0
UNSUCC 0 0.0 0.0
MVSY 160030K CIB 6 6 30M SYNC 138591K 15.4 4.4 LIST/CACHE 0 0.0 0.0 0.0 0.0
46442 SUBCH 42 32 ASYNC 6462K 38.2 90.0 LOCK 0 0.0 0.0 0.0 0.0
CHANGED 0 INCLUDED IN ASYNC TOTAL 0 0.0
UNSUCC 0 0.0 0.0
MVSW 8070K CIB 6 6 16M SYNC 5447K 11.6 2.4 LIST/CACHE 0 0.0 0.0 0.0 0.0
1848.6 SUBCH 42 12 ASYNC 1171K 78.0 1163 LOCK 0 0.0 0.0 0.0 0.0
CHANGED 0 INCLUDED IN ASYNC TOTAL 0 0.0
UNSUCC 0 0.0 0.0
©201
3 I
BM
Corp
ora
tion
CMG 2014
Coupling Links and zEC12
20
©201
3 I
BM
Corp
ora
tion
CMG 2014
CF overhead relationship to hardware configuration
21
©201
3 I
BM
Corp
ora
tion
CMG 2014
CF Duplexing – System Managed
22
CF 1CF 2
Sys B
Site ASite B
Sys A
5k m
0k m
©201
3 I
BM
Corp
ora
tion
CMG 2014
CF Duplexing – User Managed
23
CF 1CF 2
Sys B
Site ASite B
Sys A
5k m
0k m
©201
3 I
BM
Corp
ora
tion
CMG 2014
References
• ITSO Redbooks
� http://www.redbooks.ibm.com/
– SG24-8047 zEnterprise End-to-End Extended Distance Connectivity Guide
– SG24-7263 Considerations for Multisite Sysplex Data Sharing
– SG24-7539 Implementing and Managing InfiniBand Coupling Links on System z
– SG24-8049 zEC12 IBM zEnterprise EC12 Technical Guide
– ITSO Workshops “Parallel Sysplex and High Availability” – Frank Kyne
• 2009, 2010, 2011, 2012, 2013
• Other manuals
– SA22-7625 MVS Setting Up a Sysplex
24
Atualizar referencias
©201
3 I
BM
Corp
ora
tion
CMG 2014
Questions
????
25
Recommended