IBM system p - · PDF fileto the world of AIX. ... 기술은2000년대에갑자기만들어진기술이아니며, IBM서버의가상화기술에사용되고있는Firmware

IBM Confidential

The Best Reliable Partner for High Availability

© Copyright IBM Corporation 2008

IBM system p 가상화 기술 소개 및사례 연구

이현진과장

[email protected]

**‘2008 하반기효과적인 시스템 관리를 위한 기술 세미나

IBM Confidential1/96


© IBM Corporation 2008

Agenda

I. 가상화 기술의 배경I. 가상화 기술의 배경

II. 가상화 기술의 소개II. 가상화 기술의 소개

IV. 가상화 기술 사례IV. 가상화 기술 사례

III. 가상화 환경 관리 및 모니터링III. 가상화 환경 관리 및 모니터링




Agenda








Today’s reality: IT operational and energy costs continue to rise

IDC reports that IT operational overhead accounts for 70% of the IT labor budget and is growing at 10% CAGR 2003 –2008

85-95% of server capacity is excess –nearly $140B in over expenditure

Typical company IT energy costs have been rising 15% per year over the last 5 years and are forecast to match or exceed server procurement costs within 5 years

But clients who have optimized their environments have realized…

→ 2X increases in efficiency

→ 2X increases in quality and customer satisfaction

→ 3X increases in revenue growthSource: IDC, 2006, Virtualization 2.0: The Next Phase in Customer Adoption, Doc #204904, Dec 2006

$0

$50

$100

$150

$200

$250

$300

1997

1998

1999

2000

2001

2002

2003

2004

2005

2006

2007

2008

2009

2010

Installed Base(M Units)

Spending(US$B)

0

5

10

15

20

25

30

35

40

45

50

1996

Power and cooling costs x8

Server mgmt and admin costs x4

New server spending




Data source: Green IT: A New Industry Shock Wave, Gartner Symposium/ITxpo, October 2007,

– 2% of anthropogenic CO2

– Roughly equivalent to aviation industry– IT energy usage will double next 4 years

Information Technology (IT) Accounts for….




The New Enterprise Data Center: An evolutionary new model for efficient IT delivery . . .

New economics: Virtualization with optimized systems and networks to break the lock between IT resources and business services

Rapid service delivery: Service management enables visibility, control and automation to deliver quality service at any scale

Aligned with business goals: Real-time integration of transactions, information and analytics - and delivery of IT as a service




Efficient, Green and Optimized Infrastructure

and Facilities

Security and Business Resilience

Business-Driven Service Management

Highly Virtualized Resources

Enterprise Information Architecture

Enabling The New Enterprise Data Center –

a holistic, integrated approach




The New Enterprise Data Center can have far reaching benefits* –

Triple asset utilization

Provision new services in minutes

Reduce disaster recovery time by 85%

Reduce power by 40%

Up to 60% heat reduction

Reduce floor space by 80%

reallocating resources from operations to innovation




Stages of adoption

Physical consolidation and optimizationVirtualization of individual systemsSystems, network and energy management

Drives IT efficiencyHighly virtualized resource pools – “ensembles”Integrated IT service managementGreen by design

Rapid deployment of new infrastructure and services

Virtualization of IT as a service - “cloud”Business-driven service managementService oriented delivery of IT

Highly responsive and business goal driven




Many businesses today see server consolidation as theanswer to these challenges

“Most companies have already begun consolidating their servers — 86 percent of the CIOs we asked cited progress in this area. Virtualization is the next natural move.”

- McKinsey Quarterly, May 2006

Percentage of CIOs consolidating servers

86%

Two-thirds of the companies surveyed prefer to run multiple applications per server in order to minimize costs and labor and to increase flexibility and system utilization.

- IBM Market Intelligence Research, HighEnd UNIX® Buyers, November 2005

66%

Percentage of companies consolidating to reduce costs

86%86%

66%




IBM System p – the right platform for consolidation

Maintenance costs

Software licensing costs

Electrical and cooling costs

Downtime costs throughout your enterprise

Improvement of resource utilization

Ability to quickly add new serviceson demand

Delivery of high levels of availability,response time and security to meet business productivity requirements

Lower your datacenter TCO by reducing:

Increase the operational efficiency of datacenter through the:

With unique IBM virtualization and leadership performance capabilities that enable you to . . .




How can reduce TCO - Examples

Maintenance costs Virtualization 구현으로 시스템 운영 대수 감소, 그로 인한 시스템 운영비용 감소

Virtualization 구현으로 운영 시스템 감소가 가능한 이유 : CPU, Memory, IO adapter, disk의 sharing 또는dynamic resource reallocation을 통한 효율적인 사용

Software licensing costs 운영 시스템 감소로 인한 SWMA 및 각종 application licensing 비용 절감

Electrical and cooling costs 시스템 Consolidation을 통한 운영 대수 절감으로 인한 효과

시스템 사용량이 적은 때에는 LPM(Live Partition Mobility)을 이용해 한시적으로 운영 시스템 절감

Downtime costs throughout your enterprise Virtualization을 통한 planned down time 감소(by utilizing LPM)




Increase the operational efficiency of datacenter - Examples

Improvement of resource utilizationVirtualization 구현의 장점

Ability to quickly add new services on demandVirtualization 구현으로 VIO client를 손쉽게 등록

WPAR 구축을 통한 OS partitioning 개념으로…

Delivery of high levels of availability, response time and security to meet business productivity requirements

Virtualization 구성으로 CPU, Memory Resource sharing을 통해 high performance system 운영가능

OpenSSH for secure remote login, firewall for limiting access by ports, network services and IP addresses

WPAR 구성을 통해 동일 OS 내에서도 RBAC을 통해 WPAR 간 다른 security 운영 환경으로 설정이 가능함




Agenda








IBM 서버의 기술

메인프레임VM의 기초가되는Hypervisor개발 시작

물리적파티션닝을하는 최초의machine 발표

메인프레임에서의논리적파티션닝발표

POWER LPAR 설계 시작

19671967 19731973 19871987

AIX 기반의POWER4™machine에LPAR 도입

Advanced POWER Virtualization발표(micropartitioning지원)

200420042001200119971997

client quote source: rku.it case study published at http://www.ibm.com/software/success/cssdb.nsf/CS/JSTS-6KXPPG?OpenDocument&Site=eserverpseries

“In our opinion, they [System p servers] bring mainframe-quality virtualization capabilities to the world of AIX.”

- Ulrich Klenke, CIO, rku.itJanuary 2006

Advanced POWER Virtualizationon IBM System p servers

Linux® on POWER

20072007

IBM이 UNIX®서버 사상 최초로Live PartitionMobility가가능한POWER6™ 발표

20082008

IBMPowerVM발표

IBM 서버의 가상화 기술은 2000년대에 갑자기 만들어진 기술이 아니며, IBM서버의 가상화 기술에 사용되고 있는 Firmware Level의 가상화 기술은 1967년에 메인프레임에서부터 사용되어진 기술이며 현재 메인프레임을 거쳐 Power System에서 사용되고 있음.




Power Systems Software

Simplify management

Reduce energy costs

Keep your data secure

A roadmap for continuous availability

Maximize your choice of solutions

Exploit the cost savings of virtualization

Software to help maximize the return on IT investments for UNIX, Linux and i5/OS clients




Power Systems Hardware Virtualization = PowerVMPower virtualization from the company who invented VM!




PowerVM Components

PowerVM Components

Shared Processor LPARs

Shared Dedicated Capacity

Multiple Shared Processor Pools

Virtual I/O Server

Integrated Virtualization Manager

Live Partition Mobility

PowerVM Lx86

The scalable virtualization platform for your mission-critical UNIX, Linux and i5/OS® applications!




PowerVMPowerVM Feature에는 Virtual I/O server를 구축해서 VIO 환경을 구현할 수 있는 기능과 On-line 중 시스템 간 Partition 이동이 가능하도록 하는 Live Partition Mobility 기능이 있으며, 한 개의 OS를 최소 0.1개의 CPU로 구성할 수 있는 Micro-Partitioning 기능이 있음.

PowerVM 기능을 이용하면 시스템

자원을 효율적 사용 가능하고 그에 따른

운영 비용을 최대 72%까지 절감하는

효과를 가져 올 수 있음.

Business 환경 변화에 따른 요구를 짧은

시간 동안에 반영 가능하므로 유연한

시스템 운영이 가능함.

Micro-partitioning 기능을 활용하면

하나의 시스템에서 최대 254개까지

partitioning이 가능함.

Virtual I/O ServerShared Ethernet, SCSI, Fibre

Channel Disks

Integrated Virtualization Manager

Manage a single system without an HMC

Live Partition MobilitySchedule a move of a running partition from one p6

Server to another with no downtime

Micro-PartitioningTM

Create up to 10 micro-partitions for each System p5/p6 processor

Resize without rebooting your system

Power VMPower VM




IBM Power System 가상화 기술의 종류

Virtual I/OVirtual LAN*

Micro-Partitions*Shared Processor

Pools*Dynamic LPAR

POWER Hypervisor

하나의 CPU를 10개의서버처럼 파티션 할당

CPU 자원들을가상Pool로 공유

파티션자원의동적인재할당

가상 I/O 가상 네트워크

박스 간의파티션 이동

하나의 OS에여러 개의 파티션 할당

IBM p5 및 p6에는 Mainframe의 가상화 기술 즉, 펌웨어를 기반으로 단일 CPU를 1/10 단위까지 분할하여 할당하는 micro-partitioning, 유휴 CPU 자원을 실시간적으로 활용할 수 있는 shared processor을 비롯하여 고속의 hyper socket, DLPAR, Virtual I/O등을 채택함으로써 유연하고 안정적인 가상화 환경 구축을 실현합니다.

Partition Mobility

Workload Partition




LPAR(Logical Partitioning)대형 SMP 서버에 Partition을 구성하여 운영하는 방법은 일반적으로 Hardware Partitioning, Software Partitioning 과Logical Partitioning의 3가지가 있음. 그 중에서 IBM System p에서 현재까지 주로 사용되어 왔던 Partitioning 기술은 Logical Partitioning 임.

Windows

Software

Firmware

Hardware

Hardware Partitioning

Blade 서버SMP 기반의 서버nPar(HP)Segment(SUN)

Linux Windows

CPU 1 CPU 2 CPU 3 CPU 4

Applications Applications

Software Partitioning

System z 상의 z/VM 인텔 계열서버상의 VMwareContainer(SUN)HPVM(HP)

Linux Windows


z/VM or VMware

Apps AppsApps

IRD 기능을 가진 System z상의 LPARSystem i와 p 상의 LPAR vPar(HP)Domain(SUN)

Logical Partitioning

z/OSLinux


Partitioning Firmware

VSE/ESA

Apps AppsApps




DLPAR (Dynamic Logical Partitioning)DLPAR(Dynamic Logical Partitioning)기술은 하나의 물리적인 서버에 Logical Partition을 구성하여 운영하는 경우 Logical Partition의 Rebooting 없이 CPU, Memory 및 I/O 슬롯을 Partition간에 이동하여 자원을 효율적인 운영 가능하도록 하는 기술임. DLPAR를 이용하여 서버의 Resource를 효율적으로 사용 가능함. 단, partition 간 자원 이동은 주로 HMC를 이용한 수동으로하는 방식을 사용함.

dlpar1 파티션 dlpar2 파티션 dlpar3 파티션

미할당 시스템 자원HMC

Dynamic LPAR




Simultaneous Multi-threading (SMT)POWER4 (Single Threaded)

CRL

FX0FX1LSOLS1FP0FP1BRZ

Thread0 activeNo thread active

Syst

em th

roug

hput

ST

Clock ticks

Exe

cutio

n U

nits

POWER5/6 (simultaneous multithreading)

One processor (dedicated or virtual) appears as two logical processors to the

operating system (AIX 5L V5.3 and Linux)

Utilizes unused execution unit cyclesDispatch two threads per processor:

“It’s like doubling the number of processors.”

Thread1 active

SMT

Learning point: SMT = On Logical processors presentSMT = Off No logical processors

POWER6, SMT = On

~ 50

%

SMT=Off

Users

Thro

ughp

ut

POWER5, SMT = On

~ 30

%

1

22’

1

2

2’

SMT = On/Off (no effect)

SMT = Off (less throughput)

SMT = On (more throughput)




SMT = Off SMT = On

Low CPU Utilization

• SMT does not improve system throughput on a lightly loaded system

• SMT does not make a single thread run faster

SPEEDLIMIT

5.0 GHz

SMT = Off SMT = On

High CPU Utilization

• SMT does improve system throughput on a heavily loaded system

• SMT does not make a single thread run faster (unless it is waiting in the queue)

SPEEDLIMIT

5.0 GHz

Simultaneous Multi-threading (SMT) – cont.




(*) EntC : Entitled Capacity

1.0 Entitled Capacity(1개 CPU용량)

ERP 테스트 파티션

ERP 개발 파티션

0.2 Entitled Capacity

0.4Entitled Capacity

Micro Partitioning1개의 CPU용량을 time slicing 방식에 의해 최대 10개까지 쪼개어 사용함으로써, CPU 한 개 이하의 필요한 용량만큼만 할당 가능하므로 이를 통해 자원의 효율적 사용 및 비용 절감을 기대할 수 있음. 최대 254개까지의 파티션 구성이 가능함. 1개의 CPU용량은 1.0 EntC(*)로 표현하며, 마이크로 파티션은 최소 0.1 EntC부터 구성하고 0.01 EntC단위로 조정이 가능함. 또한 각 파티션은 Capped 또는 Uncapped로 설정하여 타 파티션 여유자원의 사용여부를 정의할 수 있음. 마이크로 파티션과 기존 LPAR는 혼용해서 구성이 가능함.

최소 할당 가능 CPU 단위 : 0.1CPU

CPU 개수 최소 조정 가능 단위 : 0.01 CPU

최대 파티션 가능 개수 : 254 개

최소 할당 가능 CPU 단위 : 0.1CPU

CPU 개수 최소 조정 가능 단위 : 0.01 CPU

최대 파티션 가능 개수 : 254 개

4way SMP 1대에1~40개 partition 가능


CPU 1

CPU 2 CPU 3

CPU 0



현현 재재

POWER5 SMPMicro partitioning :각각의 CPU마다 여러개의 partition을 구현

과과 거거

SMP partitioning :CPU 1개당 partition

1개




Shared Dedicated ProcessorsDedicated Sharing Disabled

Dedicated Sharing EnabledBest of both worlds:

Processor affinity with

guaranteed LPAR performance

and Best overall system performance!

Unused dedicated processor

cycles are wasted thus

reducing overall system

performance.

New in POWER6




LPAR#1

SMT=On

LPAR#2

SMT=Off

SPLPAR#3

SMT=On

SPLPAR#4

SMT=Off

SPLPAR#5

SMT=On

SPLPAR#6

SMT=On

SPLPAR#7

SMT=On

SPLPAR#8

SMT=On

Hypervisor

Pool # 0

Pool MaxPU = 3#1 ReservedPU = 0.5

Pool MaxPU = 4#2 ReservedPU = 0.6

Priority = 255PU = 1.2

V

L

V

L L L

Uncap = NoPU = 0.5

V


V

L

V

L


V

L L


V V


V

L

V

L L L

V

L L L L

L L

Core Core Core CoreCoreCoreCoreCoreCoreCore CoreCore

L L L L

1 Core (dedicated)

2 Cores(dedicated)

Multiple Shared Processor Pools

Limit processor resources to a group of SPLPARs

Up to 64 Processor Pools per server

Can help with software licensing

Help balance Prod/Dev on the same server




Virtual IO Server

VIOclnt2

(Linux)

VIOclnt1(AIX)

Logical Partitions

POWER Hypervisor

B1 B2

A1

External Storage

A1

B1 B2B3

A2 A3

B4 B5

A4A5

Dedicated I/O

VIOS

vSCSI

VIOclnt3(AIX)

A4

VIOclnt4(AIX)

B5

Physical F/C HBA

EthernetSwitch

External servers

Virtual Ethernet Switch

PhysicalEthernet

Adapter

Virtual SCSI

B4Physical

SCSI HBA

VIOS

SEA

Virtualization은 시스템 자원의 요청에 따라 자원 공유 풀에서 자원이 자동적으로 공급이 조절될 수 있도록 함으로써 사용률을 최적화하는 환경을 제공함. 시스템 Virtual 환경은 VIO server 구성을 통해서 구현 가능하며, 보통의 경우는 redundancy를 위해서 VIO server를 두 개로 운영을 함. VIO client는 VIO server에서 제공되는 가상의 device들을 사용할 수 있게 되고 VIO server와 client 간의 통신은 Hypervisor를 통해서 이뤄짐.

Redundancy를 위해 2개의 VIO server를 구성하는 경우 대개의

경우는 2개 server의 구성이 서로

동일하도록 함.

Hypervisor를 통한 VIO server와 VIO client 간의 통신이

됨.

VIO client들의 물리적 자원 공유로

인한 효율적인 자원 사용으로 자원

낭비가 적어짐.




LPAR Deployment Using Dual VIO Servers and SAN




Virtual Ethernet – (Shared Ethernet Adapter SEA)

Shared EthernetAdapter (Acts as a layer 2 bridge)

Link AggregationAdapter (Combines physical adapters)

Physical EthernetAdapter

ChannelGroup

VirtualEthernetAdapter

Interface

Path Virtual ID (PVID)IEEE 802.1Q Virtual LAN (VLAN)




HEA (Host Ethernet Adapter)

Logical L2 switch

Physical Port

Logical Ports

Partition PartitionPartition

HEA

To a LPAR, a HEA logical port appears as a generic Ethernet interface

→ With its own resources and MAC address

→ Sharing bandwidth w/ other logical ports defined on same physical port

Logical ports are allocated to partitions

→ Each Logical Port can be owned by a separate LPAR

→ A Partition can own multiple Logical Ports

→ Only one Logical Port per Physical Port per partition

One Logical Layer 2 switch per Physical port

Advantages:

No POWER Hypervisor hits

Does not require a VIO server to be running

No configuration required on any VIO servers

Removes SW packet forwarding overhead from VIO server

Provides equivalent performance as a dedicated Ethernet adapter




HEA logical port concept

Up to 32 Logical Ports per HEAOne HEA with 2 Port 10GbE can replace up to 32 1GbE dedicated adapters by sharing the 10GbE connections via LHEA Ports

X2HEA Port Group 1

Partition Partition

1G port 1G port

External Layer 2 or Layer 3 switch

Partition Partition Partition Partition

Logical L2 switch Logical L2 switch





PowerVM Live Partition MobilityContinuous Availability : Hardware 유지정비나 MES를 위해 계획되는 수많은planned outage를 줄일 수 있음.

Energy Saving : 특정 기간 동안만peak가 높은 서버들을 운영할 경우, 특정기간을 제외하고는 LPM을 이용한energy saving이 가능함.

Workload Balancing : 시스템 사용률패턴 경향에 따른 workload balancing 또한 가능함

Movement of the OS and applications to a different

server with no loss of service

Virtualized SAN and Network InfrastructureVirtualized SAN and Network Infrastructure


Live Partition Mobility는 Power6 processor가 장착된 시스템에서 운영 중인 UNIX 또는 LINUX 운영체제의 LPAR가 On-line 중에 다른 Power6 시스템에 옮겨갈 수 있도록 제공되는 기능임. End User는 전혀 서비스 중단을 느끼지 못함




• Workload Partition과 Live Application Mobility개요1. 하나의 AIXOS에서 가상화된 AIX OS들을 구성.2. Live Application Mobility는

Workload Partition을 다른 LPAR나 머신의LPAR로 이동 가능.

3. 종류는 System과 ApplicationWorkload Partition이 있음.

Workload Partition에 의한 기대 효과1. 새로운 OS환경을 빠르게 구성 가능.2. 자원 사용률의 최적화 .

(매우 작은 부하를 갖는 서버에 대한 통합화가 용이함)3. 애플리케이션들의 절연화와 제어 가능.4. Software및 OS 관리의 단순화5. 독립적인 시스템 관리로 인한 관리자 실수 최소화.6. LAM을 이용한 애플리케이션의 손쉬운 이동.

요구사항AIX6.1, 하드웨어 (p4, p5, p6) 는 무관

경쟁사 솔루션Sun -> ContainerHP-> Secure Resource Partitions

WorkloadPartition

QA

AIX # 2

WorkloadPartition

Data Mining

WorkloadPartition

App Server

WorkloadPartition

Web

AIX # 1

WorkloadPartition

Dev

Workload Partitione-mail

WorkloadPartitionsManager

for AIX

Policy

WorkloadPartitionBilling

Shared NFS Storage

-+WPAR Resource isolation – thread, process, paging

-+System & Application partition

-+Live relocation

Solaris 10AIX6.1Capability

Workload Partition




•하나의 AIX이미지에 여러 애플리케이션들을 위한 분리된 영역을 구성

분리된 시스템의 구성- 각 WPAR는 정의된 프로세서와

메모리 자원을 할당 받음.자원할당이 변경 가능함.

- 각 WPAR는 독립적인 네트워크,파일시스템, 많은 시스템 서비스를가짐.

독립적인 관리, 제어- 각 WPAR는 독립적인 관리를 할수 있으며 또한 각각 보안 권한을 가질 수 있음.

공유하는 자원- I/O Device- 프로세서- 오퍼레이팅 시스템- 공유 라이브러리와 텍스트

WPAR

Workload Partition의 개념도




Network

System/Application WPARs

NFS Server

AIX Image

WPAR Agent


WorkloadPartition1

Live Application Mobility 개념도와 동작 순서

WPAR Manager

WorkloadPartition2

AIX Image

WPAR Agent


WorkloadPartition2

WorkloadPartition1

Partition3

Partition1 Partition2

AIX Image

Management Console

11 관리콘솔에서 이동기능이 있는WPAR를 정의 및 기동.

관리콘솔에서 해당 WPAR를다른 파티션이나 박스로 이동시킴

해당 WPAR의 현재 메모리이미지를공유파일에 복사 후 WPAR정지

복사된 메모리 이미지를 다른 파티션에서로딩하여 해당 WPAR 재기동

이동이 왼료

22

33

44

55

Live Application Mobility 동작 순서

11

11

22

33 44




Virtualization Benefits

Increase Utilization→Single application servers often run at lower

average utilizations levels.

→Idle capacity cannot be used

→Virtualized servers run at high utilization levels.

Simplify Workload Sizing→Sizing new workloads is difficult

→LPARs can be resized to match needs

→Can over commit capacity

→Scale up and scale out applications on the same hardware platform

0102030405060708090

100

8:00 10:00 12:00 2:00 4:00Time

CPU

Util

izat

ion

Purchased

Peak

Average





Repurpose Assets→Scale out servers are often architected with a

specific application in mind.

→Virtualized servers can easily be changed to match a different workload

Reduce Limited Use Servers→DR and HA can often be combined with other

functions on the same server

→Resizable LPARs allow high volume testing without dedicated low use equipment

DR

Test 1

Test 2

Test 3

DR

Test 1Test 2Test 3





Rapidly Deploy Workloads→New workloads can be added quickly to a

virtual pool reducing the time to value

→LPARs can also be de-provisioned when no longer needed

Simplify Provisioning→Automated provisioning is easier with

virtualized servers

→Virtualized servers have fewer physical dependencies such as adapter slot location

LPAR #1

Capacityon

Demand

CoD CPU

CoD CPU

CoD CPU

CoD CPU

Virtualization

LPAR#2

LPAR#3

VirtualI/O

Shared Processor LPARs

NewWork

Virtualization

Apps

O/S

Apps

O/S

Apps

O/S





Reduce I/O Infrastructure→Shared I/O can reduce the time spent cabling

physical servers

→Virtualized I/O can also reduce adapter, port, and wiring costs.

Improve Networking→Low latency LPAR to LPAR communications

→Large LPAR to LPAR network bandwidth

→Improved networking security

Virtualization

LPAR#1

LPAR#3

LPAR#4 VIO VIOLPAR

#2LPAR

#5

Ethernet

...LPAR

#1LPAR

#N





Reduced Asset Management→Fewer servers to order, install, track, maintain,

and retire.

→Reduced floor and rack space

Combine Instances→Multiple instances of an application may be

combined reducing the O/S management effort

→LPARs can be combined with the original installation or at a later date.





Simplify Disaster Recovery→Virtualized images are easier to re-deploy on

different physical hardware→Non-critical VM/LPARs can be shutdown as

required→Virtual production and virtual DR servers do not

have to match exactly

. Ease Software Upgrades→New software versions can be loaded on the

same hardware

→When the new version is ready, the LPAR can take over the previous resources

→Allows rapid upgrade and/or fail back

Prod V2

Prod V1

NewProd V2

Prod V1

#1 #3 #4#2

R

SANSAN

#1 #3 #4#2

SANSAN

R

Site 1Site 2

Virtualization

Virtualization





Reduce Power and Cooling→Virtualization allows servers to run at high

utilization levels

→Servers running at higher utilization typically use power more efficiently

→Power and cooling costs are expected to become the dominating factor for a 5 year

Software Costs→Virtualized servers may lower software costs

→Running at higher utilizations can translate into fewer CPUs to license

Power Usage

0

10

20

30

40

50

60

70

80

90

100

10 20 30 40 50 60 70 80 90 100

CPU Utilization

Tota

l Wat

ts





Partition Mobility→Ability to move running LPAR from server to

server.

→Improves application availability

Future Directions→Server and network performance continues to

grow

→A dedicated model will continue to put more and more unused assets on the floor.

Rel

ativ

ePe

rfor

man

ce

1997 1998 1999 2000 2001 2004 2005 2006Year

Growth in performance

j

Virtualization

Apps

O/S

Apps

O/S

Apps

O/S

Virtualization




Virtualization feature support Matrix

Shared Processor Pool

Dynamic LPAR (PLM)

AIX v5.2

Static LPAR

Multiple virtual shared pools

Integrated Virtual Ethernet

Hardware Decimal FP

Dedicated processor sharing

Live Application Mobility

WPARs


POWER6POWER5POWER4LinuxAIX v6.1

AIX v5.3

AIX v6.1

PowerVM

Supported HardwareSupported OSLicensed Via

Feature




Agenda








Simplify IT infrastructure and administration

Reduce costs

Increase server utilization

Increase scalability of infrastructure

Enhance resilience and reliability

Improve flexibility to business goals

Improve application performance

Automate IT operations

Accelerate Application development and deployment

Single view on the IT environment

Manage a heterogeneousserver environment

48%

48%

57%

29%

25%

16%

15%

11%

11%

10%

9%

Source: IBM Systems Directions, 2006

Virtualization Brings Benefits…and New Challenges

“Virtualization without good management is more dangerous than not using virtualization in the first place,” –Gartner Source: http://www.gartner.com/it/page.jsp?id=505040

What is in my environment? What has changed?What is the utilization of my environment; how do I optimize?How do I demonstrate accountability to my application owners?




Client requirements that Service Management can address

Visibility

Respond faster and make better decisions

Delivers improved visibility into the performance and availability of services that span heterogeneous and virtual environments

Control Automation

Manage risk, compliance & shared costs

E2E Security management. Monitor shared resource usage & cost in a virtualized environment

Lower costs and build agility

Leverage automation to address operational complexity associated with managing virtual resources




Management Edition for AIX - A Brief Overview

Systems management offering that provides discovery, monitoring, performance trackingand usage accounting capabilities, providing customers with the tools to effectively and efficiently manage their enterprise IT infrastructure.

The following are the underlying products that will be included:

→ IBM Tivoli Monitoring (ITM)

→ IBM Tivoli Application Dependency Discovery Manager (TADDM) 7.1

→ IBM Usage and Accounting Manager (IUAM) Virtualization Edition 7.1

A common prerequisite for all the above products isDB2 9.1, which will also be included in the offering




IBM Tivoli Application Dependency Discovery Manager initiates and assists planning for consolidation by providing best-of-breed discovery capabilities

→ Discovers the COMPONENTS in a Data Center Environment

→ CENTRALIZES and VISUALIZES the CONFIGURATIONof the Components in a Data CenterEnvironment

→ Discovers the RELATIONSHIP ofthe Components in a Data CenterEnvironment

→ DISCOVERS AND TRACKS THECHANGES in a Data Center Environment

Discovery with IBM Tivoli Application Dependency Discovery Manager (TADDM)What are the critical components of my services?How are physical and virtual resources related?




TADDM Provides 3 Key Benefits -Enabling the IT Service Mgmt user to:

1. Understand what they have

Application Mapping with Dependencies→ Agent-less and Credential-free

→ Discover interdependencies between Applications, middleware, servers and network components)

Business Application

Infrastructure Application

Computer System

Switch





2. Learn how their CIs are configured (& changing over time)

Configuration Auditing→ Tracks changes in applications

→ Depicts that information on the map

→ Depicts that information thru reports

Automatically tracks changes on all CIs & attribute values

over time…

Application





3. Determine if their CIs are compliantCompliance→ Compare configuration to “reference master”

→ Compare to your standard policy

Comparing two instances of an Apache Web Server to the reference master

Values in red and blue are policy violations




System p Discovery - Topology View

System 1

TADDM discovery of System p Topology via Hardware Management Console (HMC)




Solving the “What Changed” MysteryAn Unauthorized Change Takes Place




Solving the “What Changed” MysteryPerformance Degradation is Observed




Solving the “What Changed” MysteryITM Monitors the Change and Provides a Direct Link to …..




Solving the “What Changed” Mystery….the Exact Configuration File Change




Monitor System Utilization with IBM Tivoli MonitoringIBM Tivoli Monitoring helps prioritize consolidation decisions by visualizing the actual virtual server utilization against historical trends. It automates a customers best practices in response to system events→ Improves mean-time-to-recovery by

visualizing the virtual world to solve“virtual performance problems”

→ Side-by-side real-time and historical dataassists in separating intermittent problemsfrom reoccurring problems from peakworkloads

→ Out-of-the-box reporting allowscustomers to quickly provide executivelevel reports and identify resourcebottlenecks




ITM for AIX/System P Architecture

AIX BaseAgent

AIX

AIX PremiumAgent

AIX

VIOS Premium or Base

Agent

VIOs

AIX PremiumAgent

AIX

System P

Server

TEPS Console Database

Console Server

TEMS Warehouse

Management Server

TEP Client

VIOSAvailability

HealthPerformance

HMC OS

HMC/IVM

TopologyAvailability

Performance

AIXAvailability

HealthPerformance

ITM Server

CEC Agent

AIX

HMC Agent

AIX




Checking for Resource Under-Utilization (AIX Premium)




WPAR Supplementary Workspace links (AIX Premium)

NOTE: Right button click on Link icon to access menu of supplemental WPAR WSs




Is the Server Over/Under Utilized? (CEC agent)




Are Storage Resources Over Utilized? (VIOS Agent)

Shows how storage devices are mapped to LPARS. Link to LPAR




LPAR Storage Details (AIX Premium)




Are Network Resources Over Utilized? (VIOS Agent)




Alert from VIOS due to Threshold Violation

Information alert because of low cpu utilization




Demonstrating Usage with IBM Usage and Accounting Manager Virtualization Edition

Apportion usage by account, department or organization→ Accountability and usage tracking ensures optimized usage by

each department

→ Easily forecast growth by department to justify year-to-year budgetchanges

Single hardware system metrics and reportsData collectors

→ AIX, Linux, and AIX Advanced Accounting –Processor, server, LPAR, I/O, and VIO

→ OS File System – allocated and usedUsability – System p tailored:

→ Administration Console→ JobRunner GUI

Reporting→ Business Intelligence Reporting Tool Reports→ Reports will be provided, with aggregation by user id within a given server→ “Pre-Defined” Accounting Schema→ Export to spreadsheet, comma delimited, and CSV

IT Expenses by AccountIT Expenses by Account




Simplify Power server mgmt with IBM Systems Director

IBM Systems Director→ Discovers server resources and relationships→ Monitors status of server components and LPARs→ Optimizes server resources → Updates software and firmware→ Integrates with enterprise service management software

IBM Systems Director Active Energy Manager→ Collects and reports energy data→ Analyzes historical energy usage → Controls energy use

PREVIEW




Simplify IT admin. and skilled personnel focus on innovation

Unifies management of all IBM servers

Consolidates virtual resource management

Deploys, administers and updates Power servers




Unify mgmt of physical and virtual server resources

IBM Systems Director Agent

Management Console(s) Web Interface

IBM System Director ServerApplication Logic

Database




Welcome

Welcome

Find a Task

Find a Resource

Navigate Resources

Automation

Availability

Capacity

Inventory

IT Infrastructure

Planning

Energy

Reporting

Release Management

Security

System Configuration

System Status and Health

Task Management

Settings

The welcome page provides a “Readiness” status for all components, links to setup tasks, and a store to download new components.

Each IBM server platform has a “home page” for management

Access Power server management tasks from a single console




Consolidates virtual resource management with a consistent interface

Integrates with PowerVM Integrated Virtualization Manager LPAR and Virtual I/O management

Integrates with Hardware Management Console LPAR management and Capacity on Demand activations

Supports PowerVM, Xen Microsoft®and VMware

Systems Director Virtualization Manager discovers, visualizes and manages virtual resources




Systems Director and PowerVM features can reduce unplanned downtime

Live Partition Mobility with POWER6Live Partition Mobility with POWER6--based serversbased servers

Migrate a running LPAR to another physical server

Movement toa different server with

no loss of service

Virtualized SAN and Network InfrastructureVirtualized SAN and Network Infrastructure

1. Monitor server health.2. If a hardware error occurs:

IBM Systems Director functions:

!!

a. Migrate the workload via the Virtualization Managerb. Alert the Power server administrator




Software and firmware updates are now possible with Systems Director

Summary page for single view Integrated actions

for download, distribute, install

and uninstall

Identify updates which are tested and should be

deployed




Administration of AIX and i operating environments is faster and easier

At-a-glance status of the operating environment

Access to all administration

commands

Common interface for IBM i and AIX




Quickly deploy and maintain services to meet business requirements

Get an inventory of systems and relationships

Provision server operating systems

Quickly find issues and drill down




Get started quickly with one-click discovery of servers and resources

Start→ Click discover

→ View results

Manage→ “Activity-based” approach

→ Focus on platform management

Learn→ Tasks

→ Transition from IBM Director 5.20




Manage your Power servers in a way that is intuitive to you

Customizable health summary→ Priority systems→ Critical monitors→ Group thumbnails

Monitoring → Monitor critical resources (AIX, i,

VIOS, LPARs, etc)→ Thresholds→ Events

Automation Plans→ Notify→ Run commands→ Trigger tasks




Get a quick view of status and drill-down with topology views

Resource Topology Map → Relationships→ Dependencies→ Physical & Virtual

Contextual Task Launch→ Launch point→ Contextual tasks→ Create virtual server→ Relocate virtual server→ Server, OS Management

Resource Health StatusResource Drill Down→ Detailed Properties→ Event logs→ Finger-tip troubleshooting




Manage energy to align IT operations with business objectives

Monitor and report energy characteristics

Control energy use on Power servers

Monitor energy usage of facilities equipment




Active Energy Manager addresses a key concern for many businesses

Active Energy Manager

Helps companies monitor, measure and control their energy usage

Provides clients with a single view of the actual power usage across multiple platforms in their infrastructure

Support across many IBM Systems including control of Power servers with EnergyScale™ technology




Manage Power at the rack and server

level

Monitor and report electrical energy and thermal characteristics

Track heat

emitted

Compare rack actual power

vs. Label Power

Trend power use over time

Compare actual vs. name plate power at

system level

View inlet and exhaust temperature

Trend temperature

over time




Control energy use on Power servers with EnergyScale™ technology

Set fixed energy usage caps that the servers will not exceed when fully configured, ORSet a lower “soft cap” for even more energy savings when the servers are not fully configured

Active Energy Manager data and energy controls are available on the console and via Command Line Interface

US Energy consumption by servers and data centers is expected to

almost double in the next 5 years.

- US Environmental Protection Agency (EPA), August 2007




Data center facility equipment and legacy systems can be managed

Active Energy Manager 4.1 collects data and alerts from facility management applications (e.g. Emerson-Liebert SiteScan)

→ Air-conditioning units

→ Uninterruptible power supplies (UPS)

→ Power distribution units (PDU)

Active Energy Manager 4.1 can display environmental data of legacy systems and other data center equipment monitored with Synapsense wireless monitors




Agenda








Case Study#1 > system p 20대 p570 2대Oracle과 EAI 업무를 서버 2대로 통합해 고가용성을 보장하고 테스트, 개발 또는 web 등의 새로운 업무를 위한 서버를 VIO 환경을 통해손쉽게 추가 가능하게 되고 자원의 활용도도 높이는 결과를 나타냄.

Redundant VIOs for VIO

clients’ high availability

OS bootOS boot

data

Storage

data

N1-ORA-Test

N1-ORA-QA

N3-Test

EAI-BrSQA

EAI-App2-QA

N1-ORA Server (Act)

N3-ORA Server(Act) N4-ORA Server (Act)

EAI-DB1 (Act)

EAI-App1 (Act)

EAI-DB2 (Passive)

EAI-App2 (Act)

HACMP

HBA cableHBA cable

SAN SwitchSAN Switch

HMC for Server #1 & 2

Redundant HMC for Server #1 & 2

VIO 2VIO 1N3-QA

EAI-DB-TestEAI-App1-Test

Private IPPrivate IP

Public IP Public IP

Dual for all Partitions

EAI-App1-QAEAI-App3-QA

NIM/CSM Server

N2-ORA Server (Act)

HACMP Cascade

N1-ORA-Test

N1-ORA-QAN3-Test

EAI-BrSQA

VIO 2VIO 1N3-QA

EAI-DB-Test

EAI-App1-Test

Dual for all Partitions

PARTITION MOBILITY

Oracle RACServer 1 (p6 570) Server 2 (p6 570)

Optional unless considering Partition Mobility

HACMP Concurrent

System p 20여대로 운영되던 복잡한 환경의 업무를 p570 2대로 단순화 함

중요 업무는 CPU 자원을 고정 할당하고, 중요하지 않거나 테스트 서버는 CPU Pool을 사용 함

새로운 업무 서비스를 위한 서버 추가는 VIO server를 통해 1~2 시간 내에 손쉽게 가능

구현 기술 내역

통합 전 시스템 20여대에서 Oracle & EAI 수행되던 업무를 가상화 기술을

이용하여 p570 2대로 통합 운영

전산실 상면공간 절약 효과

운영 비용 감소 효과

업무의 새로운 업무를 손쉽게 추가

가능한 유연한 IT Infra 환경 구축

통합 개요

통합 효과




Case Study#2 > 은행 가상화 적용사례CPU를 가상화 함으로써 기존 파티션에 할당된16개의 CPU를 7개만을 할당하였으며, OS 관리 및 설치의 용이성을 위하여 NIM 환경을추가로 구축함.

IBM 가상화 기술을 이용한 VIO 환경을 구축한 국내 은행 최초 사례임OS는 내장 디스크에 구성하지 않고 SAN boot으로 구성함SAN boot 구성으로 인해 파티션 생성 개수 제한에 거의 구속 받지 않게 됨IO가 많은 업무는 IO 성능을 고려하여 물리적인 Fiber Channel adapter를 직접 할당함


기존 시스템 자원이 파티션 6개만을구성할 수 있었으나 가상화를 통해 7개이상을 구성하고자 함

업무의 새로운 업무를 손쉽게 추가가능한 유연한

IT Infra 환경 구축

시스템 자원의 효율적인 사용으로낭비되는

자원을 줄임으로써 시스템 구축 및운영 비용 절감

가상화 배경

가상화 효과

physical Disk

Physical fcs adapter

Physical Ethernet adapter

Virtual Fcs adapter

Virtual Ethernet adapter

Virtual Disk

LPAR12way/9GB

LPAR22way/12GB

LPAR33 way/18GB

LPAR54way/22GB

LPAR62way/12GB

LPAR43way/18GB

- 물리적 device 사용 현황

VIO-1EC=0.5, VP=2/1GB

vioclnt05EC=1.0, VP=5/22GB




VIO-2EC=0.5, VP=2/1GB



가상화가상화 전전 가상화가상화 후후

10개12개PCSAdapter

4개12개EthernetAdapter

0개60개PysicalSCSI Disks

7개16개CPU

가상화

후

가상화

전

할당개수

Device




DR 시스템을 가상화 구현하여 15개 업무에 대한 테스트 환경을 구축하였으며 3-node RAC, GPFS, HACMP등을 함께 구성함

DR 용도로 도입한 시스템에 대해가상화를 구축하여 평상시에는 테스트업무를 하다가 DR 발생 시 DR용도로전환할 수 있게 하기 위함

Micro-Partition 구성

Dual VIO Server 구성

HACMP in Virtual 환경

GPFS in virtual환경

네트워크 가상화 for RAC 환경

NIM Server

가상화 배경

가상화 구현 내용

3-node RACw/ HACMP

GPFS

Case Study#3 > DR 시스템 가상화 구축




네트워크 가상화 구현 시 각 업무 별 VLAN을 따로 구성할 경우 VIOserver에서 여러 개의 SEA를 구성하여 업무 용도별로 네트워크 분리

Case Study#3 > DR 시스템 가상화 구축 - 네트워크




Production용 dual VIO server X 2, 개발용 dual VIO server X 2일부 I/O가 심한 자원은 물리적 ethernet과 물리적 HBA를 할당 (여기서는 표시 안함)VIO client partition당 VIO server에서는 vhost (가상 SCSI 서버 adapter) 1개씩 대응

stag1

EMC

CX700

SAN #1 SAN #2

VIO1fcs0 fcs1

EMC PowerPath 5.0

AIX MPIO(failover)

OS Boot Image (rootvg)

Based on VIO 1.3

EMC PowerPath 5.0

vhost0vhost0vhost0vhost0vhost4

vscsi0(vio1)

vscsi1(vio2)

stag5

AIX MPIO(failover)

vscsi0(vio1)

vscsi1(vio2)

…

VIO2fcs0 fcs1

vhost0vhost0vhost0vhost0vhost4

…power0

power5

power4

power9

power0

power5

power4

power9

hdisk0

hdisk1

hdisk0

hdisk1

… power0

power5

power4

power9

…

e2e4VIO3fcs0 fcs1

AIX MPIO(failover)

vhost0 vhost1vscsi0(vio1)

vscsi1(vio2)

e2e5

AIX MPIO(failover)

vscsi0(vio1)

vscsi1(vio2)

VIO4fcs0 fcs1

vhost0 vhost1

power0

power2

power1

power3

hdisk0

hdisk1

hdisk0

hdisk1

power0

power2

power1

power3

power0

power2

power1

power3

Case Study#4 > 보험사 가상화 적용사례 – 디스크




가상 ethernet의 이중화는 SEA Failover로 구성.평상시 VIO1 및 VIO3의 물리적 network adapter가 active (VIO2 및 VIO4는 standby)

→ VLAN 당 trunk priority는 unique해야 한다.→ VLAN ID 1의 trunk priority 1은 VIO1이, VLAN ID 2의 priority 1은 VIO3

하나의 VLAN ID에 partition당 여러 개의 VEA가 붙는 것은 상관없음.

stag1

switch #1 switch #2

VIO1

ent0 ent2

10.10.x.x

vlan id 98

OS Boot Image (rootvg)

Based on VIO 1.3

EMC PowerPath 5.0

Ent4(VEA)

Ent5(CTL)

ent2

stag5…

VIO2

ent0 ent2

e2e4VIO3

ent0 ent2

e2e5 VIO4

ent0 ent2

ent6 ent6 ent6 ent6

ent3

ent7(SEA)

Ent4(VEA)

Ent5(CTL)

ent7(SEA)

Ent4(VEA)

Ent5(CTL)

ent7(SEA)

Ent4(VEA)

Ent5(CTL)

ent7(SEA)

vlan id 99

ent2 ent3 ent2 ent2

vlan id 1 vlan id 2

192.168.x.x10.10.x.x

192.168.x.x10.10.x.x 10.10.x.x

Case Study#4 > 보험사 가상화 적용사례 – 네트워크




Case Study#5 > 해외 가상화 적용사례본 사례는 2004년에 노후 된 장비 70대 가량 서버를 p595 2대에 가상화 기술을 구현하여 서버 통합을 실시한 경우임. 78개의 partition을구성하여 운영하였고, 2008년 현재는 필요 업무 서비스 요청에 따른 서버 추가가 수시로 발생하여 동일 서버에 150개의 partition을 운영중임.

IBM 가상화 기술을 적용한 서버의 물리적 통합임

SAN boot 구성으로 인해 파티션 생성 개수 제한에 거의 구속 받지 않게 됨

단 몇 시간 내에 새로운 서버를 구축 가능하도록 구성

IO가 많은 업무는 IO 성능을 고려하여 물리적인 Fiber Channel adapter를 직접 할당함


노후 된 장비 70대 가량 서버를 p5952대로 가상화 기술을 구현하여 통합함

VIO 서버 포함 78개의 파티션을 구성함.

업무 요청에 따른 서비스 partition 생성이

자유로움

효율적인 서버 자원 사용 가능

서버 대수 감소로 상면공간 80% 이상 감소

통합 개요

통합 효과

1 x 64 way IBM System p5 595

16 dedicated partitions for DB

2 VIO servers with 12 VIO clients for App/web

servers

NIM/CSM partition

1 x 64 way IBM System p5 595

16 dedicated partitions for failover

4 VIO Servers with 28 VIO Clients for

dev/test/QA/sandbox/training

ThinkCenter

1 3 94

P72

ThinkCenter

1394

P72

ThinkCenter

1394

P72

ThinkCenter

1394

P72

Total StorageDS8300

Total StorageDS8100

EMC Symmetrix EMC Symmetrix

HMC(Redundant)

40 miles




Case Study#6 > 해외 가상화 적용사례 - HCA

HCA is the nation's leading provider of healthcare services, composed of locally managed facilities that include 168 hospitals and 113 outpatient centers in 20 states and England. At its founding in 1968, Nashville-based

HCA was one of the nation's first hospital companies. HCA employs approximately 180,000 people.

REVENUES: $26.9 billion in 2007

ASSETS: More than $24 billion in 2007

MISSION & VALUES STATEMENT: Above all else, we are committed to the care and improvement of human life. In recognition of this commitment, we strive to deliver high quality, cost effective healthcare in the communities we serve.




Refresh Aging Servers– 5 server architectures in use today, several aging

– IBM 604 (3) Refresh needed

– IBM RS64 (43) Refresh needed

– IBM POWER3 (15) Refresh needed

– IBM POWER4 (45) Refresh needed

– IBM POWER5 (77)

Increase Overall Utilization Levels Reduce Physical and Environmental Requirements

– Data Center Floor Space

– Power and Cooling

Reduce Costs– Operating (h/w and s/w annual maintenance)

– Capital (h/w acquisition costs)

Reduce Provisioning Time





Implementing

→Micropartition Pools

→VIO servers (HBA’s , boot from SAN, network)

→Virtual Ethernet

→Multiple Micropartitioning Pools

Planning to Implement

→ IBM Director

→ Virtual Partition Memory

→ Partition Mobility





감사합니다.감사합니다.Q & A

Documents

IBM system p - · PDF fileto the world of AIX. ... 기술은2000년대에갑자기만들어진기술이아니며, IBM서버의가상화기술에사용되고있는Firmware