Greenﬁ Data Center - Borderstep Institut€”Greenﬁ Data Center - ... 0 1020 3040 5060 7080 90 100 % Maximallast AC ... um Data Center EE bei IBM und den Kunden dramatisch zu

Corporate Environmental Affairs Europe

7/10/2007 © 2007 IBM Corporation

Silvio Weeren, Umweltfreundliche Produkte, Energieeffizienz und Standardisierung, CEA Europe

�Green� Data Center -Industrieaktivitäten


© 2007 IBM Corporation2 7/10/2007

Agenda

Green Grid – Best Practice

SPEC – Power Benchmarking

IEE Energie Effiziente Server

Climate Savers Computing – Effiziente Netzteile

Firmenaktivitäten – IBM Big Green / Green IT

Herausforderungen für “grünere”(?) RZ

3IBM Confidential IBM Confidential

Other44%

Planar4%

PCI3%

Memory11%

Processor30%

Standby2%

HDD6%

Lighting2%

Office Cooling1%

IT Load46%

Data Center Cooling

36%

Other12%

Cooling Plant3%

Servers50%

Network15%

Storage35%

! Storage is growing

! 40-80% of this is wasted

Aufteilung Energieverbrauch (typ. RZ)


TheGreenGrid.org – Best Practices für ein grünes RZ

! TheGreenGrid.org – seit 2Q06 – sehr breite Industriebeteiligung►Board: AMD, APC, Dell, HP, Intel, IBM, Microsoft, Rackable, Spraycool, Sun, VMWare►Plus >60 weitere Unternehmen

! Opportunity, Metric & Guideline Dokumente online! Aktive Arbeit im TC (50) in 4 Gruppen►Data collection and analysis (DC&A) – A customer facing group that will identify

problems and gaps currently in industry. (Lead by Rackable)►Technology and Strategy (T&S) – Given the problems identified by the DC&A group,

the T&S group will analyze the datacenter to look for different alternatives and new technology that will be useful to industry, all on a technical level. (Lead by Intel)

►Operational – This group will determine how to implement anything found by the T&S group. May determine standards in particular areas. (Lead by IBM)

►Metrics and Measurement (M&M) – Anything that is determined to need a specific measurement metric will be looked at by this group. (Lead by HP)


Green Grid - Metrik

! Was ist useful work??? In der Praxis viel schwierig als hier gezeigt!

Total Facility PowerPUE = DCE = 1 / PUE

IT Equipment Power

In Zukunft: DC Performance Efficiency (DCPE) = Useful Work / Total Facility Power

Power Usage Effectiveness (PUE)(1)

(1) Standard supported by Green Grid, originally published by Lawrence Berkley National Laboratory, 2003(2) Lawrence Berkley National Laboratory, 2006

Most energy efficient

Least energy efficient

1.5 3.52.0 2.5 3.0

Current (US)Objective (US)

(2)

Power Usage Effizienz (PUE)



US EPA measurement protocol (11/06)

� Savings will be lower than visualised

� http://www.energystar.gov/ia/products/downloads/Finalserverenergyprotocol-v1.pdf

Basis for SPECpower with SPECjbb like work load

� No I/O or network � extreme CPU sensitive + memory!!

� Multi-JVM mode allows �free�scalability (Sun Niagara)

� Expected ~YE 07Variation problems

� Power supplies (5%), processors (10%), RAM (100%)

� Work load distributionAll benchmarks results have to be

taken with care

US EPA & SPECpower �Benchmarking�

Sample aggressive management savings7


ClimateSaversComputing.org

! Partnership to Drive Increased Energy Efficiency/Utilization in the Use of IT Equipment►Membership Consists of:

� IT Manufacturers: Dell, Intel, IBM, HP, Lenovo, Microsoft, …� IT Users: Google, Starbucks, Yahoo, EDS, …� Power Generators: Pacific Gas & Electric, …� NGOs and Public Groups: WWF, US EPA, WRI, …

►Commitments:� IT Manufacturers: Increase Power Supply & Motherboard Efficiencies

Over Time (2007: >80% PS -> 2010: >90% PS)� IT Users: Purchase Energy Star Computers and enable Power Saving

Features� Power Generators: Offer Incentives for High Efficiency IT� NGOs: Public Support and Education of Initiative



Effizienz BladeCenter H

40

50

60

70

80

90

100

0 20 40 60 80 100

% Maximallast

AC

- D

C 1

2V E

ffiz

ienz

%

Effizienz BladeCenter H

40

50

60

70

80

90

100

0 20 40 60 80 100

% Maximallast

AC

- D

C 1

2V E

ffiz

ienz

%

Effizienz PS "low end"

40

50

60

70

80

90

100

0 10 20 30 40 50 60 70 80 90 100

% Maximallast

AC

- D

C 1

2V E

ffiz

ienz

%

Effizienz PS "low end"

40

50

60

70

80

90

100

0 10 20 30 40 50 60 70 80 90 100

% Maximallast

AC

- D

C 1

2V E

ffiz

ienz

%Effizienz von Netzteilen AC � DC 12VHoher Wirkungsgrad � geringe Abwärme

Typische Last� 40-70% normal� 20-35% redundant� �unterkonfiguriert� &

redundant (2S � 1 CPU)IBM Netzteile >80% ab 20%

� Erreicht BC / high end p / z� Ziel für alle neuen Server� Alle mit aktiver PFC

Gesamteffizienz niedriger� Ca. 70-80% (ohne UPS)� DC-DC Verluste ~10%

durch on-board Konverter



Energieeffizienz = � = KlimaschutzIBM ist weltweit erfolgreich im Klimaschutz

~5 Millionen t CO2 = ~500 Millionen $ Einsparung in 10 JahrenReduktion: 1990-2005: 40% // 2005-2012 Ziel: -12%

1990 1992 1994 1996 1998 2000 2002 20040

2

4

6

8

10

% C

O2

Red

uktio

nsra

te

IBM CO2 Reduktion IBM-WWF Reduktionsplan

IBM-WWF Klimaschutzprogramm4% Ziel für jährliche CO2 Reduktion bei IBM

durch Energiesparprojekte / erneuerbare Energie

Geheimnis:

ROI ~ 3 Jahre



IEE Projekt E-Server -> efficient-server.eu

French Environment and Energy Management Agency

Development of the market for energy efficient servers

Fokus: Kunden Projekte – Demonstration Energieeinsparungen & Beschaffungskriterien



2007 2008 2009

J F M A M J J A S O N D J F M A M J J A S O N D J F M A

WP1 Management

WP2: Market description

WP3: Criteria

WP4: Technical options

WP5: Case studies

WP 6: Market tools

WP 7: Dissemination

IEE E-server Work Packages

http://www.efficient-server.eu

General energy saving potentials and barriers for market transformation

For the assessment and comparision of servers

and measurements to improve the energy efficiency in selected server categories

for energy efficiency servers

Development of concepts and instruments to support procurement of EE-Server



Innovationen für EE Data Center

� �Project Big Green� - Initiative

� 1 Mrd $ pro Jahr Investment um Data Center EE bei IBM und den Kunden dramatisch zu steigern

� IBM erwartet die Kapazität der eignene Data Centers in 3J zu verdoppeln OHNE den Energieverbrauch zu steigern

� 5 Schritte für bessere Energie Effizienz

Diagnose, Build, Virtualize, Manage, Cool



Project Big Green Ablauf

EEI Green Plan

1. Diagnose - Evaluate existing facilities -- energy assessment

2. Build: Plan, build or update to an energy efficient data center

3. Virtualize: Virtualize IT infrastructures and special purpose processors

4. Manage: Seize control with power management software

5. Cool: Exploit liquid cooling solutions

!Data Center Energy Efficiency Assessment- GTS!Optimized airflow assessment for cabling-GTS!Data Center Infrastructure Partner Offerings -GTS!Energy Efficiency Inventory-Lab Services!Server/Storage Energy Efficiency- Lab Services! Power Configurator- STG! Power Executive- STG!DC Strategy; Relocation; Specialized Services- GTS!Scalable Modular Data Center-GTS!Energy Efficiency Project Financing-IGF!Blue Gene -GES! Virtualization technologies – including mainframe, UNIX, x86, and storage - STG! IBM BladeCenter-STG! IBM Cell Broadband Engine-STG! WebSphere DataPower SOA Appliances-SWG!Strategic Architecture, Server, Storage Services- GTS

! Power Executive software- STG!Tivoli Monitoring- SWG!Usage and Accounting Manager-SWG!Environmental compliant /secure disposal-IGF

!Data Center Stored Cooling Solution - GTS!Rear Door Heat eXchanger- STG!Acoustic Door- STG!Side Car ( future) - STG

Energy Efficiency Initiative�Build a Green Plan

Big Green Project 5 Step Plan

Data CenterServices

EnvironmentallyResponsible

IBM CoolBluePortfolio


Energy Efficiency Initiative


Wesentliche Aspekte für ein “grünes RZ”

1 Definition einer Umweltstrategie / Umweltrequirements

6 Optimieren der Kühlung und Kälteversorgung

7 Entwicklung von Umweltkriterien für Beschaffung und Lieferantenbewertung

2 Messung und Analyse der IST-Parameter

4 Abschaltung nicht benötigter Geräte

5 Einsatz von skalierbarer und energieeffizienter Hardware

3 Ausbildung von „grünen“ Mitarbeitern

8 Konsolidierung und Virtualisierung von Servern


Die “echten” Probleme - Discussion

! Transformation Marketing/Presse -> Interesse -> Praxis! Kaum Nachfrage vom öffentlichen Sektor

! Integrierte Kommunikation zwischen IT – RZ – Gebäude Management muss gelernt / gefördert werden

! Kommunikation Umweltexperten mit Server/IT/RZ Experten

! Gesamtes Thema SEHR komplex – Kunden suchen nach einfacheren Lösungen

! Prioritäten zur Lösung:►1. Auslastung optimieren mit Consolidierung / Virtualisierung►2. Intelligentes, effizientes Design (HW, DC Layout, Kühlung, ….)►3. Dynamisches Power Management►4. Effiziente Software

! Offene Themen aus den Vorträgen:►Graue Energie?►BladeCenter – Problem oder Lösung (vs. 1U)►Multi Core? Tradeoffs



HW EE � Natürliche Optimierung an beiden Enden

Mobile Geräte� Geringe Auslastung� Optimales Power Management

Blue Gene -Super Computer

� 100% Auslastung� Optimale HW Effizienz � Kein Power Management nötig

Dual Core PowerPC440 with 700MHz @ 15W Performance PC@ 150W



Green500.org SupercomputerEnergie Effizienz = Linpack Leistung / Watt

� Erster Versuch von Green500.org (Nov 2006)Offene Punkte: peak power statt real powerBasis Linpack Benchmark - nicht relevant für alle Super Computer Anwendungen

Alpha 1,25GHz1,3610,213,8840ASC Q (HP)8

NEC3,0111,935,8614Earth Simulator (NEC)7

Power3 375MHz3,582,047,30490ASC White (IBM)6

Power5 1,9GHz9,977,675,763ASC Purple (IBM)5

Itanium 1,6 GHz15,263,451,874(8)Columbia (SGI)4

XT3/Opteron32,671,33143,4810Jaguar-Cray XT3 (Cray)3

PowerPC970 2,3GHz58,231,07162,635MareNostrum(IBM)2

PowerPC440 700 MHz112,242,5280,61(+3)BlueGene/L (IBM) 1

ProcessorMflops/ Watt

Peak Power(kWatts)

Linpack Rmax (GFlops)

TOP500RankMachine (vendor)

Green500 Rank



Innovationen für Energie Effizienz

System designsLeadership computepower per kilowatt

VirtualizationStandard feature in most systems

BladeCenter®

Energy Efficiency from the ground up

Power Architecture™Processor efficiency management

X-Architecture™Processor efficiency management

! IBM Director with PowerExecutive! Power Configurator to plan your

power usage

! Leadership virtualization capabilities extend beyond simple partitioning

! Tivoli® Enterprise Management

Calibrated Vector coolingReduces wasteful air movement

IBM power suppliesMeasurement built in

Rear Door Heat ExchangerThermal management innovation



IBM PowerExecutivetm

The Knowledge to Make Better DecisionsOptimize and manage datacenter power and cooling

� Intelligence and control to manage datacenter server power utilization

� Combination of hardware, system logic and group management tools

Remove datacenter power management guess work

� Actual power draw, not conservative �label/spec power� estimates

More accurate datacenter planning helps maximize performance

� Power control capability ensure datacenter robustness within fixed power envelopeSave power with power managment

� Power capping limits the power whilelow impact on performance (1Q07)

� Dynamic Volatage & Frequency changes reduce power if performance is not needed



Managing Power with PowerExecutive

Label Power

Over Allocated

A graph of power consumed by the server over time.!Today, label power is the only option within the server -> overprovisioning

Power

(watts)

Sec Time "

# Power Exec Trending (weeks, months) "

Set Max 2

Max 2

Savings

!Set Max 2 Power Limit � Less conservative, more delay

Max 1

Savings

Set Max 1Peak work delayed

!Set Max 1 Power Limit � Very conservative, little delay

Control Power MaximumsReduce Power Margins � Maximize perf/watt

Savings allocated to next server purchased

Centralized Measurements and MonitoringChassis, Rack, Room, Building etc

!Get good power estimate from power configurator



Measurem

ents, alertsA

lloca

tions

, pol

icie

s

PowerExecutive

PowerExecutive� in the System StackFacilities Management / HVAC/Power

Services (GTS Practice, Other Providers)

Enterprise Management (Tivoli, OpenView, Unicenter)

Autonomic Managers (eWLM, WebSphere XD)

Management Module or HMCIBM Director

IBM SystemsHardware, Hypervisor, OS

Plan Manage

IBM System � Cool BlueTM

© 2003 IBM Corporation22 Template DocumentationIBM Cool Blue | © 2006 IBM Corporation IBM Internal Use

7/10/2007

System 1

APP

1

APP

2

10% busy1KW

System 2

AP

P 3

APP

4

10% busy1KW

Advanced Virtualization

APP

5

APP

6

70% busy4KW

APP

1

APP

2

AP

P 3

APP

4

Energy Management Policy ExampleServer Consolidation Conserves Energy

System 8

APP

7

APP

8

10% busy1KW

APP

7

APP

8…

Server consolidation exploiting virtualization is a very effective tool in reducing energy costs

Total Power 8KW Total Power 4KW

IBM System � Cool BlueTM

© 2003 IBM Corporation23 Template DocumentationIBM Cool Blue | © 2006 IBM Corporation IBM Internal Use

7/10/2007

Energy Management Stack

IBM Systems & Storage

Virtualization VirtualizationServers Storage

Enterprise Management (Tivoli, others)

Management Autonomics

Systems Director

EWLMPower - Performance

EWLMPower - Performance

STG

LA

B a

nd

GTS

Serv

ices

Facilities Power & Cooling Infrastructure

TPMPower - Deployment

TPMPower - Deployment

Measurem

ents, alerts

Allo

catio

ns, p

olic

ies

STGDev & Services

SWG

Partners

CCMDB IntegrationCCMDB Integration ITM / TEP SupportITM / TEP Support Facilities Integration(Maximo)

Facilities Integration(Maximo)

MMPeXPeX

Monitor / AlertMonitor / AlertDeployDeploy

OptimizeOptimizeMaintainMaintainAnalyzeAnalyze Po

wer

Po

wer

Power Executive adds power

component to Director Services



Steigender RZ IT Energieverbrauch / Fläche

Industry Updated 2/2005Published by ASHRAE



Entwicklung Server Markt WW (IDC)

$0

$20

$40

$60

$80

$100

$120

1996

1997

1998

1999

2000

2001

2002

2003

2004

2005

2006

2007

2008

2009

2010

Installed Base(M Units)

Spending(US$B)

New Server SpendingPower and Cooling

0

5

10

15

20

25

30

35

40

45

50

IDC Presentation, The Impact of Power and Cooling on Data CenterInfrastructure, Doc #201722, May 2006



Who drives Energie Efficiency? (EU)

Competitione.g. HP, Sun

EPA ConferenceCebit: T1 vs xSeries

Marketing of Eco Efficiency

CustomersProblems with

computer densitycooling & energy

costs

PoliticsClimate Protection EU EuP Directive

eco-design, energy useGreen Procurement

Energy Star

NGOs



Wie wird IT Energie Effizienz gemessen?

EE = Anwendungsleistung / Watt & Faktor für Auslastung / Nutzungsgrad� Utilisation IBM IGS: 50% < 10% & 90% < 20%

Welches System? Server – Speicher – back/front end – USV & KlimatisierungWelcher Benchmark ist der beste?

� SPECint, SPECfp, SPECweb, SPECjbb, Linpack, TPC-C/-H, SAPS, �)



Power & Cooling are Complex Issues

� There is no single fix. A holistic approach is needed! � IBM is working on this issue for it�s clients on every level

- we are delivering the most comprehensive power and cooling strategy available

Server level cooling

Moore’s Law

Rack level cooling

Low Voltage

Smarter design

Function Density

Datacenter Improvement

Airflow increases

Utilization

Current Leakage

Power Management

Power & Cooling Energy Efficiency

Initiative

Virtualization



Hot Spot Area

Air Conditioning Units

Server Racks

Data Center Hot Spots



Coolblue Solution

Rear Door Heat Exchanger

Cool Blue Solution to Hot Spots



�IBM Site and Facilities Servicesprovides the expertise to implement, integrate and automate the client combined Site and IT environmentsto help in the creation of an optimized, highly resilient and efficient business infrastructure.

Site and Facilities

"Where IT and the Building Meet"

S&F

Datacenter Design and Build Solutions! Been in business since 1986! Design and built over 30 million SF of

raised floor! Mechanical & Electrical Engineers, Space

planners and PM’s on staff► Most with over 20 years experience

! Access to product engineers! Access to research and development

IBM Site and Facilities ServicesProviding Datacenter Solutions

PlanBudget Buy Save

Kontakt: Thomas Tauer/Germany/IBM



Highlights of IBM�s Operational Leadership in Climate Protection

Present GoalFurther extend IBM�s early accomplishments by reducing CO2emissions associated with IBM�s energy use 12% from 2005 to 2012 via energy conservation, use of renewable energy, and/or funding CO2 emissions reductions with Renewable Energy Certificates or comparable instruments.

Present GoalFurther extend IBM�s early accomplishments by reducing CO2emissions associated with IBM�s energy use 12% from 2005 to 2012 via energy conservation, use of renewable energy, and/or funding CO2 emissions reductions with Renewable Energy Certificates or comparable instruments.

Early ResultsEarly Results Awards & Recognition

Early Support for Disclosure

S i n c e i n c e p t i o nS i n c e i n c e p t i o n

Charter member 2003Charter member 2003

CHARTERMEMBER

2002

CHARTERMEMBER

2002

Business EnvironmentalLeadership Council

Business EnvironmentalLeadership Council

USEPA Climate Protection Award

1998 and 2006

40% Between 1990 and 2005, IBM’s global energy conservation actions reduced or avoided CO2 emissions by an amount equal to 40% of its 1990 emissions.

Chartermember

2000

Chartermember

2000

WRI GREEN POWER MARKET DEVELOPMENT GROUP

Charter member 2000

WRI GREEN POWER MARKET DEVELOPMENT GROUP

Charter member 2000

FORTUNE 500 Top 20

2004, 2005, 2006

FORTUNE 500 Top 20

2004, 2005, 2006

Computer ProgramCharter

member 1992

Computer ProgramCharter

member 1992

1605(b) voluntary emissions reporting

S i n c e 1 9 9

1605(b) voluntary emissions reporting

S i n c e 1 9 9 5

Green Power Purchaser Award2 0 0 6

Green Power Purchaser Award2 0 0 6

20052005

‘98, ‘99, ‘01‘98, ‘99, ‘0120052005

1998Become the first semiconductor company to set a numerical target for PFC emissions reduction

600

500

400

300

200

100

02000 2001 2002 2003 2004 2005

58%

1998Became the first semiconductor company to set a numerical target for PFC emissions reduction

600

500

400

300

200

100

02000 2001 2002 2003 2004 2005

58%

The ClimateGroup

2005

The ClimateGroup

2005

The ClimateGroup

2005



Project Big Green Scope

IBM Corp.EPA�s Top Awards

Reduced CO2 by 40%

$1B per year investment

Will avoid 5 billion kilowatts

Utilities/GovernmentPG&E collaboration Mobile Measurement Technology

EEI Incentive Finder

Intelligent Oil Field

IndustryGreen Grid

EPA study of Energy Efficiency (EE)

Blade.org

Customers30 years of experience to learn

from IBM Project Financing�green-team�

5 steps process

Energy Efficiency Initiative

Data CenterServices

EnvironmentallyResponsible





IMC: Energy Efficiency - WebOptimizing IT energy page IBM.com splash page

Documents

Greenﬁ Data Center - Borderstep Institut€”Greenﬁ Data Center - ... 0 1020 3040 5060 7080 90 100 % Maximallast AC ... um Data Center EE bei IBM und den Kunden dramatisch zu