Power-Saving in Large-Scale Storage Systems with Data Migration

Koji Hasebe, Tatsuya Niwa, Akiyoshi Sugiki, and Kazuhiko KatoUniversity of Tsukuba, Japan

Background

IT systems consume 1-2% of the total energy in the world.Green IT: A New Industry Shock Wave, Gartner Symp/ITxpo, 2007

In large data centers, storage systems consume <40% of the total power. StorageIO, Greg Sculz

Power-saving in storage systems is a central issue.

Previous Studies

WorkloadLow-power mode

Peak time Off-peak time

In the literature… MAID [Colarelli-Grunwald, '02], PDC [Pinheiro-Bianchini, '04]

DIV [Pinheiro et al., '06], Pergamum [Storer et al., '08]

RIMAC [Yao-Wang, '06], eRAID [Wang-Zhu-Li, '08]

Hibernator [Zhu et al., '05], PARAID [Waddle et al. '07], etc.

Commonly-observed technique:

Previous Studies

Limitations:• Central controller to manage data accesses• Relatively small number of disks (up to several dozen)

Harnik et al. [IPDPS'09] Propose the efficient allocation of replicated data

d1 d2 d3

Previous Studies

d1 d2 d3

Previous Studies

d1 d2 d3

Low-power mode

Motivation and Objective Apply the skewing technique to large storage systems Explore an efficient technique based on the data migration,

instead of the replication approach

datadata data data data

Low-power mode

Central Idea (1)Underlying System

P1 P2 P3 P4 P5 P6 P7 P8 P9 P10 P11 P12

Block 1 Block 2 Block 3 Block 4

Parent Children

Parent Child

Assume that 3 physical nodes are required at off-peak time May increase up to four-fold

P1 P2 P3

P4 P5 P6 P7 P8 P9 P10 P11 P12

V1V2 V3 V4 V5

V7V8V9

Managed by distributed hash table (DHT)

Cf. Chord [Stoica et al. '01]

P4 P5 P6 P7 P8 P9 P10 P11 P12

Central Idea (2)Migration of Virtual Nodes

P4 P5 P6

Block 1 Block 2

Overloaded

P4 P5 P6

Block 1 Block 2

Overloaded

Divide V1 into two

P4 P5 P6

Block 1 Block 2

Overloaded

P4 P5 P6

Block 1 Block 2

Overloaded

P4 P5 P6

Block 1 Block 2

Overloaded

P4 P5 P6

Block 1 Block 2

Overloaded

V11/2V7

P2 P3 P4 P5 P6

Block 1 Block 2

V11/2V7

V92/2 V7

P1 P2 P3 P4 P5 P6 P7 P8 P9 P10 P11 P12

Parent Children

Parent Child

dd d d

Power-Saving Algorithms Short-term optimization Extension Reduction

Long-term optimization

Power-Saving Algorithm 1Short-term Optimization (Extension)

Procedure1. Each physical node checks its own workload.2. If the workload exceeds its capacity, then one of the

virtual nodes is split and migrated to its child block.

V41/2 (5)

(8)V71/2

P1 P2 P3 P4 P5 P6

Parent Child

Power-Saving Algorithm 1Short-term Optimization (Extension)

Notes: Reusing the stored data in the previous day enables the

migration by copying the difference. The mapping of virtual nodes effectively skews the workload.

V41/2 (5)

(8)V71/2

P1 P2 P3 P4 P5 P6

Parent Child

Power-Saving Algorithm 2Short-term Optimization (Reduction)

Problem

V1 V42/2

P1 P2 P3 P4 P5 P6

Parent Child

V21/2 V3

The remaining capacity of physical nodes

The workload of each virtual node = 1

(1) (1) (2)

Wrong migration

V1 V42/2

P1 P2 P3 P4 P5 P6

Parent Child

V21/2 V3

(1) (1) (2)

Wrong migration

V1 V42/2

P1 P2 P3 P4 P5 P6

Parent Child

(1) (1) (2)

(0) (0)

The solution

V1 V42/2

P1 P2 P3 P4 P5 P6

Parent Child

V21/2 V3

(1) (1) (2)

(0) (0) (0)

The solution

P1 P2 P3 P4 P5 P6

Parent Child

(1) (1) (2)

(0) (0) (0)

Procedure1. C → P: the information about the workloads for every virtual node2. P lists all possible combinations of a subset of physical nodes s.t. P can absorb

their virtual nodes

P1 {P4, P5}

P2 {P4, P5}, {P5, P6}

P3 {P4, P5}

Candidates

P1 P2 P3

V32/2 V6

(1) (∞) (∞)

P4 P5 P6

their virtual nodes

P1 {P4, P5}, {P4, P6}

P2 {P4, P5}, {P5, P6}

P3 {P4, P5}

Candidates

P1 P2 P3

(1) (∞) (∞)

P4 P5 P6

their virtual nodes

3. P → C: the result of Step 24. C calculates the intersection for all possible combinations of the results.

P1 {P4, P5}, {P4, P6}

P2 {P4, P5}, {P5, P6}

P3 {P4, P5}

Candidates {P4, P5}

P1 P2 P3

V32/2 V62/2

(1) (1) (2)

P4 P5 P6

their virtual nodes

P1 {P4, P5}, {P4, P6}

P2 {P4, P5}, {P5, P6}

P3 {P4, P5}

Candidates {P4, P5}, {P5}

V1 V42/2

P1 P2 P3

V32/2 V6

(1) (1) (2)

P4 P5 P6

their virtual nodes

P1 {P4, P5}, {P4, P6}

P2 {P4, P5}, {P5, P6}

P3 {P4, P5}

Candidates {P4, P5}, {P5}, {P4}

Solution

P1 P2 P3

V32/2 V62/2

(1) (1) (2)

P4 P5 P6

Power-Saving Algorithm 3Long-term Optimization

To maintain effective power-saving, it requires load-balancing in each block.

Example:

(4) (5)

(8)(7)

P1 P2 P3 P4 P5 P6

Parent Child

High workload

Example:

(4) (5)

(8)(7)

P1 P2 P3 P4 P5 P6

Parent Child

Low workload

Example:

(4) (5)

(8)(7)

P1 P2 P3 P4 P5 P6

Parent Child

Example:

(4) (5)

(8)(7)

P1 P2 P3 P4 P5 P6

Parent Child

Load is balanced

Purposes Evaluate the efficiency of skewing the workload. Evaluate the validity of long-term optimization.

Simulation environment

Evaluation (Simulation)

Number of physical nodes 800

Number of virtual nodes 10,000

Term of simulation 1 day

Migration condition Split：more than 90％Merge：less than 70％

Workload of all virtual nodes Initially at its lowest，increased until middle of the day．Gap was sixfold.

Virtual node groups Gap of the loads is twice.

Simulation Results (Average load)

• In the caseWithout long-term optimization:

57-69%With Long-term optimization:

67-74%

Long-term optimization algorithm improves the average load as expected.

Physical nodes run effectively, coping with the daily variation of workload.

Results

Time (hour)

Simulation Results (Active nodes)

Long-term optimization saves onAverage:

7-14%Up to:

17-39%

Optimization improves the power consumption consistently and continually.

Results

Time (hour)

Purposes Verify the efficiency of load intensive at real machine. Verify whether response time becomes below the desired time.

Response time：from sending a request until the data were loaded into memory in the server.

Experiment environment

Evaluation (Prototype implementation)

Number of physical nodes 40 •Xeon 3.60GHZ CPU x2•Memory about 2GB•HDD(SCSI) 36GB

Number of Files 60,000 x 1MB (total 60GB)

Term of experiment 1 day

Migration condition Split：over 90％，Merge：under 70％

Workload of all virtual nodes Initially at its lowest，increased until middle of the day．Gap is sixfold.

Virtual node groups Twice between two groups

Amount of each migration 10% of all the data

Response Time

• Average response time80msec

• Maximum response time534msec

Our algorithms can keep almost below desired response time.

Results

Time (hour)

Average Load

• Overall average load:67% of the capacity

Can also skew the workload effectively as the simulation.

Results

Time (hour)Load

Number of Active Physical Nodes

• Migration is done onAverage: 0.14 virtual nodesMaximum: 20 virtual nodes

Our system adjusts the number of physical nodes to the variation of

workloads and reduces power effectively

Time (hour)

Conclusions Power-saving method for large-scale distributed storage

systems. Short/Long-term optimization algorithms for reducing power

consumption.

Performance evaluation Simulation results showed that our method kept the workload

on Average: 67–74%

Prototype implementation results showed that Overall Average load was: 67% It can maintain a preferred response time

Future work Implement replication mechanism to improve reliability.

Improve the long-term optimization algorithm.

Power-Saving in Large-Scale Storage Systems with Data Migration

Documents

saving public investment

€¦ · Web viewNIKOLA TESLA (1856) ENGLAND SCALE FOR MEASURING TEMPERATURE. Alternative sources of energy – Saving energy and protecting environment ☺Discuss: What is the

NGN Migration Strategies NGN Migration Strategies

Saving Bromley Schools Money through Energy Efficiencywebfronter.com/bromley/cyp/other/Saving Bromley Schools Money... · Saving Bromley Schools Money through Energy Efficiency 5

Space Saving & Energy Saving by MENATWORK

Saving 2553

Energy Saving Energy Saving Solar - SANIHEI · energy saving energy saving solar it2 istruzioni di installazione e funzionamento 12 en installation and operation instructions 22 de

Saving Sight Worldwide

Saving and Investment

Migration au Togo Migration au Togo

GR6 - word saving days

Considerations for large scale aws migration

Life Saving Rules

Vietnamese saving

Μπορούμε: saving food -saving lives

Saving 2555

Household Energy Saving

Selfors, Suzanne - Saving Juliet

HYDRAULIC ENERGY SAVING

Saving the earth