a survey on power-reduction techniques for data...

30
COPYRIGHT © 2013 ALCATEL-LUCENT. ALL RIGHTS RESERVED. Tom Bostoen December 16, 2013 A SURVEY ON POWER-REDUCTION TECHNIQUES FOR DATA-CENTER STORAGE SYSTEMS This is a placeholder image only. Please select an image to reflect the content of your PPT presentation. Visit our approved corporate photography collection on the MarCom Store at: https://all.alcatel-lucent.com/marcomstore/

Upload: others

Post on 10-Oct-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: A SURVEY ON POWER-REDUCTION TECHNIQUES FOR DATA …dimacs.rutgers.edu/Workshops/WGGreen/Slides/bostoen.pdf · 2014. 1. 17. · Power-aware cache-replacement policies trade cache hit

COPYRIGHT © 2013 ALCATEL-LUCENT. ALL RIGHTS RESERVED.

Tom Bostoen December 16, 2013

A SURVEY ON POWER-REDUCTION TECHNIQUES FOR DATA-CENTER STORAGE SYSTEMS

This is a placeholder image only. Please select

an image to reflect the content of your PPT

presentation. Visit our approved corporate

photography collection on the MarCom Store at:

https://all.alcatel-lucent.com/marcomstore/

Page 2: A SURVEY ON POWER-REDUCTION TECHNIQUES FOR DATA …dimacs.rutgers.edu/Workshops/WGGreen/Slides/bostoen.pdf · 2014. 1. 17. · Power-aware cache-replacement policies trade cache hit

2

COPYRIGHT © 2013 ALCATEL-LUCENT. ALL RIGHTS RESERVED.

• Article: Bostoen, T., Mullender, S., and

Berbers, Y. Power-reduction techniques for

data-center storage systems. ACM Comput.

Surv. 45, 3 (June 2013), 33:1–33:38

• Me: researcher at Bell Labs in Belgium

pursueing a Ph.D. in collaboration with KU

Leuven.

• Supervisors: Sape Mullender (Bell Labs) and

Yolande Berbers (KU Leuven).

• Website:

http://belllabs.be/people/tombostoen

• Contact: [email protected]

ACM COMPUTING SURVEYS ARTICLE

Page 3: A SURVEY ON POWER-REDUCTION TECHNIQUES FOR DATA …dimacs.rutgers.edu/Workshops/WGGreen/Slides/bostoen.pdf · 2014. 1. 17. · Power-aware cache-replacement policies trade cache hit

3

COPYRIGHT © 2013 ALCATEL-LUCENT. ALL RIGHTS RESERVED.

• Electricity consumption by data centers surges due to

proliferation of data-intensive network-based applications

and services

• Data storage accounts for 25% to 35% of power consumed by

data centers

• Because storage subsystem consists of hard disk drives,

which require mechanical movement for their operation

• Research on power-reduction techniques for data-center

storage systems started beginning of 2000s

• Survey on power-reduction techniques for data-center

storage systems:

­ Any storage-stack layer

­ Any workload

­ Software rather than hardware

­ Focus on power-reduction techniques but also performance-

improvement techniques that save energy

INTRODUCTION

(1) © ITP.net

(2) © Western Digital Technologies, Inc.

(1)

(2)

Page 4: A SURVEY ON POWER-REDUCTION TECHNIQUES FOR DATA …dimacs.rutgers.edu/Workshops/WGGreen/Slides/bostoen.pdf · 2014. 1. 17. · Power-aware cache-replacement policies trade cache hit

4

COPYRIGHT © 2013 ALCATEL-LUCENT. ALL RIGHTS RESERVED.

1. Introduction

2. Disk Power Consumption

3. Dynamic Power Management (DPM)

4. DPM-Enabling Workload-Shaping Techniques

5. Access-Time Reduction by Disk-Layout Reorganization

6. Storage-Space Conservation

7. Exploiting Energy-Efficient Storage Devices and Media

8. Conclusion

AGENDA

Page 5: A SURVEY ON POWER-REDUCTION TECHNIQUES FOR DATA …dimacs.rutgers.edu/Workshops/WGGreen/Slides/bostoen.pdf · 2014. 1. 17. · Power-aware cache-replacement policies trade cache hit

5

COPYRIGHT © 2013 ALCATEL-LUCENT. ALL RIGHTS RESERVED.

SURVEY ORGANIZATION

DPM-enabling techniques Other Pow

er-

aw

are

cachin

g a

nd

buff

eri

ng in m

em

ory

Dynamic Power Management

Cachin

g a

nd b

uff

eri

ng a

cro

ss

dis

ks

Work

load c

onso

lidati

on

by r

eplicati

ng d

ata

acro

ss

dis

ks

Data

mig

rati

on a

cro

ss d

isks

to c

oncentr

ate

popula

r data

Data

gro

upin

g a

cro

ss d

isks

Div

ert

ing d

isk a

ccess

es

by e

xplo

itin

g d

ata

redundancy

Access

-tim

e r

educti

on b

y d

isk layout

reorg

aniz

ati

on

Sto

rage-s

pace c

onse

rvati

on

Explo

itin

g e

nerg

y-e

ffic

ient

stora

ge

devic

es

and m

edia

Disk power consumption

Pow

er-

aw

are

cachin

g a

nd

buff

eri

ng in m

em

ory

Dynamic Power Management

Cachin

g a

nd b

uff

eri

ng

acro

ss d

isks

Work

load c

onso

lidati

on

by r

eplicati

ng d

ata

acro

ss

dis

ks

Data

mig

rati

on a

cro

ss

dis

ks

to c

oncentr

ate

popula

r data

Data

gro

upin

g a

cro

ss d

isks

Div

ert

ing d

isk a

ccess

es

by e

xplo

itin

g d

ata

redundancy

Access

-tim

e r

educti

on b

y d

isk

layout

reorg

aniz

ati

on

Sto

rage-s

pace c

onse

rvati

on

Explo

itin

g e

nerg

y-e

ffic

ient

stora

ge

devic

es

and m

edia

Disk power consumption

Page 6: A SURVEY ON POWER-REDUCTION TECHNIQUES FOR DATA …dimacs.rutgers.edu/Workshops/WGGreen/Slides/bostoen.pdf · 2014. 1. 17. · Power-aware cache-replacement policies trade cache hit

6

COPYRIGHT © 2013 ALCATEL-LUCENT. ALL RIGHTS RESERVED.

HARD DISK DRIVE

Sector

Track

Platter

Surfaces

Spindle

Read/write

head Arm

Cylinder

Rotation

Seek

Copyright © Western Digital Technologies, Inc.

Pow

er-

aw

are

cachin

g a

nd

buff

eri

ng in m

em

ory

Dynamic Power Management

Cachin

g a

nd b

uff

eri

ng

acro

ss d

isks

Work

load c

onso

lidati

on

by r

eplicati

ng d

ata

acro

ss

dis

ks

Data

mig

rati

on a

cro

ss

dis

ks

to c

oncentr

ate

popula

r data

Data

gro

upin

g a

cro

ss d

isks

Div

ert

ing d

isk a

ccess

es

by e

xplo

itin

g d

ata

redundancy

Access

-tim

e r

educti

on b

y d

isk

layout

reorg

aniz

ati

on

Sto

rage-s

pace c

onse

rvati

on

Explo

itin

g e

nerg

y-e

ffic

ient

stora

ge

devic

es

and m

edia

Disk power consumption

Page 7: A SURVEY ON POWER-REDUCTION TECHNIQUES FOR DATA …dimacs.rutgers.edu/Workshops/WGGreen/Slides/bostoen.pdf · 2014. 1. 17. · Power-aware cache-replacement policies trade cache hit

7

COPYRIGHT © 2013 ALCATEL-LUCENT. ALL RIGHTS RESERVED.

• Hard disk drive consumes power

­ To keep platters spinning:

­ To displace actuator arm:

­ For interface and control logic:

• Total disk power:

• Spin power:

• Reduction of number of platters

­ Leads to proportional reduction of

disk capacity

­ Unless compensated for by increase of

• Reduction of platter diameter

­ Leads to reduction of but increase of

DISK POWER CONSUMPTION

TOTAL DISK POWER AND SPIN POWER

ctskspdk PPPP

spP

skP

ctP

8.26.4 dNP plsp

plN

bpldNC 2

d

plN

b

d

CPsp / CPct /

b

Pow

er-

aw

are

cachin

g a

nd

buff

eri

ng in m

em

ory

Dynamic Power Management

Cachin

g a

nd b

uff

eri

ng

acro

ss d

isks

Work

load c

onso

lidati

on

by r

eplicati

ng d

ata

acro

ss

dis

ks

Data

mig

rati

on a

cro

ss

dis

ks

to c

oncentr

ate

popula

r data

Data

gro

upin

g a

cro

ss d

isks

Div

ert

ing d

isk a

ccess

es

by e

xplo

itin

g d

ata

redundancy

Access

-tim

e r

educti

on b

y d

isk

layout

reorg

aniz

ati

on

Sto

rage-s

pace c

onse

rvati

on

Explo

itin

g e

nerg

y-e

ffic

ient

stora

ge

devic

es

and m

edia

Disk power consumption

Page 8: A SURVEY ON POWER-REDUCTION TECHNIQUES FOR DATA …dimacs.rutgers.edu/Workshops/WGGreen/Slides/bostoen.pdf · 2014. 1. 17. · Power-aware cache-replacement policies trade cache hit

8

COPYRIGHT © 2013 ALCATEL-LUCENT. ALL RIGHTS RESERVED.

DISK POWER CONSUMPTION

REDUCTION OF ROTATIONAL SPEED

• Spin power:

• Reduction of rotational speed

­ Transfer rate

­ Transfer time

­ Rotational latency

­ Access time

­ Queueing time

­ Response time

­ Throughput

8.26.4 dNP plsp

plN

b

acsqrp TTT

)1/( acsq TT

tfrtskacs TTTT

d

rtT

tfT

skT

102410248

2

60 btrk

tf

rR

31060

2

1 rtT

trkr

b rqs

11000

1024

tf

rq

tfR

sT

acsrq TR /1000

Pow

er-

aw

are

cachin

g a

nd

buff

eri

ng in m

em

ory

Dynamic Power Management

Cachin

g a

nd b

uff

eri

ng

acro

ss d

isks

Work

load c

onso

lidati

on

by r

eplicati

ng d

ata

acro

ss

dis

ks

Data

mig

rati

on a

cro

ss

dis

ks

to c

oncentr

ate

popula

r data

Data

gro

upin

g a

cro

ss d

isks

Div

ert

ing d

isk a

ccess

es

by e

xplo

itin

g d

ata

redundancy

Access

-tim

e r

educti

on b

y d

isk

layout

reorg

aniz

ati

on

Sto

rage-s

pace c

onse

rvati

on

Explo

itin

g e

nerg

y-e

ffic

ient

stora

ge

devic

es

and m

edia

Disk power consumption

WHEN POWER REDUCTION TAKES PRIORITY OVER PERFORMANCE

Page 9: A SURVEY ON POWER-REDUCTION TECHNIQUES FOR DATA …dimacs.rutgers.edu/Workshops/WGGreen/Slides/bostoen.pdf · 2014. 1. 17. · Power-aware cache-replacement policies trade cache hit

9

COPYRIGHT © 2013 ALCATEL-LUCENT. ALL RIGHTS RESERVED.

DISK POWER CONSUMPTION

SEEK POWER

• Total disk power:

• Seek power:

­ No coasting for average seek

­ Assumption:

­ Acceleration/decelaration power:

• Reduction of seek acceleration

­ Leads to increase of seek time

­ Leads to decrease of same size of rotational

latency

­ Seek acceleration may be reduced until

b

ctskspdk PPPP

stdclaclsk PPPP

aaa dclacl

skdclacl adPP

skT

rtT

stsk

sk Ta

dT 2

0rtT

Pow

er-

aw

are

cachin

g a

nd

buff

eri

ng in m

em

ory

Dynamic Power Management

Cachin

g a

nd b

uff

eri

ng

acro

ss d

isks

Work

load c

onso

lidati

on

by r

eplicati

ng d

ata

acro

ss

dis

ks

Data

mig

rati

on a

cro

ss

dis

ks

to c

oncentr

ate

popula

r data

Data

gro

upin

g a

cro

ss d

isks

Div

ert

ing d

isk a

ccess

es

by e

xplo

itin

g d

ata

redundancy

Access

-tim

e r

educti

on b

y d

isk

layout

reorg

aniz

ati

on

Sto

rage-s

pace c

onse

rvati

on

Explo

itin

g e

nerg

y-e

ffic

ient

stora

ge

devic

es

and m

edia

Disk power consumption

JUST-IN-TIME SEEKING

Page 10: A SURVEY ON POWER-REDUCTION TECHNIQUES FOR DATA …dimacs.rutgers.edu/Workshops/WGGreen/Slides/bostoen.pdf · 2014. 1. 17. · Power-aware cache-replacement policies trade cache hit

10

COPYRIGHT © 2013 ALCATEL-LUCENT. ALL RIGHTS RESERVED.

• Acceleration/decelaration power:

• Reduction of average seek distance

­ By reducing platter diameter

­ By increasing areal bit density

­ By improving data placement on disk

• Total disk power:

• Control power

­ For control and interface logic

­ Even when disk is idle but higher during

data transfer

­ Data transfer power only significant

for larger I/O requests

DISK POWER CONSUMPTION

REDUCTION OF SEEK DISTANCE AND CONTROL POWER

b

skT

rtT

skdclacl adPP

skd

ctskspdk PPPP

ctP

Pow

er-

aw

are

cachin

g a

nd

buff

eri

ng in m

em

ory

Dynamic Power Management

Cachin

g a

nd b

uff

eri

ng

acro

ss d

isks

Work

load c

onso

lidati

on

by r

eplicati

ng d

ata

acro

ss

dis

ks

Data

mig

rati

on a

cro

ss

dis

ks

to c

oncentr

ate

popula

r data

Data

gro

upin

g a

cro

ss d

isks

Div

ert

ing d

isk a

ccess

es

by e

xplo

itin

g d

ata

redundancy

Access

-tim

e r

educti

on b

y d

isk

layout

reorg

aniz

ati

on

Sto

rage-s

pace c

onse

rvati

on

Explo

itin

g e

nerg

y-e

ffic

ient

stora

ge

devic

es

and m

edia

Disk power consumption

d

b

Page 11: A SURVEY ON POWER-REDUCTION TECHNIQUES FOR DATA …dimacs.rutgers.edu/Workshops/WGGreen/Slides/bostoen.pdf · 2014. 1. 17. · Power-aware cache-replacement policies trade cache hit

11

COPYRIGHT © 2013 ALCATEL-LUCENT. ALL RIGHTS RESERVED.

• Definition: technique for reducing power consumption by

turning off system components or decreasing their

performance when they are idle or underutilized

• DPM can make system energy-proportional

• Without DPM, disk is far from energy-proportional

because ~2/3 of maximum power consumed when idle

­ To keep platters spinning

­ For interface and control logic (excluding data transfer)

• DPM = Power-State Machine + Power-Control Policy

­ Idle: platters spin

­ Active: disk transfers data

­ Standby: platters at rest

DYNAMIC POWER MANAGEMENT

Idle

Active

Standby

Spin

down

Spin

up

Seek

Pow

er-

aw

are

cachin

g a

nd

buff

eri

ng in m

em

ory

Dynamic Power Management

Cachin

g a

nd b

uff

eri

ng

acro

ss d

isks

Work

load c

onso

lidati

on

by r

eplicati

ng d

ata

acro

ss

dis

ks

Data

mig

rati

on a

cro

ss

dis

ks

to c

oncentr

ate

popula

r data

Data

gro

upin

g a

cro

ss d

isks

Div

ert

ing d

isk a

ccess

es

by e

xplo

itin

g d

ata

redundancy

Access

-tim

e r

educti

on b

y d

isk

layout

reorg

aniz

ati

on

Sto

rage-s

pace c

onse

rvati

on

Explo

itin

g e

nerg

y-e

ffic

ient

stora

ge

devic

es

and m

edia

Disk power consumption

Page 12: A SURVEY ON POWER-REDUCTION TECHNIQUES FOR DATA …dimacs.rutgers.edu/Workshops/WGGreen/Slides/bostoen.pdf · 2014. 1. 17. · Power-aware cache-replacement policies trade cache hit

12

COPYRIGHT © 2013 ALCATEL-LUCENT. ALL RIGHTS RESERVED.

• Let , , and

• Assuming idle time , when to spin down disk?

• Option 1: keep disk in idle mode

• Option 2: spin disk down

• Break-even time:

• With:

DYNAMIC POWER MANAGEMENT

BREAK-EVEN TIME

Idle

Active

Standby

Spin

down

Spin

up

Seek

Pow

er-

aw

are

cachin

g a

nd

buff

eri

ng in m

em

ory

Dynamic Power Management

Cachin

g a

nd b

uff

eri

ng

acro

ss d

isks

Work

load c

onso

lidati

on

by r

eplicati

ng d

ata

acro

ss

dis

ks

Data

mig

rati

on a

cro

ss

dis

ks

to c

oncentr

ate

popula

r data

Data

gro

upin

g a

cro

ss d

isks

Div

ert

ing d

isk a

ccess

es

by e

xplo

itin

g d

ata

redundancy

Access

-tim

e r

educti

on b

y d

isk

layout

reorg

aniz

ati

on

Sto

rage-s

pace c

onse

rvati

on

Explo

itin

g e

nerg

y-e

ffic

ient

stora

ge

devic

es

and m

edia

Disk power consumption

idP

actP

skP

sbP

dn

dn

T

E

up

up

T

E

updndu EEE updndu TTT

')( duidsbidsb ETPTE

dusbdudu TPEE '

P

ETTETE dubeidsbidid

'

)()(

sbid PPP

upEdnE

sbsbTP

idididid TPTE )(

idT

dnT sbT upT

idT

Page 13: A SURVEY ON POWER-REDUCTION TECHNIQUES FOR DATA …dimacs.rutgers.edu/Workshops/WGGreen/Slides/bostoen.pdf · 2014. 1. 17. · Power-aware cache-replacement policies trade cache hit

13

COPYRIGHT © 2013 ALCATEL-LUCENT. ALL RIGHTS RESERVED.

• Threshold-based power-control policy

­ Spin down disk when idle time exceeds threshold

­ Spin up disk when new request arrives

­ = Traditional Power Management (TPM)

DYNAMIC POWER MANAGEMENT

POWER-CONTROL POLICY

Idle

Active

Standby

Spin

down

Spin

up

Seek

Pow

er-

aw

are

cachin

g a

nd

buff

eri

ng in m

em

ory

Dynamic Power Management

Cachin

g a

nd b

uff

eri

ng

acro

ss d

isks

Work

load c

onso

lidati

on

by r

eplicati

ng d

ata

acro

ss

dis

ks

Data

mig

rati

on a

cro

ss

dis

ks

to c

oncentr

ate

popula

r data

Data

gro

upin

g a

cro

ss d

isks

Div

ert

ing d

isk a

ccess

es

by e

xplo

itin

g d

ata

redundancy

Access

-tim

e r

educti

on b

y d

isk

layout

reorg

aniz

ati

on

Sto

rage-s

pace c

onse

rvati

on

Explo

itin

g e

nerg

y-e

ffic

ient

stora

ge

devic

es

and m

edia

Disk power consumption

idP

actP

skP

sbP

dn

dn

T

E

up

up

T

E

BUT IN ENTERPRISE ENVIRONMENT

•IDLE TIME TOO SHORT

•SPIN-UP DELAY IN MOST CASES UNACCEPTABLE

•DISK DUTY-CYCLE RATING LIMITED

Page 14: A SURVEY ON POWER-REDUCTION TECHNIQUES FOR DATA …dimacs.rutgers.edu/Workshops/WGGreen/Slides/bostoen.pdf · 2014. 1. 17. · Power-aware cache-replacement policies trade cache hit

14

COPYRIGHT © 2013 ALCATEL-LUCENT. ALL RIGHTS RESERVED.

DYNAMIC POWER MANAGEMENT

MULTISPEED DISK = DYNAMIC ROTATIONS PER MIN

Idle

Active

Seek

Pow

er-

aw

are

cachin

g a

nd

buff

eri

ng in m

em

ory

Dynamic Power Management

Cachin

g a

nd b

uff

eri

ng

acro

ss d

isks

Work

load c

onso

lidati

on

by r

eplicati

ng d

ata

acro

ss

dis

ks

Data

mig

rati

on a

cro

ss

dis

ks

to c

oncentr

ate

popula

r data

Data

gro

upin

g a

cro

ss d

isks

Div

ert

ing d

isk a

ccess

es

by e

xplo

itin

g d

ata

redundancy

Access

-tim

e r

educti

on b

y d

isk

layout

reorg

aniz

ati

on

Sto

rage-s

pace c

onse

rvati

on

Explo

itin

g e

nerg

y-e

ffic

ient

stora

ge

devic

es

and m

edia

Disk power consumption

RPM 3600

Idle

Active

Seek

RPM 11400

Idle

Active

Seek

RPM 12000

...

0qN 0qN 0qN

UTTrp

min

LTTrp

UTTrp

Page 15: A SURVEY ON POWER-REDUCTION TECHNIQUES FOR DATA …dimacs.rutgers.edu/Workshops/WGGreen/Slides/bostoen.pdf · 2014. 1. 17. · Power-aware cache-replacement policies trade cache hit

15

COPYRIGHT © 2013 ALCATEL-LUCENT. ALL RIGHTS RESERVED.

• In enterprise environment, idle time too short to spin down disk

• Alternative solution to multispeed disk is workload shaping to

­ Increase mean idle time

­ Increase idle time variance over time and across disks

DPM-ENABLING WORKLOAD SHAPING

OBJECTIVE

Pow

er-

aw

are

cachin

g a

nd

buff

eri

ng in m

em

ory

Dynamic Power Management

Cachin

g a

nd b

uff

eri

ng

acro

ss d

isks

Work

load c

onso

lidati

on

by r

eplicati

ng d

ata

acro

ss

dis

ks

Data

mig

rati

on a

cro

ss

dis

ks

to c

oncentr

ate

popula

r data

Data

gro

upin

g a

cro

ss d

isks

Div

ert

ing d

isk a

ccess

es

by e

xplo

itin

g d

ata

redundancy

Access

-tim

e r

educti

on b

y d

isk

layout

reorg

aniz

ati

on

Sto

rage-s

pace c

onse

rvati

on

Explo

itin

g e

nerg

y-e

ffic

ient

stora

ge

devic

es

and m

edia

Disk power consumption

Time Time

BEFORE AFTER

Page 16: A SURVEY ON POWER-REDUCTION TECHNIQUES FOR DATA …dimacs.rutgers.edu/Workshops/WGGreen/Slides/bostoen.pdf · 2014. 1. 17. · Power-aware cache-replacement policies trade cache hit

16

COPYRIGHT © 2013 ALCATEL-LUCENT. ALL RIGHTS RESERVED.

DPM-ENABLING WORKLOAD SHAPING

CLASSES OF TECHNIQUES

Pow

er-

aw

are

cachin

g a

nd

buff

eri

ng in m

em

ory

Dynamic Power Management

Cachin

g a

nd b

uff

eri

ng

acro

ss d

isks

Work

load c

onso

lidati

on

by r

eplicati

ng d

ata

acro

ss

dis

ks

Data

mig

rati

on a

cro

ss

dis

ks

to c

oncentr

ate

popula

r data

Data

gro

upin

g a

cro

ss d

isks

Div

ert

ing d

isk a

ccess

es

by e

xplo

itin

g d

ata

redundancy

Access

-tim

e r

educti

on b

y d

isk

layout

reorg

aniz

ati

on

Sto

rage-s

pace c

onse

rvati

on

Explo

itin

g e

nerg

y-e

ffic

ient

stora

ge

devic

es

and m

edia

Disk power consumption

Power-aware caching and

buffering in memory

Caching and buffering across

disks

Workload consolidation by

replicating data across disks

Popular data concentration by

migrating data across disks

Data grouping across disks

Diverting disk accesses by

exploiting data redundancy

Cache

Cache

Redun-

dant

Popular Unpopular

1/3 1/3 1/3

1

Page 17: A SURVEY ON POWER-REDUCTION TECHNIQUES FOR DATA …dimacs.rutgers.edu/Workshops/WGGreen/Slides/bostoen.pdf · 2014. 1. 17. · Power-aware cache-replacement policies trade cache hit

17

COPYRIGHT © 2013 ALCATEL-LUCENT. ALL RIGHTS RESERVED.

• Power-aware cache-replacement policies

­ Traditional cache-replacement policies minimize number of cache misses but

don't consider distribution of such misses over time or across disks

­ Power-aware cache-replacement policies trade cache hit rate for energy

savings

­ E.g. PA-LRU makes distinction between priority and regular disks

­ Priority disks: large percentage of long idle periods and high ratio of capacity misses to

cold misses

POWER-AWARE CACHING AND BUFFERING

IN MEMORY

Pow

er-

aw

are

cachin

g a

nd

buff

eri

ng in m

em

ory

Dynamic Power Management

Cachin

g a

nd b

uff

eri

ng

acro

ss d

isks

Work

load c

onso

lidati

on

by r

eplicati

ng d

ata

acro

ss

dis

ks

Data

mig

rati

on a

cro

ss

dis

ks

to c

oncentr

ate

popula

r data

Data

gro

upin

g a

cro

ss d

isks

Div

ert

ing d

isk a

ccess

es

by e

xplo

itin

g d

ata

redundancy

Access

-tim

e r

educti

on b

y d

isk

layout

reorg

aniz

ati

on

Sto

rage-s

pace c

onse

rvati

on

Explo

itin

g e

nerg

y-e

ffic

ient

stora

ge

devic

es

and m

edia

Disk power consumption

Priority Regular

Page 18: A SURVEY ON POWER-REDUCTION TECHNIQUES FOR DATA …dimacs.rutgers.edu/Workshops/WGGreen/Slides/bostoen.pdf · 2014. 1. 17. · Power-aware cache-replacement policies trade cache hit

18

COPYRIGHT © 2013 ALCATEL-LUCENT. ALL RIGHTS RESERVED.

• Massive Array of Idle Disks (MAID)

­ Replacement of tape libraries for archival storage

­ RAID's performance and dependability not required

­ Cache disks also buffer writes

CACHING AND BUFFERING ACROSS DISKS Pow

er-

aw

are

cachin

g a

nd

buff

eri

ng in m

em

ory

Dynamic Power Management

Cachin

g a

nd b

uff

eri

ng

acro

ss d

isks

Work

load c

onso

lidati

on

by r

eplicati

ng d

ata

acro

ss

dis

ks

Data

mig

rati

on a

cro

ss

dis

ks

to c

oncentr

ate

popula

r data

Data

gro

upin

g a

cro

ss d

isks

Div

ert

ing d

isk a

ccess

es

by e

xplo

itin

g d

ata

redundancy

Access

-tim

e r

educti

on b

y d

isk

layout

reorg

aniz

ati

on

Sto

rage-s

pace c

onse

rvati

on

Explo

itin

g e

nerg

y-e

ffic

ient

stora

ge

devic

es

and m

edia

Disk power consumption

Cache

DPM Always on

Page 19: A SURVEY ON POWER-REDUCTION TECHNIQUES FOR DATA …dimacs.rutgers.edu/Workshops/WGGreen/Slides/bostoen.pdf · 2014. 1. 17. · Power-aware cache-replacement policies trade cache hit

19

COPYRIGHT © 2013 ALCATEL-LUCENT. ALL RIGHTS RESERVED.

• Power-Aware RAID

­ Exploits cyclic load fluctuations and unused storage space

­ Load-directed power control

­ Data replication results in skewed striping pattern

WORKLOAD CONSOLIDATION BY REPLICATING DATA

ACROSS DISKS

Pow

er-

aw

are

cachin

g a

nd

buff

eri

ng in m

em

ory

Dynamic Power Management

Cachin

g a

nd b

uff

eri

ng

acro

ss d

isks

Work

load c

onso

lidati

on

by r

eplicati

ng d

ata

acro

ss

dis

ks

Data

mig

rati

on a

cro

ss

dis

ks

to c

oncentr

ate

popula

r data

Data

gro

upin

g a

cro

ss d

isks

Div

ert

ing d

isk a

ccess

es

by e

xplo

itin

g d

ata

redundancy

Access

-tim

e r

educti

on b

y d

isk

layout

reorg

aniz

ati

on

Sto

rage-s

pace c

onse

rvati

on

Explo

itin

g e

nerg

y-e

ffic

ient

stora

ge

devic

es

and m

edia

Disk power consumption

Replicated

data

Original

data Gear 3

Gear 2

Gear 1

Page 20: A SURVEY ON POWER-REDUCTION TECHNIQUES FOR DATA …dimacs.rutgers.edu/Workshops/WGGreen/Slides/bostoen.pdf · 2014. 1. 17. · Power-aware cache-replacement policies trade cache hit

20

COPYRIGHT © 2013 ALCATEL-LUCENT. ALL RIGHTS RESERVED.

• Popular data concentration

­ File access frequencies follow Zipf distribution:

­ Files are placed across disks according to their access frequency

­ Disks storing most popular files may not be filled to capacity to avoid disk

contention

• Combined with RAID and DRPM: Hibernator

­ Speed of disks in array periodically adapted

­ Continuous small-scale reorganization: blocks

are migrated across all disks according to their

access frequency

­ Large-scale reorganization upon disk migration:

blocks are migrated across disks of their tier to

even out average access frequency across disks

POPULAR DATA CONCENTRATION Pow

er-

aw

are

cachin

g a

nd

buff

eri

ng in m

em

ory

Dynamic Power Management

Cachin

g a

nd b

uff

eri

ng

acro

ss d

isks

Work

load c

onso

lidati

on

by r

eplicati

ng d

ata

acro

ss

dis

ks

Data

mig

rati

on a

cro

ss

dis

ks

to c

oncentr

ate

popula

r data

Data

gro

upin

g a

cro

ss d

isks

Div

ert

ing d

isk a

ccess

es

by e

xplo

itin

g d

ata

redundancy

Access

-tim

e r

educti

on b

y d

isk

layout

reorg

aniz

ati

on

Sto

rage-s

pace c

onse

rvati

on

Explo

itin

g e

nerg

y-e

ffic

ient

stora

ge

devic

es

and m

edia

Disk power consumption

Popularity RAID

ii rp /1

Page 21: A SURVEY ON POWER-REDUCTION TECHNIQUES FOR DATA …dimacs.rutgers.edu/Workshops/WGGreen/Slides/bostoen.pdf · 2014. 1. 17. · Power-aware cache-replacement policies trade cache hit

21

COPYRIGHT © 2013 ALCATEL-LUCENT. ALL RIGHTS RESERVED.

• Semantic data placement

­ Archival-by-accident workload: write-once/read-maybe except for changing

hot area that exhibits large number of reads and overwrites

­ Similar data are temporally related

­ Data are grouped across disks according to semantic and incidental labels

­ E.g. time stamp, file-system placement, author, file type,...

DATA GROUPING ACROSS DISKS Pow

er-

aw

are

cachin

g a

nd

buff

eri

ng in m

em

ory

Dynamic Power Management

Cachin

g a

nd b

uff

eri

ng

acro

ss d

isks

Work

load c

onso

lidati

on

by r

eplicati

ng d

ata

acro

ss

dis

ks

Data

mig

rati

on a

cro

ss

dis

ks

to c

oncentr

ate

popula

r data

Data

gro

upin

g a

cro

ss d

isks

Div

ert

ing d

isk a

ccess

es

by e

xplo

itin

g d

ata

redundancy

Access

-tim

e r

educti

on b

y d

isk

layout

reorg

aniz

ati

on

Sto

rage-s

pace c

onse

rvati

on

Explo

itin

g e

nerg

y-e

ffic

ient

stora

ge

devic

es

and m

edia

Disk power consumption

Page 22: A SURVEY ON POWER-REDUCTION TECHNIQUES FOR DATA …dimacs.rutgers.edu/Workshops/WGGreen/Slides/bostoen.pdf · 2014. 1. 17. · Power-aware cache-replacement policies trade cache hit

22

COPYRIGHT © 2013 ALCATEL-LUCENT. ALL RIGHTS RESERVED.

• Diverted accesses (DIV): separate redundant from original data and turn

off disks storing redundant data when load conditions allow

• Application of DIV to RAID: EERAID

­ RAID-1: windows round-robin policy for dispatching reads and power and

redundancy-aware flush policy for buffering writes

­ RAID-5: transformable read policy for dispatching reads and power and

redundancy-aware destage policy for buffering writes

DIVERTING DISK ACCESSES BY EXPLOITING

DATA REDUNDANCY

Pow

er-

aw

are

cachin

g a

nd

buff

eri

ng in m

em

ory

Dynamic Power Management

Cachin

g a

nd b

uff

eri

ng

acro

ss d

isks

Work

load c

onso

lidati

on

by r

eplicati

ng d

ata

acro

ss

dis

ks

Data

mig

rati

on a

cro

ss

dis

ks

to c

oncentr

ate

popula

r data

Data

gro

upin

g a

cro

ss d

isks

Div

ert

ing d

isk a

ccess

es

by e

xplo

itin

g d

ata

redundancy

Access

-tim

e r

educti

on b

y d

isk

layout

reorg

aniz

ati

on

Sto

rage-s

pace c

onse

rvati

on

Explo

itin

g e

nerg

y-e

ffic

ient

stora

ge

devic

es

and m

edia

Disk power consumption

a1 b1 c1 d1 a1 b1 c1 d1

a2 b2 c2 d2 a2 b2 c2 d2

Primary replica Mirror replica

Page 23: A SURVEY ON POWER-REDUCTION TECHNIQUES FOR DATA …dimacs.rutgers.edu/Workshops/WGGreen/Slides/bostoen.pdf · 2014. 1. 17. · Power-aware cache-replacement policies trade cache hit

23

COPYRIGHT © 2013 ALCATEL-LUCENT. ALL RIGHTS RESERVED.

• Saving energy while disk is active

• Reduction of average seek distance and rotational latency by improved

I/O scheduling or reorganization of the disk layout

ACCESS-TIME REDUCTION BY DISK-LAYOUT

REORGANIZATION

Pow

er-

aw

are

cachin

g a

nd

buff

eri

ng in m

em

ory

Dynamic Power Management

Cachin

g a

nd b

uff

eri

ng

acro

ss d

isks

Work

load c

onso

lidati

on

by r

eplicati

ng d

ata

acro

ss

dis

ks

Data

mig

rati

on a

cro

ss

dis

ks

to c

oncentr

ate

popula

r data

Data

gro

upin

g a

cro

ss d

isks

Div

ert

ing d

isk a

ccess

es

by e

xplo

itin

g d

ata

redundancy

Access

-tim

e r

educti

on b

y d

isk

layout

reorg

aniz

ati

on

Sto

rage-s

pace c

onse

rvati

on

Explo

itin

g e

nerg

y-e

ffic

ient

stora

ge

devic

es

and m

edia

Disk power consumption

Organ-pipe placement

Frequently-accessed data

in faster zones Free-space file system Predictive data grouping

c

Replica

Original

Hot Hot

Hot

Cold Cold

Cold

Popular data concentration by

migrating data across disk tracks

Caching across

disk tracks

Grouping across

disk tracks

Group 2

Group 1

Group 3

Page 24: A SURVEY ON POWER-REDUCTION TECHNIQUES FOR DATA …dimacs.rutgers.edu/Workshops/WGGreen/Slides/bostoen.pdf · 2014. 1. 17. · Power-aware cache-replacement policies trade cache hit

24

COPYRIGHT © 2013 ALCATEL-LUCENT. ALL RIGHTS RESERVED.

• By eliminating unnecessary redundancy, data can be stored on fewer

disks and reading and writing data requires less time

• Space-conservation techniques that save energy on the side

• Redundancy elimination as opposed to exploitation in diverted accesses

• Opposite of replication-based energy-saving techniques

• Mainly for archival storage because size-intensive data rather than load-

intensive

• Data compression and data deduplication

STORAGE-SPACE CONSERVATION Pow

er-

aw

are

cachin

g a

nd

buff

eri

ng in m

em

ory

Dynamic Power Management

Cachin

g a

nd b

uff

eri

ng

acro

ss d

isks

Work

load c

onso

lidati

on

by r

eplicati

ng d

ata

acro

ss

dis

ks

Data

mig

rati

on a

cro

ss

dis

ks

to c

oncentr

ate

popula

r data

Data

gro

upin

g a

cro

ss d

isks

Div

ert

ing d

isk a

ccess

es

by e

xplo

itin

g d

ata

redundancy

Access

-tim

e r

educti

on b

y d

isk

layout

reorg

aniz

ati

on

Sto

rage-s

pace c

onse

rvati

on

Explo

itin

g e

nerg

y-e

ffic

ient

stora

ge

devic

es

and m

edia

Disk power consumption

Page 25: A SURVEY ON POWER-REDUCTION TECHNIQUES FOR DATA …dimacs.rutgers.edu/Workshops/WGGreen/Slides/bostoen.pdf · 2014. 1. 17. · Power-aware cache-replacement policies trade cache hit

25

COPYRIGHT © 2013 ALCATEL-LUCENT. ALL RIGHTS RESERVED.

EXPLOITING ENERGY-EFFICIENT STORAGE

DEVICES AND MEDIA

Pow

er-

aw

are

cachin

g a

nd

buff

eri

ng in m

em

ory

Dynamic Power Management

Cachin

g a

nd b

uff

eri

ng

acro

ss d

isks

Work

load c

onso

lidati

on

by r

eplicati

ng d

ata

acro

ss

dis

ks

Data

mig

rati

on a

cro

ss

dis

ks

to c

oncentr

ate

popula

r data

Data

gro

upin

g a

cro

ss d

isks

Div

ert

ing d

isk a

ccess

es

by e

xplo

itin

g d

ata

redundancy

Access

-tim

e r

educti

on b

y d

isk

layout

reorg

aniz

ati

on

Sto

rage-s

pace c

onse

rvati

on

Explo

itin

g e

nerg

y-e

ffic

ient

stora

ge

devic

es

and m

edia

Disk power consumption

Hybrid

disk

Multi-

actuator

disk

Solid-

state

disk

DRAM

Controller

DRAM

Controller

Flash

DRAM

Controller

Mult

iple

xer

Fla

sh

Fla

sh

Fla

sh

Fla

sh

• Multiactuator disk

­ Number of disks determined by

requirements of performance rather than

capacity

­ Avoid disk-space waste by improving

performance by intradisk parallellism:

DkAlSmHn

• Hybrid disk

­ Flash serves as second-level cache

­ Similar as caching and buffering in

memory but using low-power, non-volatile

flash memory

• Solid-state disk

­ No spin or seek power

­ Higher throughput per Watt than HDD but

similar or less capacity per Watt than HDD

Page 26: A SURVEY ON POWER-REDUCTION TECHNIQUES FOR DATA …dimacs.rutgers.edu/Workshops/WGGreen/Slides/bostoen.pdf · 2014. 1. 17. · Power-aware cache-replacement policies trade cache hit

26

COPYRIGHT © 2013 ALCATEL-LUCENT. ALL RIGHTS RESERVED.

CLASSICATION OF POWER-REDUCTION TECHNIQUES

ACCORDING TO PERFORMANCE IMPACT

Disk spin-up required to serve I/O request if

disk is spun down

Fewer disk spin-ups required to serve I/O

requests than for plain TPM

Disk spin-ups only for increasing bandwidth

to accomodate higher load

Only disk speed-ups for increasing bandwidth but

requests served at lower speed under lighter load

Computational overhead

Reduced seek and rotational latency

Substitution of disk access by DRAM or SSD

access

Traditional power

management

Write off-loading

Power-aware RAID

Dynamic rotations per

minute

Data compression

Free-space file system

Solid-state disk

Cause Impact Example

Increased mean

response time

Page 27: A SURVEY ON POWER-REDUCTION TECHNIQUES FOR DATA …dimacs.rutgers.edu/Workshops/WGGreen/Slides/bostoen.pdf · 2014. 1. 17. · Power-aware cache-replacement policies trade cache hit

27

COPYRIGHT © 2013 ALCATEL-LUCENT. ALL RIGHTS RESERVED.

CLASSICATION OF POWER-REDUCTION TECHNIQUES

ACCORDING TO DEPENDABILITY IMPACT

Disk spin-up required to serve I/O request if

disk is spun down

Fewer disk spin-ups required to serve I/O

requests than for plain TPM

Disk spin-ups or speed-ups only for increasing

bandwidth to accomodate higher load

Volatile memory used for buffering

Number of erase cycles of NAND flash memory

may exceed erase cycle rating for write-

intensive workload

No impact

Traditional power

management

Cause Impact Example

Limited reduction of

disk/data reliability

Write off-loading

Power-aware RAID

Power-aware

buffering

Solid-state disk

Free-space file system

Page 28: A SURVEY ON POWER-REDUCTION TECHNIQUES FOR DATA …dimacs.rutgers.edu/Workshops/WGGreen/Slides/bostoen.pdf · 2014. 1. 17. · Power-aware cache-replacement policies trade cache hit

28

COPYRIGHT © 2013 ALCATEL-LUCENT. ALL RIGHTS RESERVED.

CLASSICATION OF POWER-REDUCTION TECHNIQUES

ACCORDING TO CAPACITY IMPACT

Decreased capacity utilization to avoid disk

contention

Redundancy addition (more than working

set)

Working-set replication

No impact

Redundancy elimination

Increased capacity utilization

Popular data

concentration

Cause Impact Example

Power-aware RAID

Massive array of idle

disks

Diverted accesses

Data deduplication

Multiactuator disk

No impact

More space required

Page 29: A SURVEY ON POWER-REDUCTION TECHNIQUES FOR DATA …dimacs.rutgers.edu/Workshops/WGGreen/Slides/bostoen.pdf · 2014. 1. 17. · Power-aware cache-replacement policies trade cache hit

29

COPYRIGHT © 2013 ALCATEL-LUCENT. ALL RIGHTS RESERVED.

• Integrates different classes of power-reduction

techniques

­ Dynamic power management

­ DPM-enabling workload shaping

­ Access-time reduction by disk lay-out reorganization

­ Storage-space conservation

­ Energy-efficient storage devices and media

• Covering all of the storage-stack layers

• Addressing diverse workloads

• Offering flexible trade-off between power

consumption, performance, capacity, and

dependability

ULTIMATE POWER-AWARE ENTERPRISE

STORAGE SYSTEM

(1) © ITP.net

(2) © Western Digital Technologies, Inc.

(1)

(2)

Page 30: A SURVEY ON POWER-REDUCTION TECHNIQUES FOR DATA …dimacs.rutgers.edu/Workshops/WGGreen/Slides/bostoen.pdf · 2014. 1. 17. · Power-aware cache-replacement policies trade cache hit