Copyright 2012 EMC Corporation. All rights reserved

© Copyright 2012 EMC Corporation. All rights reserved. 1 FLASH 1ST THE STORAGE STRATEGY FOR THE NEXT DECADE © Copyright 2012 EMC Corporation. All ...
Author: Sarah Wilcox
3 downloads 0 Views 4MB Size
© Copyright 2012 EMC Corporation. All rights reserved.

1

FLASH 1ST THE STORAGE STRATEGY FOR THE NEXT DECADE

© Copyright 2012 EMC Corporation. All rights reserved.

2

Information Tipping Point Ahead The Future Will Be Nothing Like The Past 140,000

120,000

110X

100,000 80,000

MORE DATA EACH DECADE

60,000 40,000

Data A 10TB Data Center In 2001 Growing At 60% Y/Y Will Be A 120 Petabyte Data Center By 2021, - But IT Budgets Remain Flat

We are Here

Automation

20,000 0

Budget 2000

2003

© Copyright 2012 EMC Corporation. All rights reserved.

2006

2009

2012

2015

2018

2021

3

Most Data Will Be Stone Cold While We Increasingly Can’t Erase Data, We Can Store It Better

4,123 TB

37.5 TB

110 X

2011

2021

Hot

Warm

Cold

Evolution Of 50 TBs In 10 Years © Copyright 2012 EMC Corporation. All rights reserved.

4

Why Disk Aggregation Is Losing Steam Moore’s Law Drives The Escalating Need For IO Transactions

The Number Of Drives Needed Per Host Over Time 262,833

We are Here

?

164,682

103,184 64,652

23

36

58

93

148

237

378

603

962

9,964 15,903 1,536 2,451 3,912 6,243

25,381

40,509

2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020

© Copyright 2012 EMC Corporation. All rights reserved.

5

The CPU To HDD Performance Gap CPU Improves 100 Times Every Decade – Disk Speed Hasn’t MOORE’S LAW:

100X per DECADE

CPU Continue To Improve While Disk Drive Performance Remains Flat.

As A Result, Applications Will Suffer More And More Unless We Rapidly Move To FLASH.

FLASH

10,000 times improved

100 times improved 2000

© Copyright 2012 EMC Corporation. All rights reserved.

2010

2020

6

Anatomy Of A Enterprise FLASH Drive Designed For Reliability, Data Integrity And Performance Controller

SLC NAND FLASH SAS or SATA ports

DRAM End To End CRC

© Copyright 2012 EMC Corporation. All rights reserved.

7

Comparing Associated Costs Which Technology Is The Most Efficient? Capacity Acquisition Cost $-

$10

15K HDD

$30

Lowest Capacity Cost

FLASH FLASH $24.75

$/GB

$20

Capacity Power Cost

7200 HDD $0.46

15K HDD $1.80

Transaction Acquisition Cost $-

$5

15K HDD $/IOPS

FLASH $0.99

$10

$15

© Copyright 2012 EMC Corporation. All rights reserved.

20

30

15K HDD FLASH FLASH 25

mWatt/GB

0.0 $20

$6.00

10

7200 HDD 4

15K HDD 28

Transaction Power Cost

Lowest Transaction Cost 7200 HDD 15K HDD $15.28

0

50.0

100.0

150.0

15K HDD FLASH mWatt/IOPS

FLASH 1.0

7200 HDD 133.3

15K HDD 94.4

8

Two Major Components Of Your SLA Transaction And Capacity Support Needed By The Business?

Lowest $/IO

SLA Target Needed Transactions

SLA

$ Needed Capacity

© Copyright 2012 EMC Corporation. All rights reserved.

SSD

Lowest $/GB NL-HDD

9

FLASH Becomes More Affordable Projected To Fall Below $1/GB By 2018

40% LOWER

EACH YEAR

© Copyright 2012 EMC Corporation. All rights reserved.

Consumer Electronics Keep Driving FLASH FAB Capacity Up. As A Result, FLASH NAND Prices Will Continue To Fall

10

ROI Improvement Decade Outlook FLASH Technology Will Improve Faster Than Mechanical Drives 1000.0

100.0

FLASH STORAGE

29X

10.0

MECH. STORAGE

MORE IMPROVED

1.0

0.1

2010

2011

2012

2013

2014

2015

2016

2017

2018

2019

2020

IOPS per $

0.1

0.3

0.7

1.6

3.7

8.6

20.2

47.1

109.8

256.3

598.0

GB per $

0.7

1.1

1.9

3.1

5.1

8.6

14.3

23.8

39.7

66.2

110.3

© Copyright 2012 EMC Corporation. All rights reserved.

11

The VNX5500-F High Performance, High Availability FLASH Array

© Copyright 2012 EMC Corporation. All rights reserved.

12

The EMC VNX 5500-F Flash Array Proven High Availability And Consistent High Performance

10X

TRANSACTIONS

1/8th

THE COST

• 5 X 9’s Availability For Mission Critical Applications –

RAID Data Protection, Proactive Global Sparing, Replication, EMC Quality Enterprise Flash

• Starter Configuration At 2 Or 4TB Of Flash –

25 X 2.5‖ Drives, With 100GB Or 200GB SLC SSDs

• Advanced Data Efficiency Services –

Compression, De-dupe, And Thin Provisioning Doubles Usable Capacity

• Full Unified Protocol Support –

CIFS, NFS, PNFs, iSCSI, FCP And FCOE



From 49 TB Of Flash To 675 TB Of Tiered Storage (Flash, SAS, NL-SAS) As Data Ages

• Expandable To Tiered Storage With FAST

© Copyright 2012 EMC Corporation. All rights reserved.

13

The FLASH 1st Data Management Strategy Hot Data On Fast FLASH SSDs—Cold Data On Dense Disks ―Hot‖

Data Activity

High Activity

Highly Active Data Is Stored On FLASH SSDs For Fastest Response Time

As Data Ages, Activity Falls, Triggering Automatic Movement To High Capacity Disk Drives For Lowest Cost High Cap. HDD

FLASH SSD

Movement Trigger

―Cold‖

Low Activity

Data Age (5 years)

© Copyright 2012 EMC Corporation. All rights reserved.

14

Gaining Economic Efficiency FLASH SSDs For Active Transactions & 3TB HDD For Overflow 1.2

IOPS per $

1

FLASH SSD

0.8 0.6

FAST VP

0.4 0.2 0

15K HDD 0 0.5

1

3TB HDD

1.5

GB per $

© Copyright 2012 EMC Corporation. All rights reserved.

2

2.5

• FLASH SSDs Offers Highest Transaction Efficiency • Large Capacity HDD Offers Highest Capacity Efficiency • High RPM HDDs Are Not Capacity-Efficient Nor Are They Performance-Efficient • FAST VP Automatically And Seamlessly Optimizes Data Across All Disk Technologies

15

Today’s Compute Hierarchy Right Data. Right Place. Right Cost.

FAST Cache FAST Virtual Pools

© Copyright 2012 EMC Corporation. All rights reserved.

pS

Multi-core/Socket CPUs

nS

Ddr4 - 4.266ghz RAM

uS

200GB FLASH SSDs

mS

− pS Latency

− 7 To 200ns Latency

− 20 To 320 uS Latency

3TB HDDs

− 7 To 34 mS Latency

16

Optimizing Your VNX Deployment

Transactions

Lowest $/IOPS And Lowest $/GB

Max System IOPS

Add SSDs For More IOPS

Add HDDs For More Capacity System Scale

© Copyright 2012 EMC Corporation. All rights reserved.

17

Hybrid Systems A Little FLASH Goes A Long Way 90

SSDs

HDDs 85 70

45

180

30

50 75

VNX5100

VNX5300

VNX5500

© Copyright 2012 EMC Corporation. All rights reserved.

910

415

VNX5700

VNX7500

18

The FAST Suite Dynamically Optimizes IO For FLASH 1st At A 64K Page Size • FAST Cache

FAST Cache - FAST VP Relationship



Controller



Caches Data From The HDD Or NL-HDD Tiers In The Pool Operates At A Page Granularity Of 64K

• FAST VP FAST Cache



64K

64K

– 64K

SSD

HDD

NL-HDD FAST Virtual Pool

© Copyright 2012 EMC Corporation. All rights reserved.

1G

Dynamically Moves Data Between Tiers In The Storage Pool Operates At A Slice Granularity Of 1GB

• Deploying Both Together Ensures Maximum IO Granularity

19

IO Skew Random Slice Activity 1000

1000

800

800

600

600

400

All

400

200

80%

200

• Slice Activity 100% Randomized

© Copyright 2012 EMC Corporation. All rights reserved.

0 1 7 13 19 25 31 37 43 49 55 61 67 73 79 85 91 97

1 6 11 16 21 26 31 36 41 46 51 56 61 66 71 76 81 86 91 96 101

0

• Slice Activity Stack Ranked According To Access Frequency Of A Given Slice • 51 Slices Of 101 Has 80% Of IO 20

IO Skew Random Slice Activity Weighted By 3% Cooling Rate 1000 800 600

All

400

"80%"

200

© Copyright 2012 EMC Corporation. All rights reserved.

97

91

85

79

73

67

61

55

49

43

37

31

25

19

13

7

1

0

• Stack Ranked Slice Map Weighted By A 3% Cooling Rate • Now Only 31 Slices Of 101 Total Has 80% Of IO

21

Examples of IO Skew Driven By Data Growth And Business Models Very High Growth: 60% Skew

High Skew

Days Hot: 10 1% Of Data = 80% Of IO

Growth: 100% Days Hot: 30 4.2% Of Data = 80% Of IO

© Copyright 2012 EMC Corporation. All rights reserved.

Std. Skew

Growth: 50% Days Hot: 60 5.5% Of Data = 80% Of IO

Low Skew

Growth: 50% Days Hot: 90 8.2% Of Data = 80% Of IO

22

How Much FLASH? Used Dynamically With FAST

Size of FLASH FIFO Amount Of Data Being Created Daily

FLASH Capacity Number Of Days Of High Data Activity © Copyright 2012 EMC Corporation. All rights reserved.

• Data Follows A Predictable Decay In Activity • Older Data Is Constantly Being Replaced By New Highly Active Data • The Amount Of FLASH Required Is Determined By: – The Amount Of Data Created Each Day, And – The Period Of Time It Takes To Cool

23

Modeling ―Data Decay‖ A Simple Gb-day State Model Describes Typical Data Behavior

Hot

P = (1-C) A, And A = LOG1-C (P) Where:

Cold

State Change

Hot

P Is Probability Of Data Access C Is Daily Cooling Rate A Is Data Age In Days

Cold 1GB Data Age In Days

© Copyright 2012 EMC Corporation. All rights reserved.

24

FAST

Cache

Basic Data Decay Model • The Basic Storage Pool Distribution Model Assumes FLASH As The First Line Of Defense For 80% Of All IOs

20% FLASH Tier

• As An Additional Performance Buffer, 15K Drives Are Used For Overflow For 19% Of All IOs

• Only A 1% Chance Remains That Any IOs Will Be Serviced From Slow 2TB Drives

15K

60% 1% 7 days

52days

© Copyright 2012 EMC Corporation. All rights reserved.

250 days

25

How Long Does Data Stay Hot? Depends On Business Model, Applications And Workload Daily Cooling Rate @ 80%

30

5.2%

60

2.7%

90

1.8%

120

1.4%

Cold

Hot

Hot Days

30 days

60 days

90 days

120 days

Days Of High Data Activity

© Copyright 2012 EMC Corporation. All rights reserved.

26

FLASH Percentage A Function Of Data Growth And Service Level • Relative More FLASH Is Needed When: FLASH Portion

– Service Level (FLASH Hit Rate) Is Elected High, And – Data Growth Is High

• More Than 25% FLASH Is Highly Unlikely! Data Growth Rate

© Copyright 2012 EMC Corporation. All rights reserved.

27

Getting The Right Blend Of Flash 3 Fundamental Business Questions • How Much Data Is Under Management Today?  30 TBs • How Much Is Your Data Growing Each Year?  50% Y/Y • How Long Does Your Data Stay Hot?  60 days © Copyright 2012 EMC Corporation. All rights reserved.

28

Calculating Net New Data Net New Is A Function Of Amount Of Starting Data And Growth

50% Growth Rate 15

30

30

Start

Year 1

© Copyright 2012 EMC Corporation. All rights reserved.

• 50% Of 30TB Is 15TB • The Average Amount Of Data Generated Each Day: – 15 X 1024 GB / 365 = 42 GB per day

29

Calculating Needed FLASH FLASH Only Needs To Be Large Enough To Hold Hot Data

FLASH Portion Needed FLASH

2.5

12.5

• FLASH Capacity:

– 60 Days X 42 GB = 2,520 GB

• Flash Percentage:

30

30

Start

Year 1

© Copyright 2012 EMC Corporation. All rights reserved.

– FLASH Capacity/Total Capacity – 2,520 GB/(45 X 1024) GB X 100 = 5.4%

30

Calculating How Much FLASH FLASH Portion

FLASH % =

Yearly Growth Rate% X Number of Hot Days X 100 365 X (Yearly Growth Rate% + 100%)

FLASH portion of storage pool

FLASH Portion As A Function Of Yearly Data Growth 20% 15% 10% 5% 0%

30 days Hot 60 days Hot 90 days Hot 120 days Hot

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

1% 1% 2% 3%

1% 3% 4% 5%

2% 4% 6% 8%

2% 5% 7% 9%

3% 5% 8% 11%

3% 6% 9% 12%

3% 7% 10% 14%

4% 7% 11% 15%

4% 8% 12% 16%

4% 8% 12% 16%

© Copyright 2012 EMC Corporation. All rights reserved.

31

Using The Business Data To Configure With No Trace Data, The Model Is Used • •

60 days

Cold

Hot

SSD

© Copyright 2012 EMC Corporation. All rights reserved.

178 days

3-Tier FLASH 1st • Strategy

The SSD Tier Retains A 80% Probability Of Data Re-use An 15K HDD Tier Is Used As Overflow With A 19% Chance Of Data Re-use Finally, The NL-HDD Tier Is Used For Long Term Online Storage With A 1% Chance And Lower Of Data Re-use

15K-HDD

NL-HDD

32

Configuration Example 30TB Usable , 50% Growth, 60 Days Hot @ 80% FLASH Service

VNX5300

VNX5500

Smaller Foot Print

SSDs For FAST Cache SSDs For FAST VP 15K SAS HDDs For FAST VP NL-SAS HDDs For FAST VP Total

Large Foot Print 200 SAS 15K HDDs

$380,573

4 20 15 24 63

$182,882 Monolithic

© Copyright 2012 EMC Corporation. All rights reserved.

33

Tangible Business Benefits Dramatically Lower Cost And Higher Transaction Support Yearly Power Consumption

$ Per Usable GB With FAST

$3.97 $8.26

Without FAST

Disk Slots Needed With FAST Without FAST

63

With FAST

Without FAST

7,030 30,660

Transactions Supported 36,686

With FAST

200

© Copyright 2012 EMC Corporation. All rights reserved.

Without FAST

15,050

34

12.5X Compounded Improvement In ROI $/GB And $/IO Is Improves Simultaneously

IOPS per Budget $

ROI Improvement From FLASH 1st 0.25 0.20 0.15 0.10 0.05 0.00 0.00

0.25 GB/$ 0.20 IO/$

5X 0.1 GB/$ 0.04 IO/$ 0.05

© Copyright 2012 EMC Corporation. All rights reserved.

0.10 0.15 2.5X 0.20 GB per Budget $

0.25

0.30

35

Data Strategy Matrix

Read

Technology Differentiated Data Placement Strategy

Shared NL HDD

Dedicated PCIe FLASH

Write

Automation

© Copyright 2012 EMC Corporation. All rights reserved.

Shared 15K HDD

Shared FLASH SSD

Low Activity

High Activity 36

Virtualization Further Pressures Storage Moore’s Law And Better CPU Utilization Drives IOPS Need 32 cores 1M IOPS

NEED For SPEED

32 cores 1M IOPS

2M IOPS

200K IOPS

32 cores 1M IOPS

32 cores 1M IOPS

• Application Management - Like VMotion – Requires Shared Storage • A Performance Budget Of 1M IOPS Per Host Is Now A Reality • Shared Storage Risks Becoming Bottleneck In High Performance Virtualization Deployments

Note: 2M host pressure IOPS is based on 50% storage side IOPS per host

© Copyright 2012 EMC Corporation. All rights reserved.

37

VNX Virtualized Cloud Architecture Host-Side Read Caching Multiplies Performance Performance Scale

10X

BETTER PERFORMANCE

Capacity Scale

2M IOPS • Scale Out For ―Hot Data‖ And Read Performance With FLASH Based Host-Side Caching • Scale Up For Deep Archive Of ―Cold Data‖ • All Writes Are Protected By Synchronous Cache Mirroring To DRAM & FLASH In Central Array

Note: 2M storage IOPS is based on 90%/10% read/write mix

© Copyright 2012 EMC Corporation. All rights reserved.

38

High Performance Storage Hierarchy The Data Continuum Is FLASH Centric And Extends To The Host

PCIe FLASH

SSD FLASH

200uS

© Copyright 2012 EMC Corporation. All rights reserved.

Inactive Data

1,500uS

HDD

Working Set

50uS

• Host-Side Read FLASH Caching Shields Data From SAN And Array Latency • Array-Side FLASH Protects Data Against Host Failure • Array-Side HDDs Accumulates Inactive Data At Lowest Cost

39

The IO Spread: Access Density PCIe FLASH Offers 8,333X Better Data Access Than 15K HDD 10000

1000 100 10

2,500

1

25

0.1 0.03

0.01

NL-HDD

0.3 HDD

SSD

PCIe FLASH

Access Density: IOPS/GB

© Copyright 2012 EMC Corporation. All rights reserved.

40

Data Continuum As Data Activity Falls, Different Technologies Apply ―Hot‖

Data Activity

High Activity

VFCache SSD

FAST Cache

SSD

COST OPTIMIZED

Dynamic Storage Hierarchy Differentiated On Access Density Cost

FAST VP

15K HDD

―Cold‖

Low Activity

NL-HDD

Data Age © Copyright 2012 EMC Corporation. All rights reserved.

41

Storage Efficiencies/Flash Sessions USD

Lectures- Session Name

Day & Time

#7

VNX Storage Efficiencies – What, Why, And When

Monday 10:00am - 11:00am Tuesday 11:30am - 12:30pm

#8

VNX Virtual Provisioning - Leveraging The Best In Efficiency And Simplicity With Virtual Pool Provisioning

Tuesday 10:00am - 11:00am Wednesday 11:30am - 12:30pm

#9

VNX Compression And Deduplication - Optimizing Capacity For Your File And Block Infrastructure

Tuesday 4:15pm - 5:15pm Thursday 10:00am - 11:00am

#10

VNX FAST VP - Optimizing Performance And Utilization Of Virtual Pools

Tuesday 11:30am - 12:30pm Thursday 8:30am - 9:30am

#11

VNX FAST Cache – Super Charge Your Storage With Extended Cache

Monday 4:00pm - 5:00pm Wednesday 10:00am - 11:00am

#12

FAST Storage Design Basics For EMC VNX

Tuesday 2:45pm - 3:45pm Wednesday 4:15 - 5:15pm

#13

Leveraging SSD: Designing For FAST Cache And FAST VP On Unified Block Storage

Wednesday 11:30am - 12:30pm Thursday 11;30am - 12:30pm

#25

FLASH 1st - The Storage Strategy For The Next Decade

Monday Monday

FBU#1

Introduction To EMC Vfcache

Monday 8:30am - 9:30am Wednesday 4:15pm - 5:15pm

FBU#2

Leveraging EMC Vfcache With Enterprise Applications

Monday 4:00pm – 5:00pm Thursday 10:00am - 11:00am

BOF

Dive Into EMC VNX & FAST Suite Storage Efficiencies

Tuesday 1:30pm - 2:30pm

BOF

Flash Technology In The Storage Environment

Wednesday 1:30pm - 2:30pm

© Copyright 2012 EMC Corporation. All rights reserved.

8:30am - 9:30am 2:30pm - 3:30pm

42

Provide Feedback & Win!  125 Attendees Will Receive $100 iTunes Gift Cards. To Enter The Raffle, Simply Complete: – 5 Sessions Surveys – The Conference Survey

 Download The EMC World Conference App To Learn More: Emcworld.Com/App © Copyright 2012 EMC Corporation. All rights reserved.

43

© Copyright 2012 EMC Corporation. All rights reserved.

44

Suggest Documents