25
Simon Robinson Research Vice President, Storage [email protected] @simonrob451 1 Paul Turner Chief MarkeAng Officer, Cloudian [email protected] hEp://www.cloudian.com SimplificaAon of Storage – The Hot and Cold of It May 22, 2014 (9am Pacific; Noon Eastern)

Simplification of storage - The Hot and the Cold of It

Embed Size (px)

DESCRIPTION

Enterprises face many challenges when it comes to storage. Data volumes are exploding, increasing the cost of storage and the headaches of storage management. The rise of Big Data means more data is being collected and mined than ever before – 90% of the world’s data has been created in the last two years. Enterprise data is expanding at 20% per year or more. It’s not surprising that IT leaders are looking for new storage architectures to help them solve their scalability problems and reduce their costs.

Citation preview

Page 1: Simplification of storage - The Hot and the Cold of It

Simon  Robinson  Research  Vice  President,  Storage  [email protected]  @simonrob451    

1  

Paul  Turner  Chief  MarkeAng  Officer,  Cloudian  [email protected]  hEp://www.cloudian.com      

SimplificaAon  of  Storage  –  The  Hot  and  Cold  of  It    May  22,  2014    (9am  Pacific;  Noon  Eastern)  

Page 2: Simplification of storage - The Hot and the Cold of It

Agenda  

2  

q  Introductions

q  The changing IT Landscape

q  The biggest disruption ever is happening in Storage

q  Storage simplified – Hot Flash and Cold Capacity Storage

q  New architectures for Capacity Storage

q  Ecosystem Applications adopt Capacity Storage – OpenStack,

CloudStack, Amazon AWS, Hadoop

Page 3: Simplification of storage - The Hot and the Cold of It

Our  Speakers  

3  

Paul Turner leads marketing, product planning and strategy at Cloudian. A storage industry expert, he joined Cloudian from NetApp where he ran the Product Strategy Office , guiding their investments into FlashRay,Iongrid and CacheIQ. Prior to that role, he was the General Manager of the OnCommand Insight Business (which included Onaro and Akorri). Paul has more than 23 years of development and management leadership, including 15 years at Oracle.

Simon Robinson runs the Storage and Information Management practice at 451 Research. He manages a team of analysts that help 451 clients understand the impact of information growth and management on organizations. Based in London, Simon joined 451 Research in 2000, and helped develop the firm's storage industry practice. Prior to joining 451 Research, Simon was a senior reporter and editor at UK tech publications house VNU, and also worked on the City Desk at the UK's Press Association.

Page 4: Simplification of storage - The Hot and the Cold of It

The  451  Group  Company  Overview    

§  270+  Staff  §  One  company  with  3  Go  to  Market  Brands  

§  Syndicated  research,  cerAficaAon,  accreditaAon,  and  advisory  services  

§  Global  Events  

§  1,500+  client  organizaAons:  enterprises,  vendors,  service  providers,  and  investment  firms  

§  Organic  and  growth  through  acquisiAon  

4  

Page 5: Simplification of storage - The Hot and the Cold of It

About Cloudian •  Hybrid cloud storage startup in Silicon Valley

–  Strong venture backing: Goldman Sachs, Intel Capital –  Solid management team with storage, big data, enterprise software and

telco expertise –  50 employees, offices in Foster City, Japan and China

•  Production hardened product •  Target market: mid- to large-enterprises & regional service providers •  GTM: traditional storage distribution/VARs

5 5/22/14

CLOUDIAN PARTNERS

Page 6: Simplification of storage - The Hot and the Cold of It

6  

We  are  living  through  an  era  of  disrupAon…  

1.  Enormous  pressure  to  do  ‘more  with  less’  2.  Movement  to  IT-­‐as-­‐a-­‐Service  3.  Major  shigs  in  end-­‐user  compuAng  4.  Secular  changes  in  IT  supplier  market  

Page 7: Simplification of storage - The Hot and the Cold of It

Meanwhile:  in  the  storage  trench…  99  Problems  

7  

“  We  have  ever-­‐increasing  demand  without  an  ever-­‐increasing  budget.”  

“  The  part  that  pains  me  the  most  is  storage  migraAons.    It  takes  outages  to  move  data.”  

“We’re  constantly  fighAng  to  size  storage  appropriately  for  the  term,    the  life,  we  lease…  not  having  to  purchase  more  storage  or    make  huge  changes  halfway  through  the  lease.”  

“  Data  sprawl  –  it’s  growing  and  growing.  We've  been  handing    out  terabytes  like  candy.”  

“  TroubleshooAng  –  every  Ame  an  app  has  a  performance  issue,    the  ‘SAN’  is  blamed.”  

“  Backup  is  a  perennial  problem.  Never  enough  Ame.”  

“  We  do  a  terrible  job  of  archiving  data  –  we  keep  everything.”  

“  Performance  is  a  whack-­‐a-­‐mole  problem  –  we  have  to  choose    where  the  boEleneck  is.”  

“Managing  the  various  storage  ‘islands’  is  a  challenge.”  

“We  are  always  just  trying  to  keep  what  we  have  up  and  running.”  

Page 8: Simplification of storage - The Hot and the Cold of It

Poll  QuesAon  

8  

Page 9: Simplification of storage - The Hot and the Cold of It

 Dealing  with  data  growth  sAll  the  #1  pain  point  in  storage  

What  are  your  top  storage-­‐related  pain  points?*  

1H  ’12,  n=249;  1H  ’13,  n=260.  *Note  that  due  to  mul;ple  responses  per  interview,  totals  may  exceed  100%.  Source:  Storage  –  Wave  17  

6%  

6%  

11%  

11%  

14%  

15%  

19%  

20%  

21%  

45%  

3%  

6%  

8%  

8%  

16%  

12%  

26%  

13%  

27%  

56%  

Lack  of  Skilled  Staff  

SupporAng  Server  VirtualizaAon  

Data  Hoarding  

Storage  Provisioning  and  Management  

Backup  Management  

MigraAons  and  Technology  Refreshes  

Storage  ForecasAng  and  ReporAng  

Delivering  Storage  Performance  

High  Cost  of  Storage  

Rapid  Capacity  Growth  

1H  '12  

1H  '13  

Page 10: Simplification of storage - The Hot and the Cold of It

Not  only  more  data,  but…    

…more  devices,  and  ‘things’  

…more  unstructured  data  

…more  data  copies  

…in  more  places  

…more  lawsuits  and  regulaAon  

…and  keep  everything  forever!  

 

 

Page 11: Simplification of storage - The Hot and the Cold of It

Storage  Infrastructure  reaches  breaking  point  

§  EssenAally  unchanged  over  the  last  15  years  §  An  ‘Accidental  Architecture’  has  emerged;  fragmented,  complex  §  Cost  of  management  is  spiraling  out  of  control  §  Dealing  with  data  growth  is  a  constant  number  1  pain  point  §  VirtualizaAon  ‘breaks’  tradiAonal  storage  §  New  breed  of  cloud/mobile  apps  placing  fresh  demands    on  storage  

§  Budgets  flat  to  down  (do  more  with  less)    

11  

TIME  FOR  A  DIFFERENT  APPROACH!  

Page 12: Simplification of storage - The Hot and the Cold of It

Emergence  of  a  two-­‐Aer  enterprise  storage  architecture  

12  

Bigger  §  For  cool/cold  data  §  Object-­‐based  §  Scale-­‐out  (mulA-­‐PB)  §  Sogware-­‐centric  §  Cloud-­‐compaAble  

Faster  §  For  ‘hot’  data  §  Flash-­‐opAmized    §  IOPS-­‐centric  §  VM/VDI  opAmized  §  Variety  of  approaches  

Page 13: Simplification of storage - The Hot and the Cold of It

Impact  on  Storage  –  so  how  is  it  changing?  

Flash  will  be  everywhere:  §  Host-­‐based  §  As  a  Aer  in  hybrid  arrays  §  All-­‐Flash  Arrays    

13  

Flash  –  Saviour  of  the  (storage)  Universe!  But  this  is  just  star@ng  point:  §  Emergence  of  new  ‘ground  up’  architectures  that  aim  to  enable  scale,  reduce  complexity,  increase  efficiency  etc.  

§  The  era  of  VM-­‐centric,  cloud-­‐integrated  storage  is  dawning  

§  Flash  adopAon  will  have  knock-­‐on  effects  elsewhere  in  the  storage  infrastructure…  

 

 

Page 14: Simplification of storage - The Hot and the Cold of It

Object  Storage:  A  plaxorm  for  the  petabyte  era  

Scale-­‐out  Storage  §  Aimed  at  mainstream    enterprise  

§  MulA-­‐protocol  storage  §  Higher  performance  §  Sogware-­‐only  §  Open  source  emerging  

14  

Cloud  Storage  

Big  Content  

Scale-­‐out  Storage  

Big  Content  §  Aimed  at  digital  content  industries  

§  Dig  Archive/repository  §  Object-­‐only  §  Geo-­‐dispersal/EC  §  Lowest  $/GB  §  Delivered  as  hw  appliance  §  ‘Big  Game’  market  –    large  ASPs  

Cloud  Storage  §  Aimed  at  xSPs  §  Storage-­‐as-­‐as-­‐service  §  SWIFT/S3  API  compaAbility  §  Sogware-­‐only  §  Open  source  dominates  today  

Page 15: Simplification of storage - The Hot and the Cold of It

Poll  QuesAon  

15  

Page 16: Simplification of storage - The Hot and the Cold of It

EvoluAon  to  a  two-­‐Aer  storage  architecture  

Many  cloud  plaIorms  already  built  on  such  a  design  point  §  Eg  Amazon  Web  Services  –  EBS  and  S3/Glacier  §  Eg  OpenStack  –  Cinder  and  Swig  §  Simplify  automaAon,  enable  hardware  standardizaAon,  reduce  cost  §  Span  on-­‐prem  and  third  party  faciliAes  (hybrid  cloud)  

Which  data/applica@ons  suit  this  model?  §  Gradual  drip-­‐feed  of  data/applicaAons  vs  wholesale  migraAon  §  Web,  cloud,  and  mobile  apps  developed  for  ‘cloud  first’  §  Backup  and  archive  data  (incl.  tape  replacement)  §  File  synch/share  and  collaboraAon  §  ‘Aer  2’  NAS  §  Plaxorm  as  a  Service  (OpenStack,  CloudStack)  

16  

Page 17: Simplification of storage - The Hot and the Cold of It

ImplemenAng  Capacity  Storage  

Flexibility  Mobility  

Scale  Reliability  

Object  Storage   Cloud  

AND  

Cloudian  Hybrid  Cloud  Storage  

Page 18: Simplification of storage - The Hot and the Cold of It

Poll  QuesAon  

18  

Page 19: Simplification of storage - The Hot and the Cold of It

19  

Scale-­‐out  Distributed  Ring

5-14

Logical  ringData  is  automa@cally  replicated  to  mul@ple  nodes.

Loca@on  of  data  can  be  designated,  for  instance,  to  mul@ple  datacenters  and  per  rack.

DC1

DC2

In  theory,  #  of  nodes  in  a  logical  ring  can  be  up  to  2127  (almost  infinite).

Data  load  can  be  rebalanced  when  a  node  is  added  or  removed.

NOSQL  database  distributes  and  replicates  data

Page 20: Simplification of storage - The Hot and the Cold of It

20  

OpAmized  for  Any  Data  Type/Workload  

•  Policies  tailored  for  different  object  types  

•  OpAmized  for  all  data  

•  Chunking  for  beEer  performance  

•  Erasure  Coding  for  deep  archive  efficiency  

•  Reliable  Storage  across  mulA-­‐node  failures  

•  Seamless  Public  Cloud  Integrated    

HyperStore

Patent  Pending

Small  objects

Large  ObjectsActive  Content

File  System

NOSQL  DB

Erasure  Coding

DeepArchives

S3   NFS  

S3  Tier

Page 21: Simplification of storage - The Hot and the Cold of It

21  

ApplicaAon  Eco-­‐system  re-­‐writes  to  the  new  2Tier  Storage  

21  

Bigger  §  For  cool/cold  data  §  Object-­‐based  §  Scale-­‐out  (mulA-­‐PB)  §  Sogware-­‐centric  §  Cloud-­‐compaAble  

Faster  §  For  ‘hot’  data  §  Flash-­‐opAmized    §  IOPS-­‐centric  §  VM/VDI  opAmized  §  Variety  of  approaches  

Page 22: Simplification of storage - The Hot and the Cold of It

What  to  look  for  in  your  Capacity  Storage  OpAons  

q  Storage  for  any  Workload  (Erasure  Coding,  Replicas)  

q  OpAmized  for  Small  and  Large  Files  

q  MulA  Data  Center,  MulA  Site  Deployment    

q  Regional  Awareness  and  Locality    

q  MulA-­‐Tenancy  and  Chargeback  

q  Secure  EncrypAon  of  your  data  

q  Public  Cloud  Integrated  

q  Supports  Many  ApplicaAons  (S3)  

22  

Page 23: Simplification of storage - The Hot and the Cold of It

What  to  look  for  in  your  Capacity  Storage  OpAons  

ü  Storage  for  any  Workload  (Erasure  Coding,  Replicas)  

ü  OpAmized  for  Small  and  Large  Files  

ü  MulA  Data  Center,  MulA  Site  Deployment    

ü  Regional  Awareness  and  Locality    

ü  MulA-­‐Tenancy  and  Chargeback  

ü  Secure  EncrypAon  of  your  data  

ü  Public  Cloud  Integrated  

ü  Supports  Many  ApplicaAons  (S3)  

23  

Page 24: Simplification of storage - The Hot and the Cold of It

24  

Conclusion  

•  Storage  is  changing  –  Object  Storage  and  Flash  will  dominate  

•  This  Simplified  2Tier  storage  architecture  helps  overall  IT  agility  

•  Object  Storage  and  Cloud  provides  the  scale-­‐out  capacity  layer    Next  Steps  •  IdenAfy  ApplicaAons  which  can  take  advantage  of  Capacity  Storage  

•  Data  Intensive  :  Backup,  Archiving,  Mobile  File  Sharing,  Distributed  Shares  •  New  ApplicaAons  :  OpenStack,  CloudStack,  Hadoop  

 •  Try  it  out  

•  HyperStore  Free  hEp://www.cloudian.com/community-­‐ediAon.php  •  Ask  us  for  Trial  [email protected]  

   

Page 25: Simplification of storage - The Hot and the Cold of It

QuesAons?  

Simon  Robinson  Research  Vice  President,  Storage  [email protected]  @simonrob451    

25  

Paul  Turner  Chief  MarkeAng  Officer,  Cloudian  [email protected]  hEp://www.cloudian.com