39
1 © Copyright 2012 EMC Corporation. All rights reserved. EMC BACKUP AND RECOVERY SOLUTIONS Deduplication Based Backup Solutions Jean-Philippe Schwartz Technology Consultant EMC Switzerland - Backup & Recovery Systems [email protected]

Les solutions EMC de sauvegarde des données avec déduplication dans les environnements virtuels

  • Upload
    ljaquet

  • View
    1.628

  • Download
    2

Embed Size (px)

DESCRIPTION

 

Citation preview

Page 1: Les solutions EMC de sauvegarde des données avec déduplication dans les environnements virtuels

1© Copyright 2012 EMC Corporation. All rights reserved.

EMC BACKUP AND RECOVERY SOLUTIONS

Deduplication Based Backup Solutions

Jean-Philippe SchwartzTechnology ConsultantEMC Switzerland - Backup & Recovery [email protected]

Page 2: Les solutions EMC de sauvegarde des données avec déduplication dans les environnements virtuels

2© Copyright 2012 EMC Corporation. All rights reserved.

Backup and Recovery Agenda

• BRS Portfolio & EMC Leadership

• Backup Market Evolution

• Deduplication Fundamentals

• Avamar

• Data Domain

• NetWorker

• Q & A

Page 3: Les solutions EMC de sauvegarde des données avec déduplication dans les environnements virtuels

3© Copyright 2012 EMC Corporation. All rights reserved.

Backup and Recovery Agenda

• BRS Portfolio & EMC Leadership

• Backup Market Evolution

• Deduplication Fundamentals

• Avamar

• Data Domain

• NetWorker

• Q & A

Page 4: Les solutions EMC de sauvegarde des données avec déduplication dans les environnements virtuels

4© Copyright 2012 EMC Corporation. All rights reserved.

Avamar Disk Libraryfor mainframe

EMC Backup and Recovery Solutions

NetWorker Data ProtectionAdvisor

Data Domain

Page 5: Les solutions EMC de sauvegarde des données avec déduplication dans les environnements virtuels

5© Copyright 2012 EMC Corporation. All rights reserved.

Centera Atmos

EMC Archive Solutions

SourceOneData DomainArchiver

Page 6: Les solutions EMC de sauvegarde des données avec déduplication dans les environnements virtuels

6© Copyright 2012 EMC Corporation. All rights reserved.

Backup and Recovery Market Leadership#1 in deduplication backup software and storage worldwide

Source: Worldwide Tape Automation 2010–2014 Forecast and Analysis and 2009 Vendor Shares, IDC Doc #223182, May 2010

0

200

400

600

800

1 000

1 200

1 400

1 600

1 800

EMC Symantec IBM Oracle Quantum CA

Data protection and recovery softwarePurpose-built backup appliances

Tape automation (est.)

$ M

ILLI

ON

S

Page 7: Les solutions EMC de sauvegarde des données avec déduplication dans les environnements virtuels

7© Copyright 2012 EMC Corporation. All rights reserved.

Backup and Recovery Agenda

• BRS Portfolio & EMC Leadership

• Backup Market Evolution

• Deduplication Fundamentals

• Avamar

• Data Domain

• NetWorker

• Q & A

Page 8: Les solutions EMC de sauvegarde des données avec déduplication dans les environnements virtuels

8© Copyright 2012 EMC Corporation. All rights reserved.

DATA DELUGE BUDGET DILEMMA

INFRASTRUCTURE SHIFT

IT Trends Impacting Backup and Recovery

Transformation

20090.8 Zettabytes

202035.2 Zettabytes

Page 9: Les solutions EMC de sauvegarde des données avec déduplication dans les environnements virtuels

9© Copyright 2012 EMC Corporation. All rights reserved.

Disaster RecoveryStorage

Backup Applications

Onsite Backup Storage

Backup Evolution Over TimeFrom tape to disk to deduplication

Deduplication StorageBackup

Software

Deduplication Backup Software and System

TransformationalDisk-Centric

Backup Software

VTL VTL/Tape

Backup Software

Tape TapeTraditional

Tape-Centric Backup failuresRecovery timeStorage costComplexity

Decrease

Page 10: Les solutions EMC de sauvegarde des données avec déduplication dans les environnements virtuels

10© Copyright 2012 EMC Corporation. All rights reserved.

Backup and Recovery Agenda

• BRS Portfolio & EMC Leadership

• Backup Market Evolution

• Deduplication Fundamentals

• Avamar

• Data Domain

• NetWorker

• Q & A

Page 11: Les solutions EMC de sauvegarde des données avec déduplication dans les environnements virtuels

11© Copyright 2012 EMC Corporation. All rights reserved.

Deduplication Dramatically Reduces Storage Capacity Requirements

Deduplication10–30 times less data stored versus fulls + incrementals with typical retention policies

0

10

20

30

1 5 10 15 20

Weeks in Use

Dat

a S

tore

d

Deduplication storage

Traditional storage

Page 12: Les solutions EMC de sauvegarde des données avec déduplication dans les environnements virtuels

12© Copyright 2012 EMC Corporation. All rights reserved.

Second Friday Full Backup

B C D E F L G H

Data Deduplication: Technology OverviewStore more backups in a smaller footprint

A B C D E F G H I J

Friday Full Backup

A B C D A E F G

Mon Incremental A B H

Tues Incremental C B I

Thurs Incremental A C K

Weds Incremental E G J

Backup Estimated Data Logical Reduction Physical

Monday Incremental 50 GB 7–10x 5 GB

Tuesday Incremental 50 GB 7–10x 5 GB

K L

Wednesday Incremental 50 GB 7–10x 5 GB

Thursday Incremental 50 GB 7–10x 5 GB

Second FRIDAY FULL 1 TB 50–60x 18 GB

TOTAL 2.2 TB 7.6x 288 GB

FRIDAY FULL 1 TB 2–4x 250 GB

Page 13: Les solutions EMC de sauvegarde des données avec déduplication dans les environnements virtuels

13© Copyright 2012 EMC Corporation. All rights reserved.

Retain: Store More for Longer with LessOver one year of retention in 3U of Data Domain deduplication storage

Week 1

Backup Cumulative Estimated PhysicalData Logical Reduction

April 14 3.4 TB 10x 326 GB

April 21 4.6 TB 13x 364 GB

April 28 5.8 TB 14x 402 GB

May 26 10.6 TB 19x 554 GB

June 23 15.4 TB 21x 706 GB

TOTAL 15.4 TB 21x 706 GB

April 7 2.2 TB 8x 288 GB

Week 2

Week 3

Month 1

Month 2

Month 3

First Full 1 TB 4x 250 GB

Page 14: Les solutions EMC de sauvegarde des données avec déduplication dans les environnements virtuels

14© Copyright 2012 EMC Corporation. All rights reserved.

Backup and Recovery Agenda

• BRS Portfolio & EMC Leadership

• Backup Market Evolution

• Deduplication Fundamentals

• Avamar

• Data Domain

• NetWorker

• Q & A

Page 15: Les solutions EMC de sauvegarde des données avec déduplication dans les environnements virtuels

15© Copyright 2012 EMC Corporation. All rights reserved.

Avamar Backup and DeduplicationUnlike anything else in the industry

Reduce:• Data moved by 95%• Network interface card usage at the client by 95%• Backup windows by 90%• Client CPU usage by 80%• Disk access at the client by 50%• Memory usage at the client by 50%

Network

Avamar Data Store

Page 16: Les solutions EMC de sauvegarde des données avec déduplication dans les environnements virtuels

16© Copyright 2012 EMC Corporation. All rights reserved.

B

A

C C

D

D

B

A

B

A

CB

A C

B

C

D

DA

B

A

B

A

C

D

Avamar:

1. Divides data into sub-file segments

2. Determines if segments are unique or duplicate

3. Backs up only data that is unique

4. Sends data compressed and encrypted

Deduplication is the Enabler

Network

Avamar Data Store

Page 17: Les solutions EMC de sauvegarde des données avec déduplication dans les environnements virtuels

17© Copyright 2012 EMC Corporation. All rights reserved.

Every backup is a “full” backup; restore single files or full directories directly to the client

Recover in One StepAvamar daily full backups eliminate need to restore last full/incremental

1

Page 18: Les solutions EMC de sauvegarde des données avec déduplication dans les environnements virtuels

18© Copyright 2012 EMC Corporation. All rights reserved.

Avamar’s Flexible Physical and Virtual Deployment Options

SECONDARY SITE

PRIMARY DATA CENTER

Direct to Avamar Virtual Edition;Replicate to main data store

Direct to local Avamar Data Store; Replicate to main data store

Avamar agents only; Direct to main data store

SMALL REMOTE OFFICE

DESKTOPS AND LAPTOPS LARGE REMOTE OFFICE

DISTRIBUTED VIRTUALIZATION SITE

VMware ESX

Page 19: Les solutions EMC de sauvegarde des données avec déduplication dans les environnements virtuels

19© Copyright 2012 EMC Corporation. All rights reserved.

• Application-specific agent within each VM ensures consistent state for hot backup

• Deduplicates within and across virtual machines• Reduces resource contention and speeds backups• Provides file-level restore for Windows,

Linux, and Solaris• Control cost with zero-dollar agents

Avamar for VMware Guest-Level Backup

Resource Pool

VMware Virtualization Layer

x86 Architecture

Physical server

Virtual machines

AvamarData StorePhysical server

Page 20: Les solutions EMC de sauvegarde des données avec déduplication dans les environnements virtuels

20© Copyright 2012 EMC Corporation. All rights reserved.

• Deduplication within and across VMDK files• Changed Block Tracking (CBT) reduces backup time and minimizes

recovery time• File-level recovery from image backup (Windows)• Flexible restore to original, existing, or new virtual machine• Proxy server load balancing for superior throughput

Resource Pool

VMware Virtualization Layer

x86 Architecture

Physical server

Virtual machines

Storage AvamarData Store

Mount

Physical server

Avamar for VMware Image-Level BackupAvamar integration with VMware vStorage API for Data Protection

Page 21: Les solutions EMC de sauvegarde des données avec déduplication dans les environnements virtuels

21© Copyright 2012 EMC Corporation. All rights reserved.

• Leverages existing ESX servers and storage– Either 0.5TB, 1 TB or 2 TB licensed

capacity running on VMware ESX Server

• Replication (of applications and storage)• Facilitates rapid, cost-effective deployment

and return on investment• Supports vMotion for deployment and

flexibility• Up to two Avamar Virtual Edition for

VMware virtual appliances per VMware ESX server for scalability

AvamarVM

AvamarVM

AvamarVM

Resource Pool

VMware Virtualization Layer

x86 Architecture

Avamar Virtual Edition for VMwareAvamar Server deployed as a Virtual Appliance

Page 22: Les solutions EMC de sauvegarde des données avec déduplication dans les environnements virtuels

22© Copyright 2012 EMC Corporation. All rights reserved.

Backup and Recovery Agenda

• BRS Portfolio & EMC Leadership

• Backup Market Evolution

• Deduplication Fundamentals

• Avamar

• Data Domain

• NetWorker

• Q & A

Page 23: Les solutions EMC de sauvegarde des données avec déduplication dans les environnements virtuels

23© Copyright 2012 EMC Corporation. All rights reserved.

EMC Data Domain: Leadership and InnovationA history of industry firsts

First deduplication NAS

First deduplication volume replication

Largest deduplication

array

First deduplicationdirectory replication

First deduplication virtual tape library

First deduplication nearline storage

Fastest backupcontroller

Cascaded replication

2003 2004 2005 2006 2007 2008 2009 2010 2011

First long-term retention

system for backup and

archive

First distributed processing

Page 24: Les solutions EMC de sauvegarde des données avec déduplication dans les environnements virtuels

24© Copyright 2012 EMC Corporation. All rights reserved.

Data Domain BasicsEasy integration with existing environment

Replication

CIFS, NFS, NDMP, DD Boost

Ethernet

Virtual Tape Library (VTL) over

Fibre ChannelDD890 appliance

Control Tier Target Tier Disaster Recovery Tier

2U 2 to 14 ports 10 and 1 Gigabit Ethernet; 8 Gb/s Fibre Channel RAID 6 Up to 285 TB usable capacity with shelves 2 TB or 1 TB 7.2K rpm SATA HDD in shelf File system NVRAM N+1 fans and redundant, hot-plug power supplies

DD890 appliance

Backup and Archive Applications

EMC

Symantec

CommVault

IBM

HP

Veeam

Quest

Page 25: Les solutions EMC de sauvegarde des données avec déduplication dans les environnements virtuels

25© Copyright 2012 EMC Corporation. All rights reserved.

Data Domain Infrastructure and EcosystemSupports a variety of workloads and data types

VMwareMicrosoftMicrosoft SharePointOracleSAP

Backup Midrange andMainframe

EMC Bus-Tech

Archive

NAS, SAN, DAS

EMCSymantecCommVault

CAHPVizioncore

Backup ApplicationsEMCF5 NetworksSymantecCommVault

Archive Applications

IBMAtempoBakBone

Primarystorage

NetworkDisaster Recovery

Replicationover WAN

IBM i

Page 26: Les solutions EMC de sauvegarde des données avec déduplication dans les environnements virtuels

26© Copyright 2012 EMC Corporation. All rights reserved.

Methodology: Inline vs. Post-Process Deduplication

POST-PROCESSDeduplication After Storing

The more processes, the more resource contention

− Copy to tape: Too slow to stream tape− Recovery: Service level agreement predictability− Replication: Poor time-to-disaster-recovery− Deduplication: If interleaved with backup or restore

More administration to fight these issues

DeduplicationStore

3x disk accesses to shared store

Other activities unimpeded− Predictable− Simpler

INLINEDeduplication Before Storing

Deduplication

Page 27: Les solutions EMC de sauvegarde des données avec déduplication dans les environnements virtuels

27© Copyright 2012 EMC Corporation. All rights reserved.

Performance: CPU-Centric vs. Spindle-Bound

Thro

ughp

ut M

B/s

50

6,000

Number of Disk Spindles

50 100 150 200

Data Domain

Fibre Channel SATA

Mostdeduplication

vendors

Page 28: Les solutions EMC de sauvegarde des données avec déduplication dans les environnements virtuels

28© Copyright 2012 EMC Corporation. All rights reserved.

Data Integrity: Data Invulnerability Architecture

OtherRAID 6NVRAMSnapshots

End-to-end data verificationChecksumDeduplication, write to diskVerify

Self-healing file systemCleaningExpired dataDefragVerify

Deduplication

Local Compression

RAID

File System

GenerateChecksum

VerifyData

Verify the file system metadata integrity

Verify user data integrity

Verify stripe integrity

End-to-end data verification

Page 29: Les solutions EMC de sauvegarde des données avec déduplication dans les environnements virtuels

29© Copyright 2012 EMC Corporation. All rights reserved.

Network-Efficient Replication for True Disaster RecoveryLowers WAN costs; improves service level agreements

95–99% cross-site bandwidth reduction

Source:Remote sites

Destination:Data Center Hub Supports hundreds

of remote sites

1–5%

1–5%

1–5%

Archive data

Backup data

Data Domain Global Deduplication Array

Data Domain system

Flexible replication One-to-many Many-to-one Bi-directional System-to-system Cascaded

Home

DB

WAN

Home

Data Domain system

Data Domain system

Page 30: Les solutions EMC de sauvegarde des données avec déduplication dans les environnements virtuels

30© Copyright 2012 EMC Corporation. All rights reserved.

DD Boost Software• Distributes parts of deduplication process to backup

server or application clients– Licensable software works across Data Domain portfolio

• Supports majority of backup software market– EMC Avamar and NetWorker– Symantec NetBackup and Backup Exec

• Speeds backups by up to 50 percent

• Process more backups with existing resources– 20–40% less overall impact to backup server– 80–99% less LAN bandwidth

• Enables Data Domain replication management from the backup application

DDBoost

Page 31: Les solutions EMC de sauvegarde des données avec déduplication dans les environnements virtuels

31© Copyright 2012 EMC Corporation. All rights reserved.

Data Domain Replicator• Network-efficient and encrypted

• Transfers only compressed, deduplicated data over the WAN

• Consolidate up to 270 remote sites into a single system

Additional Data Domain Software Options

Data Domain Virtual Tape Library• Easily integrates with Fibre Channel

• Emulates multiple tape libraries

• Supports open systems and IBM i operating environments

Data Domain Encryption• Inline encryption of data at rest

• Satisfies internal governance rules and compliance regulations

• Protects against theft or loss of a physical system

Data Domain Retention Lock• File locking to satisfy IT governance

and compliance policies

• Electronic data shredding

Page 32: Les solutions EMC de sauvegarde des données avec déduplication dans les environnements virtuels

32© Copyright 2012 EMC Corporation. All rights reserved.

Industry’s Most Scalable Inline Deduplication Systems

DD160 DD620 DD640 DD670 DD860 DD890Global Deduplication Array

DD Archiver

Speed (DD Boost) 1.1 TB/hr 2.4 TB/hr 3.4 TB/hr 5.4 TB/hr 9.8 TB/hr 14.7 TB/hr 26.3 TB/hr 9.8 TB/hr

Speed (other) 667 GB/hr 1.1 TB/hr 2.3 TB/hr 3.6 TB/hr 5.1 TB/hr 8.1 TB/hr 10.7 TB/hr 4.3 TB/hr

Logical capacity 40–195 TB 83–415 TB 0.32–1.6 PB 0.6–2.7 PB 1.4–7.1 PB 2.9–14.2 PB 5.7–28.5 PB 5.7–28.5 PB

Usable capacity Up to 3.98 TB Up to 8.3 TB Up to 32.2 TB Up to 55.9 TB Up to 142 TB Up to 285 TB Up to 570 TB Up to 570 TB

Software options:DD Boost, DD Virtual Tape Library, DD Replicator, DD Retention Lock, and DD Encryption

DD160Appliance

DD600 Appliance Series

DD ArchiverGlobal DeduplicationArray

DD800Appliance Series

Page 33: Les solutions EMC de sauvegarde des données avec déduplication dans les environnements virtuels

33© Copyright 2012 EMC Corporation. All rights reserved.

Backup and Recovery Agenda

• BRS Portfolio & EMC Leadership

• Backup Market Evolution

• Deduplication Fundamentals

• Avamar

• Data Domain

• NetWorker

• Q & A

Page 34: Les solutions EMC de sauvegarde des données avec déduplication dans les environnements virtuels

34© Copyright 2012 EMC Corporation. All rights reserved.

Unified managementBring together a full range of traditional and next-generation data protection—from backup-to-disk to replication to tape—under a common management interface

High performanceAccelerate backup and recovery with industry-leading speed, security, and scalability to meet demanding service levels

Leading deduplicationIntegrate with Avamar and Data Domain to transform your backup and recovery with industry-leading deduplication

Maximum flexibilityBackup mission-critical business applications in physical and virtual environments

EMC NetWorkerUnified backup and recovery software

NetWorker

Page 35: Les solutions EMC de sauvegarde des données avec déduplication dans les environnements virtuels

35© Copyright 2012 EMC Corporation. All rights reserved.

Managing Deduplication with NetWorker

• Single solution with industry- leading deduplication– Avamar– Data Domain

• Integrated software and hardware– Simplicity– Predictability– Supportability

File systems and applications

AvamarData

Domain

NetWorker

Page 36: Les solutions EMC de sauvegarde des données avec déduplication dans les environnements virtuels

36© Copyright 2012 EMC Corporation. All rights reserved.

• In-guest and centralized proxy-based backup

• Application-consistent guest-level backup

• Integration with VMware vStorage API for Data Protection

– Image and file-level recovery with a single backup

– Physical and virtual proxy support

– Changed Block Tracking (CBT) incremental backup support

• Auto discovery and visualization simplifies management of large environments

OFF-HOST

IN-GUEST

NetWorker Integration with VMware

Page 37: Les solutions EMC de sauvegarde des données avec déduplication dans les environnements virtuels

37© Copyright 2012 EMC Corporation. All rights reserved.

Backup and Recovery Agenda

• BRS Portfolio & EMC Leadership

• Backup Market Evolution

• Deduplication Fundamentals

• Avamar

• Data Domain

• NetWorker

• Q & A

Page 38: Les solutions EMC de sauvegarde des données avec déduplication dans les environnements virtuels

38© Copyright 2012 EMC Corporation. All rights reserved.

Questions and Answers

Page 39: Les solutions EMC de sauvegarde des données avec déduplication dans les environnements virtuels