0% found this document useful (0 votes)
27 views

3-2 Storage Data Protection Technologies and Applications

Uploaded by

salma ben hssin
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
0% found this document useful (0 votes)
27 views

3-2 Storage Data Protection Technologies and Applications

Uploaded by

salma ben hssin
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 48

Storage Data Protection Technologies and

Applications
Foreword

Traditional data protection solutions focus on periodic data backup.


Therefore, problems such as no backup window, inconsistent data, and
impact on the production system always occur.

This course describes storage data protection technologies such as


HyperSnap, HyperClone, HyperReplication, and HyperMetro which are new
data protection methods.

1 Huawei Confidential
Objectives

On completion of this course, you will be able to understand the principles,


configuration methods, and application scenarios of the following features:
HyperSnap

HyperClone

HyperReplication

HyperMetro

2 Huawei Confidential
Contents

1. HyperSnap

2. HyperClone

3. HyperReplication

4. HyperMetro

3 Huawei Confidential
Overview

Storage Networking Industry Association (SNIA) defines a


snapshot as follows:
A snapshot is an available copy of the specified data collection. The
copy contains the image for the relevant data at a time point when
the copy begins.

A snapshot can be a duplicate or replicate of data.

4 Huawei Confidential
Working Principles of HyperSnap
Definition: A snapshot is a consistent copy of the source data at a certain point in time. After the snapshot is
generated, it can be read by hosts and used as a data backup at a certain point in time.

Main features
Instant generation: A storage system can generate a snapshot within a few seconds to obtain the consistent copy of
source data.

Small storage space occupation: A snapshot is not a full physical data copy, which does not occupy large storage space.
Therefore, a snapshot for a large amount of source data occupies only a small space.
a b c a b c
d e f d e f
8:00 AM
g h i g h i
j k l j k l

a b c a b c
d m f d e f 9:00 PM
g h n g h i
j k l j k l

5 Huawei Confidential
HyperSnap Principles – Zero Performance Loss
Data requested to be written to L2 of
the source LUN is written to P5. Data requested to be Data requested to be written
Data requested to be written to L2 of written to L0 of snapshot to L2 of snapshot 2 is written
the source LUN is again written to P7. 1 is written to P6. to P8. Data requested to be written to
L2 of the source LUN is written
LUN Mapping Table Snap Mapping Table to a new space P5. The original
Snap Mapping Table
space P2 is referenced by the
snapshot.
Data requested to be written to
L0 of snapshot 1 is written to the
new space P6, bringing no
additional read and write
overhead.
When data is written to L2 of the
source LUN again, the requested
L3->P3 L4->P4 L2->P5 L2->P7 L2->P8
L0->P6 L0->P0 L1->P1 L2->P2 data is written to a new space
P7. The original space P5 is
released because it is not
A B C D E F G H I referenced by a snapshot.
A new snapshot 2 is created and
P0 P1 P2 P3 P4 P5 P6 P7 P8 activated.
SSD storage space

6 Huawei Confidential
HyperSnap Principles – Rollback
Data 10:00 AM Data 11:00 AM Virus Infection Data 11:00 AM
Restore

10 11 12 TIME

Snap 10:00 AM Snap 11:00 AM

7 Huawei Confidential
HyperSnap Principles – Snapshot Cascading and Cross-
Level Rollback
Source Snapshot cascading: It is a child
volume
snapshot of a parent snapshot. The
difference between snapshot duplicates
and snapshot cascading is that the
latter includes the data of its parent
8:00 9:00
snapshot. Other functions are the same
snapshot0 snapshot1
as common snapshots.
10:00 11:00

Snapshot1.snapshot0 Snapshot1.snapshot1
Cross-level rollback: Snapshots sharing
the same source volume can roll back
each other regardless of their cascading
levels.

8 Huawei Confidential
Key Technologies of HyperSnap-Duplicate

How can I obtain multiple


Source duplicates of the same
volume Snapshot snapshot?

8:00

Snapshots are virtual, so


8:00 8:00 8:00
they can be duplicated fast.

9 Huawei Confidential
Key Technologies of HyperSnap - Rollback Before Write

How can I instantly recover data?

Source
volume Snapshot
Snapshot
rollback During the rollback, when a
8:00 host writes data to a source
LUN, the snapshot copies the
data blocks to the source LUN,
and then the host continues to
write data.
When no host reads or writes
data, the snapshot data is
rolled back to the source
volume in sequence.

10 Huawei Confidential
Application Scenario
Source Snapshot
LUN LUN
Source
LUN

Snapshot
Duplicate Duplicate Duplicate Duplicate
LUN

1:00
2:00
4:00 3:00

Report Data Data Decision-


generation test analysis making
support

Continuous data protection Data backup and restoration

11 Huawei Confidential
Configuration Process
Required
Start
Optional

1. Checking the
Check the license
availability of the
snapshot function file.

Create a source Performing this operation when a


storage system does not have the
LUN.
source LUN of a snapshot.

2. Creating a snapshot Create a snapshot.

End

12 Huawei Confidential
Contents

1. HyperSnap

2. HyperClone

3. HyperReplication

4. HyperMetro

13 Huawei Confidential
Overview
Definition

HyperClone creates a full data copy (a target LUN) of a source LUN at a specified
point in time (synchronization start time).

Features

A target LUN can be read and written during synchronization.

Full synchronization and incremental synchronization are supported.

Forward synchronization and reverse synchronization are supported.

Consistency groups are supported.

14 Huawei Confidential
Working Principles of HyperClone
Definition: Clone is a consistent data copy of a source data at a specific point in time. It functions as a
complete data copy after data synchronization. It serves as a data backup and is accessible to hosts.

Main features:
Quick clone generation: A storage system can generate a clone within several seconds to obtain a consistency copy of a
source data. The generated clone can be read and written immediately. Users can configure different deduplication and
compression attributes for the generated clone.

Online splitting: A split can be performed to cancel the association between a source LUN and a clone LUN without
interrupting services. The split read and write operation on the clone LUN will not affect the I/O process of the source
LUN.

Create Synchronize
HyperClone. HyperClone.
a b c a b c a b c
d e f d e f d e f
g h i g h i g h i
j k l j k l j k l

15 Huawei Confidential
HyperClone Principles - Synchronization
Scenario 1: Initial Scenario 2: Synchronization is
synchronization and full performed again after the first
copy are performed. synchronization, and differential
copy is performed.
a
b a a b Stored data
b
2 3
Snapshot c
1 2 a b c Newly copied data

Snapshot
1 c New data written to the host
a a
b b a a Internal signal flow of the
b b storage system
Source Target
LUN LUN c c
HyperClone pair
1 Create a HyperClone pair. Source Target
LUN LUN
2 Create a snapshot for the source
LUN after synchronization is 1 Create a snapshot for the source LUN
started. after a second synchronization.
3 Copy all data a and b to the target 2 Copy incremental data c to the target
LUN.
LUN.

16 Huawei Confidential
HyperClone Principles - Reverse Synchronization
Scenario 1: Full copy Scenario 2: Differential copy a b c Stored data

a a a b c d Newly copied data


b b
c c
d New data written to the host
d d
2 1 2 1 Internal signal flow of the
Snapshot Snapshot storage system

HyperClone pair

a a a a
b b b b
c c c c
d d d d
Source Target Source Target
LUN LUN LUN LUN
1 Create a snapshot for the target LUN after 1 Create a snapshot for the target LUN after
the reverse synchronization is started. the reverse synchronization is started.

2 Copy all data a, b, c, and d to 2 Copy incremental data d to the source LUN.
the source LUN.

17 Huawei Confidential
HyperSnap Principles - Restrictions on Feature Configuration

Feature Restriction

A source LUN of HyperSnap can be used as a source LUN of HyperClone, but a LUN of HyperSnap
HyperSnap
cannot be used as a target LUN of HyperClone.

HyperMetro A member LUN of HyperMetro can be used as a source or a target LUN of HyperClone.

Primary and secondary LUNs of HyperReplication can be used as a source or a target LUN of
HyperReplication
HyperClone.

SmartMigration A source or a target LUN of HyperClone cannot be used as the source or target LUN of SmartMigration.

SmartVirtualization A heterogeneous LUN cannot be used as a source or a target LUN of HyperClone.

HyperCDP A source LUN of HyperCDP can be used as a source or a target LUN of HyperClone.

18 Huawei Confidential
Application Scenarios - Data Backup and Restoration
Source
Target LUN
LUN

Time
point A a Create HyperCopy.

Synchronize data on a source LUN to a target


Time LUN. In this case, the target LUN stores the data
a a
point B on the source LUN at time point B.

Time
point C a Data on the source LUN is lost.

Time Reversely synchronize data on the target LUN


point D a a to the source LUN. In this case, the source
LUN is restored to the status at time point B.

19 Huawei Confidential
Application Scenarios - Data Analysis and Reproduction

Data analysis
Source Data analysis The data analysis service uses data on a
LUN host
target LUN to prevent the data analysis
service and production service from
Reproducing n contending for resources of a source LUN
pieces of data Only for data
analysis and affecting performance.

Data reproduction

Target Target LUN Target LUN HyperClone can create multiple copies of the
LUN (1) (n-1) (n) same source LUN for multiple target LUNs.

20 Huawei Confidential
Configuration Process
Start

Check the license.

Create a protection
group.
Create a clone pair.
Create a clone
consistency group.

End

21 Huawei Confidential
Contents

1. HyperSnap

2. HyperClone

3. HyperReplication

4. HyperMetro

22 Huawei Confidential
Overview
As a core technology for DR and backup, HyperReplication can realize the
remote data backup and disaster recovery.

Function Purpose Benefit

To recover service data using backup data in the This function prevents damage caused
Remote backup and
remote storage system after the service data is by data loss in the case that data at
recovery
invalid. the primary site becomes unavailable.

To quickly switch service data from the primary This function prevents damage caused
Continuous service
site to the secondary site to protect service by a service interruption upon a failure
support
continuity when a disaster occurs. at the primary site.

This function prevents damage caused


To recover data at the primary site using backup
DR by service data loss or a long recovery
data at the secondary site after a disaster.
duration after a disaster.

23 Huawei Confidential
Introduction to DR and Backup

When the HyperReplication feature is used, two data centers work in active/standby mode. The primary site is in
the service running status, and the DR center is in the non-service running status.

For active/standby DR, when a device in data center A is faulty or even the entire data center A is faulty, services
are automatically switched to data center B.

For backup, data center B backs up only data in data center A and does not carry services when data center A is
faulty.

Data center B (secondary site)


Data center A (primary site)

24 Huawei Confidential
HyperReplication Concepts
Question: What are HyperReplication pairs, consistency groups, synchronization,
splitting, primary/secondary switchover, data status, and writable secondary LUNs?

To implement remote backup and recovery of service data, HyperReplication involves


the following phases: creating a HyperReplication relationship, data synchronization,
service switchover, and data recovery. What do these phases mean?

25 Huawei Confidential
Phases for Realizing Remote Backup and Recovery of
Service Data
1. Create a HyperReplication pair. 2. Synchronize data.
Primary LUN Secondary LUN Primary LUN Secondary LUN

HyperReplication HyperReplication
Link Link
WAN WAN

Pair Pair

3. Switch over services. 4. Recover data.

Primary LUN Secondary LUN Primary LUN Secondary LUN


HyperReplication HyperReplication
Link Link
WAN WAN

Pair Pair

26 Huawei Confidential
Running Status of a Pair
By viewing the running status of a pair, you can perform synchronization, splitting, and primary/secondary
switchover operations on HyperReplication in time. After performing an operation, you can view the running
status of the pair to check whether the operation is successful.

Running
Description
Status
Normal Indicates that data synchronization between the primary and secondary LUNs is complete.
Indicates that data replication between the primary and secondary LUNs is suspended. For the need of services, a pair of primary
Splitting
and secondary LUNs is manually split. As a result, the running status of the pair changes to the splitting status.
Indicates that if the pair relationship between the primary and secondary LUNs is interrupted because the link used by
Interrupted
HyperReplication is down or the primary or secondary LUN of HyperReplication is faulty. The pair running status is interrupted.
Indicates that if HyperReplication requires to be restored using a manual policy after the fault caused by a pair interruption is
To be recovered rectified, the pair running status changes to the to-be-recovered status. This status indicates that users need to manually
synchronize data between the original primary LUN and the secondary LUN to restore the pair.
Indicates that if the original attributes of a primary or secondary LUN change when a pair is interrupted (for example, when the
Invalid HyperReplication link is down, the pair is deleted on the primary or secondary end), the pair running status changes to the
invalid status because the primary and secondary system configurations become inconsistent.
When the primary LUN is synchronizing data to the secondary LUN, the secondary LUN cannot be read or written. If a disaster
Synchronizing occurs, data on the secondary LUN cannot be used for service recovery. When the secondary LUN is in the complete status, data
on the secondary LUN can be used for service recovery.

27 Huawei Confidential
Principles of Asynchronous Remote Replication
Based on the known
Host
asynchronous remote
1 2 DCL
replication, try to draw a 3 6
RM
schematic diagram of
1 2
synchronous remote 5
Primary Secondary
replication. LUN Cache

Primary 5 Secondary
LUN LUN
4 4
Snapshot of the HyperReplication Link Snapshot of the
primary LUN secondary LUN
7 WAN 7

Snapshot of the Snapshot of the


primary LUN secondary LUN

DCL
Secondary Storage System
Primary Storage System

28 Huawei Confidential
HyperReplication Service Switchover
Production Host Production host Standby host
Standby Host

Services run by the Read-only


Read-only
production host
Primary Secondary Primary Disconnected Secondary
Replication LUN LUN
LUN LUN Link
Link
WAN WAN
Secondary storage Primary storage Secondary storage
Primary storage
1. Normal production at the primary site 2. A disaster at the primary site

Production host Standby host


Services
Read/Write taken
over by
Primary Disconnected Secondary the 3. Service taken over by the secondary site
LUN Link LUN standby
host
WAN
Primary storage Secondary storage

29 Huawei Confidential
HyperReplication Data Recovery
Production host Standby host Production host Standby host

Data
recovered
Services
run by the
Secondary Primary standby
Link Secondary New Primary
LUN LUN host.
Recovery LUN Link LUN

WAN WAN
Primary storage Secondary storage Primary storage Secondary storage

1. Disaster recovery at the primary site. 2. Data recovery at the primary site

Production host Standby host



Services
run by 3. Service recovery at the primary site
the Unreadable
producti Primary Unwritable
on host Replication Secondary
LUN
Link LUN
WAN
Primary storag Secondary storage

30 Huawei Confidential
Functions of a Consistency Group
Primary LUN 01 CG 01 Secondary LUN 01 Primary LUN 01 CG 01
Secondary LUN 01
HyperReplication
HyperReplication Task 01
Task 01
Primary LUN 02 Secondary LUN 02 Primary LUN 02 Secondary LUN 02
HyperReplication
HyperReplication Task 02
Task 02
Primary LUN 03 Secondary LUN 03 Primary LUN 03 Secondary LUN 03
HyperReplication
HyperReplication Task 03
Task 03

1. Create a consistency group. 2. Stop replication tasks for the consistency group.

Primary LUN 01 CG 01 Secondary LUN 01

HyperReplication
Task 01
Primary LUN 02 Secondary LUN 02

HyperReplication 3. Ensure data validity for the consistency group.


Task 02
Primary LUN 03 Secondary LUN 03
HyperReplication
Task 03

32 Huawei Confidential
Typical Application Scenarios
Analysis Item Central DR and Backup Geo-redundancy

Backup data is managed centrally so that data


analysis and data mining can be performed Three data centers are deployed in two cities to perform
without affecting services. real-time backup and remote backup concurrently.
When a disaster occurs at any service site, the Service data is backed up to an intra-city DR center in
central DR and backup site can quickly take over real time through a high-speed link.
Scenario feature its services and recover data, achieving unified After data in the primary site is invalid, services are
service data management. quickly switched to the intra-city DR center.
HyperReplication mode can be selected for a If a disaster damages the primary site and the DR center
service site flexibly based on the distance in the same city, an inter-city DR center takes over
between the service site and the central DR and services and implements DR.
backup site.

HyperReplication Intra-city: asynchronous remote replication


Asynchronous remote replication
mode Inter-city: asynchronous remote replication

Maximum distance
Asynchronous remote replication: no restriction Asynchronous remote replication: no restriction
for DR and backup

33 Huawei Confidential
Central DR and Backup Scenario
Central DR and backup refer to backing up service data from different places to the same site for centralized
management. Service data at multiple service sites is centrally backed up to and managed at the central DR
and backup site. When a disaster occurs, the central DR and backup site can take over services from the
service site and recover data.
Secondary
Primary LUN 02 HyperReplication 02 LUN 02

WAN

Host
Service site 02 Asynchronous

......
......

......
Secondary
Primary LUN n HyperReplication n LUN n

WAN

Service site n Asynchronous Central DR and


backup site

34 Huawei Confidential
Realizing DR Used with BCManager eReplication
BCManager eReplication is a DR management software specially designed for Huawei typical DR solutions. It
provides a visualized and process-based platform for simple and fast operations and monitoring based on
data consistency, HyperSnap, and HyperReplication technologies.
Primary site DR center

BCManager BCManager
Production host eReplication
eReplication
Server Agent
BCManager
eReplication
Agent

Standby host

BCManager
eReplication
Host

HyperReplication

Storage system Storage system

35 Huawei Confidential
Configuration Process
Start
Required
Check the license.
Optional

Create a logical port.

Manage a route.

Create an authentication user.

Add a remote device.

Create a protection group.

Create a HyperReplication
pair. Create a remote replication
consistency group.

End

36 Huawei Confidential
Contents

1. HyperSnap

2. HyperClone

3. HyperReplication

4. HyperMetro

37 Huawei Confidential
Overview
HyperMetro is also called active-active feature. Two data centers are backups
for each other in the running status.

If a device is faulty in a data center or even the entire center is faulty, the other
data center will automatically take over services, solving the problems of
traditional DR centers in switchover. This ensures high data reliability and
service continuity, and improves the resource utilization of the storage system.

38 Huawei Confidential
Working Principles of HyperMetro
Data center A Data center B
How to perform
arbitration when
Oracle RAC cluster/VMware a fault occurs?
vSphere cluster/
FusionSphere cluster
......

WAN
FC/IP SAN SAN SAN
FC/IP

Production Real-time data synchronization


Production
storage storage

IP network IP network

Quorum device

39 Huawei Confidential
Quorum Mode
If the link between two data centers is down or one data center is faulty, data
cannot be synchronized between the two data centers in real time. In this case,
only a HyperMetro pair or a site of HyperMetro consistency group can continue
providing services. For data consistency, HyperMetro adopts an arbitration
mechanism to determine service priority in data centers.

HyperMetro provides two quorum modes:


Static priority mode: applied to scenarios where no quorum server is configured.

Quorum server mode (recommended): applied to scenarios where a quorum server


is configured.

40 Huawei Confidential
Static Priority Mode
Fault Type Result
A HyperMetro pair is in the to-be-synchronized status.
A link between storage
LUNs in data center A continue providing services while LUNs in
systems is down.
data center B stop providing services.
A HyperMetro pair is in the to-be-synchronized status.
Host Data center B is faulty. LUNs in data center A continue providing services while LUNs in
data center B stop providing services.
A HyperMetro pair is in the to-be-synchronized status.
Data center A is faulty. LUNs in data center A cannot be accessed and LUNs in data center
B stop providing services.
A HyperMetro replication
A HyperMetro pair is in the to-be-synchronized status.
HyperMetro link is down and a link
LUNs in data center A continue providing services while LUNs in
between a host and data
data center B stop providing services.
center B is down.
Data center B is faulty
A HyperMetro pair is in the to-be-synchronized status.
and the link between the
Data center A Data center B host and data center B is
LUNs in data center A continue providing services while LUNs in
data center B stop providing services.
down.
Links between the host
A HyperMetro pair is in the normal status.
and data centers A and B
A host fails to access LUNs in both data center A and B.
are concurrently down.

41 Huawei Confidential
Quorum Server Mode

Host Fault Type Result


A HyperMetro pair is in the normal status.
The quorum server is faulty. LUNs in data center A and data center B continue
providing services.
A link between a storage system
A HyperMetro pair is in the normal status.
and the quorum (example of the
LUNs in data center A and data center B continue
storage system in data center A)
HyperMetro providing services.
is down.
A storage system is faulty A HyperMetro pair is in the to-be-synchronized status.
(example of the storage system in LUNs in data center A are invalid, but LUNs in data center
data center A). B continue providing services.
Data center A Data center B
A HyperMetro pair is in the to-be-synchronized status.
A link between storage systems is
LUNs in data center A continue providing services while
down.
LUNs in data center B stop providing services.

A storage system and the quorum


A HyperMetro pair is in the to-be-synchronized status.
server (example of the storage
Data center A is faulty and LUNs in data center B stop
Quorum server system in data center A) are
services.
concurrently faulty.

42 Huawei Confidential
Dual-Write Principle

Host

Write I/O
1 5
Cross-site active-active cluster

Array A Array B
2 HyperMetro LUN

4
4 3 3

HyperMetro LUN HyperMetro LUN

44 Huawei Confidential
Strong Data Consistency

Data center A Data center B

Host Application cluster Host

Cross-site active-active cluster

Mutual exclusion of HyperMetro LUNs' distributed locks

Array A Array B

HyperMetro LUN HyperMetro LUN

45 Huawei Confidential
Solution Extensibility Design
Disaster recovery solution HyperMetro data center solution
Site A Site B Site A
Upgraded Site B
architecture and
uninterrupted
services
Synchronous/
asynchronous HyperMetro
replication

Geo-redundant solution
Data Data Data center C
center A center B

46 Huawei Confidential
Typical Application Scenarios
Industry Feature
With the development of hospital services, the growing numbers of beds and new outpatient buildings pose
higher requirements on service continuity.
Once critical departments such as out-patient, in-patient, and electronic medical record (EMR) are interrupted,
Healthcare medical treatment will be delayed and hospitals will suffer from great economic loss and inestimable damage to
their reputation. In addition, an out-patient building is close to an in-patient network information center in the
same hospital, and two hospitals in the same city are physically close to each other. HyperMetro can meet their
requirements.

In the finance industry, banking services, 24-hour ATM services, POS services, and e-bank services are developing
quickly as bank services develop. These services require that banking systems process around-the-clock services.
Finance For reliability and stability, banks require a solution to store for reused and meet their service construction
requirements (RPO = 0, RTO = 0) to ensure business continuity. Service interruptions damage banks' reputation
and pose huge pressure on technical departments.

In the social security industry, service continuity requirements are high. Monthly settlement and year-end carry-
over require 24/7 online operation. Otherwise, people's livelihood problems may occur. For example, pension
Social cannot be paid in time, and medical insurance cannot be settled in time.
security HyperMetro is applicable to social insurance application scenarios including the basic information management,
social insurance card service, labor relationship, public services, public resource management, employment, and
social insurance management.

47 Huawei Confidential
Configuration Process
Start
Required
Prepare the configuration. Optional

Configure the switches.

Configure quorum server


software. Check the license.

Add a remote device.

Create a quorum server.


Configure HyperMetro.
Create a HyperMetro
domain.

Create a HyperMetro pair.


Configure a multipathing
policy for hosts. Create a HyperMetro
consistency group.

End

48 Huawei Confidential
Summary

HyperSnap

HyperClone
Storage Data Protection Definitions, principles,
Technologies and and configuration
Applications processes
HyperReplication

HyperMetro

49 Huawei Confidential

You might also like