CIS Module 2 - Classic Data Center - Modi
CIS Module 2 - Classic Data Center - Modi
Copyright © 2011 EMC Corporation. All Rights Reserved. Classic Data Center 2
Module 2: Classic Data Center (CDC)
Copyright © 2011 EMC Corporation. All Rights Reserved. Classic Data Center 3
Classic
CDC Data Center (CDC)
A CDC is a facility containing physical IT resources including compute,
network, and storage
Application
Compute
Storage
Network
Availability
Availability
Data
Data Integrity
Integrity Performance
Performance
Manageability
Manageability
Security
Security Flexibility
Flexibility
Scalability
Scalability
Copyright © 2011 EMC Corporation. All Rights Reserved. Classic Data Center 8
Database Management System (DBMS)
• Database is a structured way to store data in logically organized
tables that are interrelated
Helps to optimize the storage and retrieval of data
• DBMS is a collection of computer programs that control the
creation, maintenance, and use of databases
Processes an application’s request for data
Instructs the OS to retrieve the appropriate data from storage
• Popular DBMS examples are MySQL, Oracle RDBMS, SQL Server,
etc.
Copyright © 2011 EMC Corporation. All Rights Reserved. Classic Data Center 9
Compute
Compute
A resource that runs applications with the help of underlying computing
components
Copyright © 2011 EMC Corporation. All Rights Reserved. Classic Data Center 10
Examples of Compute System
• Examples of compute systems:
Laptops/Desktops
Blade servers
Complex cluster of servers
Mainframes
• Bladed server technology is commonly used to deploy compute
systems in a CDC
Consolidates power- and system-level function into a single,
integrated chassis
Enables the addition of server modules as hot-pluggable
components
Provides increased server performance and availability without
increase in size, cost, or complexity
Copyright © 2011 EMC Corporation. All Rights Reserved. Classic Data Center 11
Server Clustering
• Multiple servers (nodes ) are brought together in a cluster to
improve availability and performance
When a failure occurs on one node in a cluster, resources and
workload are redirected to another node
• Exchange heartbeat is a checkup mechanism between two nodes
To see whether a node is up and running
A failover is initiated, if heartbeat fails
Copyright © 2011 EMC Corporation. All Rights Reserved. Classic Data Center 12
Logical Components of Compute
Applications
File System
Operating System
Logical Components
Volume Manager
Device Drivers
Storage
Copyright © 2011 EMC Corporation. All Rights Reserved. Classic Data Center 13
Storage
Storage
Copyright © 2011 EMC Corporation. All Rights Reserved. Classic Data Center 14
Storage Device Options
●
Low cost solution for long term data storage
Tape Drive ●
Sequential data access, physical wear and tear, and
storage/retrieval overheads
●
Write Once and Read Many (WORM): CD, DVD
Optical Disk ●
Limited in capacity and speed
●
Popular in small, single-user environments
●
Random read/write access
Disk Drive ●
Uses mechanical parts for data access
●
Most popular storage device with large storage capacity
●
Provides ultra high performance required by mission-critical applications
Solid State Drive ●
Very low latency per I/O, low power requirements, and very high throughput
per drive
Copyright © 2011 EMC Corporation. All Rights Reserved. Classic Data Center 15
Redundant Array of Independent Disks (RAID)
RAID
Copyright © 2011 EMC Corporation. All Rights Reserved. Classic Data Center 16
RAID Techniques
A A A
A1 A2 A3 A A A1 A2 Ap
Copyright © 2011 EMC Corporation. All Rights Reserved. Classic Data Center 17
RAID Levels
Copyright © 2011 EMC Corporation. All Rights Reserved. Classic Data Center 18
Intelligent Storage System
• Is a RAID array highly optimized for I/O processing
• Have large amounts of cache for improving I/O performance
• Have operating environments that provide:
Intelligence for managing cache
Optimal management, allocation, and utilization of storage
resources
Copyright © 2011 EMC Corporation. All Rights Reserved. Classic Data Center 19
Components of an Intelligent Storage System
Cache
Network
Copyright © 2011 EMC Corporation. All Rights Reserved. Classic Data Center 20
Presenting Storage to Compute System
Cache
LUN 0
Network
Compute
LUN 1
LUN 1
Controller RAID Set
Copyright © 2011 EMC Corporation. All Rights Reserved. Classic Data Center 21
In an intelligent storage system, physical disks are logically grouped together to form a
set, called RAID set, RAID sets usually have large capacities because they combine the
total capacity of individual drives in the set. Logical Units are created from the RAID
sets by partitioning (seen as slices of RAID set) the available capacity into smaller units.
These units are then assigned to the compute system for their storage requirements.
• Logical units are spread across all the physical disks, which belong to that set. Each
logical unit created from the RAID set is assigned a unique ID called Logical Unit
Number (LUN). LUNs hide the organization and composition of RAID set from the
compute systems. The diagram on the slide shows a RAID set consisting of five disks
that have been sliced or partitioned into two LUNs: LUN 0 and LUN 1. These LUNs
are then assigned to compute system 1 and compute system 2 for their storage
requirements.
• It is also possible to control access of LUNs by a compute system. This is done with
the help of “LUN masking”. LUN masking is a process that provides data access
control by defining which LUNs a compute system can access. LUN masking function
is implemented on the storage processor/controller. This ensures that the volume
access by servers is controlled appropriately, preventing unauthorized or accidental
use in a shared environment.
Copyright © 2011 EMC Corporation. All Rights Reserved. Storage System Environment - 22
Module 2: Classic Data Center (CDC)
Copyright © 2011 EMC Corporation. All Rights Reserved. Classic Data Center 23
Compute to Compute Communication
• Typically uses Ethernet or TCP/IP protocol
LAN, MAN, and WAN
• Communication is enabled using various components:
Network Interface Card (NIC)
Has unique MAC address
Switches and routers
Switch provides scalability and interconnection between multiple
compute systems
Routers allow different networks to communicate with each other
Cables
Twisted pair, co-axial cable, optical fiber
Copyright © 2011 EMC Corporation. All Rights Reserved. Classic Data Center 24
Compute to Storage Communication
• Communication is enabled using various hardware components
(HBA, CNA, NIC, switch, router, gateway ,and cables) and
protocols
• Communication between compute and storage can be done
using channel or network technologies
Channel Technology Network Technology
Compute system and peripheral devices Compute system and peripheral devices are
are connected through channel connected over a network
Provides low protocol overhead due to High protocol overhead due to network
tight coupling connection
Supports transmission only over short Supports transmission over long distances
distances
Protocol examples: PCI, IDE/ATA, SCSI, Protocol examples: iSCSI( SCSI over IP),
etc. FCoE ( Fibre Channel over Ethernet), and
FC
Copyright © 2011 EMC Corporation. All Rights Reserved. Classic Data Center 25
Communication Protocols
• Peripheral Component Interconnect (PCI)
Provides interconnection between CPU and attached devices
Latest PCI Express bus provides throughput of 133 MB/sec
• Integrated Device Electronics/Advanced Technology Attachment
(IDE/ATA)
Popular protocol to connect to disk drives
Supports 16-bit parallel transmission
Serial version is called Serial ATA (SATA)
Both versions offer good performance at a relatively low cost
Copyright © 2011 EMC Corporation. All Rights Reserved. Classic Data Center 26
Communication Protocols (contd.)
• Small Computer System Interface (SCSI)
Preferred storage connectivity option for high-end
environments
Improved performance, scalability, and high cost when
compared to ATA
Serial version is called Serial Attached SCSI (SAS)
• Transmission Control Protocol/Internet Protocol (TCP/IP)
Traditionally used for compute to compute communication
Now used for compute to storage communication also
iSCSI (SCSI over IP) and FCoE (Fibre Channel over Ethernet) are
examples
Copyright © 2011 EMC Corporation. All Rights Reserved. Classic Data Center 27
Data Access by Compute
File level
Request Network
Block level
Network Request
File System
Storage
Storage Storage Storage
Copyright © 2011 EMC Corporation. All Rights Reserved. Classic Data Center 28
Direct Attached Storage (DAS)
DAS
Copyright © 2011 EMC Corporation. All Rights Reserved. Classic Data Center 29
Emergence of Storage Networking Technologies
• Just-in-time information for business users
• Flexible and resilient storage architecture
• DAS is inefficient to fulfill these requirements
• Storage networking technologies emerged as a solution
Fibre Channel SAN (FC SAN)
Network Attached Storage (NAS)
Internet Protocol SAN (IP SAN)
Fibre Channel over Ethernet (FCoE)
Object Based storage
Unified storage
Copyright © 2011 EMC Corporation. All Rights Reserved. Classic Data Center 30
What is FC SAN ?
• Dedicated high speed network of Servers Servers Servers
Benefits
cost
Copyright © 2011 EMC Corporation. All Rights Reserved. Classic Data Center 31
Components of FC SAN
• Node ports
• Cables
• Connectors
• Interconnecting Devices
• Storage Arrays
• SAN Management software
Copyright © 2011 EMC Corporation. All Rights Reserved. Classic Data Center 32
Fibre Channel Fabric
FC Fabric Servers
One or more interconnected FC switches
through which multiple SAN nodes can
communicate
Server Server
Copyright © 2011 EMC Corporation. All Rights Reserved. Classic Data Center 33
Port Types
N-Port
FC Switch
Compute FC Switch
F-Port
Copyright © 2011 EMC Corporation. All Rights Reserved. Classic Data Center 34
FC SAN Addressing
• Fibre Channel Address
Used to communicate between nodes within SAN
Similar in functionality to an IP address on NICs
24 bit address, dynamically assigned
Copyright © 2011 EMC Corporation. All Rights Reserved. Classic Data Center 35
Zoning
Switch Domain ID = 15
Server 1
Zone 3 Port 1
Server 2
Port 12
Port 9
WWN 50:06:04:82:E8:91:2B:9E
WWN 10:00:00:00:C9:20:DC:56
Zone 1
Copyright © 2011 EMC Corporation. All Rights Reserved. Classic Data Center 36
Module 2: Classic Data Center (CDC)
Copyright © 2011 EMC Corporation. All Rights Reserved. Classic Data Center 37
IP-SAN
IP-SAN
Copyright © 2011 EMC Corporation. All Rights Reserved. Classic Data Center 38
Block Storage Over IP – Protocol Options
Storage Array
• iSCSI (SCSI over IP) iSCSI Gateway
systems
• FCIP Storage Array
Fibre Channel-to-IP (b) FCIP Implementation
FCIP
bridge/tunnel (point-to- FCIP
gateway
gateway
point)
Fibre Channel end IP
points
Used in DR FC HBA FC Port
Storage Array Storage Array
Copyright © 2011 EMC Corporation. All Rights Reserved. Classic Data Center 39
iSCSI Topologies
• Native Native iSCSI Port
Storage Array
No FC components Servers
iSCSI Initiators
IP
connect directly to the
Array
iSCSI HBA
• Bridged Servers
iSCSI Gateway
Translates iSCSI/IP to
Storage Array
FC IP
iSCSI initiator
iSCSI HBA
configured with
Servers
bridge as target FC SAN
Bridge acts as virtual
FC initiator FC Port
FC HBA
Copyright © 2011 EMC Corporation. All Rights Reserved. Classic Data Center 40
Fibre Channel over IP (FCIP)
• IP-based storage networking technology
• Combines advantages of Fibre Channel and IP
• Creates virtual FC link that connects devices in a different fabric
• Distance extension solution
Used for data sharing over geographically dispersed SAN
FC SAN IP FC SAN
Host
Copyright © 2011 EMC Corporation. All Rights Reserved. Classic Data Center 41
Fibre Channel over Ethernet (FCoE)
• A protocol that encapsulates Fibre Channel frames for transport
over Enhanced Ethernet networks
• Enables the consolidation of SAN traffic and Ethernet traffic onto
a common 10 Gigabit Ethernet infrastructure
Consolidates compute to compute and compute to storage
communication over a single channel
Benefits
Copyright © 2011 EMC Corporation. All Rights Reserved. Classic Data Center 42
I/O Consolidation with FCoE
…………
Hosts
FCoE links
FCoE Switch
LAN
…………
Storage Arrays
Copyright © 2011 EMC Corporation. All Rights Reserved. Classic Data Center 43
Components of FCoE
• Converged Network Adapter(CNA)
Multi function adapter
Performs the data networking of NIC and storage networking of
HBA
• FCoE Switch
Contains Ethernet bridge and Fibre Channel Forwarder (FCF)
FCF encapsulates FC frames into FCoE frames and de-capsulates
FCoE frames to FC frames
• Converged Enhanced Ethernet (CEE)
Extensions to conventional Ethernet standard to eliminate its
lossy nature
Copyright © 2011 EMC Corporation. All Rights Reserved. Classic Data Center 44
File Sharing Technology Evolution
Networked File Sharing
Copyright © 2011 EMC Corporation. All Rights Reserved. Classic Data Center 45
What is Network Attached Storage(NAS)?
NAS
Application Print
Server Server NAS Device
Copyright © 2011 EMC Corporation. All Rights Reserved. Classic Data Center 46
Benefits of NAS
• Supports comprehensive access to information
• Provides improved efficiency
• Provides improved flexibility
• Provides centralized storage
• Simplifies management
• Enables scalability
• High availability – through native clustering
• Provides security integration to environment (user
authentication and authorization)
Copyright © 2011 EMC Corporation. All Rights Reserved. Classic Data Center 47
Components of NAS
UNIX
NFS Network Interface
NAS Head
NFS CIFS
IP
NAS Device OS
Windows
Storage Array
NAS
Copyright © 2011 EMC Corporation. All Rights Reserved. Classic Data Center 48
Module 2: Classic Data Center (CDC)
Copyright © 2011 EMC Corporation. All Rights Reserved. Classic Data Center 49
Object Based Storage
• Object Based Storage combines data with rich metadata to
create an “object”
• Object Based Storage stores data in a flat address space
There are no hierarchies or nested directories
• Each object is identified by an unique ID (Object ID)
Generated by a hashing function
Object
Object
Object Object
Copyright © 2011 EMC Corporation. All Rights Reserved. Classic Data Center 50
Unified Storage
• Provides Consolidated Management interface for NAS, SAN,
iSCSI, FCoE, and object based technologies
LAN/WAN
Unified Storage
Copyright © 2011 EMC Corporation. All Rights Reserved. Classic Data Center 51
Module 2: Classic Data Center (CDC)
Copyright © 2011 EMC Corporation. All Rights Reserved. Classic Data Center 52
Backup Components
• Backup client
Sends backup data to
backup server or storage
node
• Backup server
log
Manages backup ta
Ca
ta
a
tad Storage Array
operations and Backup Data Me
Ba
cku
maintains backup catalog pD
ata
Copyright © 2011 EMC Corporation. All Rights Reserved. Classic Data Center 53
Where does Deduplication Occur?
SAN
SAN
Copyright © 2011 EMC Corporation. All Rights Reserved. Classic Data Center 54
Deduplication : Methods
• Single Instance Storage (SIS)
Detects and removes redundant copies of identical files
After a file is stored in the SIS system, all other references to the
same file refer to the original copy
• Sub-file Deduplication
Identifies and filters repeated data segments stored in files
Within a single system and across multiple systems
• Compression
Reduces file size
Identifies and removes blank spaces and repeated data chunks
Can be performed at source(client) or target(storage device)
Copyright © 2011 EMC Corporation. All Rights Reserved. Classic Data Center 55
Module 2: Classic Data Center (CDC)
Copyright © 2011 EMC Corporation. All Rights Reserved. Classic Data Center 56
What is Replication?
• Process of creating an exact copy of data
• Drivers for replication
Alternate source for backup
Fast recovery
Decision support
Testing platform
Restart from replica
• Classification of Replication:
Local replication
Remote replication
REPLICATION
Copyright © 2011 EMC Corporation. All Rights Reserved. Classic Data Center 57
Local Replication
• Process of replicating data within the same array or the same
data center
• Compute based replication
Replication is performed by using CPU resources of the compute
system
Types: LVM based mirroring and File system Snapshot
• Storage array based replication
Replication is performed by using CPU resources of the storage
array
Types of Storage array based replication techniques:
Full volume mirroring
Pointer based full volume replication
Pointer based virtual replication
Copyright © 2011 EMC Corporation. All Rights Reserved. Classic Data Center 58
Compute Based Replication
• Logical Volume Manager based mirroring
Each logical partition in a logical volume is mapped to two physical
partitions on two different physical volumes
Write to a logical partition is written to the two physical partitions
• File System Snapshot
Pointer-based local replication uses Copy on the First Write (CoFW)
principle
Uses bit map and block map
Requires a fraction of the space used by the production FS
Copyright © 2011 EMC Corporation. All Rights Reserved. Classic Data Center 59
Module 2: Classic Data Center (CDC)
Copyright © 2011 EMC Corporation. All Rights Reserved. Classic Data Center 60
Overview of CDC Management Activities
• Key management activities in a CDC:
Monitoring and Alerting
Reporting
Availability Management
Capacity Management
Performance Management
Security Management
Copyright © 2011 EMC Corporation. All Rights Reserved. Classic Data Center 61
Monitoring
• Compute systems, storage, and networks are the key
components to be monitored
Key Parameters to be Description
Monitored
Accessibility Availability of a component to perform
a desired operation
Capacity Amount of resources available
For ex: free space available on a file
system or RAID group
Performance How efficiently different components
are performing
Security Mechanisms to track and prevent
unauthorized access
Copyright © 2011 EMC Corporation. All Rights Reserved. Classic Data Center 62
Capacity Management
• Ensures adequate availability of resources based on their service
level requirements
• Manages resource allocation
• Key activities
Trend and Capacity analysis
Storage provisioning
Examples
Compute: Compute configuration and file system/DB management
Storage: Device configuration and LUN Masking
SAN: Unused Ports and Zoning
Copyright © 2011 EMC Corporation. All Rights Reserved. Classic Data Center 63
Performance Management
• Configure/design for optimal operational efficiency
• Performance analysis
Identify bottlenecks
Fine tuning for performance enhancement
• Key activities:
Compute: Volume management, database/application layout
Storage Array: Choice of RAID type and layout of devices (LUNs)
and choice of front-end ports
SAN: Designing sufficient ISLs with adequate bandwidth
Copyright © 2011 EMC Corporation. All Rights Reserved. Classic Data Center 64
Security Management
• Prevents unauthorized activities or access
• Key activities:
Compute
Creation of user logins and user privileges
Storage Array
LUN masking prevents data corruption on the storage array by
restricting compute access to a defined set of logical devices
SAN
Configuration of zoning to restrict unauthorized HBAs
Copyright © 2011 EMC Corporation. All Rights Reserved. Classic Data Center 65
Managing Information in CDC – Challenges
• Exploding digital universe
Multifold increase of information growth
• Increasing dependency on information
The strategic use of information plays an important role in
determining the success of an organization
• Changing value of information
Information that is valuable today may become less important
tomorrow
Copyright © 2011 EMC Corporation. All Rights Reserved. Classic Data Center 66
Information Lifecycle Management (ILM)
ILM
A proactive strategy that enables an IT organization to effectively align the
business value of information with the most appropriate and cost-effective
infrastructure, from the time information is created, through its final
disposition
Protect
Copyright © 2011 EMC Corporation. All Rights Reserved. Classic Data Center 67