Infrastructure Building Blocks: Storage
Infrastructure Building Blocks: Storage
Lower energy consumption and cost- Faster data access compared to mechanical
effective for storing large amounts of data. disks (microseconds vs. milliseconds).
The physical size of hard disks has decreased Transition from reel tapes to cartridges like
while their capacity has increased DLT and LTO has allowed for storing vast
significantly. amounts of data efficiently.
The fundamental design of hard disks remains The most recent version of LTO, version 7
unchanged, with improvements in released in 2015, can hold up to 6 TB of data.
performance and efficiency.
Evolution and Advancements in Data Storage Systems
LTO tape cartridges are LTO tape cartridges Typical tape throughput Tape libraries, also To increase availability,
a popular choice with provide a cost-effective ranges from 100 to 150 known as tape silos or redundancy, and data
over 80% market share storage solution for MB/s, with tape drives tape robots, automate replication methods
and can store up to 6 large amounts of data, capable of even higher tape handling by like synchronous and
TB of uncompressed especially for archiving speeds. containing tape drives, asynchronous
data. purposes. slots for tape replication can be used
cartridges, and a with LTO tape
method for loading cartridges.
tapes.
Evolution and Advancements in Data Storage Systems
Provide advanced error recovery and Affects reliability and error correction
reporting functionalities. capabilities.
Evolution and Advancements in Data Storage Systems
NL-SAS Disks
Combine SAS interface with SATA
Evolution and Advancements in Data Storage Systems
SSDs have no moving parts, leading to Limited rewrite lifespan due to the nature of
increased durability and reliability. flash memory.
SSDs offer significantly faster data access SSDs with MLC architecture have longer
compared to mechanical disks. access times compared to SLC.
All-flash arrays using SSDs are preferred for Data loss risk in case of power failure if not
high-demanding OLTP systems due to high equipped with proper backup mechanisms.
performance.
Evolution and Advancements in Data Storage Systems
Tape storage is a cost- Tapes have a long life LTO tape cartridges, Typical tape throughput Tape libraries automate
effective option for expectancy and are with a market share of ranges from 100 to 150 tape handling,
archiving large suitable for offsite over 80%, can store up MB/s, with interface containing tape drives,
amounts of data. storage to protect data to 6 TB of data. speeds supporting even slots for tape
in case of disasters. higher speeds. cartridges, and a
method for loading
tapes.
Evolution and Advancements in Data Storage Systems
RAID 0 RAID 1
RAID 0, also known as striping, provides a RAID 1, known as mirroring, enhances data
way to increase performance by using redundancy by creating an exact copy of
multiple disks where data is split across data on two separate disks simultaneously.
them for faster read and write operations.
RAID 1 prioritizes data redundancy and
RAID 0 focuses on performance fault tolerance, ensuring data integrity even
improvement but lowers data availability as if one disk fails.
all data is lost if one disk fails.
RAID 1 is ideal for applications where data
RAID 0 is suitable for applications where protection is a priority.
performance is critical.
Evolution and Advancements in Data Storage Systems
Provides data redundancy as Mirrors data for redundancy Commonly used in database
data is written to both disks and stripes it for servers and critical
simultaneously. performance. applications.
RAID 10 RAID 5
Combines striping and mirroring for improved Utilizes striping with distributed parity to
performance and redundancy. balance performance and data protection.
Offers higher redundancy and fault tolerance Provides a good balance between
compared to RAID 5. performance and storage efficiency.
Requires more disk space due to mirroring. More storage-efficient compared to RAID 10.
RAID 6 provides double disk This RAID level can withstand The additional parity
failure protection by utilizing the failure of up to two disks information in RAID 6 increases
distributed double parity across simultaneously without data data protection but comes at
the disks. loss. the cost of slightly reduced
write performance compared to
In RAID 6, data is striped across RAID 6 offers a higher level of RAID 5.
multiple disks, and parity fault tolerance compared to
information is distributed across RAID 5, making it suitable for
all disks for redundancy. critical data storage
environments.
Evolution and Advancements in Data Storage Systems
Optimizes storage capacity by eliminating Leads to cost savings and improved storage
redundant data blocks and improving performance by reducing redundant data.
efficiency.
Evolution and Advancements in Data Storage Systems
Provide instant availability Allows for allocating more Commonly used in PCs
storage capacity to users than
Minimal additional disk space physically installed Used for local disk storage
usage compared to cloning
Optimizes storage usage
Evolution and Advancements in Data Storage Systems
Provides disk blocks to the computer for file Offers virtual disks to servers in the form of
storage. LUNs.
Commonly used for boot devices and caching LUNs are only accessible to the server with
in servers. that specific LUN mounted.
Evolution and Advancements in Data Storage Systems
Crucial components in HBAs ensure high- Vary depending on SANs with large disk Allows for seamless
Storage Area Networks speed data transfers requirements capacities are expansion
(SANs) between servers and commonly used
storage devices in SAN Options range from Accommodates
Facilitate the environments terabytes to petabytes Store vast amounts of growing storage
connection between data securely and requirements over time
servers and disk Accommodate diverse efficiently
controllers storage needs
Evolution and Advancements in Data Storage Systems
Operates at the disk Offers a shared SAN uses technologies NAS systems typically NAS has knowledge
block level, providing filesystem accessible like Fibre Channel or provide redundancy, about the files it stores,
exclusive access to disk by multiple servers, iSCSI for server-to-disk load balancing, and enabling optimized file
blocks for individual allowing for centralized controller connections. data replication handling and file-level
servers. file storage. services, freeing up services like snapshot
NAS uses protocols like operating systems from and clone technology.
SMB/CIFS or NFS over these tasks.
TCP/IP.
Evolution and Advancements in Data Storage Systems
Software-Defined Storage
(SDS)
Abstracts storage resources and
provides centralized management.
Allows for flexible storage
allocation and automated data
management.
Evolution and Advancements in Data Storage Systems
Caching
Snapshotting
Cloning
Redundancy and data Components like HBAs Multipathing involves Further redundancy can Storage replication
replication are essential and switches in a SAN using multiple paths be achieved by utilizing methods, such as
for increasing the can be redundantly between HBAs and SAN multiple storage synchronous and
availability of storage installed to enhance switches, enabling systems, sometimes in asynchronous
systems. availability. automatic failover in different locations. replication, play a
case of a failure. crucial role in ensuring
data availability and
protection in case of
disasters.
Evolution and Advancements in Data Storage Systems
Crucial for data Serve as a last resort to Backups are for data Timely backups are Acts as a time
protection and recovery restore data to a loss protection. recommended. machine.
in case of data loss, previous state.
corruption, or disasters. Archiving is for long- Data copies typically Allows organizations to
Essential for term data storage relevant for disaster retrieve lost data and
safeguarding compliance. recovery within a few maintain operational
organizational weeks of creation. continuity.
information.
Evolution and Advancements in Data Storage Systems
Disk performance is a High-end and low-end High-end disks with Understanding the Different types of
critical aspect often disks differ in rotation faster rotation speeds mechanics of a disk is operations, such as
overlooked in IT speed, seek times, and and head movement essential for optimizing random writes/reads
systems, impacting interface protocol, mechanics can produce storage performance, and sequential writes,
overall system affecting their ability to more operations per especially in terms of require specific load
performance read and write data second compared to read and write optimization strategies
significantly. efficiently. low-end disks. operations. for improved storage
efficiency.
Evolution and Advancements in Data Storage Systems
Disk Performance
Measuring Disk Importance of Impact of Higher Impact of Higher
and System
Performance IOPS IOPS IOPS
Efficiency
Disk performance is Disk performance is IOPS is a key metric to Higher IOPS indicate Higher IOPS indicate
crucial for overall measured in IOPS - assess the speed and faster data read and faster data read and
system efficiency. Input/Output Operations responsiveness of disk write operations. write operations.
Per Second. systems.
Evolution and Advancements in Data Storage Systems
Mechanical Hard Disks SSD Disks SATA Disks SAS Disks NL-SAS Disks
Lower IOPS due to Higher IOPS due to lack Lower IOPS compared Higher IOPS than SATA Combine SAS interface
slower rotation speeds of moving parts and to SAS and SSDs, disks with faster with SATA mechanics
and seek times faster data access. suitable for bulk rotational speeds. for bulk storage.
compared to SSDs. storage applications.
Can provide thousands Can deliver hundreds Provide moderate IOPS,
Typically offer around to tens of thousands of Offer around 50-100 to thousands of IOPS typically in the range of
75-100 IOPS for IOPS for random reads IOPS for random reads for random reads and 100-200 for random
random reads and and writes. and writes. writes. reads and writes.
writes.
Evolution and Advancements in Data Storage Systems
Improves performance Read-cache for web Optimizes storage by Creates a hierarchy of Manages data from
through data buffering servers. moving data to the storage media based creation to archiving or
for reads and writes. most suitable storage on cost, performance, deletion based on
Write-cache for medium. and availability needs. value and organization
databases. policies.
Evolution and Advancements in Data Storage Systems
Ensuring data Utilizing encryption Implementing role- Adhering to data Continuous monitoring
confidentiality, algorithms to secure based access controls protection regulations for unauthorized access
integrity, and data at rest and in and authentication and industry standards. and potential threats.
availability. transit. mechanisms.
Evolution and Advancements in Data Storage Systems
SAN Zoning is a method used to Disk Access Control involves setting Implementing SAN Zoning and Disk
partition a Storage Area Network (SAN) permissions and restrictions on who can Access Control is crucial for maintaining
into multiple zones to control access and access specific disks or disk resources a secure and efficient storage
improve security. within a SAN environment. environment in enterprise settings.
SAN Zoning helps in isolating different Disk Access Control ensures that only
parts of the SAN to prevent authorized users or systems can read
unauthorized access and ensure data from or write to specific disks,
integrity. enhancing data protection.