SlideShare a Scribd company logo
What to know about Amazon
Elastic Block Store (EBS)
About me
● 13+ years of professional experience in System and 9+ years in Cloud
Computing architecting and administration (jacek.biernat@lcloud.pl)
● AWS Certifications:
○ AWS Certified Solutions Architect from 2013 (Professional from 2016)
○ AWS Certified SysOps Administrator from 2014
● Founder and CEO at LCloud, ex. Linxsys
○ AWS Partner from 2012 (Advanced Partner from 2016) in Poland
○ We are after 200+ AWS projects
Storage service
Block File
Object
Storage service
Block File
Object
Amazon Elastic Block Store Amazon Elastic File System Amazon Simple Storage
Service
Amazon Glacier
Block storage offering
EC2 instance
store
AWS block
storage
Amazon EC2 instance store
Non-persistent data store
Data not replicated
No snapshot support
SSD or HDD
What is EBS?
Ec2 instance
!=
EBS volume
What is EBS?
Ec2 instance
- Create, attach volumes through an
API
- Block storage as a service over the
network
EBS volume - EBS encryption is supported
What is EBS?
- EBS is independent of Ec2
- Detach and attach between Ec2
- EBS and Ec2 must be in the
same AZ
What is EBS?
- EBS attach to one Ec2 at a time
- Many EBS can attach to one Ec2
- Separate boot volume
What is EBS?
Ec2 instance
EBS volume
What is EBS?
- SLA EBS is 99.999%
-
AFR (annual failure rate) is 0.1%
- 0.2%
What is EBS snapshot?
- SLA S3 is 99.999999999%
-
No specific AZ
- Backup of modified volume blocks
- Next snapshots are incremental
What can we do with a snapshot?
- Create AMI from snapshot
-
Create new size EBS from snapshot
What can we do with a snapshot?
What is an EBS-optimized instance?
~125 MB/s
Ec2
Internet
What is an EBS-optimized instance?
~125 MB/s
Ec2
Internet
~125 MB/s
EBS
- Default for c4, d2, m4, p2, x1 Ec2 instances
- Some 8xlarge Ec2 have 10 Gbps network bandwidth and don’t
Block storage offering
EC2 instance
store
AWS block EBS HDD-backed magnetic
storage volume
Block storage offering
EC2 instance
store
AWS block EBS HDD-backed magnetic
storage volume
EBS SSD-backed
gp2 io1
Block storage offering
EC2 instance
store
AWS block EBS HDD-backed magnetic st1
sc1
storage volume
EBS SSD-backed
gp2 io1
EBS volume types
Magnetic General Purpose Provisioned IOPS Throughput Optimized Cold HDD (sc1)
SSD (gp2) SSD (io1) HDD (st1)
1GB - 1TB 1GB - 16TB 4GB - 16TB 500GB - 16TB 500GB-16TB
Av. 100 IOPS 3 IOPS @ GB Max. 20,000 IOPS Max. 500 IOPS Max. 250 IOPS
Max. 10,000 IOPS
Av. 65 MB/s Max. 160 MB/s Max. 320 MB/s 40 MB/s @ TB 12 MB/s @ TB
Max. 500 MB/s Max. 192 MB/s
Burst: - Burst: 3,000 IOPS (1TB) Burst: - Burst: 250 MB/s @ TB Burst:
80MB/s @ TB
gp2 - burst performance
gp2- how long can I burst?
Max I/O credit is 5.4 million I/O credits, accumulating 3 IOPS per GB per second
Io1 - performance
st1 - throughput
Burst to 125-500MB/s
per TB,
Accumulating 40 MB per TB
per second,
sc1 - throughput
Burst to 80MB/s per TB,
Accumulating 12 MB per TB
per second,
EBS volume types
Magnetic - data is infrequently accessed
General Purpose SSD (gp2) - boot volumes, low-latency applications, bursty database, Development
and test environments
Provisioned IOPS SSD (io1) - critical applications and large databases with sustained IOPS
Throughput Optimized HDD (st1) - large-block, high-throughput sequential workloads (streaming),
Big Data, Data warehouses, Log processing
Cold HDD (sc1) - sequential throughput workloads, such as logging and backup
Choosing an EBS volume type
When to RAID?
- Storage requirement > 16TB
- Throughput requirement > 500 MB/s
- IOPS requirement > 20,000 @ 16K
Avoid RAID for redundancy
- EBS data is already replicated
- RAID1 halves available EBS bandwidth
- RAID5/6 loses 20% - 30% of usable I/O
Thank you for your
attention.
Ad

More Related Content

What's hot (20)

Microsoft Azure Media Services
Microsoft Azure Media ServicesMicrosoft Azure Media Services
Microsoft Azure Media Services
Pavel Revenkov
 
sinsai.infoの裏側(インフラ偏)
sinsai.infoの裏側(インフラ偏)sinsai.infoの裏側(インフラ偏)
sinsai.infoの裏側(インフラ偏)
Michael H. Oshita
 
WIndows Azure Virtual Machines - deep dive session
WIndows Azure Virtual Machines - deep dive sessionWIndows Azure Virtual Machines - deep dive session
WIndows Azure Virtual Machines - deep dive session
Microsoft
 
Redis overview for Software Architecture Forum
Redis overview for Software Architecture ForumRedis overview for Software Architecture Forum
Redis overview for Software Architecture Forum
Christopher Spring
 
Understanding and tuning WiredTiger, the new high performance database engine...
Understanding and tuning WiredTiger, the new high performance database engine...Understanding and tuning WiredTiger, the new high performance database engine...
Understanding and tuning WiredTiger, the new high performance database engine...
Ontico
 
MongoDB tuning on AWS
MongoDB tuning on AWSMongoDB tuning on AWS
MongoDB tuning on AWS
Ryuji Tamagawa
 
Webinar Back to Basics 3 - Introduzione ai Replica Set
Webinar Back to Basics 3 - Introduzione ai Replica SetWebinar Back to Basics 3 - Introduzione ai Replica Set
Webinar Back to Basics 3 - Introduzione ai Replica Set
MongoDB
 
A Brief Introduction to Redis
A Brief Introduction to RedisA Brief Introduction to Redis
A Brief Introduction to Redis
Charles Anderson
 
MongoDB London PHP
MongoDB London PHPMongoDB London PHP
MongoDB London PHP
Mike Dirolf
 
Introduction to Redis
Introduction to RedisIntroduction to Redis
Introduction to Redis
Maarten Smeets
 
Backup, Restore, and Disaster Recovery
Backup, Restore, and Disaster RecoveryBackup, Restore, and Disaster Recovery
Backup, Restore, and Disaster Recovery
MongoDB
 
Mongo db in 3 minutes BoilerMake
Mongo db in 3 minutes   BoilerMakeMongo db in 3 minutes   BoilerMake
Mongo db in 3 minutes BoilerMake
Valeri Karpov
 
Fusion-io and MySQL at Craigslist
Fusion-io and MySQL at CraigslistFusion-io and MySQL at Craigslist
Fusion-io and MySQL at Craigslist
Jeremy Zawodny
 
Azure ad multipleforest-pdf
Azure ad multipleforest-pdfAzure ad multipleforest-pdf
Azure ad multipleforest-pdf
Suman Singh
 
MySQL And Search At Craigslist
MySQL And Search At CraigslistMySQL And Search At Craigslist
MySQL And Search At Craigslist
Jeremy Zawodny
 
Cache is King!
Cache is King!Cache is King!
Cache is King!
David Engel
 
Caching solutions with Redis
Caching solutions   with RedisCaching solutions   with Redis
Caching solutions with Redis
George Platon
 
MongoDB
MongoDBMongoDB
MongoDB
Konstantin Chukhlomin
 
MongoFr : MongoDB as a log Collector
MongoFr : MongoDB as a log CollectorMongoFr : MongoDB as a log Collector
MongoFr : MongoDB as a log Collector
Pierre Baillet
 
Introduction to Redis
Introduction to RedisIntroduction to Redis
Introduction to Redis
Arnab Mitra
 
Microsoft Azure Media Services
Microsoft Azure Media ServicesMicrosoft Azure Media Services
Microsoft Azure Media Services
Pavel Revenkov
 
sinsai.infoの裏側(インフラ偏)
sinsai.infoの裏側(インフラ偏)sinsai.infoの裏側(インフラ偏)
sinsai.infoの裏側(インフラ偏)
Michael H. Oshita
 
WIndows Azure Virtual Machines - deep dive session
WIndows Azure Virtual Machines - deep dive sessionWIndows Azure Virtual Machines - deep dive session
WIndows Azure Virtual Machines - deep dive session
Microsoft
 
Redis overview for Software Architecture Forum
Redis overview for Software Architecture ForumRedis overview for Software Architecture Forum
Redis overview for Software Architecture Forum
Christopher Spring
 
Understanding and tuning WiredTiger, the new high performance database engine...
Understanding and tuning WiredTiger, the new high performance database engine...Understanding and tuning WiredTiger, the new high performance database engine...
Understanding and tuning WiredTiger, the new high performance database engine...
Ontico
 
Webinar Back to Basics 3 - Introduzione ai Replica Set
Webinar Back to Basics 3 - Introduzione ai Replica SetWebinar Back to Basics 3 - Introduzione ai Replica Set
Webinar Back to Basics 3 - Introduzione ai Replica Set
MongoDB
 
A Brief Introduction to Redis
A Brief Introduction to RedisA Brief Introduction to Redis
A Brief Introduction to Redis
Charles Anderson
 
MongoDB London PHP
MongoDB London PHPMongoDB London PHP
MongoDB London PHP
Mike Dirolf
 
Backup, Restore, and Disaster Recovery
Backup, Restore, and Disaster RecoveryBackup, Restore, and Disaster Recovery
Backup, Restore, and Disaster Recovery
MongoDB
 
Mongo db in 3 minutes BoilerMake
Mongo db in 3 minutes   BoilerMakeMongo db in 3 minutes   BoilerMake
Mongo db in 3 minutes BoilerMake
Valeri Karpov
 
Fusion-io and MySQL at Craigslist
Fusion-io and MySQL at CraigslistFusion-io and MySQL at Craigslist
Fusion-io and MySQL at Craigslist
Jeremy Zawodny
 
Azure ad multipleforest-pdf
Azure ad multipleforest-pdfAzure ad multipleforest-pdf
Azure ad multipleforest-pdf
Suman Singh
 
MySQL And Search At Craigslist
MySQL And Search At CraigslistMySQL And Search At Craigslist
MySQL And Search At Craigslist
Jeremy Zawodny
 
Caching solutions with Redis
Caching solutions   with RedisCaching solutions   with Redis
Caching solutions with Redis
George Platon
 
MongoFr : MongoDB as a log Collector
MongoFr : MongoDB as a log CollectorMongoFr : MongoDB as a log Collector
MongoFr : MongoDB as a log Collector
Pierre Baillet
 
Introduction to Redis
Introduction to RedisIntroduction to Redis
Introduction to Redis
Arnab Mitra
 

Similar to What to know about Amazon Elastic Block Store (EBS) (10)

Aws Elastic Block Storage
Aws Elastic Block StorageAws Elastic Block Storage
Aws Elastic Block Storage
Dhananjay Aloorkar
 
AWS Summit Seoul 2015 - EBS 성능 향상 및 EC2 비용 최적화 기법
AWS Summit Seoul 2015 - EBS 성능 향상 및 EC2 비용 최적화 기법AWS Summit Seoul 2015 - EBS 성능 향상 및 EC2 비용 최적화 기법
AWS Summit Seoul 2015 - EBS 성능 향상 및 EC2 비용 최적화 기법
Amazon Web Services Korea
 
AWS vs Azure vs Google Cloud Storage Deep Dive
AWS vs Azure vs Google Cloud Storage Deep DiveAWS vs Azure vs Google Cloud Storage Deep Dive
AWS vs Azure vs Google Cloud Storage Deep Dive
RightScale
 
Tech Talks On Site- Edição de Agosto- Armazenamento em AWS
Tech Talks On Site- Edição de Agosto- Armazenamento em AWSTech Talks On Site- Edição de Agosto- Armazenamento em AWS
Tech Talks On Site- Edição de Agosto- Armazenamento em AWS
Amazon Web Services LATAM
 
view the deck as powerpoint
view the deck as powerpointview the deck as powerpoint
view the deck as powerpoint
webhostingguy
 
view the deck as powerpoint
view the deck as powerpointview the deck as powerpoint
view the deck as powerpoint
webhostingguy
 
Amazon Web Services (AWS) Elastic Compute Cloud (EC2)
Amazon Web Services (AWS) Elastic Compute Cloud (EC2)Amazon Web Services (AWS) Elastic Compute Cloud (EC2)
Amazon Web Services (AWS) Elastic Compute Cloud (EC2)
Kaivalya Shah
 
High Performance MongoDB on Storage-Optimized AWS EC2
High Performance MongoDB on Storage-Optimized AWS EC2High Performance MongoDB on Storage-Optimized AWS EC2
High Performance MongoDB on Storage-Optimized AWS EC2
MongoDB
 
Using Windows Storage Spaces and iSCSI on Amazon EBS
Using Windows Storage Spaces and iSCSI on Amazon EBSUsing Windows Storage Spaces and iSCSI on Amazon EBS
Using Windows Storage Spaces and iSCSI on Amazon EBS
Laroy Shtotland
 
Armazenamento em Amazon Web Service para Setor Publico
 Armazenamento em Amazon Web Service para Setor Publico  Armazenamento em Amazon Web Service para Setor Publico
Armazenamento em Amazon Web Service para Setor Publico
Amazon Web Services LATAM
 
AWS Summit Seoul 2015 - EBS 성능 향상 및 EC2 비용 최적화 기법
AWS Summit Seoul 2015 - EBS 성능 향상 및 EC2 비용 최적화 기법AWS Summit Seoul 2015 - EBS 성능 향상 및 EC2 비용 최적화 기법
AWS Summit Seoul 2015 - EBS 성능 향상 및 EC2 비용 최적화 기법
Amazon Web Services Korea
 
AWS vs Azure vs Google Cloud Storage Deep Dive
AWS vs Azure vs Google Cloud Storage Deep DiveAWS vs Azure vs Google Cloud Storage Deep Dive
AWS vs Azure vs Google Cloud Storage Deep Dive
RightScale
 
Tech Talks On Site- Edição de Agosto- Armazenamento em AWS
Tech Talks On Site- Edição de Agosto- Armazenamento em AWSTech Talks On Site- Edição de Agosto- Armazenamento em AWS
Tech Talks On Site- Edição de Agosto- Armazenamento em AWS
Amazon Web Services LATAM
 
view the deck as powerpoint
view the deck as powerpointview the deck as powerpoint
view the deck as powerpoint
webhostingguy
 
view the deck as powerpoint
view the deck as powerpointview the deck as powerpoint
view the deck as powerpoint
webhostingguy
 
Amazon Web Services (AWS) Elastic Compute Cloud (EC2)
Amazon Web Services (AWS) Elastic Compute Cloud (EC2)Amazon Web Services (AWS) Elastic Compute Cloud (EC2)
Amazon Web Services (AWS) Elastic Compute Cloud (EC2)
Kaivalya Shah
 
High Performance MongoDB on Storage-Optimized AWS EC2
High Performance MongoDB on Storage-Optimized AWS EC2High Performance MongoDB on Storage-Optimized AWS EC2
High Performance MongoDB on Storage-Optimized AWS EC2
MongoDB
 
Using Windows Storage Spaces and iSCSI on Amazon EBS
Using Windows Storage Spaces and iSCSI on Amazon EBSUsing Windows Storage Spaces and iSCSI on Amazon EBS
Using Windows Storage Spaces and iSCSI on Amazon EBS
Laroy Shtotland
 
Armazenamento em Amazon Web Service para Setor Publico
 Armazenamento em Amazon Web Service para Setor Publico  Armazenamento em Amazon Web Service para Setor Publico
Armazenamento em Amazon Web Service para Setor Publico
Amazon Web Services LATAM
 
Ad

More from LCloud (15)

Zero Trust - Unlock the highest level of Security
Zero Trust - Unlock the highest level of SecurityZero Trust - Unlock the highest level of Security
Zero Trust - Unlock the highest level of Security
LCloud
 
From vision to real value | Generative AI (GenAI)
From vision to real value | Generative AI (GenAI)From vision to real value | Generative AI (GenAI)
From vision to real value | Generative AI (GenAI)
LCloud
 
Well architected tool - Serverless and Machine Learning Lens
Well architected tool - Serverless and Machine Learning LensWell architected tool - Serverless and Machine Learning Lens
Well architected tool - Serverless and Machine Learning Lens
LCloud
 
3 ways to efficiently migrate your big data to AWS cloud | LCloud
3 ways to efficiently migrate your big data to AWS cloud | LCloud3 ways to efficiently migrate your big data to AWS cloud | LCloud
3 ways to efficiently migrate your big data to AWS cloud | LCloud
LCloud
 
On a trail with Amazon Detective | LCloud
On a trail with Amazon Detective | LCloudOn a trail with Amazon Detective | LCloud
On a trail with Amazon Detective | LCloud
LCloud
 
"Don’t Run with Scissors: Serverless Security Survival Guide" | Hillel Solow,...
"Don’t Run with Scissors: Serverless Security Survival Guide" | Hillel Solow,..."Don’t Run with Scissors: Serverless Security Survival Guide" | Hillel Solow,...
"Don’t Run with Scissors: Serverless Security Survival Guide" | Hillel Solow,...
LCloud
 
"Building a Production-Grade Serverless Deployment" - Eoin Shanaghy, CTO, fo...
"Building a Production-Grade Serverless Deployment"  - Eoin Shanaghy, CTO, fo..."Building a Production-Grade Serverless Deployment"  - Eoin Shanaghy, CTO, fo...
"Building a Production-Grade Serverless Deployment" - Eoin Shanaghy, CTO, fo...
LCloud
 
Amazon Aurora MySQL - tips & tricks in configuration | LCloud
Amazon Aurora MySQL - tips & tricks in configuration | LCloudAmazon Aurora MySQL - tips & tricks in configuration | LCloud
Amazon Aurora MySQL - tips & tricks in configuration | LCloud
LCloud
 
AWS Landing Zone Essentials PL | LCloud
AWS Landing Zone Essentials PL | LCloudAWS Landing Zone Essentials PL | LCloud
AWS Landing Zone Essentials PL | LCloud
LCloud
 
Security management using devops | LCloud
Security management using devops | LCloudSecurity management using devops | LCloud
Security management using devops | LCloud
LCloud
 
Amazon Neptune - visually more options
Amazon Neptune - visually more optionsAmazon Neptune - visually more options
Amazon Neptune - visually more options
LCloud
 
How to use AWS practices to provide the enterprise architecture in the cloud
How to use AWS practices to provide the enterprise architecture in the cloudHow to use AWS practices to provide the enterprise architecture in the cloud
How to use AWS practices to provide the enterprise architecture in the cloud
LCloud
 
Overview of Amazon Web Services - kwiecień 2017
Overview of Amazon Web Services - kwiecień 2017Overview of Amazon Web Services - kwiecień 2017
Overview of Amazon Web Services - kwiecień 2017
LCloud
 
Good practices to design and implement IT architecture based on AWS
Good practices to design and implement IT architecture based on AWSGood practices to design and implement IT architecture based on AWS
Good practices to design and implement IT architecture based on AWS
LCloud
 
Lcloud na AWS re: Invent 2016 w Las Vegas
Lcloud na AWS re: Invent 2016 w Las Vegas Lcloud na AWS re: Invent 2016 w Las Vegas
Lcloud na AWS re: Invent 2016 w Las Vegas
LCloud
 
Zero Trust - Unlock the highest level of Security
Zero Trust - Unlock the highest level of SecurityZero Trust - Unlock the highest level of Security
Zero Trust - Unlock the highest level of Security
LCloud
 
From vision to real value | Generative AI (GenAI)
From vision to real value | Generative AI (GenAI)From vision to real value | Generative AI (GenAI)
From vision to real value | Generative AI (GenAI)
LCloud
 
Well architected tool - Serverless and Machine Learning Lens
Well architected tool - Serverless and Machine Learning LensWell architected tool - Serverless and Machine Learning Lens
Well architected tool - Serverless and Machine Learning Lens
LCloud
 
3 ways to efficiently migrate your big data to AWS cloud | LCloud
3 ways to efficiently migrate your big data to AWS cloud | LCloud3 ways to efficiently migrate your big data to AWS cloud | LCloud
3 ways to efficiently migrate your big data to AWS cloud | LCloud
LCloud
 
On a trail with Amazon Detective | LCloud
On a trail with Amazon Detective | LCloudOn a trail with Amazon Detective | LCloud
On a trail with Amazon Detective | LCloud
LCloud
 
"Don’t Run with Scissors: Serverless Security Survival Guide" | Hillel Solow,...
"Don’t Run with Scissors: Serverless Security Survival Guide" | Hillel Solow,..."Don’t Run with Scissors: Serverless Security Survival Guide" | Hillel Solow,...
"Don’t Run with Scissors: Serverless Security Survival Guide" | Hillel Solow,...
LCloud
 
"Building a Production-Grade Serverless Deployment" - Eoin Shanaghy, CTO, fo...
"Building a Production-Grade Serverless Deployment"  - Eoin Shanaghy, CTO, fo..."Building a Production-Grade Serverless Deployment"  - Eoin Shanaghy, CTO, fo...
"Building a Production-Grade Serverless Deployment" - Eoin Shanaghy, CTO, fo...
LCloud
 
Amazon Aurora MySQL - tips & tricks in configuration | LCloud
Amazon Aurora MySQL - tips & tricks in configuration | LCloudAmazon Aurora MySQL - tips & tricks in configuration | LCloud
Amazon Aurora MySQL - tips & tricks in configuration | LCloud
LCloud
 
AWS Landing Zone Essentials PL | LCloud
AWS Landing Zone Essentials PL | LCloudAWS Landing Zone Essentials PL | LCloud
AWS Landing Zone Essentials PL | LCloud
LCloud
 
Security management using devops | LCloud
Security management using devops | LCloudSecurity management using devops | LCloud
Security management using devops | LCloud
LCloud
 
Amazon Neptune - visually more options
Amazon Neptune - visually more optionsAmazon Neptune - visually more options
Amazon Neptune - visually more options
LCloud
 
How to use AWS practices to provide the enterprise architecture in the cloud
How to use AWS practices to provide the enterprise architecture in the cloudHow to use AWS practices to provide the enterprise architecture in the cloud
How to use AWS practices to provide the enterprise architecture in the cloud
LCloud
 
Overview of Amazon Web Services - kwiecień 2017
Overview of Amazon Web Services - kwiecień 2017Overview of Amazon Web Services - kwiecień 2017
Overview of Amazon Web Services - kwiecień 2017
LCloud
 
Good practices to design and implement IT architecture based on AWS
Good practices to design and implement IT architecture based on AWSGood practices to design and implement IT architecture based on AWS
Good practices to design and implement IT architecture based on AWS
LCloud
 
Lcloud na AWS re: Invent 2016 w Las Vegas
Lcloud na AWS re: Invent 2016 w Las Vegas Lcloud na AWS re: Invent 2016 w Las Vegas
Lcloud na AWS re: Invent 2016 w Las Vegas
LCloud
 
Ad

Recently uploaded (20)

Enhancing ICU Intelligence: How Our Functional Testing Enabled a Healthcare I...
Enhancing ICU Intelligence: How Our Functional Testing Enabled a Healthcare I...Enhancing ICU Intelligence: How Our Functional Testing Enabled a Healthcare I...
Enhancing ICU Intelligence: How Our Functional Testing Enabled a Healthcare I...
Impelsys Inc.
 
What is Model Context Protocol(MCP) - The new technology for communication bw...
What is Model Context Protocol(MCP) - The new technology for communication bw...What is Model Context Protocol(MCP) - The new technology for communication bw...
What is Model Context Protocol(MCP) - The new technology for communication bw...
Vishnu Singh Chundawat
 
Generative Artificial Intelligence (GenAI) in Business
Generative Artificial Intelligence (GenAI) in BusinessGenerative Artificial Intelligence (GenAI) in Business
Generative Artificial Intelligence (GenAI) in Business
Dr. Tathagat Varma
 
UiPath Community Berlin: Orchestrator API, Swagger, and Test Manager API
UiPath Community Berlin: Orchestrator API, Swagger, and Test Manager APIUiPath Community Berlin: Orchestrator API, Swagger, and Test Manager API
UiPath Community Berlin: Orchestrator API, Swagger, and Test Manager API
UiPathCommunity
 
2025-05-Q4-2024-Investor-Presentation.pptx
2025-05-Q4-2024-Investor-Presentation.pptx2025-05-Q4-2024-Investor-Presentation.pptx
2025-05-Q4-2024-Investor-Presentation.pptx
Samuele Fogagnolo
 
Designing Low-Latency Systems with Rust and ScyllaDB: An Architectural Deep Dive
Designing Low-Latency Systems with Rust and ScyllaDB: An Architectural Deep DiveDesigning Low-Latency Systems with Rust and ScyllaDB: An Architectural Deep Dive
Designing Low-Latency Systems with Rust and ScyllaDB: An Architectural Deep Dive
ScyllaDB
 
Noah Loul Shares 5 Steps to Implement AI Agents for Maximum Business Efficien...
Noah Loul Shares 5 Steps to Implement AI Agents for Maximum Business Efficien...Noah Loul Shares 5 Steps to Implement AI Agents for Maximum Business Efficien...
Noah Loul Shares 5 Steps to Implement AI Agents for Maximum Business Efficien...
Noah Loul
 
AI and Data Privacy in 2025: Global Trends
AI and Data Privacy in 2025: Global TrendsAI and Data Privacy in 2025: Global Trends
AI and Data Privacy in 2025: Global Trends
InData Labs
 
HCL Nomad Web – Best Practices und Verwaltung von Multiuser-Umgebungen
HCL Nomad Web – Best Practices und Verwaltung von Multiuser-UmgebungenHCL Nomad Web – Best Practices und Verwaltung von Multiuser-Umgebungen
HCL Nomad Web – Best Practices und Verwaltung von Multiuser-Umgebungen
panagenda
 
HCL Nomad Web – Best Practices and Managing Multiuser Environments
HCL Nomad Web – Best Practices and Managing Multiuser EnvironmentsHCL Nomad Web – Best Practices and Managing Multiuser Environments
HCL Nomad Web – Best Practices and Managing Multiuser Environments
panagenda
 
Into The Box Conference Keynote Day 1 (ITB2025)
Into The Box Conference Keynote Day 1 (ITB2025)Into The Box Conference Keynote Day 1 (ITB2025)
Into The Box Conference Keynote Day 1 (ITB2025)
Ortus Solutions, Corp
 
Greenhouse_Monitoring_Presentation.pptx.
Greenhouse_Monitoring_Presentation.pptx.Greenhouse_Monitoring_Presentation.pptx.
Greenhouse_Monitoring_Presentation.pptx.
hpbmnnxrvb
 
Andrew Marnell: Transforming Business Strategy Through Data-Driven Insights
Andrew Marnell: Transforming Business Strategy Through Data-Driven InsightsAndrew Marnell: Transforming Business Strategy Through Data-Driven Insights
Andrew Marnell: Transforming Business Strategy Through Data-Driven Insights
Andrew Marnell
 
Build Your Own Copilot & Agents For Devs
Build Your Own Copilot & Agents For DevsBuild Your Own Copilot & Agents For Devs
Build Your Own Copilot & Agents For Devs
Brian McKeiver
 
Transcript: #StandardsGoals for 2025: Standards & certification roundup - Tec...
Transcript: #StandardsGoals for 2025: Standards & certification roundup - Tec...Transcript: #StandardsGoals for 2025: Standards & certification roundup - Tec...
Transcript: #StandardsGoals for 2025: Standards & certification roundup - Tec...
BookNet Canada
 
Quantum Computing Quick Research Guide by Arthur Morgan
Quantum Computing Quick Research Guide by Arthur MorganQuantum Computing Quick Research Guide by Arthur Morgan
Quantum Computing Quick Research Guide by Arthur Morgan
Arthur Morgan
 
Semantic Cultivators : The Critical Future Role to Enable AI
Semantic Cultivators : The Critical Future Role to Enable AISemantic Cultivators : The Critical Future Role to Enable AI
Semantic Cultivators : The Critical Future Role to Enable AI
artmondano
 
Cyber Awareness overview for 2025 month of security
Cyber Awareness overview for 2025 month of securityCyber Awareness overview for 2025 month of security
Cyber Awareness overview for 2025 month of security
riccardosl1
 
IEDM 2024 Tutorial2_Advances in CMOS Technologies and Future Directions for C...
IEDM 2024 Tutorial2_Advances in CMOS Technologies and Future Directions for C...IEDM 2024 Tutorial2_Advances in CMOS Technologies and Future Directions for C...
IEDM 2024 Tutorial2_Advances in CMOS Technologies and Future Directions for C...
organizerofv
 
Splunk Security Update | Public Sector Summit Germany 2025
Splunk Security Update | Public Sector Summit Germany 2025Splunk Security Update | Public Sector Summit Germany 2025
Splunk Security Update | Public Sector Summit Germany 2025
Splunk
 
Enhancing ICU Intelligence: How Our Functional Testing Enabled a Healthcare I...
Enhancing ICU Intelligence: How Our Functional Testing Enabled a Healthcare I...Enhancing ICU Intelligence: How Our Functional Testing Enabled a Healthcare I...
Enhancing ICU Intelligence: How Our Functional Testing Enabled a Healthcare I...
Impelsys Inc.
 
What is Model Context Protocol(MCP) - The new technology for communication bw...
What is Model Context Protocol(MCP) - The new technology for communication bw...What is Model Context Protocol(MCP) - The new technology for communication bw...
What is Model Context Protocol(MCP) - The new technology for communication bw...
Vishnu Singh Chundawat
 
Generative Artificial Intelligence (GenAI) in Business
Generative Artificial Intelligence (GenAI) in BusinessGenerative Artificial Intelligence (GenAI) in Business
Generative Artificial Intelligence (GenAI) in Business
Dr. Tathagat Varma
 
UiPath Community Berlin: Orchestrator API, Swagger, and Test Manager API
UiPath Community Berlin: Orchestrator API, Swagger, and Test Manager APIUiPath Community Berlin: Orchestrator API, Swagger, and Test Manager API
UiPath Community Berlin: Orchestrator API, Swagger, and Test Manager API
UiPathCommunity
 
2025-05-Q4-2024-Investor-Presentation.pptx
2025-05-Q4-2024-Investor-Presentation.pptx2025-05-Q4-2024-Investor-Presentation.pptx
2025-05-Q4-2024-Investor-Presentation.pptx
Samuele Fogagnolo
 
Designing Low-Latency Systems with Rust and ScyllaDB: An Architectural Deep Dive
Designing Low-Latency Systems with Rust and ScyllaDB: An Architectural Deep DiveDesigning Low-Latency Systems with Rust and ScyllaDB: An Architectural Deep Dive
Designing Low-Latency Systems with Rust and ScyllaDB: An Architectural Deep Dive
ScyllaDB
 
Noah Loul Shares 5 Steps to Implement AI Agents for Maximum Business Efficien...
Noah Loul Shares 5 Steps to Implement AI Agents for Maximum Business Efficien...Noah Loul Shares 5 Steps to Implement AI Agents for Maximum Business Efficien...
Noah Loul Shares 5 Steps to Implement AI Agents for Maximum Business Efficien...
Noah Loul
 
AI and Data Privacy in 2025: Global Trends
AI and Data Privacy in 2025: Global TrendsAI and Data Privacy in 2025: Global Trends
AI and Data Privacy in 2025: Global Trends
InData Labs
 
HCL Nomad Web – Best Practices und Verwaltung von Multiuser-Umgebungen
HCL Nomad Web – Best Practices und Verwaltung von Multiuser-UmgebungenHCL Nomad Web – Best Practices und Verwaltung von Multiuser-Umgebungen
HCL Nomad Web – Best Practices und Verwaltung von Multiuser-Umgebungen
panagenda
 
HCL Nomad Web – Best Practices and Managing Multiuser Environments
HCL Nomad Web – Best Practices and Managing Multiuser EnvironmentsHCL Nomad Web – Best Practices and Managing Multiuser Environments
HCL Nomad Web – Best Practices and Managing Multiuser Environments
panagenda
 
Into The Box Conference Keynote Day 1 (ITB2025)
Into The Box Conference Keynote Day 1 (ITB2025)Into The Box Conference Keynote Day 1 (ITB2025)
Into The Box Conference Keynote Day 1 (ITB2025)
Ortus Solutions, Corp
 
Greenhouse_Monitoring_Presentation.pptx.
Greenhouse_Monitoring_Presentation.pptx.Greenhouse_Monitoring_Presentation.pptx.
Greenhouse_Monitoring_Presentation.pptx.
hpbmnnxrvb
 
Andrew Marnell: Transforming Business Strategy Through Data-Driven Insights
Andrew Marnell: Transforming Business Strategy Through Data-Driven InsightsAndrew Marnell: Transforming Business Strategy Through Data-Driven Insights
Andrew Marnell: Transforming Business Strategy Through Data-Driven Insights
Andrew Marnell
 
Build Your Own Copilot & Agents For Devs
Build Your Own Copilot & Agents For DevsBuild Your Own Copilot & Agents For Devs
Build Your Own Copilot & Agents For Devs
Brian McKeiver
 
Transcript: #StandardsGoals for 2025: Standards & certification roundup - Tec...
Transcript: #StandardsGoals for 2025: Standards & certification roundup - Tec...Transcript: #StandardsGoals for 2025: Standards & certification roundup - Tec...
Transcript: #StandardsGoals for 2025: Standards & certification roundup - Tec...
BookNet Canada
 
Quantum Computing Quick Research Guide by Arthur Morgan
Quantum Computing Quick Research Guide by Arthur MorganQuantum Computing Quick Research Guide by Arthur Morgan
Quantum Computing Quick Research Guide by Arthur Morgan
Arthur Morgan
 
Semantic Cultivators : The Critical Future Role to Enable AI
Semantic Cultivators : The Critical Future Role to Enable AISemantic Cultivators : The Critical Future Role to Enable AI
Semantic Cultivators : The Critical Future Role to Enable AI
artmondano
 
Cyber Awareness overview for 2025 month of security
Cyber Awareness overview for 2025 month of securityCyber Awareness overview for 2025 month of security
Cyber Awareness overview for 2025 month of security
riccardosl1
 
IEDM 2024 Tutorial2_Advances in CMOS Technologies and Future Directions for C...
IEDM 2024 Tutorial2_Advances in CMOS Technologies and Future Directions for C...IEDM 2024 Tutorial2_Advances in CMOS Technologies and Future Directions for C...
IEDM 2024 Tutorial2_Advances in CMOS Technologies and Future Directions for C...
organizerofv
 
Splunk Security Update | Public Sector Summit Germany 2025
Splunk Security Update | Public Sector Summit Germany 2025Splunk Security Update | Public Sector Summit Germany 2025
Splunk Security Update | Public Sector Summit Germany 2025
Splunk
 

What to know about Amazon Elastic Block Store (EBS)

  • 1. What to know about Amazon Elastic Block Store (EBS)
  • 2. About me ● 13+ years of professional experience in System and 9+ years in Cloud Computing architecting and administration ([email protected]) ● AWS Certifications: ○ AWS Certified Solutions Architect from 2013 (Professional from 2016) ○ AWS Certified SysOps Administrator from 2014 ● Founder and CEO at LCloud, ex. Linxsys ○ AWS Partner from 2012 (Advanced Partner from 2016) in Poland ○ We are after 200+ AWS projects
  • 4. Storage service Block File Object Amazon Elastic Block Store Amazon Elastic File System Amazon Simple Storage Service Amazon Glacier
  • 5. Block storage offering EC2 instance store AWS block storage
  • 6. Amazon EC2 instance store Non-persistent data store Data not replicated No snapshot support SSD or HDD
  • 7. What is EBS? Ec2 instance != EBS volume
  • 8. What is EBS? Ec2 instance - Create, attach volumes through an API - Block storage as a service over the network EBS volume - EBS encryption is supported
  • 9. What is EBS? - EBS is independent of Ec2 - Detach and attach between Ec2 - EBS and Ec2 must be in the same AZ
  • 10. What is EBS? - EBS attach to one Ec2 at a time - Many EBS can attach to one Ec2 - Separate boot volume
  • 11. What is EBS? Ec2 instance EBS volume
  • 12. What is EBS? - SLA EBS is 99.999% - AFR (annual failure rate) is 0.1% - 0.2%
  • 13. What is EBS snapshot? - SLA S3 is 99.999999999% - No specific AZ - Backup of modified volume blocks - Next snapshots are incremental
  • 14. What can we do with a snapshot? - Create AMI from snapshot - Create new size EBS from snapshot
  • 15. What can we do with a snapshot?
  • 16. What is an EBS-optimized instance? ~125 MB/s Ec2 Internet
  • 17. What is an EBS-optimized instance? ~125 MB/s Ec2 Internet ~125 MB/s EBS - Default for c4, d2, m4, p2, x1 Ec2 instances - Some 8xlarge Ec2 have 10 Gbps network bandwidth and don’t
  • 18. Block storage offering EC2 instance store AWS block EBS HDD-backed magnetic storage volume
  • 19. Block storage offering EC2 instance store AWS block EBS HDD-backed magnetic storage volume EBS SSD-backed gp2 io1
  • 20. Block storage offering EC2 instance store AWS block EBS HDD-backed magnetic st1 sc1 storage volume EBS SSD-backed gp2 io1
  • 21. EBS volume types Magnetic General Purpose Provisioned IOPS Throughput Optimized Cold HDD (sc1) SSD (gp2) SSD (io1) HDD (st1) 1GB - 1TB 1GB - 16TB 4GB - 16TB 500GB - 16TB 500GB-16TB Av. 100 IOPS 3 IOPS @ GB Max. 20,000 IOPS Max. 500 IOPS Max. 250 IOPS Max. 10,000 IOPS Av. 65 MB/s Max. 160 MB/s Max. 320 MB/s 40 MB/s @ TB 12 MB/s @ TB Max. 500 MB/s Max. 192 MB/s Burst: - Burst: 3,000 IOPS (1TB) Burst: - Burst: 250 MB/s @ TB Burst: 80MB/s @ TB
  • 22. gp2 - burst performance
  • 23. gp2- how long can I burst? Max I/O credit is 5.4 million I/O credits, accumulating 3 IOPS per GB per second
  • 25. st1 - throughput Burst to 125-500MB/s per TB, Accumulating 40 MB per TB per second,
  • 26. sc1 - throughput Burst to 80MB/s per TB, Accumulating 12 MB per TB per second,
  • 27. EBS volume types Magnetic - data is infrequently accessed General Purpose SSD (gp2) - boot volumes, low-latency applications, bursty database, Development and test environments Provisioned IOPS SSD (io1) - critical applications and large databases with sustained IOPS Throughput Optimized HDD (st1) - large-block, high-throughput sequential workloads (streaming), Big Data, Data warehouses, Log processing Cold HDD (sc1) - sequential throughput workloads, such as logging and backup
  • 28. Choosing an EBS volume type
  • 29. When to RAID? - Storage requirement > 16TB - Throughput requirement > 500 MB/s - IOPS requirement > 20,000 @ 16K
  • 30. Avoid RAID for redundancy - EBS data is already replicated - RAID1 halves available EBS bandwidth - RAID5/6 loses 20% - 30% of usable I/O
  • 31. Thank you for your attention.

Editor's Notes

  • #4: Everything from what makes up the service all the characteristics of it performance, best practices around reliability, security and performance durable, block-level storage device
  • #5: Everything from what makes up the service all the characteristics of it performance, best practices around reliability, security and performance durable, block-level storage device
  • #7: temporary block-level storage for your instance. This storage is located on disks that are physically attached to the host computer. Instance store is ideal for temporary storage of information that changes frequently, such as buffers, caches, scratch data.
  • #9: EBS volumes are highly available and reliable storage volumes that can be attached to any running instance that is in the same Availability Zone. EBS volumes that are attached to an EC2 instance are exposed as storage volumes that persist independently from the life of the instance. Attach both encrypted and unencrypted, support all EBS volume types, snapshots are encrypted, support currently generation instances
  • #12: Massive distributed system They are blocks that are distributed across many physical devices
  • #13: annual failure rate - roczna stopa awaryjności, gives the estimated probability that a device or component will fail during a full year of use For enterprise architecture hard disk is about 4%, for 1000 EBS for 1 year, we can expect to lose 1-2 EBS,
  • #14: First snapshot copy every modified block on S3
  • #15: Volume the same size or bigger
  • #16: Another region or AWS account We can share snapshot private/public
  • #17: Throughput a network bandwidth
  • #18: Dedicated bandwitdth to EBS
  • #22: What is most important for you IOPS or throughput or we are not sure Io1 daje podwojne wartosci z gp2