SlideShare a Scribd company logo
amazon
web services
AWS 201T Workshop
Younjin Jeong
Solution Architect
younjin@amazon.com
Agenda
• House Keeping & Setup
• Introduction to Amazon
Web Services
• Lab: Building a Web
Property on AWS
– Storage: S3, EBS
– Compute
– Content Delivery
– Relational Database
– Dynamo DB
• Lab: Scalability and
Availability
– Snapshots
– Load Balancing
– Auto Scaling
– Security
• Log Processing Scenario
– Logging to AWS
– Elastic Map Reduce
Questions ?
House Keeping
• Breaks
Agenda
• House Keeping & Setup
• Introduction to Amazon
Web Services
• Building a Web Property on
AWS
– Storage: S3, EBS
– Compute
– Content Delivery
– Relational Database
• Scalability and Availability
– Snapshots
– Load Balancing
– Auto Scaling
– Security
• Log Processing Scenario
– Logging to AWS
– Elastic Map Reduce
– Dynamo DB
Region GovCloud Region
Global AWS Infrastructure ][
Availability Zone
Global AWS Infrastructure ][
[Jun AWS 201] Technical Workshop
Edge Locations
Global AWS Infrastructure ][
Dallas (2)
St.Louis
Miami
JacksonvilleLos Angeles (2)
Palo Alto
Seattle
Ashburn
(2)
Newark
New York (3)
Dublin
London (2)Amsterdam (2)
Stockholm
Frankfurt (2)
Paris
(2)
Singapore
(2)
Hong Kong
(2)
Tokyo (2)
Sao Paulo
South Bend
San Jose
Osaka
Milan
Sydney
Hayward
Madrid
The Amazon Web Services universe[ ]
amazon
web services
The Amazon Web Services universe[ ]
SDK
API
Web Console
Command Line
[ ]
Management +
Interface
Cross
Service
Features
CloudFormationSimple WorkFlow
CloudWatch
Elastic BeanStalk
IAM
The Amazon Web Services universe
(some services are omitted here)
Simple Notification Service
[ ]
Management +
Interface
Platform
Building
blocks
RDS
EMR
DynamoDB
CloudFrontSQS
CloudSearchSES
Cross
Service
Features
The Amazon Web Services universe
(some services are omitted here)
Redshift
Infrastructure
Building
Blocks
[ ]
Management +
Interface
Platform
Building
blocks
Cross
Service
Features
Glacier EBS S3Virtual Private Cloud
The Amazon Web Services universe
(some services are omitted here)
EC2
[ ]
Management +
Interface
RDS CloudSearch
SES CloudFront SQS
EMR DynamoDB
Elastic Beanstalk
Simple WorkFlow
CloudFormation
CloudWatch
IAM
VPC EC2
EBS S3
(some services are omitted here)
Infrastructure
Building
Blocks
Platform
Building
blocks
Cross
Service
Features Command Line
Web Console
APIs
SDK
The Amazon Web Services universe
Agenda
• House Keeping & Setup
• Introduction to Amazon
Web Services
• Building a Web Property
on AWS
– Storage: S3, EBS
– Compute
– Content Delivery
– Relational Database
– Dynamo DB
• Scalability and Availability
– Snapshots
– Load Balancing
– Auto Scaling
– Security
• Log Processing Scenario
– Logging to AWS
– Elastic Map Reduce
Labs
During this workshop, we will build from
scratch a highly available, redundant,
scalable web property on AWS.
Storage
Amazon Simple Storage Service (S3)
Amazon S3 Bucket Volume SnapshotAmazon Elastic
Block Storage
(EBS)
Amazon Elastic Block Storage (Amazon EBS)
Our Building Blocks
Compute
Our Building Blocks
Amazon Elastic Compute Cloud (EC2)
Amazon EC2 Instance Instances AMI DB on
Instance
Instance with
CloudWatch
Elastic IP
Content Delivery & Database
Our Building Blocks
Amazon Database Services RDS/DDB
Amazon RDS MySQL DB Instance DynamoDB
Amazon Cloudfront
Amazon
Cloudfront
Download
Distribution
Edge LocationStreaming
Distribution
console.aws.amazon.com
• Object-based storage
(no Filesystem)
• Easily store/retrieve data
• Durability of 99.999999999%
or 99.99%
• Integrated with other AWS
Services
• Scalable
• Redundancy is managed
transparently
• File (Object): up to 5 TB each
• HTTP, HTTPS, BitTorrent
protocols
28
Amazon S3
Simple Storage Service
Data
Any Amazon S3 Region
Your Data
Data
Data
Data
Data
Amazon S3 Redundancy
Data is replicated
multiple times
In case of failure,
data is replicated again,
transparently
• Backup
• Archive (Glacier)
• Disaster Recovery (DR)
• Content Storage
• Website
30
Amazon S3 Use cases
Questions ?
• Delivery of content
worldwide
• Static: HTTP / HTTPS
• Streaming: RTMP
• Dynamic Content
• Origin server: S3,
EC2, non-AWS
• Public/Private
Distributions
33
Amazon CloudFront
Content Delivery Network
Regions, Availability Zones,
Edge Locations
Dallas
St.Louis Miami
Jacksonville
Los Angeles (2)
Palo Alto
Seattle
Ashburn
Newark
New York (2)
Dublin
London
Amsterdam
Stockholm
Frankfurt
Paris
Singapore
Hong Kong
Tokyo
Sao Paulo
South Bend
San Jose
38 Edge Locations in total (as of Dec 2012)
Sydney
Let’s simplify a bit:
we consider only a few of them
Stockholm
Hong Kong
Sao Paulo
San Jose
Your web servers
in Singapore
Stockholm
Hong Kong
Sao Paulo
San Jose
Content Delivery Network:
How it works
Dynamic pages (PHP, Java) (from web servers)
Static content or streaming (with CloudFront)
Your web servers
in Singapore
• Accelerated web content delivery
• Off-load traffic from web servers
• Big spikes in traffic
• Event streaming
• Marketing campaigns
37
Amazon CloudFront Use cases
Questions ?
• Linux / Windows virtual
machines
• Elastic (scale in minutes)
• Many Instance types
(micro, small, large...)
• AMI: Amazon Machine
Image
• VPC: Virtual Private Cloud
• Security (Groups,
Keys...)
• VM Import
• Auto Scaling, Elastic
Load Balancing
40
Amazon EC2
Elastic Compute Cloud
Availability Zone
I see 20 Availability Zones in total (as of Feb 2013)
• Media
• Hosting
• High Performance
Computing
• Dev & Test
• Internal Applications
• Gaming
• ... Everything that
needs computing!
42
EC2 Use cases
Lab Exercise
• Create a new Security Group
• Launch an Amazon EC2 instance (Linux)
• Log in with SSH as ec2-user@
• Install a web server
• Create a simple web page
• Test it on a browser: it works!
• Create and attach an Elastic IP
• Create an AMI from an EC2 Instance
Questions ?
• Block Level Storage for use
with EC2
• Volume: 1 GB to 1 TB
• Raw unformatted block
device
• Local to an Availability Zone
• Redundant
• Persistent
• Point-in-time snapshots to
Amazon S3
• Integration with CloudWatch
46
EBS
Elastic Block Storage
• Relational Database “as a
Service”
• Simple to Deploy
• Managed by the AWS team
• MySQL, SQLServer or
Oracle (as of 2012)
• Scalable
• Optional: automatic
Standby Replica
• Optional: multiple Read-
Only copies
• Easy DB Snapshots and
automated backup
49
RDS
Relational Database Service
Demo RDS
• Create a DB Instance on RDS (MySQL)
• Enable Multi-AZ Deployment
• Enable one Read Replica
• Optional: connect to the DB Instance
Agenda
• House Keeping & Setup
• Introduction to Amazon
Web Services
• Lab: Building a Web
Property on AWS
– Storage: S3, EBS
– Compute
– Content Delivery
– Relational Database
– Dynamo DB
• Lab: Scalability and
Availability
– Snapshots
– Load Balancing
– Auto Scaling
– Security
• Log Processing Scenario
– Logging to AWS
– Elastic Map Reduce
Let’s take our Web Application to
the next level
EBS
Elastic Load Balancer
• Automatically distribute incoming traffic to
multiple Amazon EC2 instances (in the same
Region).
• Automatic Health check
• IPv6 support
• Can be integrated with AutoScaling
Questions ?
Snapshots & AMIs
• Copies of EBS Volumes
• Essential to Reusability
• Copy between Regions
• Durability in S3
Lab Exercise
• Duplicate your entire architecture by
making an AMI
• Increase your availability by spreading
your application across availability
zones
• Bring up an ELB in front of your website
• Optional – Create a CNAME to the ELB
Questions ?
CloudWatch
• Integrated across AWS platform
• Nothing to install
• Custom Metrics
• Set Alarms
• View graphs and statistics
• Feeds into Autoscaling
Lab Exercise
• Check out the metrics of your web
application
• Set up an alarm to monitor your site
Questions ?
AutoScaling
• Auto Up and Auto Down
• Runs on CloudWatch metrics
• Notifications via SNS
• Spot or On-demand
• No additional Fees
AutoScaling
• Launch config: AMI to be used
• Autoscaling group: where/how to
launch
• Autoscaling policy: what should AS do
• Autoscaling trigger: what will activate
AS
Questions ?
Security
• Security Groups
• Granular tiered secure architecture
• Roles for services
• Best Practices - Bastions
[Jun AWS 201] Technical Workshop
Before we get started on the controls…
• AWS Reports, Certifications & Accreditations
• SOC 1, Type 2 report
• SOC 2 report
• ISO 27001
• PCI DSS Level 1 service provider
• FISMA Moderate
• MPAA
• Look at http://aws.amazon.com/security
[Jun AWS 201] Technical Workshop
A Protected
Infrastructure:
IAM
VPC
ACL
ELB
AZ
SG
TMG
RDP
WSUS
Questions ?
Agenda
• House Keeping & Setup
• Introduction to Amazon
Web Services
• Lab: Building a Web
Property on AWS
– Storage: S3, EBS
– Compute
– Content Delivery
– Relational Database
– Dynamo DB
• Lab: Scalability and
Availability
– Snapshots
– Load Balancing
– Auto Scaling
– Security
• Log Processing Scenario
– Logging to AWS
– Elastic Map Reduce
Getting your Data into S3
S3Console Upload
FTP
S3 API
AWS Import / Export
Direct Connect
Tsunami UDP
Storage Gateway
3rd Party Commercial
Applications
CloudFront
Flume
AWS Data Pipeline
S3 and Big Data
• Why S3?
• Hadoop Overview
• Hadoop on the Cloud
• Hadoop File System
Questions ?
Introducing Apache Hadoop
• Apache Hadoop
• Software for distributed data analysis
• Map/Reduce framework
• Focus on data
• But
• Complex
• Hard to setup
• Cap-ex intensive
• Difficult to manage
EMR is Hadoop in the Cloud
Hadoop is an open-source framework for
parallel processing huge amounts of data on
a cluster of machines
What is Amazon Elastic MapReduce (EMR)?
How does it work?
EMR
EMR ClusterS3
Put the data
into S3
Choose: Hadoop distribution, #
of nodes, types of nodes, custom
configs, Hive/Pig/etc.
Get the output
from S3
Launch the cluster using
the EMR console, CLI, SDK,
or APIs
You can also store
everything in HDFS
011001101
DynamoDB and Big Data
• What is Dynamo?
• Dynamo in Big Data – Volume & Velocity
Questions ?
Watch out for unexpected Costs
When the Technical Workshop comes to an end, to
avoid unwanted costs:
• Delete your S3 objects
• Destroy your CloudFront distributions
• Stop or Shut Down your EC2 and RDS instances
The customer is responsible for the resources he’s
using. AWS declines any responsibility if the
customer forgets to shut down resources.
amazon
web services
Thank You
Younjin Jeong
Solution Architect
younjin@amazon.com
Ad

More Related Content

Similar to [Jun AWS 201] Technical Workshop (10)

AMAZON CLOUD Course Content
AMAZON CLOUD Course ContentAMAZON CLOUD Course Content
AMAZON CLOUD Course Content
Varnaaz Technologies
 
What is Amazon Web Services & How to Start to deploy your apps ?
What is Amazon Web Services & How to Start to deploy your apps ?What is Amazon Web Services & How to Start to deploy your apps ?
What is Amazon Web Services & How to Start to deploy your apps ?
Sébastien ☁ Stormacq
 
Architecting for AWS Cloud - let's do it right!
Architecting for AWS Cloud - let's do it right!Architecting for AWS Cloud - let's do it right!
Architecting for AWS Cloud - let's do it right!
Misha Hanin
 
Amazon Web Services OverView
Amazon Web Services OverViewAmazon Web Services OverView
Amazon Web Services OverView
Ariel K
 
AWS Education and Research 101
AWS Education and Research 101AWS Education and Research 101
AWS Education and Research 101
Steven Bryen
 
Introduction to AWS Services: Compute, Storage,_Databases
Introduction to AWS Services: Compute, Storage,_DatabasesIntroduction to AWS Services: Compute, Storage,_Databases
Introduction to AWS Services: Compute, Storage,_Databases
daffapunk92
 
Architecting Cloud Apps
Architecting Cloud AppsArchitecting Cloud Apps
Architecting Cloud Apps
jineshvaria
 
Big data and serverless - AWS UG The Netherlands
Big data and serverless - AWS UG The NetherlandsBig data and serverless - AWS UG The Netherlands
Big data and serverless - AWS UG The Netherlands
Marek Kuczynski
 
Cloud computing-Practical Example
Cloud computing-Practical ExampleCloud computing-Practical Example
Cloud computing-Practical Example
Tasawar Gulzar
 
Dean Bryen: Scaling The Platform For Your Startup
Dean Bryen: Scaling The Platform For Your StartupDean Bryen: Scaling The Platform For Your Startup
Dean Bryen: Scaling The Platform For Your Startup
huguk
 
What is Amazon Web Services & How to Start to deploy your apps ?
What is Amazon Web Services & How to Start to deploy your apps ?What is Amazon Web Services & How to Start to deploy your apps ?
What is Amazon Web Services & How to Start to deploy your apps ?
Sébastien ☁ Stormacq
 
Architecting for AWS Cloud - let's do it right!
Architecting for AWS Cloud - let's do it right!Architecting for AWS Cloud - let's do it right!
Architecting for AWS Cloud - let's do it right!
Misha Hanin
 
Amazon Web Services OverView
Amazon Web Services OverViewAmazon Web Services OverView
Amazon Web Services OverView
Ariel K
 
AWS Education and Research 101
AWS Education and Research 101AWS Education and Research 101
AWS Education and Research 101
Steven Bryen
 
Introduction to AWS Services: Compute, Storage,_Databases
Introduction to AWS Services: Compute, Storage,_DatabasesIntroduction to AWS Services: Compute, Storage,_Databases
Introduction to AWS Services: Compute, Storage,_Databases
daffapunk92
 
Architecting Cloud Apps
Architecting Cloud AppsArchitecting Cloud Apps
Architecting Cloud Apps
jineshvaria
 
Big data and serverless - AWS UG The Netherlands
Big data and serverless - AWS UG The NetherlandsBig data and serverless - AWS UG The Netherlands
Big data and serverless - AWS UG The Netherlands
Marek Kuczynski
 
Cloud computing-Practical Example
Cloud computing-Practical ExampleCloud computing-Practical Example
Cloud computing-Practical Example
Tasawar Gulzar
 
Dean Bryen: Scaling The Platform For Your Startup
Dean Bryen: Scaling The Platform For Your StartupDean Bryen: Scaling The Platform For Your Startup
Dean Bryen: Scaling The Platform For Your Startup
huguk
 

More from Amazon Web Services Korea (20)

[D3T1S01] Gen AI를 위한 Amazon Aurora 활용 사례 방법
[D3T1S01] Gen AI를 위한 Amazon Aurora  활용 사례 방법[D3T1S01] Gen AI를 위한 Amazon Aurora  활용 사례 방법
[D3T1S01] Gen AI를 위한 Amazon Aurora 활용 사례 방법
Amazon Web Services Korea
 
[D3T1S06] Neptune Analytics with Vector Similarity Search
[D3T1S06] Neptune Analytics with Vector Similarity Search[D3T1S06] Neptune Analytics with Vector Similarity Search
[D3T1S06] Neptune Analytics with Vector Similarity Search
Amazon Web Services Korea
 
[D3T1S03] Amazon DynamoDB design puzzlers
[D3T1S03] Amazon DynamoDB design puzzlers[D3T1S03] Amazon DynamoDB design puzzlers
[D3T1S03] Amazon DynamoDB design puzzlers
Amazon Web Services Korea
 
[D3T1S04] Aurora PostgreSQL performance monitoring and troubleshooting by use...
[D3T1S04] Aurora PostgreSQL performance monitoring and troubleshooting by use...[D3T1S04] Aurora PostgreSQL performance monitoring and troubleshooting by use...
[D3T1S04] Aurora PostgreSQL performance monitoring and troubleshooting by use...
Amazon Web Services Korea
 
[D3T1S07] AWS S3 - 클라우드 환경에서 데이터베이스 보호하기
[D3T1S07] AWS S3 - 클라우드 환경에서 데이터베이스 보호하기[D3T1S07] AWS S3 - 클라우드 환경에서 데이터베이스 보호하기
[D3T1S07] AWS S3 - 클라우드 환경에서 데이터베이스 보호하기
Amazon Web Services Korea
 
[D3T1S05] Aurora 혼합 구성 아키텍처를 사용하여 예상치 못한 트래픽 급증 대응하기
[D3T1S05] Aurora 혼합 구성 아키텍처를 사용하여 예상치 못한 트래픽 급증 대응하기[D3T1S05] Aurora 혼합 구성 아키텍처를 사용하여 예상치 못한 트래픽 급증 대응하기
[D3T1S05] Aurora 혼합 구성 아키텍처를 사용하여 예상치 못한 트래픽 급증 대응하기
Amazon Web Services Korea
 
[D3T1S02] Aurora Limitless Database Introduction
[D3T1S02] Aurora Limitless Database Introduction[D3T1S02] Aurora Limitless Database Introduction
[D3T1S02] Aurora Limitless Database Introduction
Amazon Web Services Korea
 
[D3T2S01] Amazon Aurora MySQL 메이저 버전 업그레이드 및 Amazon B/G Deployments 실습
[D3T2S01] Amazon Aurora MySQL 메이저 버전 업그레이드 및 Amazon B/G Deployments 실습[D3T2S01] Amazon Aurora MySQL 메이저 버전 업그레이드 및 Amazon B/G Deployments 실습
[D3T2S01] Amazon Aurora MySQL 메이저 버전 업그레이드 및 Amazon B/G Deployments 실습
Amazon Web Services Korea
 
[D3T2S03] Data&AI Roadshow 2024 - Amazon DocumentDB 실습
[D3T2S03] Data&AI Roadshow 2024 - Amazon DocumentDB 실습[D3T2S03] Data&AI Roadshow 2024 - Amazon DocumentDB 실습
[D3T2S03] Data&AI Roadshow 2024 - Amazon DocumentDB 실습
Amazon Web Services Korea
 
AWS Modern Infra with Storage Roadshow 2023 - Day 2
AWS Modern Infra with Storage Roadshow 2023 - Day 2AWS Modern Infra with Storage Roadshow 2023 - Day 2
AWS Modern Infra with Storage Roadshow 2023 - Day 2
Amazon Web Services Korea
 
AWS Modern Infra with Storage Roadshow 2023 - Day 1
AWS Modern Infra with Storage Roadshow 2023 - Day 1AWS Modern Infra with Storage Roadshow 2023 - Day 1
AWS Modern Infra with Storage Roadshow 2023 - Day 1
Amazon Web Services Korea
 
사례로 알아보는 Database Migration Service : 데이터베이스 및 데이터 이관, 통합, 분리, 분석의 도구 - 발표자: ...
사례로 알아보는 Database Migration Service : 데이터베이스 및 데이터 이관, 통합, 분리, 분석의 도구 - 발표자: ...사례로 알아보는 Database Migration Service : 데이터베이스 및 데이터 이관, 통합, 분리, 분석의 도구 - 발표자: ...
사례로 알아보는 Database Migration Service : 데이터베이스 및 데이터 이관, 통합, 분리, 분석의 도구 - 발표자: ...
Amazon Web Services Korea
 
Amazon DocumentDB - Architecture 및 Best Practice (Level 200) - 발표자: 장동훈, Sr. ...
Amazon DocumentDB - Architecture 및 Best Practice (Level 200) - 발표자: 장동훈, Sr. ...Amazon DocumentDB - Architecture 및 Best Practice (Level 200) - 발표자: 장동훈, Sr. ...
Amazon DocumentDB - Architecture 및 Best Practice (Level 200) - 발표자: 장동훈, Sr. ...
Amazon Web Services Korea
 
Amazon Elasticache - Fully managed, Redis & Memcached Compatible Service (Lev...
Amazon Elasticache - Fully managed, Redis & Memcached Compatible Service (Lev...Amazon Elasticache - Fully managed, Redis & Memcached Compatible Service (Lev...
Amazon Elasticache - Fully managed, Redis & Memcached Compatible Service (Lev...
Amazon Web Services Korea
 
Internal Architecture of Amazon Aurora (Level 400) - 발표자: 정달영, APAC RDS Speci...
Internal Architecture of Amazon Aurora (Level 400) - 발표자: 정달영, APAC RDS Speci...Internal Architecture of Amazon Aurora (Level 400) - 발표자: 정달영, APAC RDS Speci...
Internal Architecture of Amazon Aurora (Level 400) - 발표자: 정달영, APAC RDS Speci...
Amazon Web Services Korea
 
[Keynote] 슬기로운 AWS 데이터베이스 선택하기 - 발표자: 강민석, Korea Database SA Manager, WWSO, A...
[Keynote] 슬기로운 AWS 데이터베이스 선택하기 - 발표자: 강민석, Korea Database SA Manager, WWSO, A...[Keynote] 슬기로운 AWS 데이터베이스 선택하기 - 발표자: 강민석, Korea Database SA Manager, WWSO, A...
[Keynote] 슬기로운 AWS 데이터베이스 선택하기 - 발표자: 강민석, Korea Database SA Manager, WWSO, A...
Amazon Web Services Korea
 
Demystify Streaming on AWS - 발표자: 이종혁, Sr Analytics Specialist, WWSO, AWS :::...
Demystify Streaming on AWS - 발표자: 이종혁, Sr Analytics Specialist, WWSO, AWS :::...Demystify Streaming on AWS - 발표자: 이종혁, Sr Analytics Specialist, WWSO, AWS :::...
Demystify Streaming on AWS - 발표자: 이종혁, Sr Analytics Specialist, WWSO, AWS :::...
Amazon Web Services Korea
 
Amazon EMR - Enhancements on Cost/Performance, Serverless - 발표자: 김기영, Sr Anal...
Amazon EMR - Enhancements on Cost/Performance, Serverless - 발표자: 김기영, Sr Anal...Amazon EMR - Enhancements on Cost/Performance, Serverless - 발표자: 김기영, Sr Anal...
Amazon EMR - Enhancements on Cost/Performance, Serverless - 발표자: 김기영, Sr Anal...
Amazon Web Services Korea
 
Amazon OpenSearch - Use Cases, Security/Observability, Serverless and Enhance...
Amazon OpenSearch - Use Cases, Security/Observability, Serverless and Enhance...Amazon OpenSearch - Use Cases, Security/Observability, Serverless and Enhance...
Amazon OpenSearch - Use Cases, Security/Observability, Serverless and Enhance...
Amazon Web Services Korea
 
Enabling Agility with Data Governance - 발표자: 김성연, Analytics Specialist, WWSO,...
Enabling Agility with Data Governance - 발표자: 김성연, Analytics Specialist, WWSO,...Enabling Agility with Data Governance - 발표자: 김성연, Analytics Specialist, WWSO,...
Enabling Agility with Data Governance - 발표자: 김성연, Analytics Specialist, WWSO,...
Amazon Web Services Korea
 
[D3T1S01] Gen AI를 위한 Amazon Aurora 활용 사례 방법
[D3T1S01] Gen AI를 위한 Amazon Aurora  활용 사례 방법[D3T1S01] Gen AI를 위한 Amazon Aurora  활용 사례 방법
[D3T1S01] Gen AI를 위한 Amazon Aurora 활용 사례 방법
Amazon Web Services Korea
 
[D3T1S06] Neptune Analytics with Vector Similarity Search
[D3T1S06] Neptune Analytics with Vector Similarity Search[D3T1S06] Neptune Analytics with Vector Similarity Search
[D3T1S06] Neptune Analytics with Vector Similarity Search
Amazon Web Services Korea
 
[D3T1S04] Aurora PostgreSQL performance monitoring and troubleshooting by use...
[D3T1S04] Aurora PostgreSQL performance monitoring and troubleshooting by use...[D3T1S04] Aurora PostgreSQL performance monitoring and troubleshooting by use...
[D3T1S04] Aurora PostgreSQL performance monitoring and troubleshooting by use...
Amazon Web Services Korea
 
[D3T1S07] AWS S3 - 클라우드 환경에서 데이터베이스 보호하기
[D3T1S07] AWS S3 - 클라우드 환경에서 데이터베이스 보호하기[D3T1S07] AWS S3 - 클라우드 환경에서 데이터베이스 보호하기
[D3T1S07] AWS S3 - 클라우드 환경에서 데이터베이스 보호하기
Amazon Web Services Korea
 
[D3T1S05] Aurora 혼합 구성 아키텍처를 사용하여 예상치 못한 트래픽 급증 대응하기
[D3T1S05] Aurora 혼합 구성 아키텍처를 사용하여 예상치 못한 트래픽 급증 대응하기[D3T1S05] Aurora 혼합 구성 아키텍처를 사용하여 예상치 못한 트래픽 급증 대응하기
[D3T1S05] Aurora 혼합 구성 아키텍처를 사용하여 예상치 못한 트래픽 급증 대응하기
Amazon Web Services Korea
 
[D3T1S02] Aurora Limitless Database Introduction
[D3T1S02] Aurora Limitless Database Introduction[D3T1S02] Aurora Limitless Database Introduction
[D3T1S02] Aurora Limitless Database Introduction
Amazon Web Services Korea
 
[D3T2S01] Amazon Aurora MySQL 메이저 버전 업그레이드 및 Amazon B/G Deployments 실습
[D3T2S01] Amazon Aurora MySQL 메이저 버전 업그레이드 및 Amazon B/G Deployments 실습[D3T2S01] Amazon Aurora MySQL 메이저 버전 업그레이드 및 Amazon B/G Deployments 실습
[D3T2S01] Amazon Aurora MySQL 메이저 버전 업그레이드 및 Amazon B/G Deployments 실습
Amazon Web Services Korea
 
[D3T2S03] Data&AI Roadshow 2024 - Amazon DocumentDB 실습
[D3T2S03] Data&AI Roadshow 2024 - Amazon DocumentDB 실습[D3T2S03] Data&AI Roadshow 2024 - Amazon DocumentDB 실습
[D3T2S03] Data&AI Roadshow 2024 - Amazon DocumentDB 실습
Amazon Web Services Korea
 
AWS Modern Infra with Storage Roadshow 2023 - Day 2
AWS Modern Infra with Storage Roadshow 2023 - Day 2AWS Modern Infra with Storage Roadshow 2023 - Day 2
AWS Modern Infra with Storage Roadshow 2023 - Day 2
Amazon Web Services Korea
 
AWS Modern Infra with Storage Roadshow 2023 - Day 1
AWS Modern Infra with Storage Roadshow 2023 - Day 1AWS Modern Infra with Storage Roadshow 2023 - Day 1
AWS Modern Infra with Storage Roadshow 2023 - Day 1
Amazon Web Services Korea
 
사례로 알아보는 Database Migration Service : 데이터베이스 및 데이터 이관, 통합, 분리, 분석의 도구 - 발표자: ...
사례로 알아보는 Database Migration Service : 데이터베이스 및 데이터 이관, 통합, 분리, 분석의 도구 - 발표자: ...사례로 알아보는 Database Migration Service : 데이터베이스 및 데이터 이관, 통합, 분리, 분석의 도구 - 발표자: ...
사례로 알아보는 Database Migration Service : 데이터베이스 및 데이터 이관, 통합, 분리, 분석의 도구 - 발표자: ...
Amazon Web Services Korea
 
Amazon DocumentDB - Architecture 및 Best Practice (Level 200) - 발표자: 장동훈, Sr. ...
Amazon DocumentDB - Architecture 및 Best Practice (Level 200) - 발표자: 장동훈, Sr. ...Amazon DocumentDB - Architecture 및 Best Practice (Level 200) - 발표자: 장동훈, Sr. ...
Amazon DocumentDB - Architecture 및 Best Practice (Level 200) - 발표자: 장동훈, Sr. ...
Amazon Web Services Korea
 
Amazon Elasticache - Fully managed, Redis & Memcached Compatible Service (Lev...
Amazon Elasticache - Fully managed, Redis & Memcached Compatible Service (Lev...Amazon Elasticache - Fully managed, Redis & Memcached Compatible Service (Lev...
Amazon Elasticache - Fully managed, Redis & Memcached Compatible Service (Lev...
Amazon Web Services Korea
 
Internal Architecture of Amazon Aurora (Level 400) - 발표자: 정달영, APAC RDS Speci...
Internal Architecture of Amazon Aurora (Level 400) - 발표자: 정달영, APAC RDS Speci...Internal Architecture of Amazon Aurora (Level 400) - 발표자: 정달영, APAC RDS Speci...
Internal Architecture of Amazon Aurora (Level 400) - 발표자: 정달영, APAC RDS Speci...
Amazon Web Services Korea
 
[Keynote] 슬기로운 AWS 데이터베이스 선택하기 - 발표자: 강민석, Korea Database SA Manager, WWSO, A...
[Keynote] 슬기로운 AWS 데이터베이스 선택하기 - 발표자: 강민석, Korea Database SA Manager, WWSO, A...[Keynote] 슬기로운 AWS 데이터베이스 선택하기 - 발표자: 강민석, Korea Database SA Manager, WWSO, A...
[Keynote] 슬기로운 AWS 데이터베이스 선택하기 - 발표자: 강민석, Korea Database SA Manager, WWSO, A...
Amazon Web Services Korea
 
Demystify Streaming on AWS - 발표자: 이종혁, Sr Analytics Specialist, WWSO, AWS :::...
Demystify Streaming on AWS - 발표자: 이종혁, Sr Analytics Specialist, WWSO, AWS :::...Demystify Streaming on AWS - 발표자: 이종혁, Sr Analytics Specialist, WWSO, AWS :::...
Demystify Streaming on AWS - 발표자: 이종혁, Sr Analytics Specialist, WWSO, AWS :::...
Amazon Web Services Korea
 
Amazon EMR - Enhancements on Cost/Performance, Serverless - 발표자: 김기영, Sr Anal...
Amazon EMR - Enhancements on Cost/Performance, Serverless - 발표자: 김기영, Sr Anal...Amazon EMR - Enhancements on Cost/Performance, Serverless - 발표자: 김기영, Sr Anal...
Amazon EMR - Enhancements on Cost/Performance, Serverless - 발표자: 김기영, Sr Anal...
Amazon Web Services Korea
 
Amazon OpenSearch - Use Cases, Security/Observability, Serverless and Enhance...
Amazon OpenSearch - Use Cases, Security/Observability, Serverless and Enhance...Amazon OpenSearch - Use Cases, Security/Observability, Serverless and Enhance...
Amazon OpenSearch - Use Cases, Security/Observability, Serverless and Enhance...
Amazon Web Services Korea
 
Enabling Agility with Data Governance - 발표자: 김성연, Analytics Specialist, WWSO,...
Enabling Agility with Data Governance - 발표자: 김성연, Analytics Specialist, WWSO,...Enabling Agility with Data Governance - 발표자: 김성연, Analytics Specialist, WWSO,...
Enabling Agility with Data Governance - 발표자: 김성연, Analytics Specialist, WWSO,...
Amazon Web Services Korea
 
Ad

Recently uploaded (20)

Linux Professional Institute LPIC-1 Exam.pdf
Linux Professional Institute LPIC-1 Exam.pdfLinux Professional Institute LPIC-1 Exam.pdf
Linux Professional Institute LPIC-1 Exam.pdf
RHCSA Guru
 
Noah Loul Shares 5 Steps to Implement AI Agents for Maximum Business Efficien...
Noah Loul Shares 5 Steps to Implement AI Agents for Maximum Business Efficien...Noah Loul Shares 5 Steps to Implement AI Agents for Maximum Business Efficien...
Noah Loul Shares 5 Steps to Implement AI Agents for Maximum Business Efficien...
Noah Loul
 
TrsLabs - Fintech Product & Business Consulting
TrsLabs - Fintech Product & Business ConsultingTrsLabs - Fintech Product & Business Consulting
TrsLabs - Fintech Product & Business Consulting
Trs Labs
 
AI EngineHost Review: Revolutionary USA Datacenter-Based Hosting with NVIDIA ...
AI EngineHost Review: Revolutionary USA Datacenter-Based Hosting with NVIDIA ...AI EngineHost Review: Revolutionary USA Datacenter-Based Hosting with NVIDIA ...
AI EngineHost Review: Revolutionary USA Datacenter-Based Hosting with NVIDIA ...
SOFTTECHHUB
 
Semantic Cultivators : The Critical Future Role to Enable AI
Semantic Cultivators : The Critical Future Role to Enable AISemantic Cultivators : The Critical Future Role to Enable AI
Semantic Cultivators : The Critical Future Role to Enable AI
artmondano
 
Generative Artificial Intelligence (GenAI) in Business
Generative Artificial Intelligence (GenAI) in BusinessGenerative Artificial Intelligence (GenAI) in Business
Generative Artificial Intelligence (GenAI) in Business
Dr. Tathagat Varma
 
Drupalcamp Finland – Measuring Front-end Energy Consumption
Drupalcamp Finland – Measuring Front-end Energy ConsumptionDrupalcamp Finland – Measuring Front-end Energy Consumption
Drupalcamp Finland – Measuring Front-end Energy Consumption
Exove
 
Cybersecurity Identity and Access Solutions using Azure AD
Cybersecurity Identity and Access Solutions using Azure ADCybersecurity Identity and Access Solutions using Azure AD
Cybersecurity Identity and Access Solutions using Azure AD
VICTOR MAESTRE RAMIREZ
 
Electronic_Mail_Attacks-1-35.pdf by xploit
Electronic_Mail_Attacks-1-35.pdf by xploitElectronic_Mail_Attacks-1-35.pdf by xploit
Electronic_Mail_Attacks-1-35.pdf by xploit
niftliyevhuseyn
 
SAP Modernization: Maximizing the Value of Your SAP S/4HANA Migration.pdf
SAP Modernization: Maximizing the Value of Your SAP S/4HANA Migration.pdfSAP Modernization: Maximizing the Value of Your SAP S/4HANA Migration.pdf
SAP Modernization: Maximizing the Value of Your SAP S/4HANA Migration.pdf
Precisely
 
Build Your Own Copilot & Agents For Devs
Build Your Own Copilot & Agents For DevsBuild Your Own Copilot & Agents For Devs
Build Your Own Copilot & Agents For Devs
Brian McKeiver
 
TrustArc Webinar: Consumer Expectations vs Corporate Realities on Data Broker...
TrustArc Webinar: Consumer Expectations vs Corporate Realities on Data Broker...TrustArc Webinar: Consumer Expectations vs Corporate Realities on Data Broker...
TrustArc Webinar: Consumer Expectations vs Corporate Realities on Data Broker...
TrustArc
 
Transcript: #StandardsGoals for 2025: Standards & certification roundup - Tec...
Transcript: #StandardsGoals for 2025: Standards & certification roundup - Tec...Transcript: #StandardsGoals for 2025: Standards & certification roundup - Tec...
Transcript: #StandardsGoals for 2025: Standards & certification roundup - Tec...
BookNet Canada
 
Dev Dives: Automate and orchestrate your processes with UiPath Maestro
Dev Dives: Automate and orchestrate your processes with UiPath MaestroDev Dives: Automate and orchestrate your processes with UiPath Maestro
Dev Dives: Automate and orchestrate your processes with UiPath Maestro
UiPathCommunity
 
Procurement Insights Cost To Value Guide.pptx
Procurement Insights Cost To Value Guide.pptxProcurement Insights Cost To Value Guide.pptx
Procurement Insights Cost To Value Guide.pptx
Jon Hansen
 
Greenhouse_Monitoring_Presentation.pptx.
Greenhouse_Monitoring_Presentation.pptx.Greenhouse_Monitoring_Presentation.pptx.
Greenhouse_Monitoring_Presentation.pptx.
hpbmnnxrvb
 
Special Meetup Edition - TDX Bengaluru Meetup #52.pptx
Special Meetup Edition - TDX Bengaluru Meetup #52.pptxSpecial Meetup Edition - TDX Bengaluru Meetup #52.pptx
Special Meetup Edition - TDX Bengaluru Meetup #52.pptx
shyamraj55
 
Designing Low-Latency Systems with Rust and ScyllaDB: An Architectural Deep Dive
Designing Low-Latency Systems with Rust and ScyllaDB: An Architectural Deep DiveDesigning Low-Latency Systems with Rust and ScyllaDB: An Architectural Deep Dive
Designing Low-Latency Systems with Rust and ScyllaDB: An Architectural Deep Dive
ScyllaDB
 
Technology Trends in 2025: AI and Big Data Analytics
Technology Trends in 2025: AI and Big Data AnalyticsTechnology Trends in 2025: AI and Big Data Analytics
Technology Trends in 2025: AI and Big Data Analytics
InData Labs
 
AI and Data Privacy in 2025: Global Trends
AI and Data Privacy in 2025: Global TrendsAI and Data Privacy in 2025: Global Trends
AI and Data Privacy in 2025: Global Trends
InData Labs
 
Linux Professional Institute LPIC-1 Exam.pdf
Linux Professional Institute LPIC-1 Exam.pdfLinux Professional Institute LPIC-1 Exam.pdf
Linux Professional Institute LPIC-1 Exam.pdf
RHCSA Guru
 
Noah Loul Shares 5 Steps to Implement AI Agents for Maximum Business Efficien...
Noah Loul Shares 5 Steps to Implement AI Agents for Maximum Business Efficien...Noah Loul Shares 5 Steps to Implement AI Agents for Maximum Business Efficien...
Noah Loul Shares 5 Steps to Implement AI Agents for Maximum Business Efficien...
Noah Loul
 
TrsLabs - Fintech Product & Business Consulting
TrsLabs - Fintech Product & Business ConsultingTrsLabs - Fintech Product & Business Consulting
TrsLabs - Fintech Product & Business Consulting
Trs Labs
 
AI EngineHost Review: Revolutionary USA Datacenter-Based Hosting with NVIDIA ...
AI EngineHost Review: Revolutionary USA Datacenter-Based Hosting with NVIDIA ...AI EngineHost Review: Revolutionary USA Datacenter-Based Hosting with NVIDIA ...
AI EngineHost Review: Revolutionary USA Datacenter-Based Hosting with NVIDIA ...
SOFTTECHHUB
 
Semantic Cultivators : The Critical Future Role to Enable AI
Semantic Cultivators : The Critical Future Role to Enable AISemantic Cultivators : The Critical Future Role to Enable AI
Semantic Cultivators : The Critical Future Role to Enable AI
artmondano
 
Generative Artificial Intelligence (GenAI) in Business
Generative Artificial Intelligence (GenAI) in BusinessGenerative Artificial Intelligence (GenAI) in Business
Generative Artificial Intelligence (GenAI) in Business
Dr. Tathagat Varma
 
Drupalcamp Finland – Measuring Front-end Energy Consumption
Drupalcamp Finland – Measuring Front-end Energy ConsumptionDrupalcamp Finland – Measuring Front-end Energy Consumption
Drupalcamp Finland – Measuring Front-end Energy Consumption
Exove
 
Cybersecurity Identity and Access Solutions using Azure AD
Cybersecurity Identity and Access Solutions using Azure ADCybersecurity Identity and Access Solutions using Azure AD
Cybersecurity Identity and Access Solutions using Azure AD
VICTOR MAESTRE RAMIREZ
 
Electronic_Mail_Attacks-1-35.pdf by xploit
Electronic_Mail_Attacks-1-35.pdf by xploitElectronic_Mail_Attacks-1-35.pdf by xploit
Electronic_Mail_Attacks-1-35.pdf by xploit
niftliyevhuseyn
 
SAP Modernization: Maximizing the Value of Your SAP S/4HANA Migration.pdf
SAP Modernization: Maximizing the Value of Your SAP S/4HANA Migration.pdfSAP Modernization: Maximizing the Value of Your SAP S/4HANA Migration.pdf
SAP Modernization: Maximizing the Value of Your SAP S/4HANA Migration.pdf
Precisely
 
Build Your Own Copilot & Agents For Devs
Build Your Own Copilot & Agents For DevsBuild Your Own Copilot & Agents For Devs
Build Your Own Copilot & Agents For Devs
Brian McKeiver
 
TrustArc Webinar: Consumer Expectations vs Corporate Realities on Data Broker...
TrustArc Webinar: Consumer Expectations vs Corporate Realities on Data Broker...TrustArc Webinar: Consumer Expectations vs Corporate Realities on Data Broker...
TrustArc Webinar: Consumer Expectations vs Corporate Realities on Data Broker...
TrustArc
 
Transcript: #StandardsGoals for 2025: Standards & certification roundup - Tec...
Transcript: #StandardsGoals for 2025: Standards & certification roundup - Tec...Transcript: #StandardsGoals for 2025: Standards & certification roundup - Tec...
Transcript: #StandardsGoals for 2025: Standards & certification roundup - Tec...
BookNet Canada
 
Dev Dives: Automate and orchestrate your processes with UiPath Maestro
Dev Dives: Automate and orchestrate your processes with UiPath MaestroDev Dives: Automate and orchestrate your processes with UiPath Maestro
Dev Dives: Automate and orchestrate your processes with UiPath Maestro
UiPathCommunity
 
Procurement Insights Cost To Value Guide.pptx
Procurement Insights Cost To Value Guide.pptxProcurement Insights Cost To Value Guide.pptx
Procurement Insights Cost To Value Guide.pptx
Jon Hansen
 
Greenhouse_Monitoring_Presentation.pptx.
Greenhouse_Monitoring_Presentation.pptx.Greenhouse_Monitoring_Presentation.pptx.
Greenhouse_Monitoring_Presentation.pptx.
hpbmnnxrvb
 
Special Meetup Edition - TDX Bengaluru Meetup #52.pptx
Special Meetup Edition - TDX Bengaluru Meetup #52.pptxSpecial Meetup Edition - TDX Bengaluru Meetup #52.pptx
Special Meetup Edition - TDX Bengaluru Meetup #52.pptx
shyamraj55
 
Designing Low-Latency Systems with Rust and ScyllaDB: An Architectural Deep Dive
Designing Low-Latency Systems with Rust and ScyllaDB: An Architectural Deep DiveDesigning Low-Latency Systems with Rust and ScyllaDB: An Architectural Deep Dive
Designing Low-Latency Systems with Rust and ScyllaDB: An Architectural Deep Dive
ScyllaDB
 
Technology Trends in 2025: AI and Big Data Analytics
Technology Trends in 2025: AI and Big Data AnalyticsTechnology Trends in 2025: AI and Big Data Analytics
Technology Trends in 2025: AI and Big Data Analytics
InData Labs
 
AI and Data Privacy in 2025: Global Trends
AI and Data Privacy in 2025: Global TrendsAI and Data Privacy in 2025: Global Trends
AI and Data Privacy in 2025: Global Trends
InData Labs
 
Ad

[Jun AWS 201] Technical Workshop

  • 1. amazon web services AWS 201T Workshop Younjin Jeong Solution Architect [email protected]
  • 2. Agenda • House Keeping & Setup • Introduction to Amazon Web Services • Lab: Building a Web Property on AWS – Storage: S3, EBS – Compute – Content Delivery – Relational Database – Dynamo DB • Lab: Scalability and Availability – Snapshots – Load Balancing – Auto Scaling – Security • Log Processing Scenario – Logging to AWS – Elastic Map Reduce
  • 5. Agenda • House Keeping & Setup • Introduction to Amazon Web Services • Building a Web Property on AWS – Storage: S3, EBS – Compute – Content Delivery – Relational Database • Scalability and Availability – Snapshots – Load Balancing – Auto Scaling – Security • Log Processing Scenario – Logging to AWS – Elastic Map Reduce – Dynamo DB
  • 6. Region GovCloud Region Global AWS Infrastructure ][
  • 7. Availability Zone Global AWS Infrastructure ][
  • 9. Edge Locations Global AWS Infrastructure ][ Dallas (2) St.Louis Miami JacksonvilleLos Angeles (2) Palo Alto Seattle Ashburn (2) Newark New York (3) Dublin London (2)Amsterdam (2) Stockholm Frankfurt (2) Paris (2) Singapore (2) Hong Kong (2) Tokyo (2) Sao Paulo South Bend San Jose Osaka Milan Sydney Hayward Madrid
  • 10. The Amazon Web Services universe[ ] amazon web services
  • 11. The Amazon Web Services universe[ ] SDK API Web Console Command Line
  • 12. [ ] Management + Interface Cross Service Features CloudFormationSimple WorkFlow CloudWatch Elastic BeanStalk IAM The Amazon Web Services universe (some services are omitted here) Simple Notification Service
  • 14. Infrastructure Building Blocks [ ] Management + Interface Platform Building blocks Cross Service Features Glacier EBS S3Virtual Private Cloud The Amazon Web Services universe (some services are omitted here) EC2
  • 15. [ ] Management + Interface RDS CloudSearch SES CloudFront SQS EMR DynamoDB Elastic Beanstalk Simple WorkFlow CloudFormation CloudWatch IAM VPC EC2 EBS S3 (some services are omitted here) Infrastructure Building Blocks Platform Building blocks Cross Service Features Command Line Web Console APIs SDK The Amazon Web Services universe
  • 16. Agenda • House Keeping & Setup • Introduction to Amazon Web Services • Building a Web Property on AWS – Storage: S3, EBS – Compute – Content Delivery – Relational Database – Dynamo DB • Scalability and Availability – Snapshots – Load Balancing – Auto Scaling – Security • Log Processing Scenario – Logging to AWS – Elastic Map Reduce
  • 17. Labs During this workshop, we will build from scratch a highly available, redundant, scalable web property on AWS.
  • 18. Storage Amazon Simple Storage Service (S3) Amazon S3 Bucket Volume SnapshotAmazon Elastic Block Storage (EBS) Amazon Elastic Block Storage (Amazon EBS) Our Building Blocks
  • 19. Compute Our Building Blocks Amazon Elastic Compute Cloud (EC2) Amazon EC2 Instance Instances AMI DB on Instance Instance with CloudWatch Elastic IP
  • 20. Content Delivery & Database Our Building Blocks Amazon Database Services RDS/DDB Amazon RDS MySQL DB Instance DynamoDB Amazon Cloudfront Amazon Cloudfront Download Distribution Edge LocationStreaming Distribution
  • 22. • Object-based storage (no Filesystem) • Easily store/retrieve data • Durability of 99.999999999% or 99.99% • Integrated with other AWS Services • Scalable • Redundancy is managed transparently • File (Object): up to 5 TB each • HTTP, HTTPS, BitTorrent protocols 28 Amazon S3 Simple Storage Service
  • 23. Data Any Amazon S3 Region Your Data Data Data Data Data Amazon S3 Redundancy Data is replicated multiple times In case of failure, data is replicated again, transparently
  • 24. • Backup • Archive (Glacier) • Disaster Recovery (DR) • Content Storage • Website 30 Amazon S3 Use cases
  • 26. • Delivery of content worldwide • Static: HTTP / HTTPS • Streaming: RTMP • Dynamic Content • Origin server: S3, EC2, non-AWS • Public/Private Distributions 33 Amazon CloudFront Content Delivery Network
  • 27. Regions, Availability Zones, Edge Locations Dallas St.Louis Miami Jacksonville Los Angeles (2) Palo Alto Seattle Ashburn Newark New York (2) Dublin London Amsterdam Stockholm Frankfurt Paris Singapore Hong Kong Tokyo Sao Paulo South Bend San Jose 38 Edge Locations in total (as of Dec 2012) Sydney
  • 28. Let’s simplify a bit: we consider only a few of them Stockholm Hong Kong Sao Paulo San Jose Your web servers in Singapore
  • 29. Stockholm Hong Kong Sao Paulo San Jose Content Delivery Network: How it works Dynamic pages (PHP, Java) (from web servers) Static content or streaming (with CloudFront) Your web servers in Singapore
  • 30. • Accelerated web content delivery • Off-load traffic from web servers • Big spikes in traffic • Event streaming • Marketing campaigns 37 Amazon CloudFront Use cases
  • 32. • Linux / Windows virtual machines • Elastic (scale in minutes) • Many Instance types (micro, small, large...) • AMI: Amazon Machine Image • VPC: Virtual Private Cloud • Security (Groups, Keys...) • VM Import • Auto Scaling, Elastic Load Balancing 40 Amazon EC2 Elastic Compute Cloud
  • 33. Availability Zone I see 20 Availability Zones in total (as of Feb 2013)
  • 34. • Media • Hosting • High Performance Computing • Dev & Test • Internal Applications • Gaming • ... Everything that needs computing! 42 EC2 Use cases
  • 35. Lab Exercise • Create a new Security Group • Launch an Amazon EC2 instance (Linux) • Log in with SSH as ec2-user@ • Install a web server • Create a simple web page • Test it on a browser: it works! • Create and attach an Elastic IP • Create an AMI from an EC2 Instance
  • 37. • Block Level Storage for use with EC2 • Volume: 1 GB to 1 TB • Raw unformatted block device • Local to an Availability Zone • Redundant • Persistent • Point-in-time snapshots to Amazon S3 • Integration with CloudWatch 46 EBS Elastic Block Storage
  • 38. • Relational Database “as a Service” • Simple to Deploy • Managed by the AWS team • MySQL, SQLServer or Oracle (as of 2012) • Scalable • Optional: automatic Standby Replica • Optional: multiple Read- Only copies • Easy DB Snapshots and automated backup 49 RDS Relational Database Service
  • 39. Demo RDS • Create a DB Instance on RDS (MySQL) • Enable Multi-AZ Deployment • Enable one Read Replica • Optional: connect to the DB Instance
  • 40. Agenda • House Keeping & Setup • Introduction to Amazon Web Services • Lab: Building a Web Property on AWS – Storage: S3, EBS – Compute – Content Delivery – Relational Database – Dynamo DB • Lab: Scalability and Availability – Snapshots – Load Balancing – Auto Scaling – Security • Log Processing Scenario – Logging to AWS – Elastic Map Reduce
  • 41. Let’s take our Web Application to the next level
  • 42. EBS Elastic Load Balancer • Automatically distribute incoming traffic to multiple Amazon EC2 instances (in the same Region). • Automatic Health check • IPv6 support • Can be integrated with AutoScaling
  • 44. Snapshots & AMIs • Copies of EBS Volumes • Essential to Reusability • Copy between Regions • Durability in S3
  • 45. Lab Exercise • Duplicate your entire architecture by making an AMI • Increase your availability by spreading your application across availability zones • Bring up an ELB in front of your website • Optional – Create a CNAME to the ELB
  • 47. CloudWatch • Integrated across AWS platform • Nothing to install • Custom Metrics • Set Alarms • View graphs and statistics • Feeds into Autoscaling
  • 48. Lab Exercise • Check out the metrics of your web application • Set up an alarm to monitor your site
  • 50. AutoScaling • Auto Up and Auto Down • Runs on CloudWatch metrics • Notifications via SNS • Spot or On-demand • No additional Fees
  • 51. AutoScaling • Launch config: AMI to be used • Autoscaling group: where/how to launch • Autoscaling policy: what should AS do • Autoscaling trigger: what will activate AS
  • 53. Security • Security Groups • Granular tiered secure architecture • Roles for services • Best Practices - Bastions
  • 55. Before we get started on the controls… • AWS Reports, Certifications & Accreditations • SOC 1, Type 2 report • SOC 2 report • ISO 27001 • PCI DSS Level 1 service provider • FISMA Moderate • MPAA • Look at http://aws.amazon.com/security
  • 59. Agenda • House Keeping & Setup • Introduction to Amazon Web Services • Lab: Building a Web Property on AWS – Storage: S3, EBS – Compute – Content Delivery – Relational Database – Dynamo DB • Lab: Scalability and Availability – Snapshots – Load Balancing – Auto Scaling – Security • Log Processing Scenario – Logging to AWS – Elastic Map Reduce
  • 60. Getting your Data into S3 S3Console Upload FTP S3 API AWS Import / Export Direct Connect Tsunami UDP Storage Gateway 3rd Party Commercial Applications CloudFront Flume AWS Data Pipeline
  • 61. S3 and Big Data • Why S3? • Hadoop Overview • Hadoop on the Cloud • Hadoop File System
  • 63. Introducing Apache Hadoop • Apache Hadoop • Software for distributed data analysis • Map/Reduce framework • Focus on data
  • 64. • But • Complex • Hard to setup • Cap-ex intensive • Difficult to manage
  • 65. EMR is Hadoop in the Cloud Hadoop is an open-source framework for parallel processing huge amounts of data on a cluster of machines What is Amazon Elastic MapReduce (EMR)?
  • 66. How does it work? EMR EMR ClusterS3 Put the data into S3 Choose: Hadoop distribution, # of nodes, types of nodes, custom configs, Hive/Pig/etc. Get the output from S3 Launch the cluster using the EMR console, CLI, SDK, or APIs You can also store everything in HDFS 011001101
  • 67. DynamoDB and Big Data • What is Dynamo? • Dynamo in Big Data – Volume & Velocity
  • 69. Watch out for unexpected Costs When the Technical Workshop comes to an end, to avoid unwanted costs: • Delete your S3 objects • Destroy your CloudFront distributions • Stop or Shut Down your EC2 and RDS instances The customer is responsible for the resources he’s using. AWS declines any responsibility if the customer forgets to shut down resources.