26 SEP,2024

© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Cloud infrastructure for modern
applications

Vijay Menon
Principal Specialist Solutions Architect
AWS

© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Today’s agenda
Global scale and highest availability

Data center innovation

Cloud-optimized hardware

Serverless innovations

Security
© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
 AWS Global Network

Network backbone Terrestrial fiber optic cable

© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
 Total network capacity
2024

2019

2005

© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
 2006–2011 2012–2017 2018–2024 Coming soon

8 new Regions 10 new Regions 15 new Regions 8 new Regions

• 105 Availability Zones across 33 geographic Regions

• Coming soon, 21 more Availability Zones across seven more AWS Regions in Malaysia, Mexico,
New Zealand, the Kingdom of Saudi Arabia, Thailand, Taiwan
• AWS European Sovereign Cloud

© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
 More choices Lower latency Higher availability

© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
 Region
Asia Pacific (Sydney)
ap-southeast-2

Availability Zone 1

Transit Availability Zone 2

center

Availability Zone 3

© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
 Region
Asia Pacific (Sydney)
ap-southeast-2

Availability Zone 1

Transit Availability Zone 2

center

Availability Zone 3

© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
 41 AWS Local Zones

© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
 25ms rtt US West (Oregon)

Los Angeles

© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
 134+ AWS Direct Connect locations

© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
 15 years of innovation 600+

with Amazon CloudFront

Points of
Presence

150
Points of
Presence

Launch

2008 2009 2010 2011 | 2012 2013 2014 2015 | 2016 2017 2018 2019 | 2020 2021 2022 2023

© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS Nitro

© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
 AWS Nitro System Server

Network

Customer instances
Storage

Security

Hypervisor

© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Network bandwidth
Handle more data, faster while maintaining 400 Gbps

security, speed, and reliability

200 Gbps

100 Gbps

50 Gbps
25 Gbps
10 Gbps
1 Gbps 1 Gbps 10 Gbps 10 Gbps

Baseline AWS Nitro-enabled Network-optimized

© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Network bandwidth
Handle more data, faster while maintaining 400 Gbps

security, speed, and reliability

200 Gbps

100 Gbps

50 Gbps
25 Gbps
10 Gbps
1 Gbps 1 Gbps 10 Gbps 10 Gbps

Baseline AWS Nitro-enabled Network-optimized

© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Network bandwidth 6400 Gbps
Handle more data, faster while maintaining
security, speed, and reliability

3200 Gbps

1600 Gbps

800 Gbps
400 Gbps
100 Gbps 200 Gbps
1 Gbps 1 Gbps 10 Gbps 10 Gbps 10 Gbps 25 Gbps 50 Gbps

Baseline AWS Nitro-enabled Network-optimized High-scale workloads

© 2024,©Amazon
2024, Amazon Web Services,
Web Services, Inc.
Inc. or its or its affiliates.
affiliates. All rightsAllreserved.
rights reserved.
© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Instance Amazon Elastic Block Store
(Amazon EBS) bandwidth and IOPS
Scale your most I/O intensive workloads while maintaining low latency and high durability
100 Gbps
400K IOPS
80 Gbps
350K IOPS

60 Gbps
260K IOPS

38 Gbps
160K IOPS

19 Gbps
14 Gbps 80K IOPS
4 Gbps 75K IOPS
1 Gbps 2 Gbps
16K IOPS 32K IOPS
8K IOPS

Share with Dedicated Amazon EBS bandwidth AWS Nitro-enabled Network and block storage
network optimized

© 2024,©Amazon
2024, Amazon Web Services,
Web Services, Inc.
Inc. or its or its affiliates.
affiliates. All rightsAllreserved.
rights reserved.
© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS Graviton
BEST PRICE PERFORMANCE ON AMAZON EC2

NEW!
Graviton Graviton2 Graviton3 Graviton4
2018 2019 2021 2023

© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
 Graviton3-based instances

C7gn HPC7g M7g C7g R7g

Network-optimized HPC-optimized General-purpose Compute-optimized Memory-optimized

© 2024,©Amazon
2024, Amazon Web Services,
Web Services, Inc.
Inc. or its or its affiliates.
affiliates. All rightsAllreserved.
rights reserved.
© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Graviton4-based memory-optimized instance
BEST PRICE PERFORMANCE FOR MEMORY-INTENSIVE WORKLOADS ON AMAZON EC2

Up to 30% better performance compared to Graviton3-based

R7g instances

Up to 3x more vCPUs and 3x more memory than Graviton3-

based R7g instances
R8g

Ideal for memory-intensive workloads such as databases, in-

memory caches, and real time big data analytics

© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
 Highest performance
GPU-based instances
P4d P5

High-scale machine learning Highest performance for

(ML) training deep learning
and HPC applications
400 Gbps instance networking 3200 Gbps instance networking

Delivers 2.5x ML training speed Delivers 6x deep learning training

and 60% lower cost than P3 speed and 40% lower cost

© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
 2012

2023

10,000 GPUs
2 GPUs 500B parameters
60M parameters

© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
 CLOS networks

© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
 CLOS networks

AI/ML Challenges
workload
Traffic congestion risks

Inefficient performance

Scaling limits

© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
 Amazon EC2 UltraCluster 1.0
CLOS networks Dedicated network for AI/ML

© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
 Amazon EC2 UltraCluster 1.0
Dedicated network for AI/ML

Challenges

Scale
From portions of buildings to
multiple buildings in a campus

Performance
From 400 Gbps instances
to 3.2 Tbps instances

Availability
Higher convergence time with
traditional protocols: Border Gateway
Protocol (BGP) / Open Shortest Path
First (OSPF)

© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
 Amazon EC2
UltraCluster 2.0

Solutions

New network design Higher performance Improved availability

Flatter and wider network fabric, 10x more bandwidth with non- Innovative SIDR protocol
optimized specifically for the P5 blocking 3.2 Tbps capacity to each optimized for hyperscale to
and future ML accelerators instance ensure safe, rapid convergence

© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
 Traditional TCP routing
The network

Instance Instance
(Source) (Destination)

© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
 Scalable Reliable Datagram (SRD) routing
The network

Instance Instance
(Source) (Destination)

© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
 85 instance types
with ENA Express (SRD)

© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
 Elastic Fabric Adapter (EFA)
• SRD protocol purpose-built for
scalability in the cloud

• Kernel bypass and GPU-direct

Remote Direct Memory Access
(RDMA) for low latency,
high-throughput communication
between GPUs

• Continuing improvements in latency

and completion times

© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS pioneering serverless

AWS Lambda Amazon Elastic Amazon ECS AWS AWS SAM Amazon AWS Lambda AWS Step AWS Lambda AWS Application
preview Container Service service Lambda@Edge implementation EventBridge Amazon Elastic Functions Function URLs Composer
(Amazon ECS) GA auto scaling open source File System Workflow Studio
AWS Lambda GA (Amazon EFS)
AWS Lambda AWS SAM Firecracker Amazon ECS support Amazon AWS Fargate
node.js support local deployment EventBridge larger task size
circuit breaker Scheduler support

AWS Lambda AWS Serverless Amazon ECS GPU Amazon Simple AWS Lambda Amazon ECS and AWS SAM Telemetry Seekable OCI
supports Java Application support Queue Service destinations Amazon EFS Accelerate API (SOCI) for
Model (Amazon SQS) integration Amazon ECS
(AWS SAM) as an event
AWS Fargate source AWS Lambda AWS Identity and Event Amazon ECS
GA provisioned Access filtering Service Connect
Amazon ECS concurrency Management
AWS Lambda AWS Step
FireLens support (AWS IAM)
supports Python, Functions condition keys
5-minute Lambda
functions SnapStart
AWS Fargate
Spot
Amazon
EventBridge
Graviton
Pipes
support for
Lambda and Step Functions
Fargate Distributed Map

© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Technology foundation of AWS Lambda

Firecracker
Secure and fast
microVMs for serverless Better resource Security and isolation Faster startup times
utilization
computing

© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Lambda
SnapStart
Improves cold starts
Leverages Functions start 10x No changes
for Java based functions Firecracker faster to your
technology code

© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Serverless
on AWS Graviton
AWS Lambda AWS Fargate

Up to Up to
AWS Graviton support
for AWS Lambda and
AWS Fargate better price performance* better price performance*

© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
 Nitro Hypervisor
card firmware

Nitro
Security Chip

© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
 Amazon EC2 instance

Users Third-party Applications Operating

libraries systems

What is AWS Secure local channel

Nitro Enclaves? AWS Nitro Enclaves

AWS Nitro Enclaves provide
additional isolation for data in
use
Encrypted Plain text
data processing

CPU and memory isolation

© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
 AWS detects and successfully prevents
hundreds of cyberattacks
every day

© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
 Smart deception Automation Constant evolution

© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
 AWS Web Application Firewall

AWS Security Hub

AWS Network Firewall

Amazon GuardDuty

Sandbox AWS Shield

© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
DDoS attacks blocked Command-and-control Layer 7 DDoS sources
servers intelligence shared dismantled

In Q1 2023 alone

© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
 What will you build?

© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Visit the Migrate. Modernize. Build. resource hub
Dive deeper into these resources:

• 6 steps to success with generative AI

• Understanding the costs of generative AI
• 5 ways a secure cloud infrastructure drives innovation
• 10 ways to optimize costs and innovate with AWS
• Containers and serverless recommendation guide https://tinyurl.com/migrate-modernize-build

• Running Windows workloads on AWS: Your questions answered

• Top 10 reasons to choose AWS for SAP

… and more!

Visit resource hub

© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS Training and Certification
Access 600+ free digital courses with AWS Skill Builder

Focus on the cloud skills and services that are most relevant to you across
30+ AWS solutions, including digital self-paced learning plans and ramp-up
guides

• Build your future in the AWS Cloud at your own pace

https://skillbuilder.aws/
• Advance your skills and knowledge with learning plans
• Validate your cloud expertise with AWS Certification

Learn your way skillbuilder.aws »

© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Why work with an AWS Partner
AWS Partners are uniquely positioned to help your organization at any stage of your
cloud adoption journey, providing

• Innovation – innovative and cost-effective scalable cloud solutions and

capabilities for your organization — helping you keep pace with cutting edge
technology changes

• Expertise – strategic experts and experienced builders, providing

groundbreaking, relevant and reliable solutions to help your business grow Connect with an AWS Partner

• Global Reach – Choose from a global community of trusted AWS Partners

across software, hardware, and services

Connect with an AWS partner

© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Thank you for attending AWS Innovate – Migrate. Modernize. Build.

We hope you found it interesting! A kind reminder to complete the survey.

Let us know what you thought of today’s event and how we can improve the event
experience for you in the future.

[email protected]

twitter.com/AWSCloud

facebook.com/AmazonWebServices

youtube.com/user/AmazonWebServices

linkedin.com/company/amazon-web-services

twitch.tv/aws

© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Thank you!

© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2024, Amazon Web Services, Inc. or its affiliates. All rights reserved.