I N D I A | M A Y 2 5 , 2 0 2 3

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AIML001

Generative AI on AWS - Build and

scale generative AI applications
with foundation models
Praveen Jayakumar
Head of ML Solutions Architecture
AWS India

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Question: What is generative artificial intelligence (AI)?
• Creates new content and ideas, including conversations,
stories, images, videos, and music
• Powered by large models that are pretrained on vast corpuses
of data and commonly referred to as foundation models (FMs)

BLOOM

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Why foundation models?

Tasks Tasks

… … Text generation Text generation

… … Summarization Summarization

Labeled ML Information Unlabeled Foundation Information

data models extraction data model extraction

… … Q&A Q&A

… … Chatbot Chatbot

Train Deploy Pretrain Adapt

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
 Flexibility

Secure
customization

The most cost-

Why AWS for effective
generative AI? infrastructure

The easiest way

to build with FMs

Generative AI-
powered solutions

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
 Flexibility Choose from a wide
selection of FMs built by
AI21 Labs, Anthropic,
Secure
Stability AI, and Amazon to
customization
find the right model for your
use case.
The most cost-
Why AWS for effective
generative AI? infrastructure

The easiest way

to build with FMs

Generative AI-
powered solutions

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
 Flexibility

Secure Customize FMs for your

customization business with just a few
labeled examples. Since all
data is encrypted and does
The most cost-
Why AWS for effective
not leave your Amazon
Virtual Private Cloud (VPC),
generative AI? infrastructure you can trust that your data
will remain private and
The easiest way confidential.
to build with FMs

Generative AI-
powered solutions

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
 Flexibility

Secure
customization

The most cost-

Why AWS for effective
Get the best price
generative AI? infrastructure
performance for generative
AI with infrastructure
powered by AWS-designed
The easiest way ML chips and NVIDIA GPUs.
to build with FMs Cost-effectively scale
infrastructure to train and
run FMs containing hundreds
Generative AI- of billions of parameters.
powered solutions

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
 Flexibility

Secure
customization

The most cost-

Why AWS for effective Quickly integrate and deploy
generative AI? infrastructure FMs into your applications
and workloads running on
AWS using familiar controls
The easiest way
and integrations with the
to build with FMs
depth and breadth of AWS
capabilities and services like
Generative AI- Amazon SageMaker and
powered solutions Amazon S3.

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
 Flexibility

Secure
customization
With generative AI built in,
The most cost- services such as Amazon
Why AWS for effective CodeWhisperer, an AI coding
generative AI? infrastructure companion, can help you
improve productivity. In
addition, you can deploy
The easiest way common generative AI use
to build with FMs cases like call summarization
and question answering using
AWS sample solutions that
Generative AI-
combine AWS AI services with
powered solutions
leading FMs.
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Building with generative AI on AWS

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Foundation models
available through
Amazon SageMaker
JumpStart

Proprietary Models in
Gated Preview only
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Demo

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Bedrock
The easiest way to build and scale
generative AI applications with
foundation models (FMs)

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Bedrock key benefits

Accelerate Choose FMs from Privately customize Enhance your data Use AWS tools and
development of AI21 Labs, Anthropic, FMs using your protection using capabilities that you
generative AI Stability AI, and organization’s data comprehensive AWS are familiar with to
applications using Amazon to find the security capabilities deploy scalable,
FMs through an API, right FM for your use reliable, and secure
without managing case generative AI
infrastructure applications

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Bedrock supports a wide range of
foundation models

FMs from Amazon FMs from AI21 Labs, Anthropic, and Stability AI

Titan Text Titan Jurassic-2 Claude Stable

Embeddings Diffusion

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Titan
INNOVATE RESPONSIBLY WITH HIGH-
PERFORMING FOUNDATION MODELS
(FMs) FROM AMAZON
Benefits
• Built with 20+ years of Amazon
ML experience
• Automate language tasks such as
summarization and text generation with
Amazon Titan Text FM
Titan Text Titan Embeddings
• Enhance search accuracy and improve
focused on for enterprise tasks
personalized recommendations with
NLP tasks such as search and
Amazon Titan Embeddings FM
personalization
• Support responsible use of AI by reducing
inappropriate or harmful content

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Foundation models from top AI startups

Jurassic-2 Claude Stable Diffusion

Multilingual LLMs for text LLM for conversational and text Generation of unique, realistic,
generation in Spanish, French, processing tasks high-quality images, art, logos,
German, Portuguese, Italian, and and designs
Dutch

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Privately customize foundation models
using your organization’s data

Fine-tune

PURPOSE Maximizing accuracy for specific tasks

DATA NEED Small number of labeled examples

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon CodeWhisperer
Build applications faster and more securely
with an AI coding companion

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CodeWhisperer
BUILD APPLICATIONS FASTER AND MORE SECURELY WITH YOUR AI CODING COMPANION

Code generation

AND AND
Go, Rust, PHP, Ruby, Kotlin, C, C++, CLion, GoLand, WebStorm, Rider,
Shell scripting, SQL, and Scala PhpStorm, RubyMine, and DataGrip

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Code generation
• Get multiple code suggestions in seconds based
on natural language (English) description of
coding task and surrounding code
• Code generation can range from single-line
suggestions to full-function blocks
• Provides high-quality suggestions for popular
AWS services
• Generated code matches developer style and
patterns

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Reference tracking

• Trained on billions of lines of code

• Flags code similar to open-source training

data
• Tracks accepted suggestions so that you can
provide appropriate attribution
• Enterprise controls to more easily
deactivate/filter code suggestions similar to
open-source training data

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Security scanning

• Scan generated and developer-written

code to detect security vulnerabilities
• Receive vulnerability remediation
suggestions
• Scan for hard-to-find security
vulnerabilities
• Supports Python, Java, and JavaScript

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Demo

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Summary

• Amazon SageMaker Jumpstart – Foundation Model

• Amazon Bedrock

• Amazon CodeWhisperer

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
skillbuilder.aws

Your time is now

Build in-demand cloud skills your way

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Thank you! Please complete the
session survey

Praveen Jayakumar
Head of ML Solutions Architecture
AWS India

© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.