SlideShare a Scribd company logo
How Azure helps to build
better business processes
and customer experiences
with AI
Maxim Salnikov
Microsoft
• Building on web platform since 90s
• Organizing developer communities and technical conferences
• Speaking, training, blogging: Webdev, Cloud, OpenAI
Helping developers to succeed with the Cloud & AI technology
Maxim.Salnikov@microsoft.com
Let’s connect and chat!
Of AI used by the enterprises over the past several years
Of executives view AI and machine
learning as priorities that they should
be incorporating into their product
lines and businesses
Redmond WA Montreal QB
New York NY
Boston MA
Cambridge, UK
India
Beijing, China
Shanghai, China
Global research
centers
Researchers
employed
worldwide
AI-related
patents
AI research
papers
published
To human parity
on vision,
speech, and
language
2016
2017
2018
2019
2020
2021
2021
ML Platform
Customizable AI Models
Cognitive Services
Scenario-Based Services
Applied AI Services
Application Platform
AI Builder
Applications Partner Solutions
Power BI Power Apps Power Automate Power Virtual Agents
Azure Machine Learning
Vision Speech Language Decision
Azure OpenAI
Service
Immersive Reader
Form Recognizer
Bot Service Video Indexer Metrics Advisor
Cognitive Search
Developers &
Data Scientists
Business
Users
How Azure helps to build better business processes and customer experiences with AI
Ensure that artificial
general intelligence (AGI)
benefits humanity
Empower every person and
organization on the planet
to achieve more
GPT-3.5 and GPT-4
Text
ChatGPT
Conversation
Codex
Code
DALL·E 2
Images
Prompt
Write a tagline for
an ice cream shop.
Prompt
Table customers, columns =
[CustomerId, FirstName,
LastName, Company, Address,
City, State, Country,
PostalCode]
Create a SQL query for all
customers in Texas named Jane
query =
Prompt
A ball of fire with vibrant
colors to show the speed of
innovation at our media and
entertainment company
Response
We serve up smiles
with every scoop!
Response
SELECT *
FROM customers
WHERE State = 'TX' AND
FirstName = 'Jane'
Response
Prompt
I’m having trouble getting
my Xbox to turn on.
Response
There are a few things you
can try to troubleshoot
this issue … …
Prompt
Thanks! That worked. What
games do you recommend for
my 14-year-old?
Response
Here are a few games that you
might consider: …
GPT-3.5 and GPT-4 ChatGPT Codex DALL·E 2
GPT-3.5 & 4 (preview) ChatGPT (preview)
Codex DALL·E 2 (preview)
Azure OpenAI
Content
generation
Call center analytics:
automatically generate
responses to customer inquiries
Generate personalized UI
for your website
Summarization
Call center analytics:
summary of customer
support conversation logs
Subject matter expert document:
summarization (e.g. Financial
reporting, analyst articles)
Social media trends
summarization
Code
generation
Convert natural language to
SQL (or vice versa) for
telemetry data
Convert natural language to
query proprietary data models
Code documentation
Semantic
search
Search reviews for a specific
product/service
Information discovery and
knowledge mining
Azure OpenAI
Finance
Automatically generate
financial summaries
Create natural language
responses for financial queries
IT
Convert natural language to
SQL (or vice versa) for
telemetry data
Convert natural language to
query proprietary data
models
Auto generate code
documentation
Human
resources
Automate recruitment process
by screening resumes and
identifying the most qualified
candidates
Analyze employee sentiment
(e.g., email, etc) providing
insights into company culture
Automate routine tasks
during the onboarding
process, such as sending
welcome emails and
scheduling orientation
sessions
Marketing
Generate idea for content
across different formats (blog
posts, articles, videos, and
social media)
Copywriting: generate ideas,
creating outlines, and writing
dialogue and product
descriptions
Create personalized and
targeted email campaigns to
promote products or services
to a specific audience
Azure OpenAI
Finance
Intelligent Compliance & Risk
Management
Retail Healthcare
Personalised Customer Care
Cost Savings through
Optimised Engagement
Innovation w/ Better /
Alternative Treatment
Comms & Media
Hyper-personalisation
Innovative Content Creation
Intelligent Contact Center
Personalised Customer Care
Cost Savings through
Optimised Engagement
Hyper-personalisation
Innovative Marketing and
Campaigning
Intelligent Contact Center
CarMax produced 11 years'
worth of car summaries in a
matter of months.
Using Azure OpenAI Service
reduces their marketing
freelancer spend.
It also enables them to
provide new information to
their customers faster than
their competitors.
“With Azure OpenAI Service,
we are able to create content
that empowers our customers
so they can be informed
before they make a decision,”
‒ Shamim Mohammad, CarMax executive
vice president and chief information and
technology officer. “
“Azure OpenAI Service is
definitely playing a big part in
our SEO improvement.”
‒ Sean Goetz, Director, Application Systems
Strabag SE builds a risk management
solution to improve efficiency
Challenge
Strabag specializes in construction and related services. The company was
seeking a solution to centralize and better leverage their data in order to
optimize their operations.
Solution
With Microsoft’s Intelligent Data Platform serving as the foundation of Strabag’s
Data Science Hub, they were able to leverage Azure OpenAI Service to create a
solution that allows it to assess the potential impacts of a project in its earliest
stages by comparing it against all its realized projects – therefore minimizing the
risks.
“With this solution, enabled by Azure OpenAI Service, we know when the
weather will prevent us using a crane on-site. Moreover, by the aid of
Generative Design our real estate development unit knows with a few clicks
how much maximum gross floor area they can develop on a site. This kind of
information is vital when you have projects worth two million euros with a
margin of 4-5%.”
Manufacturing Austria
Corporate
(10,000+ employees)
1. A secret step (on the last slide)
2. Request access by submitting a form on azure.microsoft.com
3. Send your first request to Completions API
4. Experiment with models, prompts, parameters
5. Try different options to use your own data
6. Build a product and share with the world! 🎉
“Classic” GPT-3 models
Previous models were text-in and text-out
(i.e., they accepted a prompt string and returned a completion to
append to the prompt).
Answer questions from the context below.
Context:
A neutron star is the collapsed core of a massive
supergiant star, which had a total mass of between 10
and 25 solar masses, possibly more if the star was
especially metal-rich.
Q: What is a neutron star?
A:
The ChatGPT model
The ChatGPT model is conversation-in and message-out.
(i.e., it expects a prompt string that is formatted in a specific chat-
like transcript format and returns a completion that represents a
model-written message in the chat)
<|im_start|>system
Assistant is an AI Chatbot designed to answer questions
from the context provided below.
Context:
A neutron star is the collapsed core of a massive
supergiant star, which had a total mass of between 10
and 25 solar masses, possibly more if the star was
especially metal-rich.
<|im_end|>
<|im_start|>user
What is a neutron star?
<|im_end|>
<|im_start|>assistant
Prompt—Text input that
provides some context to the
engine on what is expecting.
Completion—Output that
GPT-3 generates based on
the prompt.
some context
Token — partial or full words
processed and produced by
the GPT models
Context
Write a
tagline for
our ice cream
shop.
Prompt Response
Scoops of
heaven in the
heart of
Phoenix!
## This is a conversational agent whose code name is Dana:
- Dana is a conversational agent at Gourmet Ice Cream, Inc.
- Gourmet Ice Cream’s marketing team uses Dana to help them be more
effective at their jobs.
- Dana understands Gourmet Ice Cream’s unique product catalog, store
locations, and the company’s strategic goal to continue to go upmarket
## On safety:
- Dana should moderate the responses to be safe, free of harm
and non-controversial.
## On Dana’s ability to gather and present information:
- Dana’s responses connect to the Product Catalog DB, Store Locator DB,
and Microsoft 365 it has access to through the Microsoft Cloud,
providing great CONTEXT
## On Dana’s profile and general capabilities:
- Dana’s responses should be informational and logical
- Dana’s logic and reasoning should be rigorous, intelligent and defensible
Extract precise answers from your unstructured documents with Azure OpenAI + Cognitive Search: article + repo
1. Give clearer instructions
2. Split complex tasks into simpler subtasks
3. Structure the instruction to keep the model on task
4. Prompt the model to explain before answering
5. Ask for justifications of many possible answers, and then synthesize
6. Generate many outputs, and then use the model to pick the best one
7. Fine-tune custom models to maximize performance
How Azure helps to build better business processes and customer experiences with AI
◉ Learn more in the Azure OpenAI WorkshopI
◉ See examples in the Open AI Cookbook
◉ Start experimenting and developing your MVP
◉ Get support and help
◉ How-to guides: Generate embeddings and Fine-tune
◉ Complete embeddings and document search tutorial.
◉ How your/your customer data is processed, used and stored in Azure OpenAI:
Data, privacy and security
◉ Review the Enterprise Data with ChatGPT tech blog, and work through the
accompanying GitHub repository.
◉ Become familiar with the APIs
◉ Understand “What is Azure OpenAI?”: compare Azure OpenAI and
OpenAI. Review key concepts.
◉ Work through Introduction to Azure OpenAI Service training
module
◉ Explore key Responsible AI guidelines and principles
◉ Create an Azure subscription
◉ Apply for access to the Azure OpenAI Service:
https://aka.ms/oai/access )
◉ Watch the video: An Introduction to Azure OpenAI
◉ Get Familiarized with the product content: Azure OpenAI Page
◉ Review how other customers are using Azure AI
Maxim.Salnikov@microsoft.com
Let’s connect and chat!
Ad

Recommended

PPTX
OpenAI-Copilot-ChatGPT.pptx
Udaiappa Ramachandran
 
PDF
Microsoft + OpenAI: Recent Updates (Machine Learning 15minutes! Broadcast #74)
Naoki (Neo) SATO
 
PDF
ChatGPT and not only: how can you use the power of Generative AI at scale
Maxim Salnikov
 
PDF
Best Practice on using Azure OpenAI Service
Kumton Suttiraksiri
 
PDF
Generative-AI-in-enterprise-20230615.pdf
Liming Zhu
 
PDF
GENERATIVE AI, THE FUTURE OF PRODUCTIVITY
Andre Muscat
 
PPTX
The Ideal Approach to Application Modernization; Which Way to the Cloud?
Codit
 
PPTX
introduction Azure OpenAI by Usama wahab khan
Usama Wahab Khan Cloud, Data and AI
 
PDF
Leveraging Generative AI & Best practices
DianaGray10
 
PDF
generative-ai-fundamentals and Large language models
AdventureWorld5
 
PPTX
Generative AI Use cases for Enterprise - Second Session
Gene Leybzon
 
PPTX
Generative AI Use-cases for Enterprise - First Session
Gene Leybzon
 
PPTX
The Future of AI is Generative not Discriminative 5/26/2021
Steve Omohundro
 
PDF
Gen AI Cognizant & AWS event presentation_12 Oct.pdf
PhilipBasford
 
PDF
A Framework for Navigating Generative Artificial Intelligence for Enterprise
RocketSource
 
PPTX
Episode 2: The LLM / GPT / AI Prompt / Data Engineer Roadmap
Anant Corporation
 
PDF
𝐆𝐞𝐧𝐞𝐫𝐚𝐭𝐢𝐯𝐞 𝐀𝐈: 𝐂𝐡𝐚𝐧𝐠𝐢𝐧𝐠 𝐇𝐨𝐰 𝐁𝐮𝐬𝐢𝐧𝐞𝐬𝐬 𝐈𝐧𝐧𝐨𝐯𝐚𝐭𝐞𝐬 𝐚𝐧𝐝 𝐎𝐩𝐞𝐫𝐚𝐭𝐞𝐬
VINCI Digital - Industrial IoT (IIoT) Strategic Advisory
 
PPTX
Copilot to Cover: Why AI can't replace developers with robots, but can make l...
Andy Piper
 
PDF
Using the power of Generative AI at scale
Maxim Salnikov
 
PDF
Unlocking the Power of ChatGPT and AI in Testing - NextSteps, presented by Ap...
Applitools
 
PDF
Challenges in AI LLMs adoption in the Enterprise
George Bara
 
PDF
Unlocking the Power of Generative AI An Executive's Guide.pdf
PremNaraindas1
 
PPTX
Generative AI.pptx
RohitRadhakrishnan8
 
PDF
How Does Generative AI Actually Work? (a quick semi-technical introduction to...
ssuser4edc93
 
PPTX
Understanding cloud with Google Cloud Platform
Dr. Ketan Parmar
 
PDF
Generative AI for the rest of us
Massimo Ferre'
 
PDF
AI and ML Series - Introduction to Generative AI and LLMs - Session 1
DianaGray10
 
PPTX
AzureOpenAI.pptx
Udaiappa Ramachandran
 
PDF
Building Generative AI-infused apps: what's possible and how to start
Maxim Salnikov
 
PDF
ChatGPT and not only: How to use the power of GPT-X models at scale
Maxim Salnikov
 

More Related Content

What's hot (20)

PDF
Leveraging Generative AI & Best practices
DianaGray10
 
PDF
generative-ai-fundamentals and Large language models
AdventureWorld5
 
PPTX
Generative AI Use cases for Enterprise - Second Session
Gene Leybzon
 
PPTX
Generative AI Use-cases for Enterprise - First Session
Gene Leybzon
 
PPTX
The Future of AI is Generative not Discriminative 5/26/2021
Steve Omohundro
 
PDF
Gen AI Cognizant & AWS event presentation_12 Oct.pdf
PhilipBasford
 
PDF
A Framework for Navigating Generative Artificial Intelligence for Enterprise
RocketSource
 
PPTX
Episode 2: The LLM / GPT / AI Prompt / Data Engineer Roadmap
Anant Corporation
 
PDF
𝐆𝐞𝐧𝐞𝐫𝐚𝐭𝐢𝐯𝐞 𝐀𝐈: 𝐂𝐡𝐚𝐧𝐠𝐢𝐧𝐠 𝐇𝐨𝐰 𝐁𝐮𝐬𝐢𝐧𝐞𝐬𝐬 𝐈𝐧𝐧𝐨𝐯𝐚𝐭𝐞𝐬 𝐚𝐧𝐝 𝐎𝐩𝐞𝐫𝐚𝐭𝐞𝐬
VINCI Digital - Industrial IoT (IIoT) Strategic Advisory
 
PPTX
Copilot to Cover: Why AI can't replace developers with robots, but can make l...
Andy Piper
 
PDF
Using the power of Generative AI at scale
Maxim Salnikov
 
PDF
Unlocking the Power of ChatGPT and AI in Testing - NextSteps, presented by Ap...
Applitools
 
PDF
Challenges in AI LLMs adoption in the Enterprise
George Bara
 
PDF
Unlocking the Power of Generative AI An Executive's Guide.pdf
PremNaraindas1
 
PPTX
Generative AI.pptx
RohitRadhakrishnan8
 
PDF
How Does Generative AI Actually Work? (a quick semi-technical introduction to...
ssuser4edc93
 
PPTX
Understanding cloud with Google Cloud Platform
Dr. Ketan Parmar
 
PDF
Generative AI for the rest of us
Massimo Ferre'
 
PDF
AI and ML Series - Introduction to Generative AI and LLMs - Session 1
DianaGray10
 
PPTX
AzureOpenAI.pptx
Udaiappa Ramachandran
 
Leveraging Generative AI & Best practices
DianaGray10
 
generative-ai-fundamentals and Large language models
AdventureWorld5
 
Generative AI Use cases for Enterprise - Second Session
Gene Leybzon
 
Generative AI Use-cases for Enterprise - First Session
Gene Leybzon
 
The Future of AI is Generative not Discriminative 5/26/2021
Steve Omohundro
 
Gen AI Cognizant & AWS event presentation_12 Oct.pdf
PhilipBasford
 
A Framework for Navigating Generative Artificial Intelligence for Enterprise
RocketSource
 
Episode 2: The LLM / GPT / AI Prompt / Data Engineer Roadmap
Anant Corporation
 
𝐆𝐞𝐧𝐞𝐫𝐚𝐭𝐢𝐯𝐞 𝐀𝐈: 𝐂𝐡𝐚𝐧𝐠𝐢𝐧𝐠 𝐇𝐨𝐰 𝐁𝐮𝐬𝐢𝐧𝐞𝐬𝐬 𝐈𝐧𝐧𝐨𝐯𝐚𝐭𝐞𝐬 𝐚𝐧𝐝 𝐎𝐩𝐞𝐫𝐚𝐭𝐞𝐬
VINCI Digital - Industrial IoT (IIoT) Strategic Advisory
 
Copilot to Cover: Why AI can't replace developers with robots, but can make l...
Andy Piper
 
Using the power of Generative AI at scale
Maxim Salnikov
 
Unlocking the Power of ChatGPT and AI in Testing - NextSteps, presented by Ap...
Applitools
 
Challenges in AI LLMs adoption in the Enterprise
George Bara
 
Unlocking the Power of Generative AI An Executive's Guide.pdf
PremNaraindas1
 
Generative AI.pptx
RohitRadhakrishnan8
 
How Does Generative AI Actually Work? (a quick semi-technical introduction to...
ssuser4edc93
 
Understanding cloud with Google Cloud Platform
Dr. Ketan Parmar
 
Generative AI for the rest of us
Massimo Ferre'
 
AI and ML Series - Introduction to Generative AI and LLMs - Session 1
DianaGray10
 
AzureOpenAI.pptx
Udaiappa Ramachandran
 

Similar to How Azure helps to build better business processes and customer experiences with AI (20)

PDF
Building Generative AI-infused apps: what's possible and how to start
Maxim Salnikov
 
PDF
ChatGPT and not only: How to use the power of GPT-X models at scale
Maxim Salnikov
 
PDF
Intro to Product Development
Puja Pramudya
 
PPTX
Global ai night sept 2019 - Milwaukee
Cameron Vetter
 
PPTX
AI at Microsoft for HEC
Alex Danvy
 
PDF
Bhadale group of companies - Our project works
Vijayananda Mohire
 
PDF
Are API Services Taking Over All the Interesting Data Science Problems?
IDEAS - Int'l Data Engineering and Science Association
 
PPTX
Build Your Own Copilot & Agents For Devs
Brian McKeiver
 
PPTX
[DSC MENA 24] Hany_Saad_Gheit_-_Azure_OpenAI_service.pptx
DataScienceConferenc1
 
PDF
201908 Overview of Automated ML
Mark Tabladillo
 
PDF
AI Intelligence: Exploring the Future of Artificial Intelligence
sayalikerimova20
 
PDF
MongoDB World 2018: Building Intelligent Apps with MongoDB & Google Cloud
MongoDB
 
PDF
Maruti gollapudi cv
Maruti Gollapudi
 
PDF
IIBA® Sydney Unlocking the Power of Low Code No Code: Why BAs Hold the Key
AustraliaChapterIIBA
 
PPTX
Tour de France Azure PaaS 6/7 Ajouter de l'intelligence
Alex Danvy
 
PDF
The Future of Data Science
DataWorks Summit
 
PPTX
TechDayPakistan-Slides RAG with Cosmos DB.pptx
Usama Wahab Khan Cloud, Data and AI
 
PPTX
Going open source with small teams
Jamie Thomas
 
PDF
TechEvent 2019: Artificial Intelligence in Dev & Ops; Martin Luckow - Trivadis
Trivadis
 
PDF
ChatGPT-and-Generative-AI-Landscape Working of generative ai search
rohitcse52
 
Building Generative AI-infused apps: what's possible and how to start
Maxim Salnikov
 
ChatGPT and not only: How to use the power of GPT-X models at scale
Maxim Salnikov
 
Intro to Product Development
Puja Pramudya
 
Global ai night sept 2019 - Milwaukee
Cameron Vetter
 
AI at Microsoft for HEC
Alex Danvy
 
Bhadale group of companies - Our project works
Vijayananda Mohire
 
Are API Services Taking Over All the Interesting Data Science Problems?
IDEAS - Int'l Data Engineering and Science Association
 
Build Your Own Copilot & Agents For Devs
Brian McKeiver
 
[DSC MENA 24] Hany_Saad_Gheit_-_Azure_OpenAI_service.pptx
DataScienceConferenc1
 
201908 Overview of Automated ML
Mark Tabladillo
 
AI Intelligence: Exploring the Future of Artificial Intelligence
sayalikerimova20
 
MongoDB World 2018: Building Intelligent Apps with MongoDB & Google Cloud
MongoDB
 
Maruti gollapudi cv
Maruti Gollapudi
 
IIBA® Sydney Unlocking the Power of Low Code No Code: Why BAs Hold the Key
AustraliaChapterIIBA
 
Tour de France Azure PaaS 6/7 Ajouter de l'intelligence
Alex Danvy
 
The Future of Data Science
DataWorks Summit
 
TechDayPakistan-Slides RAG with Cosmos DB.pptx
Usama Wahab Khan Cloud, Data and AI
 
Going open source with small teams
Jamie Thomas
 
TechEvent 2019: Artificial Intelligence in Dev & Ops; Martin Luckow - Trivadis
Trivadis
 
ChatGPT-and-Generative-AI-Landscape Working of generative ai search
rohitcse52
 
Ad

More from Maxim Salnikov (20)

PDF
Azure AI Foundry: The AI app and agent factory
Maxim Salnikov
 
PDF
Reimagining Software Development and DevOps with Agentic AI
Maxim Salnikov
 
PDF
Agentic Techniques in Retrieval-Augmented Generation with Azure AI Search
Maxim Salnikov
 
PDF
Meet the Agents: How AI Is Learning to Think, Plan, and Collaborate
Maxim Salnikov
 
PDF
Privacy-first in-browser Generative AI web apps: offline-ready, future-proof,...
Maxim Salnikov
 
PDF
Evaluation as an Essential Component of the Generative AI Lifecycle
Maxim Salnikov
 
PDF
From Traction to Production Maturing your LLMOps step by step
Maxim Salnikov
 
PDF
Privacy-first in-browser Generative AI web apps: offline-ready, future-proof,...
Maxim Salnikov
 
PDF
Real-world coding with GitHub Copilot: tips & tricks
Maxim Salnikov
 
PDF
AI-assisted development: how to build and ship with confidence
Maxim Salnikov
 
PDF
Prompt Engineering - an Art, a Science, or your next Job Title?
Maxim Salnikov
 
PDF
If your code could speak, what would it tell you? Let GitHub Copilot Chat hel...
Maxim Salnikov
 
PDF
Prompt Engineering - an Art, a Science, or your next Job Title?
Maxim Salnikov
 
PDF
Using the power of OpenAI with your own data: what's possible and how to start?
Maxim Salnikov
 
PDF
If your code could speak, what would it tell you? Let GitHub Copilot Chat hel...
Maxim Salnikov
 
PDF
Prompt Engineering - an Art, a Science, or your next Job Title?
Maxim Salnikov
 
PDF
Web Push Notifications done right
Maxim Salnikov
 
PDF
The Status of Angular v13
Maxim Salnikov
 
PPTX
Azure cloud for the web frontend developers
Maxim Salnikov
 
PDF
[Russian] Сервис-воркеры: используем накопленные знания для светлого будущего...
Maxim Salnikov
 
Azure AI Foundry: The AI app and agent factory
Maxim Salnikov
 
Reimagining Software Development and DevOps with Agentic AI
Maxim Salnikov
 
Agentic Techniques in Retrieval-Augmented Generation with Azure AI Search
Maxim Salnikov
 
Meet the Agents: How AI Is Learning to Think, Plan, and Collaborate
Maxim Salnikov
 
Privacy-first in-browser Generative AI web apps: offline-ready, future-proof,...
Maxim Salnikov
 
Evaluation as an Essential Component of the Generative AI Lifecycle
Maxim Salnikov
 
From Traction to Production Maturing your LLMOps step by step
Maxim Salnikov
 
Privacy-first in-browser Generative AI web apps: offline-ready, future-proof,...
Maxim Salnikov
 
Real-world coding with GitHub Copilot: tips & tricks
Maxim Salnikov
 
AI-assisted development: how to build and ship with confidence
Maxim Salnikov
 
Prompt Engineering - an Art, a Science, or your next Job Title?
Maxim Salnikov
 
If your code could speak, what would it tell you? Let GitHub Copilot Chat hel...
Maxim Salnikov
 
Prompt Engineering - an Art, a Science, or your next Job Title?
Maxim Salnikov
 
Using the power of OpenAI with your own data: what's possible and how to start?
Maxim Salnikov
 
If your code could speak, what would it tell you? Let GitHub Copilot Chat hel...
Maxim Salnikov
 
Prompt Engineering - an Art, a Science, or your next Job Title?
Maxim Salnikov
 
Web Push Notifications done right
Maxim Salnikov
 
The Status of Angular v13
Maxim Salnikov
 
Azure cloud for the web frontend developers
Maxim Salnikov
 
[Russian] Сервис-воркеры: используем накопленные знания для светлого будущего...
Maxim Salnikov
 
Ad

Recently uploaded (20)

PPT
Complete Guideliness to Build an Effective Maintenance Plan.ppt
QualityzeInc1
 
PDF
Decipher SEO Solutions for your startup needs.
mathai2
 
PPTX
IObit Driver Booster Pro 12 Crack Latest Version Download
pcprocore
 
PPTX
Foundations of Marketo Engage - Programs, Campaigns & Beyond - June 2025
BradBedford3
 
PPTX
HYBRIDIZATION OF ALKANES AND ALKENES ...
karishmaduhijod1
 
PDF
Humans vs AI Call Agents - Qcall.ai's Special Report
Udit Goenka
 
PDF
Heat Treatment Process Automation in India
Reckers Mechatronics
 
DOCX
Zoho Creator Solution for EI by Elsner Technologies.docx
Elsner Technologies Pvt. Ltd.
 
PDF
Building Geospatial Data Warehouse for GIS by GIS with FME
Safe Software
 
PPTX
IDM Crack with Internet Download Manager 6.42 [Latest 2025]
HyperPc soft
 
PPTX
arctitecture application system design os dsa
za241967
 
PDF
Modern Platform Engineering with Choreo - The AI-Native Internal Developer Pl...
WSO2
 
PDF
Best Practice for LLM Serving in the Cloud
Alluxio, Inc.
 
PDF
Y - Recursion The Hard Way GopherCon EU 2025
Eleanor McHugh
 
DOCX
Best AI-Powered Wearable Tech for Remote Health Monitoring in 2025
SEOLIFT - SEO Company London
 
PDF
CodeCleaner: Mitigating Data Contamination for LLM Benchmarking
arabelatso
 
PDF
From Data Preparation to Inference: How Alluxio Speeds Up AI
Alluxio, Inc.
 
PDF
OpenChain Webinar - AboutCode - Practical Compliance in One Stack – Licensing...
Shane Coughlan
 
PDF
Why Edge Computing Matters in Mobile Application Tech.pdf
IMG Global Infotech
 
PDF
On-Device AI: Is It Time to Go All-In, or Do We Still Need the Cloud?
Hassan Abid
 
Complete Guideliness to Build an Effective Maintenance Plan.ppt
QualityzeInc1
 
Decipher SEO Solutions for your startup needs.
mathai2
 
IObit Driver Booster Pro 12 Crack Latest Version Download
pcprocore
 
Foundations of Marketo Engage - Programs, Campaigns & Beyond - June 2025
BradBedford3
 
HYBRIDIZATION OF ALKANES AND ALKENES ...
karishmaduhijod1
 
Humans vs AI Call Agents - Qcall.ai's Special Report
Udit Goenka
 
Heat Treatment Process Automation in India
Reckers Mechatronics
 
Zoho Creator Solution for EI by Elsner Technologies.docx
Elsner Technologies Pvt. Ltd.
 
Building Geospatial Data Warehouse for GIS by GIS with FME
Safe Software
 
IDM Crack with Internet Download Manager 6.42 [Latest 2025]
HyperPc soft
 
arctitecture application system design os dsa
za241967
 
Modern Platform Engineering with Choreo - The AI-Native Internal Developer Pl...
WSO2
 
Best Practice for LLM Serving in the Cloud
Alluxio, Inc.
 
Y - Recursion The Hard Way GopherCon EU 2025
Eleanor McHugh
 
Best AI-Powered Wearable Tech for Remote Health Monitoring in 2025
SEOLIFT - SEO Company London
 
CodeCleaner: Mitigating Data Contamination for LLM Benchmarking
arabelatso
 
From Data Preparation to Inference: How Alluxio Speeds Up AI
Alluxio, Inc.
 
OpenChain Webinar - AboutCode - Practical Compliance in One Stack – Licensing...
Shane Coughlan
 
Why Edge Computing Matters in Mobile Application Tech.pdf
IMG Global Infotech
 
On-Device AI: Is It Time to Go All-In, or Do We Still Need the Cloud?
Hassan Abid
 

How Azure helps to build better business processes and customer experiences with AI

  • 1. How Azure helps to build better business processes and customer experiences with AI Maxim Salnikov Microsoft
  • 2. • Building on web platform since 90s • Organizing developer communities and technical conferences • Speaking, training, blogging: Webdev, Cloud, OpenAI Helping developers to succeed with the Cloud & AI technology [email protected] Let’s connect and chat!
  • 3. Of AI used by the enterprises over the past several years Of executives view AI and machine learning as priorities that they should be incorporating into their product lines and businesses
  • 4. Redmond WA Montreal QB New York NY Boston MA Cambridge, UK India Beijing, China Shanghai, China Global research centers Researchers employed worldwide AI-related patents AI research papers published To human parity on vision, speech, and language
  • 6. ML Platform Customizable AI Models Cognitive Services Scenario-Based Services Applied AI Services Application Platform AI Builder Applications Partner Solutions Power BI Power Apps Power Automate Power Virtual Agents Azure Machine Learning Vision Speech Language Decision Azure OpenAI Service Immersive Reader Form Recognizer Bot Service Video Indexer Metrics Advisor Cognitive Search Developers & Data Scientists Business Users
  • 8. Ensure that artificial general intelligence (AGI) benefits humanity Empower every person and organization on the planet to achieve more GPT-3.5 and GPT-4 Text ChatGPT Conversation Codex Code DALL·E 2 Images
  • 9. Prompt Write a tagline for an ice cream shop. Prompt Table customers, columns = [CustomerId, FirstName, LastName, Company, Address, City, State, Country, PostalCode] Create a SQL query for all customers in Texas named Jane query = Prompt A ball of fire with vibrant colors to show the speed of innovation at our media and entertainment company Response We serve up smiles with every scoop! Response SELECT * FROM customers WHERE State = 'TX' AND FirstName = 'Jane' Response Prompt I’m having trouble getting my Xbox to turn on. Response There are a few things you can try to troubleshoot this issue … … Prompt Thanks! That worked. What games do you recommend for my 14-year-old? Response Here are a few games that you might consider: … GPT-3.5 and GPT-4 ChatGPT Codex DALL·E 2
  • 10. GPT-3.5 & 4 (preview) ChatGPT (preview) Codex DALL·E 2 (preview)
  • 11. Azure OpenAI Content generation Call center analytics: automatically generate responses to customer inquiries Generate personalized UI for your website Summarization Call center analytics: summary of customer support conversation logs Subject matter expert document: summarization (e.g. Financial reporting, analyst articles) Social media trends summarization Code generation Convert natural language to SQL (or vice versa) for telemetry data Convert natural language to query proprietary data models Code documentation Semantic search Search reviews for a specific product/service Information discovery and knowledge mining
  • 12. Azure OpenAI Finance Automatically generate financial summaries Create natural language responses for financial queries IT Convert natural language to SQL (or vice versa) for telemetry data Convert natural language to query proprietary data models Auto generate code documentation Human resources Automate recruitment process by screening resumes and identifying the most qualified candidates Analyze employee sentiment (e.g., email, etc) providing insights into company culture Automate routine tasks during the onboarding process, such as sending welcome emails and scheduling orientation sessions Marketing Generate idea for content across different formats (blog posts, articles, videos, and social media) Copywriting: generate ideas, creating outlines, and writing dialogue and product descriptions Create personalized and targeted email campaigns to promote products or services to a specific audience
  • 13. Azure OpenAI Finance Intelligent Compliance & Risk Management Retail Healthcare Personalised Customer Care Cost Savings through Optimised Engagement Innovation w/ Better / Alternative Treatment Comms & Media Hyper-personalisation Innovative Content Creation Intelligent Contact Center Personalised Customer Care Cost Savings through Optimised Engagement Hyper-personalisation Innovative Marketing and Campaigning Intelligent Contact Center
  • 14. CarMax produced 11 years' worth of car summaries in a matter of months. Using Azure OpenAI Service reduces their marketing freelancer spend. It also enables them to provide new information to their customers faster than their competitors. “With Azure OpenAI Service, we are able to create content that empowers our customers so they can be informed before they make a decision,” ‒ Shamim Mohammad, CarMax executive vice president and chief information and technology officer. “ “Azure OpenAI Service is definitely playing a big part in our SEO improvement.” ‒ Sean Goetz, Director, Application Systems
  • 15. Strabag SE builds a risk management solution to improve efficiency Challenge Strabag specializes in construction and related services. The company was seeking a solution to centralize and better leverage their data in order to optimize their operations. Solution With Microsoft’s Intelligent Data Platform serving as the foundation of Strabag’s Data Science Hub, they were able to leverage Azure OpenAI Service to create a solution that allows it to assess the potential impacts of a project in its earliest stages by comparing it against all its realized projects – therefore minimizing the risks. “With this solution, enabled by Azure OpenAI Service, we know when the weather will prevent us using a crane on-site. Moreover, by the aid of Generative Design our real estate development unit knows with a few clicks how much maximum gross floor area they can develop on a site. This kind of information is vital when you have projects worth two million euros with a margin of 4-5%.” Manufacturing Austria Corporate (10,000+ employees)
  • 16. 1. A secret step (on the last slide) 2. Request access by submitting a form on azure.microsoft.com 3. Send your first request to Completions API 4. Experiment with models, prompts, parameters 5. Try different options to use your own data 6. Build a product and share with the world! 🎉
  • 17. “Classic” GPT-3 models Previous models were text-in and text-out (i.e., they accepted a prompt string and returned a completion to append to the prompt). Answer questions from the context below. Context: A neutron star is the collapsed core of a massive supergiant star, which had a total mass of between 10 and 25 solar masses, possibly more if the star was especially metal-rich. Q: What is a neutron star? A: The ChatGPT model The ChatGPT model is conversation-in and message-out. (i.e., it expects a prompt string that is formatted in a specific chat- like transcript format and returns a completion that represents a model-written message in the chat) <|im_start|>system Assistant is an AI Chatbot designed to answer questions from the context provided below. Context: A neutron star is the collapsed core of a massive supergiant star, which had a total mass of between 10 and 25 solar masses, possibly more if the star was especially metal-rich. <|im_end|> <|im_start|>user What is a neutron star? <|im_end|> <|im_start|>assistant
  • 18. Prompt—Text input that provides some context to the engine on what is expecting. Completion—Output that GPT-3 generates based on the prompt. some context Token — partial or full words processed and produced by the GPT models
  • 19. Context Write a tagline for our ice cream shop. Prompt Response Scoops of heaven in the heart of Phoenix! ## This is a conversational agent whose code name is Dana: - Dana is a conversational agent at Gourmet Ice Cream, Inc. - Gourmet Ice Cream’s marketing team uses Dana to help them be more effective at their jobs. - Dana understands Gourmet Ice Cream’s unique product catalog, store locations, and the company’s strategic goal to continue to go upmarket ## On safety: - Dana should moderate the responses to be safe, free of harm and non-controversial. ## On Dana’s ability to gather and present information: - Dana’s responses connect to the Product Catalog DB, Store Locator DB, and Microsoft 365 it has access to through the Microsoft Cloud, providing great CONTEXT ## On Dana’s profile and general capabilities: - Dana’s responses should be informational and logical - Dana’s logic and reasoning should be rigorous, intelligent and defensible
  • 20. Extract precise answers from your unstructured documents with Azure OpenAI + Cognitive Search: article + repo
  • 21. 1. Give clearer instructions 2. Split complex tasks into simpler subtasks 3. Structure the instruction to keep the model on task 4. Prompt the model to explain before answering 5. Ask for justifications of many possible answers, and then synthesize 6. Generate many outputs, and then use the model to pick the best one 7. Fine-tune custom models to maximize performance
  • 23. ◉ Learn more in the Azure OpenAI WorkshopI ◉ See examples in the Open AI Cookbook ◉ Start experimenting and developing your MVP ◉ Get support and help ◉ How-to guides: Generate embeddings and Fine-tune ◉ Complete embeddings and document search tutorial. ◉ How your/your customer data is processed, used and stored in Azure OpenAI: Data, privacy and security ◉ Review the Enterprise Data with ChatGPT tech blog, and work through the accompanying GitHub repository. ◉ Become familiar with the APIs ◉ Understand “What is Azure OpenAI?”: compare Azure OpenAI and OpenAI. Review key concepts. ◉ Work through Introduction to Azure OpenAI Service training module ◉ Explore key Responsible AI guidelines and principles ◉ Create an Azure subscription ◉ Apply for access to the Azure OpenAI Service: https://aka.ms/oai/access ) ◉ Watch the video: An Introduction to Azure OpenAI ◉ Get Familiarized with the product content: Azure OpenAI Page ◉ Review how other customers are using Azure AI