Microsoft + OpenAI: Recent Updates (Machine Learning 15minutes! Broadcast #74)
3 likes3,119 views
The document provides an overview of advancements in artificial intelligence from 1956 to 2023, highlighting key technologies like GPT-3, Codex, and DALL·E. It discusses Microsoft's partnership with OpenAI to enhance AI capabilities in platforms such as Bing and Azure, aimed at empowering users and improving productivity. The document also covers various applications of AI, including language processing, coding assistance, and customer service analytics, showcasing the potential of generative AI to transform various industries.
![Generative AI
Prompt:
Write a tagline for an ice
cream shop.
Response:
We serve up smiles with every
scoop!
Prompt:
Table customers, columns =
[CustomerId, FirstName,
LastName, Company, Address,
City, State, Country,
PostalCode]
Create a SQL query for all
customers in Texas named Jane
query =
Response:
SELECT *
FROM customers
WHERE State = 'TX' AND
FirstName = 'Jane'
Prompt: A white Siamese cat
Response:
GPT-3 Codex DALL·E](https://image.slidesharecdn.com/20230225ml15minmicrosoftopenairecentupdates-230225060031-4caefdba/85/Microsoft-OpenAI-Recent-Updates-Machine-Learning-15minutes-Broadcast-74-7-320.jpg)
Microsoft + OpenAI: Recent Updates (Machine Learning 15minutes! Broadcast #74)
- 2. 1956 Artificial Intelligence 1997 Machine Learning 2017 Deep Learning 2021 Generative AI
- 3. GPT-3: We’re at the very beginning of a new app ecosystem | VentureBeat How the tech behind ChatGPT could change the world—an updated episode from our archive | The Economist OpenAI’s ChatGPT is a fascinating glimpse into the scary power of AI - Vox dall-e | TechCrunch A.I. Can Now Write Its Own Computer Code. That’s Good News for Humans. - The New York Times (nytimes.com) Microsoft Bets Big on the Creator of ChatGPT in Race to Dominate A.I. - The New York Times (nytimes.com)
- 6. Ensure that artificial general intelligence (AGI) benefits humanity. Empower every person and organization on the planet to achieve more GPT-3 Generate and Understand Text Codex Generate and Understand Code DALL·E Generate images from text prompts
- 7. Generative AI Prompt: Write a tagline for an ice cream shop. Response: We serve up smiles with every scoop! Prompt: Table customers, columns = [CustomerId, FirstName, LastName, Company, Address, City, State, Country, PostalCode] Create a SQL query for all customers in Texas named Jane query = Response: SELECT * FROM customers WHERE State = 'TX' AND FirstName = 'Jane' Prompt: A white Siamese cat Response: GPT-3 Codex DALL·E
- 8. The new Bing
- 12. Search 20 years ago Search today
- 13. Search
- 14. Powerful & Exciting Generative AI Reliable and Well-Known Search Search + AI = The Answer Engine ChatGPT Bing
- 15. AI-powered copilot for the web Joy of discovery
- 16. AI-powered copilot for the web A better Search It’s search you are familiar with that’s safe, more reliable, and delivers results like you expect. Web navigations Weather queries Answers for You It reviews results from across the web to find and summarize the answer you're looking for. Comprehensive summary Comparative insights A new chat experience Use chat to ask questions and get suggestions. It helps refine complicated research to get better recommendations. Travel planning Shopping research Sparks your Creativity You’re no longer limited by searching for what already exists. It helps you create new content with just a description. Draft an email Create a meal plan Responsible & Safe Gives value back Built as a platform Scenarios Foundational Bing
- 19. ML Platform Customizable AI Models Cognitive Services Scenario-Based Services Applied AI Services Application Platform AI Builder Applications Azure AI Partner Solutions Power BI Power Apps Power Automate Power Virtual Agents Azure Machine Learning Vision Speech Language Decision OpenAI Service Immersive Reader Form Recognizer Bot Service Video Indexer Metrics Advisor Cognitive Search Developers & Data Scientists Business Users
- 20. Azure OpenAI Service GPT-3 Codex DALL·E (preview)
- 22. Inferencing time Capability Ada • Simple classification • Parsing and formatting text Curie • Answering questions • Complex, nuanced classification Davinci • Summarizing for specific audience • Generating creative content Babbage • Semantic search ranking • Moderately complex classification Azure OpenAI Service models Cushman-codex Davinci-codex Capability Codex GPT-3
- 23. Comments from code Code refactoring Creative Ideation Image Generation Virtual Assistants Subject Research Essay outlines Poem creation Azure OpenAI | Capabilities Language Translation Summarizing text Extracting insights Classifying text Answering questions Dialog agents Semantic search Writing assistance Code generation
- 24. Azure OpenAI | Top 4 Capabilities & Use Cases Call Center Analytics: Summary of customer support conversation logs Convert Natural Language to SQL (or vice versa) for telemetry data Subject Matter Expert Document Summarization (e.g. financial reporting, analyst articles) Convert Natural Language to Query Proprietary Data Models Code Documentation Search reviews for a specific product / service Social Media Trends Summarization Information Discovery and Knowledge Mining End to End Call Center Analytics: Classification, Sentiment, Entity Extraction, Summarization and Email Generation Customer 360: Hyper-personalisation using timely Summarization of customer queries & trends, Search, and Content Generation Call Center Analytics: Automatically generate responses to customer inquiries Generate personalised UI for your website Business Process Automation: Search through structured & unstructured documentation, Generate Code to query data models, Content Generation
- 25. Produced 11 years' worth of car summaries in a matter of Months
- 26. Power BI Web Application Cosmos DB PDF OCR pipeline Azure Cognitive Search Azure OpenAI Service Azure Form Recognizer Documents Document Process Automation Extract rich insights from documents and summarizing them
- 27. Contact Center Analytics using Speech API & OpenAI Extract rich insights from call transcripts Call-Center Agent Person-to-Person Conversation Caller Telephony Server Azure Storage Azure Cognitive Services – Speech & OpenAI Intelligent Transcription Speech-to-Text Azure OpenAI Service Conversation Trends & Insights PowerBI Insights (near real-time) Audio Files Detailed call history incl. summaries, call reasons, etc. CRM
- 28. Generative pre-trained transformer 3 (GPT-3) Azure OpenAI | Overview of GPT-3
- 29. Powerful language models accessible to all skill levels Simple UX—validate proof of concepts fast Built in ML science intuition for everyone, with deeper controls for ML practitioners General purpose text-in/text-out interface—flexibility Azure OpenAI | GPT-3 Models
- 30. Prompt – Text input that provides some context to the engine on what is expecting. Completion – Output that GPT-3 generates based on the prompt. some context Azure OpenAI | GPT-3 Prompt Design
- 31. Azure OpenAI Instruction Output Customer conversation Azure OpenAI | Sample Use Cases
- 32. Customer conversation in English (or other language) Azure OpenAI Instruction in English Output as JSON Azure OpenAI | Sample Use Cases
- 33. Input - German Azure OpenAI Instruction - English Output - English Azure OpenAI | Sample Use Cases
- 34. Azure OpenAI | GPT-3 Ideate, Experiment and Fine-Tune
- 35. Azure OpenAI | Considerations Vision Speech Language Decision OpenAI Service I need a general-purpose model that can handle multiple tasks. e.g. translation+entity recognition+sentiment analysis I need to generate human-like content, whilst preserving data privacy and security e.g., abstractive summarization, content writing, paraphrasing, code I could use a model with little or no training I need rapid prototyping and quick time to market for many use cases I want to explore solutions / use cases that have been described previously Azure AI Cognitive Services
- 36. Azure OpenAI | Benefits Enhanced customer experience with a greater focus on customer-centric services and products, whilst utilizing feedback and trends better Increased efficiency and productivity by getting more done in lesser time through rapid prototyping and quicker time to market* Faster time to realize value Easy to use: Even junior data scientists or business users can use Azure OpenAI Service Playground Ensure data privacy & security, and implement it in a responsible manner using a Trusted Cloud Provider Does not require a long tedious annotation process* Less training data is required for many relevant use cases* * in most relevant use cases observed Ability to perform text analytics and generation tasks that up until now were reserved only to humans
- 37. Accelerates software development Makes APIs more accessible Widens who can code OpenAI Codex
- 38. OpenAI Codex Models Derived from base models and trained on both NL and code (billions of Lines of Code) Support multiple programming languages Multiple tasks: Use Cases
- 39. Codex Models
- 40. GitHub Copilot Your AI pair programmer
- 41. Provide editor context Provide suggestions Improve suggestions
- 42. Power BI Generating DAX expressions with natural language
- 43. Power Platform Power Fx formulas
- 44. Accelerate designs or inspire creative decision Generate an infinite number of images with simple text prompts Build capability into enterprise applications through APIs and SDKs DALL•E 2 Preview