SlideShare a Scribd company logo
APPS ON GOOGLE
ASSISTANT USING
ACTIONS
GAURAV BHATNAGAR
AGENDA
• Background
• Google AssistantWorkflow
• How Assistant provides customized response.
• Dialogflow and all its main components
• Demo of an example
• Basics of Conversation design
• GUI vsVUI
BACKGROUND
• Google Assistant is currently available on more than 400 million devices around the
world.
• It is available in phones(iOS or android), tablets, cars, Chromebook & Home Devices.
GOOGLE ASSISTANT STATS
GOOGLE ASSISTANT WORKFLOW
Source : https://dialogflow.com/docs/agents
DIFFERENT APPROACHES FOR CUSTOMIZED
ASSISTANT APPS
GOOGLE ASSISTANT WORKFLOW (USING
DIALOGFLOW)
Source : https://dialogflow.com/docs/agents
DIALOGFLOW
• Agents
Agents are NLU Modules built with the help of contexts, intent priorities, responsibilities, and fulfillment via webhook.
• Intents
They represent a mapping between what a user says and what action should be taken by your customized software.
• Contexts
They are designed for passing on information based on user’s preferences, geographic location.
• Fulfillment
This component connects your Dialogflow agent to your services,APIs and/or databases. It connects to webhooks via Actions on Google.
• Entities,Actions, Parameters…..
INTEGRATIONS PROVIDED BY DIALOGFLOW
Source : https://dialogflow.com/docs/integrations
SHOWING AN EXAMPLE
DEMO
CONVERSATION DESIGN
• It is basically a design language based on human conversation.
• We are providing an experience and merely not just an application.
• Creating a System and User persona.
• Conversation Design should be built on cooperative principle.
Conversations should always be designed to provide comfortable, frictionless and user
centric experience.
• Group devices by the components used in conversation : For e.g. Google Home/ Pixel.
BUILDING BLOCKS FOR CONVERSATION
• Expect users to give more information.
• Try to always keep the dialog towards the use case you are trying to solve.
• Try to always move the conversation forward.
• Try to keep the conversation optimized for relevance and provide clarity in answers.
• Try to understand the context and listen between the lines.
• Follow-up conversations should have the context attached.
• Keep the conversation going by taking turns and not try to monopolize.
Google assistant basics
ALWAYS KEEPING REAL LIFE USER CONDITIONS IN
MIND
Interrupted Cut off too soon No way out Accent Language
understanding
Self Correction Confused Side Speech Valid but not in
grammar
Didn’t Understand
Background noise Ask a question
back.
Coughs Talked too long Too quiet
Hesitate Know options by
some other
manner
Stutter Start Too many choices Poor connection
In Conversations, there are no “Errors”.
REFERENCES
• Actions on Google Developers : https://developers.google.com/actions.
• https://developers.google.com/actions/design/
• https://dialogflow.com
• https://caster.io/courses/google-assistant-app-with-zero-code

More Related Content

What's hot (18)

An Overview of Google Assistant
An Overview of Google Assistant An Overview of Google Assistant
An Overview of Google Assistant
Cynoteck Technology Solutions Private Limited
 
Amazon Echo vs Google Home: The Smart Home Begins
Amazon Echo vs Google Home: The Smart Home BeginsAmazon Echo vs Google Home: The Smart Home Begins
Amazon Echo vs Google Home: The Smart Home Begins
Blue Dress® Internet Marketing
 
Building Conversational Experiences with Actions on Google
Building Conversational Experiences with Actions on GoogleBuilding Conversational Experiences with Actions on Google
Building Conversational Experiences with Actions on Google
Peter Friese
 
Google home
Google homeGoogle home
Google home
Iqbal Shaikh
 
Voice recognition system
Voice recognition systemVoice recognition system
Voice recognition system
DEEPENDRA KORI
 
Alexa-An intelligent voice-controlled personal assistant by AMAZON
Alexa-An intelligent voice-controlled personal assistant by AMAZONAlexa-An intelligent voice-controlled personal assistant by AMAZON
Alexa-An intelligent voice-controlled personal assistant by AMAZON
Anusha Deva
 
6. production reflection
6. production reflection6. production reflection
6. production reflection
Joshua Palmer
 
Amazon Echo
Amazon EchoAmazon Echo
Amazon Echo
Harshit Shah
 
Evaluation Q1 Part A
Evaluation Q1 Part AEvaluation Q1 Part A
Evaluation Q1 Part A
sophiejake
 
SimpleK12 webinar - Increase Classroom Mobility & Control an IWB 020913
SimpleK12 webinar - Increase Classroom Mobility & Control an IWB 020913SimpleK12 webinar - Increase Classroom Mobility & Control an IWB 020913
SimpleK12 webinar - Increase Classroom Mobility & Control an IWB 020913
Christopher Casal
 
3. audio production experiments 1
3. audio production experiments 13. audio production experiments 1
3. audio production experiments 1
OliverFrost4
 
IoT showdown: Amazon Echo vs Google Home
IoT showdown: Amazon Echo vs Google HomeIoT showdown: Amazon Echo vs Google Home
IoT showdown: Amazon Echo vs Google Home
Thelton McMillian
 
Google Home Mini (كاش باك)
Google Home Mini (كاش باك)Google Home Mini (كاش باك)
Google Home Mini (كاش باك)
Panda7CashBack
 
Google Home
Google HomeGoogle Home
Google Home
Noor Fatima
 
Tim Peacock - Emotion AI Developer Day 2016
Tim Peacock - Emotion AI Developer Day 2016Tim Peacock - Emotion AI Developer Day 2016
Tim Peacock - Emotion AI Developer Day 2016
Affectiva
 
Amazon Alexa
Amazon AlexaAmazon Alexa
Amazon Alexa
Akhil john
 
LO1 - Lesson 1 - Controls
LO1 - Lesson 1 - ControlsLO1 - Lesson 1 - Controls
LO1 - Lesson 1 - Controls
The English Martyrs School & Sixth Form College
 
Sound fx
Sound fxSound fx
Sound fx
MartinDevney
 
Building Conversational Experiences with Actions on Google
Building Conversational Experiences with Actions on GoogleBuilding Conversational Experiences with Actions on Google
Building Conversational Experiences with Actions on Google
Peter Friese
 
Voice recognition system
Voice recognition systemVoice recognition system
Voice recognition system
DEEPENDRA KORI
 
Alexa-An intelligent voice-controlled personal assistant by AMAZON
Alexa-An intelligent voice-controlled personal assistant by AMAZONAlexa-An intelligent voice-controlled personal assistant by AMAZON
Alexa-An intelligent voice-controlled personal assistant by AMAZON
Anusha Deva
 
6. production reflection
6. production reflection6. production reflection
6. production reflection
Joshua Palmer
 
Evaluation Q1 Part A
Evaluation Q1 Part AEvaluation Q1 Part A
Evaluation Q1 Part A
sophiejake
 
SimpleK12 webinar - Increase Classroom Mobility & Control an IWB 020913
SimpleK12 webinar - Increase Classroom Mobility & Control an IWB 020913SimpleK12 webinar - Increase Classroom Mobility & Control an IWB 020913
SimpleK12 webinar - Increase Classroom Mobility & Control an IWB 020913
Christopher Casal
 
3. audio production experiments 1
3. audio production experiments 13. audio production experiments 1
3. audio production experiments 1
OliverFrost4
 
IoT showdown: Amazon Echo vs Google Home
IoT showdown: Amazon Echo vs Google HomeIoT showdown: Amazon Echo vs Google Home
IoT showdown: Amazon Echo vs Google Home
Thelton McMillian
 
Google Home Mini (كاش باك)
Google Home Mini (كاش باك)Google Home Mini (كاش باك)
Google Home Mini (كاش باك)
Panda7CashBack
 
Tim Peacock - Emotion AI Developer Day 2016
Tim Peacock - Emotion AI Developer Day 2016Tim Peacock - Emotion AI Developer Day 2016
Tim Peacock - Emotion AI Developer Day 2016
Affectiva
 

Similar to Google assistant basics (20)

Google Assistant Revolution
Google Assistant RevolutionGoogle Assistant Revolution
Google Assistant Revolution
Rafael Casuso Romate
 
Building Conversational Experiences for Google Assistant '18
Building Conversational Experiences for Google Assistant '18Building Conversational Experiences for Google Assistant '18
Building Conversational Experiences for Google Assistant '18
Abdelrahman Omran
 
Google Actions - Hack Night Workshop 1
Google Actions - Hack Night Workshop 1Google Actions - Hack Night Workshop 1
Google Actions - Hack Night Workshop 1
Zubin Pratap
 
The Voice Interface Revolution
The Voice Interface RevolutionThe Voice Interface Revolution
The Voice Interface Revolution
Rafael Casuso Romate
 
Building High-Quality Apps for Google Assistant
Building High-Quality Apps for Google AssistantBuilding High-Quality Apps for Google Assistant
Building High-Quality Apps for Google Assistant
Peter Friese
 
Building Conversational Experiences with Actions on Google
Building Conversational Experiences with Actions on Google Building Conversational Experiences with Actions on Google
Building Conversational Experiences with Actions on Google
Peter Friese
 
Build a homemade AI device. Antimo Musone - Ernst & Young
Build a homemade AI device. Antimo Musone - Ernst & YoungBuild a homemade AI device. Antimo Musone - Ernst & Young
Build a homemade AI device. Antimo Musone - Ernst & Young
Data Driven Innovation
 
Naomi Makofsky - Connecting with your customer via conversation
Naomi Makofsky - Connecting with your customer via conversation Naomi Makofsky - Connecting with your customer via conversation
Naomi Makofsky - Connecting with your customer via conversation
Hilary Ip
 
Creating Voice User interfaces from scratch
Creating Voice User interfaces from scratchCreating Voice User interfaces from scratch
Creating Voice User interfaces from scratch
Stoyan Stoyanov
 
EIA2017Portugal - Martin Omander - Build your own app for Google Home
EIA2017Portugal - Martin Omander - Build your own app for Google HomeEIA2017Portugal - Martin Omander - Build your own app for Google Home
EIA2017Portugal - Martin Omander - Build your own app for Google Home
European Innovation Academy
 
EIA2017Italy - Martin Omander - Build Your Own App for Google Home
EIA2017Italy - Martin Omander - Build Your Own App for Google HomeEIA2017Italy - Martin Omander - Build Your Own App for Google Home
EIA2017Italy - Martin Omander - Build Your Own App for Google Home
European Innovation Academy
 
#MTC2019: Dialog z klientem w Erze Asystentów - Michal Dlugosz (Google)
#MTC2019: Dialog z klientem w Erze Asystentów - Michal Dlugosz (Google)#MTC2019: Dialog z klientem w Erze Asystentów - Michal Dlugosz (Google)
#MTC2019: Dialog z klientem w Erze Asystentów - Michal Dlugosz (Google)
Mobile Trends
 
Engage user with actions
Engage user with actionsEngage user with actions
Engage user with actions
Matteo Bonifazi
 
Building your actions for Google Assistant
Building your actions for Google AssistantBuilding your actions for Google Assistant
Building your actions for Google Assistant
Ahmed Abu Eldahab
 
Antimo Musone - Vocal Assistant - build natural and rich conversational exper...
Antimo Musone - Vocal Assistant - build natural and rich conversational exper...Antimo Musone - Vocal Assistant - build natural and rich conversational exper...
Antimo Musone - Vocal Assistant - build natural and rich conversational exper...
Codemotion
 
VUI Design
VUI DesignVUI Design
VUI Design
Ido Green
 
The future of conversation ui
The future of conversation uiThe future of conversation ui
The future of conversation ui
Andrés Leonardo Martinez Ortiz
 
Designing Voice Applications - Create For Voice
Designing Voice Applications - Create For VoiceDesigning Voice Applications - Create For Voice
Designing Voice Applications - Create For Voice
Kasia Ryniak
 
Conversational UI Design and Research at UXSEA Summit 2018
Conversational UI Design and Research at UXSEA Summit 2018Conversational UI Design and Research at UXSEA Summit 2018
Conversational UI Design and Research at UXSEA Summit 2018
Kuldeep Kulshreshtha
 
Designing Conversation for Google Assistant
Designing Conversation for Google AssistantDesigning Conversation for Google Assistant
Designing Conversation for Google Assistant
GITS Indonesia
 
Building Conversational Experiences for Google Assistant '18
Building Conversational Experiences for Google Assistant '18Building Conversational Experiences for Google Assistant '18
Building Conversational Experiences for Google Assistant '18
Abdelrahman Omran
 
Google Actions - Hack Night Workshop 1
Google Actions - Hack Night Workshop 1Google Actions - Hack Night Workshop 1
Google Actions - Hack Night Workshop 1
Zubin Pratap
 
Building High-Quality Apps for Google Assistant
Building High-Quality Apps for Google AssistantBuilding High-Quality Apps for Google Assistant
Building High-Quality Apps for Google Assistant
Peter Friese
 
Building Conversational Experiences with Actions on Google
Building Conversational Experiences with Actions on Google Building Conversational Experiences with Actions on Google
Building Conversational Experiences with Actions on Google
Peter Friese
 
Build a homemade AI device. Antimo Musone - Ernst & Young
Build a homemade AI device. Antimo Musone - Ernst & YoungBuild a homemade AI device. Antimo Musone - Ernst & Young
Build a homemade AI device. Antimo Musone - Ernst & Young
Data Driven Innovation
 
Naomi Makofsky - Connecting with your customer via conversation
Naomi Makofsky - Connecting with your customer via conversation Naomi Makofsky - Connecting with your customer via conversation
Naomi Makofsky - Connecting with your customer via conversation
Hilary Ip
 
Creating Voice User interfaces from scratch
Creating Voice User interfaces from scratchCreating Voice User interfaces from scratch
Creating Voice User interfaces from scratch
Stoyan Stoyanov
 
EIA2017Portugal - Martin Omander - Build your own app for Google Home
EIA2017Portugal - Martin Omander - Build your own app for Google HomeEIA2017Portugal - Martin Omander - Build your own app for Google Home
EIA2017Portugal - Martin Omander - Build your own app for Google Home
European Innovation Academy
 
EIA2017Italy - Martin Omander - Build Your Own App for Google Home
EIA2017Italy - Martin Omander - Build Your Own App for Google HomeEIA2017Italy - Martin Omander - Build Your Own App for Google Home
EIA2017Italy - Martin Omander - Build Your Own App for Google Home
European Innovation Academy
 
#MTC2019: Dialog z klientem w Erze Asystentów - Michal Dlugosz (Google)
#MTC2019: Dialog z klientem w Erze Asystentów - Michal Dlugosz (Google)#MTC2019: Dialog z klientem w Erze Asystentów - Michal Dlugosz (Google)
#MTC2019: Dialog z klientem w Erze Asystentów - Michal Dlugosz (Google)
Mobile Trends
 
Engage user with actions
Engage user with actionsEngage user with actions
Engage user with actions
Matteo Bonifazi
 
Building your actions for Google Assistant
Building your actions for Google AssistantBuilding your actions for Google Assistant
Building your actions for Google Assistant
Ahmed Abu Eldahab
 
Antimo Musone - Vocal Assistant - build natural and rich conversational exper...
Antimo Musone - Vocal Assistant - build natural and rich conversational exper...Antimo Musone - Vocal Assistant - build natural and rich conversational exper...
Antimo Musone - Vocal Assistant - build natural and rich conversational exper...
Codemotion
 
Designing Voice Applications - Create For Voice
Designing Voice Applications - Create For VoiceDesigning Voice Applications - Create For Voice
Designing Voice Applications - Create For Voice
Kasia Ryniak
 
Conversational UI Design and Research at UXSEA Summit 2018
Conversational UI Design and Research at UXSEA Summit 2018Conversational UI Design and Research at UXSEA Summit 2018
Conversational UI Design and Research at UXSEA Summit 2018
Kuldeep Kulshreshtha
 
Designing Conversation for Google Assistant
Designing Conversation for Google AssistantDesigning Conversation for Google Assistant
Designing Conversation for Google Assistant
GITS Indonesia
 
Ad

Google assistant basics

  • 1. APPS ON GOOGLE ASSISTANT USING ACTIONS GAURAV BHATNAGAR
  • 2. AGENDA • Background • Google AssistantWorkflow • How Assistant provides customized response. • Dialogflow and all its main components • Demo of an example • Basics of Conversation design • GUI vsVUI
  • 3. BACKGROUND • Google Assistant is currently available on more than 400 million devices around the world. • It is available in phones(iOS or android), tablets, cars, Chromebook & Home Devices.
  • 5. GOOGLE ASSISTANT WORKFLOW Source : https://dialogflow.com/docs/agents
  • 6. DIFFERENT APPROACHES FOR CUSTOMIZED ASSISTANT APPS
  • 7. GOOGLE ASSISTANT WORKFLOW (USING DIALOGFLOW) Source : https://dialogflow.com/docs/agents
  • 8. DIALOGFLOW • Agents Agents are NLU Modules built with the help of contexts, intent priorities, responsibilities, and fulfillment via webhook. • Intents They represent a mapping between what a user says and what action should be taken by your customized software. • Contexts They are designed for passing on information based on user’s preferences, geographic location. • Fulfillment This component connects your Dialogflow agent to your services,APIs and/or databases. It connects to webhooks via Actions on Google. • Entities,Actions, Parameters…..
  • 9. INTEGRATIONS PROVIDED BY DIALOGFLOW Source : https://dialogflow.com/docs/integrations
  • 11. CONVERSATION DESIGN • It is basically a design language based on human conversation. • We are providing an experience and merely not just an application. • Creating a System and User persona. • Conversation Design should be built on cooperative principle. Conversations should always be designed to provide comfortable, frictionless and user centric experience. • Group devices by the components used in conversation : For e.g. Google Home/ Pixel.
  • 12. BUILDING BLOCKS FOR CONVERSATION • Expect users to give more information. • Try to always keep the dialog towards the use case you are trying to solve. • Try to always move the conversation forward. • Try to keep the conversation optimized for relevance and provide clarity in answers. • Try to understand the context and listen between the lines. • Follow-up conversations should have the context attached. • Keep the conversation going by taking turns and not try to monopolize.
  • 14. ALWAYS KEEPING REAL LIFE USER CONDITIONS IN MIND Interrupted Cut off too soon No way out Accent Language understanding Self Correction Confused Side Speech Valid but not in grammar Didn’t Understand Background noise Ask a question back. Coughs Talked too long Too quiet Hesitate Know options by some other manner Stutter Start Too many choices Poor connection In Conversations, there are no “Errors”.
  • 15. REFERENCES • Actions on Google Developers : https://developers.google.com/actions. • https://developers.google.com/actions/design/ • https://dialogflow.com • https://caster.io/courses/google-assistant-app-with-zero-code