PROJECT REPORT

on

AI VOICE ASSISTANT

(J.A.R.V.I.S)

By

Amitesh Srivastava (171242)

Submitted to

[1]
CERTIFICATE

I hereby declare that the work presented in this report entitled “AI Voice Assistant”
in partial fulfillment of the requirements for the Major Project(8th Semester) in
Computer Science and Engineering submitted in the department of Computer
Science & Engineering and Information Technology, Jaypee University of Information
Technology, Waknaghat is an authentic record of my own work carried out over a
period from Feb 2021 to May 2021 under the supervision of Dr. Mrityunjay Singh.

Amitesh Srivastava(171242)

This is certified to be the bonafied work of the students in the Major Project Lab
during academic year 2021.

Supervisor - Dr. Mrityunjay Singh

Date – 18/05/2020

[2]
 ACKNOWLEDGEMENT

Besides the hard work of a group, the success of a project also

depends highly on the encouragement and guidelines of many
others. I take this opportunity to express my sincere and heartfelt
gratitude to the people who have been instrumental in the successful
completion of this project.

My first and foremost acknowledgement goes to our supervisor and

mentor, Dr. Mrityunjay Singh, without whose help the completion
of this project wouldn’t have been possible.
It is because of her guidance and efforts that I was able to
implement a practical idea based on my field of interest.
Last but not the least I would like to acknowledge my institution
Jaypee University Of Information Technology for giving me a
platform to give me life and implementation, to the various fields I
have studied till date.

[3]
TABLE OF CONTENTS:

List of Abbreviations
List of figures
List of Graphs
List of tables

ABSTRACT

1. INTRODUCTION
1.1 Introduction
1.2 Problem Statement
1.3 Objectives
1.4 Methodology
1.5 Organization
2. LITERATURE SURVEY
3. SYSTEM DEVELOPEMENT
4. PERFORMANCE ANALYSIS
5. CONCLUSIONS
5.1 Conclusions
5.2 Future Scope
5.3 Applications Contributions

REFERENCES
APPENDICES

[4]
List of Abbreviations

1. A.I. -> Artificial Intelligence

[5]
List of Figures

3.1 -> import pyttsx3

3.2 -> define speak()

3.3 -> define wishMe()

3.4 -> define takeCommand()

3.5 -> install module wikipedia

3.6 -> code for searching query on wikipedia

3.7 -> code for playing a video on youtube

3.8 -> code for searching query on google

3.9 -> code for telling date and time

3.10 -> code for answering basic questions

3.11 -> code to exit

4.1 -> answering a question

4.2 -> answering a question

4.3 -> answering a question

4.4 -> play pirates of the Caribbean on youtube

4.5 -> youtube page (pirates of the caribbean)

4.6 -> play bts on youtube

4.7 -> youtube page (bts)

4.8 -> search about salman khan on wikipedia

4.9 -> Wikipedia results

[6]
4.10 -> what is education google search

4.11 -> search results

4.12 -> open instagram

4.13 -> Instagram opened on chrome

4.14 -> can you open the big bang theory series for me google search

4.15 -> search results

[7]
List of Graphs No

graphs

List of Tables No

tables

[8]
ABSTRACT
The project aims to develop a personal-assistant for Linux-based systems. Jarvis
draws its inspiration from virtual assistants like Cortana for Windows, and Siri
for iOS. It has been designed to provide a user-friendly interface for carrying
out a variety of tasks by employing certain well-defined commands. Users can
interact with the assistant either through voice commands or using keyboard
input. As a personal assistant, Jarvis assists the end-user with day-to-day
activities like general human conversation, searching queries in google, bing or
yahoo, searching for videos, retrieving images, live weather conditions, word
meanings, searching for medicine details, health recommendations based on
symptoms and reminding the user about the scheduled events and tasks. The user
statements/commands are analysed with the help of machine learning to give an
optimal solution.

[9]
1. INTRODUCTION

1.1 Introduction

Just imagine having an A.I. right hand just like one in the movie Iron
man. Just think of it’s applications like sending e-mails without
opening up your mail, searching on Wikipedia and googling and
playing music on youtube without using your web browser, and other
date to day tasks done on a computer. In this project, we will
demonstrate how we can make our own A.I. associate using Python 3.

What can this A.I. colleague accomplish for you?

o It can answer basic questions fed to it.

o It can play music and videos on Youtube.

Videos have remained as a main source of entertainment,

one of the most prioritized tasks of virtual assistants.
They are equally important for entertainment as well as
educational purposes as most teaching and research
activities in present times are done through Youtube.
This helps in making the learning process more practical
and out of the four walls of the classroom. Jarvis
implements the feature through pywhatkit module. This
scraps the searched YouTube query.

o It can do Wikipedia looks for you.

o It is equipped for opening sites like Google (listens to queries

and searches them on Google), Youtube, and so forth, on

[10]
 Chrome.

Making queries is an essential part of one’s life, and nothing

changes even for a developer working on Windows. We have
addressed the essential part of a netizen’s life by enabling our
voice assistant to search the web. Here we have used
webbrowser module for extracting the result from the web as
well as displaying it to the user. Jarvis supports a plethora of
search engines like Google, Bing and Yahoo and displays the

result by scraping the searched queries.

1.2 Problem statement

We are all well aware about Cortana, Siri, Google Assistant and many
other virtual assistants which are designed to aid the tasks of users
in Windows, Android and iOS platforms. But to our surprise,
there’s no such virtual assistant available for the paradise of
Developers i.e. Windows platform.

PURPOSE: This Software aims at developing a personal assistant for

Windows-based systems. The main purpose of the software is to
perform the tasks of the user at certain commands, provided in
either of the ways, speech or text. It will ease most of the work of
the user as a complete task can be done on a single command.
Jarvis draws its inspiration from Virtual assistants like Cortana for
Windows and Siri for iOS. Users can interact with the assistant
either through voice commands or keyboard input.

PRODUCT GOALS AND OBJECTIVES: Currently, the project aims

to provide the Windows Users with a Virtual Assistant that would
not only aid in their daily routine tasks like searching the web,
extracting weather data, vocabulary help and many others but also
help in automation of various activities. In the long run, we

[11]
 aim to develop a complete server assistant, by automating the
entire server management process - deployment, backups, auto-
scaling, logging, monitoring and make it smart enough to act as a
replacement for a 6 general server administrator.

PRODUCT DESCRIPTION: As a personal assistant, Jarvis assists

the end-user with day-to-day activities like general human
conversation, searching queries in various search engines like
Google, Bing or Yahoo, searching for videos, retrieving images,
live weather conditions, word meanings, searching for medicine
details, health recommendations based on symptoms and
reminding the user about the scheduled events and tasks. The user
statements/commands are analysed with the help of machine
learning to give an optimal solution.

1.3 Objectives

o Allow the A.I. to speak a given piece of text.

o Make a function to open websites which asked to be opened

o Make a function which opens the latest uploaded video on

Youtube with the title said by the user

o Make a function to search for the query on Google for

something that the A.I. doesn’t understand.

o Feed some questions and answers to make A.I. talk like a

human being.

1.4 Methodology

o Jj

1.5 Organization

o Ll

o ;ll

[12]
2. LITERATURE SURVEY

In this Project Jarvis is Digital Life Assistant which uses mainly

human communication means such Twitter, instant message and
voice to create two way connections between human and his
apartment, controlling lights and appliances, assist in cooking,
notify him of breaking news, Facebook’s Notifications and
many more. In our project we mainly use voice as
communication means so the Jarvis is basically the Speech
recognition application. The concept of speech technology really
encompasses two technologies: Synthesizer and recognizer. A
speech synthesizer takes as input and produces an audio stream
as output. A speech recognizer on the other hand does
opposite. It takes an audio stream as input and thus turns it
into text transcription. The voice is a signal of infinite
information. A direct analysisand synthesizing the complex voice
signal is due to too much information contained in the signal.
Therefore the digital signal processes such as Feature Extraction
and Feature Matching are introduced to represent the voice
signal. In this project we directly use speech engine which use
Feature extraction technique as Mel scaled frequency cepstral.
The melscaled frequency cepstral coefficients (MFCCs) derived
from Fourier transform and filter bank analysis are perhaps the
most widely used front- ends in state-of-the-art speech
recognition systems. Our aim to create more and more
functionalities which can help human to assist in their daily life
and also reduces their efforts. In our test we check all this

[13]
 functionality is working properly. We test this on 2 speakers(1
Female and 1 Male) for accuracy purpose.

-ShrutiKa Khobragade

Department of Computer Vishwakarma

Institute of InformationTechnology
Pune,INDIA

3. SYSTEM DEVELOPEMENT

Tools and technologies used

Language used: Python 3

Modules used :
● pyttsx3 (imports voices and has functions related to
speaking)
● datetime (#not important .)
● speech_recognition (to convert speech to text)
● wikipedia (to access Wikipedia information)
● webbrowser (to manipulate web browsing operations)
● os (for just os.clear())
● pywhatkit (for playing songs on youtube)

Functions created :
● speak() (speaks text given as argument)
● wishMe (Wishes according to the day hour)
● takeCommand() (to convert speech to text and give it as
input )

[14]
 ● indices(), openwebsite(), printspeak() are functionss
just to shorten the code therefore, not important.

We implemented the code on Visual studio code.

Working:

What is pyttsx3?

A python library which will assist us with changing content over to

discourse. So, it is a book to-discourse library.

Fig. 3.1

What is sapi5?

Discourse API created by Microsoft.

Aides in blend and acknowledgment of voice. What

Is VoiceId?

Voice id encourages us to choose various voices.

voice[0].id = Male voice

voice[1].id = Female voice

1. speak()

[15]
The most importantly thing for an A.I. right hand is that it should
have the option to talk. To make our J.A.R.V.I.S. talk, we will
make a capacity called talk. This capacity will accept sound as
a contention,and afterward, it will articulate it.

Fig. 3.2
2. wishMe()

The most importantly thing for an A.I. right hand is that it should
have the option to talk. To make our J.A.R.V.I.S. talk, we will
make a capacity called talk. This capacity will accept sound as
a contention,and afterward, it will articulate it.

Fig. 3.3
3. takeCommand()

How about we begin coding the takeCommand() work :

[16]
 Fig. 3.4

We have effectively made our takeCommand() work.

Characterizing Task 1: To look through something on Wikipedia

To do Wikipedia look, we have to introduce and bring the Wikipedia

module into our program. Type the beneath order to introduce the
Wikipedia module

pip introduce wikipedia

Fig. 3.5

On the off chance that 'wikipedia' in inquiry: #if wikipedia found in the
question then this square will be executed

[17]
 Fig. 3.6

Characterizing Task 2: To play any video on youtube

Fig. 3.7

Characterizing Task 3: If any query is not understood by the assistant it look

about it on google.

Fig. 3.8

Characterizing Task 4 : To know the current time

Fig. 3.9

[18]
Characterizing Task 5: To ask basic questions

Fig. 3.10

Characterizing Task 6: To exit

Fig. 3.11

[19]
Complete code:

import pyttsx3

import datetime

import speech_recognition as sr

import wikipedia

import webbrowser

import os

import pywhatkit

#initializing voice settings

engine=pyttsx3.init('sapi5')

voices=engine.getProperty('voices')

engine.setProperty('voice',voices[1].id)

def speak(audio):

engine.say(audio)

engine.runAndWait()

def wishMe():

hour=int(datetime.datetime.now().hour)

if(hour>=3 and hour<12):

return('Good morning')

elif(hour>=12 and hour<16):

[20]
 return("Good afternoon")

else:

return("Good evening")

def takeCommand():

r = sr.Recognizer()

with sr.Microphone() as source2:

r.adjust_for_ambient_noise(source2, duration=0.2)

print('Listening...')

audio2 = r.listen(source2)

try:

os.system('cls||clear')

print('Recognizing...')

MyText = r.recognize_google(audio2)

MyText = MyText.lower()

print('You: '+MyText)

os.system('cls||clear')

except:

print('Bot: Sorry, I could not undertsand.')

speak('Sorry, I could not undertsand.')

return(MyText)

#functions to shorten code

def indices(a,c):

[21]
 for i in range(len(a)):

if(a[i]==c):

ans=i

break

else:

ans=-1

return(ans)

def openwebsite(query):

Query=query.split()

x=indices(Query,'open')

website=Query[x+1]

webbrowser.open('https://'+str(website)+'.com')

def printspeak(s):

print('Bot: '+s)

speak(s)

if name ==" main ":

query=takeCommand().lower()

print(query)

if('wikipedia' in query):

printspeak('Searching Wikipedia...')

query=query.replace("wikipedia","")

results=wikipedia.summary(query, sentences=3)

[22]
 os.system('cls||clear')

printspeak('According to wikipedia,' + str(results))

elif(('good morning' in query) or ('good afternoon' in query) or ('good evening' in

query)):

printspeak(wishMe())

elif(('hello' in query) or ('hi' in query) or ('hey there' in query) or ('hola' in query)):

printspeak('Hello!')

elif(("What's up" in query) or ('how are you' in query) or ('how is it going' in query) or
('hows it going' in query)):

printspeak('It is fantastic in here. what about you?')

elif(('i am fine' in query) or ("everything's good" in query) or ('everything is good' in

query) or ('I am good' in query)):

printspeak('Good to know!')

elif(('who created you' in query) or ('who made you' in query)):

printspeak('I was created by Mr. Amitesh Srivastava.')

elif(('who are you' in query) or('what is your identity' in query) or ('introduce yourself'
in query)):

printspeak('I am JARVIS. I was created by Mr. Amitesh Srivastava.')

elif(('what is your name' in query) or ("what's your name" in query)):

printspeak('I am JARVIS')

elif(('thank you' in query) or ('thanks' in query) or ('gratitude' in query) or ('grateful' in

query)):

printspeak('Your welcome.')

elif(('like pets') in query):

[23]
 printspeak('Ofcourse! In fact, turtle is my favourite pet.')

elif('tell me about your likes and dislikes' in query):

printspeak('I like singing, painting, playing the voilen, and clicking pictures of the
food i cook. Lol. and being a machine, there is nothing I dislike.')

elif('open' in query):

printspeak('Opening the website...')

openwebsite(query)

elif('play' in query):

query=query.split('play')

printspeak('Searching youtube...')

pywhatkit.playonyt(query[1])

elif(('date' in query) and (("what's" in query) or ("what is" in query) or ("tell" in query)
or ('say' in query))):

current_time = datetime.datetime.now()

date=str(current_time)[:10]

printspeak('The date is: '+date)

elif(('time' in query) and (("what's" in query) or ("what is" in query) or ("tell" in query)
or ('say' in query))):

current_time = datetime.datetime.now()

time=str(current_time)[11:]

hour=time[:2]

m=' a.m.'

if(int(hour)>=13 or int(hour)<24):

[24]
 m=' p.m.'

hour=str(int(hour)-12)

minute=time[3:5]

time=hour+':'+minute+m

printspeak('The time is: '+time)

else:

webbrowser.open('https://google.com?#q='+str(query))

try:

query=query.replace("wikipedia","")

results=wikipedia.summary(query, sentences=3)

if(query in results):

printspeak('According to wikipedia, '+str(results))

else:

printspeak('Showing Google search results for '+str(query))

except:

printspeak('Showing Google search results for '+str(query)) os.system('cls||

clear')

os.system('cls||clear')

[25]
4. PERFORMANCE ANALYSIS

4.1 It can answer basic questions fed to it.

Fig. 4.1

Fig. 4.2

[26]
 Fig. 4.3
As we can see, it responded with an answer that makes sense!

[27]
4.2 It can play music and videos on Youtube.

Fig. 4.4

Fig. 4.5

[28]
 Fig. 4.6

Fig. 4.7

[29]
4.3 It can do Wikipedia looks for you.

Fig. 4.8

Fig. 4.9

[30]
4.4 It is equipped for opening sites like Google, Youtube, and so forth,
on Chrome.

Fig. 4.10

Fig. 4.11

[31]
 Fig. 4.12

Fig. 4.13

[32]
 Fig. 4.14

Fig. 4.15

[33]
 5. CONCLUSIONS

5.1 Conclusions
Through this voice assistant, we have automated various services using a single
line command. It eases most of the tasks of the user like searching the web,
retrieving weather forecast details, vocabulary help and medical related queries.
We aim to make this project a complete server assistant and make it smart
enough to act as a replacement for a general server administration. The future
plans include integrating Jarvis with mobile using React Native to provide a
synchronised experience between the two connected devices. Further, in the long
run, Jarvis is planned to feature auto deployment supporting elastic beanstalk,
backup files, and all operations which a general Server Administrator does. The
functionality would be seamless enough to replace the Server Administrator with
Jarvis.

5.2 Future Scope

We plan to Integrate Jarvis with mobile using react native, to provide a
synchronized experience between the two connected devices. Further, in the long
run, Jarvis is planned to feature auto deployment supporting elastic beanstalk,
backup files, and all operations which a general Server Administrator does. The
functionality would be seamless enough to replace the Server Administrator with
Jarvis.
Functional Requirements:
● Proper Internet Connection
● Github Credentials
● Python 3.7
● pyttsx3 module for voice support (Text-to-Speech)

[34]
 ● Chromium-based browser, like Chrome, Edge
● Node JS with npm Non-Functional Requirements:

The non-functional requirements of the system include:

● The system ensures safety, security and usability, which are observable during
operation (at run time).
● The system is adaptable to different situations.
● The project has good and compact UI using AngularJS with responsive
interface.
● The project is light on resources.

5.3 Applications Contributions

o Allow the A.I. to speak a given piece of text.

[35]
REFERENCES: www.youtube.com

codewithharry.com

kaggle

towardsdatascience.com

[36]