Over Head Mounted

Display

Under the guidance of:

Mrs Archana Deshpande
Group Members:

 AJAY YADAV (BE-EXTC-B)

 DHARAMENDRA YADAV (BE-EXTC-B)
 RAMASHISH YADAV (BE-EXTC-B)
Abstract

 37 million people across the globe who are blind, over 5 million are from India
based on the definition that a person who is unable to count fingers from a
distance of three metres would be considered blind.
 About 1.99 million people of our county are deaf.
 The idea of Smart Glasses or Over Head Mounted Display
 A Head-mounted Display (HMD) is just what it sounds like -- a computer display
you wear on your head. Most HMDs are mounted in a helmet or a set of goggles.
 wearable computer glasses that are able to change their optical properties at
runtime.
 can communicate with the Internet via natural language voice commands,
while other use touch buttons. Also has inbuilt speakers and microphones.
 Abstract

 It uses various sensors which give real time inputs to the machine which then
computes all the parameters and provides the user with guidance and feedback to
help them navigate, interact and
understand better about the world
around them.
 Though it doesn’t compensate for the
missing senses that the user may have
damaged due to accident or by must
have so from birth but it does acts as a
supporter for them.
 Introduction

 This project is aimed to provide personal assistance to disabled people who may include
the blind and the deaf. They face many daily life issues which a person with all senses
won’t find difficult to do.
 The idea is to provide people with such a wearable glass that can provide them with the
missing inputs in some other form preferably in the form of display (for the deaf) and audio
(for the blind) which they can comprehend easily.
 Person with disability have missing senses which makes it hard for them to do some of the
daily tasks easily done by normal people. This projects aims to tackle the two problems, first
being the vision and the second being the hearing.
Introduction

 The device is aimed to be compact wearable glass mounted which can be fitted to
any normal eye glass regardless of shape and size with emphasis being paid on the
efficiency of data accumulation and processing whilst being light weighted so that
the user may not find it difficult to wear it.

 It is equipped with various sensors and features extracting algorithm that take in
various information from the vicinity of the user, process it and give feeds in real time.
They aim to make the user more self reliant and self independent
Literature Survey:

 Smart Guiding Glasses for Visually Impaired People in Indoor Environment

Published By: Jinqiang Bai, Shiguo Lian, Member, IEEE, Zhaoxiang Liu, Kai Wang, Dijun Liu
Year: 2017
 The SmartVision Navigation Prototype for Blind Users:
Published By: J.M. Hans du Buf, João Barroso, João M.F. Rodrigues, Hugo Paredes, Miguel
Farrajota, Hugo Fernandes, João José, Victor Teixeira, Mário Saleiro
Year: 2011
 Babel Speech To Text Glasses Will Show The Deaf What Some One Says in Real Time:
Published By: Evan Selleck
Year: 2010
 Smart glasses: technology and applications
Student report: Ubiquitous computing seminar FS2014, Hermann Schweizer
Year: 2014
 Literature Survey:

 Smart vision for the blind people

Published By: R.Mohanapiya, U.Nirmala, C.Pearlin
Year: 2016
 Head-Mounted Display Visualizations to Support Sound Awareness for the Deaf and Hard of
Hearing
Presented By: Dhruv Jain, Leah Findlater, Jamie Gilkeson, Benjamin Holland, Ramani
Duraiswami, Dmirty Zotkin, Christian Vogler, Jon E. Froehlich
Year: 2015
 Google Glass – Review Paper
Presented By: Priyanka Jindal, Amit Kumar Vishnoi
Year:2016
Gaps found:

 Most devices designed for visually impaired used who can still see
 Cost efficient devices not developed
 Relevant features: has many feature which makes them bulky
 2D mapping used
Proposed method:

 Implementation of Over Head Mounted Display (Wearable Glasses) for the disabled
 Design an OHMD with all the required sensors such as ultrasound sensors, camera, microphone
,GPS etc. ,all assembled over an microcontroller.
 The objective of this project is to implement the concept of Over Head Mounted Display with
features such as:
 Navigator and guide
 obstacle detector
 personal assistant (text/face detection)
 Interpreter for the deaf user.
Proposed Method

 Arduino nano will be the preferred microcontroller over which an OLED display will be
interfaced to provide visuals to the user. Ultrasonic sensors for obstacle detection linked
with accelerometer will be used for obstacle detection.
 Text/Face detection will be included
 GPS linked with Google Map API and Google Navigation is used to provide data log and
guidance to the user using an app that interfaces between the phone and the
microcontroller.
 Also speech to text and text to speech features are used from google and windows
respectively to make the device more interactive.
Block diagram of basic circuitry
 Working
 The device is designed to operate for three different type of users.
 Blind users
 Deaf users
 Normal users

 For the blind, the glasses will perform tasks such as obstacle detection, navigation based on data
logger and voice command interactions.
 Audio feeds are given so that the user is well informed about it.
 For the deaf, it is aimed to display real time audio to text message over the glass surface which is
placed in front of the normal eye glass.
Working

 For normal users, the glass can be used to access features such as calculator, navigator
when riding a two wheeler, stop watch and other features that are available for other
type of users as well.
 All of these features are incorporated into one single device with is flexible enough to be
used by users with different body composure and age.
Block Diagram of Process flow
Depth Ultrasonic
sensor sensor

Text output
Object detection
& range
GPS detection

Navigation OLED Screen &

Microcontroller
and guidance speakers

Google
Maps API
Audio output
Face /text
detection Speech to text

ANDROID
MATLAB
camera microphone STUDIO
Expected Results

 The device will act as a personal assistance and the needed senses for the user. Not only
will it help them to interact but also will be a fun device for them to use. It will eliminate the
interaction barriers and will make them a bit more self-dependent.
 For future developments, it can be connected to internet to provide augmented reality
features which will make the user experience more interactive and fun.
 Also for future implementation face detection feature for blind user will be implemented
so as to provide the user with the audio feeds about the person in front of him. The device
can also be used to record videos and take images and store it.
 So as to implement the text/face detection and matched feature technique Harris
Feature Matching algorithm was implemented by us where in we tried to match 66
combinations of 8 signature sets.
 Range Detection: Object Detection

 long rangeR()
 {
 long microsecondsToCentimeters(long
 long durationR,cmR;
microseconds)
 pinMode(trigPinR, OUTPUT);
 {
 digitalWrite(trigPinR, LOW);
 // The speed of sound is 340 m/s or 29
 delayMicroseconds(2);
microseconds per centimeter.
 digitalWrite(trigPinR, HIGH);
 // The ping travels out and back, so to find the
 delayMicroseconds(10); distance of the
 digitalWrite(trigPinR, LOW);  // object we take half of the distance travelled.
 pinMode(echoPinR, INPUT);
 return microseconds / 29 / 2;
 durationR = pulseIn(echoPinR, HIGH);
 }
 cmR = microsecondsToCentimeters(durationR);
 return cmR;
 }
Pattern Detection: Text/Face recognition
 Conclusion:

 The device will act as a personal assistance and the needed senses for the user. Not only will it
help them to interact but also will be a fun device for them to use.
 It will eliminate the interaction barriers and will make them a bit more self-dependent. For future
developments, it can be connected to internet to provide augmented reality features which will
make the user experience more interactive and fun.
 Also for future implementation face detection feature for blind user will be implemented so as to
provide the user with the audio feeds about the person in front of him. The device can also be
used to record videos and take images and store it.