SIX SENSE TECHNOLOGY

Hemanth Kumar
(19H61A0569)

Guide:
Mr. V. Rama Krishna
 ABSTRACT

 Sixth Sense Technology is a mini-projector coupled with a camera and a cellphone—which

 Sixth Sense can also obey hand gestures. The camera recognizes objects around a person
instantly, with the micro-projector overlaying the information on any surface, including the
object itself or hand.

 The device has a huge number of applications , it is portable and easily to carry as can wear
it in neck.

 The drawing application lets user draw on any surface by observing the movement of index
finger. Mapping can also be done anywhere with the features of zooming in or zooming out.
 Some of the more practical uses are reading a newspaper. Reading a newspaper and viewing
videos instead of the photos in the paper or live sports updates while reading the newspaper.

 The device can also tell arrival, departure or delay time of air plane on tickets.

 Open any book and find the Amazon ratings of the book. To add to it, pick any page and the
device gives additional information on the text, comments and lot more add on feature.
 INTRODUCTION
 We’ve evolved over millions of years to sense the world around us. When we encounter
something, someone or some place, we use our five natural senses which includes eye, ear,
nose, tongue mind and body to perceive information about it.

 Although the miniaturization of computing devices allows us to carry computers in our

 Sixth Sense bridges this gap, bringing intangible, digital information out into the tangible
world, and allowing us to interact with this information via natural hand gestures.

 ‘Sixth Sense’ frees information from its confines by seamlessly integrating it with reality,
and thus making the entire world your computer .
 Sixth Sense is a wearable “gesture based” device that augments the physical world with
digital information and lets people use natural hand gestures to interact with that information.

 It was developed by Pranav Mistry, a PhD student in the Fluid Interfaces Group at the MIT
Media Lab. A grad student with the Fluid Interfaces Group at MIT, he caused a storm with his
creation of Sixth Sense.

 Sixth Sense will allow us to interact with our world like never before. We can get information
on anything we want from anywhere within a few moments!
 EXISTING SYSTEM
 Augmented reality is a term for a live direct or indirect view of a physical real world
environment whose elements are augmented by virtual computer generated imagery.

 Gesture recognition is a topic in computer science and language technology with the goal of
interpreting human gestures via mathematical algorithms.

 Computer vision is the science and technology of machines with its vision. It is concerned
with the theory behind artificial systems that extract information from images.

 Radio Frequency Identification is basically an electronic tagging technology that allows the
detection, tracking of tags and consequently the objects that they are affixed
 DRAWBACKS
 To find appropriate vision based gesture recognition algorithm is very difficult task
in the sixth sense technology. The effective working of the technology depends on
precision and usefulness of the gesture recognition software.

 The programming code used is specific to the particular device used and
application of usage. Hence there may be trouble in executing it on the another
device.

 Failure of any components makes functioning difficult.

 The devices based on this technology are very expensive.

 The projectors runs on batteries for power where regularly have to place.
 METHODOLOGY
 To develop an application based on sixth sense technology one can use

1. Language: Java, C #, C++, OpenCV, JavaCV.

2. Image processing Software: MatLab, Mathematica, Cylab.

 Initialization Different gestures are captured, enhanced, features are extracted and finally a
gesture template or cluster model is created using different algorithm.

Acquisition:

 It is a real time approach where frames are captured using webcam or from a video input.
 Segmentation:

 Each of the frames is processed separately and image is smoothed, skin pixels are labeled,
noise is removed and small gaps are filled using filters.

 By segmentation algorithm all the features of picture is extracted from it and stored in data
base.

Pattern Recognisation:

 The users gesture is captured and features are extracted which is compared to the stored hand
gesture using comparison algorithm like Hausdorff matching, Euclidean distance, hidden
Markova model, Bag of Words, Hamming Distance, correlation based approach etc.
 Execution:

Finally, the system carries out the

 The drawing application lets user draw on any surface by observing the movement
of index finger.

 Mapping can also be done anywhere with the features of zooming in or zooming
out.

 Make a Call: This technology enables the user to call without using the dialer. The
information of the dialer would be projected on the device as soon as the user
brings the palm in front of the device. 

 The Clock: The user simply needs to make a gesture of a circle on the wrist and
the clock with current time will be projected on the users hand.
 Video Newspapers: This device also recognizes articles in the newspaper. Also it
can retrieve the latest related stories or video stream from the internet and then
display them on pages for user.

 Book Information: For book lovers it has proved to be a boon as you just open any
book and find the ratings of the book and can also move to any page and get
additional information.

 Motion Capture: Using fingers, the user can capture photos and there no need to
carry an extra gadgets. The box created by fingers act as a frame. 
 CONCLUSION
 It’s the beginning of a new era of technology where engineering will reach new
milestones. Just like in the science fiction movies where display of computer screen
appears on walls, commands are given by gestures, the smart digital environment
which talks to us to do our work and so on, these all will be possible very soon.

 You imagine it and Sixth Sense technology will make it possible.

 Now it’s time for sci-fi movie directors to think ahead because the technology shown
in there fiction movies soon will become household stuff.

 Before few years back it was considered to be supernatural or tantalizing

1. www.blendernation.com/sixth-sense-technology/

2. http://boingboing.net/2009/11/12/sixth-sense-technolo.html

3. http://gizmodo.com/5167790/sixth-sense-technology-may-change-how-
we-lookat-the-world-forever

4. http://theviewspaper.net/sixth-sense-technology-will-revolutionize-the-
world/