BLUE EYES TECHNOLOGY

Abhimanyu ps, Mrs,Rekha Sunny

Department of MCA, SCMS School of Technology and Management,
Mahatma Gandhi University Cochin, India

XXX-X-XXXX-XXXX-X/XX/$XX.00 ©20XX IEEE

 Abstract—Human error is still one of the most frequent causes of surroundings where the computers and humans
catastrophes and ecological disasters. The main reason is that
themonitoring systems concern only the state of the processes can work together as intimate partners.
whereas human contribution to the overall performance of
the system is left unsupervised. Since the control instruments are Blue eyes technology consist of,
automated to a large extent, a human – operator becomes
a passive observer of the supervised system, which results in 1. Mobile measuring device or Data Acquisition
weariness and vigilance drop. Thus, he may not notice
important changes of indications causing financial or ecological
Unit (DAU)
consequences and a threat to human life. It therefore is crucial to 2. Central System Unit (CSU)
assure that the operator’s conscious brain is involved in an active 3. The Hardware\
system supervising over the whole work time period.

Blue Eyes
- the system developed intended to be the complex
solution for monitoring and recording the operator ’s
conscious brain involvement as well as his
physiological condition. This required designing a
Personal Area Network linking all the operators and
the supervising system. As the operator using his sight
and hearing senses the state of the controlled system, the
supervising system will look after his physiological condition
I. Mobile measuring device or Data Acquisition
Unit (DAU) of Blue Eyes technology:

The DAU used in the Blue Eyes technology is the mobile

I. INTRODUCTION component of the system. The main function of DAU is to
gather the physiological information from sensors and forward
BlueEyes system provides technical means for to the CSU for processing and verification purposes.
m o n i t o r i n g a n d r e c o r d i n g t h e o p e r a t o r ’s b a s i c p
hysiological parameters. The most important parameter is saccadic
operator’s visual attention along with head acceleration, which
accompanieslarge displacement of the visual axis. Complex
industrial environment can create a danger of exposingthe operator
to toxic substances, which can affect his cardiac, circulatory and
pulmonary systems. Thus,on the grounds of plethysmographic
signal taken from the forehead skin surface, the system
computesheart beat rate and blood oxygenation.The BlueEyes
system checks above parameters against abnormal (e.g. a low level
of blood oxygenationor a high pulse rate) or undesirable (e.g. a
longer period of lowered visual attention) values and
triggersu s e r - d e f i n e d a l a r m s w h e n n e c e s s a r y . T h i s
paper is about the hardware, software, benefits
a n d interconnection of various parts involved in the “blue eye”
technology.Toward this end, the Blue Eyes aims at
creating computational devices with the sort of
perceptualabilities that people take for granted Blue eyes is being
developed by the team of Poznan University of Technology&
Microsoft. It makes use of the “blue tooth technology developed by
Ericsson
The blue tooth module, which is integrated with the mobile device
II. SYSTEM OVERVIEW (DAU), provides a wireless interface between the Central System
The hardware consists of a central system unit Unit (CSU) and the user or operator having the sensors. PIN codes
and ID cards are assigned to the entire operator’s for authentication
(CSU) and data acquisition unit (DAU). purposes. The device uses a five-key keyboard, beeper and LCD
Microcontroller- ATMEL 89C52 is the heart of the display for the interaction with the operators and if, any unwanted
data acquisition unit. Bluetooth technology is situation occurs, the machine uses these devices to inform the
operators. The ‘voice’ information from the user is transferred with
provided for the coordination and communication the help of a headset, which is interfaced with the Data Acquisition
between the two units. We can adapt this Blue Unit using a mini jack plug. DAU incorporates various hardware
Eyes technology in all working places, where the modules like system-core Bluetooth section, Atmel 89C52
microcontroller, EEPROM, Beeper, LCD display (HD44780), LED
operator’s attention is continually available. Using indicator, voltage level monitors and 6 AA batteries.
the Blue eyes Technology it is able to record and
monitor the user’s physiological condition by a
technical approach. The aim of this Blue Eyes II. Central system Unit (CSU) of Blue Eyes technology:
technology is to provide a machine or system
having sensory and perceptual abilities like human CSU is the next squint of wireless-network connection in the Blue
beings thus it will support healthy stress free Eyes technology. The CSU mainly contains codec (PCM Codec
commonly used for voice information transmission) and a wireless
blue tooth module. This CSU section is integrated to a personal
computer using USB, parallel and serial cable. The mini-jack Blue Eyes utilizes many sensor mechanisms, which is equivalent
socket is used for audio data accessing. The program containing for the ears, eyes and other sensory organs that human beings used
the operators personal ID is amalgamating to the personal to express emotions and recognize each other. Blue Eyes uses
computer through the serial and power ports. The microcontroller voice recognition software, cameras and biometric sensors to
(Atmel- 89C2051) inside the unit handles the I2C EEPROM- understand and respond to the emotional levels of humans. The
programming and UART transmission. voice recognition software can perceive not only what is being
spoken but also the tone how it is said. High resolution cameras are
used for tracking the minute facial expressions, hand gestures and
eye movements. Biometric sensors are used for measuring and
analyzing the muscle tension, body temperature, blood pressure
and other physiological gesture correlated with emotions.

2. Detecting human emotions/ Affect Detection:

In Blue Eyes technology, the machines have the ability to identify

the minor variations in the moods of human beings. Say a person
may strike the keyboard hastily or softly depends on his mood like
happy or in angry. The Blue Eyes enables the machines to identify
these minor emotional variations of human beings even by a single
touch on the mouse or key board and the machines started to react
with the users according to this emotional levels. This is done with
the guidance of intelligent devices like “Emotion Mouse”. Along
with this Emotion Mouse, Simple User Interest Tracker (SUITOR)
and Artificial Intelligent Speech Recognition are equipped with the
Blue Eyes technology to understand the speech and identify the
interest of the peoples at that instance of time.
v. SOFTWARE USED IN BLUE EYES TECHNOLOGY

The Software used in Blue Eyes Technology:

Types of Emotion Sensors used in Blue Eyes Technology:
The operator’s physiological condition is continually supervised by
this Blue Eyes technology software. The software will respond in  For Hand - Emotion Mouse:
real time according to the operator’s physiological condition. This
software helps to transfer the data or information from managers to The major aim of Brain Computer Interface (BCI)is to develop a
the data analyzers. Then it transfers the processed information from smart and adaptive computer system. These types of project must
this data analyzers unit to the GUI controls and data analyzers. At include speech recognition, eye tracking, facial recognition,
last, the data visualization module supports a user supervisor gesture recognition etc. software and hardware. Similarly in Blue
interface section. The visualization module is in the off-line mode Eyes technologies, we need to build a system have the ability to
and it will continually fetch the information from database and also identify all these perceptual abilities of human beings. In Blue
records the video, audio and physiological parameters. Thus ‘Blue Eyes, the machines have the ability to identify the minor variations
Eyes’ software enables the supervisor to know about the in the moods of human beings. Say a person may strike the
physiological condition of the operators. keyboard hastily or softly depends on his mood like happy or in
angry. The Blue Eyes technology enables the machines to identify
these minor emotional variations of human beings even by a single
touch on the mouse or key board and the machines started to react
with the users according to this emotional levels. This is done with
the guidance of intelligent devices like “Emotion Mouse”. Actually
this Emotion Mouse is an input device to track the emotions of a
user by a simple touch on it. The Emotion Mouse is designed to
evaluate and identify the user’s emotions such as fear, surprise,
anger, sadness, happiness, disgust etc. when he/she is interacting
with computer. The main objective of the Emotion Mouse is to
gather the user’s physical and physiological information by a
simple touch.

A. The Blue Eyes Technology and Its Basic Structure

1. Process of giving sensing capacity:

 cursor placement and target identification, were outlined, analyzed
III. For Eye - Expression Glass:
and executed with an eye tracker unit.

Expression Glass is an alternative for the usually available machine

Advantages of MAGIC Pointing Technique:
vision face or eye recognition methods. By analyzing pattern

recognition methods and facial muscle variations, the glass senses Reduced physical effort compared with the traditional
manual pointing techniques.
and identifies the expressions such as interest or confusion of the Greater spontaneity than traditional manual pointing.
user. The prototype used for this glass uses piezoelectric sensors.
Greater accuracy.
FASTER SPEED OF OPERATION THAN MANUAL POINTING



III. The Simple User Interest Tracker (SUITOR):

The Simple User Interest Tracker is revolutionary approaches

towards the design of machine having the ability to maintain an
intimate relationship between the humans and the computers. The
SUTOR continuously analyzes the user that where his eye focus on
the personal computer screen. The SUITOR has the ability to
A. MAGIC Pointing: determining the topic of interest of the user and also according to
this it can able to deliver the appropriate data to a handheld device.

The Eye gaze tracking methods explores a new way for handling

‘eye gaze’ for man machine interfacing. The gaze tracking has been

deliberated as an excellent pointing method for giving input to

computers. But many drawbacks exist with this traditional eye

gaze tracking methods. To overcome these difficulties an

alternative approach – termed as MAGIC - Manual and Gaze Input

VI
Cascaded – is projected. In this approach, eye gaze pointing
Artificial Intelligent Speech Recognition used in Blue Eyes
appears to the user as a manual job, utilized for fine selection and Technology:
manipulation processes. Even so, a large amount of the cursor
For implementing the Artificial Intelligent Speech Recognition
movement is removed by bending the cursor to the eye gaze system in Blue Eyes technology, the working environment should
be very important. The manner of the user’s speech, grammar,
portion, which surrounds the target. The selection and pointing of noise type, noise level and the position of the microphone are some
important factors that may influence the features of speech
the curser is primarily controlled by manual means but also guided recognition system. In Artificial Intelligent Speech Recognition
by a gaze tracking mechanism and is commonly known as MAGIC system, an automatic call handling method is implemented without
any telephone operator.
Pointing.

The main aim of MAGIC pointing is to use ‘gaze’ to warp the

previous position (home) of the curser to the locality of the target,

reasonably where the user was looking at, so as to reduce the

VII Two basic ideas are included in the Artificial intelligence (AI)
cursor motion amplitude required for target selection. When the
 Study the thought of human beings.
cursor position is identified, only a small movement is needed by
 Represents the thought process of human beings
the user to click on the target by a manual input device that is to through robots, computers etc.

accomplish Manual Acquisition with Gaze Initiated Cursor or Actually Artificial intelligence (AI) denotes the behavior of a
computer or any machines but it is carried out by the humans is
Manual and Gaze Input Cascaded (MAGIC) pointing. Two called as ‘intelligent’. This AI makes machines more power full,
useful, and smarter and also it is less expensive compared to
MAGIC Pointing methods – conservative and liberal –in terms of
natural intelligence. Natural language processing (NLP) makes • Control systems - Human control is required in various
artificial intelligence systems to communicate English. The main control system, however human may get tired, so to avoid
goal of the Natural language processing (NLP) is to understand the this situation, blue eye technology can be used ,where
users input and react according to these inputs. The input data or cameras kept for surveillance can be used to detect the
words are continuously scanned and finds matches against inside person’s emotional condition rather than just recording.
stored known data or words. And after identifying the key words, Blueeye technology can be used in various control
the corresponding actions are carried out by the machine. In this systems like banks, aeroplanes, trains, etc
way the Blue Eyes technology enables the users to communicate
with the machines with their own languages.

REFERENCES

Applications of Blue Eyes Technology 1. S. Madhumitha, Slide Share, Blue Eyes

Technology, March 2013, www. slideshare.
Applications of Blue Eyes Technology Some of the many
applications of Blue Eyes Technology are discussed below: net/Colloquium/blue-eyes-technology.6
i. A number of large retailers have implemented surveillance 2. Texture Based Expression Modeling for a Virtual
systems that record and interpret customer movements, using Talking Head, Daniel Hoglind, Master of Science
software from Almaden'sBlueEyes research project . Blue Eyes is Thesis Stockholm Sweden 2006, www. cse. kth. se.
developing ways for computers to anticipate users' wants by
3. Psychologist World, Eye Reading Language (Body
gathering video data on eye movement and facial expression.
One’s gaze might rest on a Web site heading, for example, and that Language), July2013, www. psychologistworld.
would prompt his computer to find similar links and to call them com/bodylanguage/ eyes. php.6’
up in a new window. But the first practical use for the research 4. SuvamChatterjee, Haoshi, "A Novel Neuro Fuzzy
turns out to be snooping on shoppers. Blue Eyes software makes
Approach to Human Emotion Determination",
sense of what the cameras see to answer key questions for retailers,
including, How many shoppers ignored a promotion? How many Digital Image Computing Techniques and
stopped? How long did they stay? Did their faces register boredom Application (DICIA), 2010 International
or delight? How many reached for the item and put it in their Conference.
shopping carts? Blue Eyes works by tracking pupil, eyebrow and
mouth movement. When monitoring pupils, the system uses a
camera and two infrared light sources placed inside the product
display. One light source is aligned with the camera's focus; the
other is slightly off axis. When the eye looks into the camera-
aligned light, the pupil appears bright to the sensor, and the
software registers the customer's attention. This is the way it
captures the person's income and buying preferences. Blue Eyes is
actively been incorporated in some of the leading retail outlets.
ii. Another application would be in the automobile industry. By
simply touching a computer input device such as a mouse, the
computer system is designed to be able to determine a person's
emotional state for cars, it could be useful to help with critical
decisions like: "I know you want to get into the fast lane, but I'm
afraid I can't do that. Your too upset right now" and therefore assist
in driving safely .
iii. Current interfaces between computers and humans can present
information vividly, but have no sense of whether that information
is ever viewed or understood. In contrast, new real-time computer
vision techniques for perceiving people allows us to create "Face-
responsive Displays" and "Perceptive Environments", which can
sense and respond to users that are viewing them. Using stereo-
vision techniques, we are able to detect, track, and identify users
robustly and in real time. This information can make spoken
language interface more robust, by selecting the acoustic
information from a visually-localized source. Environments can
become aware of how many people are present, what activity is
occuring, and therefore what display or messaging modalities are
most appropriate to use in the current situation .

Concluding remarks and future outlook

• Security systems - The security can be controlled by using
blue eye technology. the concerns of getting a wrong
person in security systems should be avoided and if his ntain guidance text for composing and formatting conference papers. Please
intentions are not harmful then he must be allowed to ensure that all template text is removed from your conference paper
enter the security system prior to submission to the conference. Failure to remove template text
from your paper may result in your paper not being published.
 We suggest that you use a text box to insert a graphic
(which is ideally a 300 dpi TIFF or EPS file, with all fonts
embedded) because, in an MSW document, thisethod is
somewhat more stable than directly inserting a picture.
To have non-visible rules on your frame, use the
MSWord “Format” pull-down menu, select Text Box >
Colors and Lines to choose No Fill and No Line.