BLUE EYES TECHNOLOGY:

BRIDGING THE GAP BETWEEN HUMAN AND MACHINE

Yash Mulay
 2/21

AGENDA
Introduction – What, Why
Working
Benefits
Future
Conclusion
WHAT IS BLUE EYES
TECHNOLOGY
A system that uses non-intrusive sensors to
understand human behavior and emotions
through physiological data and visual attention.

In the term, Blue Eye Technology blue stands for

Bluetooth (enable wireless connection) & eye
stands for the movement of the eye to obtain
data.

The Goal is to Give computers human-like

perceptual abilities to create a more natural and
interactive experience.
 4/21

NEED OF BLUE EYES TECHNOLOGY

• Human errors can cause catastrophes and ecological disasters as
monitoring systems only focus on the state of processes, neglecting the
role of humans.
• The Blue Eyes system monitors the operator's conscious brain involvement
and physiological condition, such as weariness, to prevent human errors
and their consequences.
• This technology reduces production costs, operator fatigue, and prevents
dangerous incidents while suggesting better courses of action during daily
activities.
WORKING 5/21

• BLUE EYES Technology offers a solution for monitoring and recording physiological
parameters of operators in complex industrial environments.
• It tracks saccadic activity (visual attention) and head acceleration to monitor exposure
risks like toxic substances.
• Using a lethysmographic signal from the forehead, it calculates heart rate and blood
oxygenation, indicating heart and lung health. If abnormal values are detected, user-
defined alarms are triggered.
• The system records the
• operator's voice
• physiological data
• operating environment
• It consists of a mobile measuring device and a central analytical system with Bluetooth
communication between sensors and the central unit. Each operator has a personalized
ID card for data collection.
 6/21
A. HARDWARE
• Data Acquisition Unit (DAU): A mobile device with sensors to
collect physiological data (like heart rate, eye movements). It
communicates wirelessly with the central system.
• Central System Unit (CSU): Equipped with Bluetooth
modules and connected to a PC for processing. It handles data
from the DAU and provides a user interface for monitoring.
• ID Cards: Each operator is assigned an ID card for
personalized data collection.
• These components work together to track and analyze the
operator ’s physiological and psychological state.
 7/21

DAU: DATA ACQUISITION UNIT

• The Data Acquisition Unit (DAU) in the Blue

Eyes system is the mobile component that
collects physiological data from sensors and
transmits it to the central system for
processing.
• It manages wireless Bluetooth connections
(establishing, authenticating, and
terminating) and uses ID cards and PIN
codes for operator authorization.
• The DAU has a 5-key keyboard, LCD display,
and beeper for communication and alerts.
• A headset is used for voice data transmission.
• It consists of hardware modules such as the
Atmel 85C52 microcontroller, Bluetooth
module, LCD display, EEPROM, and sensor
interfaces, powered by G AA batteries.
 8/21

CSU: CENTRAL SYSTEM UNIT

• The Central System Unit (CSU) is equipped

with a Bluetooth module (ROK101008)
and a PCM codec for voice data
transmission.
• It connects to a PC via parallel, serial, and
USB cables, with mini-jack sockets for audio
data.
• Operator ID cards are programmed using a
programming device linked to a PC
through serial and PS/2 ports. This device
uses an Atmel 85C2051 microcontroller to
handle UART transmission and I2C
EEPROM programming.
 9/21
B. SOFTWARE
• The Blue Eyes software monitors operators' physiological conditions and
triggers alarms when necessary.
• It performs real-time buffering and analysis of data and consists of several
modules, including the system core which facilitates data flow between
other modules.
• The system core uses thread-safe queues to enable high scalability and easy
addition of new processing modules.
 •Connection Manager: Manages wireless
communication between mobile Data Acquisition 10/21
Units and the Central System Unit (CSU). Functions
include:
SOFTWARE ANALYSIS
• Handling communication with CSU
hardware
• Scanning for new devices and
establishing Bluetooth connections
• Authenticating connections, buffering
data
and sending notifications
•Data Analysis Module: Analyzes sensor data to
assess operator's physiological condition. It includes:
• Saccade detector: Tracks eye movements for
visual attention
• Pulse rate analyzer: Computes pulse
rate from blood oxygenation signals
• Custom analyzers: Detects
additional behaviors using the C4.5
decision tree Algorithm
•Visualization Module: Provides a graphical
interface for supervisors to monitor operators. It
shows real-time physiological data, video, audio
streams, and alerts. In offline mode, it allows
reviewing historical data to reconstruct a worker's
shift using pie charts and VU-meters for data
visualization.
TECHNOLOGIES USED IN BLUE 11/21

EYES TECH
• For Hand
o Emotion mouse
o Sentic Mouse
• For Eyes
o Expression Glasses
• For Voice
o AI Speech Recognition
• MAGIC (Manual and Gaze Input Cascaded)
• Suitor (Simple User Interest Tracker)
 12/21

EMOTION MOUSE
• PG refers to the photoplethysmogram, which is a
physiological signal that measures changes in volume
within the circulatory system.
• GSR refers to the galvanic skin response, which is a
measure of the electrical conductivity of the skin and is
used as an indicator of emotional and sympathetic
nervous system activity.
• SKT refers to the skin temperature, which is a
physiological signal that represents the temperature of
the skin and is used as an indicator of parasympathetic
nervous system activity.
 13/21

SENTIC MOUSE
• The Sentic Mouse is a computer mouse that has been
modified to include a directional pressure sensor for
the recognition of emotional valence
(i.e. liking/ attraction disliking/ avoidance) .
 14/21

EXPRESSION GLASSES
• The Eye Expression Glasses are wearable devices that
allow viewers to visualize the confusion and interest
levels of the wearer.
• Other recent developments in related technology
include attempts to learn the needs of users by tracking
their interaction with computers, in order to
determine their current interests.
 15/21

AI SPEECH RECOGNITION
• Artificial Intelligence (AI) studies human thought
processes and replicates them in machines like computers
or robots, allowing them to perform tasks that usually
require human intelligence. AI aims to make machines
smarter and more useful, and it's more cost-effective than
natural intelligence.
• Speech recognition lets users communicate with
computers via a microphone. It uses filters, like switched
capacitor digital filters, to improve accuracy. The system
converts the analog speech signal into a digital format
using an ADC and stores it in RAM for processing. Speech
frequency ranges from 200 Hz to 7 kHz for normal speech
and 300 Hz to 3.3 kHz for telephone calls. Spoken words
are converted into binary templates for comparison, and
statistical techniques are used to match them due to
variations in speech.
 16/21

MAGIC (MANUAL AND GAZE INPUT CASCADED)

• MAGIC pointing technique, a novel approach that uses eye gaze
for computer input. Unlike traditional gaze tracking, MAGIC
pointing combines eye gaze with manual input for better control.
• Key goals:
o Reduce fatigue: Minimizes manual effort by eliminating long-
distance cursor movements.
o Improve accuracy: Hand completes the task, making it as
accurate as other manual input methods, unlike pure gaze
tracking.
o Natural interaction: Users don’t need to be aware of their
eye
gaze, as pointing feels like a normal manual task.
o Increase speed: Less manual movement makes it faster than
purely manual pointing.
o Better user experience: Smaller manual movements make it
feel faster and easier to use.
 17/21

SUITOR (SIMPLE USER INTEREST TRACKER)

• If computers had sensory abilities like living beings,
they would be much more powerful.
• SUITOR (Simple User Interest Tracker) is a
revolutionary tool that enhances the relationship
between humans and computers.
• It helps internet users by observing the webpages they
browse and delivering relevant information to their
device.
• By tracking eye movements, SUITOR accurately
identifies the user's topic of interest, and its success
relies on how well it connects with the user.
 18/21

APPLICATIONS OF BLUE EYES TECH

• Speech recognition allows users to multitask by controlling machinery via
voice commands, useful in scenarios like military operations, where pilots
control weapons hands-free.
• Radiologists use speech recognition to dictate reports while analyzing medical
images, improving focus and efficiency.
• Airline and hotel industries use voice recognition for efficient reservations
and inquiries.
• It can prevent dangerous incidents and reduce ecological, financial, and
human risks.
• Blue Eyes system monitors the physiological condition of operators, tracking
visual attention, pulse rate, and position (standing/lying). It uses Bluetooth for
wireless data acquisition and triggers real-time alarms. It records physiological
data, voice, and the control room environment for comprehensive monitoring.
 19/21

FUTURE SCOPE
• IBM researchers are developing MAGIC technology, which tracks eye
movement to control the cursor on a screen, allowing users to select
objects by focusing on them and clicking the mouse.
• They are also working on emotion detection technology.
• In the future, Blue Eyes technology could enable computers to interact
with humans more efficiently, enhancing creativity and innovation.
 20/21

CONCLUSION
In the 1550s, there were significant advancements in interface design aimed at
improving interactions between humans and machines.
BLUE EYES technology is a user-friendly way of simplifying computing
devices.
The goal now is to improve the hardware without the need for bulky
modules to gather user information.
In the future, this technology may become commonplace in households,
potentially making people lazier and even being integrated into handheld
mobile devices.
However, this is simply a technological prediction.
THANK
YOU
Yash Mulay
7038450G25
[email protected]