Escolar Documentos
Profissional Documentos
Cultura Documentos
( blue eyes –
Human operator
monitoring system )
Agenda
•Motivation
•What is
BlueEyes ? Motivation
•Physiological
foundations
What is BlueEye technology ?
•System
What is BlueEyes ?
design System designing
•System System overview
implementation
DAU
•Future
improvements
CSU
•Project work
Data security
summary IBM research
•System Conclusion
demonstration
Motivation
•Motivation
•What is
BlueEyes ?
•Physiological
Human error - a frequent reason of
foundations
•System
catastrophes and ecological disasters
design
•System
implementation
•Future -temporary indisposition
improvements
•Project work
-weariness
summary
•System
-oversight
demonstration
What is blue eye
technology ?
The BLUE EYES technology
aims at creating
computational machines that
have perceptual and sensory
ability like those of human
beings.
How can we make
computers “see” and
“feel” ?
Blue eyes uses sensing technology to
identify a user’s actions and to extract
key information.
Information is then analyzed to
determine the user’s physical
,emotional ,or informational state.
What is BlueEyes ?
•Motivation
•What is
BlueEyes ?
The complex solution for human-operator monitoring:
•Physiological
foundations – Visual attention monitoring
•System – Physiological condition
design
– Operator’s position detection
•System
implementation – Wireless data acquisition using bluetooth
•Future – Real time user defined alarm triggering
improvements
– Recorded data playback
•Project work
summary
•System
demonstration
What is BlueEyes not?
Doesn’t predict nor interfere with
operator’s thoughts
Cannot force directly the operator to
work
Applications of BlueEyes
•Motivation
•What is
BlueEyes ?
•Physiological
Generic control rooms
foundations
•System
(System can be applied in every working environment
design requiring permanent operator’s attention)
•System
implementation – Power station
•Future – Captain bridge
improvements
•Project work – Flight control centers
summary
– Operating theatres – anesthesiologists
•System
demonstration
BlueEyes - benefits
•Motivation
•What is
BlueEyes ?
•Physiological
foundations
•System
Prevention from dangerous incidents
design
•System
implementation Minimization of
•Future
improvements – ecological consequences
•Project work
summary – financial loss
•System
demonstration – a threat to a human life
The reconstruction
of the course of
operator’s work
Implementation and
engineering
considerations
-THREE groups of users
OPERATOR -a person whose physiological parameters are
supervised
- authorization in the system
- receiving alerts
SUPERVISOR – a person responsible for analyzing operator’s
Jazz Multisensor
Jazz
DAU
The DAU consists of the following components
ATMEL 8952 microcontroller
BLUE TOOTH MODULE – supports synchronous voice
data transmission
PCM CODEC –used to transmit operator’s voice and
central system sound feedback
UART –communication between bluetooth module and
microcontroller (115200 bps)
MAX232 –level shifter
ALPHAUNUMERIC LCD display
LED indicators
ID CARD interface
DAU - components
microphone MC 145483
earphone PCM codec
UART
microcontroller
LCD display
UART MAX232
LED indicators
BlueEyes
Data Acquisition Unit
ID card Simple
interface keyboard
ID card
Microcontroller & blue
tooth module
EEPROMS & the PCB
Implementation - DAU
•Motivation
•What is
BlueEyes ?
•Physiological
•DAU
•CSU
•Future
improvements
Bluetooth module
Batteries and
•Project work
summary
•System
voltage level monitor
demonstration
DAU - features
•Motivation
•What is Data Acquisition Unit
BlueEyes ?
•Physiological
foundations
Lightweight
Atmel 89C52
•System
design microcontroller
Bluetooth Runs on batteries - low
•Objectives power consumption
Jazz
•System
overview Multisensor Easy to use - does not
•DAU disturb the operator
•CSU
working
•System
implementation
ID cards for operator
•Future authorization
improvements
•Project work Voice transmission using
summary
•System
hardware PCM codec
demonstration
CSU - features
•Motivation
•What is Central System Unit
BlueEyes ? Connection
•Physiological
foundations management Connection Visualization
•System Bluetooth Manager Module
design
•Objectives
Data
•System processing Data Analysis
Data
Logger
overview
•DAU Visualization
•CSU
Data recording
•System
implementation
Access
•Future
improvements
verification
•Project work
summary
System maintenance
•System
demonstration
CSU – components
CONNECTION MANAGER – main task to
perform low-level blue tooth communication
DATA ANALYSIS MODULE – performs the
analysis of the raw sensor data in order to
obtain information about operator’s
physiological condition
DATA LOGGER MODULE – provides support
for storing the monitored data.
VISULAIZATION MODULE – provides user
interface for the supervisors
CSU - Visualization
•Motivation Module
•What is
BlueEyes ?
•Physiological
Raw and processed data visualization
foundations
•System
using:
design – VU-meters
•Objectives
•System – pie-charts
overview
•DAU – time series
•CSU
•System
implementation
•Future
audio and video
improvements
•Project work data playback
summary
•System
demonstration
Data security
•Motivation
•What is
BlueEyes ?
•Physiological Only registered mobile devices
foundations
•System can connect to the system
design
•Objectives Bluetooth connection authentication
•System
overview
•DAU
Bluetooth connection encryption
•CSU Access rights restrictions
•System
implementation
Personal and physiological data
•Future
improvements encryption
•Project work
summary
•System
demonstration
IBM research
BLUE EYE – EMOTIONAL MOUSE
sensors in the mouse ,sense the
physiological attributes which are
correlated to emotions using
correlation model
-by simply touching the mouse ,the
computer will be able to determine a
person’s emotional state.
BLUE EYE enabled TELEVISION – could
become active when the user makes
an eye contact.
Conclusion
In the near future ,ordinary
household devices- such as
television , refrigerators ,ovens
may be able to do their jobs when
we look at them and speak to
them.
Future applications of blue eye
technology is limitless
References
www.seminar4u.com
www.howstuffswork.com
www.cs.put.poznan.com
www.whitepapers.com
www.ibmresearchcenter.com
www.almaden.ibm.com
•Motivation
•What is
Thank you
BlueEyes ?
•Physiological
foundations
•System
design
BlueEyes
•System
implementation
•System
demonstration
Human-Operator
•Future
improvements
•Project work
summary
Monitoring System