BARKATULLAH UNIVERSITY INSTITUE OF TECHNOLOGY

PRESENTATION ON

BLUE EYES TECHNOLOGY

Submitted to: MISS MAYURI CHOURE RAJORIYA

Submitted by:DEEPENDRA CIVIL ENGG. 4th SEM

CONTENTS

1. 2.

Introduction How can we make computer see and feel? Technologies Used Emotion mouse and its Application MAGIC and its Application SUITOR and its Application Artificial Intelligent Speech Recognition and its Application Advantages of Blue Eyes Technology

3. 4. 5. 6. 7. 8.

INTRODUCTION:
Is it possible to create a computer, which can interact with us as we interact each other? For example imagine in a fine morning you walk on to your computer room and switch on your computer, and then it tells you Hey friend, good morning you seem to be a

bad mood today. And then it opens your mail box and shows you some of the mails and tries to cheer you. It seems to be a fiction, but it will be the life lead by BLUE EYES in the very near future. The basic idea behind this technology is to give the computer the human power. We all have some perceptual abilities. That is we can understand each others feelings. For example we can understand ones emotional state by analyzing his facial expression. If we add these perceptual abilities of human to computers would enable computers to work together with human beings as intimate partners. The BLUE EYES technology aims at creating computational machines that have perceptual and sensory ability like those of human beings. Imagine yourself in a world where humans interact with computers. You are sitting in front of your personal computer that can listen, talk, or even scream aloud. It has the ability to gather information about you and interact with you through special techniques like facial recognition, speech recognition, etc. It can even understand your emotions at the touch of the mouse. Human cognition depends primarily on the ability to perceive, interpret, and integrate audiovisuals and sensoring information. Adding extraordinary perceptual abilities to computers would enable computers to work together with human beings as intimate partners The BLUE EYES technology aims at creating computational machines that have perceptual and sensory ability like those of human beings. It uses non-obtrusive sensing method, employing most modern

video cameras and microphones to identify the users actions through the use of imparted sensory abilities. The machine can understand what a user wants, where he is looking at, and even realize his physical or emotional state.

How can we make computers "see" and "feel"?

Blue Eyes uses sensing technology to identify a user's actions and to extract key information. This information is then analyzed to determine the user's physical, emotional, or informational state, which in turn can be used to help make the user more productive by performing expected actions or by providing expected information. For example, a Blue Eyesenabled television could become active when the user makes eye contact, at which point the user could then tell the television to turn on". Most of us hardly notice the surveillance cameras watching over the grocery store or the bank. But lately those lenses have been looking for far more than shoplifters.

THEORY:

Based on Paul Elmans facial expression work, we see a correlation between a persons emotional state and a persons physiological measurements. Selected works from Ekman and others on measuring facial behaviours describe Ekmans Facial Action Coding System (Ekman and Rosenberg, 1997). One of his experiments involved participants attached to devices to record certain measurements including pulse, galvanic skin response (GSR), temperature, somatic movement and blood pressure. He then recorded the measurements as the participants were instructed to mimic facial expressions which corresponded to the six basic emotions. He defined the six basic emotions as anger, fear, sadness, disgust, joy and surprise. From this work, Dryer (1993) determined how physiological measures could be used to distinguish various emotional states The need of an hour is to design an adaptive smart computer system that could possibly recognize your face gestures, speed and even track your eye. An alternative approach to gather personal information through touch. A smart computer can gain information about the user through touch via a special mouse and determine his emotional state, which in turn is related to the task user is currently involved in with the computer. Emotional aspect of a person are critical for rational decision making In other words, emotion detection is the best

approach to an adaptive computer system by imparting the computer a longitudinal understanding of emotional state of the user, The other physiological measures that may affect the emotions of the user are;

A) HEART RATE: Heart rate is the frequency at which the heart generates impulses. B) GALVANIC SKIN RESPONSE: In response to an external stimulus (stimulus is anything which excites functional activity in an organ or part), such as touching a sharp points the resistance of skin response. C) GALVANIC SOMATIC ACTIVITY (GSA): The activities of afferent nerves that carry sensory information from the sensors on the skin to the brain is called as galvanic somatic activity. D) BLOOD PRESSURE: This is the pressure exerted by the blood vessel walls usually refer to the pressure within the arteries. Heart rate is measured through a chest strap sensor.

GSA samples are taken through the mouse driver. GSR sample through finger tips. Blood pressure through blood pressure sensor (BVP) which the user have to wear

THE OPERATION :
The computer will determine the emotional state the user when he simply touches the mouse. Sensors in the mouse sense the physiological attributes which, intern, are related to the personal emotional state. The changes in the temperature of the fingers also form a reliable measure for prediction of the users emotion.

SUITOR :
The need of the present scenario is to develop intimate relationship between the computer and humans. And the simple user interest trackers (SUITOR) are a revolutionary approach in this direction. By observing the webpage a bedizen is browsing, the suitor can help fetch more related information at his desktop. By simply noticing where the users eyes focus on the computer screen the SUITOR can be more precise eyes focus on the computer screen the SUITOR can be more precise in determining his topic of interest. It can even deliver relevant information to a handheld device

SUITOR WORKING
SUITOR fills a scrolling ticker on a computer screen with information related to the users current task. SUITOR knows where you are looking what application you are working and what web pages you may browse. If we are reading a webpage about something and if we need to read the heading of the ticker, it pops up the story in a Browser window. If we start to read the story it adds related stories to the tickers. That's the whole idea of an attentive system. One that attends to what you are doing, typing, reading. So that it can attend to yours information need. (Ticker is a type of watcher, or a type machine

ARTIFICIAL INTELLIGENT SPEECH RECOGNITION

It is important to consider the environment in which the speech recognition system has to work. The grammar used by the speaker and accepted byte system, noise level, noise type, position of the microphone, and speed and manner of the users speech are some factors that may affect the quality of speech recognition .When you dial the telephone number of a big company, you are likely to hear the sonorous voice of a cultured lady who responds to your call with great courtesy saying Welcome to company X. Please give me the extension number you want. You pronounce the

extension number, your name, and the name of person you want to contact. If the called person accepts the call, the connection is given quickly. This is artificial intelligence where an automatically-handling system is used without employing any telephone operator.

Advantages of Artificial Intelligent Speech Recognition

One of the main benefits of speech recognition system is that it lets user do other works simultaneously. The user can concentrate on observation and manual operations, and still control the machinery by voice input commands. Another major application of speech processing is in military operations. Voice control of weapons is an example. With reliable speech recognition equipment, pilots can give commands and information to the computers by simply speaking into their microphonesthey dont have to use their hands for this purpose. Another good example is a radiologist scanning hundreds of X-rays, ultra sonograms, CT scans and simultaneously dictating conclusions to a speech recognition system connected to word processors. The radiologist can focus his attention on the images rather than writing the text. Voice recognition could also be used on computers for making airline and hand held mobile device.

ADVANTAGES

1. Blue Eyes technology aims at creating computational Machines with perceptual and sensory abilities like those of human begins. Blue Eyes system is thus a versatile system which can be modified to cater to the working environment. 2. The Blue Eyes system has hardware with software loaded on it Blue Eyes system can be applied in every working environment requiring permanent operators attention for it. The hardware comprises of data acquisition unit and central system unit. The heart of Data acquisition unit is ATMEL 89C52 microcontroller Bluetooth technology is used for communication and coordination between the two units. Blue eye system can be applied in every working environment which requires permanent operators attention. 3. Blue eyes system provides technical means for monitoring and recording human operators physiological condition. A blue eyes is a project aiming to be a means of stress reliever driven by the advanced, technology of studying the facial expressions for judgment of intensity of stress handled

BlueEyes and Its Applications:

Blue Eyes is the name of a human recognition venture initiated by IBM to allow people to interact with computers in a more natural

manner. The technology aims to enable devices to recognize and use natural input, such as facial expressions. The initial developments of this project include scroll mice and other input devices that sense the user's pulse, monitor his or her facial expressions, and the movement of his or her eyelids. Animal survival depends on highly developed sensory abilities. Likewise, human cognition depends on highly developed abilities to perceive, integrate, and interpret visual, auditory, and touch information. Without a doubt, computers would be much more powerful if they had even a small fraction of the perceptual ability of animals or humans Blue Eyes system can be applied in every working environment requiring permanent operator's attention: at power plant, control rooms, at captain bridges, at flight control centres professional drivers.
1.

Engineers at IBM's ffice:smarttags" Research Centre in San Jose, CA, report that a number of large retailers have implemented surveillance systems that record and interpret customer movements, using software from Alma dens Blue Eyes research project.

Blue Eyes software makes sense of what the cameras see to answer key questions for retailers, including, how many shoppers ignored a promotion? How many stopped? How long did they stay? Did their faces register boredom or delight? How many reached for the item and put it in their shopping carts? Blue Eyes works by tracking pupil, eyebrow and mouth movement. When monitoring pupils, the system uses a camera and two infrared light sources placed inside the product display. One light source is aligned with the camera's focus; the other is slightly off axis. When the eye looks into the camera-aligned light, the pupil appears bright to the sensor, and the software registers the customer's attention. this is way it captures the person's income and buying preferences

2. Another application would be in the automobile industry. By simply touching a computer input device such as a mouse, the computer system is designed to be able to determine a person's emotional state. for cars, it could be useful to help with critical decisions like:

3. Current interfaces between computers and humans can present information vividly, but have no sense of whether that information is ever viewed or understood. In contrast, new real-time computer vision techniques for perceiving people allows us to create "Face-responsive Displays" and "Perceptive Environments", Environments can become aware of how many people are present, what activity is occurring, and therefore what display or messaging modalities are most appropriate to use in the current situation. The results of our research will allow the interface between computers and human users to become more natural and intuitive.

4. We could see its use in video games where, it could give individual challenges to customers playing video games. Typically targeting commercial business. The integration of children's toys, technologies and computers is enabling new play experiences that were not commercially feasible until recently. The Intel Play QX3 Computer Microscope, the Me2Cam with Fun Fair, and the Computer

Sound Morphed are commercially available smart toy products developed by the Intel Smart Toy Lab in. One theme that is common across these PC-connected toys is that users interact with them using a combination of visual, audible and tactile input & output modalities. 5. Where we are. We use our looks, feelings, and actions to give the computer the experience it needs to work with us. Keyboards and mice will not continue to dominate computer user interfaces. Keyboard input will be replaced in large measure by systems that know what we want and require less explicit communication. Sensors are gaining fidelity and ubiquity to record presence and actions; sensors will notice when we enter a space, sit down, lie down, pump iron, etc. Pervasive infrastructure is recording it. This technology is endless ranging from the voice operated lighting system at your house hold to the most advanced aero planes that can communicates with the pilot.

In the future ordinary house old appliances such as Refrigerator, Television, Microwave oven, may be able to do their jobs when we look at them and speak to them.

References: 1. BOOKS 2. WEB

THANK YOU