SSCET 1

Technical paper presentation

on

“ BRAINGATE SYSTEM”
(Application of human computer interaction)

Presented by
M.V.S.Sushmitha E.N.V.Serisha
06R81A0517 06R81A0521
CSE,3/4 Btech CSE,3/4Btech
susmitha.mylavarapu@gmail.com sirisha.enturi@gmail.com
Sri Sunflower College of Engineering & Technology

ABSTRACT: generated even though they are

The mind-to-movement not sent to the arms, hands and
system that allows a legs.The signals are interpreted
quadriplegic man to control a and translated into cursor
computer using only his movements, offering the user
thoughts is a scientific an alternate Brain Gate
milestone. It was reached, in pathway to control a computer
large part, through the brain with thought,just as individuals
gate system. This system has who have the ability to move
become a boon to the their hands use a mouse.
paralyzed. The Brain Gate The 'Brain Gate'
System is based on Cyber contains tiny spikes that will
kinetics platform technology to extend down about one
sense,transmit,analyze and millimetre into the brain after
apply the language of neurons. being implanted beneath the
The principle of operation skull,monitoring the activity
behind the Brain Gate System from a small group of
is that with intact brain neurons.It will now be possible
function, brain signals are for a patient with spinal cord
 SSCET 2

injury to produce brain signals whenever they are stimulated.

that relay the intention of The electrical patterns are
moving the paralyzed limbs,as called brain waves. Neurons act
signals to an implanted like the wires and gates in a
sensor,which is then output as computer, gathering and
electronic impulses. These transmitting electrochemical
impulses enable the user to signals over distances as far as
operate mechanical devices several feet. The brain encodes
with the help of a computer information not by relying on
cursor. Matthew Nagle,a 25- single neurons, but by
year-old Massachusetts man spreading it across large
with a severe spinal cord populations of neurons, and by
injury,has been paralyzed from rapidly adapting to new
the neck down since 2001.After circumstances.
taking part in a clinical trial of Motor neurons carry
this system,he has opened e- signals from the central nervous
mail,switched TV system to the muscles, skin and
channels,turned on lights.He glands of the body, while
even moved a robotic hand sensory neurons carry signals
from his wheelchair. This from those outer parts of the
marks the first time that neural body to the central nervous
movement signals have been system. Receptors sense things
recorded and decoded in a like chemicals, light, and sound
human with spinal cord and encode this information
injury.The system is also the into electrochemical signals
first to allow a human to transmitted by the sensory
control his surrounding neurons. And interneurons tie
environment using his mind. everything together by
How does the brain control connecting the various neurons
motor function? within the brain and spinal
The brain is cord. The part of the brain that
"hardwired" with connections, controls motor skills is located
which are made by billions of at the ear of the frontal lobe.
neurons that make electricity
 SSCET 3

How does this NEUROPROSTHETIC

communication happen? DEVICE:
A neuroprosthetic
Muscles in the body's limbs
device known as Braingate
contain embedded sensors
converts brain activity into
called muscle spindles that
computer commands. A sensor
measure the length and speed
is implanted on the brain, and
of the muscles as they stretch
electrodes are hooked up to
and contract as you move.
wires that travel to a pedestal
Other sensors in the skin
on the scalp. From there, a fiber
respond to stretching and
optic cable carries the brain
pressure. Even if paralysis or
activity data to a nearby
disease damages the part of the
computer.
brain that processes movement,
PRINCIPLE:
the brain still makes neural
signals. They're just not being "The principle of

sent to the arms, hands and operation of the BrainGate

legs. Neural Interface System is that

with intact brain function,
 A technique called
neural signals are generated
neurofeedback uses
even though they are not sent to
connecting sensors on the
the arms, hands and legs. These
scalp to translate brain
signals are interpreted by the
waves into information a
System and a cursor is shown
person can learn from. The
to the user on a computer
sensors register different
screen that provides an
frequencies of the signals
alternate "BrainGate pathway".
produced in the brain.
The user can use that cursor to
These changes in brain
control the computer, just as a
wave patterns indicate
mouse is used."
whether someone is
concentrating or
suppressing his impulses, or
whether he is relaxed or
tense.
 SSCET 4

BrainGate is a brain implant

system developed by the
bio-tech company
Cyberkinetics in 2003 in
conjunction with the
Department of
Neuroscience at Brown
University. The device
was designed to help
those who have lost
control of their limbs, or
other bodily functions,
such as patients with
amyotrophic lateral
sclerosis (ALS) or spinal
cord injury. The
computer chip, which is
implanted into the
patient and converts the
intention of the user into

computer commands.

NEURO CHIP:
 SSCET 5

patterns in a patient with

epilepsy.
Braingate is currently recruiting
patients with a range of
neuromuscular and
neurodegenerative conditions
Currently the chip uses for pilot clinical trials in the
100 hair-thin electrodes that United States.
'hear' neurons firing in specific
areas of the brain, for example,
the area that controls arm
movement. The activity is
translated into electrically
charged signals and are then
sent and decoded using a
program, which can move
either a robotic arm or a
computer cursor. According to
the Cyberkinetics' website,
three patients have been
implanted with the BrainGate WORKING:
system. The company has Operation of the BCI
confirmed that one patient system is not simply listening
(Matt Nagle) has a spinal cord the EEG of user in a way that
injury, whilst another has let’s tap this EEG in and listen
advanced ALS. what happens. The user usually
In addition to real-time generates some sort of mental
analysis of neuron patterns to activity pattern that is later
relay movement, the Braingate detected and classified.
array is also capable of PREPROCESSING:
recording electrical data for The raw EEG signal
later analysis. A potential use requires some preprocessing
of this feature would be for a before the feature extraction.
neurologist to study seizure This preprocessing includes
 SSCET 6

removing unnecessary band pass filtering the signal,

frequency bands, averaging the then calculating these time -or
current brain activity level, frequency domain features and
transforming the measured then classifying them. These
scalp potentials to cortex classification algorithms
potentials and denoising. include simple comparison of
Frequency bands of the EEG : amplitudes linear and non-
. linear equations and artificial
Band Frequen- Amplit- Location
neural networks. By constant
cy [Hz] -ude
[_V] feedback from user to the
Alpha 8-12 10 -150 Occipital/
system and vice versa, both
(_) Parietal
regions partners gradually learn more
µ- 9-11 varies Precentral/
from each other and improve
rhyth Postcentra
m l regionsthe overall performance.
Beta 14 -30 25 typically
CONTROL:
(_) frontal
regions The final part consists
Theta 4-7 varies varies
(_) of applying the will of the user
Delta
<3 varies varies to the used application. The
(_)
user chooses an action by
controlling his brain activity,
DETECTION:
which is then detected and
The detection of the input
classified to corresponding
from the user and them
action. Feedback is provided to
translating it into an action
user by audio-visual means e.g.
could be considered as key part
when typing with virtual
of any BCI system. This
keyboard, letter appears to the
detection means to try to find
message box etc.
out these mental tasks from the
TRAINING:
EEG signal. It can be done in
The training is the part
time-domain, e.g. by comparing
where the user adapts to the
amplitudes of the EEG and in
BCI system. This training
frequency-domain. This
begins with very simple
involves usually digital signal
exercises where the user is
processing for sampling and
familiarized with mental

activity which is used to relay
the information to
computer. Motivation,
frustration, fatigue, etc. apply
also here and their effect should
be taken into consideration
when planning the training
procedures.
BIO FEEDBACK:
The definition of the
biofeedback is biological
information which is returned
to the source that created it, so
that source can understand it
and have control over it. This
biofeedback in BCI systems is
usually provided by visually,
e.g. the user sees cursor moving
up or down or letter being
selected from the alphabet.
A boon to the paralyzed
-Brain Gate Neural Interface
System
The first patient,
Matthew Nagle, a 25-year-old
Massachusetts man with
severe spinal cord injury, has
SSCET 7
been paralyzed from the neck
the down since 2001. Nagle is
unable to move his arms and
legs after he was stabbed in the
neck. During 57 sessions, at
New England Sinai Hospital
and Rehabilitation Center,
Nagle learned to open
simulated e-mail, draw circular
shapes using a paint program
on the computer and play a
simple videogame, "neural
Pong," using only his thoughts.
He could change the channel
and adjust the volume on a
television, even while
conversing. He was ultimately
able to open and close the
fingers of a prosthetic hand and
use a robotic limb to grasp and
move objects. Despite a decline
in neural signals after few
months, Nagle remained an
active participant in the trial
and continued to aid the clinical
team in producing valuable
feedback concerning the
BrainGate` technology.
a

NAGLE’S STATEMENT:
“I can't put it into
words. It's just—I use my brain.
I just thought it. I said, "Cursor
go up to the top right." And it
did, and now I can control it all
over the screen. It will give me
a sense of independence.”
SSCET 8
OTHER APPLICATIONS:
Rats implanted with
BCIs in Theodore Berger's
experiments.Several
laboratories have managed to
record signals from monkey
and rat cerebral cortexes in
order to operate BCIs to carry
out movement. Monkeys have
navigated computer cursors on
screen and commanded robotic
arms to perform simple tasks
simply by thinking about the
task and without any motor
output. Other research on
cats has decoded visual
signals.
Garrett Stanley's
recordings of cat vision
using a BCI implanted in the
lateral geniculate nucleus
(top row: original image;
bottom row: recording) in
1999, researchers led by

Garrett Stanley at Harvard
University decoded neuronal
firings to reproduce images
seen by cats. The team used an
array of electrodes embedded in
the thalamus (which integrates
all of the brain’s sensory input)
of sharp-eyed cats. Researchers
targeted 177 brain cells in the
thalamus lateral geniculate
nucleus area, which decodes
signals from the retina. The cats
were shown eight short movies,
and their neuron firings were
recorded. Using mathematical
filters, the researchers decoded
the signals to generate movies
of what the cats saw and were
able to reconstruct recognisable
scenes and moving objects.
In the 1980s, Apostolos
Georgopoulos at Johns Hopkins
University found
mathematical relationship
between the (based on a cosine
function). He also found that
dispersed groups of neurons in
SSCET 9
different areas of the brain
collectively controlled motor
commands but was only able to
record the firings of neurons in
one area at a time because of
technical limitations imposed
by his equipment.[4]
There has been rapid
development in BCIs since the
mid-1990s.[5] Several groups
have been able to capture
complex brain motor centre
signals using recordings from
neural ensembles (groups of
neurons) and use these to
control external devices,
including research groups led
by Richard Andersen, John
Donoghue, Phillip Kennedy,
Miguel Nicolelis, and Andrew
Schwartz.
Diagram of the BCI
a developed by Miguel Nicolelis
and collegues for use on
Rhesus monkeys
Later experiments by
Nicolelis using rhesus
 SSCET 10

monkeys, succeeded in closing from far fewer neurons than

the feedback loop and Nicolelis (15–30 neurons
reproduced monkey reaching versus 50–200 neurons).
and grasping movements in a Donoghue's group
robot arm. With their deeply reported training rhesus
cleft and furrowed brains, monkeys to use a BCI to track
rhesus monkeys are considered visual targets on a computer
to be better models for human screen with or without
neurophysiology than owl assistance of a joystick (closed-
monkeys. The monkeys were loop BCI).[10] Schwartzss's
trained to reach and grasp group created a BCI for three-
objects on a computer screen dimensional tracking in virtual
by manipulating a joystick reality and also reproduced BCI
while corresponding control in a robotic arm.
movements by a robot arm
were hidden.The monkeys were CONCLUSION:
later shown the robot directly The idea of moving
and learned to control it by robots or prosthetic devices not
viewing its movements. The by manual control, but by mere
BCI used velocity predictions “thinking” (i.e., the brain
to control reaching movements activity of human subjects) has
and simultaneously predicted been a fascinated approach.
hand gripping force. Medical cures are unavailable
Other labs that develop for many forms of neural and
BCIs and algorithms that muscular paralysis. The
decode neuron signals include enormity of the deficits caused
John Donoghue from Brown by paralysis is a strong
University, Andrew Schwartz motivation to pursue BMI
from the University of solutions. So this idea helps
Pittsburgh and Richard many patients to control the
Andersen from Caltech. These prosthetic devices of their own
researchers were able to by simply thinking about the
produce working BCIs even task.
though they recorded signals
 SSCET 11

This technology is well working conference on

supported by the latest fields of Advanced visual interfaces.
Biomedical Instrumentation, New York, NY, USA :
Microelectronics, signal ACM,Mai 2008, S. 490{491.
processing, Artificial Neural 3)http://portal.acm.org/citation.
Networks and Robotics which cfm?id=1385569.1385671.
has overwhelming { ISBN 0-978-60558-141-5
developments. Hope these 4)[Huffman 2008] Huffman,
systems will be effectively Scott: Search evaluation at
implemented for many Google.
Biomedical applications. Website.September2008.{URL
http://googleblog.blogspot.com/
REFERENCES 2008/09/
1)Graun, Christian ; Gerken, search-evaluation-at-
Jens ; Jetter, Hans-Christian ; google.html
Kaonig,Werner ; Reiterer,
Harald: MedioVis - a User-
Centred Library Metadata
Browser.In: ECDL 2005:
Research and Advanced
Technology for Digital
Libraries, Proceedingsof the 9th
European Conference on
Digital Libraries, Springer
Verlag, September 2005.
2)[Heilig u. a. 2008] Heilig,
Mathias ; Demarmels, Mischa ;
Konig, Werner A. ; Gerken,
Jens ; Rexhausen, Sebastian ;
Jetter, Hans-Christian ;
Reiterer, Harald:
MedioVis: visual information
seeking in digital libraries. In:
AVI '08: Proceedings ofthe