Você está na página 1de 7


E.PRIYANKA -08671A0456
SIXTH SENSE TECHNOLOGY making the entire world your computer. It can turn
any surface into a touch-screen for computing,
Abstract controlled by simple hand gestures. It is not a
Every one of us is aware of the five basic senses – technology which is aimed at changing human
seeing, feeling, smelling, tasting and hearing. These habits but causing computers and other machines to
senses have evolved through millions of years. adapt to human needs. It also supports multi user
Whenever we encounter a new object/experience and multi touch provisions. Sixth Sense device is a
our natural senses try to analyse that experience mini-projector coupled with a camera and a cell
and the information that is obtained is used to phone—which acts as the computer and your
modify our interaction with the environment. But in connection to the Cloud, all the information stored
this new age of technologies the most important on the web. The current prototype costs around
information that helps one to make right decision is $350. The Sixth Sense prototype is used to
something that cannot be perceived and analysed implement several applications that have shown the
by our natural senses. That information is the data usefulness, viability and flexibility of the system.
in the digital form, and it is available to everyone
through sources like internet. The sixth sense SIXTH SENSE DEVICES
technology concept is an effort to connect this data 'Sixth Sense' is a wearable gestural interface that
in the digital world in to the real world. augments the physical world around us with digital
information and lets us use natural hand gestures to
Introduction interact with that information. The hardware
Although miniaturized versions of computers help components are coupled in a pendant like mobile
us to connect to the digital world even while we are wearable device. The Sixth Sense prototype is
travelling there aren’t any device as of now which comprised of a pocket projector, a mirror, coloured
gives a direct link between the digital world and markers and a camera. The camera, mirror and
our physical interaction with the real world. projector are connected wirelessly to a blue tooth
Usually the information’s are stored traditionally smart phone device that can easily fit into the
on a paper or a digital storage device. Sixth sense user’s pocket. Software then processes the data that
technology helps to bridge this gap between is collected by the capturing device and produces
tangible and non-tangible world. Sixth Sense analysis. The software that is used in sixth sense
device is basically a wearable gestural device is open source type.
interface that connects the physical world around
us with digital information and lets us use natural
hand gestures to interact with this information .The
sixth sense technology was developed by Pranav
Mistry, a PhD student in the Fluid Interfaces Group
at the MIT Media Lab. The sixth sense technology
has a Web 4.0 view of human and machine
interactions. Sixth Sense integrates digital
information into the physical world and its objects,
Camera Mirror
It captures the image of the object in view and The usage of a mirror is important as the projector
tracks the user’s hand gesture. The camera dangles pointing downwards from the neck. The
recognizes individuals, images, pictures, gestures mirror reflects the image on to a desire surface.
that user makes with his hand. The camera then Thus finally the digital image is freed from its
sends this data to a smart phone for processing. confines and placed in the physical world.
Basically the camera forms a digital eye which
connects to the world of digital information.

Coloured Marker
There are colour markers placed at the tip of user’s
finger. Marking the user’s fingers with red, yellow
green and blue coloured tape helps the webcam to
recognize the hand gestures. The movements and
arrangement of these markers are interpreted into
gestures that act as an interaction instruction for the
projected application interfaces.

Mobile Component
The Sixth Sense device consists of a web enabled
smart phone which process the data send by the
Technologies that are related to Sixth Sense
camera. The smart phone searches the web and
interprets the hand gestures with help of the
coloured markers placed at the finger tips.
Gesture Recognition
It is a technology which is aimed at interpreting
human gestures with the help of mathematical
The information that is interpreted through the
algorithms. Gesture recognition technique basically
smart phone can be projected into any surface. The
focuses on the emotion recognition from the face
projector projects the visual information enabling
and hand gesture recognition. Gender recognition
surfaces and physical objects to be used as
technique enables humans to interact with
interfaces. The projector itself consists of a battery
computers in a more direct way without using any
which have 3 hours of battery life .A tiny LED
external interfacing devices. It can provide a much
projector displays the data sent from the smart
better alternative to text user interfaces and
phone on any surface in view- object, wall or
graphical user interface which requires the need of
person. The downward facing projector projects the
a keyboard or mouse to interact with the computer.
image on to a mirror.
An interface which solely depends on the gestures
requires precise hand pose tracking. In the early
versions of gesture recognition process special type
of hand gloves which provide information about
hand position orientation and flux of the fingers. In it’s almost certain that the device will cost much
the Sixth Sense devices coloured bands are used for lower than the current price.
this purpose. Once hand pose has been captured the
gestures can be recognised using different Connectedness between real world and digital
techniques. Neural network approaches or world
statistical templates are the commonly used Forming a connection between the real world and
techniques used for the recognition purposes. This the digital world was the main aim of the sixth
technique has a high accuracy usually showing sense technology.
accuracy of more than 95%. Time dependent neural
network will also be used for real time recognition Data access directly from the machines in real
of the gestures. time
With help of a sixth sense device the user can
ADVANTAGES OF SIXTH SENSE DEVICES easily access data from any machine at real time
speed. The user doesn’t require any machine-
Portable human interface to access the data. The data access
One of the main advantages of the sixth sense through recognition of hand gestures is much easier
devices is its small size and portability. It can be and user friendlier compared to the text user
easily carried around without any difficulty. The interface or graphical user interface which requires
prototype of the sixth sense is designed in a way keyboard or mouse.
that it gives more importance to the portability
factor. All the devices are light in weight and the Mind map the idea anywhere
smart phone can easily fit into the user’s pocket. With the advent of the sixth sense device,
requirement of a platform or a screen to analyse
Support multi touch and multi user interaction and interpret the data has become obsolete. We can
Multi touch and multi user interaction is another project the information into any surface and can
added feature of the sixth sense devices. Multi work and manage the data as per our convenience.
sensing technique allows the user to interact with .
system with more than one finger at a time... Sixth Open source software
sense devices also in-cooperates multi user The software that is used to interpret and analyse
functionality. This is typically useful for large the data collected by the device is made open
interaction scenarios such as interactive table tops source. This enables other developers to contribute
and walls. to the development of the system.

Cost effective DISADVANTAGES

The cost incurred for the construction of the sixth The only disadvantage of the sixth sense
sense proto type is quiet low. It was made from technology is that the lifetime of the battery is only
parts collected together from common devices. And 3 hours.
a typical sixth sense device cost up to $300. The
sixth sense devices have not been made in large
scale for commercial purpose. Once that happens
The sixth sense technology finds a lot of
application in the modern world. The sixth sense
devices bridge the gap by bringing the digital world
into the real world and in that process allowing the
users to interact with the information without the
help of any machine interfaces. Prototypes of the
sixth sense device have demonstrated viability,
usefulness and flexibility of this new technology.
According to the words of its developers the extent
of use of this new device is only limited by the
imagination of human beings. Some practical
applications of the sixth sense technology is given

The user taking making a pose gesture

Map Application
The camera takes the photo of the location
With the help of a map application the user can call
Drawing Application
upon any map of his/her choice and navigate
The drawing application allows the user you to
through them by projecting the map on to any
draw on any surface by tracking the fingertip
surface. By using the thumb and index fingers
movements of the user’s index finger. The pictures
movements the user can zoom in, zoom out or pan
that are drawn by the user can be stored and
the selected map.
replaced on any other surface. The user can also
shuffle through various pictures and drawing by
using the hand gesture movements.

The user calling up a map

Taking Pictures
Another application of sixth sense devices is the
Making Calls
implementation of a gestural camera. This camera
We can make calls with help of sixth sense
takes the photo of the location user is looking at by
device .The sixth sense device is used to project the
detecting the framing gesture. After taking the
keypad into your palm and the using that virtual
desired number of photos we can project them onto
keypad we can make calls to anyone.
any surfaces and then use gestures to sort through
those photos and organize and resize them.
Getting Information
Sixth sense devices can be used for getting various
informations relating to our everyday life by
getting in contact with objects.

Using palm for dialling a number

Interacting with physical objects

The Sixth Sense system also helps to interact with
physical objects we use in a better way. It augments
physical objects by projecting more information
about these objects projected on them. For
example, a gesture of drawing a circle on the user’s
wrist projects an analog watch on the user’s hand.
Similarly a newspaper can show live video news or
dynamic information can be provided on a regular
piece of paper.

Product Information:
Sixth sense technology uses marker technology or
image recognition techniques to recognize the
objects we pick in our hand and then provide

Newspaper showing live feeds information relating to that product.

an analog watch projected into the wrist

Book Information:
By holding and shuffling through the book pages, The sixth sense technology and devices are
the sixth sense provides Amazon ratings on that definitely the way forward. The sixth sense
book, other reviews and other relevant things recognizes the objects around us and displays the
related to the book. information relating to those objects in a real time
environment. The sixth sense technology allows the
user to interact the information through hand
gestures. This is a quiet efficient way compared to
the text and graphic based user interface. It has the
potential to form the transparent user interface for
accessing the information around us. . Even though
the sixth sense devices are currently in
development stages and have not been used in large
Flight Updates:
now, it’s quiet predictable that this technology have
With the help of the sixth sense technology it is no
the potential to revolutionise the way in which we
longer required to log into any sites for checking
interacts with the digital world.
the status of the flights. The system will recognize
your boarding pass and let you know whether the
flight is on time or not.

• http://www.ted.com/talks/pranav_mistry_t
• http://www.commoncraft.com/augmented-
• http://www.arcane-technologies.com/en/
Boarding pass showing current flight status • http://en.wikipedia.org/wiki/Augmented_r

Information about People: eality

With help of face recognition techniques the sixth • http://www.rfidjournal.com/

sense devices are able to provide information about • http://www.ted.com/talks/pattie_maes_de
the people when we meet them. The sensor detects mos_the_sixth_sense.html
the face and checks the data base for the relevant • http://timesofindia.indiatimes.com/Health
information. The system will then project the __Science/Sixth_sense_gizmo_a_sci-
relevant information about a person like what they fi_reality/articleshow/4083978.cms
do, where they work, • http://www.gesturetek.com/