A Project Proposal Report

On

DETECTION OF THE SELECTED, BASIC EMOTIONS

BASED ON FACE EXPRESSION USING KINECT
Submitted by

Amarender Reddy (13IT01F)

Ashok Kumar J (13IT12F)
Sundeep Vilasagarapu (13IT25F)

In partial fulfillment for the award of the degree

Of

Master of Technology
In

Information Technology
Under the guidance of
Prof G.R.M Reddy

Department Of Information Technology

National Institute Of Technology Karnataka, Surathkal.
2013-2014
1

CERTIFICATE

This is to certify that the project entitled Detection of the selected, basic emotions based
on face expression using Kinect is a bonafide work carried out as part of the course
Multimedia systems, under my guidance by Amarender Reddy, Ashok Kumar J, Sundeep
Vilasagarapu

M.Tech (Fulltime) students at the Department of Information Technology,

National Institute of Technology Karnataka, Surathkal, during the academic semester II , in

partial fulfillment of the requirements for the award of the degree of Master of Technology in
Information Technology, at NITK Surathkal.

Place:

Signature of the Faculty

Date:

DECLARATION

I hereby declare that the project entitled Detection of the selected, basic emotions based
on face expression using Kinect submitted as part of the partial course requirements for the
course Multimedia systems for the award of the degree of Master of Technology in Information
Technology at NITK Surathkal has been carried out by me. The project has not formed the
basis for the award of any degree, fellowship or any other similar titles elsewhere.

Further, I agree that I will not share, re-submit or publish the code, idea, framework
and/or any publication that may arise out of this work elsewhere for academic or profit purposes
without first obtaining due permission through written consent from the project guide.

Signature of the Student:

Place: Surathkal
Date:

ABSTRACT
Automation of reading emotion from facial expression is a milestone of communication
between human and computer. This paper presents an application and way which allows to
recognize four (anger, happiness, sadness and surprise) from six basic emotions defined by
Paul Ekman. Application Emotion Detector use very simple method to recognize it. Thanks
to data provided by Kinect, algorithms like k nearest neighbors & SVM can classify user
emotion in real time.

TABLE OF CONTENTS
1.

INTRODUCTION .......................................................................................................1

2.

LITERATURE SURVEY.............................................................................................3

3.

METHODOLOGY........................................................................................................6

4.

WORKDONE AND RESULTS..................................................................................10

5.

CONCLUSION AND FUTURE WORK.................................................................12

6.

REFERENCES.............................................................................................................13

LIST OF FIGURES
2.2.1 Showing Kinect construction.3
3.1

Position of Action units on human face.4

4.1

Classification using KNN..8

4.2

Classification using SVM..8

4.3

Compassion of results using SVM vs KNN..9

LIST OF TABLES
2.2.1 Description of video streams provided by Kinect.3