1

Principal Component Analysis based Facial Expression

Recognition
Mr. Shubham Singhal Mr. Sukhwinder Singh
E&EC ENGINEERING E&EC DEPARTMENT
PEC UNIVERSITY OF TECHNOLOGY PEC UNIVERSITY OF TECHNOLOGY
CHANDIGARH CHANDIGARH
shubhamsinghal2908@gmail.com mfs1980@rediffmail.com

Abstract : I n this Paper a facial expression algorithm has been proposed. Face is the most important part of human
beings identity , so as to recognize the expressions of the face for identity purpose provides a great deal of importance .
Five Expressions Happy, Anger , Neutral , Disgust and Sad has been recognized in this paper using Principal
Component analysis technique. Firstly the eigen vectors are located and then the number of vectors are minimized
using PCA and at the end Euclidean distance classifier is used. Each expression can be recognized by level of its
dissimilarity with the other. PCA based algorithms provide results with low error rates. I n this paper we conclude that
PCA provides good results with different faces even in different illumination conditions.
Keywords : Principal Component Analysis (PCA) , eigenvalues , eigenvectors, eigenfaces, expression
I. Introduction
Face being the most important part of a persons identity , it is very important for the security purpose to recognize the
different expressions on the face of anonymous individuals. Expressions of an individual provides information about his
mental state , emotional state and also the physical condition of that individual. Facial expression can be used in the
security purpose for recognizing the mood of the criminal by reading the expressions from the images[1]. Unlike the
other identification systems such as fingerprint verification, it can be used without the consent of the individual.

Facial Expression Recognition system includes two steps (a) firstly it recognizes the face of an individual (b) and then
the feature selection for recognition of facial expression[2].

Principal Component Analysis (PCA) reduces the data in such a way that most of the variation in the data set remains
intact. This reduction is accomplished by identifying the principal components of the data set , which are the main
directions of the variation of the data set[3]. Thus the whole data set can be represented by the few components instead of
the thousands of variables.

II. Related Work

II.1 Previous Approaches to Facial Expression Recognition
Various algorithms like linear discriminant analysis and gabor wavelet filter has been used . Unlike Principal component
analysis , Linear discriminant analysis (LDA) two or more classes of objects or events, which do not produce results with
as much precision and accuracy as with PCA, so as to improve on this method we introduce Euclidean Distance
Classifier technique.

II.2 Approach Taken for Facial Expression Recognition
Consider a image of size N x N which can also be converted into one dimension of size N
2
. In which the length of the
each dimension vector is N
2
[7]. Let us consider that there are Y images of N x N size which can be represented as X
1
,
X
2
,........X
n
, then the mean of the data set is
y =

Then the mean image is subtracted from the each image of the set, so as to equalize the data
K
i
= X
i
-n
Then a matrix is formed by concatinating all mean images.
F=[K
1
,K
2
,......K
n
]
A covariance matrix is formed U= FF
T
having dimensions N
2
x N
2
, which then produces eigenvectors and eigenvalues.
The eigen vectors are :
FF
T
J
i
=
i
J
i

Which then also be written as
F
T
FFJ
i
= F(
i
J
i
)
F
T
F(FJ
i
)=
i
(FJ
i
)
2

FJ
i
is the eigen vector denoted by U
i
and
i
is the eigen value. U
i
represent the faces which look hazy and are called
eigenfaces[5]. The eigenfaces which have the large eigenvalues account for the most variance of the data set. Each face
image is now projected on this face space using

r
= U
T
(X
r
- n) , r = 1,2,......n
where (X
r
- n) represents the mean centered image . therefore above equation can be used for finding the projection of
each image

II.3 Recognition
During recognition process the test image X is projected onto the face space , which obtain the vector

= U
T
(X

- n)
The Euclidean Distance Classifier is used to calculate the distance between the projected test image and each of the
projected images during the training

= -
r

2
, r = 1,2......n
A threshold is set up to classify the face
=

max
t,r

t
-
r
,j,r=1,2......n

III. Experiments and results

Disgust Neutral Happy




Sad Anger
Fig. 1 Output of Various Facial Expressions
Database
(1) Number of individual : 1
(2) Total number of Training Images : 50
(3) Total number of Testing images : 40
(4) Image Lighting Variation is very little


TABLE I. Recognition Rates of Various Facial Expressions

Facial Expression Recognition Rate using PCA
Happy 62.5
Disgust 75
Neutral 87.5
Sad 87.5
Anger 62.5
3




Fig.2 Bar Graph Showing Recognition Rates of Various Facial Expressions

TABLE II. System Performance Results For Testing 40 images using PCA Method

Target
Recognition
Rate
Happy
[8]
Disgust
[8]
Neutral
[8]
Sad
[8]
Anger
[8]
Average
Happy 5 2 0 0 2
Disgust 3 6 0 1 0
Neutral 0 0 7 0 0
Sad 0 0 1 7 1
Anger 0 0 0 0 5
Recognition
Rate
62.5 75 87.5 87.5 62.5 75

IV. Conclusion
In this paper facial expression recognition system has been implemented . the experiments shows the recognition rate of
75 % has been obtained using Principal Component Analysis

V. Refrences
[1]Bartlett, M. S., Donato, G., Ekman, P., Hager, J. C., Sejnowski, T.J., 1999,"Classifying Facial Actions", IEEE Trans.
Pattern Analysis and Machine Intelligence, Vol. 21, No. 10, pp. 974-989.
[2] Yang, J., Zhang, D., 2004, Two-dimensional pca: a new approach to appearance-based face representation and
recognition, IEEE Trans. Pattern Anal. Mach. Intell.Vol.26, No.1, pp. 131137.
[3] Yi, J., R. Qiuqi et al. (2008),Gabor-based Orthogonal Locality Sensitive Discriminant Analysis for face
recognition, Signal Processing, 2008. ICSP 2008. 9th International Conference on.
[4] Menaka Rajapakse, Jeffrey Tan, Jagath Rajapakse,Color Channel Encoding With NMF for Face Recognition,
International Conference on Image Processing; Proceedings; ICIP, pp 2007-2010 (October 2004).
[5] Cohn, J.F., Kanade, T., Lien, J.J., 1998,"Automated Facial Expression Recognition Based on FACS Action Units",
Proc. Third EEE Int. Conf. Automatic Face and Gesture Recognition, pp. 390-395.
[6] M. Turk, A. and Pentland, "Eigen faces for face recognition ", Journal cognitive neuroscience, Vol. 3, No.1, 1991.
[7] Ching-Chih, T., C. You-Zhu et al. (2009),"Interactive emotion recognition using Support Vector Machine for human-
robot interaction. Systems, Man and Cybernetics, 2009. SMC 2009. IEEE International Conference on.M. Turk, A. and
Pentland, "Eigen faces for face recognition ", Journal cognitive neuroscience, Vol. 3, No.1, 1991.
[8] Pantic, M. and Rothkrantz, L., 2000, Automatic analysis of facial expressions: The state of the art, IEEE
Transactions on Pattern Analysis and Machine Intelligence, Vol. 22, No. 12, pp.14241445.
[9] Jain, A.K., Duin R.P.W., Mao J., 2000,"Statistical Pattern Recognition: A Review", IEEE Trans. Pattern Analysis and
Machine Intelligence, Vol. 22, No. 1, pp. 4-37.
[10] Pantic, M. and Rothkrantz, L., 2000, Automatic analysis of facial expressions: The state of the art, IEEE
Transactions on Pattern Analysis and Machine Intelligence, Vol. 22, No. 12, pp.14241445.




0
20
40
60
80
100
Recognition Rate using
PCA
Recognition
Rate using PCA
4