Scribd
Upload
212 views

Emotion Recognition Using Facial Expressions

This document discusses emotion recognition using facial expressions. It introduces emotion recognition and its importance in human-machine interactions. The document covers the basics of emotion recognition including the history, common items used like cameras and software, how it works by extracting geometric and appearance features, and common classifiers like KNN and MLP. It discusses the advantages of lower complexity, disadvantages like head movements, and applications in predictive environments, health care, education, and more. The conclusion states challenges remain around movements and the future scope includes handling occlusions better and applying it to more applications.

Uploaded by

Jismy Jelson
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
212 views

Emotion Recognition Using Facial Expressions

This document discusses emotion recognition using facial expressions. It introduces emotion recognition and its importance in human-machine interactions. The document covers the basics of emotion recognition including the history, common items used like cameras and software, how it works by extracting geometric and appearance features, and common classifiers like KNN and MLP. It discusses the advantages of lower complexity, disadvantages like head movements, and applications in predictive environments, health care, education, and more. The conclusion states challenges remain around movements and the future scope includes handling occlusions better and applying it to more applications.

Uploaded by

Jismy Jelson
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 28

EMOTION RECOGNITION

USING FACIAL EXPRESSIONS

Guided by, Presented by,


Remya Krishna J.S Jismy Jelson
Asst.Professor LTJE16EC028
Dept. of ECE S7 ECE
1
CONTENTS
 Introduction
 Emotions

 Working

 Classifiers

 Advantages

 Disadvantages

 Applications

 Future Scope

 Conclusion

 References 2
INTRODUCTION

 Emotion recognition is the process of


identifying human emotion, most typically
from facial expressions as well as from verbal
expressions
 extracting and understanding of emotion has a
high importance of the interaction between
human and machine communication.

3
WHAT IS EMOTION

4
HISTORY
 Tomkins 1964 Started

 In 1978 Paul Ekman introduced a system Facial


Action Coding System(FACT).

 Based on Paul Ekman's 6 Basic


Emotions.

5
USED ITEMS

 CAMERA

 MICROSOFT KINECT 3D SOFTWARE

 CLASSIFIER

6
WORKING

7
FEATURE EXTRACTION

 Appearance Features

 Geometric Features

8
GEOMETRIC FEATURE EXTRACTION

 A three-state lip model describes the lip state: open, closed,


tightly closed. A two-state model (open or closed) is used for
each of the eyes. Each brow and cheek has a one-state
model.

9
APPEARANCE FEATURE EXTRACTION

Gabor wavelets are widely used to extract the facial


appearance changes as a set of multi scale and multi
orientation coefficients. The Gabor filter may be applied to
specific locations on a face or to the whole face image.

10
ACTION UNITS

 AUs are considered to be the smallest visually


discernible facial movements.
 As AUs are independent of any interpretation,
they can be used as the basis for recognition of
basic emotions.
 However, both timing and the duration of
various AUs are important for the interpretation
of human facial behavior.
 It is an unambiguous means of describing all
possible movements of face in 46 action points .
11
appearance features. Geometric features

12
13
14
15
CLASSIFIERS

K-NN CLASSIFIER MLP CLASSIFIER

 K Nearest Neighbors  Multilayer Perception


 Simple algorithm  Include 3 layers
 Nonlinear classifier  Class of artificial neural
network
 96% accuracy
 90% accuracy

16
KNN CLASSIFIER

17
KNN classifier cont.…..

18
KNN classifier cont.…..

ADVANTAGES DISADVANTAGES

 Very simple  Choosing k is tricky


 Easy to understand  Expensive

 Effective  No training stage

 Sensitive to noise

19
ADVANTAGES

 Lower complexity

 Less computer demanding

 Sensitive

 Real time monitoring

 More secured

20
DISADVANTAGES
 Pose and Frequent head movements
 Presence of structural components

 Occlusion

 Image orientation

 Imaging conditions

 Subtle facial deformation

 Ambiguity and uncertainty in face motion


measurement

21
APPLICATIONS
 Predictive environments (Ambient Intelligence).
 More human-like human-computer, and human
robot
 interaction (e.g: emotional avatar).

 Emotional Mirror (Affective Computing).

 Treatment for people with psycho-affective

 illnesses (e.g: autism).

 Distance learning

 Robotics

22
 Emotion recognition in Health Care
 Automotive industry and emotion recognition

 Emotion recognition in video game testing

 Educational

23
24
SELF DRIVING
FUTURE SCOPE
 Handle partial occlusions better.
 Make it more robust (lighting conditions etc.)

 More person independent (fit mask


automatically).
 Use other classifiers (dynamics).

 Apply emotion recognition in applications. For


example games

25
CONCLUSION
 Facial emotion recognition has more challengs.by
using K-NN classifier we can reduce some of this.

 Developing technology’s using.

 Movements of head will effect the emotion


recognition.

26
REFERENCES
 International Conference on Computational
Science, ICCS 2017, 12-14 June 2017, Zurich,
Switzerland.
 P. Ekman. Emotions Revealed: Recognizing
Faces and Feeling to Improve Communication
and Emotional Life. Holt, 2003.
 Ratliff M. S., Patterson E., Emotion recognition
using facial expressions with active appearance
models, Proceedings of the Third IASTED
International Conference on Human Computer
Interaction, ACTA Press, Anaheim, CA, USA,
2008, 138–143.
 Etc………….. 27
28

You might also like