COMSATS UNIVERSITY ISLAMABAD

DEPARTMENT OF COMPUTER SCIENCE

Emotion Detection System

By

Muhammad Azhar CIIT/FA20-BCS-050/VHR

Muhammad Fahad Imtiaz CIIT/ FA20-BCS-053/VHR

Supervisor
Tahir Rasheed

Bachelor of Science in Computer Science (2020-2024)

UNDERGRADUATE FINAL YEAR PROJECT HANDBOOK - FALL 2018 1

 COMSATS University Islamabad, Pakistan

Emotion Detection System

By

Muhammad Azhar CIIT/FA20-BCS-050/VHR

Muhammad Fahad Imtiaz CIIT/ FA20-BCS-053/VHR

Supervisor
Tahir Rasheed

Bachelor of Science in Computer Science (2020-2024)

The candidate confirms that the work submitted is their own and appropriate credit has been
given where reference has been made to the work of others.
 COMSATS University, Islamabad Pakistan

Emotion Detection System

A project presented to
COMSATS Institute of Information Technology, Islamabad

In partial fulfillment of the

requirement for the degree of

Bachelor of Science in Computer Science (2020-2024)

By

Muhammad Azhar CIIT/FA20-BCS-050/VHR

Muhammad Fahad Imtiaz CIIT/ FA20-BCS-053/VHR

 DECLARATION
We hereby declare that this software, neither whole nor as a part has been copied out from any
source. It is further declared that we have developed this software and accompanied report entirely
on the basis of our personal efforts. If any part of this project is proved to be copied out from any
source or found to be reproduction of some other. We will stand by the consequences. No Portion
of the work presented has been submitted of any application for any other degree or qualification
of this or any other university or institute of learning.

M Azhar M Fahad Imtiaz

 CERTIFICATE OF APPROVAL
It is to certify that the final year project of BS (CS) “Emotion Detection System” was
developed by Muhammad Azhar (CIIT/FA20-
BCS-050) and Muhammad Fahad Imtiaz
(CIIT/FA20-BCS-053) under the supervision of “Sir Tahir Rasheed” and that in his opinion;
it is fully adequate, in scope and quality for the degree of Bachelors of Science in Computer
Sciences.
.

Supervisor

External Examiner

Head of Department
(Department of Computer Science)
 Executive Summary
Emoodify is a web-based platform designed to enhance users' emotional well-being by leveraging
cutting-edge emotion detection and personalized content recommendations. This innovative system
integrates advanced Deep Learning CNN algorithms to analyze users' emotions from images, offering
tailored content such as entertainment, inspiration, and self-care tips that align with users' current
emotional states.
Traditional emotion detection applications typically focus on surface-level analysis, but Emoodify stands
out by providing a holistic user experience that combines real-time emotion detection with curated
content recommendations. Users can interact with the platform through a user-friendly interface that
allows seamless navigation, real-time emotion feedback, and customization options for content
preferences.
Emoodify's unique approach includes not only providing uplifting and entertaining content but also
fostering a sense of happiness and positivity in users' lives. The platform's continuous improvement is
driven by user feedback and advancements in emotional well-being research.
In addition to offering a wide range of content, Emoodify's impact extends across multiple domains
such as mental health improvement, the entertainment industry, educational tools, and corporate well-
being programs. The platform ensures user privacy and data security through encryption and adherence
to data protection regulations.
Emoodify's comprehensive architecture includes an Emotion Detection Module, Content
Recommendation through APIs, and a User Interaction Interface. The system operates in a web based
environment compatible with major operating systems and browsers, supporting devices with cameras
such as PCs, laptops, smartphones, and tablets.
 Acknowledgement
All praise is to Almighty Allah who bestowed upon us a minute portion of His boundless knowledge by
virtue of which we were able to accomplish this challenging task.

We are greatly indebted to our project supervisor “Sir Tahir Rasheed”. Without their personal
supervision, advice and valuable guidance, completion of this project would have been doubtful. We
are deeply indebted to them for their encouragement and continual help during this work.

And we are also thankful to our parents and family who have been a constant source of encouragement
for us and brought us the values of honesty & hard work

M Azhar M Fahad Imtiaz

 Abbreviations

SRS Software Require Specification

PC Personal Computer
Table of Contents
1 INTRODUCTION...............................................................................................................................11
1.1 System Introduction.....................................................................................................................11
1.2 Background of the System...........................................................................................................11
1.3 Objectives of the System.............................................................................................................12
1.4 Significance of the System...........................................................................................................12
2 REQUIREMENT SPECIFICATIONS................................................................................................13
2.1 Product Scope..............................................................................................................................13
2.2 Product Description...................................................................................................................13
2.2.1 Product Perspective...........................................................................................................13
2.2.2 Product Functionality.........................................................................................................14
2.2.3 Users and Characteristics...................................................................................................14
2.2.4 Administrators:..................................................................................................................15
2.2.5 Operating Environment.....................................................................................................15
2.3 Specific Requirements.................................................................................................................16
2.3.1 Functional Requirements...................................................................................................16
2.3.2 Behavioral Requirements...................................................................................................16
2.3.3 Check Emotions:................................................................................................................17
2.3.4 Content Review:.................................................................................................................17
2.3.5 Improvements:...................................................................................................................17
2.3.6 External Interface Requirements.......................................................................................18
2.3.7 Hardware Interfaces..........................................................................................................21
2.3.8 Software Interfaces............................................................................................................21
2.3.9 Communication Interfaces.................................................................................................22
2.4 Non-functional Requirements......................................................................................................22
2.4.1 Performance Requirements...............................................................................................22
2.4.2 Safety and Security Requirements.....................................................................................22
2.4.3 Software Quality Attributes...............................................................................................23
3 DESIGN SPECIFICATIONS..............................................................................................................24
3.1 Introduction..................................................................................................................................24
3.2 Composite Viewpoint..................................................................................................................24
3.3 Logical Viewpoint.......................................................................................................................25
3.4 Information Viewpoint.................................................................................................................25
3.5 Interaction Viewpoint..................................................................................................................26
3.6 State Dynamics Viewpoint..........................................................................................................27
4 DEVELOPMENT AND TOOLS........................................................................................................28
4.1 Introduction..................................................................................................................................28
4.2 Development Plan........................................................................................................................28
4.3 Development Tools......................................................................................................................29
4.4 Conclusion and Future Work/Extensions....................................................................................29
5 QUALITY ASSURANCE...................................................................................................................30
5.1 Introduction..................................................................................................................................30
5.2 Traceability Matrix......................................................................................................................30
5.3 Test Plan......................................................................................................................................31
6 USER MANUAL.................................................................................................................................32
6.1 Introduction..................................................................................................................................32
6.2 Hardware/Software Requirements for the System.......................................................................32
6.3 Installation guide for Application................................................................................................32
6.4 Operating Manual........................................................................................................................32
1 INTRODUCTION
This chapter introduces Emoodify, a web-based platform with interchangeable features,
personalized content recommendations and emotion detection to improve user emotional
well- being. We give an overview of the system's history and emphasize its distinctive
method of fusing personalized content recommendations with emotion recognition. The
goals of Emoodify are listed with a focus on delivering a pleasant user experience,
encouraging joy and optimism and making constant improvements in response to user input
and technology developments. In conclusion, we go over the importance of Emoodify and
demonstrate how it can affect a range of industries, including education, entertainment,
mental health and corporate wellness initiatives.

1.1 System Introduction

The "Emoodify" software is an all-inclusive web-based platform that combines interactive

elements, emotion detection and personalized content recommendation based on user
emotions to improve emotional well-being. To identify user emotions from images.
Emoodify uses state-of-the-art technology CNN algorithm for deep learning with content
recommendations that are personalized according to the user emotional state, the software's
main goal is to provide a joyful and good user experience. The goal of Emoodify is to
make people happy in addition to offering them inspirational and amazing stuff.

1.2 Background of the System

Software varies widely in the field of emotion aware applications basic emotion
detection tools to more complex platforms with sentiment analysis are available.
Emoodify offers a special combination of personalized content recommendations and
real-time engagement by fusing emotion detection with user emotion. The user
experience with Emoodify is more comprehensive and captivating than with
conventional emotion detection apps since it goes beyond superficial analysis. Emoodify
distinguishes itself from other systems with the incorporation of interactive features,
personalized content recommendations and a focus on user emotions.
1.3 Objectives of the System

 Emoodify is a web platform which aims to improve user emotional wellbeing.

 By using the Deep Learning CNN technique to integrate sophisticated emotion
recognition technologies and analyses user feelings from photographs.
 To create a happy and upbeat user experience, offer personalized content
recommendations depending on the emotional states of the user.
 Provide a wide variety of content that satisfies user emotional needs such as music,
motivational videos andbooks.
 Use interactive elements to draw users in and promote proactive involvement in
emotional wellness practices.
 Encourage users to feel joyful and optimistic by providing them with dynamic
experiences and well-chosen information.
 Emoodify is updated and enhanced on a regular basis in response to user feedback and
developments in emotion recognition technology.
 Assure data security and user privacy in compliance with legal requirements and best
practices.

1.4 Significance of the System

Emoodify is significant because of its capacity to affect user mental health and the
variety of application domains it can serve such as:

 Enhancement of Mental Health: Emoodify can have a beneficial effect by

encouraging mental and emotional wellness.
 Entertainment Industry: Emoodify integration can provide a distinctive and
captivating user experience on entertainment platforms.
 Educational resources: To foster a supportive and encouraging learning environment
Emoodify can be integrated into educational resources.
 Corporate Well-Being Programs: Businesses can utilize Emoodify to promote a
good work environment among employees as part of their well-being initiatives.
2 REQUIREMENT SPECIFICATIONS
The focus of this part is on user interaction, content recommendation, emotion
recognition and special requirements of the Emoodify. It explains the viewpoint, features,
user attributes, operating system and particular behavioral and functional needs of the
product. The software analyses facial expressions make personalized content
recommendations and encourages user interaction in an effort to improve user emotional
well-being.

It also offers use case scenarios that describe tasks including managing profiles,
registering users, assessing emotions, reviewing content and making system
enhancements for both ordinary users and administrators. A system-level use case graphic
that shows how users, administrators and other system operations interact with one
another wraps up the chapter.

2.1 Product Scope

Emoodify is made to offer a full platform for user interaction, content recommendation
and emotion detection. Its main goals are to read facial expressions, recognize emotions
with accuracy, provide tailored content based on user choices, detected emotions and
encourage user interaction with feedback systems. The software functionality includes
user interaction, content recommendation, emotion analysis and system management. It
also ensures smooth navigation, user-friendly interfaces and standard security measures.
Emoodify stays focused on its intended features of user experience, content
recommendation, user interaction or system management.

2.2 Product Description

2.2.1 Product Perspective

Emoodify is a standalone web-based product designed to operate as an independent

system focused on enhancing user emotional wellbeing. It is not a replacement for
existing systems but introduce a combining emotion detection and content
recommendation on the basis of user emotions. The product architecture includes
major components such as the Emotion Detection Module, Content Recommendation
through
 API's and User Interaction Interface. The diagram below illustrates the high-level
interactions between these components:

Figure 1 Product Perspective

2.2.2 Product Functionality

 Emoodify utilize Deep Learning CNN algorithm to accurately detect and

analyses user emotions from images uploaded by the user.
 Personalized content recommendation is based on the detected emotional states,
recommend tailored content to users that aligns with their current emotional
needs and preferences.
 Diverse Content recommendation gives a wide range of content including
entertainment, inspiration, self-care tips, motivational quotes, uplifting stories
and other emotionally enriching material.
 Positive User Experience design the platform to priorities user experience,
ensuring ease of navigation, visually appealing interface and seamless
interaction with content and features.
 Regular Improvement can improve Emoodify based on user feedback,
technological advancements and emerging trends in emotional wellbeing
research.

2.2.3 Users and Characteristics

Regular Users:
Characteristics:
 Moderate to high frequency of use.
 Varied technical expertise.
 Access to basic functionalities.
Requirements:
 Seamless navigation.
 User-friendly interface.
 Standard security measures.

2.2.4 Administrators:

Characteristics:
 Moderate frequency of use.
 High technical expertise.
 Full access to all functionalities.
Requirements:
 Advanced user controls.
 Enhanced security features.
 Comprehensive reporting tools.
Distinguishing Important Users:
The user probably makes up the majority of the user base but the administrators are essential
for efficiently overseeing the system and guaranteeing its safety and seamless functioning.
However, a smooth and user friendly experience is necessary for the average user. Other
advanced security features; controls are essential for administrators to carry out their duties.
Both users and administrators are crucial but administrators may need extra care to ensure
that their unique needs are met in order to preserve Emoodify's integrity and functionality.

2.2.5 Operating Environment

 Emoodify is designed to operate as a web-based environment with the following

requirements:
 Hardware Platform: Works with a device with a camera like PC, laptop,
smartphone, tablet etc.
 Operating System: Works with Windows, machos, Linux, Android, and iOS,
among other popular operating systems.
  Software Components: It requires a modern web browser like chrome, Firefox
etc. for the user interface.
 External APIs: The Integration with external APIs for supplementary services and
data enrichment.

2.3 Specific Requirements

2.3.1 Functional Requirements

Emotion Detection Module

 Image will be fetched to system and emotion of user will be analyzed.

 It will use CNN algorithm to recognize the user feel such as smiles and other
expressions.
 The Emotion Detection Module will classify the emotions in different levels
e.g. Happy, Sad, Angry etc.
 It gives a score of high-confidence in detecting an emotion for every detected
emotion.
User Interaction Interface
 The User Interaction Interface will be as simple to use as a dashboard.
 The app provides instant emotion feedback.
 Interface for the user that suggests content and takes his/her feedback on the
suggested content.
Content Recommendations
 The system recommends different types of content (videos, quotes, etc.) based
on that detected emotion.

2.3.2 Behavioral Requirements

Actors:
 User: Performs actions in the system via the User Interaction Interface.
 Admin: These are the users who actually made improvements and checked
ratings.
Actor: User
 Description: Through the user interaction interface user can manage his profile.
This consists of up to date info, desire modifications and viewing past
activities.

2.3.3 Check Emotions:

Actor: User

 Description: Users can check their emotions by taking a picture of them or by

simply using the camera of their devices via User Interaction Interface. This
image is sent to the Emotion Detection Module, which processes and provides
emotion detection feedback.

2.3.4 Content Review:

Actor: User
 Description: A clear explanation of how users can review suggested content
through the User Interaction Interface.
 The content they engage can be rated, commented or provided feedback.

2.3.5 Improvements:

Actor: Admin
 Description: Provides system analytics and user feedback to admins so they can
see where changes need to be made. These teams can implement changes to
improve the performance of the system, algorithmic recommendations, or user
experience.
2.3.6 External Interface Requirements

User Interface
Default:

Figure 3 User Interface Default Page

 Button: Try Emoodify.

 Function: It will take the user to the home page where user can check emotion.
 Button: Learn About us.
 Function: It will take the user to the About page.
Home:

Figure 4 User Interface Home Page

 Button: Result
 Function: It will take the user to the result page where user can check result.
 Button: About
 Function: It will take the user to the About page.
 Button: Click here to open camera
 Function: It opens a pop window for user to click his/her image to check
emotion.
 Button: Click here to upload image
 Function: It opens a pop window for user to Upload his/her image to check
emotion.
Results:
  Function: It will take the user to the result page where user can check result
and watch videos, read books and hear music.
About:

Figure 6 User Interface About Page

2.3.7 Hardware Interfaces

 Camera Interface: This allows the system to connect with the camera of the
device for live feeds.
 Device Compatibility: Compatible with any device that opens a browser and
has a camera.

2.3.8 Software Interfaces

 System Support: Compatible with Windows, machos, Linux, Android & iOS
amongst other mainstream OS.
 Web Browser: Modern UIs need a modern web browser
 APIs connects to external APIs for additional services and data enrichment.
2.3.9 Communication Interfaces

 Data Transfer: Uses HTTP/HTTPS standard protocol to transfer data.

 Security: Encryption in communication (HTTPS)

2.4 Non-functional Requirements

2.4.1 Performance Requirements

Real-time Emotion Detection

 The Emotion Detection Module shall be able to process live camera feeds and
output feedback for emotions detected within a time span of 1 second.
 15 fps (Live camera feed and processing).
Content Recommendation
 The Content Recommendation APIS shall Recommend to Books, Videos,
songs within 2 Secs of getting and sending the emotion data

2.4.2 Safety and Security Requirements

User Data Protection

 The system must work with data protection laws which mean the privacy of the
user must be protected.
 User-generated content and personal data should be encrypted when you are
transmitting it.
System Access Control
 Access to the administrative functions of the system will require that users be
authenticated.
 Role-based access control to bound the unauthorized access of some sensitive
functionalities.
Content Filtering
 It uses a type of content filter to prevent recommending any inappropriate or
supposedly offensive content.
 The users will be able to report or block certain content.
System Monitoring
 The system must provide logging and auditing of the activity of a user, system
errors, and security-related events.
 Regularly reviewing security logs to identify and remediate possible security
issues.

2.4.3 Software Quality Attributes

Reliability
 In the case of continuous availability, a system is provided at least 99.9% uptime.
 Since the recovery time in the case of system failure must be less than 30 minutes.
Maintainability
 Codebase will conform to our coding standards and the system will be well
documented for future development teams to maintain it.
 Patches and updates should be live with minimum downtime.
Usability
 The User Interaction Interface include controls and features that are laid out in
a user-friendly way, structured according to a series of usability norms.
 Collection of user feedback and interface improvements, which will be updated
monthly.
Scalability
 The system must be architecturally designed to horizontally scale and handle
increased users.
 It is recommended to perform performance testing regularly to make the system
working well with different number of users.
Flexibility
 The system will be such that allow future integration of more functionalities or
third- party services.
 The changes to the content generation algorithms will adapt easily along with
some emotion detection techniques.
3 DESIGN SPECIFICATIONS
In design specification, it provides details about the design of Emoodify such as architectural
design, user interface design, database design, and other aspects of the design that are
important in the development of the platform. This chapter outlines the architecture of
Emoodify and how users would be able to navigate with the application.

3.1 Introduction

This chapter provides an understanding of the design specifications of Emoodify and the
factors like composite view point, Logical View point and Informational View point, etc. It
gives a clear indication on how the system will look like and how the users will be able to use
it during the development phase of the project.

3.2 Composite Viewpoint

Figure 2 Composite viewpoint

3.3 Logical Viewpoint

Figure 3Logical Viewpoint

3.4 Information
Viewpoint

Figure 4 Informational viewpoint

3.5 Interaction Viewpoint

Figure 5 Interction View point

3.6 State Dynamics Viewpoint

Figure 6 State Dynamic View point

4 DEVELOPMENT AND TOOLS
In this section, we explain how Emoodify was created and what tools were used in the
process. It provides knowledge on the programming languages, frameworks, libraries, and
development methodologies that has made the platform a reality. Furthermore, it also
describes the setup process of the development environment. This chapter explains a step-by-
step guide of how the technical application of creating Emoodify occurred and how it was
operational.

4.1 Introduction

In this chapter, an emphasis is placed on the tools that were employed in the creation of the
application called Emoodify. It illustrates languages, frameworks, version control systems,
ide used in the front end and back end development of the software. It may also refer to any
other additional tools used during testing or for testing purposes or even for deployment.

4.2 Development Plan

Development Team:
 M Azhar
 M Fahad Imtiaz
Development Plan:

Task Fahad's Responsibility Azhar’s Responsibility

Frontend Development Yes Yes
(HTML/CSS)

Backend Development Yes Yes

(JavaScript)
Backend Framework (Flask) Yes Yes

Python model Training No Yes

User Implementation Yes NO

Content Recommendation Yes Yes

 Testing and Debugging Yes Yes

Deployment and Server No Yes

Management

4.3 Development Tools

 HTML/CSS for frontend development

 JavaScript for backend development
 Flask for backend framework
 Python for model training
 Visual Studio Code (IDE) for code editing and development

4.4 Conclusion and Future Work/Extensions

In conclusion, the creation of Emoodify is considered as a significant contribution to

identifying an application with focus on enhancing mood of users by utilizing stylized
notification for primary emotion detection enhanced by subsequent content recommendation.
Social integration: The given option allows individual to share his/her emotional occurrences
and it will allow participating in spectator emotional process as well.
Advanced emotion analysis: Increasing the range of recipes for determining the absence or
presence of any emotions, as well as providing a more accurate search for content.
5 QUALITY ASSURANCE
In this chapter, the concerns on the quality assurance activities performed during the
development of Emoodify are discussed. They describe the approach adopted, the procedures
and techniques used to maintain the dependability, functionality, integrity and efficiency of
the platform. Also it might describe the testing methodologies, approaches and tools applied
to ensure the correctness of Emoodify’s operations and its usability.

5.1 Introduction

This section presents the quality assurance initiatives carried out on Emoodify which relates
to the testing approaches and techniques. It defines several testing approaches to ensure
validity and reliability including performance testing, security testing, usability testing and
functional testing. In Quality assurance includes the discussion of the need the process of
constructing test plans, test cases and the requirement traceability matrices. In general, all
these actions are intended to provide users with an uninterrupted positive experience and
achieve the goals set by Emoodify.

5.2 Traceability Matrix

Requirement ID Test Case IDs

TC_2 TC_3 TC_4

TC_1
R_1 X X X

R_2 X X
5.3 Test Plan
6 USER MANUAL
In this chapter, we proved a comprehensive user manual for Emoodify, guiding users through
the installation, operation, and usage of the web application. It includes information on
hardware and software requirements, installation procedures, and an operating manual to
navigate the platform effectively.

6.1 Introduction

We provide a comprehensive user manual for Emoodify, guiding users through the
installation, operation, and usage of the web application. It includes information on hardware
and software requirements, installation procedures, and an operating manual to navigate the
platform effectively.

6.2 Hardware/Software Requirements for the System

 Compatible web browser (Chrome, Firefox, Safari, Edge)

 Internet connection

6.3 Installation guide for Application

 Access Emoodify website

 Check your Emotions

6.4 Operating Manual

 Access Emoodify website

 Navigating the home page
 Uploading images for emotion detection
 Viewing recommended content based on emotions
 Providing feedback on recommended content