SlideShare a Scribd company logo
IJRET: International Journal of Research in Engineering and Technology eISSN: 2319-1163 | pISSN: 2321-7308
__________________________________________________________________________________________
Volume: 03 Issue: 05 | May-2014, Available @ http://www.ijret.org 182
IMPLEMENTATION OF VIDEO TAGGING: IDENTIFYING
CHARACTERS IN VIDEO
Akshay Bhardwaj1
, Ramani S2
, Mayank Goyal3
1
Student, School of Computing Science and Engineering, Vellore Institute of Technology, Vellore, India
2
Assistant Professor, School of Computing Science and Engineering, Vellore Institute of Technology, Vellore, India
3
Student, School of Computing Science and Engineering, Vellore Institute of Technology, Vellore, India
Abstract
Automatic face detection in movies has been an interesting area of research. Due to the various appearances of the characters in the
moving film it is not easy to identify the true faces. There has been a significant growth in the field of image processing to detect still
human faces with high accuracy and results. This idea can be further used to implement video tagging. We see biometric security
check points that compare still images to verify a person in the database and the same can be done if a person is in the motion. This
paper proposes a method to identify characters appearing in the moving film.
Keywords—Video Tagging, Image processing, Eigen objects, Security, Template matching
----------------------------------------------------------------------***----------------------------------------------------------------------
1. INTRODUCTION
The growing video and TV content on the internet comes with
huge amount of digital video data just like still images. This
resulted in studying and developing efficient techniques for
understanding the video content. The concept of automatic video
analysis is one of the technologies which is studied and
implemented here.
Video tagging is a concept similar to image tagging with a
difference being that the faces are in the motion in the former.
The key concept is to store the image from a running video and
storing it after training under constraint like size of image, gray
scale and bytes. Photo tagging has been implemented in various
social media such as Facebook and Instagram where you can tag
a person once and the next time you upload a photo of the same
character his name will appear automatically.
The objective is to identify the human faces present in the
running film and label them with their corresponding identity for
example the name of character. Figure1 explains the underlying
idea by pointing the name of faces detected.
Fig.1
2. RELATED WORK
Template matching is a common technique where an object is
captured as an image called template.
The match will fail if the object appears scaled, rotated, or
skewed on the image. Instead, this can be done using Emgu CV
image processing library.It is written entirely in C#. The benefit
is that it can be compiled in mono and therefore is able to run on
any platform Mono supports, including Linux, Mac OS X, win.
It comprises of 2 layers, Layer 1 contains functions,
enumeration, structures and Layer 2 has classes. The figure
below is the architecture overview of the Emgu CV library.
IJRET: International Journal of Research in Engineering and Technology eISSN: 2319-1163 | pISSN: 2321-7308
__________________________________________________________________________________________
Volume: 03 Issue: 05 | May-2014, Available @ http://www.ijret.org 183
3. WORK DONE
The idea in this paper uses the above mentioned Emgu, an image
processing library to achieve the video tagging concept. The
process consists of mainly three following steps:
When the video is played or streamed the faces appearing on the
screen will be detected. Faces will have different orientation, size
and color. Only after the face of a person is detected, the
information of its identity will be entered that can be Name, ID,
Gender etc. of the person. This information will be stored in the
database as a tag which will be called in the future reference. So
when a video is played and the same person whose information is
already stored appears in that video, the system will recognize
him [8] and displays his related information.
4. IMPLEMENTATION OF VIDEO TAGGING
4.1 Detecting the Face
It uses simple rectangular features also called Haarfeature[2],
where each feature is a single valueobtained bysubtracting sum
of pixels under white rectangle from sumof pixels under black
rectangle. If the difference is above threshold, corresponding
feature like eyes, nose etc. are present. Then a special
representation of the sample called the integral image is used
which makes feature extraction faster. A series of AdaBoost[2]
classifiers works as a filter chain. Image sub regions that make it
through the entire cascade are classified as face. All others are
classified as non-face. The classifiers are used efficiently by
assigning heavily weighted filters first on the window, if a
window fails the first stage, discard it and we don’t consider
remaining features on it. If it passes we apply the remaining
featuresand continue the process. Finally once the face is
detected using above filters, we draw a focus around the region
to highlight the face.
4.2 Recognizing the face:
Once the faces are detected they are saved into database as
image templates. All the trained faces are histogram normalized
to convert them into 0-255 gray scale [3] and correspondingly
object recognizer is created for the given faces. Calculation of
Eigen image and correspondingly Eigen values are done after
that.And when the new face is detected, calculation of Eigen
distance value [4] of the projected face with the trained faces
isperformed.If the value of Eigen distance is greater than
threshold for a particular image, and we display the label of the
correspondingtrained face to the projected face.
Fig 2 Video tagging illustrations
IJRET: International Journal of Research in Engineering and Technology eISSN: 2319-1163 | pISSN: 2321-7308
__________________________________________________________________________________________
Volume: 03 Issue: 05 | May-2014, Available @ http://www.ijret.org 184
5. CONCLUSIONS
Video tagging is done on a video with the concept explained in
the paper. Figure 2 shows the process steps taking place, a face
is recognized successfully after matching with the image
template of the person stored for the first time. Now if the same
person appears in that video or any other video, the face will be
automatically recognized by the system with a tag to tell who the
person is. Implemented concept of video tagging in this paper
can have various utilities.
FUTURE WORK
The basic concept will remain the same which is to identify a
character present in the video [5] or live streaming. The
following work can be done in future based on the work done-
Tagging a Video on the Facebook
Photo tagging is a major reason that makes photos special on
Facebook. So video tagging can be introduced too. You can tag a
video to show who’s in the video or tell who you are with. The
tag will be the user name of the person. When a friend is tagged
in the video, he will be notified through an alert. The user needs
to be tagged just once in a video and every time that person
appears in any video uploaded later; he will be recognized
automatically like auto photo tagging.
Biometric Security Checks for Secure Areas
In normal face recognition biometric test a person stands in front
of the detector and matches the traits with the once stored in the
system. In that a person should be still to match the features. So
using this idea there is no need to stop and unlock. The person
can be recognized while in motion and the camera will detect
and recognize if the person appearing on stream is valid in
database or not and permission will be granted if match is found.
REFERENCES
[1]. Jitao Sand and ChangshengXu, “Robust Face-Name Graph
Matching for Movie Character Identification”,
IEEETransactionson multimedia Vol. 14, no3, June 2012
[2]. P. Viola and M Jones, “Rapid Object Detection using
boosted cascade of simple features”. Computer Vision and
Pattern Recognition, IEEE CVPR.2001.990517 Vol1.
[3]. Dalal N and Triggs B, “Histograms of oriented gradients for
human detection”.Computer Vision and Pattern Recognition,
IEEE CVPR.2005.177 Vol1.
[4]. A. Sanfeliu and K. Fu, “A distance measure between
attributed relationalgraphs for pattern recognition,” IEEE Trans.
Syst. Man Cybern.vol.13, no. 3, 1983.
[5]. J. Stallkamp, H. K. Ekenel, and R. Stiefelhagen, “Video-
based face recognition on real-world data,” in Proc. Int. Conf.
Comput. Vis. 2007, pp. 1-8
[6]. channel9.msdn.com/Face-Detection-with-Emgu-CV-in-C-
and-WPF.
[7]. M. DharmatejaPurna, N. Praveen “A Novel Method for
Movie Character Identification and its Facial Expression
Recognition”, IJMER Vol.3, Issue.3 2013
[8]. W. Zhao, R. Chelappa, P. J. Phillips, and A. Rosenfeld,
“Face recognition: A literature survey,” ACM Compu. Survey.,
vol. 35, no. 4, pp. 399–458, 2003

More Related Content

What's hot (20)

PDF
IRJET- Navigation and Camera Reading System for Visually Impaired
IRJET Journal
 
PDF
A survey paper on various biometric security system methods
IRJET Journal
 
PDF
Scale Invariant Feature Transform Based Face Recognition from a Single Sample...
ijceronline
 
PDF
Eye(I) Still Know! – An App for the Blind Built using Web and AI
Dr. Amarjeet Singh
 
PDF
Authentication Using Graphical Password
ijceronline
 
PDF
An overview of face liveness detection
ijitjournal
 
PDF
IRJET- Applications of Object Detection System
IRJET Journal
 
PDF
An optimal face recoginition tool
eSAT Publishing House
 
PDF
IRJET - NETRA: Android Application for Visually Challenged People to Dete...
IRJET Journal
 
PDF
Dq4301702706
IJERA Editor
 
PDF
Automatic Attendance Using Face Recognition
rahulmonikasharma
 
PDF
Bimodal Biometric System using Multiple Transformation Features of Fingerprin...
IDES Editor
 
PDF
Reduction of False Acceptance Rate Using Cross Validation for Fingerprint Rec...
IJTET Journal
 
PPTX
A comparative review of various approaches for feature extraction in Face rec...
Vishnupriya T H
 
PDF
The influence of eyes and brain
ijma
 
PDF
Face Recognition & Detection Using Image Processing
paperpublications3
 
PDF
Saksham seminar report
SakshamTurki
 
PPTX
Saksham presentation
SakshamTurki
 
PDF
IRJET- A Smart Personal AI Assistant for Visually Impaired People: A Survey
IRJET Journal
 
IRJET- Navigation and Camera Reading System for Visually Impaired
IRJET Journal
 
A survey paper on various biometric security system methods
IRJET Journal
 
Scale Invariant Feature Transform Based Face Recognition from a Single Sample...
ijceronline
 
Eye(I) Still Know! – An App for the Blind Built using Web and AI
Dr. Amarjeet Singh
 
Authentication Using Graphical Password
ijceronline
 
An overview of face liveness detection
ijitjournal
 
IRJET- Applications of Object Detection System
IRJET Journal
 
An optimal face recoginition tool
eSAT Publishing House
 
IRJET - NETRA: Android Application for Visually Challenged People to Dete...
IRJET Journal
 
Dq4301702706
IJERA Editor
 
Automatic Attendance Using Face Recognition
rahulmonikasharma
 
Bimodal Biometric System using Multiple Transformation Features of Fingerprin...
IDES Editor
 
Reduction of False Acceptance Rate Using Cross Validation for Fingerprint Rec...
IJTET Journal
 
A comparative review of various approaches for feature extraction in Face rec...
Vishnupriya T H
 
The influence of eyes and brain
ijma
 
Face Recognition & Detection Using Image Processing
paperpublications3
 
Saksham seminar report
SakshamTurki
 
Saksham presentation
SakshamTurki
 
IRJET- A Smart Personal AI Assistant for Visually Impaired People: A Survey
IRJET Journal
 

Viewers also liked (20)

PDF
International Journal of Engineering Research and Development (IJERD)
IJERD Editor
 
PDF
Biosorption of hg (ii) from aqueous solutions
eSAT Publishing House
 
PDF
Identification of dynamic rigidity for high speed
eSAT Publishing House
 
PDF
An assessment of cloud computing evolution
eSAT Publishing House
 
PDF
A review on managed aquifer recharge by check dams a case study near chennai,...
eSAT Publishing House
 
PDF
Online stream mining approach for clustering network traffic
eSAT Publishing House
 
PDF
A novel hybrid communication technique involving power line communication and...
eSAT Publishing House
 
PDF
Green vehicle
eSAT Publishing House
 
PDF
Redesign and thermal analysis of transfer mold tool
eSAT Publishing House
 
PDF
Monitoring wind turbine using wi fi network for reliable communication
eSAT Publishing House
 
PDF
Performance comparison of row per slave and rows set
eSAT Publishing House
 
PDF
Testing and ergonomically evaluation of tractor mounted and self mounted coco...
eSAT Publishing House
 
PDF
Fusion method used to tolerate the faults occurred in disrtibuted system
eSAT Publishing House
 
PDF
Production and characterization of nano copper powder using electric explosio...
eSAT Publishing House
 
PDF
An overview of plastic card frauds and solutions for
eSAT Publishing House
 
PDF
Analysis of dual bell rocket nozzle using
eSAT Publishing House
 
PDF
Growth and physical properties of pure and manganese doped strontium tartrate...
eSAT Publishing House
 
PDF
Mathematical model study on solvent extraction of
eSAT Publishing House
 
PDF
A heuristic approach for optimizing travel planning using genetics algorithm
eSAT Publishing House
 
PDF
Channel feedback scheduling for wireless communications
eSAT Publishing House
 
International Journal of Engineering Research and Development (IJERD)
IJERD Editor
 
Biosorption of hg (ii) from aqueous solutions
eSAT Publishing House
 
Identification of dynamic rigidity for high speed
eSAT Publishing House
 
An assessment of cloud computing evolution
eSAT Publishing House
 
A review on managed aquifer recharge by check dams a case study near chennai,...
eSAT Publishing House
 
Online stream mining approach for clustering network traffic
eSAT Publishing House
 
A novel hybrid communication technique involving power line communication and...
eSAT Publishing House
 
Green vehicle
eSAT Publishing House
 
Redesign and thermal analysis of transfer mold tool
eSAT Publishing House
 
Monitoring wind turbine using wi fi network for reliable communication
eSAT Publishing House
 
Performance comparison of row per slave and rows set
eSAT Publishing House
 
Testing and ergonomically evaluation of tractor mounted and self mounted coco...
eSAT Publishing House
 
Fusion method used to tolerate the faults occurred in disrtibuted system
eSAT Publishing House
 
Production and characterization of nano copper powder using electric explosio...
eSAT Publishing House
 
An overview of plastic card frauds and solutions for
eSAT Publishing House
 
Analysis of dual bell rocket nozzle using
eSAT Publishing House
 
Growth and physical properties of pure and manganese doped strontium tartrate...
eSAT Publishing House
 
Mathematical model study on solvent extraction of
eSAT Publishing House
 
A heuristic approach for optimizing travel planning using genetics algorithm
eSAT Publishing House
 
Channel feedback scheduling for wireless communications
eSAT Publishing House
 
Ad

Similar to Implementation of video tagging identifying characters in video (20)

DOCX
Human Face Identification
bhupesh lahare
 
PDF
IRJET - Applications of Image and Video Deduplication: A Survey
IRJET Journal
 
PDF
IRJET- Real-Time Object Detection System using Caffe Model
IRJET Journal
 
PDF
IRJET - Facial Recognition based Attendance Management System
IRJET Journal
 
PDF
SMART MEDIA PLAYER USING AI
IRJET Journal
 
PDF
Criminal Face Identification
IRJET Journal
 
PDF
IRJET - Direct Me-Nevigation for Blind People
IRJET Journal
 
PDF
IRJET - Blind Guidance using Smart Cap
IRJET Journal
 
PDF
Face Annotation using Co-Relation based Matching for Improving Image Mining ...
IRJET Journal
 
PDF
YOLOv4: A Face Mask Detection System
IRJET Journal
 
PDF
Face Recognition System using OpenCV
IRJET Journal
 
PDF
IRJET - Face Detection and Recognition System
IRJET Journal
 
PDF
Covid Mask Detection and Social Distancing Using Raspberry pi
IRJET Journal
 
PDF
Human Segmentation Using Haar-Classifier
IJERA Editor
 
PDF
”YOGA WITH AI”
IRJET Journal
 
PDF
IRJET-Human Face Detection and Identification using Deep Metric Learning
IRJET Journal
 
PDF
IRJET- Object Detection and Recognition for Blind Assistance
IRJET Journal
 
PDF
Text Recognition, Object Detection and Language Translation App
IRJET Journal
 
PDF
Progression in Large Age-Gap Face Verification
IRJET Journal
 
PDF
Face Recognition and Increased Reality System for Mobile Devices
ijtsrd
 
Human Face Identification
bhupesh lahare
 
IRJET - Applications of Image and Video Deduplication: A Survey
IRJET Journal
 
IRJET- Real-Time Object Detection System using Caffe Model
IRJET Journal
 
IRJET - Facial Recognition based Attendance Management System
IRJET Journal
 
SMART MEDIA PLAYER USING AI
IRJET Journal
 
Criminal Face Identification
IRJET Journal
 
IRJET - Direct Me-Nevigation for Blind People
IRJET Journal
 
IRJET - Blind Guidance using Smart Cap
IRJET Journal
 
Face Annotation using Co-Relation based Matching for Improving Image Mining ...
IRJET Journal
 
YOLOv4: A Face Mask Detection System
IRJET Journal
 
Face Recognition System using OpenCV
IRJET Journal
 
IRJET - Face Detection and Recognition System
IRJET Journal
 
Covid Mask Detection and Social Distancing Using Raspberry pi
IRJET Journal
 
Human Segmentation Using Haar-Classifier
IJERA Editor
 
”YOGA WITH AI”
IRJET Journal
 
IRJET-Human Face Detection and Identification using Deep Metric Learning
IRJET Journal
 
IRJET- Object Detection and Recognition for Blind Assistance
IRJET Journal
 
Text Recognition, Object Detection and Language Translation App
IRJET Journal
 
Progression in Large Age-Gap Face Verification
IRJET Journal
 
Face Recognition and Increased Reality System for Mobile Devices
ijtsrd
 
Ad

More from eSAT Publishing House (20)

PDF
Likely impacts of hudhud on the environment of visakhapatnam
eSAT Publishing House
 
PDF
Impact of flood disaster in a drought prone area – case study of alampur vill...
eSAT Publishing House
 
PDF
Hudhud cyclone – a severe disaster in visakhapatnam
eSAT Publishing House
 
PDF
Groundwater investigation using geophysical methods a case study of pydibhim...
eSAT Publishing House
 
PDF
Flood related disasters concerned to urban flooding in bangalore, india
eSAT Publishing House
 
PDF
Enhancing post disaster recovery by optimal infrastructure capacity building
eSAT Publishing House
 
PDF
Effect of lintel and lintel band on the global performance of reinforced conc...
eSAT Publishing House
 
PDF
Wind damage to trees in the gitam university campus at visakhapatnam by cyclo...
eSAT Publishing House
 
PDF
Wind damage to buildings, infrastrucuture and landscape elements along the be...
eSAT Publishing House
 
PDF
Shear strength of rc deep beam panels – a review
eSAT Publishing House
 
PDF
Role of voluntary teams of professional engineers in dissater management – ex...
eSAT Publishing House
 
PDF
Risk analysis and environmental hazard management
eSAT Publishing House
 
PDF
Review study on performance of seismically tested repaired shear walls
eSAT Publishing House
 
PDF
Monitoring and assessment of air quality with reference to dust particles (pm...
eSAT Publishing House
 
PDF
Low cost wireless sensor networks and smartphone applications for disaster ma...
eSAT Publishing House
 
PDF
Coastal zones – seismic vulnerability an analysis from east coast of india
eSAT Publishing House
 
PDF
Can fracture mechanics predict damage due disaster of structures
eSAT Publishing House
 
PDF
Assessment of seismic susceptibility of rc buildings
eSAT Publishing House
 
PDF
A geophysical insight of earthquake occurred on 21 st may 2014 off paradip, b...
eSAT Publishing House
 
PDF
Effect of hudhud cyclone on the development of visakhapatnam as smart and gre...
eSAT Publishing House
 
Likely impacts of hudhud on the environment of visakhapatnam
eSAT Publishing House
 
Impact of flood disaster in a drought prone area – case study of alampur vill...
eSAT Publishing House
 
Hudhud cyclone – a severe disaster in visakhapatnam
eSAT Publishing House
 
Groundwater investigation using geophysical methods a case study of pydibhim...
eSAT Publishing House
 
Flood related disasters concerned to urban flooding in bangalore, india
eSAT Publishing House
 
Enhancing post disaster recovery by optimal infrastructure capacity building
eSAT Publishing House
 
Effect of lintel and lintel band on the global performance of reinforced conc...
eSAT Publishing House
 
Wind damage to trees in the gitam university campus at visakhapatnam by cyclo...
eSAT Publishing House
 
Wind damage to buildings, infrastrucuture and landscape elements along the be...
eSAT Publishing House
 
Shear strength of rc deep beam panels – a review
eSAT Publishing House
 
Role of voluntary teams of professional engineers in dissater management – ex...
eSAT Publishing House
 
Risk analysis and environmental hazard management
eSAT Publishing House
 
Review study on performance of seismically tested repaired shear walls
eSAT Publishing House
 
Monitoring and assessment of air quality with reference to dust particles (pm...
eSAT Publishing House
 
Low cost wireless sensor networks and smartphone applications for disaster ma...
eSAT Publishing House
 
Coastal zones – seismic vulnerability an analysis from east coast of india
eSAT Publishing House
 
Can fracture mechanics predict damage due disaster of structures
eSAT Publishing House
 
Assessment of seismic susceptibility of rc buildings
eSAT Publishing House
 
A geophysical insight of earthquake occurred on 21 st may 2014 off paradip, b...
eSAT Publishing House
 
Effect of hudhud cyclone on the development of visakhapatnam as smart and gre...
eSAT Publishing House
 

Recently uploaded (20)

PPTX
Mechanical Design of shell and tube heat exchangers as per ASME Sec VIII Divi...
shahveer210504
 
PPTX
GitOps_Without_K8s_Training_detailed git repository
DanialHabibi2
 
PPTX
Knowledge Representation : Semantic Networks
Amity University, Patna
 
PDF
AN EMPIRICAL STUDY ON THE USAGE OF SOCIAL MEDIA IN GERMAN B2C-ONLINE STORES
ijait
 
PDF
Halide Perovskites’ Multifunctional Properties: Coordination Engineering, Coo...
TaameBerhe2
 
PDF
Digital water marking system project report
Kamal Acharya
 
PDF
3rd International Conference on Machine Learning and IoT (MLIoT 2025)
ClaraZara1
 
PDF
methodology-driven-mbse-murphy-july-hsv-huntsville6680038572db67488e78ff00003...
henriqueltorres1
 
PDF
Pressure Measurement training for engineers and Technicians
AIESOLUTIONS
 
PDF
Electrical Engineer operation Supervisor
ssaruntatapower143
 
PPT
Footbinding.pptmnmkjkjkknmnnjkkkkkkkkkkkkkk
mamadoundiaye42742
 
PDF
Electrical Machines and Their Protection.pdf
Nabajyoti Banik
 
PDF
SERVERLESS PERSONAL TO-DO LIST APPLICATION
anushaashraf20
 
PPTX
Final Major project a b c d e f g h i j k l m
bharathpsnab
 
PDF
Design Thinking basics for Engineers.pdf
CMR University
 
PPTX
How Industrial Project Management Differs From Construction.pptx
jamespit799
 
PPT
Testing and final inspection of a solar PV system
MuhammadSanni2
 
PDF
Data structures notes for unit 2 in computer science.pdf
sshubhamsingh265
 
PPTX
Water Resources Engineering (CVE 728)--Slide 4.pptx
mohammedado3
 
PPTX
What is Shot Peening | Shot Peening is a Surface Treatment Process
Vibra Finish
 
Mechanical Design of shell and tube heat exchangers as per ASME Sec VIII Divi...
shahveer210504
 
GitOps_Without_K8s_Training_detailed git repository
DanialHabibi2
 
Knowledge Representation : Semantic Networks
Amity University, Patna
 
AN EMPIRICAL STUDY ON THE USAGE OF SOCIAL MEDIA IN GERMAN B2C-ONLINE STORES
ijait
 
Halide Perovskites’ Multifunctional Properties: Coordination Engineering, Coo...
TaameBerhe2
 
Digital water marking system project report
Kamal Acharya
 
3rd International Conference on Machine Learning and IoT (MLIoT 2025)
ClaraZara1
 
methodology-driven-mbse-murphy-july-hsv-huntsville6680038572db67488e78ff00003...
henriqueltorres1
 
Pressure Measurement training for engineers and Technicians
AIESOLUTIONS
 
Electrical Engineer operation Supervisor
ssaruntatapower143
 
Footbinding.pptmnmkjkjkknmnnjkkkkkkkkkkkkkk
mamadoundiaye42742
 
Electrical Machines and Their Protection.pdf
Nabajyoti Banik
 
SERVERLESS PERSONAL TO-DO LIST APPLICATION
anushaashraf20
 
Final Major project a b c d e f g h i j k l m
bharathpsnab
 
Design Thinking basics for Engineers.pdf
CMR University
 
How Industrial Project Management Differs From Construction.pptx
jamespit799
 
Testing and final inspection of a solar PV system
MuhammadSanni2
 
Data structures notes for unit 2 in computer science.pdf
sshubhamsingh265
 
Water Resources Engineering (CVE 728)--Slide 4.pptx
mohammedado3
 
What is Shot Peening | Shot Peening is a Surface Treatment Process
Vibra Finish
 

Implementation of video tagging identifying characters in video

  • 1. IJRET: International Journal of Research in Engineering and Technology eISSN: 2319-1163 | pISSN: 2321-7308 __________________________________________________________________________________________ Volume: 03 Issue: 05 | May-2014, Available @ http://www.ijret.org 182 IMPLEMENTATION OF VIDEO TAGGING: IDENTIFYING CHARACTERS IN VIDEO Akshay Bhardwaj1 , Ramani S2 , Mayank Goyal3 1 Student, School of Computing Science and Engineering, Vellore Institute of Technology, Vellore, India 2 Assistant Professor, School of Computing Science and Engineering, Vellore Institute of Technology, Vellore, India 3 Student, School of Computing Science and Engineering, Vellore Institute of Technology, Vellore, India Abstract Automatic face detection in movies has been an interesting area of research. Due to the various appearances of the characters in the moving film it is not easy to identify the true faces. There has been a significant growth in the field of image processing to detect still human faces with high accuracy and results. This idea can be further used to implement video tagging. We see biometric security check points that compare still images to verify a person in the database and the same can be done if a person is in the motion. This paper proposes a method to identify characters appearing in the moving film. Keywords—Video Tagging, Image processing, Eigen objects, Security, Template matching ----------------------------------------------------------------------***---------------------------------------------------------------------- 1. INTRODUCTION The growing video and TV content on the internet comes with huge amount of digital video data just like still images. This resulted in studying and developing efficient techniques for understanding the video content. The concept of automatic video analysis is one of the technologies which is studied and implemented here. Video tagging is a concept similar to image tagging with a difference being that the faces are in the motion in the former. The key concept is to store the image from a running video and storing it after training under constraint like size of image, gray scale and bytes. Photo tagging has been implemented in various social media such as Facebook and Instagram where you can tag a person once and the next time you upload a photo of the same character his name will appear automatically. The objective is to identify the human faces present in the running film and label them with their corresponding identity for example the name of character. Figure1 explains the underlying idea by pointing the name of faces detected. Fig.1 2. RELATED WORK Template matching is a common technique where an object is captured as an image called template. The match will fail if the object appears scaled, rotated, or skewed on the image. Instead, this can be done using Emgu CV image processing library.It is written entirely in C#. The benefit is that it can be compiled in mono and therefore is able to run on any platform Mono supports, including Linux, Mac OS X, win. It comprises of 2 layers, Layer 1 contains functions, enumeration, structures and Layer 2 has classes. The figure below is the architecture overview of the Emgu CV library.
  • 2. IJRET: International Journal of Research in Engineering and Technology eISSN: 2319-1163 | pISSN: 2321-7308 __________________________________________________________________________________________ Volume: 03 Issue: 05 | May-2014, Available @ http://www.ijret.org 183 3. WORK DONE The idea in this paper uses the above mentioned Emgu, an image processing library to achieve the video tagging concept. The process consists of mainly three following steps: When the video is played or streamed the faces appearing on the screen will be detected. Faces will have different orientation, size and color. Only after the face of a person is detected, the information of its identity will be entered that can be Name, ID, Gender etc. of the person. This information will be stored in the database as a tag which will be called in the future reference. So when a video is played and the same person whose information is already stored appears in that video, the system will recognize him [8] and displays his related information. 4. IMPLEMENTATION OF VIDEO TAGGING 4.1 Detecting the Face It uses simple rectangular features also called Haarfeature[2], where each feature is a single valueobtained bysubtracting sum of pixels under white rectangle from sumof pixels under black rectangle. If the difference is above threshold, corresponding feature like eyes, nose etc. are present. Then a special representation of the sample called the integral image is used which makes feature extraction faster. A series of AdaBoost[2] classifiers works as a filter chain. Image sub regions that make it through the entire cascade are classified as face. All others are classified as non-face. The classifiers are used efficiently by assigning heavily weighted filters first on the window, if a window fails the first stage, discard it and we don’t consider remaining features on it. If it passes we apply the remaining featuresand continue the process. Finally once the face is detected using above filters, we draw a focus around the region to highlight the face. 4.2 Recognizing the face: Once the faces are detected they are saved into database as image templates. All the trained faces are histogram normalized to convert them into 0-255 gray scale [3] and correspondingly object recognizer is created for the given faces. Calculation of Eigen image and correspondingly Eigen values are done after that.And when the new face is detected, calculation of Eigen distance value [4] of the projected face with the trained faces isperformed.If the value of Eigen distance is greater than threshold for a particular image, and we display the label of the correspondingtrained face to the projected face. Fig 2 Video tagging illustrations
  • 3. IJRET: International Journal of Research in Engineering and Technology eISSN: 2319-1163 | pISSN: 2321-7308 __________________________________________________________________________________________ Volume: 03 Issue: 05 | May-2014, Available @ http://www.ijret.org 184 5. CONCLUSIONS Video tagging is done on a video with the concept explained in the paper. Figure 2 shows the process steps taking place, a face is recognized successfully after matching with the image template of the person stored for the first time. Now if the same person appears in that video or any other video, the face will be automatically recognized by the system with a tag to tell who the person is. Implemented concept of video tagging in this paper can have various utilities. FUTURE WORK The basic concept will remain the same which is to identify a character present in the video [5] or live streaming. The following work can be done in future based on the work done- Tagging a Video on the Facebook Photo tagging is a major reason that makes photos special on Facebook. So video tagging can be introduced too. You can tag a video to show who’s in the video or tell who you are with. The tag will be the user name of the person. When a friend is tagged in the video, he will be notified through an alert. The user needs to be tagged just once in a video and every time that person appears in any video uploaded later; he will be recognized automatically like auto photo tagging. Biometric Security Checks for Secure Areas In normal face recognition biometric test a person stands in front of the detector and matches the traits with the once stored in the system. In that a person should be still to match the features. So using this idea there is no need to stop and unlock. The person can be recognized while in motion and the camera will detect and recognize if the person appearing on stream is valid in database or not and permission will be granted if match is found. REFERENCES [1]. Jitao Sand and ChangshengXu, “Robust Face-Name Graph Matching for Movie Character Identification”, IEEETransactionson multimedia Vol. 14, no3, June 2012 [2]. P. Viola and M Jones, “Rapid Object Detection using boosted cascade of simple features”. Computer Vision and Pattern Recognition, IEEE CVPR.2001.990517 Vol1. [3]. Dalal N and Triggs B, “Histograms of oriented gradients for human detection”.Computer Vision and Pattern Recognition, IEEE CVPR.2005.177 Vol1. [4]. A. Sanfeliu and K. Fu, “A distance measure between attributed relationalgraphs for pattern recognition,” IEEE Trans. Syst. Man Cybern.vol.13, no. 3, 1983. [5]. J. Stallkamp, H. K. Ekenel, and R. Stiefelhagen, “Video- based face recognition on real-world data,” in Proc. Int. Conf. Comput. Vis. 2007, pp. 1-8 [6]. channel9.msdn.com/Face-Detection-with-Emgu-CV-in-C- and-WPF. [7]. M. DharmatejaPurna, N. Praveen “A Novel Method for Movie Character Identification and its Facial Expression Recognition”, IJMER Vol.3, Issue.3 2013 [8]. W. Zhao, R. Chelappa, P. J. Phillips, and A. Rosenfeld, “Face recognition: A literature survey,” ACM Compu. Survey., vol. 35, no. 4, pp. 399–458, 2003