SlideShare a Scribd company logo
Abstract
This poster represent very active research topic in human
computer interaction (HCI) as automatic hand gesture recognition
using nvidia GPU. In this work neural network based video gesture
are processed and recognize the finger counts. Due to real time
requirement algorithm need to optimize and computationally
efficient. We implemented the MATLAB code, it perform slow when
neural network processing started. Implementing them in a parallel
programming model such as GPU-CUDA would provide the
necessary gain in processing speed. Algorithmic result validation is
done using standard video data set and recognition rate is
calculated. A performance improvement of 15x speed is achieved
which is faster than Intel quad core processor.
Introduction
The goal of this project is to develop a program
implementing gesture recognition. At any time, a user can exhibit
his hand doing a specific gesture in front of a video camera linked
to a computer.
The program has to collect pictures of this gesture, analyze it
and to identify the sign. In order to lighten the project, it has been
decided that the identification would consist in counting the number
of fingers that are shown by the user in the input picture.
Database And MATLAB Results
CUDA Approach
1. Camera capture video – process frame by frame image
2. Extract features from the image using various segmentation techniques
implemented in MATLAB, CUDA. Output features then written to a text file.
3. Use the matrix obtained in step 2 to train the neural network(on CPU
using MATLAB).
4. Once the network is trained , we test it on GPU.
5. GPU implementation :-
a. Load the test image into GPU global memory
b. Process it as in step 2, output will be matrix of size (262144 x1).
c. Pad the matrix with 0's - output will be a matrix of size (262144 x16) -
Inputs matrix.
d. This is all done on the GPU. Now pass the neural network weights
matrix, to the GPU.
e. Multiply neuralnetwork_weights matrix by Inputs matrix - which
will give a 16 x 16 matrix. Extract the first five values from it. The
index of the value which has maximum value + 1 gives us the count.
NN Training Results
GPU (GeForce GT 525M)
References
[1] Malima, A.; Ozgur,E.; Cetin,M.; [2006] “A Fast Algorithm for Vision-Based
Hand Gesture Recognition for Robot Control”, Signal Processing and
Communications Applications, IEEE
[2] A Neural Network on GPU,
http://www.codeproject.com/KB/graphics/GPUNN.aspx
[3] NVIDIA Corporation, Compute Unified Device Architecture (CUDA),
http://developer.nvidia.com/object/cuda.html.
Enhanced Human Computer Interaction using hand gesture analysis on GPU
Mahesh Khadtare1, Pragati Dharmale2
1 – I2IT, Pune, IN; 2 – SNHU, NH, US;
Flow CPU GPU Speedup
(ms) (ms)
Preprocessing 45 2.12 21.22
Feature Extraction 52 3.54 14.68
Neural Network
Training 192 25.21 7.61
Neural Network
Testing 62 12.23 5.06
Total 351 43 8.16
Preprocessing Feature Extraction Pattern recognition
Pattern recognition
Image from
camera
Output
( No. of
count )
Training File
Preprocessing Feature Extraction
Image from
camera
(a) Training Phase
(b) Testing Phase
No of epochs MSE
Time in
seconds
2000 1.64272e-006 12.62
5000 1.58837e-006 19.875
8000 1.41844e-006 8.359
12000 1.92353e-006 9.484
No. of neurons in Hidden Layer: 7
MSE: 1.61835e-006
Elapsed time : 11.453000 seconds.
No. of neurons in Hidden Layer: 8
MSE : 1.39452e-006
Elapsed time: 8.281000 seconds.
contact Name
Pragati Dharmale: pragatiusstudies@gmail.com
Poster
P5235
Category: Computer Vision & Machine Vision - CV16

More Related Content

What's hot (18)

IIBMP2019 講演資料「オープンソースで始める深層学習」
IIBMP2019 講演資料「オープンソースで始める深層学習」IIBMP2019 講演資料「オープンソースで始める深層学習」
IIBMP2019 講演資料「オープンソースで始める深層学習」
Preferred Networks
 
IMQA Poster
IMQA PosterIMQA Poster
IMQA Poster
Vignesh Kannan
 
An Open Source solution for Three-Dimensional documentation: archaeological a...
An Open Source solution for Three-Dimensional documentation: archaeological a...An Open Source solution for Three-Dimensional documentation: archaeological a...
An Open Source solution for Three-Dimensional documentation: archaeological a...
Giulio Bigliardi
 
Find nuclei in images with U-net
Find nuclei in images with U-netFind nuclei in images with U-net
Find nuclei in images with U-net
Ding Li
 
An35225228
An35225228An35225228
An35225228
IJERA Editor
 
NVIDIA 深度學習教育機構 (DLI): Image segmentation with tensorflow
NVIDIA 深度學習教育機構 (DLI): Image segmentation with tensorflowNVIDIA 深度學習教育機構 (DLI): Image segmentation with tensorflow
NVIDIA 深度學習教育機構 (DLI): Image segmentation with tensorflow
NVIDIA Taiwan
 
IRJET-ASIC Implementation for SOBEL Accelerator
IRJET-ASIC Implementation for SOBEL AcceleratorIRJET-ASIC Implementation for SOBEL Accelerator
IRJET-ASIC Implementation for SOBEL Accelerator
IRJET Journal
 
HC-4012, Complex Network Clustering Using GPU-based Parallel Non-negative Mat...
HC-4012, Complex Network Clustering Using GPU-based Parallel Non-negative Mat...HC-4012, Complex Network Clustering Using GPU-based Parallel Non-negative Mat...
HC-4012, Complex Network Clustering Using GPU-based Parallel Non-negative Mat...
AMD Developer Central
 
딥러닝 중급 - AlexNet과 VggNet (Basic of DCNN : AlexNet and VggNet)
딥러닝 중급 - AlexNet과 VggNet (Basic of DCNN : AlexNet and VggNet)딥러닝 중급 - AlexNet과 VggNet (Basic of DCNN : AlexNet and VggNet)
딥러닝 중급 - AlexNet과 VggNet (Basic of DCNN : AlexNet and VggNet)
Hansol Kang
 
IEEEFYP2014poster Track 5 Vincent Yeong Chun Kiat
IEEEFYP2014poster Track 5 Vincent Yeong Chun KiatIEEEFYP2014poster Track 5 Vincent Yeong Chun Kiat
IEEEFYP2014poster Track 5 Vincent Yeong Chun Kiat
Vincent Yeong
 
Image Processing using Matlab ( using a built in Highboost filtering,averagin...
Image Processing using Matlab ( using a built in Highboost filtering,averagin...Image Processing using Matlab ( using a built in Highboost filtering,averagin...
Image Processing using Matlab ( using a built in Highboost filtering,averagin...
Majd Khaleel
 
Implementation of PD controller in attitude of quadcopter
Implementation of PD controller in attitude of quadcopterImplementation of PD controller in attitude of quadcopter
Implementation of PD controller in attitude of quadcopter
Tack-geun You
 
Ultra Fast SOM using CUDA
Ultra Fast SOM using CUDAUltra Fast SOM using CUDA
Ultra Fast SOM using CUDA
QuEST Global (erstwhile NeST Software)
 
Operation cost reduction in unit commitment problem using improved quantum bi...
Operation cost reduction in unit commitment problem using improved quantum bi...Operation cost reduction in unit commitment problem using improved quantum bi...
Operation cost reduction in unit commitment problem using improved quantum bi...
IJECEIAES
 
Improving initial generations in pso algorithm for transportation network des...
Improving initial generations in pso algorithm for transportation network des...Improving initial generations in pso algorithm for transportation network des...
Improving initial generations in pso algorithm for transportation network des...
ijcsit
 
IRJET- Image Compression Technique for Quantized Encrypted Images using SVD
IRJET-  	  Image Compression Technique for Quantized Encrypted Images using SVDIRJET-  	  Image Compression Technique for Quantized Encrypted Images using SVD
IRJET- Image Compression Technique for Quantized Encrypted Images using SVD
IRJET Journal
 
Mapping Parallel Programs into Hierarchical Distributed Computer Systems
Mapping Parallel Programs into Hierarchical Distributed Computer SystemsMapping Parallel Programs into Hierarchical Distributed Computer Systems
Mapping Parallel Programs into Hierarchical Distributed Computer Systems
Mikhail Kurnosov
 
B Eng Final Year Project Presentation
B Eng Final Year Project PresentationB Eng Final Year Project Presentation
B Eng Final Year Project Presentation
jesujoseph
 
IIBMP2019 講演資料「オープンソースで始める深層学習」
IIBMP2019 講演資料「オープンソースで始める深層学習」IIBMP2019 講演資料「オープンソースで始める深層学習」
IIBMP2019 講演資料「オープンソースで始める深層学習」
Preferred Networks
 
An Open Source solution for Three-Dimensional documentation: archaeological a...
An Open Source solution for Three-Dimensional documentation: archaeological a...An Open Source solution for Three-Dimensional documentation: archaeological a...
An Open Source solution for Three-Dimensional documentation: archaeological a...
Giulio Bigliardi
 
Find nuclei in images with U-net
Find nuclei in images with U-netFind nuclei in images with U-net
Find nuclei in images with U-net
Ding Li
 
NVIDIA 深度學習教育機構 (DLI): Image segmentation with tensorflow
NVIDIA 深度學習教育機構 (DLI): Image segmentation with tensorflowNVIDIA 深度學習教育機構 (DLI): Image segmentation with tensorflow
NVIDIA 深度學習教育機構 (DLI): Image segmentation with tensorflow
NVIDIA Taiwan
 
IRJET-ASIC Implementation for SOBEL Accelerator
IRJET-ASIC Implementation for SOBEL AcceleratorIRJET-ASIC Implementation for SOBEL Accelerator
IRJET-ASIC Implementation for SOBEL Accelerator
IRJET Journal
 
HC-4012, Complex Network Clustering Using GPU-based Parallel Non-negative Mat...
HC-4012, Complex Network Clustering Using GPU-based Parallel Non-negative Mat...HC-4012, Complex Network Clustering Using GPU-based Parallel Non-negative Mat...
HC-4012, Complex Network Clustering Using GPU-based Parallel Non-negative Mat...
AMD Developer Central
 
딥러닝 중급 - AlexNet과 VggNet (Basic of DCNN : AlexNet and VggNet)
딥러닝 중급 - AlexNet과 VggNet (Basic of DCNN : AlexNet and VggNet)딥러닝 중급 - AlexNet과 VggNet (Basic of DCNN : AlexNet and VggNet)
딥러닝 중급 - AlexNet과 VggNet (Basic of DCNN : AlexNet and VggNet)
Hansol Kang
 
IEEEFYP2014poster Track 5 Vincent Yeong Chun Kiat
IEEEFYP2014poster Track 5 Vincent Yeong Chun KiatIEEEFYP2014poster Track 5 Vincent Yeong Chun Kiat
IEEEFYP2014poster Track 5 Vincent Yeong Chun Kiat
Vincent Yeong
 
Image Processing using Matlab ( using a built in Highboost filtering,averagin...
Image Processing using Matlab ( using a built in Highboost filtering,averagin...Image Processing using Matlab ( using a built in Highboost filtering,averagin...
Image Processing using Matlab ( using a built in Highboost filtering,averagin...
Majd Khaleel
 
Implementation of PD controller in attitude of quadcopter
Implementation of PD controller in attitude of quadcopterImplementation of PD controller in attitude of quadcopter
Implementation of PD controller in attitude of quadcopter
Tack-geun You
 
Operation cost reduction in unit commitment problem using improved quantum bi...
Operation cost reduction in unit commitment problem using improved quantum bi...Operation cost reduction in unit commitment problem using improved quantum bi...
Operation cost reduction in unit commitment problem using improved quantum bi...
IJECEIAES
 
Improving initial generations in pso algorithm for transportation network des...
Improving initial generations in pso algorithm for transportation network des...Improving initial generations in pso algorithm for transportation network des...
Improving initial generations in pso algorithm for transportation network des...
ijcsit
 
IRJET- Image Compression Technique for Quantized Encrypted Images using SVD
IRJET-  	  Image Compression Technique for Quantized Encrypted Images using SVDIRJET-  	  Image Compression Technique for Quantized Encrypted Images using SVD
IRJET- Image Compression Technique for Quantized Encrypted Images using SVD
IRJET Journal
 
Mapping Parallel Programs into Hierarchical Distributed Computer Systems
Mapping Parallel Programs into Hierarchical Distributed Computer SystemsMapping Parallel Programs into Hierarchical Distributed Computer Systems
Mapping Parallel Programs into Hierarchical Distributed Computer Systems
Mikhail Kurnosov
 
B Eng Final Year Project Presentation
B Eng Final Year Project PresentationB Eng Final Year Project Presentation
B Eng Final Year Project Presentation
jesujoseph
 

Viewers also liked (20)

Ppt final
Ppt finalPpt final
Ppt final
ravi teja
 
Hand Gesture Recognition System for Human-Computer Interaction with Web-Cam
Hand Gesture Recognition System for Human-Computer Interaction with Web-CamHand Gesture Recognition System for Human-Computer Interaction with Web-Cam
Hand Gesture Recognition System for Human-Computer Interaction with Web-Cam
ijsrd.com
 
ADITYA UMARE_CV
ADITYA UMARE_CVADITYA UMARE_CV
ADITYA UMARE_CV
Aditya Umare
 
Presentación matrimonios 2015
Presentación matrimonios 2015Presentación matrimonios 2015
Presentación matrimonios 2015
oscarpley2012
 
22 diferente do outro, avaliação clínica do tratamento restaurador atraumáti...
22  diferente do outro, avaliação clínica do tratamento restaurador atraumáti...22  diferente do outro, avaliação clínica do tratamento restaurador atraumáti...
22 diferente do outro, avaliação clínica do tratamento restaurador atraumáti...
Luanna Melo
 
Presentació p 4 2015-2016 (edit)
Presentació p 4 2015-2016 (edit)Presentació p 4 2015-2016 (edit)
Presentació p 4 2015-2016 (edit)
Gaudicastelldefels
 
graphing experimental result
graphing  experimental resultgraphing  experimental result
graphing experimental result
Helal Uddin Mullah
 
Día de los muertos
Día de los muertosDía de los muertos
Día de los muertos
ap10349
 
Anwendungsbeispiele Industrie Terminals 2
Anwendungsbeispiele Industrie Terminals 2Anwendungsbeispiele Industrie Terminals 2
Anwendungsbeispiele Industrie Terminals 2
Nicole Eisele
 
Coursera DUVSFFTADYC2
Coursera DUVSFFTADYC2Coursera DUVSFFTADYC2
Coursera DUVSFFTADYC2
Ferdi Ramdhon
 
Estudio de casos
Estudio de casosEstudio de casos
Estudio de casos
Carlos Marín
 
El cuento del gusano
El cuento del gusanoEl cuento del gusano
El cuento del gusano
Alicia Martínez
 
Job Profiles In Gaming Industry
Job Profiles In Gaming IndustryJob Profiles In Gaming Industry
Job Profiles In Gaming Industry
Animation Kolkata
 
Real time gesture recognition of human hand
Real time gesture recognition of human handReal time gesture recognition of human hand
Real time gesture recognition of human hand
Vishnu Kudumula
 
gesture recognition!
gesture recognition!gesture recognition!
gesture recognition!
mehran kordavani
 
Que es el mantenimiento de un artefacto tecnologico
Que es el mantenimiento de un artefacto tecnologicoQue es el mantenimiento de un artefacto tecnologico
Que es el mantenimiento de un artefacto tecnologico
Marleny Gutierrez Pedroza
 
SPEECH RECOGNITION USING NEURAL NETWORK
SPEECH RECOGNITION USING NEURAL NETWORK SPEECH RECOGNITION USING NEURAL NETWORK
SPEECH RECOGNITION USING NEURAL NETWORK
Kamonasish Hore
 
Artificial Neural Network Based Object Recognizing Robot
Artificial Neural Network Based Object Recognizing RobotArtificial Neural Network Based Object Recognizing Robot
Artificial Neural Network Based Object Recognizing Robot
Jaison Sabu
 
Neural tool box
Neural tool boxNeural tool box
Neural tool box
Mohan Raj
 
Fuzzy and Neural Approaches in Engineering MATLAB
Fuzzy and Neural Approaches in Engineering MATLABFuzzy and Neural Approaches in Engineering MATLAB
Fuzzy and Neural Approaches in Engineering MATLAB
ESCOM
 
Hand Gesture Recognition System for Human-Computer Interaction with Web-Cam
Hand Gesture Recognition System for Human-Computer Interaction with Web-CamHand Gesture Recognition System for Human-Computer Interaction with Web-Cam
Hand Gesture Recognition System for Human-Computer Interaction with Web-Cam
ijsrd.com
 
Presentación matrimonios 2015
Presentación matrimonios 2015Presentación matrimonios 2015
Presentación matrimonios 2015
oscarpley2012
 
22 diferente do outro, avaliação clínica do tratamento restaurador atraumáti...
22  diferente do outro, avaliação clínica do tratamento restaurador atraumáti...22  diferente do outro, avaliação clínica do tratamento restaurador atraumáti...
22 diferente do outro, avaliação clínica do tratamento restaurador atraumáti...
Luanna Melo
 
Presentació p 4 2015-2016 (edit)
Presentació p 4 2015-2016 (edit)Presentació p 4 2015-2016 (edit)
Presentació p 4 2015-2016 (edit)
Gaudicastelldefels
 
Día de los muertos
Día de los muertosDía de los muertos
Día de los muertos
ap10349
 
Anwendungsbeispiele Industrie Terminals 2
Anwendungsbeispiele Industrie Terminals 2Anwendungsbeispiele Industrie Terminals 2
Anwendungsbeispiele Industrie Terminals 2
Nicole Eisele
 
Coursera DUVSFFTADYC2
Coursera DUVSFFTADYC2Coursera DUVSFFTADYC2
Coursera DUVSFFTADYC2
Ferdi Ramdhon
 
Job Profiles In Gaming Industry
Job Profiles In Gaming IndustryJob Profiles In Gaming Industry
Job Profiles In Gaming Industry
Animation Kolkata
 
Real time gesture recognition of human hand
Real time gesture recognition of human handReal time gesture recognition of human hand
Real time gesture recognition of human hand
Vishnu Kudumula
 
Que es el mantenimiento de un artefacto tecnologico
Que es el mantenimiento de un artefacto tecnologicoQue es el mantenimiento de un artefacto tecnologico
Que es el mantenimiento de un artefacto tecnologico
Marleny Gutierrez Pedroza
 
SPEECH RECOGNITION USING NEURAL NETWORK
SPEECH RECOGNITION USING NEURAL NETWORK SPEECH RECOGNITION USING NEURAL NETWORK
SPEECH RECOGNITION USING NEURAL NETWORK
Kamonasish Hore
 
Artificial Neural Network Based Object Recognizing Robot
Artificial Neural Network Based Object Recognizing RobotArtificial Neural Network Based Object Recognizing Robot
Artificial Neural Network Based Object Recognizing Robot
Jaison Sabu
 
Neural tool box
Neural tool boxNeural tool box
Neural tool box
Mohan Raj
 
Fuzzy and Neural Approaches in Engineering MATLAB
Fuzzy and Neural Approaches in Engineering MATLABFuzzy and Neural Approaches in Engineering MATLAB
Fuzzy and Neural Approaches in Engineering MATLAB
ESCOM
 

Similar to Enhanced Human Computer Interaction using hand gesture analysis on GPU (20)

Hand Finger Counting using Deep Convolutional Neural Network (CNN) on GPU
Hand Finger Counting using Deep Convolutional Neural Network (CNN) on GPUHand Finger Counting using Deep Convolutional Neural Network (CNN) on GPU
Hand Finger Counting using Deep Convolutional Neural Network (CNN) on GPU
Mahesh Khadatare
 
Computer-Vision_Integrating-Technology_MOB_17.06.16
Computer-Vision_Integrating-Technology_MOB_17.06.16Computer-Vision_Integrating-Technology_MOB_17.06.16
Computer-Vision_Integrating-Technology_MOB_17.06.16
Schuyler Kennedy
 
Benchmark of common AI accelerators: NVIDIA GPU vs. Intel Movidius
Benchmark of common AI accelerators: NVIDIA GPU vs. Intel MovidiusBenchmark of common AI accelerators: NVIDIA GPU vs. Intel Movidius
Benchmark of common AI accelerators: NVIDIA GPU vs. Intel Movidius
byteLAKE
 
Implementation of embedded arm9 platform using qt and open cv for human upper...
Implementation of embedded arm9 platform using qt and open cv for human upper...Implementation of embedded arm9 platform using qt and open cv for human upper...
Implementation of embedded arm9 platform using qt and open cv for human upper...
Krunal Patel
 
Gpudigital lab for english partners
Gpudigital lab for english partnersGpudigital lab for english partners
Gpudigital lab for english partners
Oleg Gubanov
 
VisionizeBeforeVisulaize_IEVC_Final
VisionizeBeforeVisulaize_IEVC_FinalVisionizeBeforeVisulaize_IEVC_Final
VisionizeBeforeVisulaize_IEVC_Final
Masatsugu HASHIMOTO
 
Machine-Learning-based Performance Heuristics for Runtime CPU/GPU Selection
Machine-Learning-based Performance Heuristics for Runtime CPU/GPU SelectionMachine-Learning-based Performance Heuristics for Runtime CPU/GPU Selection
Machine-Learning-based Performance Heuristics for Runtime CPU/GPU Selection
Akihiro Hayashi
 
Sample of project synopsis (2)
Sample of project synopsis (2)Sample of project synopsis (2)
Sample of project synopsis (2)
TH8B
 
CNC plotter controlled using Android application
CNC plotter controlled using Android applicationCNC plotter controlled using Android application
CNC plotter controlled using Android application
Yuval Yoskovits
 
MAJOR PROJECT
MAJOR PROJECT MAJOR PROJECT
MAJOR PROJECT
sandeep amaravadi
 
IRJET- Self Driving RC Car using Behavioral Cloning
IRJET-  	  Self Driving RC Car using Behavioral CloningIRJET-  	  Self Driving RC Car using Behavioral Cloning
IRJET- Self Driving RC Car using Behavioral Cloning
IRJET Journal
 
Using GPUs to Handle Big Data with Java
Using GPUs to Handle Big Data with JavaUsing GPUs to Handle Big Data with Java
Using GPUs to Handle Big Data with Java
Tim Ellison
 
Image Processing Application on Graphics processors
Image Processing Application on Graphics processorsImage Processing Application on Graphics processors
Image Processing Application on Graphics processors
CSCJournals
 
Computer Graphics Practical
Computer Graphics PracticalComputer Graphics Practical
Computer Graphics Practical
Neha Sharma
 
Marek Suplata Projects
Marek Suplata ProjectsMarek Suplata Projects
Marek Suplata Projects
guest14f12f
 
Monte Carlo on GPUs
Monte Carlo on GPUsMonte Carlo on GPUs
Monte Carlo on GPUs
fcassier
 
Nvidia (History, GPU Architecture and New Pascal Architecture)
Nvidia (History, GPU Architecture and New Pascal Architecture)Nvidia (History, GPU Architecture and New Pascal Architecture)
Nvidia (History, GPU Architecture and New Pascal Architecture)
Saksham Tanwar
 
Smart Face Recognition System Analysis
Smart Face Recognition System AnalysisSmart Face Recognition System Analysis
Smart Face Recognition System Analysis
Vishal Aditya
 
201001162_report
201001162_report201001162_report
201001162_report
Shirish Jadav
 
Interfacing of MATLAB with Arduino for Object Detection Algorithm Implementat...
Interfacing of MATLAB with Arduino for Object Detection Algorithm Implementat...Interfacing of MATLAB with Arduino for Object Detection Algorithm Implementat...
Interfacing of MATLAB with Arduino for Object Detection Algorithm Implementat...
Panth Shah
 
Hand Finger Counting using Deep Convolutional Neural Network (CNN) on GPU
Hand Finger Counting using Deep Convolutional Neural Network (CNN) on GPUHand Finger Counting using Deep Convolutional Neural Network (CNN) on GPU
Hand Finger Counting using Deep Convolutional Neural Network (CNN) on GPU
Mahesh Khadatare
 
Computer-Vision_Integrating-Technology_MOB_17.06.16
Computer-Vision_Integrating-Technology_MOB_17.06.16Computer-Vision_Integrating-Technology_MOB_17.06.16
Computer-Vision_Integrating-Technology_MOB_17.06.16
Schuyler Kennedy
 
Benchmark of common AI accelerators: NVIDIA GPU vs. Intel Movidius
Benchmark of common AI accelerators: NVIDIA GPU vs. Intel MovidiusBenchmark of common AI accelerators: NVIDIA GPU vs. Intel Movidius
Benchmark of common AI accelerators: NVIDIA GPU vs. Intel Movidius
byteLAKE
 
Implementation of embedded arm9 platform using qt and open cv for human upper...
Implementation of embedded arm9 platform using qt and open cv for human upper...Implementation of embedded arm9 platform using qt and open cv for human upper...
Implementation of embedded arm9 platform using qt and open cv for human upper...
Krunal Patel
 
Gpudigital lab for english partners
Gpudigital lab for english partnersGpudigital lab for english partners
Gpudigital lab for english partners
Oleg Gubanov
 
VisionizeBeforeVisulaize_IEVC_Final
VisionizeBeforeVisulaize_IEVC_FinalVisionizeBeforeVisulaize_IEVC_Final
VisionizeBeforeVisulaize_IEVC_Final
Masatsugu HASHIMOTO
 
Machine-Learning-based Performance Heuristics for Runtime CPU/GPU Selection
Machine-Learning-based Performance Heuristics for Runtime CPU/GPU SelectionMachine-Learning-based Performance Heuristics for Runtime CPU/GPU Selection
Machine-Learning-based Performance Heuristics for Runtime CPU/GPU Selection
Akihiro Hayashi
 
Sample of project synopsis (2)
Sample of project synopsis (2)Sample of project synopsis (2)
Sample of project synopsis (2)
TH8B
 
CNC plotter controlled using Android application
CNC plotter controlled using Android applicationCNC plotter controlled using Android application
CNC plotter controlled using Android application
Yuval Yoskovits
 
IRJET- Self Driving RC Car using Behavioral Cloning
IRJET-  	  Self Driving RC Car using Behavioral CloningIRJET-  	  Self Driving RC Car using Behavioral Cloning
IRJET- Self Driving RC Car using Behavioral Cloning
IRJET Journal
 
Using GPUs to Handle Big Data with Java
Using GPUs to Handle Big Data with JavaUsing GPUs to Handle Big Data with Java
Using GPUs to Handle Big Data with Java
Tim Ellison
 
Image Processing Application on Graphics processors
Image Processing Application on Graphics processorsImage Processing Application on Graphics processors
Image Processing Application on Graphics processors
CSCJournals
 
Computer Graphics Practical
Computer Graphics PracticalComputer Graphics Practical
Computer Graphics Practical
Neha Sharma
 
Marek Suplata Projects
Marek Suplata ProjectsMarek Suplata Projects
Marek Suplata Projects
guest14f12f
 
Monte Carlo on GPUs
Monte Carlo on GPUsMonte Carlo on GPUs
Monte Carlo on GPUs
fcassier
 
Nvidia (History, GPU Architecture and New Pascal Architecture)
Nvidia (History, GPU Architecture and New Pascal Architecture)Nvidia (History, GPU Architecture and New Pascal Architecture)
Nvidia (History, GPU Architecture and New Pascal Architecture)
Saksham Tanwar
 
Smart Face Recognition System Analysis
Smart Face Recognition System AnalysisSmart Face Recognition System Analysis
Smart Face Recognition System Analysis
Vishal Aditya
 
Interfacing of MATLAB with Arduino for Object Detection Algorithm Implementat...
Interfacing of MATLAB with Arduino for Object Detection Algorithm Implementat...Interfacing of MATLAB with Arduino for Object Detection Algorithm Implementat...
Interfacing of MATLAB with Arduino for Object Detection Algorithm Implementat...
Panth Shah
 

Recently uploaded (20)

MODULE 4 BUILDING PLANNING AND DESIGN SY BTECH HVAC SYSTEM IN BUILDING
MODULE 4 BUILDING PLANNING AND DESIGN SY BTECH HVAC SYSTEM IN BUILDINGMODULE 4 BUILDING PLANNING AND DESIGN SY BTECH HVAC SYSTEM IN BUILDING
MODULE 4 BUILDING PLANNING AND DESIGN SY BTECH HVAC SYSTEM IN BUILDING
Dr. BASWESHWAR JIRWANKAR
 
ENERGY STORING DEVICES-Primary Battery.pdf
ENERGY STORING DEVICES-Primary Battery.pdfENERGY STORING DEVICES-Primary Battery.pdf
ENERGY STORING DEVICES-Primary Battery.pdf
TAMILISAI R
 
[HIFLUX] Lok Fitting&Valve Catalog 2025 (Eng)
[HIFLUX] Lok Fitting&Valve Catalog 2025 (Eng)[HIFLUX] Lok Fitting&Valve Catalog 2025 (Eng)
[HIFLUX] Lok Fitting&Valve Catalog 2025 (Eng)
하이플럭스 / HIFLUX Co., Ltd.
 
Application Security and Secure Software Development Lifecycle
Application  Security and Secure Software Development LifecycleApplication  Security and Secure Software Development Lifecycle
Application Security and Secure Software Development Lifecycle
DrKavithaP1
 
HVAC Air Filter Equipment-Catalouge-Final.pdf
HVAC Air Filter Equipment-Catalouge-Final.pdfHVAC Air Filter Equipment-Catalouge-Final.pdf
HVAC Air Filter Equipment-Catalouge-Final.pdf
FILTRATION ENGINEERING & CUNSULTANT
 
ISO 4548-9 Oil Filter Anti Drain Catalogue.pdf
ISO 4548-9 Oil Filter Anti Drain Catalogue.pdfISO 4548-9 Oil Filter Anti Drain Catalogue.pdf
ISO 4548-9 Oil Filter Anti Drain Catalogue.pdf
FILTRATION ENGINEERING & CUNSULTANT
 
world subdivision.pdf...................
world subdivision.pdf...................world subdivision.pdf...................
world subdivision.pdf...................
bmmederos10
 
Tesia Dobrydnia - A Leader In Her Industry
Tesia Dobrydnia - A Leader In Her IndustryTesia Dobrydnia - A Leader In Her Industry
Tesia Dobrydnia - A Leader In Her Industry
Tesia Dobrydnia
 
DIY Gesture Control ESP32 LiteWing Drone using Python
DIY Gesture Control ESP32 LiteWing Drone using  PythonDIY Gesture Control ESP32 LiteWing Drone using  Python
DIY Gesture Control ESP32 LiteWing Drone using Python
CircuitDigest
 
2. CT M35 Grade Concrete Mix design ppt.pdf
2. CT M35 Grade Concrete Mix design  ppt.pdf2. CT M35 Grade Concrete Mix design  ppt.pdf
2. CT M35 Grade Concrete Mix design ppt.pdf
smghumare
 
Video Games and Artificial-Realities.pptx
Video Games and Artificial-Realities.pptxVideo Games and Artificial-Realities.pptx
Video Games and Artificial-Realities.pptx
HadiBadri1
 
Highway Engineering - Pavement materials
Highway Engineering - Pavement materialsHighway Engineering - Pavement materials
Highway Engineering - Pavement materials
AmrutaBhosale9
 
Kevin Corke Spouse Revealed A Deep Dive Into His Private Life.pdf
Kevin Corke Spouse Revealed A Deep Dive Into His Private Life.pdfKevin Corke Spouse Revealed A Deep Dive Into His Private Life.pdf
Kevin Corke Spouse Revealed A Deep Dive Into His Private Life.pdf
Medicoz Clinic
 
Introduction to Machine Vision by Cognex
Introduction to Machine Vision by CognexIntroduction to Machine Vision by Cognex
Introduction to Machine Vision by Cognex
RicardoCunha203173
 
Forensic Science – Digital Forensics – Digital Evidence – The Digital Forensi...
Forensic Science – Digital Forensics – Digital Evidence – The Digital Forensi...Forensic Science – Digital Forensics – Digital Evidence – The Digital Forensi...
Forensic Science – Digital Forensics – Digital Evidence – The Digital Forensi...
ManiMaran230751
 
Air Filter Flat Sheet Media-Catalouge-Final.pdf
Air Filter Flat Sheet Media-Catalouge-Final.pdfAir Filter Flat Sheet Media-Catalouge-Final.pdf
Air Filter Flat Sheet Media-Catalouge-Final.pdf
FILTRATION ENGINEERING & CUNSULTANT
 
MODULE 5 BUILDING PLANNING AND DESIGN SY BTECH ACOUSTICS SYSTEM IN BUILDING
MODULE 5 BUILDING PLANNING AND DESIGN SY BTECH ACOUSTICS SYSTEM IN BUILDINGMODULE 5 BUILDING PLANNING AND DESIGN SY BTECH ACOUSTICS SYSTEM IN BUILDING
MODULE 5 BUILDING PLANNING AND DESIGN SY BTECH ACOUSTICS SYSTEM IN BUILDING
Dr. BASWESHWAR JIRWANKAR
 
Prediction of Unconfined Compressive Strength of Expansive Soil Amended with ...
Prediction of Unconfined Compressive Strength of Expansive Soil Amended with ...Prediction of Unconfined Compressive Strength of Expansive Soil Amended with ...
Prediction of Unconfined Compressive Strength of Expansive Soil Amended with ...
Journal of Soft Computing in Civil Engineering
 
Filters for Electromagnetic Compatibility Applications
Filters for Electromagnetic Compatibility ApplicationsFilters for Electromagnetic Compatibility Applications
Filters for Electromagnetic Compatibility Applications
Mathias Magdowski
 
MODULE 4 BUILDING PLANNING AND DESIGN SY BTECH HVAC SYSTEM IN BUILDING
MODULE 4 BUILDING PLANNING AND DESIGN SY BTECH HVAC SYSTEM IN BUILDINGMODULE 4 BUILDING PLANNING AND DESIGN SY BTECH HVAC SYSTEM IN BUILDING
MODULE 4 BUILDING PLANNING AND DESIGN SY BTECH HVAC SYSTEM IN BUILDING
Dr. BASWESHWAR JIRWANKAR
 
ENERGY STORING DEVICES-Primary Battery.pdf
ENERGY STORING DEVICES-Primary Battery.pdfENERGY STORING DEVICES-Primary Battery.pdf
ENERGY STORING DEVICES-Primary Battery.pdf
TAMILISAI R
 
Application Security and Secure Software Development Lifecycle
Application  Security and Secure Software Development LifecycleApplication  Security and Secure Software Development Lifecycle
Application Security and Secure Software Development Lifecycle
DrKavithaP1
 
world subdivision.pdf...................
world subdivision.pdf...................world subdivision.pdf...................
world subdivision.pdf...................
bmmederos10
 
Tesia Dobrydnia - A Leader In Her Industry
Tesia Dobrydnia - A Leader In Her IndustryTesia Dobrydnia - A Leader In Her Industry
Tesia Dobrydnia - A Leader In Her Industry
Tesia Dobrydnia
 
DIY Gesture Control ESP32 LiteWing Drone using Python
DIY Gesture Control ESP32 LiteWing Drone using  PythonDIY Gesture Control ESP32 LiteWing Drone using  Python
DIY Gesture Control ESP32 LiteWing Drone using Python
CircuitDigest
 
2. CT M35 Grade Concrete Mix design ppt.pdf
2. CT M35 Grade Concrete Mix design  ppt.pdf2. CT M35 Grade Concrete Mix design  ppt.pdf
2. CT M35 Grade Concrete Mix design ppt.pdf
smghumare
 
Video Games and Artificial-Realities.pptx
Video Games and Artificial-Realities.pptxVideo Games and Artificial-Realities.pptx
Video Games and Artificial-Realities.pptx
HadiBadri1
 
Highway Engineering - Pavement materials
Highway Engineering - Pavement materialsHighway Engineering - Pavement materials
Highway Engineering - Pavement materials
AmrutaBhosale9
 
Kevin Corke Spouse Revealed A Deep Dive Into His Private Life.pdf
Kevin Corke Spouse Revealed A Deep Dive Into His Private Life.pdfKevin Corke Spouse Revealed A Deep Dive Into His Private Life.pdf
Kevin Corke Spouse Revealed A Deep Dive Into His Private Life.pdf
Medicoz Clinic
 
Introduction to Machine Vision by Cognex
Introduction to Machine Vision by CognexIntroduction to Machine Vision by Cognex
Introduction to Machine Vision by Cognex
RicardoCunha203173
 
Forensic Science – Digital Forensics – Digital Evidence – The Digital Forensi...
Forensic Science – Digital Forensics – Digital Evidence – The Digital Forensi...Forensic Science – Digital Forensics – Digital Evidence – The Digital Forensi...
Forensic Science – Digital Forensics – Digital Evidence – The Digital Forensi...
ManiMaran230751
 
MODULE 5 BUILDING PLANNING AND DESIGN SY BTECH ACOUSTICS SYSTEM IN BUILDING
MODULE 5 BUILDING PLANNING AND DESIGN SY BTECH ACOUSTICS SYSTEM IN BUILDINGMODULE 5 BUILDING PLANNING AND DESIGN SY BTECH ACOUSTICS SYSTEM IN BUILDING
MODULE 5 BUILDING PLANNING AND DESIGN SY BTECH ACOUSTICS SYSTEM IN BUILDING
Dr. BASWESHWAR JIRWANKAR
 
Filters for Electromagnetic Compatibility Applications
Filters for Electromagnetic Compatibility ApplicationsFilters for Electromagnetic Compatibility Applications
Filters for Electromagnetic Compatibility Applications
Mathias Magdowski
 

Enhanced Human Computer Interaction using hand gesture analysis on GPU

  • 1. Abstract This poster represent very active research topic in human computer interaction (HCI) as automatic hand gesture recognition using nvidia GPU. In this work neural network based video gesture are processed and recognize the finger counts. Due to real time requirement algorithm need to optimize and computationally efficient. We implemented the MATLAB code, it perform slow when neural network processing started. Implementing them in a parallel programming model such as GPU-CUDA would provide the necessary gain in processing speed. Algorithmic result validation is done using standard video data set and recognition rate is calculated. A performance improvement of 15x speed is achieved which is faster than Intel quad core processor. Introduction The goal of this project is to develop a program implementing gesture recognition. At any time, a user can exhibit his hand doing a specific gesture in front of a video camera linked to a computer. The program has to collect pictures of this gesture, analyze it and to identify the sign. In order to lighten the project, it has been decided that the identification would consist in counting the number of fingers that are shown by the user in the input picture. Database And MATLAB Results CUDA Approach 1. Camera capture video – process frame by frame image 2. Extract features from the image using various segmentation techniques implemented in MATLAB, CUDA. Output features then written to a text file. 3. Use the matrix obtained in step 2 to train the neural network(on CPU using MATLAB). 4. Once the network is trained , we test it on GPU. 5. GPU implementation :- a. Load the test image into GPU global memory b. Process it as in step 2, output will be matrix of size (262144 x1). c. Pad the matrix with 0's - output will be a matrix of size (262144 x16) - Inputs matrix. d. This is all done on the GPU. Now pass the neural network weights matrix, to the GPU. e. Multiply neuralnetwork_weights matrix by Inputs matrix - which will give a 16 x 16 matrix. Extract the first five values from it. The index of the value which has maximum value + 1 gives us the count. NN Training Results GPU (GeForce GT 525M) References [1] Malima, A.; Ozgur,E.; Cetin,M.; [2006] “A Fast Algorithm for Vision-Based Hand Gesture Recognition for Robot Control”, Signal Processing and Communications Applications, IEEE [2] A Neural Network on GPU, http://www.codeproject.com/KB/graphics/GPUNN.aspx [3] NVIDIA Corporation, Compute Unified Device Architecture (CUDA), http://developer.nvidia.com/object/cuda.html. Enhanced Human Computer Interaction using hand gesture analysis on GPU Mahesh Khadtare1, Pragati Dharmale2 1 – I2IT, Pune, IN; 2 – SNHU, NH, US; Flow CPU GPU Speedup (ms) (ms) Preprocessing 45 2.12 21.22 Feature Extraction 52 3.54 14.68 Neural Network Training 192 25.21 7.61 Neural Network Testing 62 12.23 5.06 Total 351 43 8.16 Preprocessing Feature Extraction Pattern recognition Pattern recognition Image from camera Output ( No. of count ) Training File Preprocessing Feature Extraction Image from camera (a) Training Phase (b) Testing Phase No of epochs MSE Time in seconds 2000 1.64272e-006 12.62 5000 1.58837e-006 19.875 8000 1.41844e-006 8.359 12000 1.92353e-006 9.484 No. of neurons in Hidden Layer: 7 MSE: 1.61835e-006 Elapsed time : 11.453000 seconds. No. of neurons in Hidden Layer: 8 MSE : 1.39452e-006 Elapsed time: 8.281000 seconds. contact Name Pragati Dharmale: [email protected] Poster P5235 Category: Computer Vision & Machine Vision - CV16