Scribd
Upload
74 views12 pages

Capture Frames and Convert To Grayscale

This document discusses gesture recognition technology. It notes that gestures include movements of the hands, arms, face, head, and body. Gesture recognition uses mathematical algorithms to interpret human gestures and aims to enable interaction between the human body and computers. This technology can be useful for controlling devices through hand gestures and could benefit physically challenged or blind individuals. Key aspects for gesture recognition systems are functionality and usability.

Uploaded by

Chandrashekhar Katagi
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd
74 views12 pages

Capture Frames and Convert To Grayscale

This document discusses gesture recognition technology. It notes that gestures include movements of the hands, arms, face, head, and body. Gesture recognition uses mathematical algorithms to interpret human gestures and aims to enable interaction between the human body and computers. This technology can be useful for controlling devices through hand gestures and could benefit physically challenged or blind individuals. Key aspects for gesture recognition systems are functionality and usability.

Uploaded by

Chandrashekhar Katagi
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd
You are on page 1/ 12

 Gestures include movements of hands, arms, face , head , and / or

body.
 They play a major role during communication by providing easier
understanding.
 Gesture Recognition is the technology that interprets human
gestures via mathematical algorithms.
 The goal of Gesture Recognition is to provide an interaction
between human body with computer.
 Human Machine interface(HMI) refers to the relation between
the human and the computer.
 Tracing of hand can be interfaced for controlling appliances
through hand gesture asa remote control device and prove to be
a possible solution to control multiple gadgets.
 It can be very useful for physically challenged and blind people.
 Two characteristics to be focused on
1. Functionality
2. Usability

1. Capture frames and convert to grayscale


 we capture the images of the hand and convert them to grayscale.
 Q. Why grayscale ?
A. We convert an image from RGB to grayscale and then to binary in order to
find the ROI i.e. the portion of the image we are further interested for image
processing. By doing this our decision becomes binary: "yes the pixel is of
interest" or "no the pixel is not of interest".
2. Blur image
 I've used Gaussian Blurring on the original image. We blur the image for
smoothing and to reduce noise and details from the image. We are not interested
in the details of the image but in the shape of the object to track.
 By blurring, we create smooth transition from one color to another and reduce the
edge content. We use thresholding for image segmentation, to create binary
images from grayscale images.
3. Thresholding
 In very basic terms, thresholding is like a Low Pass Filter by allowing only
particular color ranges to be highlighted as white while the other colors are
suppressed by showing them as black.
 I've used Otsu's Binarization method. In this method, OpenCV automatically
calculates/approximates the threshold value of a bimodal image from its image
histogram. But for optimal results, we may need a clear background in front of
the webcam which sometimes may not be possible.
4. Draw contours

5. Find convex hull and convexity defects


 We now find the convex points and the defect points. The convex points are
generally, the tip of the fingers. But there are other convex point too. So, we find
convexity defects, which is the deepest point of deviation on the contour. By this
we can find the number of fingers extended and then we can perform different
functions according to the number of fingers extended.
Steps:

Flowchart:

You might also like