Hand Gestures Controlled Robot
Hand Gestures Controlled Robot
www.ijtre.com
635
A. Camera Unit
A 6 megapixel USB 2.0 still webcam of INTEX Company is
mounted on a stand having a perfectly black platform. The
user has to perform different gestures wearing a white glove
in his/her hand on this platform.
www.ijtre.com
If
Match
found
NO
YES
Exaction of instruction set corresponding
to the matched gesture
Passing the instructions to robot through
serial port for execution of corresponding
636
Hand Gesture
Code
Description
#11
Forward
2.
#21
Reverse
3.
#31
Left
1.
www.ijtre.com
637
4.
#41
Right
5.
#51
Up
6.
#61
Down
7.
#71
Stop
V. GESTURE USES
Gesture recognition is useful for processing information from
humans which is not conveyed through speech or type. As
well, there are various types of gestures which can be
identified by computers.
Sign language recognition: Just as speech recognition can
transcribe speech to text, certain types of gesture recognition
software can transcribe the symbols represented through sign
language into text ([9], [24]).
For socially assistive robotic: By using proper sensors
(accelerometers and gyros) worn on the body of a patient and
by reading the values from those sensors, robots can assist in
patient rehabilitation. The best example can be stroke
rehabilitation.
Directional indication through pointing: Pointing has a very
specific purpose in our society, to reference an object or
location based on its position relative to ourselves. The use of
gesture recognition to determine where a person is pointing is
useful for identifying the context of statements or
instructions. This application is of particular interest in the
field of robotics.
Control through facial gestures: Controlling a computer
through facial gestures is a useful application of gesture
recognition for users who may not physically be able to use a
mouse or keyboard. Eye track in particular may be of use for
controlling cursor motion or focusing on elements of a
display.
Alternative computer interfaces: Foregoing the traditional
keyboard and mouse setup to interact with a computer, strong
gesture recognition could allow users to accomplish frequent
or common tasks using hand or face gestures to a camera.
www.ijtre.com
VII. CONCLUSIONS
A low cost computer vision system that can be executed in a
common PC equipped with low power USB web cam was
one of the main objectives of our work, which has been
implemented successfully. We have experimented with
around 30 hand gesture images and achieved higher average
precision. The best classification rate of 97% was obtained
under different light conditions. But the drawback in this
method is that the hand should be properly placed with
respect to the webcam so that the entire hand region is
captured. If the hand is not placed properly the gesture is not
recognized appropriately. Gesture made in this method
involves only one hand and this reduces the number of
gestures that can be made using both hands.
VIII. ACKNOWLEDGMENT
We would like to thank Prof. H. D. Shinde, for her valuable
guidance and support during the completion of this project.
REFERENCES
[1] R. Gonzales, and E. Woods, Digital Image
Processing, Prentice Hall, Inc, New Jersey, 2002.
[2] J. Davis, M. Shah, Visual gesture recognition.
IEE Proc. Vis. Image Signal Process, 141(2):101106, 1994.
[3] E. Sanchez-Nielsen, L. Anton-Canalis, M.
Hernandez-Tejera, Hand gesture recognition for
human machine interaction, Journal of WSCG,
638
www.ijtre.com
639