Volume 10, Issue 4, April – 2025 International Journal of Innovative Science and Research Technology

ISSN No:-2456-2165 https://doi.org/10.38124/ijisrt/25apr564

Guesture Controlled Virtual Mouse

Rishikesh Harad1; Nirmal Bhange2; Jay Patil3; Ajitkumar Khachane4
1,2,3
Vidyalankar Institute of Technology, Mumbai Affilation with University of Mumbai
Mumbai, Maharashtra, India
4
Professor, Vidyalankar Institute of Technology,Mumbai, Maharashtra, India

Publication Date: 2025/04/26

Abstract: The rapid advancement of human-computer interaction has led to the development of innovative technologies
that enhance user experience and accessibility. Gesture-Controlled Virtual Mouse is an AI-powered system designed to
replace traditional input devices by enabling users to control the cursor using hand gestures. This technology leverages
Computer Vision (CV), Machine Learning (ML), and Hand Tracking Algorithms to interpret gestures, allowing seamless
navigation and interaction with digital interfaces.

One of the key features of the Gesture-Controlled Virtual Mouse is its ability to perform essential mouse functions such as
clicking, scrolling, and dragging without physical contact. The system detects hand movements in real time, ensuring high
accuracy and responsiveness. Additionally, it enhances accessibility by offering an alternative input method for individuals
with mobility impairments.

For users, this technology provides an intuitive and touch-free computing experience, reducing dependence on traditional
peripherals like a mouse or trackpad. It is particularly beneficial in scenarios requiring hands-free operation, such as
gaming, presentations, and medical environments. The Gesture-Controlled Virtual Mouse streamlines interaction, improves
efficiency, and represents a step forward in touchless computing solutions.

Whether a candidate is a tech enthusiast or an experienced developer, Gesture-Controlled Virtual Mouse enhances
human-computer interaction by providing a seamless, touch-free experience. Utilizing advanced computer vision and
machine learning, it enables intuitive cursor control, bridging the gap between physical gestures and digital navigation.

Keywords: Gesture Recognition, Computer Vision, Machine Learning, Virtual Mouse, Human-Computer Interaction.

How to Cite: Rishikesh Harad; Nirmal Bhange; Jay Patil; Ajitkumar Khachane (2025) Guesture Controlled Virtual Mouse
Interaction International Journal of Innovative Science and ResearchTechnology, 10(4), 1474-1478.
https://doi.org/10.38124/ijisrt/25apr564

I. INTRODUCTION clicking, scrolling, and cursor movement. This technology

provides a touch-free and intuitive alternative to traditional
In today’s technology-driven world, innovative human- input devices, enhancing user experience and accessibility.
computer interaction methods are gaining significant
attention. Traditional input devices like a mouse and keyboard By automating the interaction process and eliminating
have limitations, making it essential to explore alternative the need for physical input devices, the Gesture-Controlled
interaction techniques. Gesture-controlled virtual mouse Virtual Mouse reduces strain on users and enhances
systems offer a touch-free and intuitive way to interact with accessibility for individuals with mobility impairments.
computers, enhancing accessibility and user experience. Moreover, it offers innovative applications in gaming, virtual
Manual control methods can be restrictive and inefficient in reality, and smart home control, making human-computer
various scenarios, leading to the need for advanced, AI- interaction more seamless and natural.
powered solutions. To address these challenges, gesture-
controlled virtual mouse systems leverage computer vision This paper presents an in-depth analysis of the Gesture-
and machine learning techniques to enable seamless cursor Controlled Virtual Mouse, its architecture, key functionalities,
control, clicking, and scrolling through hand gestures, and the benefits it offers to users across various domains.
revolutionizing human-computer interaction. Gesture-
Controlled Virtual Mouse is an AI-powered system designed By automating cursor movement and click functions
to enable hands-free computer interaction using hand gestures. through hand gestures, the Gesture-Controlled Virtual Mouse
By integrating Computer Vision (CV) and Machine Learning reduces the need for physical peripherals, enhancing user
(ML) algorithms, the system detects, tracks, and interprets convenience and accessibility. Moreover, it assists users in
hand movements to simulate mouse functionalities such as interacting with digital interfaces more intuitively by

IJISRT25APR564 www.ijisrt.com 1474

Volume 10, Issue 4, April – 2025 International Journal of Innovative Science and Research Technology
ISSN No:-2456-2165 https://doi.org/10.38124/ijisrt/25apr564
streamlining navigation and control. This paper presents an III. MAINTAINING THE INTEGRITY OF THE
in-depth analysis of the Gesture-Controlled Virtual Mouse, its SPECIFICATIONS
architecture, key functionalities, and the benefits it offers in
improving human-computer interaction. The Gesture Controlled Virtual Mouse system follows a
structured approach to ensuring accurate gesture recognition
II. EASE OF USE and seamless user interaction. To maintain precision and
efficiency, specific implementation standards must be
Before implementing the Gesture Controlled Virtual followed.
Mouse, ensure that the system is designed for user-friendly
interaction with minimal effort. The interface should be All aspects of the system, including camera calibration,
intuitive, allowing users to perform essential mouse functions gesture mapping, response time, and cursor movement,
like clicking, scrolling, and dragging using simple hand should be optimized for real-time processing and user-
gestures. friendly control. Avoid excessive modifications to these
parameters, as they are designed to enhance the system's
For the best user experience, the system should support accuracy and usability.
real-time gesture recognition, have low latency, and be
adaptable to different lighting conditions. A well-optimized Certain design choices—such as predefined gesture
algorithm should minimize false detections while ensuring recognition patterns, optimal hand detection ranges, and
smooth and accurate cursor control. filtering techniques—are intentionally implemented to
improve gesture tracking consistency and minimize errors in
 Experience. real-world applications.
If your resume includes your project "Gesture-
Controlled Virtual Mouse," make sure to highlight it under IV. ABBREVIATIONS AND ACRONYMS
the Projects section with a clear description, technologies
used, and your contributions. Maintaining a structured format In the Gesture Controlled Virtual Mouse project,
will improve readability and analysis accuracy. abbreviations and acronyms should be clearly defined upon
their first appearance to ensure clarity and consistency
 Maintaining the Integrity of the Specifications throughout the documentation. For example, Computer Vision
GUESTURE CONTROLLED VIRTUAL MOUSE (CV) and Machine Learning (ML) should be written in full
processes hand gestures based on predefined recognition initially, followed by their acronyms in parentheses. After this
algorithms to interpret user inputs effectively. To ensure a initial definition, the acronym may be used independently
seamless experience, adhere to the following specifications: throughout the paper.

 Key Formatting Guidelines: Common industry-standard abbreviations, such as AI

(Artificial Intelligence), HCI (Human-Computer Interaction),
 File Format : and FPS (Frames Per Second), do not require repeated
Upload reports, project documentation, or resumes in definitions. However, avoid excessive abbreviations in critical
PDF or DOCX format for accurate parsing and readability. sections like the Abstract, Introduction, and Conclusion, as
they may reduce readability and clarity.
 Font and Size:
Use standard fonts like Arial, Calibri, or Times New V. EQUATIONS
Roman with a font size between 10-12 pt to maintain clarity.
In CVSCAN, equations play a crucial role in key In the
 Sections and Headings: Gesture Controlled Virtual Mouse project, equations play a
Clearly label sections such as Project Overview, crucial role in key functionalities such as hand tracking,
Technologies Used, Implementation, Challenges, and Future gesture recognition, cursor movement mapping, and noise
Scope to improve content organization. filtering. To ensure clarity and consistency in mathematical
representations, all equations should follow a structured and
 Avoid Complex Formatting : standardized format.
Minimize the use of tables, text boxes, and graphics, as
they may disrupt proper content extraction and readability. Equations related to computer vision algorithms,
machine learning models, and coordinate transformations
 Consistent Spacing: should be clearly formatted using Times New Roman or the
Maintain proper line spacing and margins for a clean, Symbol font—no other fonts should be used. If an equation
structured presentation of project details. requires multiple levels or complex notation, it may be
necessary to represent it as a graphic or LaTeX-rendered
 Bullet Points for Readability : formula for better readability.
Use bullet points to highlight key features,
methodology, achievements, and results instead of lengthy In the Gesture Controlled Virtual Mouse project,
paragraphs.. equations are essential for defining gesture recognition
models, hand tracking algorithms, and cursor control

IJISRT25APR564 www.ijisrt.com 1475

Volume 10, Issue 4, April – 2025 International Journal of Innovative Science and Research Technology
ISSN No:-2456-2165 https://doi.org/10.38124/ijisrt/25apr564
mechanisms. To ensure clarity and precision, all mathematical To maintain compactness, mathematical expressions
expressions should follow a structured and standardized such as solidus ( / ), the exp function, or appropriate
format. exponents should be used where applicable. Italicize Roman
symbols for quantities and variables, but not Greek symbols.
If an equation requires multiple levels, it may be Use a long dash (—) instead of a hyphen (-) for a minus sign.
necessary to treat it as a graphic and insert it accordingly for
better readability. Equations must be numbered consecutively, When equations form part of a sentence, apply
with numbers placed flush right in parentheses, as in: appropriate punctuation. Equation references should be
formatted as (1), not Eq. (1) or equation (1). However, at the
X_{c} = (X_{h} - X_{m})/S_{f} Y_{c} = (Y_{h} - beginning of a sentence, it should be written as "Equation (1)
Y_{m})/S_{f} (1 is...".

Where Xc,YcX_c, Y_cXc,Yc are the cursor coordinates, By following these guidelines, the Gesture Controlled
Xh,YhX_h, Y_hXh,Yh are the hand coordinates, Virtual Mouse project ensures a mathematically accurate and
Xm,YmX_m, Y_mXm,Ym represent the mapped screen structured approach, improving the efficiency and reliability
center, and SfS_fSf is the scaling factor. of gesture-based interactions.

Fig 1 Flow-Chart

IJISRT25APR564 www.ijisrt.com 1476

Volume 10, Issue 4, April – 2025 International Journal of Innovative Science and Research Technology
ISSN No:-2456-2165 https://doi.org/10.38124/ijisrt/25apr564
VI. ACKNOWLEDGMENT encouragement in shaping this project. His expertise and
guidance have been instrumental in refining our approach and
The development of the Gesture Controlled Virtual achieving our objectives.
Mouse has been a collaborative effort, and we extend our
sincere gratitude to those who have guided and supported us We are also profoundly grateful to Dr. Vidya Chitre,
throughout this project. Head of the Department, for providing us with the necessary
We would like to express our deep appreciation to Prof. resources, support, and motivation to undertake this research.
Ajitkumar khachane, our project guide, for his invaluable Her leadership and encouragement have greatly contributed to
mentorship, insightful feedback, and continuous the successful completion of this work.

Table 1 Comparative Summary

Aspect Gesture Controlled Virtual Hand Gesture Recognition Building a Gesture- AI-Powered Gesture
Mouse Using AI (IRJMETS) for Virtual Mouse (IEEE Based Virtual Mouse Mouse Control
Reference) (Medium Article) (IJCSPUB)
Authors Nimish Patil, Shubham Not specified (IEEE paper) Chetaniya Bajaj Nagisetti Saideepthi,
Yadav, Vikas Biradar Movva Hema Latha,
Kalluri Deepthi, Guttula
Krupa Harika
Source IRJMETS (Research IEEE (Research Medium (Technical IJCSPUB (International
Journal) Conference/Journal) Blog) Journal of Current
Science)
Objective Develop a gesture-controlled Implement hand gesture Step-by-step guide to Enhance user interaction
virtual mouse using AI and recognition for controlling a building a virtual by providing a
computer vision to replace virtual mouse efficiently mouse using hand contactless mouse
traditional input devices gestures experience using AI-
based gesture control
Key OpenCV, Python, Computer Vision, Deep Python, OpenCV, AI, Computer Vision,
Technologies MediaPipe, Machine Learning, TensorFlow/Keras MediaPipe OpenCV, Deep Learning
Learning
Methodology 1. Capture hand gestures 1. Preprocess hand images 1. Detect hand 1. Train a model for
using a webcam → 2. → 2. Train deep learning landmarks using gesture recognition → 2.
Process the gestures using model for gesture OpenCV & MediaPipe Integrate with OpenCV
OpenCV & MediaPipe → 3. recognition → 3. Implement → 2. Map hand for real-time detection
Map gestures to mouse gesture-based control for movements to cursor → 3. Develop an AI-
actions (click, scroll, move) mouse actions actions → 3. Implement based control system for
→ 4. Optimize for real-time gesture-based clicks smooth mouse
performance and scrolling interaction.
Field Hand position, finger Hand gestures, finger Hand landmark Hand tracking, click
Extraction movements, click gestures, tracking, object interaction detection, gesture detection, scrolling,
scroll gestures, drag-and- classification, motion virtual keyboard control
drop actions tracking
Analysis Gesture recognition Machine learning-based Landmark detection AI-based gesture
Performed accuracy, real-time gesture classification, efficiency, gesture-to- mapping, accuracy
performance analysis, response time analysis action mapping optimization for real-
latency testing world usage
Recruiter Control mouse cursor, Gesture-based cursor Step-by-step guide for Hands-free interaction,
Features left/right click, scrolling, movement, click detection, developers to gesture-based typing,
drag-and-drop, customizable optimized tracking for implement gesture- enhanced accessibility
gestures smooth interaction based control
Tools Used Python (OpenCV, Python, TensorFlow/Keras, Python, OpenCV, Python, AI, Computer
MediaPipe, PyAutoGUI), Deep Learning, OpenCV MediaPipe, Vision, Machine
Computer Vision, AI PyAutoGUI Learning
Challenges Achieving real-time Improving gesture Handling different Ensuring smooth and
accuracy, handling different recognition accuracy, webcam resolutions, precise cursor
lighting conditions, avoiding minimizing latency, adapting avoiding accidental movement, real-time
false gestures to different hand sizes gestures adaptability
Future Scope Improving gesture detection Using advanced AI models Expanding gesture sets, Integrating with IoT
with deep learning, for higher accuracy, enabling making it compatible devices, adding AI-
integrating voice commands, multi-hand gestures with multiple operating driven adaptive gesture
making it compatible with systems learning
AR/VR

IJISRT25APR564 www.ijisrt.com 1477

Volume 10, Issue 4, April – 2025 International Journal of Innovative Science and Research Technology
ISSN No:-2456-2165 https://doi.org/10.38124/ijisrt/25apr564
VII. CONCLUSION

The IEEE paper is highly technical, focusing on

computer vision, deep learning, and hand-tracking algorithms
for implementing the GestureControlled Virtual Mouse. It
emphasizes mathematical modeling, neural networks, and real-
time processing techniques to ensure precise and efficient
gesture recognition, enhancing accuracy and responsiveness in
human-computer interaction.

REFERENCES

[1]. Wu, H., Cai, X., Ma, J. and Zhang, X., 2022,
September. Towards Natural Virtual Mouse with mm-
Wave
[2]. Radar. In 2022 19th European Radar Conference
(EuRAD) (pp. 45-48), IEEE.
[3]. Joy Guha, Shreya Kumari, Prof. Shiv Kumar Verma,
“AI Virtual Mouse Using Hand Gesture Recognition”,
[4]. Key Comparisons:
[5]. (IRJMETS Paper) – Focuses on developing a gesture-
based interaction system for controlling a virtual
mouse, utilizing computer vision and hand-tracking
techniques.
[6]. (IEEE Paper) – Emphasizes deep learning-based hand
gesture recognition for human-computer interaction,
improving accuracy and robustness in virtual
mouseapplications.
[7]. (Medium Article) – A practical, hands-on guide aimed
at developers for building a simple gesture-controlled
mouse using OpenCV, MediaPipe, and Python.
[8]. (IJCSPUB Paper) – Extends gesture-controlled
interfaces with AI-based enhancements, including
predictive gesture recognition and adaptive cursor
control for improved usability.

IJISRT25APR564 www.ijisrt.com 1478