VIRTUAL TOUCH SYSTEM USING MEDIAPIPE AND OPENCV FOR GESTURE-BASED HUMAN-COMPUTER INTERACTION
The Virtual Touch System is a touchless human-computer interaction solution that allows users to control digital interfaces using hand gestures and voice commands. This system is developed using Python, integrating MediaPipe for hand tracking, OpenCV for image processing, and NLP for voice recognition. The system detects finger positions and interprets them as touch events, simulating real-time interaction without physical contact. It provides a hygienic, efficient, and low-cost alternative to traditional touch-based systems.
Unlike traditional input devices, the proposed system provides a natural and intuitive interface by interpreting human gestures in real time. The integration of rule-based gesture mapping ensures fast response and low computational complexity, making the system suitable for deployment on standard computing devices without requiring specialized hardware. Additionally, the system addresses critical challenges such as hygiene and accessibility by offering a completely contactless interaction mechanism.
Experimental results demonstrate that the system achieves high accuracy under controlled lighting conditions, with minimal latency, making it practical . The proposed solution can be effectively used in public interaction systems, healthcare environments, smart homes, and assistive technologies. Furthermore, this work lays a foundation for future enhancements using artificial intelligence, deep learning, and augmented reality to improve gesture recognition and expand functionality.
GY, D. (2026). Virtual Touch System using Mediapipe and Opencv for Gesture-Based Human-Computer Interaction. International Journal of Science, Strategic Management and Technology, 02(05). https://doi.org/10.55041/ijsmt.v2i5.592
GY, Devika. "Virtual Touch System using Mediapipe and Opencv for Gesture-Based Human-Computer Interaction." International Journal of Science, Strategic Management and Technology, vol. 02, no. 05, 2026, pp. . doi:https://doi.org/10.55041/ijsmt.v2i5.592.
GY, Devika. "Virtual Touch System using Mediapipe and Opencv for Gesture-Based Human-Computer Interaction." International Journal of Science, Strategic Management and Technology 02, no. 05 (2026). https://doi.org/https://doi.org/10.55041/ijsmt.v2i5.592.
[2] S. Mitra and T. Acharya, “Gesture Recognition: A Survey,” IEEE Transactions on Systems, Man, and Cybernetics, 2007.
[3] G. Bradski, “The OpenCV Library,” Dr. Dobb’s Journal of Software Tools, 2000.
[4] Google, “MediaPipe Hands: On-device Real-time Hand Tracking,” 2023.
[5] P. Patel and K. Mehta, “Touchless Virtual Interface System Using Computer Vision,” International Journal of Computer Applications, 2022.
[6] A. Chaudhary, J. L. Raheja, K. Das, and A. Raheja, “A Survey on Hand Gesture Recognition in Context of Soft Computing,” Artificial Intelligence Review, 2013.
[7] V. Kanhangad and A. Kumar, “Hand Gesture Recognition for Human Computer Interaction,” IEEE Conference, 2014.
[8] N. Otsu, “A Threshold Selection Method from Gray-Level Histograms,” IEEE Transactions on Systems, Man, and Cybernetics, 1979.
[9] D. J. Sturman and D. Zeltzer, “A Survey of Glove-Based Input,” IEEE Computer Graphics and Applications, 1994.
[10] T. Pavlovic, R. Sharma, and T. Huang, “Visual Interpretation of Hand Gestures for Human-Computer Interaction,” IEEE Transactions, 1997.