ABSTRACT
The AI-Enhanced Gesture-ControlledAir Mouse using ESP32 is an advanced IoT-based Human-Computer Interaction (HCI) system designed to eliminate the physical constraints of traditional input devices. Standard computer mice and touchpads are limited by their requirement forflat surfaces and mechanical contact, which can lead to ergonomicstrain and present significant barriers for users with limited mobility or those working in specialized environments, such as sterile medical theaters.
This project addresses these limitations by integrating an ESP32 microcontroller with an MPU6050 6-axis motion sensor to capture real-time hand orientation data, including Pitch, Roll, and Yaw. To achieve professional-grade precision and responsiveness, the system utilizes software-based intelligence, incorporating filtering algorithms such as Kalman or Complementary filters.These algorithms are critical for mitigating high-frequency noise and "gyroscope drift," ensuring the cursor remains stable and accurate during use.
The device functions as a native Bluetooth Low Energy (BLE) Human Interface Device (HID), allowing it to be recognized by various operating systems as a standard wireless mouse without the need for external driver installation. By mapping natural hand tilts to cursorcoordinatesandspecificgesturestoclickingandscrollingevents,thisprojectprovides a versatile, ergonomic, and touch-free interface suitable for educators, medical professionals, and individuals with physical disabilities.
Keywords: ESP32, MPU6050, Gesture Control, AI Filtering, Bluetooth HID, IoT, Human- Computer Interaction.
