An AI-powered gaze tracking system using MediaPipe and OpenCV to translate iris movement into directional commands for assistive robotics
This is my first major Computer Science project. It uses AI-driven computer vision to track a user's iris and translate eye movement into directional commands (LEFT, RIGHT, UP, DOWN).
Designed as the "Brain" for assistive technology, this software allows individuals with limited mobility to control a robot or a computer interface using only their eyes.
- MediaPipe Face Mesh: Detects 468 facial landmarks.
- Iris Refinement: Specifically targets Landmark 468 (the pupil center).
- Gaze Ratio Math: Calculates the relative position of the iris between the eye corners and eyelids.
- Logic Thresholds: Translates these ratios into commands with a "deadzone" to prevent accidental movement.
- Python 3.10
- OpenCV (Computer Vision)
- MediaPipe (AI/Machine Learning)
- NumPy (Mathematical calculations