AR Hand Interaction with Computer Vision

An interactive augmented reality system that uses computer vision to detect and track hand movements in real time. The system animates a virtual hand that mirrors the user’s gestures, allowing intuitive manipulation of virtual objects within AR environments.

This creates a natural interaction layer between the user and digital content without requiring physical controllers.

Features:
- Real-time hand tracking using computer vision
- Animated virtual hand mirroring user gestures
- Gesture-based interaction with AR objects
- Object manipulation (grab, move, rotate) in AR space
- Smooth integration between camera input and AR scene
- Mobile-optimized performance for Android devices

Technologies Used
- Unity
- Computer Vision (MediaPipe)
- AR Foundation
- Android platform deployment
- Real-time tracking and animation system

Purpose:
Designed to explore natural human–computer interaction by combining computer vision and augmented reality. The goal is to enable intuitive, controller-free manipulation of virtual objects for applications in education, training, and interactive experiences.