AirDraw XR: Gesture-Based MR Drawing App

Inspiration:-

People draw in the air naturally when explaining ideas. I wanted to transform these invisible gestures into visible, persistent, immersive 3D drawings using only hands — no controllers, no tools. Meta Quest’s passthrough, hand tracking, and spatial computation inspired AirDraw XR.

What It Does:-

AirDraw XR allows users to create mixed-reality drawings with natural hand gestures:

🎨 Draw in mid-air 🖐 Finger tracking → color selection 🤏 Pinch → draw ✋ Palm → erase 📐 Auto shapes (line, circle, triangle) 🧠 AI Outline Cleaner (NEW) 🔍 Surface-Locked Drawing on real walls (NEW) 🪄 Microgesture Toolbar (NEW) 🌐 3D Multi-Layer Volumetric Drawing (NEW) 🕒 Spatial Timeline — swipe to navigate older strokes (NEW) 🖼 Passthrough MR whiteboard mode 👥 Multi-user mode (planned)

Your entire room becomes a creative playground.

How We Built It:-

Prototype (Desktop)

MediaPipe hand tracking

Gesture recognition (pinch, finger count, hand poses)

Shape detection

Drawing engine with smoothing + eraser

Modular Python architecture for portability

XR Upgrade (Unity + Meta XR SDK)

Migrated hand tracking to Meta XR v81+

Implemented Passthrough

Implemented Plane Detection