🏀 CourtVision

3D AI Playback for Athletes, Trainers & Analysts — Built with Gaussian Splatting

Thumbnail


🚨 The Problem

Athletes watch film. But the camera lies. It’s flat. It’s fixed. It misses the details that actually matter.

You can’t see your shoulder angle. Your foot placement. The hesitation before the shot. You know something felt off—but you can’t pinpoint what.


💡 Our Solution: CourtVision

CourtVision turns standard game footage into a fully interactive 3D replay using Gaussian Splatting. You don’t just watch the play — you step back into it. Then you ask the system what could’ve gone better.

“What if I stepped left before the screen?” “Was my posture clean on that jumper?” “Why did I get beat on that cut?”

You can now see the difference — not just imagine it.


🧠 What It Does

🧍 Step Into Your Play

  • Converts 2D game clips into a time-accurate 3D Gaussian splat
  • Lets you rotate, zoom, and slow down your own movements
  • View from first-person, third-person, or anywhere in between

🎙️ Ask the CourtBot

  • Voice-controlled breakdowns of mechanics and movement
  • Ask questions like:

    • “Was my back straight on that drive?”
    • “Was I off-balance on that shot?”
  • It doesn’t just answer — it justifies:

“Weight on back foot + early jump = short release”


🛠️ How We Built It

  • Video Gaussians – Reconstruct 3D scenes from 2D footage, with time-consistent splats
  • Multimodal LLM – Interprets your posture, intent, and motion frame by frame
  • Vapi Voice API – Enables natural, real-time Q&A about form, decision-making, and body control

🎯 Use Cases

  • 🧠 Skill Review – Study what you did, not what the camera captured
  • 🏋️ Posture & Form – Catch rounded backs, bent knees, off-center landings
  • 📈 Gameplay Decisions – Identify better movement options (“Should’ve cut baseline”)
  • 🎓 Trainer Feedback – Remote coaching with shared 3D walkthroughs

📊 Performance Gains

Before CourtVision With CourtVision
Static overhead film Full 3D movement replay
Guesswork on body alignment Visual breakdown of joints and motion
No feedback loop Voice-led self-review & tactical correction

🔮 What’s Next

  • 🧑‍🤝‍🧑 Shared VR film sessions with teammates
  • 📊 Automated body tracking and stat overlays
  • 🗣️ Trainer/athlete voice conversations mid-review
  • 🧠 "What if" simulation tools to test alternate decisions

💬 Designed for Athletes

  • Desktop-friendly, VR-ready, and voice-first
  • No buttons. No menus. Just talk to the play.
  • It listens. It shows. It explains.

With CourtVision—you can. The film room isn’t flat anymore. It’s intelligent. It’s immersive. It talks back.


Built With

Share this project:

Updates