Inspiration
I enjoy watching sports games.... when I'm with good company. All the best sports games are shared with a crowd of people to rejoice in excitement, disappointment, and victory together. I missed having buddies nearby to watch sports games with as much as I did in college, and watching them alone just isn't the same. What if I could watch alongside my favorite players?
What it does
Video player that concurrently loads in rigged animated 3D models of athletes and renders them in a shared space.
How we built it
Built for Apple Vision Pro I created this inside Xcode beta 15 using the visionOS SDK, elevenlabs for the athlete voice generation, Blender to rig and animate the 3D models.
Challenges we ran into
RealityKit and SwiftUI for visionOS is still in Beta so there's hacky things I had to do just to get basic functions like audio, video playing, etc. Rigging the characters proved to be much harder than I anticipated. Surprisingly finding good clean datasets of Lebron James voice for elevenlabs took longer than I anticipated too. And just overspeccing from the beginning with all these visions I wanted to include in the prototype probably caused me to not move as efficiently as I could have, because I was speccing out and envisioning what my ideal spec would look like
Accomplishments that we're proud of
Glad I got the animated rigs working, that was tough. Loading audio into RealityKit + SwiftUI was surprisingly tedious. Glad I got something that can at least start to envision the idea of watching games alongside athletes and start to help people imagine where it could go from there.
What we learned
Learned some rigging skills, learned gotchas inside RealityKit
What's next for SupPlayer
Incorporate state based conversations and reactions, generative branching dialogues, recommendations e.g. "this game is best watched with James Harden," setting attitude / energy level of the athletes so you can choose if the group is more competitive or more laid back that game, actually choose your athlete lol, and I think this could expand to athletes accompanying you while you play a video game they're in too. I'm thinking play 2K but the bench is in yuor living room, so when Steph gets subbed out he is sitting in your living room now and giving feedback as you play the game
Log in or sign up for Devpost to join the conversation.