Apex Jevends

Inspiration

We wanted to build some cool AI agents with Jev, a new type of model that acts as a decision model for software, as opposed to outputting text. It makes probabilistic choices given several options (e.g., push, retreat, shoot, hide, flank, etc.).

Because of this, it's able to make decisions much more quickly than traditional LLMs (and thus allows us to do some pretty cool stuff, like create a video game where you command a real-time team of AI agents)!

What it does

Apex Jevends is a multiplayer first-person shooter where you command your teammates—5 Jev-powered agents— with just your voice and hand gestures.

You can switch between a map mode and a first-person mode, giving your team comms on how to claim site and plant the spike. You control with voice commands, and point your team where to go, armed with guns, grenades, smokes, flashes, knives, and spikes. Choose to play against either easy bots, stronger bots with an OpenAI-powered brain, or against your friends in a multiplayer room.

No more bum teammates to blame your 1v9 on. Everything is up to you and your Jev underlings :)

How we built it

We built this with Jev for the brains of the AI agents, OpenAI models for the stronger bots, Deepgram for audio transcription, and MediaPipe for handling gestures. We host multiplayer games using Cloudflare Tunnels. Our graphics are handled with Three.js.

Challenges we ran into

The Jev models get distracted at times and forget the main mission, so it's almost like you're wrangling up some unruly teammates. But some are more obedient and others, and sometimes their mistakes are what make them endearing. By the end of the game, you might find yourself being emotionally bonded to "Bravo" or "Foxtrot."

Accomplishments that we're proud of

We made a really fun game, while making something really cool! We combined many moving parts and tested it with a number of people (our poor roommates, who came out as we were yelling at 3am) who really enjoyed it. It's fun to control. and the constraints honestly make the game even more fun. We found ourselves playtesting the game often and we hope people who play the game enjoy it just as much.