Yap the North

Inspiration

i think the idea kind of just popped in our heads

What it does

Yap the North is a game where you have to speedrun getting 3 other teammates! The twist is that you have to actually speak to the characters, through your computer audio. The characters all have unique personalities and different specifications for whether they'll join your team or not, and will respond differently, depending on what you say.

How we built it

Backend

Each character is a custom prompt-engineered LLM with conversation history. To determine whether or not they wanted to join your team, we run each response through a secondary LLM and generate a value between 0-1.

Frontend

The interface is a React website built with Vite. It records audio and sends the Blobs to the backend, which then returns the responses from the different LLMs.

Challenges we ran into

• be us
• make the main game in godot but start with making the backend separate, with intention of integrating both at a later time
• find out that getting audio drivers in godot is a complete pain 8 hours before submission
• spend 4 hours trying to get it working
• there are approx 5 hours of hacking time left now
• give up and scrape all godot stuff, moving the entire game to web
• redo all art assets from scratch
• yay it works now i guess

Accomplishments that we're proud of

This project was a ton of firsts for us, as we:

• Made our first game (ever!)
• Designed awesome characters with LLMs
• Made our first full-stack web application (also ever!)

also proud that we persevered through having to remake the game with a completely different stack. at 5am.

What we learned

game dev is hard.

What's next

sleep, probably.

Built With

• node.js
• openai
• react
• vite
• whisper