Bullet Brain

Inspiration

We wanted to find a fun and innovative way to learn in an engaging way with friends when hanging out or during a studying session.

What it does

We designed a game that uses your notes to test you on the material, paraphrased by Cohere. The turret then spins around and randomly selects a player to answer a question. If selected, you must answer the question and if answered incorrectly, determined by the LLM, you are shot by the turret. The game continues forever until decided by the players.

How we built it

We used React and Node.js to take in pdf files containing notes and using Cohere to interpret the stringified PDF and create questions and answers out of them. We then used a webserver to connect to the ESP32 to send and receive signals to and from the turret to determine when to move and shoot. The camera uses computer vision to identify faces and turn around the table, stopping at a random face detected. Servos were used to rotate the motor and fire bullets at the target. Cohere was also used to determine whether your response was accurate or not using embeddings.

Challenges we ran into

We had issues with amplifying the voltage to a pair of DC motors to shoot the bullet with a high enough speed and tried to use MOSFETs to solve the issue but ended up using a mechanical switch instead. Additionally, we had issues using our camera circuit component but was incompatible with our system so we found an alternative by using one of our phones to act as the camera instead. There were also times where the voice recognition would not pick up on our voice which was fixed by making it our music more quiet and optimizing the efficiency of our program.

Accomplishments that we're proud of

Completing the project on time

What we learned

A lot of things don't go exactly how you want it to go so always have a backup solution and design a project to build up instead of downgrading the original design

What's next for Bullet Brain

In the future, we want to use image recognition to designate certain questions to their respective person based on the notes they submitted. We also want to design a better turret with a wider range of motion and ability to shoot, making the game more fun and exciting.