Inspiration
When all your friends are busy, and you want to play a game and enrich the experience by setting custom goals, that's what leads to creating a gaming buddy. However, it's disappointing that deaf people cannot interact freely with an AI companion that requires live input, so we have added sign language support.
What it does
You can ask questions about the game you play or chat to have fun
How we built it
Gemini Live API + screen/camera stream + mediapipe (for hands detection)
Challenges we ran into
Gemini keeps interrupting itself
Accomplishments that we're proud of
Incorporated Google search about game topics to answer user questions with the Gemini Liva API to answer questions in real time
What we learned
How to use Live API
What's next for GeminiGaming
Creating the Discord bot so all interaction can be done in a group
Log in or sign up for Devpost to join the conversation.