Inspiration

I wanted to make learning fun for kids and adults. Instead of a boring text chat, I wanted a cartoon character you could actually talk to.

What it does

Barky is a "Professor Dog". You speak to him using your microphone, and he responds instantly with a real voice. He Talks: He has a personality, makes dog puns, and reacts to you. He Teaches: If you ask him to explain something, he uses a "Smart Chalkboard" to show you lists, charts, or code snippets. He Reacts: He wags his tail when happy and gets annoyed if you bark at him too much.

How I built it

Google AI Studio: I used Google AI Studio to design the "Professor Barky" persona, test the system instructions, and generate the API keys. Gemini Live API: I used the new Gemini Live API for the real-time audio conversation. It handles the listening and speaking. React: I built the frontend website where the dog lives. Tools: I created a custom tool called updateBoard that allows the AI to draw on the chalkboard when it needs to explain complex topics.

Challenges I faced

Connecting the real-time audio stream from the browser to the AI was tricky. I had to make sure the dog's mouth moved at the exact same time as the audio played so it looked real.

Built With

Share this project:

Updates