QuackGPT

Inspiration

Have you ever spent an hour fruitlessly trying to fix some elusive error in your code, call a coworker over for some help and then instantly spot the issue when explaining to them? There's a term for this - Rubber Duck Debugging.

But sometimes you do actually need someone who can point out the issue you've become blind to. This normally requires finding a human. That sounds like a pain, surely we can do better?

Introducing QuackGPT - a rubber duck that can listen to your woes and speak to you.

We got this idea just after I got to this hackathon. I sat with someone who was having an issue with their React code, they explained the issue they were having and then fixed it with no input from me.

What it does

QuackGPT is a rubber duck that can listen to your woes and speak to you.

How we built it

We stream audio from a microphone hidden inside the duck to a backend. We then process this audio using OpenAI's realtime mode, preprocessing, and Whisper for audio transcription. We then stream the audio back to a speaker inside the duck.

Challenges we ran into

• Latency of audio models
• Finding a rubber duck in cambridge on a few hours notice
• Fitting the electronics into the duck

Built With

• bluetooth
• javascript
• openai
• react