Inspiration
Life is full of boredom and loneliness.. and don't you just want to, toast it up a bit sometimes? Well we here at Toaster-Chan team certainly do, and thats why, well, we built this :)
What it does
Toaster-Chan turns your boring old toaster into a talking, interactive Singaporean Waifu with the latest in Large Language Models and Voice technology. Instead of fiddling around with lame buttons, you can now turn it on with just your voice~~ uwu ~~ and it replies you in Singlish wokay (powered by LLM mmm)
How we built it
idk fam, I just pressed some buttons
but ok for the actual real stuff:
Frontend: ReactJS with Material UI. One button controls the audio recording, and you press it to start talking to toaster-chan. This video then..
Backend: .. is sent to the backend, built in fastapi. The backend would then parse the audio recording with OpenAI's whisper API, and decipher whether the user wants to
- Turn on the toaster (which it would then send a http request to the smart switch that controls the toaster to turn it on)
- Turn it off (same as above but turn off)
- The user said rubbish and it would ignore the command.
Once done, the backend then processes a reply using Eleven Labs and sends it back as an audio file. The audio file will then be played back to the user on the front end and you will see the avatar say it back to you in your favourite cute Singaporean Toaster waifu voice :0
Challenges we ran into
Debugging was a pain.. and so was frontend backend integration but we fixed it ig YAY
Accomplishments that we're proud of
The code works ig
What we learned
A lot... about all the stacks that we implemented, bringing together all the different technologies and especially integrating with the toaster
We also learned that teamwork makes the dream work!
What's next for Toaster-Chan
Idk fam, can we sell this? Has technology went too far? Should we worry for the future of the human population?
Built With
- chatgpt
- docker
- elevenlabs
- fastapi
- iot
- materialui
- nextjs
- openai
- python
- react
- toaster
- typescript
- wifirouter
Log in or sign up for Devpost to join the conversation.