Inspiration
Privacy is a rare commodity in today's tech field, and it will be rarer in the future. Our project, Butler is made so that people who do value their data privacy also have access to a home assistant capable of many things products like Alexa and Google Home have.
What it does
It runs python scripts on voice command, capable of doing anything python can. It currently is capable of turning on Philips hue light builds and turning on computers using wake on lan.
How we built it
We used a Python library to convert speech to text, and then used built-in python functions to run python scripts when the program heard a given prompt from the user.
Challenges we ran into
The speech-to-text was hard to process, and sometimes slow, so optimizations needed to be made for a good experience. We ran into many bugs with getting the scripts to run on voice commands, including but not limited to dynamic paths with Python, API posting issues, and optimization problems.
Accomplishments that we're proud of
The speech-to-text is fast and responsive, and it is able to run Python scripts that can affect separate real-world objects is our proudest accomplishments.
What we learned
We learned how to work with Cuda, Pytorch, and Python backends, and how to connect it with JavaScript APIs and Front-ends
What's next for Butler
Integration with Home Assistant, to further expand its capabilities to be able to control thermostats, garage doors, cameras, etc. User login functionality
Log in or sign up for Devpost to join the conversation.