Inspiration
We wanted to learn something new and the Frames gave us the perfect opportunity. So, we took advantage of the sensors inside to create an accessibility device so users can use the Frames as a cursor on their computer.
What it does
Our project allows you to control a cursor by moving your head around looking at a screen
How we built it
Using Bose API through Unity, we export the sensor data, and feed it straight into Python where we perform geometry to determine the mouses location, and we use algorithms to smooth the mouse movement even though the data is noisy.
Challenges we ran into
Exporting data from Unity and onto the computer to use with python was really difficult, so that was a big hurdle.
Accomplishments that we're proud of
We were using Python which not everyone on our team was familiar with, so collaborating and keeping everyone on the same page was really important to us. This means that everyone on the team is familiar with the project and understands it to the core.
What we learned
Python! Unity! Mouse smoothing algorithms, and a LOT about the Bose Frames and their sensors and how they work.
Log in or sign up for Devpost to join the conversation.