CSTAR developed a head-mounted mouse so surgeons could point at a screen without using their hands. This inspired us to make a more general-use device with a focus on recognizing gestures.

What it does

Provides input to a computer based on head gestures.

How we built it

We used Arduino to take input from a gyroscope and send it to a python shell. From the python shell, we had to parse the raw data from the gyroscope into information that could be implemented within a computer. From this point, we researched web scraping and manipulation, and found that Python has a library called selenium used the manipulate a websites DOM. We then proceded to genereate an algorithm to identify different gestures, to provide intuitive means of controling a computer. Finaly we built a working prototype of our concept which is able to wirelessly communicate to any computer through Bluetooth.

Challenges we ran into

A challenge we faced was correcting for errors within the gyroscope. Sometimes it would send unusual values which could be misinterpreted as a gesture. Another difficulty was finding a good way to communicate with a browser using Python. We originally tried using Node.js before switching to Selenium

Accomplishments that we're proud of

We were able to wirelessly control video playback with just the head-mounted device.

What we learned

We learned about socket programming using Python. We also learned about Serial communication with BlueTooth.

What's next for A Thinking Cap

Currently, A Thinking Cap is a rough prototype with some implementations of input. The next steps include a sturdy and polished-looking design, as well as expanded input

Built With

Share this project: