Inspiration
We wanted to create an app that would help people who have issues with their hands write text on computers easily
What it does
This tracks a person's nose or any part of the individual's body, and it tracks it to control the mouse. This then writes on our own custom made draw program which directly saves every file that is written, and this is sent to interpreter code we wrote with AI learning in jupyter. This would then analyze the image and figure out what characters were in it, and then this was outputted out as a string value.
How we built it
We used python to create our custom "Paint" program and we used jupyter to create the analyzing and learning program, which had Python as well.
Challenges we ran into
Creating a whole paint program from scratch and we had to understand machine learning to be able to do the artificial intelligence part.
Accomplishments that we're proud of
We actually did everything that we wanted to do including creating a whole new Paint program and learning and successfully implementing deep learning.
What we learned
We learned several machine learning techniques and how to create different aspects of a Paint canvas.
What's next for Hands-Free Text Writer
Try to improve the accuracy of the analysis and see if we can get it out there.
Built With
- jupyter
- python
Log in or sign up for Devpost to join the conversation.