Inspiration

Many people suffer from disease such as parkinson, arthritis and other physical ailments that prevent them from doing basic tasks as simple as writing letters.

What it does

Drawl Assist allows a user to dictate text to it and have it reproduce your speech into your own natural hand writing, or any other font.

How we built it

The break down for this projected started with integrating Google's talk to text API to allow real time voice transcribing to be passed on to be printed. Next we creating our own font in G-code, a machine interpretable language, that would still look natural however require very few brushstrokes to maintain a sufficient speed. From here on we took the text received from the TTT applet and converted into sentences that auto complies the G-code base on the general case functions we wrote. This is then passed directly into the machines interpreter and Each operation is executed by the CNC drawling machine.

Challenges we ran into

We had Some troubles getting the G-code to pass directly into the machine's interpreter over a COM port. There also were some challenges Getting the talk to text API to refresh and feed live.

Accomplishments that we're proud of

The Drawl assist can print out in natural latin writing what is being said out loud in real time with the user. This was our primary objective.

What we learned

Machine G-Code is very difficult to write because it is not in a natural readable format due to it being a semi-pre compiled language.

What's next for Drawl Assist

Add feature to allow fast training of a new handwriting/ font through machine learning.

Built With

Share this project:

Updates