Text to Chess

Inspiration

I can't play chess so any help I can get, I need. Chess.com doesn't have this feature so this would improve accessibility quite a bit for sight impaired users

What it does

At the start of your move, you tell the computer what move you want to make using your voice, for example, d3 do d4. Deepgram will convert this to text, and the program turns this into a chess move for Chess.com using Selenium.

How we built it

Python, Selenium, DEEPGRAM,

Challenges we ran into

Websockets for real time language processing, so I cheated a little bit. Unfamiliar with selenium. Asynchronous methods. Chess.com not having unique IDs for its web elements.

Accomplishments that we're proud of

Using DEEPGRAM and combining it with other tech I wasn't totally comfortable with to make something sort of functional

What we learned

Real time audio streaming is not straightforward. Selenium is a gift from the gods.

What's next for Text to Chess

MUCH more error prevention, mainly asynchronous and dealing with potential deepgram innaccuracy. Making it totally hands free using websockets. Maybe turning it into a browser extension for Chess.com

Built With

• deepgram
• python
• selenium