Chatter

• 

  Chatter is an app to increase inclusivity for deaf and hard of hearing people in the gaming community

• 

  It is currently difficult to communicate while playing a game in real time for deaf players

• 

  They can read speech-to-text transcriptions in real time, as the other users are speaking

• 

  The chat room

• 

  Sentiment analysis summarizes the sentiment of a message, showing based on color - green is positive

• 

  Neutral sentiment

• 

  Negative sentiment

Inspiration

Many games involve collaboration and group communication, such as Valorant or League of Legends, and players often voice chat or call each other while playing the game. However, hard of hearing players might not be able to hear or understand other players while voice calling. When searching for a challenge to tackle, I found that while there exist applications to transcribe speech to text, you have to record audio, process and upload it to a server, and then get a transcription. For users that want to communicate with others in real time, perhaps while simultaneously playing a game, there were very few resources.

What it does

This app is aimed to increase accessibility and communication, specifically for deaf and hard of hearing esports players. More importantly, Chatter facilitates conversations between players in real-time.

This app works as a chat room that can hold multiple people, and you can communicate with each other easily and in real time. If a player is hard of hearing, they can read what the other person is saying as they are speaking. There is also an option to type in something, which will be spoken aloud so that the other person can hear what they are saying without looking away from their game. Chatter makes communication faster, simpler, and easier.

How we built it

I built it with React, Javascript, Node.js, HTML, and CSS. I also incorporated speech recognition and sentiment analysis APIs.

Challenges we ran into

I am not familiar with building an app in React and using APIs, so I was proud that I could make a well functioning product in a short time.

Accomplishments that we're proud of

Making an app to make gaming and communicating more inclusive for deaf/hard of hearing people!

What we learned

Using React

What's next for Chatter

Using better speech recognition models

Built With

• css
• html
• javascript
• node.js
• react