WaveGPT

Inspiration

This project exemplifies the positive and meaningful impact that AI technologies can have on people's lives. The convergence of AI technologies with American Sign Language (ASL) immediately struck me as a highly fruitful endeavor. ASL, a beautiful and powerful language, sheds a brilliant light on Deaf Culture and deserves recognition and appreciation. However, I am acutely aware that Deaf individuals represent a linguistic and cultural minority in the world, and consequently, many people are unfamiliar with ASL. Therefore, I envisioned leveraging the power of AI to facilitate ASL learning, thereby increasing awareness of ASL and Deaf culture. Specifically, I am particularly interested in exploring how ChatGPT can be utilized to develop ASL proficiency and foster ASL awareness, given its universal availability and low barriers to entry.

What it does

WaveGPT is an integrated plugin for ChatGPT that extends its capabilities, serving as a tool for learning and practicing ASL while also providing insights into Deaf culture. Similar to ChatGPT, WaveGPT offers a personalized and adaptive learning experience that caters to individual user needs and preferences.

How we built it

Visual Studio Code served as our development platform for HTML, CSS, and React code. In the future, our plan involves integrating the ChatGPT API into our React application to execute the WaveGPT program.

Challenges we ran into

I encountered difficulties in finding suitable methods to display resource videos compatible with our codebase. I attempted embedding videos, but they only appeared as empty black screens within WaveGPT. Despite confirming the correct path, the videos failed to display properly. Another significant challenge was devising a mechanism for WaveGPT to accurately detect and provide feedback on users' sign language accuracy.

Accomplishments that we're proud of

The entire process was incredibly enjoyable, and I believe our Figma design has been faithfully translated into our codebase.

What we learned

Through this project, I gained insights into how ChatGPT technology can raise awareness of ASL and Deaf Culture while educating individuals. Additionally, I learned valuable lessons on translating ideas into design and code. Merging HTML, CSS, and React to execute our vision in a well-crafted and visually appealing manner proved to be an enlightening experience for all involved. Furthermore, I acquired knowledge on incorporating ASL video datasets and camera views into our code. Leveraging the diverse skills of our team members effectively for collaboration was another valuable lesson I learned. Given the complexity and scale of this project, future endeavors will undoubtedly involve continuous learning.

What's next for WaveGPT

WaveGPT focuses on American Sign Language (ASL). However, there is potential to extend its capabilities to include other sign languages from around the world. This would broaden its user base and make sign language learning more accessible and inclusive

Built With

• css
• figma
• githubrepo
• html
• javascript
• jslibrary
• react