Speech therapy, while a necessity for many kids who have autism or other speech disorders, costs over $100 per hour. During the course of the Covid 19 pandemic inflation has risen over 15% according to the national department of the treasury. Hence this makes speech therapy very expensive for many families and often can take a hot on the socioeconomic status of families. Seeing this reality, we wanted to create a speech therapy/practice app that will not only help people with speech disorders but can also help ANYONE with speech anxiety. Speech Splendid addresses this by giving valuable semantic and expressional feedback, which can be used to improve speech confidence and performance.
What it does
Our AI-driven speech practice buddy, with optional facial analysis will give you expert level feedback on your speaking and optionally, facial expressions while speaking. Just click record and our algorithm will closely track your speaking for factors such as intonation and emotion and we will also track facial expression through a series of deep neural networks. In a matter of seconds the program will give you a report with recommendations to improve your speaking and facial expressions as soon as you're done!
How we built it
We built our project using Python, Streamlit, machine-learning, transfer-learning, IBM-cloud, VADER, and py-feat.
Challenges we ran into
Some of the challenges we faced were managing memory and figuring out the proppers tools to link our front end to our backend.
Accomplishments that we're proud of
Bridging natural language processing and image detection/analysis to create an app that helps people address such a common problem such as public speaking anxiety.
What's next for SpeechSplendid
Adding practice functionalities to the app, further optimizing memory usage, adding an option for live recordings, and hosting the app on a server.