ConvoKids

User Profile Page
Topic Prompt Page
Eye Contact Report Page

Inspiration

As we barrel down the second year of the pandemic, its become evident that life has not been the same as pre-pandemic times. Children all around the world have been stuck at home and lost precious time to build up their conversation skills with their friends and classmates. To resolve this issue, we present to you ConvoKids, the beginner friendly, intuitive conversation aide that was designed to help elementary school students improve their conversation skills. The end goal in mind is to make a all-inclusive medical tool that can be used by pediatricians and speech therapists, early diagnosis of multiple neurological disorders such as Autism, Alexithymia and Selective mutism is possible due to the nature of the data analyzed.

What it does

The program provides, the user with a conversation prompt and begins recording of audio and video via the webcam/camera of the device. Using multiple APIs and researched information, a intuitive and comprehensive report of how the user did will be displayed. It returns information such as number of times eye-contact was lost, how many conversation pauses there were, was the emotion displayed similar or the same as what was expected for the prompt. After this some suggestions and resources are delivered to further aid the user.

How we built it

We planned out the entire design on a virtual sketchboard form which we based our prototype which was created on Figma, at this point the entire back-end of the program was planned and the architecture was layed out. We started coding using Javascript to access the webcam but due to time constraints and the fact that some of the team was learning it for the first time, we focused more on refining our idea. We also used GCP Firebase Authentication to affirm a safe and reliable login service.

Challenges we ran into

We took on a huge project with major plans that we had assumed we could manage, but the time crunch and sheer mass of new languages and programs we had to learn immediately humbled us. Due to this we narrowed our sights and picked out the most important things from our project that would get our idea out to the masses.

Accomplishments that we're proud of

We are proud of the ingenious concept for our program and its many beneficial uses. As well as how nicely we structured all the APIs together and how smoothly they integrate with our program.

What we learned

we learned about:

The Figma team project environment
Making a cohesive and interactive UX/UI
A lot of different google cloud services
How to thoroughly plan a full stack web development project

What's next for ConvoKids

Our program is mainly marketed to help develop the conversational skills that kids lack experience in due to the pandemic, using the information gained from our program, early diagnosis of multiple neurological disorders such as Autism, Alexithymia and Selective mutism is possible. With this only being the start we hope to branch this and refine its uses into a comprehensive medical aide to Speech therapists and Social workers.