-
-
Insight!
-
Two Friends Talking!
-
Video Channel Code :)
Inspiration
Our inspiration behind the project was to challenge ourselves to think beyond the box and help people who are impaired by connecting human sense with haptic technologies.
What it does
Insight is a video chat mobile application that allows for the visually impaired to detect facial expressions and descriptions from the video stream of the opposite user.
How I built it
We developed a machine learning algorithm with Open CV and implemented the frames for the video call to be collected through the algorithm to give instantaneous feedback towards the impaired user.
Challenges I ran into
The major challenge in which we had we setting-up the API system for the video call. As there was many difficulties designing the channel system for users to join calls.
Accomplishments that I'm proud of
We were able to complete the video call portion of the application and develop a solid system for user interaction.
What I learned
I learned a lot about machine learning in OpenCV and API development in Twilio.
What's next for Insight
We will like to implement this application into real world objects making the program more practical for use beyond the phone device.
Log in or sign up for Devpost to join the conversation.