Counsel Through Code / Marriage Counselor

Main Screen
Identifying Needs
Emotional Recognition

Inspiration

Everyday, Tristrum and I witnessed people in our lives being hurt by those that they hold most dearly. We set out to create a program to repair and nurture their relationships.

What it does

Counsel Through Code asks relationship partners various questions and listens to their responses. Using these responses Counsel Through Code can identify relationship weak and strong points, each partner's needs in the relationship and tries to keep the conversation going by focusing questions on topic's the partners have mentioned.

How we built it

First, we record the audio using built-in Java classes. Next we send this audio to the Houndify API and get back a text transcription. We send this text to IBM-Watson which gives back relationship data analysis on both responses and the conversation as a whole.

Challenges we ran into

Matching the bit rate of our recorded audio to that of the Houndify API was a struggle. Also, parsing JSON into Java was a huge pain. It was so hard to keep track of JSON Arrays that we had to paste the output into google docs and highlight through it.

Accomplishments that we're proud of

Both of us are freshmen computer science students at Penn. This is one of our first hackathons, so we are mostly proud of ourselves for making it through this 48 hour coding marathon. Getting the multiple APIs working, as well as the graphics and user interface, was definitely an added bonus.

What we learned

We learned a ton about Houndify API and programming in general. Before this hackathon, I barely knew how to install a JAR file. We both gained experience with graphics, .wav files, and integrating multiple classes in java.

What's next for Counsel Through Code / Marriage Counselor

The product that we are submitting at this point in time is far from finished. We have the basic framework complete, but we definitely need to polish up the response library and AI. Additionally, IBM Watson has a ton of extra methods for analyzing text that can really improve the level of counseling provided by Counsel Through Code. We look forward to patching up our code and improving our project in the future!