Inspiration
Last year I started therapy and I noticed that once a week wasn't cutting it. A week is a long time! A lot happens and I could never remember all of the important details to discuss in my next session. There were so many times I left my therapy sessions feeling like I wasn't making the most out of the opportunity. I started to do cognitive behavioural therapy on the side, using a popular self reflection app I found on the app store. I remember thinking "Wow! Wouldn't it be cool if my therapist could see my logs? Better yet, could I automate the analysis of my logs and see if I could pull out any insights?". I brought the idea to my therapist and he loved it! We've talk about it all the time and now my team was able to create an MVP! This is the inspiration behind BeYou, helping you unlock the power of self reflection.
What it does
BeYou is a powerful video journaling application designed to help users track their emotional journey in detail. We use machine learning to automatically analyze the audio, visual, and thematic content of a user's journal entries. By doing so, we can better understand their emotional changes over time. If users wish to share this information with their therapist, the app provides an interactive dashboard that displays emotional findings. This feature allows therapists to view and provide feedback on their patient's emotional state regularly, fostering more personalized treatment.
How we built it
To build BeYou, we combined different notable technologies and frameworks. We used a React front-end and a Python back-end to create a seamless user experience. Our machine learning models, developed in TensorFlow, analyze video inputs that we process using OpenCV. We operated our server using Flask, ensuring stability and reliability. To store emotional insights and previous journal data securely and efficiently, we chose MongoDB. By selecting these technologies, we created an application that is both powerful and easy to use.
Challenges we ran into
During the development of BeYou, we encountered some obstacles that required creative solutions. We experienced difficulties with video transfer between the front-end and back-end, which we resolved by optimizing our network architecture. Additionally, our complex three-level analysis of video inputs, which provides a comprehensive understanding of the user's emotional state, resulted in slower processing times. As a result, we spent a significant amount of time fine-tuning our algorithms to enhance the speed and accuracy of our analysis. Despite these challenges, we successfully overcame them and created a robust application that provides valuable insights into the user's emotional well-being.
Accomplishments that we're proud of
As a team, we are incredibly proud of developing BeYou, an end-to-end application that captures user input on the front-end and conducts comprehensive analysis on the back-end using machine learning and Python/Flask. This application required intense collaboration and dedication, and we are thrilled to have overcome various technical challenges along the way. Our team's ability to work cohesively in a fast-paced environment allowed us to learn more about each other's strengths and areas of improvement, which has been invaluable for our future projects.
What we learned
Throughout the development of BeYou, we were excited to tackle the challenges that many patients and individuals typically face with cognitive behavioural therapy (CBT). By understanding these challenges and leveraging our technical expertise, we aimed to create an application that could provide valuable insights and support. We also gained valuable experience in incorporating various open-source machine learning models, enabling us to provide high-quality feedback on the emotional content of video journals. This project allowed us to deepen our understanding of the intersection between mental health and technology, and we are proud of the impact that BeYou can have on people's lives.
What's next for BeYou
Looking forward, we have ambitious plans for BeYou's continued development. We aim to integrate conversational AI to guide users towards more positive reflections during their journaling experience, enhancing the therapeutic benefits of the app. Additionally, we want to create a seamless communication system that enables asynchronous coaching, providing users with support and guidance whenever they need it. By implementing these features, we hope to make BeYou even more effective in helping people improve their emotional well-being.
Log in or sign up for Devpost to join the conversation.