HeartBridgeAI โ€“ The Intelligent Bridge to Family Connection

Track: Healthcare


๐ŸŒŸ Inspiration

Our project was inspired by personal experiences and research on mental health and family well-being:

  • One of our teammates grew up with a single parent, experiencing emotional challenges.
  • As international students, we often face long-distance relationships with our parents, which can impact mental well-being.
  • Research and surveys highlight the mental health challenges faced by parents and teens:
  • About two-thirds (66%) felt the demands of parenthood sometimes or frequently feel isolating and lonely.
  • About 62% feel burned out by their responsibilities as a parent.
  • Nearly 2 in 5 (38%) feel they have no one to support them in their parenting role.
  • Nearly 4 in 5 (79%) would value a way to connect with other parents outside of work and home.

Social support is also lacking for many U.S. teens. Only 58.5% of teens always or usually receive the social and emotional support they need (CDC, 2024).

These insights highlight a critical need for AI-powered tools that support mental health, emotional well-being, and family connection, which is the foundation of HeartBridgeAI.


๐Ÿ’ป What We Built

HeartBridgeAI focuses on AI agents, event suggestions, and a web app, with a strong emphasis on mental health and emotional support.

1. AI Agent for Emotional Well-Being

  • Handles voice and text interactions for parents and children.
  • Voice powered by Eleven Labs API for natural, empathetic speech.
  • Uses Grok AI to understand context, intent, and emotional content.
  • Integrates with Google Gemini to detect severity and mood from childrenโ€™s messages, notifying parents of potential mental health concerns while maintaining privacy.
  • Multi-agent system ensures context-aware support and timely guidance for mental well-being.

2. Event Suggestions for Positive Engagement

  • Collects interests and preferences from children through the AI agent.
  • Uses Amazon Nova SDK to suggest activities, classes, or sports that promote mental and physical health.
  • Integrates with Google Calendar API to schedule family activities that reduce stress and encourage bonding.
  • Provides personalized recommendations to enhance emotional health and strengthen parent-child relationships.

3. Web App for Monitoring and Support

  • Interactive dashboard displays AI notifications, child mood summaries, and suggested activities.
  • Family Memories Page reinforces positive memories and emotional connection.
  • Family tree visualization supports understanding of family relationships and emotional dynamics.
  • Enables seamless interaction with the AI agent via voice or text, fostering mental well-being.

๐Ÿง  Challenges

  1. Database & Emotional Data Management
  • Securely storing and managing family relationships, emotional states, and mood data while maintaining privacy was challenging.
  1. Multi-Agent Coordination for Mental Health Support
  • Coordinating multiple AI agents to respond empathetically, provide guidance, and maintain emotional context required careful design.
  1. Mood Detection and Privacy
  • Detecting nuanced emotions in text and voice input using Gemini API while protecting child privacy was technically complex.
  1. Activity Recommendations for Health
  • Suggesting activities that not only match preferences but also positively impact mental health and family engagement required careful integration of event discovery and scheduling.

๐Ÿ“ Lessons Learned

  • AI can provide meaningful emotional and mental health support in family settings.
  • Multi-agent systems can enhance responsiveness and empathy but require careful orchestration.
  • Privacy and trust are essential when handling sensitive emotional information.
  • Combining voice, text, and visual interfaces supports engagement and mental well-being.

โšก Tech Stack

Layer Tools & APIs
AI Agent (Voice & Text) Grok AI, Eleven Labs API
Mood & Severity Analysis Google Gemini API
Event Discovery Amazon Nova SDK
Calendar Integration Google Calendar API
Database Firebase / DynamoDB
Frontend React.js / Web App

๐Ÿš€ Future Directions

  • Mobile app version for on-the-go family engagement and mental health support.
  • AI-generated suggestions for activities and conversations based on mood and emotional trends.
  • Integration with mental health resources and family counseling tools for proactive support.

Built With

Share this project:

Updates