MoodMentor App

MoodMentor: Your AI-Powered Mental Wellness Companion 🌟 Inspiration Mental health is an essential part of overall well-being, yet many people struggle to recognize and express their emotions. Traditional therapy and self-help methods often lack accessibility and real-time engagement. We wanted to build a multi-modal AI-powered companion that helps users express themselves naturally—through speech, text, and images—while receiving meaningful insights into their emotional state.

MoodMentor is designed to bridge the gap between technology and mental wellness, offering an easy-to-use platform for self-reflection and emotional awareness.

💡 What It Does MoodMentor allows users to interact through voice, text, or images to analyze their emotions and receive insightful feedback. Key features include:

🔹 Speech Analysis: Users can talk to MoodMentor, which transcribes their speech and analyzes sentiment. 🔹 Text Analysis: MoodMentor processes written input to detect emotions and mood patterns. 🔹 Image Analysis: By uploading a selfie or using the camera, users can receive AI-based facial emotion analysis. 🔹 Real-Time Feedback: The app provides immediate emotional insights based on Azure AI services.

🛠️ How We Built It We leveraged Azure AI and modern web technologies to create a seamless and interactive chatbot experience:

Tech Stack: Frontend: Angular (for an intuitive chatbot UI)

Backend: Python (Azure Functions for handling AI requests)

APIs Used:

Azure Speech-to-Text: Converts spoken input into text for analysis.

Azure OpenAI & Language Service: Analyzes text sentiment and emotional tone.

Azure Computer Vision: Detects facial expressions and emotions from images.

Database: Azure Cosmos DB (for session data and insights storage)

Deployment: Hosted on Azure Static Web Apps & Azure Functions

🚧 Challenges We Ran Into Latency issues when processing speech in real-time.

Ensuring accurate sentiment detection across different input formats.

UI/UX design to make the chatbot feel natural and engaging.

Fine-tuning AI models to improve emotion detection precision.

Seamless API integration between different Azure AI services.

🎯 Accomplishments That We're Proud Of ✅ Successfully integrated multi-modal AI for speech, text, and image processing. ✅ Built an intuitive Angular-based chatbot UI that enhances user engagement. ✅ Optimized API performance for real-time sentiment analysis and feedback. ✅ Ensured secure and scalable cloud deployment using Azure services. ✅ Created a unique AI companion that makes emotional awareness more accessible.

📚 What We Learned 🔹 The power of multi-modal AI in enhancing user experience. 🔹 Optimizing Azure AI services for real-time interaction. 🔹 Best practices for frontend-backend integration in an AI-driven app. 🔹 Leveraging GitHub Copilot for efficient and maintainable code.

🚀 What's Next for MoodMentor App ✨ Adding personalized mental health recommendations based on analysis results. ✨ Supporting multilingual processing to expand accessibility. ✨ Enhancing privacy and data security for sensitive user inputs. ✨ Introducing integration with mental health professionals and resources.

MoodMentor is just the beginning of a smarter, more empathetic AI companion for mental well-being. 💙

Built With

• angular.js
• azure-api-management
• azure-computer-vision
• azure-content-safety
• azure-cosmos-db
• azure-functions
• azure-language-service
• azure-openai
• azure-speech-to-text
• azure-static-web-apps
• css
• github-actions
• github-copilot
• html
• lucide-icons
• postman
• python
• shadcn/ui
• tailwind-css
• typescript
• vs-code