-
-
first page
-
sign in/ sign up page
-
a page containing healthy mindset ways
-
recording session
-
processing
-
key insights
-
-
logout
-
page after logout
🪞 Project Story
🩷 Inspiration
In today’s fast-paced and emotionally demanding world, people often struggle to articulate their feelings. Ally was inspired by the idea that everyone deserves a moment of clarity,a chance to be heard, understood, and supported. We envisioned an emotionally intelligent companion that listens without judgment and helps users turn raw thoughts into positivity and growth.
🎧 What It Does
Ally is an AI-powered Voice2Mood journaling companion that transforms voice reflections into structured emotional insights. Users simply speak their thoughts aloud, and Ally intelligently:
Transcribes the spoken words to text.
Analyzes emotional tone and sentiment.
Summarizes reflections into concise insights.
Rewrites them into positive, balanced journal entries.
Adds personalized affirmations to promote mindfulness and well-being.
All processing is handled in English, offering an intuitive, voice-first journaling experience.
💻 How We Built It
⚙️ Frontend & Framework
Developed with React + TypeScript for scalability and smooth performance.
Implemented navigation using React Router DOM with clear user flow:
/ → Splash screen with “Ally” in cursive typography.
/auth → Login/Signup page (Name, Mobile, Email).
/wellness → Educational section promoting mental wellness habits.
/journal → Core functionality page (Voice journaling and emotional analysis).
- → Custom 404 Not Found page.
🌐 Data Management & UI
Used React Query (@tanstack/react-query) for handling Gemini API requests and caching efficiently.
Integrated TooltipProvider, Toaster, and Sonner for interactive UI feedback.
Styled with a baby pink color palette accented by neon icons, creating a calm, aesthetic, and emotionally friendly environment.
🧠 Gemini API Integration
The core intelligence of Ally is powered by Google’s Gemini API Suite, enabling audio understanding and emotional text generation:
🎙️ Prompt API: Converts voice input into text and detects emotional tone.
💡 Summarizer API: Extracts key thoughts from spoken reflections.
✍️ Rewriter API: Converts raw or negative thoughts into positive reflections.
🪶 Writer API: Generates meaningful affirmations based on emotional context.
🔍 Proofreader API: Refines journal entries for clarity and correctness.
(The Translator API was excluded since the current version operates solely in English.)
🚧 Challenges We Ran Into
Ensuring high transcription accuracy while maintaining real-time responsiveness.
Managing sequential Gemini API responses (Prompt → Summarizer → Rewriter → Writer → Proofreader) with minimal latency.
Designing a UI that promotes emotional comfort and psychological safety without overloading the user.
Handling varied tone, background noise, and user expression during voice input.
🏆 Accomplishments That We’re Proud Of
Developed a fully voice-based emotional journaling system using only frontend technologies.
Successfully integrated multiple Gemini APIs to simulate empathetic understanding.
Designed a visually soothing and user-centric interface that aligns with the theme of mindfulness.
Showcased how AI can contribute meaningfully to emotional wellness and self-reflection.
📚 What We Learned
The power of multimodal AI in understanding and processing human emotions.
How to chain and orchestrate multiple AI APIs effectively in a lightweight web environment.
The significance of UX design in mental health tools, focusing on calm colors and emotional safety.
How AI can move beyond automation to empathy and self-growth assistance.
🌱What’s Next for Ally - Your Voice2Mood Companion
The journey of Ally doesn’t end here. We plan to expand its emotional intelligence and reach through upcoming enhancements:
🌤️ Personalized Mood Dashboard: Track daily emotional patterns, progress, and wellness trends visually.
🧘 Mindful Recommendations: Suggest meditation, breathing, or journaling prompts tailored to user moods.
🌍 Multilingual Support: Introduce the Gemini Translator API to allow journaling in multiple languages.
🔒 Cloud Journaling & Data Security: Enable secure user profiles for saving and revisiting emotional growth over time.
💬 AI Companion Mode: Let users engage in brief supportive conversations with Ally, powered by Gemini’s multimodal understanding.
Through these upgrades, Ally aims to become not just a journaling tool, but a trusted emotional ally for everyday reflection and growth.
Log in or sign up for Devpost to join the conversation.