Logo
LoadingScreen
HomeTab-English
Favorites Tab
Accessibility Tab
HomeScreenHindi
About-1
About-2
EmergencyTab
EmergencyTab-Help-Options

SpeakEZ: Empowering the Mute with Voice

An Impactful App that is for the "SOCIAL GOOD and HUMAN INTERACTION"

🌐 United Nations SDGs Achieved

The SpeakEZ project supports the following United Nations Sustainable Development Goals (SDGs):

UN SDG 3 (Good Health and Well-being),
UN SDG 4 (Quality Education),
UN SDG 9 (Industry, Innovation and Infrastructure), and
UN SDG 10 (Reduced Inequalities) by enabling inclusive communication for individuals with speech disabilities through AI-powered assistive technology.

🌟 About the Project

Inspiration

Around 2.5% of the global population has speech or communication disorders. While many assistive tools exist, they are often outdated, expensive, or not tailored to individual needs. Inspired by a hackathon's theme "Social Good & Making Life Easier for the DISABLED People", we set out to build SpeakEZ, A modern, AI-powered communication assistant that makes expression accessible and effortless for the PEOPLE who are VOCALLY DISABLED / SPEECH IMPAIRED

💡 What It Does

SpeakEZ is a web-based communication aid designed for individuals with speech impairments. It allows users to:

User can type their Text and it comes to Life in form of AUDIO/VOICE
Multi Language Support to Empower Local Population
Select pre-generated phrases from intuitive categories.
Use AI suggestions based on context (via Google Gemini).
Customize and favorite frequently used phrases for ease in Daily Operational Tasks
Use the interface independently or with caregiver support.
Emergency Calling Support
FlashLight Triggering Support
SMS SOS Support
Device Vibrations Support

🛠️ How We Built It

Designed an accessible UI/UX using Next.js + Tailwind CSS with Lottie animations for a friendly experience.
Integrated Google Gemini API to generate smart, contextual phrases across categories like “Emotions”, “Needs”, “Health”, etc.
Implemented state management and custom hooks using React for a dynamic experience.
Hosted and deployed on Vercel for fast global access.

🚧 Challenges We Faced

Creating a UX simple enough for accessibility but powerful enough for flexibility.
Balancing real-time AI generation with latency and safety.
Choosing between AI models—initially used Groq SDK, but latency and cost forced us to switch to Gemini.
Ensuring the interface was inclusive and easy to use across different devices.

📈 What We Learned

Accessibility isn't just a feature—it's a mindset that affects every design decision.
AI can truly enhance assistive tech, but only when combined with thoughtful UX.
Community feedback (from teachers and speech therapists) helped us fine-tune our approach to real-world scenarios.

🔧 Built With

Frontend & Framework

Next.js (React-based SSR, SSG)
React (for component-based UI)
TypeScript (for reliable development)

Styling & Animation

Tailwind CSS (utility-first CSS)
Custom CSS (global styles)
Lottie-react (animated splash and logo)
Lucide-react (icon library)
Custom SVGs (for header, emotion icons, etc.)

State & Hooks

React Hooks (useState, useEffect)
Custom Hooks (useFavorites, useConfetti)

APIs & AI

Google Gemini API (for phrase generation)
(Rolled back from Groq due to stability)

Hosting & Environment

Vercel (CI/CD & Hosting)
Environment Variables (.env.local for keys)

🛡️ Countermeasures

Latency in AI response : Pre-fetching common phrases and caching user-favorite responses. Inappropriate AI suggestions Gemini prompts are fine-tuned and filtered; NSFW and offensive terms are blacklisted. Accessibility limitations Tab navigation, readable font sizes, high-contrast mode, and screen reader compatibility were implemented. AI API limits or failure Local fallback to static category templates when AI API is unavailable. User data safety: No personal data is stored. All favorites are stored locally via browser storage (no backend used). Device compatibility: Mobile-first design tested on multiple devices (Chrome, Firefox, Edge, Safari).

🌍 Impact & Future

SpeakEZ aims to give every voice a chance to be heard, especially those who’ve been sidelined due to lack of tech accessibility. Future plans include: