SpeakEasy Homepage - Dark Mode
SpeakEasy Homepage - Light Mode
SpeakEasy Mobile app
How To use Speak Easy
PWA - Notification

SpeakEasy: AI-Powered Accessible Voice Reminders

Inspiration

We were deeply inspired by the daily challenges faced by millions of individuals struggling with cognitive impairments, visual limitations, and technological barriers. Remembering simple daily tasks, such as taking medication or drinking water regularly, can become unnecessarily difficult. We wanted to create an inclusive solution that effortlessly enhances independence and daily productivity, empowering everyone through accessible technology.

What it does

SpeakEasy allows users to create and manage daily reminders using just their voice. Leveraging advanced AI-powered voice recognition and natural language processing, SpeakEasy instantly transforms spoken commands into structured, actionable reminders. Users can set recurring or one-time reminders, receive timely notifications, and interact with a user-friendly, accessible interface optimized for all devices.

How we built it

Frontend: Utilized Next.js 13, React 18, and TypeScript for robust performance and scalability.
Styling & Accessibility: Integrated Tailwind CSS for rapid development, with Radix UI for accessible and interactive UI components.
Voice Recognition & AI: Implemented Hugging Face's Whisper model for accurate and robust speech-to-text conversion, with Web Speech API as an optional browser-based alternative for real-time transcription.
Progressive Web App (PWA): Implemented service workers and web manifests for offline capabilities and seamless installation across devices.
State Management: React Hooks provided efficient and maintainable state management.
Deployment: Deployed swiftly on Vercel for stable and reliable hosting.

Challenges we ran into

Voice recognition accuracy: Handling diverse accents and speech patterns required extensive fine-tuning and fallback solutions.
Offline functionality: Achieving robust offline capability was challenging, particularly regarding voice processing without internet connectivity.
Accessibility considerations: Ensuring the application remained highly accessible, compatible with screen readers, and visually inclusive required significant iterative testing and improvement.

Accomplishments that we're proud of

Seamless Voice Interaction: Achieving intuitive voice-driven reminders that require zero technical knowledge.
Robust Offline Support: Creating an accessible and reliable app experience, even without stable internet.
High Accessibility Standards: Ensuring our design meets rigorous accessibility criteria for maximum usability by diverse audiences.
Fully-functional PWA: Successfully delivering a native-app-like experience directly from the browser.

What we learned

The importance and impact of designing accessible, inclusive applications from the start.
Deepened understanding of voice recognition technology and AI-driven transcription models.
Practical experience implementing and refining Progressive Web App features, ensuring reliability and ease-of-use across platforms.

What's next for SpeakEasy: AI-Powered Accessible Voice Reminders

Multi-language Support: Expanding SpeakEasy’s global reach by adding additional languages.
Wearable Device Integration: Connecting SpeakEasy seamlessly with smartwatches and other wearables for enhanced usability.
Cloud Synchronization: Allowing users to manage and sync reminders across multiple devices seamlessly, improving convenience and user experience.

Built with ❤️ for the Hack the Vibe Hackathon.