VoiceQuest

Inspiration

I was inspired to create VoiceQuest after seeing how many students with physical disabilities face barriers in traditional learning environments. I wanted to make studying accessible, engaging, and hands-free, turning routine assignments into a fun and interactive experience.

What it does

VoiceQuest is a gamified, voice-controlled learning app that transforms assignments and study materials into meaningful “quests.” By leveraging assignment metadata, it generates personalized, interactive study challenges, allowing users to learn, progress, and achieve entirely through their voice.

How I built it

I built VoiceQuest as a full-stack, voice-first learning app using React and TypeScript on the frontend, capturing speech with the Web Speech API and generating audio feedback with ElevenLabs TTS. I implemented the backend in Python and Flask, storing users, quests, achievements, and live quest sessions in a SQLite database. I use OpenAI’s GPT-4o-mini to parse assignment metadata, interpret voice commands, and generate adaptive, gamified study quests in real time.

Challenges I ran into

One of my biggest challenges was designing an interface that works entirely through voice while remaining intuitive and responsive. I also had to figure out how to accurately parse assignment metadata to generate meaningful quests. Ensuring accessibility across different types of physical disabilities required careful testing and iteration.

Accomplishments that I'm proud of

I successfully created a fully functional, voice-controlled learning platform that converts assignments into engaging quests. The app is fully hands-free, accessible, and demonstrates that gamification can make studying more interactive for students with disabilities.

What I learned

I learned the importance of accessibility-first design and the power of gamification in education. I also gained experience in voice interface development, data parsing, and creating adaptive learning experiences that respond to user input.

What's next for VoiceQuest

Next, I plan to expand the app’s quest generation capabilities, integrate more assignment formats, and improve the voice interface with natural language understanding. I also hope to collaborate with educators to make the platform widely available to students with disabilities.

Built With

• elevenlabs
• flask
• openai
• python
• react
• sqlite
• typescript
• webspeechapi