EyeQ | Devpost

Inspiration

Studying is now Accessible

Millions of individuals across the globe are locked out of a fair chance at academics due to physical disabilities. Without the motor abilities to properly access a keyboard or mouse these individuals cannot independently access the internet, a massive disadvantage. The statistics are terrifying. With only 34% of physically disabled undergraduates finishing their university programs.

We recognize that these individuals require a modern, easy to use, and effective studying tool that incorporates AI. That is why EyeQ is built with accessibility in mind.

What it does

EyeQ is the first hands-free, eye and voice-controlled study suite, built specifically for students with physical disabilities. We’ve eliminated the need for a mouse or keyboard by combining precision gaze-tracking with a voice-activated AI assistant. Generating instant quizzes, or reviewing flashcards, users can navigate and learn entirely through natural eye movement and speech.

With over 7.5 million students in the U.S. currently requiring special education services, and 21% of undergraduates reporting a disability, EyeQ addresses a critical gap in the $31.4 billion assistive technology market. We built this to ensure that physical limitations no longer dictate a student's ability to succeed in the classroom.

How we built it

Frontend: HTML, CSS (Large UI buttons for ease of user experience)
Backend: Python, Javascript, FastAPI, Groq api
Frameworks: Flask
Eye Tracking: WebGazer.js
AI Assistance and Question Generation: Groq api
Speech Recognition: Google Cloud Speech API

Challenges we ran into

Implementing and Calibrating the Eye Tracking System. Designing UI around a hands free system. Getting around the traditional "mouse-based" approach many websites use.

Accomplishments that we're proud of

Seamless Hands-Free Navigation: Successfully architected a functional MVP using WebGazer.js to allow users with motor impairments to navigate the entire study system without a mouse or keyboard.

Engineered and calibrated eye-tracking system that adapts to various screen sizes and lighting conditions, ensuring a reliable "eye-to-UI" experience.

Developed a personalized AI study assistant that is fully operational via voice commands, bridging the gap between digital content and inclusive accessibility.

Impact

Around 5.4 million people **in the U.S suffer from some form of paralysis. These individuals spend thousands of dollars in accommodations and require constant attention to access study resources. With EyeQ, access to study tools for these people have never been easier. Now, anyone can use AI assistants, flashcards, and generated quizzes, **not just the able bodied.

What's next for EyeQ

--> Further improve intuitive layout to best accommodate eye and voice recognition
--> Improve eye tracking accuracy algorithm to reduce jitter.
--> Fully voice controlled file access including PDF/File upload
--> Saving user eye data and calibration for convenience and future use
--> Custom quiz editing features