MX Read

MX Read Semi Final
MX Read

MX Read: Turning Pages into Experiences

Inspiration

Reading is one of the oldest ways of learning, yet interaction with physical books has changed very little. Many people face challenges such as language barriers, difficulty taking digital notes from physical books, and limited accessibility for elderly or non-readers.
SmartRead was inspired by the idea of combining mixed reality and intelligent tools to make books interactive, accessible, and collaborative.

What it does

SmartRead transforms a physical book into an interactive learning experience using Meta Quest 3 and a Logitech pen.
The system allows users to:

Scan books and create notes in mixed reality.
Translate books written in different languages.
Listen to text by pointing the pen at a specific line or word.
Record voice comments and annotations while reading.
Share notes and insights with friends.

How we built it

We built SmartRead by integrating:

Meta Quest 3 for mixed reality visualization.
Logitech pen for interaction and annotations.
Computer vision for detecting book pages and text.
Speech and translation models for multilingual audio output.

Challenges we ran into

Aligning virtual annotations accurately with physical book pages.
Achieving real-time translation and audio feedback.
Designing natural pen-based interaction inside mixed reality.
Integrating multiple hardware and software components smoothly.

Accomplishments that we're proud of

Successfully combining physical books with mixed reality interaction.
Enabling multilingual reading through simple pen gestures.
Creating a system that supports accessibility for elderly and non-readers.
Demonstrating collaborative note-sharing directly from physical books.

What we learned

Through this project, we learned that meaningful innovation often comes from improving everyday experiences.
We also understood the importance of human-centered design, accessibility, and seamless interaction between physical and digital environments.