ReadWimi

About the project

For our project, we developed a personalized AI reading companion designed to support individuals grades K-12 with dyslexia and other reading disabilities. Our app assesses users' reading levels and provides tailored assistance to improve pronunciation, comprehension, and text decoding. Using AI-driven speech recognition and text analysis, the app offers interactive lessons that help users sound out words, understand context, and build confidence in their reading skills. It adapts to each learner’s progress, offering real-time feedback and personalized exercises. Additionally, the tool integrates seamlessly with digital content, allowing users to practice reading texts from their devices. Our goal was to expand accessibility for those who need extra reading support, ensuring they have the tools necessary to improve literacy at their own pace. By combining adaptive learning with user-friendly technology, we aim to make reading more inclusive and empowering for individuals facing literacy challenges.

Research process and findings

Our research process for developing a personalized AI reading companion began with a comprehensive competitor analysis, examining four prominent applications in the educational technology sector: Amira Learning, Ello, Epic, and Oxford Buddy. This analysis revealed that while these platforms excel in foundational literacy skills, particularly phonics and word decoding, they often fall short in addressing the broader needs of learners. Specifically, we identified a significant gap in the integration of social-emotional learning, a crucial aspect for fostering intrinsic motivation and resilience in struggling readers. Furthermore, the existing applications predominantly cater to younger children, neglecting the unique requirements of adolescent and adult learners who may also face literacy challenges. We also noted a lack of real-time, interactive support that allows users to ask questions and seek clarification directly within the text, limiting their ability to navigate complex passages independently. Additionally, these platforms offered support exclusively for books in their own libraries, which meant students couldn't use their own preferred reading materials.

To complement our competitor analysis, we conducted in-depth interviews with three individuals possessing extensive experience with learners who face reading difficulties: a parent of an autistic child, a teacher specializing in individualized education programs (IEPs), and a caregiver dedicated to supporting individuals with learning disabilities. These interviews provided invaluable insights into the lived experiences and challenges faced by our target users. A recurring theme was the pervasive lack of motivation to engage with reading, often compounded by feelings of frustration and stigmatization due to perceived academic shortcomings. The interviewees also highlighted the inequitable access to digital reading platforms, citing financial constraints and limited institutional resources as significant barriers. They also highlighted the need for more visuals accompanied by audio in books and other reading materials to aid with comprehension. Additionally, many interviewees emphasized that their learners struggle with pronunciation, vocabulary, and understanding the meaning of stories or sentences.

Interview Questions:

1. Could you tell me about your learner’s experience with digital books or reading materials?
2. What types of books or texts do you or the learners you work with typically engage with?
3. When working through a text or chapter, what does the reading process look like?
4. What are some common points where learners might encounter challenges or get stuck?
5. How would you describe the reading levels of the learners you work with, or the individual you are referencing?
6. What strategies have you found to be effective in supporting reading comprehension and engagement?
7. Are there any approaches that have been less successful? If so, what are they?
8. What factors seem to influence your learner’s motivation to read?

Design decisions rationale

Our design process focused on creating a highly engaging and supportive reading companion. One of our key decisions was integrating AI to provide a personalized experience. The AI adapts to each user’s reading level and generates visual aids, transforming scanned text into images to enhance comprehension. This feature is especially beneficial for learners who rely on visual cues to bridge the gap between text and understanding.

To foster a deeper connection and maintain motivation, we introduced character customization. Users can personalize their reading companion, Wimi, with accessories that reflect their interests. For example, a football fan can equip Wimi with a helmet and football. Our research consistently highlighted motivation as a challenge, and this feature makes reading more engaging and personal. Recognizing the limitations of platforms restricted to specific digital libraries, we implemented a scan material feature. This allows users to scan any book or reading material, providing greater flexibility and access to a wider range of content. Interviews and competitor analysis reinforced the need for this feature, as readers expressed a strong desire for freedom in their reading choices.

Our research, particularly through educator and caregiver interviews, emphasized the importance of real-time, interactive support for comprehension. Many competitor applications rely on predetermined questions at the end of a chapter or section. Instead, we integrated support within the reading experience. Users can access pre-set questions to clarify difficult words or sentences and use a microphone icon to ask additional questions. This feature directly addresses the challenge of learners getting stuck on specific words or phrases and needing immediate clarification. Additionally, the companion incorporates questions that encourage social-emotional learning, an aspect missing in competitor applications. Our research showed that decoding words alone is not enough; readers must understand context and emotional nuances to fully engage with the material. This interactive approach fosters deeper comprehension and independent learning.

We also identified a need for a more comprehensive reading assistance approach. Many existing applications focus primarily on phonics or comprehension, but we aimed to support both. Our design includes features that enhance phonics, vocabulary development, and overall comprehension.

To reinforce positive reading habits and increase engagement, we incorporated gamification. Students earn star points by correctly answering questions, which they can use in a virtual shop to customize Wimi with new accessories. This turns reading into a more rewarding and interactive experience, addressing the motivation challenges identified in our research. Finally, we included reading comprehension quizzes based on app-generated short stories. These quizzes provide immediate feedback, reinforcing comprehension in a fun and engaging way while solidifying learned material.

Built With

• figma