illume : Illuminating Learning Through Context-Aware AI

illume transforms web reading into active, personalized learning—capturing full context, leveraging advanced AI for adaptive lesson plans, seamlessly integrating multimodal content.

Comment

Inspiration

We set out to transform ordinary web reading into a dynamic, immersive learning experience. In a world overflowing with information, we wanted to illuminate the parts that truly matter—helping people discover, understand, and master new concepts right in the flow of their everyday browsing.

What It Does

Illume is a context-aware Chrome extension that turns highlighted text into interactive lessons and learning modules. With a single click, it seamlessly analyzes the entire page to provide targeted questions, explanations, and even recommended videos—empowering users to deepen their knowledge instantly.

How We Built It

Beneath Illume’s clean interface lies a sophisticated AI pipeline. Here’s how it works:

  1. Contextual Data Capture: Illume sends the entire DOM plus highlighted text to our backend, ensuring the AI has the full story—not just snippets.
  2. Adaptive Engine: Our content inference and similarity searches detect which subtopics the user might already grasp—and which they don’t.
  3. Recursive Questioning: Every user response feeds back into the model, refining the next batch of questions to target only the knowledge gaps that matter.
  4. Multimodal Integration: Tightly woven YouTube recommendations keep learning fresh and engaging, catering to different styles of understanding.

Challenges We Ran Into

  • Context Management: Processing entire DOM bodies without overwhelming our AI models required fine-tuning performance and memory handling.
  • Adaptive Questioning: Building a quiz system that iterates intelligently based on user responses proved complex but crucial for effective personalized learning.
  • Scalability: Ensuring Illume could handle the wide variety of page structures across the web pushed us to optimize data flow and model efficiency.

Accomplishments That We're Proud Of

  • Context-Aware Mastery: By capturing full-page data instead of isolated text, we’re enabling a deeper, more nuanced AI understanding.
  • Truly Personalized Lesson Plans: Our recursive questioning identifies exact knowledge gaps and hones in on them until users reach mastery.
  • Streamlined User Experience: Despite the advanced tech under the hood, Illume remains incredibly simple for users—click, highlight, and learn.

What We Learned

  • Supporting Rather Than Supplanting: People learn best when they’re nudged in the right direction but still do the heavy lifting themselves. AI should amplify human curiosity, not replace it.
  • Balancing Tech & Usability: It’s one thing to engineer advanced AI pipelines; it’s another to make them disappear into a frictionless user experience.
  • Value of Contextual Data: Going beyond snippets to analyze broader context unlocks a richer understanding—proof that even small design choices can yield enormous educational benefits.

What's Next for Illume: Illuminating Learning Through Context-Aware AI

We plan to enhance Illume’s adaptability by:

  • Expanding Multimodal Content: Integrating scholarly articles, podcasts, and new media for an even more diverse learning ecosystem.
  • Deeper Personalization: Refining user profiles to maintain progress across multiple sites and sessions—learning how each user learns best.
  • Publishing this as an official Google Extension!!!: We currently have a functioning scalable back end with Google Cloud Platform, which we estimate to be able to work with 1,000+ users at a time, but due to the monetary restraints, we cannot currently make it official.
Share this project:

Updates