Inspiration

The idea for SummarEyes came from observing students struggling with digital textbooks and online learning materials. Many students face information overload, language barriers, and difficulty staying engaged with complex academic content. Many of my friends and myself included find it hard to be efficient when studying and oftentimes end up studying the wrong material and missing out on what matters for exams. As educational resources increasingly move online, I saw an opportunity to leverage Chrome's new AI capabilities to create a more intelligent and interactive study experience.

What it does

SUMMAREYES transforms any educational webpage into an interactive study session by:

  • Analyzing content and highlighting the most relevant sections based on user-specified topics.
  • Navigating the user to the most important sections.
  • Generating smart summaries of each section
  • Creating interactive quizzes for each section to reinforce learning
  • Providing multilingual support across 11 languages with context-aware translation
  • Using multimodal AI to analyze educational diagrams and images in textbooks
  • Offering an intuitive navigation system to move between relevant sections
  • Maintaining academic precision while making content more accessible

How I built it

I leveraged Chrome's latest AI capabilities through three key APIs:

  • Prompt API for intelligent content analysis and context-aware translations
  • Summarizer API for generating concise, accurate summaries
  • Writer API for creating interactive quiz questions

The extension is built with JavaScript and uses Chrome's extension architecture with:

  • Content scripts for webpage analysis and interaction
  • Popup interface for user controls and display
  • Local storage for session management
  • Message passing between components
  • Multimodal AI integration for image analysis

Challenges I ran into

  • Maintaining academic precision while simplifying content
  • Handling diverse educational platforms with different DOM structures
  • Optimizing time performance with multiple AI model interactions
  • Managing AI model downloads and availability states

Accomplishments that I'm proud of

  • Created a truly multilingual learning experience that maintains academic rigor
  • Implemented multimodal AI analysis for educational diagrams and charts
  • Developed an intuitive UI that makes advanced AI features accessible
  • Built a scalable platform that works across major educational websites
  • Achieved seamless integration of multiple Chrome AI APIs
  • Created interactive quizzes that adapt to content and language

What I learned

  • How to effectively combine multiple AI APIs for enhanced functionality
  • Strategies for optimizing AI model performance in extensions
  • How to create a chrome extension with multiple AI capabilities

What's next for SummarEyes

  • Integrating a voice-powered study assistant into SummerEyes
  • Mobile Support
  • Granular Text highlighting (increasing precision in highlighting)

Built With

Share this project:

Updates