๐Ÿฅฃ Pudding โ€“ AI Cognitive Accessibility Engine


๐Ÿ’ก Inspiration

Reading online should be simple. For millions of people, it isn't.

  • 8.4 million people with dyslexia see words jumble and lines blur.
  • 6.4 million people with ADHD lose focus in dense paragraphs before finishing a single article.
  • 4+ billion non-English speakers face the added challenge of understanding complex content in a second language.

I've seen this firsthand. Friends avoid reading the news because it's exhausting. Classmates reread the same paragraph multiple times. Family members give up on understanding medical or legal information because the language is too dense.

Existing tools don't solve the real problem.

  • Text-to-speech feels robotic.
  • Font changers only scratch the surface.
  • Cloud summarizers compromise privacy.
  • None of them learn how you read.
  • None of them truly adapt.

That's the gap Pudding fills.


๐Ÿš€ What It Does

Pudding is a Chrome browser extension and Cognitive Adaptation Engine that uses on-device AI to transform any webpage into content tailored to your reading style, in your preferred language, without sending any data off your device.


โœจ Core Features

๐Ÿง  Adaptive AI Simplification

  • Uses Chrome's built-in Gemini Nano completely offline
  • Converts dense paragraphs into concise bullet points
  • Replaces jargon with plain language while preserving meaning
  • Three simplification levels:
    • Low
    • Mid
    • High

๐Ÿ“ˆ Cognitive Behavior Tracking

  • Monitors scroll speed, pauses, and rereads locally
  • Builds a personalized reading profile over time
  • Automatically adjusts simplification based on fatigue signals
  • Learns and improves with continued use

๐ŸŽฏ Complexity Mapping

  • Real-time readability heatmap (Green โ†’ Yellow โ†’ Red)
  • Click difficult sections to simplify only those paragraphs
  • Visual guidance showing exactly where reading becomes challenging

๐ŸŽฏ Focus Mode

  • Blurs distractions such as ads, comments, and sidebars
  • Highlights only the current paragraph
  • Supports keyboard navigation using arrow keys
  • Designed specifically for ADHD reading patterns

๐ŸŒ 10-Language Support

Supports:

  • English
  • Spanish
  • French
  • German
  • Arabic
  • Chinese
  • Japanese
  • Hindi
  • Portuguese
  • Bengali

Additional features:

  • Full RTL support for Arabic
  • Instant language switching
  • Persistent language preferences
  • Potential reach of more than 5 billion users

๐Ÿ—๏ธ How We Built It

User reads webpage
        โ†“
Cognitive Tracker monitors behavior (local)
        โ†“
Complexity Analyzer scores each paragraph
        โ†“
Gemini Nano (on-device) simplifies content
        โ†“
Content Restructurer transforms the DOM
        โ†“
Focus Mode + Reading Beam guide attention

Tech Stack

  • Chrome Manifest V3
  • Chrome Prompt API (Gemini Nano)
  • cognitive-tracker.js
  • complexity-analyzer.js
  • content-restructurer.js
  • fatigue-detector.js
  • i18n-helper.js
  • OpenDyslexic font (bundled locally)

โš™๏ธ Challenges We Faced

Gemini Nano Availability

Chrome's on-device AI currently requires Canary or Dev builds with experimental flags.

To ensure compatibility, we implemented a complete fallback simplification pipeline so the extension remains fully functional even without Gemini Nano.


Real-Time Performance

Continuous reading behavior tracking initially introduced performance issues.

Optimizations included:

  • 300ms debouncing
  • Throttled tracker updates
  • Cached complexity scores

Result: approximately 60% lower CPU usage.


Multilingual Simplification

Simplification quality differs across languages.

To improve consistency, we created:

  • Language-specific prompting
  • Conservative fallback strategies for lower-resource languages

Privacy vs Capability

Most AI reading assistants upload webpage content to external servers.

Pudding keeps everything local:

  • Gemini Nano runs on-device
  • Reading profiles remain in localStorage
  • No external APIs
  • No cloud processing
  • Zero data leaves the device

๐Ÿ“š What We Learned

  • Cognitive load is often invisible until reading becomes easier.
  • Accessibility tools should adapt to peopleโ€”not force people to adapt.
  • Powerful AI experiences can be built without sacrificing privacy.
  • Features designed for accessibility often improve everyone's experience.

๐Ÿ† Accomplishments

  • Fully working Chrome extension
  • Offline AI-powered content simplification
  • Behavioral reading adaptation
  • Support for 10 languages
  • RTL support for Arabic
  • 100% private architecture
  • OpenDyslexic font integration
  • WCAG AA compliant color contrast

๐Ÿ”ฎ What's Next

  • Voice narration with synchronized highlighting
  • Study Mode with AI-generated flashcards
  • Classroom Mode for educators
  • Native iOS and Android applications
  • Firefox and Safari support

๐ŸŒ Impact

SDG 4 โ€” Quality Education

Students with dyslexia and ADHD can independently access educational content.

SDG 10 โ€” Reduced Inequalities

Improves digital inclusion for people with cognitive disabilities and multilingual audiences.

SDG 3 โ€” Good Health and Well-Being

Reduces reading fatigue and cognitive stress during everyday web browsing.


โ–ถ๏ธ Try It

GitHub

https://github.com/Tasfia-17/Puddingext

git clone https://github.com/Tasfia-17/Puddingext.git

Load the extension in:

chrome://extensions

Enable Developer Mode and choose Load unpacked.


๐Ÿ™ Acknowledgments

  • Youth Code Foundation for creating a platform where students build meaningful projects
  • Chrome AI Team for Gemini Nano
  • OpenDyslexic community for the accessibility font
  • Everyone who shared their experiences with dyslexia, ADHD, and online reading

๐Ÿ Submission Information

Track: Track 03 โ€” AI That Actually Helps People

License: MIT

Status: Working Prototype

Share this project:

Updates

Submission history