Sonar Access

Inspiration

As a visually impaired student myself, STEM subjects have always presented a unique wall. Science and Mathematics are inherently visual—from mathematical function graphs to complex carbon-based molecular structures in organic chemistry.

When preparing for my Class 10 board examinations, understanding spatial structures, graphs, and molecular geometries required constant manual assistance or audio descriptions. Despite these accessibility hurdles, I pushed through to score 98.6% (topping my district), but the core challenge remained clear: Visually impaired students shouldn't have to rely on visual workarounds to understand abstract mathematical and scientific structures.

I built Sonar Access to eliminate this visual tax. By translating spatial coordinates and structural graphs into dynamic audio frequencies, Sonar Access empowers blind and visually impaired students—as well as auditory learners—to "see" math and chemistry through sound.

What It Does

Sonar Access is a multi-modal sonification suite designed for accessible STEM learning:

• Math Sonification Engine: Maps 2D algebraic curves and function graphs into real-time audio. The $X$-axis translates to time/duration, while the $Y$-axis translates to audio frequency/pitch, allowing users to hear slope, roots, and curvature.

• Organic Chemistry Sonification Engine: Synthesizes carbon-based organic molecules into intuitive sonic profiles:

  • Main Chain: Expressed via base chord progressions.
  • Branches & Unsaturations: Represented through frequency modulations for double/triple bonds and side chains.
  • Functional Groups: Distinct harmonic accents.
  • BYOK AI Feature: An optional "Bring Your Own Key" architecture allowing students to integrate custom LLM API keys for real-time conversational analysis and structural explanations.

• Chemistry Learning Hub:

  • 🧱 Atom-by-Atom Explorer ("Lego" Tool): Step-by-step structural decomposition of complex molecules.
  • 🧪 Sonic Sandbox: An interactive workbench where users build and sonify molecules from scratch—dynamically adding carbons, branches, and functional groups.
  • ⚖️ Comparative Tour: Play and compare distinct molecular audio signatures side-by-side to recognize structural variations.
  • 🎧 Ear Training: A gamified audio quiz testing the user's ability to identify functional groups and molecular traits solely by ear.

How We Built It

• Cross-Platform Deployment: Deployed as an accessible mobile application, currently live and published on the Indus Appstore.
• AI Integration: Implemented a secure, privacy-first BYOK (Bring Your Own Key) architecture for interactive tutoring capabilities without centralized API reliance.
• AI Assisted in code implementation, but the pseudocode, design architecture, and user flow relied on lived experience.

Challenges We Ran Into

The biggest technical hurdle was mapping complex multi-branched organic molecules without creating dissonant, chaotic noise. Designing a custom sound mapping algorithm required finding the sweet spot where adding functional groups, double bonds, or long carbon chains created a distinct, memorable "sonic signature" without overwhelming the listener's ears.

Accomplishments That We're Proud Of

• Turning a personal lived challenge into a working, deployed assistive tool that makes STEM genuinely accessible to blind students.
• Successfully publishing the application live on the Indus Appstore.
• Building an intuitive Ear Training gamified module that proves multi-sensory learning can make organic chemistry fun and intuitive for everyone.

What We Learned

We learned that accessibility is not an add-on feature—it is a fundamentally superior design philosophy. Designing for auditory feedback forced us to make the mathematical and chemical data representation far cleaner, more modular, and more intuitive than traditional visual tools.

What's Next for Sonar Access

• 3D Calculus & Surfaces: Expanding the sonification engine to 3D multivariable calculus surfaces and inorganic coordination complexes.
• Haptic Feedback Integration: Combining audio frequencies with haptic vibrations for touch-assisted learning hardware.

Built With

• accessibility
• ai
• android
• audioprocessing
• edtech
• education
• indusappstore
• mathematics
• organicchemistry
• sonification