Inspiration

Visually impaired STEM students face major barriers because complex algebraic curves, calculus graphs, and matrices cannot be rendered in standard Braille text books without months of manual transcription delay. According to WHO and UNESCO, over 90% of visually impaired children in low-income settings lack accessible STEM educational materials. We wanted to build a zero-budget, instant solution that empowers students to "hear" and "feel" mathematical shapes directly in their browser.

What it does

TactiMath-Engine converts structural mathematical expressions (LaTeX/MathML) directly into spatial audio frequencies and real-time haptic waveforms. Users can type any equation, instantly view its rendered graph with critical points (intercepts and extrema), and navigate the curve using arrow keys to hear shifting audio frequencies and spatial panning.

How we built it

  • Architecture: Built as a 100% client-side application running entirely in the browser without requiring external cloud databases or processing servers.
  • Parser & Math Engine: Evaluates equations and breaks them down into Cartesian point tracks.
  • Audio & Haptic System: Utilizes the HTML5 Web Audio API to map coordinate points to high-precision frequency pitches and stereo panning offsets (Left-to-Right sound shifting).
  • Tech Stack: React, HTML5 Web Audio API, Tailwind CSS, Vite. ## Challenges we ran into Handling complex mathematical syntax and mapping continuous Cartesian coordinates smoothly into auditory frequencies (preventing sudden harsh audio spikes) required careful tuning of the Web Audio synthesizer and frequency range limits. ## Accomplishments that we're proud of
  • Successfully delivered a zero-latency, browser-only spatial audio vector sonification engine.
  • Created an inclusive learning tool that works instantly without requiring costly specialized hardware or braille embossers. ## What we learned We gained deep technical insights into browser-based audio synthesis, spatial audio panning nodes, and designing accessible web applications tailored for assistive technologies. ## What's next for TactiMath-Engine
  • Adding multi-variable equation support (3D vectors).
  • Expanding multi-language structural speech explanations.
  • Integrating enhanced haptic touch feedback for mobile and trackpad devices.

Built With

Share this project:

Updates

Submission history