Inspiration

What if a mathematical formula could be heard as music, seen as vector art, and explored as a moving 3D sculpture—all at the same time?

Today, spreadsheets, synthesizers, drawing tools, and 3D engines are separate creative environments. Harmoglyph brings them together through one shared mathematical state, so changing a number or a shape can change the whole experience.

What it does

Harmoglyph is an experimental browser-based instrument for creative coders, musicians, visual artists, and curious math learners.

At its heart is a 48-step, six-column formula sheet. Each row describes a musical step; its cells control pitch, gate, modulation, spatial movement, decay, and harmonic ratio. Editing a formula affects three connected outputs:

  • Sound: a Web Audio FM synthesizer plays the sequence and can render a WAV file.
  • 2D art: parametric curves turn the same data into harmonographs, mandalas, ribbons, and pitch spirals.
  • 3D sculpture: a Three.js stage visualizes the musical and geometric relationships as interactive forms.

Users can start with presets and simple controls, explore mathematical foundations such as Fibonacci sequences and the golden ratio, or edit spreadsheet formulas directly. A drawing-to-formula mode explores the reverse direction: converting simple geometry into a playable mathematical sequence.

How it works

The application combines a custom spreadsheet-formula evaluator, audio synthesis, SVG geometry, and real-time WebGL visualization. The formula sheet acts as the shared control surface; the audio and visual engines interpret the evaluated parameters rather than operating as disconnected demos.

The current repository also includes deterministic property-based test code covering formula cycles, audio parameter bounds, CSV round-trips, WAV structure, and mathematical transformations. Test execution results and a publicly accessible demo still need final verification.

Why Frankenstein?

Harmoglyph connects technologies that usually live apart: spreadsheet formulas, FM music synthesis, vector plotting, and 3D graphics. The interesting part is their coupling: the same mathematical idea can become a sound, a drawing, and a sculpture—and selected visual inputs can become formulas again.

Built with

React, TypeScript, Vite, Web Audio API, Three.js, SVG, D3, Express, and optional server-side Gemini assistance.

Development notes

This is a work-in-progress hackathon draft. Before final submission we will verify the public build, demonstrate real Kiro-assisted development against the tracked /.kiro/ specifications, record the end-to-end demo, and document the limitations honestly.

Built With

Share this project:

Updates