Inspiration
A zipper is easy to use and hard to see inside. We started with a question: what happens inside the slider when you pull it? That gave us a format for looking at other objects we use by feel, from a click pen to a spray bottle.
What it does
Thingwhy is an AR Lens for Snap SPECS. You operate an everyday object, predict what will happen next, and open a cutaway to see which part caused the result. Replay lets you pause on the motion you might miss at full speed.
- Zipper: Pull the slider, then watch its guide channels bring two rows of teeth together. Fit the shell back into place and test it by closing and reopening the zipper.
- Earbuds: Change the tip seal and toggle active noise cancellation. Compare the modeled pressure traces to see how each change affects the sound reaching a virtual ear.
- Click pen: Press the same button twice and watch the cam rotate. The shallow stop holds the tip out. The deeper groove lets the spring pull it back.
- Spray bottle: Squeeze the trigger to see the piston push liquid out. Release it and follow the refill through the dip tube and inlet valve.
How we built it
We built Thingwhy in Lens Studio with TypeScript and used CLAD to exercise the interactions in SPECS 27 Preview. Each chapter has its own mechanism model, with shared controls for inspecting and replaying motion. The earbud chapter uses a simplified signal model to compare tip seal and active noise cancellation.
Challenges we ran into
The zipper had to look right while moving in both directions. If the teeth joined at the wrong point, the cutaway would teach the wrong thing. We tied the tooth motion and guide-channel cues to the slider position so they stay in sync when you reverse the pull.
The earbuds posed a different problem. A better seal and active noise cancellation can both reduce what reaches your ear. We gave each its own control so you can change one at a time and compare the traces.
Accomplishments that we're proud of
The zipper chapter ends with a working test. After fitting the shell, you have to close and reopen the zipper before you earn a miniature you can still operate. We also ran the earbud chapter from start to finish in Preview using simulated hand rays.
What we learned
The pen made a good case for replay. With the barrel lifted and the click paused, you can see exactly where the cam lands. That small change in where it stops explains how the same button can extend the tip on one press and retract it on the next.
What's next for Thingwhy
We want to test on physical SPECS and watch first-time users try the chapters without coaching. We'll look at whether they can reach the controls comfortably, follow the cutaways, and explain what moved after a replay.
Built With
- augmented-reality
- clad
- lens-studio-typescript
- snap-specs
- spectacles-interaction-kit