Inspiration

Engineering teams lose millions every year to miscommunicated design feedback. Reviewing complex 3D prototypes through flat screens, email chains, and annotated screenshots creates costly blind spots. We wanted to ask: what if feedback lived directly on the product itself?

What it does

MarkUp3D lets engineers step inside their 3D prototypes in mixed reality using a Meta Quest headset. Using the Logitech MX Ink stylus, they trace stress paths on curved surfaces, circle fault lines, and attach precision comments directly to specific geometry with millimeter accuracy. Teammates join the same shared MR space in real time, see every annotation spatially, and respond instantly.

How we built it

Built for Meta Quest using the MX Ink stylus SDK, with a spatial annotation engine that anchors comments to 3D geometry coordinates. CAD models are imported and rendered in mixed reality, with stylus input tracked for precision drawing and markup.

Challenges we ran into

Anchoring annotations accurately to curved 3D surfaces while maintaining precision across different model scales was a core challenge. Ensuring stylus input felt natural and responsive in MR was critical to the experience.

Accomplishments that we're proud of

Creating an interaction where the stylus feels truly irreplaceable, not just a pointer but the actual tool that makes the workflow possible.

What we learned

Precision input in MR changes how people think about spatial feedback. When you can mark exactly what you mean, communication becomes unambiguous.

What's next for MarkUp3D

Integration with major CAD platforms like SolidWorks and Fusion 360, async collaboration features, and AI powered annotation suggestions based on structural analysis.

Built With

  • google-slides
  • logitech-mx-ink-documentation
  • meta-quest-developer-docs
Share this project:

Updates