Inspiration
Engineering teams lose millions every year to miscommunicated design feedback. Reviewing complex 3D prototypes through flat screens, email chains, and annotated screenshots creates costly blind spots. We wanted to ask: what if feedback lived directly on the product itself?
What it does
MarkUp3D lets engineers step inside their 3D prototypes in mixed reality using a Meta Quest headset. Using the Logitech MX Ink stylus, they trace stress paths on curved surfaces, circle fault lines, and attach precision comments directly to specific geometry with millimeter accuracy. Teammates join the same shared MR space in real time, see every annotation spatially, and respond instantly.
How we built it
Built for Meta Quest using the MX Ink stylus SDK, with a spatial annotation engine that anchors comments to 3D geometry coordinates. CAD models are imported and rendered in mixed reality, with stylus input tracked for precision drawing and markup.
Challenges we ran into
Anchoring annotations accurately to curved 3D surfaces while maintaining precision across different model scales was a core challenge. Ensuring stylus input felt natural and responsive in MR was critical to the experience.
Accomplishments that we're proud of
Creating an interaction where the stylus feels truly irreplaceable, not just a pointer but the actual tool that makes the workflow possible.
What we learned
Precision input in MR changes how people think about spatial feedback. When you can mark exactly what you mean, communication becomes unambiguous.
What's next for MarkUp3D
Integration with major CAD platforms like SolidWorks and Fusion 360, async collaboration features, and AI powered annotation suggestions based on structural analysis.
Built With
- google-slides
- logitech-mx-ink-documentation
- meta-quest-developer-docs
Log in or sign up for Devpost to join the conversation.