Inspiration
We noticed that most VR training tools use simple controller triggers, which cannot simulate real precision tasks. In real labs and technical environments, pressure control matters. We want to explore how Logitech MX Ink can solve this limitation and enable true precision training in mixed reality.
What it does
Spatial Mentor AI is a mixed reality precision training platform we are developing for Meta Quest using MX Ink’s pressure-sensitive stylus. It is designed to simulate tasks like pipetting where fine motor control is critical. The system converts stylus pressure into measurable output and provides real-time feedback on accuracy and technique.
How we are building it
We are building the project in Unity using Meta Quest mixed reality and OpenXR. Stylus pressure input is being mapped to task-specific values, validated against a target range, and connected to an AI-based feedback system. The platform is designed to be modular so new training scenarios can be added easily.
Challenges we are addressing
One of the main challenges is creating realistic pressure-to-volume mapping while maintaining smooth performance in mixed reality. We are also working on fine-tuning accuracy validation and keeping the experience responsive on Quest hardware.
What we’re proud of so far
We have started working on an early prototype that demonstrates pressure-based validation in mixed reality. It highlights the potential of MX Ink beyond creative use cases and into professional training environments.
What we are learning
We are learning how much hardware capabilities influence user experience. Even small differences in input, like analog pressure, can unlock entirely new application categories in mixed reality.
What’s next for Spatial Mentor AI - Precision MR Training
Next, we plan to integrate full MX Ink hardware support, expand training scenarios, and build an instructor dashboard for performance tracking and analytics.
Log in or sign up for Devpost to join the conversation.