Inspiration

As a technical person who has worked in the XR industry, and have worked on using XR as a training platform, One issue I keep noticing is that the trainees always have a lower efficiency in the real work bench and where they fail to adapt to the real world environment where precision is key. They often note that during the simulation the hand held devices did not emulate the real device behavior along with it being more forgiving to inconsistencies.

This is a frustration which I have notice among many training simulations and have noted that the issues simply can not be resolved by the current hardware ...

Controllers are clunky for precision work and do not provide a natural hold making them feel alien in our hands, they break immersion, and add cognitive load at exactly the moment one needs the brain focused on the task.

Hand tracking (which relies on computer vision methods) has an error rate one can simply not afford when the margin for mistake is a burnt pad or a snapped wire. Not to mention its failure in cases of occluded hands where the hand tracking models simply predict a certain hand pose which might be far off from the ground truth. Given assembly tasks where hands are often occluded by components, this becomes a critical bottleneck.

Tracking gloves are heavy, disruptive, and fight against the very dexterity they're supposed to enable.

There was no good answer. Until MX Ink came out as an unconventional alternative. We realize many precision tools are in a form which is very similar to a pen!

Humans have been holding pen-like instruments for thousands of years. It is the most natural tool interface we have ever developed. The grip is instinctive. The control is intuitive. The cognitive load is near zero because your brain already knows how to hold a pen.

For precision trades like soldering, micro-assembly, surgical training, the tool being trained IS a pen-like instrument. A soldering iron. A probe. A scalpel. These are all held the same way and require utmost precisions and care.

The MX Ink is not just a stylus. It's the first MR input device that speaks the same physical language as the skills that need training most.

PrecisionXR is built on that insight.

Built With

Share this project:

Updates