Handy Desktop for PICO

💡 Inspiration

After testing the Pico 4 headset, we realized that they were no possibility to use a web browser in a mixed reality interface. We decided to start from this idea and detailed it as much as possible.

❓ What is it ?

This UI is supposed to serve as a desktop where you can work, do research, watch videos, listen to music while doing other things outside of the MR. It needs to fluent and simple to be used in everyday life. For that, we detect precise hand gesture of the user detected by the headset that operate action without the need of controller to stay hand free.

✋ Interaction

Applications can be open with the non-dominant hand in the form of windows that are movable and sizable by grabbing or pinching the interface. Other interaction can also produce some interaction: Take a picture (“L” with both hands, Pull closer/Push away a window, Type on virtual keyboard, …).

🛠️ Main use

The main use of this could be for web browsing, hand drawing, taking notes or getting info. Some option could be implemented to give the user some personalization like the dark mode for example.

🚀 To go further

To add more functionality, anchors could be used to fix the UI in space and load it when the app is launched. Wall detection could be used to block windows from going in walls and be seeing through them.

Built With

• pico
• unity
• unreal-engine