Inspiration

Recall the nostalgia of childhood, when you could draw and imagine a world inside your head. Perhaps you were an avid sketcher who wanted your creations to pop out of the paper and come to life in the real world.

Today's technology makes it possible, and in particular, our platform empowers you to transform your ideas into elevated visual experiences.

Our platform is powered by machine learning algorithms and semantics segmentation, so it becomes smarter with each use.

Walkthrough

Our breakthrough product is MagicDex, a creative way to make your sketches come alive.

Let’s say you were a fan of the world of wizardry and magic, and you bought the ‘magic pack’ full of pre-loaded interactive content. You would draw some sketches while wearing the Magic Leap. The device would pick up specific markers that were drawn and launch the MagicDex experience.

Once you’re in the experience, you can navigate through the catalog of magic spells and choose the one you’d like to cast, either through the carousel or search functionality. You can also use your phone as an enhanced remote that allows you to quickly adjust settings on the fly.

Future Plan

The opportunity spaces are endless. Using this robust foundation, we can create white-labeled consumer versions for interactive learning materials like children’s books, and create enterprise-level solutions for professionals in the film industry, architects, product designers, UX designers, and other professionals who would like to turn their concepts into rich visual experiences.


Previous Submission - Background

Title: More Sensors and Uses for Magic Leap via iPhone / Android / Windows Phone mobile devices

At an AEC hackathon in late 2016, I developed a bridge that lets any Unity HMD app I/O to iPhone or Android device. I used this to demonstrate how to search and browse through hundreds of furniture (without hand strain or voice communications issues), with live preview and placement on HoloLens in the real world. https://gitlab.com/Yosun/HoloUndergroundApartments

Basically, by allowing for a ubiquitous smartphone to speak to a HMD, a whole host of more usable and better designed apps are possible. In addition, all of a phone's capabilities would be available to Magic Leap - such as GPS, a software 6 dof or 9 dof controller-remote (all phones have IMU's + cameras), and more!

I'd like to flesh out this concept on the Magic Leap.

--

Yosun's Skillset in Mixed Reality:

Unity dev for 10+ years, familiarity with all AR SDK's. Have built award-winning apps for various legacy depth sensor platforms: Kinect, Intel RealSense (Perceptual Computing), Project Tango. Have also built a Sundance finalist HoloLens experience: HoloShatter.com

Haven't had the chance to build something great on Magic Leap yet, but very familiar with using Unity to build amazing AR/XR experiences.

Share this project:
×

Updates