Spatial programming is the beginnings of a node based programming interface, like Scratch, but in mixed reality. The idea stemmed from a desire to learn to program while rapidly prototyping for mixed reality. The productivity potentials for a system like caught our imagination as much as the educational potentials.

What it does

Control a robot by organizing a sequence of node-based commands in MR

How we built it

Built in unity with the mixed reality toolkit

Challenges we ran into

Figuring out what was possible to achieve in the limited time-frame

Accomplishments that we're proud of

We're proud of our use of natural interfaces, took advantage of the affordances of the WMR interface.

What we learned

We learned what it takes to create a pseudo-programming language. We learned programming languages are very complex and to break it down spatial. It involves more than just throwing objects together.

What's next for Spatial Programming

Phase One Features: finish fleshing out the library of nodes to get it closer to a full programming language. Phase Two: add features such as:

  • Multi-user cross-platform AR/VR collaboration
  • Connect IOT devices to literally program your environment
  • Import & parse scripts to visualize more complex program flows

Generally pushing towards being an open source productivity tool.

Built With

  • unity-mixedrealitytoolkit
Share this project: