Spatial programming is the beginnings of a node based programming interface, like Scratch, but in mixed reality. The idea stemmed from a desire to learn to program while rapidly prototyping for mixed reality. The productivity potentials for a system like caught our imagination as much as the educational potentials.
What it does
Control a robot by organizing a sequence of node-based commands in MR
How we built it
Built in unity with the mixed reality toolkit
Challenges we ran into
Figuring out what was possible to achieve in the limited time-frame
Accomplishments that we're proud of
We're proud of our use of natural interfaces, took advantage of the affordances of the WMR interface.
What we learned
We learned what it takes to create a pseudo-programming language. We learned programming languages are very complex and to break it down spatial. It involves more than just throwing objects together.
What's next for Spatial Programming
Phase One Features: finish fleshing out the library of nodes to get it closer to a full programming language. Phase Two: add features such as:
- Multi-user cross-platform AR/VR collaboration
- Connect IOT devices to literally program your environment
- Import & parse scripts to visualize more complex program flows
Generally pushing towards being an open source productivity tool.