Augmented Reality Terminal

AR and VR headsets today are more akin to gaming consoles than to desktops and latops.

They are general purpose computers in that they can be programmed to do arbitrary tasks, but a hallmark of a flexible personal computer over which you have control is being able to develop new software on it, not just running software someone else has written.

Take phones as an example, while we all carry around more computing power than it took NASA to reach the moon in our pocket we instead are all hacking on laptops (or desktops - respect) in this competition. Arguably this is due to the interface of the device (i.e. small screen), and it is possible to get a linux environment like Termux on an Android device, but the prinicple stands.

AR and VR headsets aren't limitted by this interface constraint. Arguably, they could provide a better interface with infinite virtual monitors!

Dedicated Virtual Reality Computers are possible, but their cost is roughly 10x their mass market peers. We could instead leaverage existing hardware to support our vision. The minimum requirement of being able to develop software, and something that you can do a heck of a lot of on it's own, is a terminal interface.

The justification for using the AR with the Hololens 2 is that is doesn't seperate you from the real world, harking back to Mark Weiser's ideas of 'embodied virtuality' rather than 'virtual reality'. VR headests like the Oculus Quest 2 do have passthrough, but it's really janky.

Now being a Microsoft product the Hololens 2 runs Windows 10. I've been primarly using linux machines for a while, and only using linux machines or a *nix environement for development for longer than that. So this product involed magesticaly fighting with weird microsoft C linker issues to build the windows terminal. I got some respones from some very helpful and very experience people in the realm of the windows terminal and hololense, but I gave up after about 12 hours of this, and instead fell to my backup plan: using a SRCF shell in a box through the Hololense browser.

However, I did find a nice blog post series in the Windows Termiunal (one of the few features of the Windows OS which I quite like).

Maybe it's just an issue with my lack of understanding, but the fact that these machines are so hard to hack on is an indicator that they are hostile to development. The user doesn't really own their own machine. This is important for technology education - how are kids meant to learn anything if they can't explore their own technology. Hopefully this will change as AR moves from industrial markets to consumer markets (see Apple's upcoming AR glasses).

Built With

• c
• hololense
• visual-studio