Welcome to the Mixed Reality Toolkit

The Mixed Reality Toolkit's primary focus is to make it extremely easy to get started creating Mixed Reality applications and to accelerate deployment to multiple platforms from the same Unity project.

Build Status

Modules Build Agent OpenUpm
XRTK-Core Build status openupm
SDK Build status openupm
WMR Build status openupm
Lumin Build status openupm
Oculus Build status openupm

Getting Started

Overview

Developing Mixed Reality Applications in Unity is hard, and we know there are many developers who are frustrated with the current state of both game and general application development within the Mixed Reality ecosystem: a quickly developing market that encompasses the whole spectrum from Mobile Augmented Reality to high-end Virtual Reality.

To improve this situation, the Mixed Reality Toolkit's vision is simple, to provide a complete cross-platform solution for AR/XR/VR development that supports three different developer skill levels:

  • Beginner No Coding Required: Perfect for artists, Hackathons, and Quick Prototyping.

  • Intermediate Customizable: The framework is flexible enough so coders can customize what they need to cover edge cases with ease.

  • Advanced Extensible: The framework is easy to extend and modify to add additional custom services to meet specific criteria and needs.

Our philosophy is to enable developers to focus on building content and structure and not have to worry about the underlying complexities for supporting multiple platforms in order to build it everywhere and on each device as required. In Short, built it once and ship it everywhere with as little effort as possible.

We’d like to invite all the major hardware vendors to help guide their platform-specific implementations, from Microsoft’s Windows Mixed Reality and Magic Leap’s Lumin OS to Google’s ARCore and Apple’s ARKit. Including any upcoming Mixed Reality capable devices that would like to be included for adoption.

Chat with the community

We recently moved our main conversations regarding Mixed Reality Toolkit over to Discord, which allows us to do a lot more (and the chat/streaming there is awesome), but we keep a Mixed Reality Toolkit presence on Slack too, in order to retain links to our friends on there.

Discord

Come join us on Discord!

Supported Platforms

By default, we support OpenVR on all platforms that support the standard, as well as Native SDK implementations for various vendors.

  • [x] Windows Standalone
  • [x] Linux
  • [x] OSX Standalone
  • [x] Open VR
  • [ ] Open XR
  • [x] Windows Mixed Reality
    • [x] HoloLens
    • [x] Windows Mixed Reality HMDs
    • [-] HoloLens 2 (platform supported, hands / eyes pending)
  • [x] Lumin (aka Magic Leap)
  • [x] Native Oculus API
    • [x] Rift
    • [x] Quest
    • [ ] Go
  • [ ] Native Steam VR
    • [ ] HTC Vive
    • [ ] Vive Index
  • [ ] iOS
    • [ ] ARKit
  • [ ] Android
    • [ ] ARCore
  • [ ] WebAssembly
    • [ ] WebVR
    • [ ] WebXR

Built With

Share this project:

Updates

posted an update

XRTK developer update 27th April 2020

It's been a mad few weeks, hence the polite silence (that and Oculus Destroyed my main rig with their beta. Note to self, ALWAYS do a full backup and add multiple System Restore points with "driver" updates)

But we've had huge major developments and renewed focus these past few weeks, so let's dive right in

nReal is the latest partner to work with the XRTK

It's almost a monthly event when we either reach out to a new XRTK partner or they contact us and this month is no different.

Following on from our partnership with Lenovo, we reached out to nReal to talk about adding their platform for integration with XRTK. They were so excited they rushed our team a preview developer kit while the one we ordered is on its way.

Stay tuned for more news on that front

0.2.0 Preview packages available

We had hoped to get the 0.2 release out in the wild by now, but the team were overwhelmed with requests for 2019.3 and a bunch of other tasks, so we have taken the executive decision to also upgrade to Unity 2019.3 for the next release.

But not wanting to keep everyone waiting, we have also upgraded our CU/CD pipeline to also push out XRTK Preview releases. Now when you open the package manager you will see our stable 0.1 releases alongside the preview packages.

** A word of caution, the previews are prone to breaking as they are effectively daily builds of our development branches (sometimes multiple in a day), so bear with us should you wish to see the previews of what's coming. But thanks to the UPM packaging, you can easily switch between versions as often as you like without affecting your project.

0.2.0 Stabilisation

Apart from the 2019.3 upgrade, there are a ton of core features built already in the 0.2 development stream and we're hard at work hammering the heck out of it, but we could always use a little extra help.

If you are up for the challenge, why not try a little test with the 0.2 preview packages and if you find issues/warnings or even just want to ask a question, then drop it into the XRTK Github.

This is that big push on the cure framework features we want to get nailed down before jumping headlong into the SDK features everyone keeps asking for, so if you can, just lend us a hand :D

Stay tuned for more news

Phew, that is enough rest, time to get back to the code and testing. Well, once I've finished rebuilding my blinking PC that is :D

Log in or sign up for Devpost to join the conversation.

posted an update

XRTK developer update 27th April 2020

The road to 0.2 draws near and the XRTK team have been taking to the road, things are really starting to heat up.

Big thanks to the XR Creators group for hosting XRTK

We had a blast at the XR creators event and showcasing both past, present and the future of the XRTK. You can check the recording here:

XR Creators present Stephen Hodgson & Simon Jackson

Slides for the event can also be found here

The party continued after the event with some great discussions and suggestions from the audience

I'd highly recommend checking out all their other events in their calendar, it's a fun time to get involved in immersive events XR Creators AltspaceVR channel

Testing for 0.2 has begun

Some of the last major changes finally made it over our extensive peer review cycle and got merged into dev, so much so you may not even recognise some areas (without affecting existing projects too much, except for new config).

So begins our big QA phase for any significant release, as well as a few minor features we've been holding off on while we got the big things out of the way.

Come and join in the fun if you dare, clone the development branch and play

Roadmap 0.3 and beyond

The fun never stops when it comes to the XRTK and we are constantly evolving our roadmaps to meet both current and future customer demands (that means YOU!). The main focus for the 0.3 branch will be our SDK features, giving a lot of drive for those things needed to rapidly accelerate your projects, including (but not limited to):

  • New interaction system for Buttons, Sliders, etc
  • Improved teleportation options
  • Scene manipulation and events
  • Much, Much, More

We also looking to revamp the Configuration UI for the XRTK using UIElements and depending on its progress (e.g. Unity bugs), it will appear in 0.3

Got a suggestion or feature you need before fully adopting the XRTK, then log it here!

Stay tuned for more news

Keep an eye on the Discord for more live sessions and join in the discussions, help XRTK be the best framework you need it to be.

Log in or sign up for Devpost to join the conversation.

posted an update

XRTK developer update 21st April 2020

The event schedule is fast filling up with lots of people flooding to online and immersive events, including the XRTK themselves.

Check out XRTK at the XR Creators event in AltspaceVR

Come check out the XR Creators Unite AltspaceVR event featuring the Mixed Reality Toolkit (XRTK), with none other than @SimonDarksideJ and @Stephen Hodgson https://account.altvr.com/events/1455126216410399022

Saturday 25th April at 9 PM BST

We'll be talking XRTK and fielding questions and bowling answers, or just come and chat

Check out the new Input Mapping and controller system

We're fast revamping some of the XRTK UI in regards to Controller mapping and Input Actions. The team are hard at work to get this finalised for the upcoming 0.2 release.

As a preview, here is the updated input system view, offering direct access to basic controller mappings

The updated platform configuration in it's "Simple" view

And the more Advanced individual controller view, with sharable visualisation settings

The new system is a lot more flexible and requires even less code change/management going ahead. It's also UIElements ready, so we will have an easier time transitioning.

Other events happening

Simon (darkside) Jackson is running additional settings on getting meetings online and immersive. For those who have tried the more immersive platforms such as AltspaceVR and Mozilla hubs, you will have experienced a place that feels more like we are still together, rather than the flat 2D world of Zoom and Teams.

For those of us creating / managing and hosting events, the sessions show the easiest path to achieve that with AltspaceVR (and later hubs)

Check the follow on sessions here:

More details about the events can be found on the listings page below:

https://darkgenesis.zenithmoon.com/save-the-date-altspacevr-walkthrough-online/

Everyone is welcome and should have fun just meeting out.

There will be additional sessions in the future on:

  • How to record your event – a step by step guide
  • A developer-focused event – for creating worlds, objects and components :D

Back to our regular broadcast

On with the show and whether you are interacting on the phone, in on-screen meetings or taking your first jump into VR, we look forward to seeing you there.

Log in or sign up for Devpost to join the conversation.

posted an update

XRTK developer update 13th April 2020

Time and events are certainly overtaking us in these trying times, but the XRTK team are using this time wisely as we push ever onwards to a full beta release

XRTK Release 0.2 incoming

This past week has seen a rapid upscaling of effort in the XRTK in our lead up to our latest feature release. Expect more news on this very soon.

This release will see vast improvements in:

  • New platform system, giving better granularity in platform organisation
  • New data providers and controllers. Sounds handy?
  • Revamped input system, improving on the original base system and adding even more performance
  • More flexible camera system, allowing and extended platform capabilities in this area

Stay tuned for this release hitting soon

We're streaming more than ever

If you want to know more about how the XRTK is built and what it takes to get things running, then join us on our Discord and check out the Streaming channels we have set up. As often as we can, members of the XRTK developer community are streaming their work as it happens and the team discuss choices and guide each other on the correct path.

It's also an open forum to simply ask questions if you want to.

An advance warning, big changes ahead

One of the major revamps in the XRTK this week was the update to the controller configuration system. Previously this was broken up into three dedicated areas dealing with:

  • Controller Definitions (data providers) - Adding controllers for each platform to the framework
  • Controller Visualisation (visuals) - Defining how controllers are displayed in a scene, with overrides to use different models for specific platforms
  • COntroller Mapping (actions) - Setting up what each button, trigger or stick does in your product, mapping the physical action to a virtual action at runtime

These are now being unified under a single controller definition, this both simplifies and reduces the number of places where you need to configure controllers. This is a fairly significant change and will require you to regenerate your configuration profiles, but this will be fairly seamless.

We are still working on the UXX for this feature, so join us in helping shape this into the best approach that suits you.

Stay safe, Stay calm and play on.

We encourage everyone to stay safe and use your time wisely by creating the best projects you can.

P.S. Extra credit

If you are around at 6 PM (BST) today (13th April 2020), @SimonDarksideJ is hosting an event about educating event hosts on running an effective AltspaceVR event.

Check the details here: https://darkgenesis.zenithmoon.com/save-the-date-april-13th-6-pm-bst-altspacev-walkthrough-online/

Log in or sign up for Devpost to join the conversation.

posted an update

XRTK developer update 31th March 2020

Another missed week but we continue to plough on, with as much news as we can muster.

Late night coding sessions continue

The XRTK team have been hard at work with renewed vigour, especially with the lock-down and nowhere to go :D all you can do is code.

Last night (30th) a group of us were hard at work on two exciting fronts:

  • Master Hodgson was hammering away at the new platform system for the XRTK, enabling is to clearly define the differences between platforms and take us further down the "one-click" road to producing builds. We have to take a lot of care with this as it's fundamental to the XRTK, ensuring every platform has its place (check out the #improved-platform-definitions for more details). Were'also targetting a new platform, but more on that later

  • Design god Jarod brought his new UI elements designs for the XRTK inspectors (and his drumsticks :S ) for review and also setting some guiding principles for changes to make the UIElements designs easier. (check out the #uielements-upgrade channel for details). It's certainly looking interesting. On the downside, we got to look at some Unity CSS, which burns the mind.

Keep an eye on the @XRTK_dev twitter handle or just jump into the XRTK Discord Server and join in the party.

Hands system refactor

Our good friend and companion on this merry adventure Dino Fejzagić pushed past another milestone with some assistance (if you call it that) from Stephen this week, updating with some new developments in the core, that did cause some rework but they collaborated together to get it done. There should only be a few tasks left before we can get this out the door. We're all feeling the strain with the lock-down and long term projects like this can be a struggle, so let's all give a clap to Dino to help him finish this little marathon :D

New appointments

One startling bit of news is that Stephen Hodgson got scooped by one of our supporters upon hearing he was available for hire. He's moving back closer to his family (which he loves) and has essentially got his dream job now, so we're all really pleased. Hopefully, he'll finally cheer up a bit :D

His new employer is wholely dedicated to the XRTK, so this will actually help accelerate XRTK development as his job is also to build the XRTK, freeing him from the constraints of having to work on other peoples projects. Now, the XRTK is his project and we have renewed focus.

XRTK remains open source and we have no plans to change that and we are truly grateful for this additional support and focus.

So please join in with me and give our friend and colleague a big hand of fun

Time to party

I'm a little busy teaching everyone to use Altspace, so I'm sure at some point we'll also host our own XRTK event, but for now, stay safe, stay healthy and "Smile and wave" everyone

Log in or sign up for Devpost to join the conversation.

posted an update

XRTK developer update 18th March 2020

Things keep slipping with so much going on, but we're committed to getting out the latest news and updates as the world continues to spin.

The Ghost Howls about online events not to miss

The world is shrinking and yet getting larger at the same time, now there are even more events we can attend with everything going online. The excellent @Skarredghost VR news site has pushed an article on some of the lesser-known events that have popped up in light of in-person events being cancelled.

Of the most notable is the V2EC is the rebranding of the VEC, the Vive Ecosystem Conference

When: March, 19th, 2020, 1.30 am GMT Platform: ENGAGE Link: https://engagevr.io/v2ec-event-registration/ Price: free

Find more details of the other events on the Skarred Ghost website

Educators in VR is the place to be for VR / AR

The whole Educators in VR discord is going nuclear with the sheer amount of information, content and resources being shared. If you're not already on here, then you should be.

The group are also both hosting and sending out notices for Conferences and events, such as their very own guide to presenting in VR:

Learn more about Educators in VR on their site and their AltspaceVR Educators in VR Channel.

Game Stack Live is happening now

Granted this is one of the many reasons I'm late to the party, but you should certainly check out this live-hosted event covering Microsoft Azure's Game Stack services that provide back end services, solutions and products for projects of all types.

Just because it has Game in the title, doesn't mean it's only for games, any project needing interconnectivity (such as VR / AR titles) should also get informed.

You've already missed day 1, but this was recorded for all, and day 2 starts today (17:00 UTC). have a question, just pop on the discord and have it answered live on stage.

Well back to the show

Stay safe everyone and let's all meet virtually anywhere!

Log in or sign up for Devpost to join the conversation.

posted an update

XRTK developer update 9th Feb 2020

We skipped a week as there really wasn't much news, family, daily lives and a certain pesky bug seemed to interfere with everything, and not the coding variety for once

Windows Mixed Reality Platform updated

There are some bugs we can get rid of, such as an artefact of the recent SDK changes that snuck around the goal post without their dependencies being released. At this stage of the framework, this really helps to lock down our build processes to ensure smooth operation.

The XRTK has an extensive CI/CD pipeline with lots of tests and any areas we can improve are being updated constantly. This ensures that when we move to a more beta phase we will have all the checks we need to keep the fires burning.

As we also utilise Unity's UPM implementation, it means you can hop forward and back as you wish with no effect on your project (and no pesky file overwrites of the unitypackage days of old)

Pre-Release alert

There will be a new core release coming very soon, we're just finalising some key changes we want to get in for this release, which will include:

  • Refactored configuration profiles - Should not affect your existing projects as it's all backwards compatible. This just makes the system more maintainable and paves the way for its UI refresh
  • Improved configuration validation - each platform will not manage it's own configuration correctly and inform you of any changes/dependencies you need. Better than the "every platform at once" current default which caused some corruption if you didn't have a platform installed (a unity thing)
  • New scene helper scripts to get you running quicker, specifically one for just setting up the ground in the proper way. I have to do this 100's of times during testing so I've been using it A LOT :S
  • A few additional extensions, for when things just don't stretch enough.

There will be more, so keep an eye out for the release.

Sadly, can't promise hands in this next release as some of the team decided to get on a plane instead. But you can still check out the current status in the relevant "Hands branches" in all the repos. It does work, honest :D

All our meetings/events be cancelled

Sadly due to that little thing spreading around, most (if not all) events are getting cancelled/reschedule (including some of my trips to the US), but fear not, this is where technology, more specifically Mixed Reality is jumping into the fray.

Here are some to keep an eye out for and jump in (if you're awake): Times are in GMT so adjust your clocks accordingly

Most of these groups have their own discord and chat channels to keep you connected too (just beware of Discord meltdown)

That's a wrap

Enough for this week and hopefully that makes up for last week too. Fingers crossed I should have some major news for next week (if I can just find the time :P)

Log in or sign up for Devpost to join the conversation.

posted an update

XRTK developer update 24th Feb 2020

Birthdays, events and a slow news week. Not too much to report this Monday as we've all been having busy lives and some people took time away for a birthday of all things. Oh and Happy Birthday Stephen :D

etee controller integration has begun

Thanks to etee shipping us some test devices and their latest SDK, we've begun the work to integrate them with the XRTK. Thanks to the multi-tiered architecture of the XRTK, this involves no changes on any client project that wants to use them, once upgraded you will simply have yet another platform to add and it all just magically works (assuming you want to use hands)

For more information on etee and their amazing hand controllers, head on over to their site

etee Intro Video

New Platform management and configuration systems incoming

With the many new platforms and vendors we've been working with, we've identified some improvements in the core of the framework to make it even more multi-platform friendly. Some are breaking changes, but again thanks to the architecture of the XRTK this is unlikely to have an effect on projects being built with the XRTK today. At most you'll need to edit your configuration assets and save them again.
New projects won't even feel a thing :D

It's all about the interactions

With so much news about hands interfaces being in the news, I thought I'd share a really cool article on some of the more "interesting" interaction models being trailed for VR.

I'm not entirely sure the idea of throwing a hand in the distance to get it to activate a magic switch will really grow on me (to be honest I’m still a little freaked out) but I'm sure there are "some" people out there who would willingly throw body parts at people for fun? (I hear there is this thing called the internet apparently)

Just check out the article and see what enlightens you

Enough sailing

That's for this week, on with the show.

Log in or sign up for Devpost to join the conversation.

posted an update

XRTK developer update 18th Feb 2020

Almost lost a week as I couldn't recall if I'd done another newsletter or not, time is certainly an illusion, lunchtime doubly so.

We've been bouncing around a few events and cutting code all week and I just don't know where the time goes, but he's the XRTK vibe

XRTK attended the XR Creators Altspace event

This week the XR Creators group hosted yet another one of their events in AltSpace, this time featuring a friend of the XRTK Stefan Wasserbauer (@wassx). There he discussed the world of wonder that is Data Visualisation and what it means to translate huge amounts of data into an immersive Mixed Reality experience. The XRTK crew were also in attendance for the after party where much XRTK was drank.

Check out the details here

The Educators in VR international summit is in action (17th-22nd February)

Only found out about this event this week but it's a little late in the evening for me (2PM PST) but hopefully most of the sessions are getting recorded. It's a huge event taking place with the cancellation of MWC lasting 6 days (over 150 round-the-clock hours) with a diverse range of over 150 speakers and presentations.

There is so much content here a simple newsletter item wouldn't do it justice, so simple pop along to the event page here

Bugs be fixed and features incoming

We had a flurry of updates in the repo's this week due to some free time had by all. hands were tested, configuration validating fixes were input and platforms were getting squeezed. No new release to the core or other packages as yet but expect it soon. This train doesn't stop for anything.

Keep us posted

If you hear of anything interesting or just want to chat, pop on over to our discord and hit us up. We like to party.

Log in or sign up for Devpost to join the conversation.

posted an update

XRTK developer update 10th Feb 2020

Life is always moving fast. If you don't stop and take a look around every once in a while, you might miss it. XRTK ploughed on in my absence last week due to "work stuff" (it always gets in the way), but still more to talk about

New Core release

The Core XRTk framework got an update this week, pumping it up to 0.1.30. This release contained mostly performance fixes and tweaks, as well as some pre-enhancements for configuration validation.

To update, just visit the Unity Package manager and click update (also has a dependant SDK update) or visit the release page for information on getting it freshly installed.

Partner vendor etee announcement

etee came front and center in the XRTK Discord to announce their ties with XRTK, looking to leverage the framework to extend their reach for device support with their awesome new hand’s devices. While image-based hand tracking is good, it loses some fidelity that controllers naturally give you. the etee controllers are a leap forward in this area (similar to Vive Index controllers) and strap on to your hands to give you full hands responsive input.

Check out their video to see more:

View etee Video

If you want to learn more, just click over to their website to sign up.

Upcoming XRTK dev streams

As the founding team, both @StephenHodgson and SimonDarksideJ are always committed to getting information out as soon as possible. So, we are taking to the web with a series of dev streams (Watch out we are bluntly honest) as we build out more of the framework.

Stay tuned for more info soon.

Log in or sign up for Devpost to join the conversation.

posted an update

XRTK developer update 1st Feb 2020

2020 is really in full swing now, however most of it is under the covers and behind the scenes. It may seem that not much is happening, but this is so far from the truth

Work on the XRTK first example app is underway

A simple example app which is a fairly simply model viewer is bashing around the works, just something simple to highlight some of the core features of the XRTK.
This isn't a big wow project, just something small and easy to work with.

Given the current state of the XRTK SDK (which we admit is lacking while we focus on the core), this will also ensure that some basic SDK components are drafted and toned in to looking good.

Call for input

While we work on the first sample app, if there are components / features or things you are struggling with, either with the XRTK or even the MRTK, then let us know. The thing that really drives us is to really make you, the developers more productive. If we can help, we REALLY will.

Also, if there are any specific use cases you are looking in to or trying to build, let us know and we may even look to stream building them (within reason :D )

Got an idea, any idea, just create a feature request on the GitHub site

On to more slow weeks

Time is an illusion, lunchtime doubly so. And in that very Hitchhiking view, we'll catch you again next week (ish)

Log in or sign up for Devpost to join the conversation.

posted an update

XRTK developer update 26th Jan 2020

Posting a later due to technical difficulties, which in technical garb means "Windows Update stole Sunday from me" :D

Hands support takes another bold leap

In the words of Dino the hands god

Fixed the issue with the moving palm joint on Oculus today and added estimated poses for metacarpal joints. Now having full coverage of joints between WMR and Oculus.

Getting The palm orientation worked out is critical for interactions within an XR scene, especially when you want that same system to work on all platforms and Dino is really knocking it out of the park.

Yet more Vendor talks

Yeah, I hate this news, not because more vendors keep recognising XRTK, but just by the fact we can't talk about it. But yet more hardware support is coming our way and I'm on the edge of my seat trying not to blab :S

But wait, there is more

One Vendor this week did announce they would like to go public and this is by far one of our largest supporters so far. So stay tuned for more news

Log in or sign up for Devpost to join the conversation.

posted an update

XRTK developer update 18th Jan 2020

It's been a slower week in XR (yes even with CES going full tilt) due to the awesome MIT Mixed Reality hack which has consumed probably 60% of all the Mixed Reality devs and vendors out there!

MIT Mixed Reality Hack

XRTK is present at the MIT Mixed Reality hack with one of our core devs Stephen Hodgson making an appearance to mentor and educate developers on the best tips and tricks with Mixed Reality

Stay tuned to their Twitter handle and the #HackToTheFuture hashtag

Also, check out the Live Steam that was done for the event for some highlights!

Vendors hit up the Mixed Reality hack big time

Microsoft, NReal and Magic Leap were just some of the vendors hitting up the hack and also giving away free gear to the most dedicated hackers (darn them).

Seems Sean Ong grabbed the NReal glasses, arguably the coolest looking headset available at the moment

Carlos C managed to grab the one and only Varjo devices, these are a premium alternative to the Oculus Quest and looks totally awesome (just a few more pennies)

Time for downtime

A big feature of the Mixed Reality hack is the space which has been carefully crafted for devs who just need to kick back and free their minds.

And of course, a place to rest those busy minds as it's another long hack fest

Wishing everyone the best

Hope everyone has fun whatever they are doing and hoping to get more out of the world of XRTK next week (although unlikely as everyone will likely be sleeping!)

Log in or sign up for Devpost to join the conversation.

posted an update

XRTK developer update 11th Jan

Well, it's been another bust week in XRTK after the holiday breaks and as ever everything is accelerating forward. Here are the top topics of note this week:

Yet more vendor interest

Another vendor joined our ranks in opting for XRTK support for their products, to date that makes 4 specific vendors pitching in to support the XRTK. While we can't talk specifics due to NDA's, (Non-Disclosure agreements), these vendors range from new and upcoming headsets, visionary control systems and even XR marketplaces.

Expect to hear more once the vendors lift their respective embargos and we can talk more publically.

What is truly exciting is these vendors are seeking XRTK out, as another gateway to help developers build their cross-platform dreams. We do advise those vendors to see XRTK as another platform, some are looking to making XRTK their primary support mechanism for platforms and even pitching in to contribute back to the XRTK. Fun times indeed.

New XR content marketplace opens up an invitation-only Beta

One of the partners we've been talking to have thrown open their doors for honest and constructive feedback on their new platform. It's very early days and they are looking at ways to provide the best service they can to the Mixed Reality community for building XR solutions. Check the XRTK Discord for more info

This ranges from an extensive XR marketplace, where consumers will be able to purchase XR content, but creators will also be able to publish and monetise their own content, with a roadmap to also expand this into building whole XR experiences on the platform.

It's truly an exciting time and even if you don't have plans yet in this area, I encourage all XRTK devs to jump in and guide them on the right path. If there is something missing or something you are going to need in the future, help provide feedback if you can.

Hands support edges closer

This is something likely to be in every week, just because of how exciting it is. The whole community is pitching in to ensure the hand's solution for the XRTK is as streamlined as possible, all possible due to Dino Fejzagic (who most of the XR community met at the MR developer summit in London last year) who is tirelessly tailoring his craft in this large contribution.

Already there is editor and Lumin support and Dino announced he had Oculus hand tracking working. There is still a fair road to the finished solution but this marks a unique jump forward simply due to the complexities that Oculus brings.

Every platform has it's unique differences, and this is where XRTK excels to unify all these capabilities into a single solidified experience. Hands are just another type of controller to XRTK, so once you build a solution using controllers, then hands fit right in.

Roundup

Keep on building those experiences and join in the XRTK family to help build this into the one toolkit for the community. Build it once and ship EVERYWHERE.

Log in or sign up for Devpost to join the conversation.

posted an update

In the Beginning

In the run-up for publically talking about XRTK, it's important to talk about the roads we took to get here and believe me, it's a LOT.

Apart from the base framework that enables a true multi-platform mixed reality environment, we've created the foundations for a multi-tiered framework serving:

  • Beginner No Coding Required: Perfect for artists, Hackathons, and Quick Prototyping.

  • Intermediate Customizable: The framework is flexible enough so coders can customize what they need to cover edge cases with ease.

  • Advanced Extensible: The framework is easy to extend and modify to add additional custom services to meet specific criteria and needs.

To date, the developer population is largely in the Intermediate to Advanced stage with already multiple apps deployed to several stores built on the XRTK. The reason for this is simple, we need to ensure the base framework is fully fit for purpose and optimised for delivering efficient solutions. There have been many breaking changes in the evolution of the framework to meet the demanding needs of the various platforms we support.

Learning and teaching more

As we enter 2020, we feel the foundation has stabilised sufficiently that the framework is ready to get into more hands and to that end, you will see an explosion of education content and more "drag and drop" features (aka the SDK) appearing over the next few months.

Building partnerships

We've also been hard at work building relationships with multiple vendors and positioning the XRTK as the SDK to use for their products in addition to their own API's, this further accelerates XRTK's adoption and broad deployment story, giving you more placed that with a click of a button your project is readily available for more platforms.

The Roadmap ahead

As a sneak peek, this is what we have to look forward to in the coming months:

  • A new cross-platform hands system, which is thoroughly optimised and extensible
  • Vendor collaboration with more Hands "providers" including some image-based recognition for mobile ar
  • New and improved platform recognition system, mainly to cope with everyone using Android (but a little different each time)
  • An extended Input Action System that is more scalable and allows more precise behaviours (more on that later)
  • The first wave of new SDK features
  • More documentation, more tutorials, more videos... You get the picture.

And so, on to 2020 and the sheer explosion that is Mixed Reality. Remember, it's not just AR, it's not just VR, it's everything, everywhere and on as many devices as you like with a flick of a switch.

Log in or sign up for Devpost to join the conversation.

posted an update

Welcome to the XRTK Development Log

Welcome one and all to 2020 and the beginning of the public journey for the XRTK.

We've been hard at work on the core framework for the past few years, initially only for Microsoft and now separately for the community, expanding our platform support every few months. We've also been hard at work with several platform vendors and hope to announce something about those plans later in the year. It's truly an exciting time to get on board the Mixed Reality train.

Expect to hear a lot more from us this year as we shift cycles into more community-driven features such as:

  • Hand Tracking (HoloLens 2, Magic Leap, Oculus, Leap Motion and even Mobile AR)
  • Integration with Microsofts WebRTC and Spectator projects
  • Expansive SDK features and common reusable components for prototyping and rapid development
  • Rich experience projects to showcase building Mixed Reality Experiences

Onwards to 2020

Hoping to get a post out each week on a Monday to give a recap of the adventures of the previous week, so stay tuned.

Log in or sign up for Devpost to join the conversation.