Taskotomo

• 

  Initial state of Taskotomo

• 

  when the OpenAI connection starts and creates steps for a task (entered in virtual keyboard)

• 

  we can then feed Tomo with our completed tasks (like a Tamogotchi!)

• 

• 

  you can organize steps in different visual ways

• 

  a different organization of steps

• 

  here a step is completed

• 

  and it turns into a find for our friend Tomo

Inspiration

I have ADHD so every little task becomes a hurdle for me. I wanted to create a fun Mixed Reality experience to help me get motivated to complete my boring chores and tasks. I was inspired by the Job Simulator, TV shows like Loki & Maniac.

What it does

It takes a written task (in the virtual keyboard) and with the help of OpenAI's api, automatically turns the task into steps. Each step then becomes a tangible block and can be completed with the headset on (uses Passthrough). Taskotomo is however similar to a Tamogotchi and you can feed it with the completed tasks (which when placed in the tomo device, become his brain food :) A little motivation if you're having hard time to complete boring tasks ;)

How we built it

I built it in Unity, using the new Meta Core SDK with the Interaction SDK, utilizing passthrough, hand tracking, virtual keyboard, interactables, OpenAI (ChatGPT & DallE).

Challenges we ran into

I still need to figure out runtime simulation, since I had to patch-build to the device for every little XR interaction. Keyboard was somehow hard to figure out and the main challenge was actually coming up with a design that is a bit of a smart device/agent but also can place tasks in tangible forms. I couldn't figure out recording screen capture with the passthrough mode on (so now the environment looks black)

Accomplishments that we're proud of

I think in the end, this is an interesting prototype to see how XR can be used to make 2D tools (ie. like a project management) much more tangible and immersive. It really has a strong cognitive effect, making our tools more interesting to use.

What we learned

XR can still be a little tricky to design and develop for, but there's also so much untapped potential! I'm definitely going to work on more ideas and prototypes.

What's next for Taskotomo

I'll fix some bugs (DallE connection works on my computer but didn't work on the device) and polish some other things (particles, sound, etc) and publish it the Quest store! And probably do some testing to see how anyone finds the tangible way of working :)

Built With

• chatgpt
• core
• dalle
• interaction
• meta
• openai
• passthrough
• sdk
• unity