TykeAI

• 

  TykeAI - the NPC navigating & conversing inside my home.

Inspiration

My inspiration was my late best mate, my dog Tyke. He had been in bad health for a while and I knew his time was limited. Without fully realizing it at the time, I started this project seeking the companionship I was about to lose.

What it does

TykeAI features an AI powered NPC buddy that can automatically AI navigate inside a scanned room, including being able to sit and stand, and go for walks with the user outside. The NPC can also perform image recognition so it can analyze its surroundings.

How we built it

First, learning the basics of VR/MR development and Unity, then gradually iterating the project until goals were reached.

Challenges we ran into

Getting the AI navigation right using Meta Scene API and Unity AI navigation was challenging as a newcomer to these tools. So was creating the logic for the outdoor walking. As the outdoor mode doesn't use any Scene or boundary data I had to be creative in how the NPC copes with varying terrain.

Accomplishments that we're proud of

I think the app does something I've not seen before in a standalone or PCVR app.

What we learned

Lots about the Meta SDK's, lots about Unity, lots about various AI based API's, and not to give up.

What's next for TykeAI

Refining what is there, and adding to it such as more abilities for the NPC.

Note

I've put TykeAI on Patreon for $2. Reason being is that it costs monthly AI API calls that I must pay so I need to cover this.

Built With

• api
• c#
• inworld.ai
• meta
• sdk
• unity