[T25] - POEY | Devpost

POEY logo

Inspiration

Ever tried to find your doctor’s room in a hospital?

Or that one booth at the gaming festival?

Maybe the toy shop when the mall is about to close down?

POEY helps navigate you in complex environments such as hospitals, malls and convention halls. With her by your side, you won’t get lost next time in Comic-Con! In contrast to conventional virtual wayfinding solutions such as google maps's boring arrows, POEY is fun. Just don’t forget to give her apples. I’m serious. You don’t want her to get hungry.

What it does

Team roles

Alperen: Data Wizard

Berkay: Unity Headmaster

Talha: POEY

Javed: Seek and Deploy

Burcu: the Architect

How we built it

Custom Spatial Anchors are created on top of META’s space setup Spatial anchors are saved in our cloud system, telling POEY what’s where POEY uses our navigation system to bring you there

Spatial anchors: CUSTOM ANCHORS! We need to tag different rooms and store that info. Recognise how player navigates around, where the player is inside our map. Data Management: --but Burcu, META already stores anchor info, why need data management?-- What if the hospital / mall buys another headset? What if they need to reset the headset? Our custom anchors use cloud system (firebase) so even if the system loses data, we got you! Navigation: POEY needs AI Navmesh to bring us to our destination Our algorithm finds the shortest path between points

Challenges we ran into

First day we had trouble setting up the basics. We didn't own a Quest 3 so we first needed to get one. Once we got it, we tried hard to set it up. Thanks to our mentors and fellow hackers, we had the system running in a few hours. After that, we needed to still deal with connection issues, and we needed to figure out a quick way to build and deploy. That also took a while. Each team member had their own share of technical challenges. We tried to take a breath and stay reasonable. We asked for help when needed, and got the solution quicker than expected once we actually asked.

Also sitting for that long is hard.

Accomplishments that we're proud of

Running the Quest in mixed reality mode, adding basic interactions, building and deploy, and actually running it in our physical environment was an achievement in and of itself. And we loooooved seeing our logo appear.

What we learned

How to make a running app in MR! We are ready for other ideas! (At least until any updates from unity or meta's sides).

What's next for POEY

Uh. We have a long way. Getting the navigation algorithm to work smoothly, adding the room names with the virtual keyboard AND voice command, plugging in the AI kit to capture images and ask them to ChatGPT, using voice commands with POEY, adding consciousness to POEY, world domination, infecting cuteness and peace to the world, etc etc.