Visio Auxilio

Inspiration

I was introduced to Software Development as a way positively impact the world. No matter how big or small, every bit counts.

What it does

Assists the visually impaired in order to better navigate the dynamic environment around them.

How I built it

I utilized the power of Unity3D to quickly prototype my bare-bones idea that was powered by Google's ARCore plugin for Android.

Challenges I ran into

I originally wanted to use ARToolKitX, however, I spent 3-4 hours trying to get it to work and I had to call it and switch to ARCore. ARToolKitX was my first goto as I wanted to find the most cross-platform solution that could work on any device even low spec devices (economically friendly).

Accomplishments that I'm proud of

Getting a prototype to work and getting some auditory feedback about obstacle distance.

What I learned

I should dive deeper into Computer Vision to build or use a model to extract depth information from a single 2D image. Certain models are not mini-fied and require powerful GPUs to run, this would be an interesting challenge to bring it mobile device (especially low-end devices).

What's next for Visio Auxilio

I would like to continue to work on this and build my own TensorFlow model that just extract depth information to a certain degree in order to begin drafting up better ways to solve this particular problem.

Built With

• arcore
• c#
• unity