ExpoAR

echoAR Console Models-1
echoAR Console Models-2
echoAr Console Metadata

Inspiration

We wanted to help create an experience that could keep participants engaged even if events are remote or they are not able to attend in person. Especially with the circumstances created by the current pandemic, we saw the opportunity to help supplement remote networking events by creating a virtual experience where participants could feel like they are visiting company tables/booths in person.

What it does

ExpoAr allows users to switch between the swag and info of different companies replicating the experience one would have at an in person convention or hackathon. It provides users with the option to pick between seven well known companies including Facebook, Google, and Microsoft. When a user selects a company and a target surface, the app projects the swag that the companies are sending for the event onto the surface in front of them. Users can look at the different items and switch to other companies.

How I built it

We built this app using Unity to create the AR app and distribute to mobile platforms as well as echoAR for hosting our 3D assets and metadata. We used different public resources to collect 3D models and even customized some of our own. Using echoAR, we were able to categorize our models by different companies and using scripting in Unity we were able to query for company specific content depending on user input. EchoAR also provides real time scaling and positioning for our app. Unity AR Foundation was used for its plane detection and anchor management so that we could provide users the ability to select a target surface and render the EchoAR content to the specific location. We used some initial samples from Unity to get us started with this AR framework.

Challenges I ran into

The team had not previously worked with these technologies before other than some brief Unity experience. The initial challenge was learning about AR development and the terminology that is used when documenting the technology. We had to learn how to use AR foundation and create custom scripts that provide certain tracking behavior for the user. echoAR was a new technology as well and we faced challenges when it came to properly organizing and scaling our models. Documentation was a bit scarce on the front end so part of the challenge was being able to review different sources and figure out how to create the behavior we wanted. Another challenge we faced at the end of the project was long wait times when querying our database. This results in an extended amount of waiting while we obtain the model data so that Unity can render it. This is definitely something we would want to address as having quicker loading times would help improve the user experience.

Accomplishments that I'm proud of

The team created a working AR app with no prior knowledge or experience. From front to back we were able to learn how to use AR Foundation and connect to echoAR on the back. We are proud to have been able to create an experience that leverages these technologies and allows us to dynamically render content for the user based on their input.

What I learned

I learned about AR development in general and the various applications of it. Essentially learning what's possible with different frameworks and SDKs. I also learned how to deploy mobile apps from Unity and work with AR Foundation which is Unity's in house AR framework. I learned about backend services for AR/VR apps through echoAR and how these technologies can help build experiences by allowing for dynamic content with ease of use.

What's next for ExpoAR

ExpoAR is an idea that can grow into a larger scope than showing off company swag. It can incorporate more custom content from all the companies helping them bridge the connection with the students and professionals they want to connect with. We would also want to target other aspects of these events that people might be missing out on because of the pandemic or inability to intend in person. Aspects such as engaging with other participants through augmented experiences. Expo AR can help organizations connect participants and companies no matter where in the world they might be located.