Yeongrak Choi is a DevC (Facebook Developer Circles) lead in Seoul, Korea. He has had organised over 70 community events just not with DevC local events in Korea. He came to this hackathon with a goal of really wanting to help users to engage more easily and through different ways or medium. Cheryl has cool experiences with developing 3D games, and Yeonsoo is very eager to realize our software idea with beautiful designs.
Over our discussion on how we can utilize Facebook technology/features and its platform to help DevC communities and communities alike, we decided on accomplishing this in a unique way (i.e. a path less traveled), and settled on integrating augmented reality (AR). By using 3D visualization we hope to encourage more interactivity among community individuals e.g. by making location information enjoyable for (physical) offline events. Overall increasing community participation (keep loyal individuals and attract new attendees) and the effect of making community events fun and unique.
What it does
- To demonstrate how all kinds of communities could use the technologies we've used to make AR experiences to make their event unique and engaging.
- We complished this by using augmented reality to bridge offline community events with online event specific information.
- A Visualization of where the event venue is through augmented reality.
- Detailed visualization of where the event room is inside the event building through augmented reality.
- An AR tool for finding empty seats in an event room via augmented reality technology.
- Placing these suite of AR tools inside a
Chatbot(Facebook Messenger Platform), a one stop place for all event related information.
How we built it
- We implemented augmented reality using Facebook AR Studio.
- Connect our augmented reality experiences onto a chatbot in which we created Facebook page as a prototype via Facebook developers.
- We defined very helpful use cases which could help participants (e.g. get their questions answered in a more interactive way) and to promote interactivity in offline community events (invoke exploration in participants), and realized those idea as chatbot prompts.
Challenges we ran into
Facebook AR Studiohas many cool capabilities especially around making face animations/experiences. AR world interaction and
Facebook Dating Featurementioned by Mark during the F8 keynote was really a teaser and we couldn't use it at all.
- Having both front and back cameras on for AR does not work (OS level permissions related).
- We weren't allowed early access to the Target Tracking API and had to find work arounds to demonstrate our ideas. This ideas will be full functional when these APIs and bugs in AR Studio gets fixed.
- Chatbots cannot not ask permission to use a user's front/back camera. In other words, chatbots can open another application within Facebook, not yet at least.
Accomplishments that we're proud of
- Completing AR experiences.
- Chatting with Facebook people about our ideas and be surprised that they liked them and thought it would be cool to have it in beta.
- Stay up all night !
- Using tools we would have not used before.
- Working with an international team in an international environment.
- Not over eating ...
What we learned
- AR is super approachable for beginners like us, which happened to our first time doing AR.
- AR Studio is relatively young and using Unity would have been more preferable.
What's next for community-events-with-ar
- The release of Target Tracking Capabilities for AR Studio
- Real life application of our proof of concept!