Inspiration

  • Gorillaz’s live AR performance over Time Square in New York, in 2022.
  • Canadian artist Justin LeDuc's digital aniamtion of a gigantic Grim Reaper at Golden Gate Bridge in San Francisco, in 2018.

What it does

  • Location-based animated AR show that reveals a gigantic Grim Reaper cloaked in camouflage, wandering around Taipei 101.
  • It visualizes Taiwan-Strait-Geopolitical Risk Index 1985-2022, in a creative and dramatical way, to show the public the deteriorating truth and reality of military escalation risk in Taiwan, where China and the US on a collision course for war.

APP Instruction

https://docs.google.com/document/d/1Qe2yIS1weNBmWhJf13HYs5RAdmMJrU2oBZP-FMoBIpo/edit?usp=sharing

How we built it

  • Designing, rigging, animating character in Maya
  • Retrieving 3D model of Taipei 101 from Google Map for occlussion culling.
  • C# coding, compositing, and ARCore Geospatial API integration in Unity.
  • Developing a calibrator for audience, allowing them manually aligning occlusion culling to get better individual viewing experience.

Challenges we ran into

  • Occlusion culling offset constantly happens when the character make a contact or walk behind the skyscraper, which impairs UX and limits artist's creativity.
  • The screen turns up black when testing to one of our Android phones (Samsung Galaxy A23). It can only be fixed temporarily by re-installing 'Google Play Service for AR'. The problem will happens again next time if quitting the APP.

Accomplishments that we're proud of

  • First-time experiene of the ARCore Geospatial API, applying to an animated AR show.
  • Using the techniques to tell the most important story/fact that happening in our home island.

What we learned

  • ARCore Geospatial API is way better than GPS in location-based AR. It looks quite promising in marketing, navigation, game and entertainment.
  • The occlusion culling offset most likely happens when camera aims at high angle, too much camera movement, or the viewing position far from the target location, which is a ground geographic position.

What's next for Taiwan Geopolitical Risk

  • To improve UX by alternative ways of auto alignment techniques to avoid occlusion culling offset.
  • To expand the project into a location-based game or live AR show that applying ARCore Geospatial API.

Built With

Share this project:

Updates