Penang, a humble island from a country named as Malaysia. It's equipped with fascinating heritage buildings, mural paintings & arts, food and a mix of cultures and traditions from the local Penangnites. However, the tourists/customers' experience is bad as the content such as mural paintings & arts are not constantly updated. Besides, feedbacks for the improvement of Penang Streets are lacking as locals are not tech savvy here to utilise technology to gather information.
What it does
An easy to use web app which contains all local information of Penang such as location of mural paintings/arts. Users can Spark AR/Facebook Camera to interact with the AR content on a targeted location/marker. Besides, AR can pop up feedback form to prompt visitors to type feedback to be saved into database of PGCON App
How I built it
Web App is fully built with React & Semantic UI with Firebase as PaaS. Spark AR is being used to generate AR content. Adobe Mixamo is used to render 3d models with animations.
Challenges I ran into
Lack of time to complete more features for the benefits of tourists to Penang. Coronavirus causes a few delays of outdoor shootings schedule. Wish Spark AR to provide more SDK such as allowing developers to add 3D objects programatically. We have to split image marker into three filters as we are not able to change the marker programtically.
Accomplishments that I'm proud of
Manage to build a functional MVP with the help of Spark AR. Tweak, hack possible solution to build PGCON App
What I learned
Spark AR & how Three JS is important to be used in Immersive media ( VR & AR )
What's next for PGCON App
Connecting to Firebase datastore. Collect feedback from Spark AR (Editable Text) and proceed to save to Firebase.