ARUDance is inspired by a “rhythm game” that challenges a player to sense the rhythm. This game typically focuses on dance or the simulated performance of musical instruments, and require the player to press the button in a sequence dictated on the screen.
What it does
You can play this filter with your feet. Simply scan the floor using a back camera, tap the screen, and follow the rhythm. There are four buttons with different colors that we have provided, you just need to step on buttons at precise times. The screen will show which button you have to step on for accuracy and for synchronization with the beat.
How we built it
Our idea is to create an alternative version of “rhythm game” on Instagram to make you keep moving and uplift your mood. We enable the effect on the back camera. We use plane tracking to place some kind of outline rectangle on the ground. The position and size of that outline rectangle can be adjusted so that it seems to appears right in front of our feet. Then, if we are ready to play, we can tap the screen to start the music. A series of rectangles will be moving closer to the outline rectangle. Then, we should step on when the rectangle and the outline rectangle are in the same position.
We developed the effect mostly by using the patch editor within Spark AR studio version 90. The 3D model is modeled using the Blender application. We implement the moving rectangle using a patch editor. We use a plane tracker to track the ground. All of them were done on a personal computer running Windows 10 with Intel Core i5 7th Generation and 16Gb RAM. The effect was tested using Instagram and the Spark AR Player application for Android.
Challenges we ran into
There are our challenges in the process of developing the effect
- Spark AR doesn’t support track our feet, so we can’t implement the point system
- Spark AR ground is not really stable if the ground is plain, so we created a function to move and zoom by panning and pinching the screen to adjust the position of the object.
- There is still a very little Q.A. forum available on the internet.
Accomplishments that we're proud of
We’re proud that we are able to develop the ARUDance with Spark AR. The reason is, we can bring happiness to people through dancing in this pandemic situation. Since we move our bodies around, it helps us to exercise at home. Also, people can share their excitement in Instagram and Facebook stories.
What we learned
We learned that there are still many idea and products which can be provided in the AR technology. This filter can make peoples enjoy their #stayathome moment.
What's next for ARUDance
All that we want for ARUDance is bringing a new experience for Instagram users and being the pioneer of “rhythm game” using Augmented Reality (AR) technology on smartphones.