aerodance.

Inspiration

Aerodance was inspired by Just Dance-like games and systems like the Wii and Xbox Kinect.

What it does

Aerodance is a motion-tracked dance game in a Frutiger Aero style for one or two players. Players copy the moves of the dancers on screen and earn points based on how closely they match. The player with the most points wins.

Players also have the option to connect through Solana for dance battles. The players scan a QR code to join as dancers or as the crowd. The crowd can send the dancers SOL to hype them up mid-dance. When the battle ends, the result is recorded and the winner receives an NFT trophy. Everyone will see the results by text. The phone number connected is the wallet for the users connected.

How we built it

Game: built with React and three.js, running in the browser. Everything, including the menus, is drawn in 3D to get the Wii-style look.
Motion tracking: MediaPipe tracks the players’ bodies, either from a webcam or from an IoT camera over Wi-Fi.
Scoring: we compare the angles of the player’s arms, legs and body to the dancers on screen every tenth of a second.
Battles: an Express and Socket.IO server keeps phones and the game in sync, and a TimescaleDB database stores the results.
Solana and texting: a separate service handles the wallets, SOL transfers, NFT trophies and on-chain results. It texts players through Photon’s iMessage bot.