Inspiration

Every year, 1 in 4 seniors experiences a fall, making it the leading cause of injury-related deaths among older adults. According to the CDC, every 19 minutes, a senior dies from fall-related injuries. This heartbreaking reality costs the healthcare system over $50 billion annually, while also robbing families of their loved ones' independence and confidence. For me, this issue is deeply personal. My grandmother was one of those affected. I witnessed firsthand how the fear of falling isolated her from social activities, eroded her strength, and diminished her quality of life. Falls don’t just hurt physically—they fracture families and sever connections. Balance+ was created to change this narrative. Inspired by the therapeutic benefits of Tai Chi and powered by AR technology, Balance+ turns balance training into an engaging, safe, and joyful experience. By incorporating family-centered play, we aim to rebuild not only physical strength but also the bonds that make life meaningful. Balance+ isn’t just about preventing falls—it’s about restoring independence, rebuilding confidence, and reconnecting generations.

What it does

Balance+ is a Tai Chi-inspired AR game designed to transform balance training into a fun, immersive, and collaborative experience for seniors and their families. Its key features include:

Single-Player Mode:

Seniors perform Tai Chi-inspired movements, gamified into balance challenges that help improve coordination and strength. The AI-enabled ankle band tracks pressure distribution and balance shifts, issuing real-time fall alerts via LED wrist notifications.

Family Collaboration:

Leveraging Spectacle's spatial connectivity, grandparents and grandchildren collaborate in a shared AR Match-Three game. Together, they find and match virtual objects in a shared space, subtly engaging in balance training while creating joyful, intergenerational connections.

Action-Feedback Loop:

Players receive immediate feedback as they interact with the game—whether it’s clearing levels, improving balance metrics, or achieving higher scores. This continuous loop of action and reward keeps the experience engaging and empowering. Imagine a holiday gathering, where families come together to play, laugh, and strengthen not just their bodies but also their relationships, all while addressing one of the leading causes of senior injuries.

How we built it

Balance+ was developed through rapid prototyping and tight collaboration between interaction designers, hardware engineers, and 3D creators. Here’s how we brought it to life: Hardware Innovation: We designed an AI-enabled ankle band using e-textiles and pressure sensors to monitor balance and predict fall risks. Real-time data is sent to the AR system to enhance gameplay and issue fall alerts via a connected wristband. Game Development: Using Unity, we developed a Tai Chi-inspired AR game optimized for Spectacle glasses. Blender was used to handcraft 3D assets and animations, ensuring an immersive and engaging experience. Social Connectivity: Spectacle's spatial connected features enabled synchronized gameplay, allowing grandparents and grandchildren to share a collaborative AR space. Overcoming Communication Challenges: We faced limitations with Snap's protocol for remote communication. After experimenting with WSS and MQTT, we achieved reliable one-way communication between the ankle band and Spectacle, enabling real-time interaction. Optimized Workflow: By iterating directly on device with Unity and Blender, we rapidly addressed performance issues, ensuring smooth animations, responsive gameplay, and lightweight assets.

Challenges we ran into

Technical Barriers: Integrating the ankle band with Spectacle glasses was challenging due to Snap’s limitations in remote communication protocols. After testing various approaches, we implemented a one-way communication workaround to achieve functional integration. Design Balance: Creating Tai Chi-inspired movements that felt intuitive for seniors while engaging enough for gameplay required extensive iteration. Time Constraints: Developing a functional prototype within 2.5 days required prioritizing features and streamlining workflows. Despite these challenges, we successfully delivered a working prototype that combines innovation with empathy, paving the way for future iterations.

Accomplishments that we're proud of

Functional Prototype: We transformed our concept into a working prototype within just 2.5 days. Intergenerational Impact: Testers praised the family collaboration feature, with one user describing it as “a beautiful way to reconnect through play.” Technical Innovation: Our AI ankle band’s real-time fall detection and integration with AR gameplay stand out as a unique and practical solution. Emotional Connection: The combination of safety, movement, and family bonding created a meaningful experience that resonated with users.

What we learned

The Power of Passion: With determination and teamwork, even ambitious goals can be achieved within tight timelines. Iterative Design Matters: Rapid prototyping allowed us to identify and solve technical and design challenges early. Empathy Drives Impact: Designing for seniors requires understanding their physical and emotional needs, ensuring the experience is both accessible and empowering.

What’s next for Balance+

This is just the beginning. Our vision for Balance+ includes: Enhanced Hardware: Improve sensor accuracy and responsiveness in the ankle band for more precise fall detection and balance tracking. Expanded Gameplay: Add more Tai Chi-inspired levels and motion challenges to diversify training and keep users engaged. Community Partnerships: Collaborate with senior centers, healthcare organizations, and rehabilitation programs to pilot Balance+ in real-world settings. User Testing and Feedback: Conduct comprehensive usability studies with seniors and their families to refine the experience and ensure accessibility. Scalability: Explore integration with other AR platforms and devices to broaden Balance+’s reach and impact. With Balance+, we’re not just preventing falls—we’re transforming rehabilitation into a shared, joyful connection that strengthens bonds and enhances lives.

Built With

Share this project:

Updates