[T18] - PosturePomodoro XR

• 

  PosturePomodoro XR_Image 1

• 

  PosturePomodoro XR_Image 2

• 

  PosturePomodoro XR_Image 3

• 

  PosturePomodoro XR_Image 4

Inspiration

With the rise of remote work and increasing hours spent in front of screens, we noticed a widespread issue: poor posture, especially forward neck posture—something I personally struggle with—and its long-term health effects. Many workers, students, and gamers experience discomfort and pain due to unergonomic work setups. We were inspired to combine the Pomodoro technique, which promotes productivity through structured work intervals, with real-time posture correction to create a Mixed Reality (MR) solution that improves both health and productivity.

What it does

PosturePomodoro XR is an MR app designed to help users maintain proper posture and stay productive. It uses the Pomodoro technique to structure work into intervals and incorporates real-time posture monitoring via an avatar mirror that reflects the user's posture status. The app provides an ergonomic virtual workspace setup with posture reminders and offers gamified exercise breaks during Pomodoro intervals, encouraging stretching exercises to improve posture. Additionally, users can earn rewards for reaching Pomodoro milestones, adding motivation to stay engaged and productive.

How we built it

We developed PosturePomodoro XR using Unity and the Oculus Meta Movement SDK to capture real-time body movement data. The Posture Mirror and reminders are integrated alongside the virtual desktop in a passthrough environment. The avatar mirror reflects user movements, providing visual posture feedback, and the Pomodoro timer tracks work and break intervals. We also used passthrough and the Interaction SDK to create a hit-the-ball stretching exercise game, where the app detects the user’s camera position and spawns balls at the top area that can be reached by stretching their arms.

Accomplishments that we're proud of

We innovatively integrated the Movement SDK to address a health issue related to posture. Additionally, using gamification for targeted stretching exercises is novel. We’re proud of creating an engaging MR solution that integrates both health and productivity. The real-time posture detection feedback, gamified exercise breaks, and Pomodoro-based timer differentiate PosturePomodoro XR from other posture solutions by offering a more engaging, all-in-one strategy for productive and comfortable screen-based work.

Challenges we ran into

One of our main challenges was accurately capturing and reflecting real-time posture data in the MR environment. Ensuring the avatar movements were precise and intuitive required extensive fine-tuning. For now, we reference an initial proper sitting pose as the baseline for posture correction.

What we learned

We gained a deeper understanding of the real-world issues related to poor posture and productivity, and how MR can provide innovative solutions through empathy and user-centered design. We also improved our Unity development skills and enhanced our integration of the Meta Presence Platform, laying a strong foundation for future XR/MR projects with the latest SDKs and technologies.

What's next for PosturePomodoro XR

Moving forward, we plan to enhance the user experience by integrating AI/ML technology for more precise posture tracking and tailored feedback based on individual user data. We will expand the reward system for Pomodoro challenge milestones and introduce more gamified exercises. Additionally, we aim to further refine the project by integrating more SDKs, incorporating user habits to improve the experience for screen-based work and study scenarios, and enhancing the versatility and artistic quality of the gamified exercises.

Accuracy Improvement with Logitech MX Ink: We also plan to leverage the Logitech MX Ink pen to enhance accuracy. Users will be able to draw a mesh along their backbone, enabling detailed posture analysis with AI/ML integration. This will allow for more accurate posture tracking and insightful feedback. Additionally, users will be able to take body measurements by drawing along their physical body diameter, improving the ergonomic setup of their virtual workspace and ensuring precision in the stretch gameplay.

Built With

• c#
• meta
• mr
• quest3
• unity