Inspiration

The inspiration behind Flexi stems from the growing need for innovative healthcare solutions that can enhance physical therapy and rehabilitation processes. We recognized that many patients struggle with tracking their progress during rehabilitation, and therapists often need better tools to assess and monitor their patients' movements remotely. This gap in the healthcare industry motivated us to create an app that utilizes PoseNet technology to address these challenges.

What it does

Flexi is a cross-platform mobile application available on iOS and Android that leverages PoseNet technology to detect and analyze body movements. Its primary purpose is to assist patients in their rehabilitation journey and provide healthcare professionals with valuable insights into their progress. Here's what Flexi does:

Pose Detection: Flexi uses PoseNet, a deep learning model, to track the user's body movements in real-time. It captures key joint positions and body postures with remarkable accuracy.

Progress Tracking: Users can record and compare their movements over time. Flexi stores these movement data points and generates reports to visualize improvements or setbacks. This empowers patients to take an active role in their rehabilitation.

Therapist Dashboard: Flexi offers a separate dashboard for healthcare professionals, allowing them to remotely monitor their patients' progress. Therapists can view patient data, set goals, and provide feedback through the app.

Exercise Library: Flexi comes with an extensive library of rehabilitation exercises and tutorials. Users can access detailed instructions and videos for each exercise, ensuring they perform them correctly.

How we built it

Flexi was developed using a combination of technologies and methodologies:

PoseNet Integration: We integrated PoseNet, an open-source pose estimation model, into the app. This allowed us to accurately track and analyze body movements.

Cross-Platform Development: We used frameworks like React Native to create a cross-platform app that works seamlessly on both iOS and Android devices, reducing development time and effort.

Backend Development: We set up a secure Firebase to store and manage user data, exercise libraries, and therapist-patient interactions.

User Experience Design: A user-centric approach was taken to design the app, ensuring an intuitive and visually appealing interface.

Data Visualization: We employed data visualization libraries to create informative progress reports and charts for users and therapists.

Challenges we ran into

Building Flexi came with its fair share of challenges:

Pose Detection Accuracy: Achieving high accuracy in pose detection was a significant challenge, as it required fine-tuning and optimizing the PoseNet model to work effectively on mobile devices.

Cross-Platform Compatibility: Ensuring the app performed consistently on both iOS and Android devices demanded meticulous testing and debugging.

Data Security: Safeguarding sensitive patient data and ensuring HIPAA compliance posed a substantial challenge.

User Engagement: Encouraging consistent use of the app by patients throughout their rehabilitation journey was challenging. We addressed this by incorporating gamification features.

Accomplishments that we're proud of

The moment that color changed to green it was a sign that the logic I made was working!

What we learned

Posenet and integration of Posenet with mobile devices

What's next for Flexi

Duplicating for all muscle groups, and extending the app to wearable devices

Built With

Share this project:

Updates