Therapute

Inspiration

In today’s world, accessing comprehensive physical and sports therapy is challenging due to high costs and limited support between sessions. Traditional methods often involve spaced-out appointments, leaving patients reliant on at-home therapy exercises to advance their rehabilitation. These exercises may include potentially risky maneuvers such as dumbbell thrusts, deadlifts, or weighted internal rotations, which, if performed incorrectly, can impede muscle regrowth, hinder recovery, and cause reinjury. This lack of personalized guidance not only prolongs the rehabilitation process but also poses risks to patients' physical and mental well-being.

What it does

Our solution, Therapute, aligns with the United Nations' Sustainable Development Goal of ensuring healthy lives and promoting well-being for all, at all ages, specifically targeting the decrease in the proportion of the population with musculoskeletal disorders, one of the most common disorders in the worldwide (especially in the Western world). We were motivated to address this goal and target due to the exorbitant costs associated with physical therapy, the high rates of reinjury during PT, and the lack of cohesive platforms to bridge at-home exercises to spaced-out physical therapy sessions. By tackling these challenges, we aim to contribute to global well-being by promoting healthier, less pained individuals worldwide, fostering innovation and productivity as more people can actively engage in creating solutions to global problems. With our custom time-warping algorithm, Therapute is able to analyze the exercise form of patients and provide them with valuable intuitively visualized insights describing their errors and showing them an improved path to recovery. Patients are able to document any pain or difficulties they face during their exercise with our LLM model. The patient's physiotherapist is able to track their patient's progress and keep track of important insights such as their most common exercise errors and effectively analyze their trajectory on their path to recovery and diagnose/prevent potential reinjuries early on.

How we built it

Therapute, our advanced physical therapy tool, initially hosted on Google Cloud Run, transitioned to Microsoft Azure for enhanced capabilities. Azure App Service managed our frontend built with React, Next.js, and TypeScript, ensuring a responsive and interactive interface. For the backend, a Flask server integrated with MediaPipe and OpenCV facilitated pose analysis, employing Dynamic Time Warping and time series prediction for accurate form detection. Azure Machine Learning powered our AI-driven analysis. Azure Cosmos DB securely managed user data, while Azure Cognitive Services enhanced user experience. Azure Monitor ensured platform reliability. This transition streamlined development, improving performance, and positioned Therapute to revolutionize physical therapy with its seamless user experience and advanced features.

Challenges we ran into

We ran into challenges with storing video footage on the cloud as we expanded Therapute into an end-to-end web application as we wanted to ensure maximum efficiency while also maintaining privacy and cybersecurity standards to protect our users' data. We settled on utilizing Azure blob storage and media service to ensure that we can access exercise videos easily for analysis and have a secure way to store them on the cloud. The compatibility of these services with the other Azure services that we are planning to implement in the future also makes them a perfect fit for Therapute.

Accomplishments that we're proud of

We're proud of creating an app that can transform the lives of patients seeking physiotherapy. Our inspiration for Therapute stems from firsthand experiences witnessing the debilitating effects of musculoskeletal conditions on family members and recognizing the critical importance of swift and effective intervention for both individual well-being and global development. After consulting numerous physiotherapists at 6 clinics across the Atlanta and Orlando Metro areas, we were able to pinpoint our main action items as creating an effective model for detecting form errors and equally importantly, designing a system that makes such errors intuitive for patients to understand and learn from. We are proud of being able to deliver on this MVP and expand Therapute to transform the rehabilitation process; we are getting closer to our goal of enabling physiotherapists to gain deeper insights into the quality of their patients' exercise routines and better track their progress over time, decreasing the risk of reinjury.

What we learned

We learned an immense amount about hosting and model deployment as this was our first time creating a full-stack web application that runs a model on the cloud. Apart from the various Azure products that we learned to use through this project, we also learned about the physiotherapy industry and the kinds of insights that would be useful for patients and therapists alike. From our talks with med tech experts at Elevance Health, we were suggested to improve our model by utilizing dynamic analysis rather than static analysis which we utilized when initially creating Therapute. We began to focus on creating a model that analyzed a patient's range of motion rather than checking for static instances when set thresholds were broken. This allowed us to provide a level of insight that is similar to the methodology through which a physiotherapist would assess their patients. This understanding allowed us to increase the value of our product multifold as Therapute was now able to simulate the level of judgement that a physiotherapist would utilize, allowing us to get closer to our mission of providing the best exercise form correction and injury mitigation for patients right from the comfort of their home.

What's next for Therapute

Moving forward, the next steps for our project involve collaboration with physical therapists to introduce our app into beta testing trials. By partnering with professionals in the field, we can gather real user data and utilize it to enhance our models, ensuring accuracy and efficiency in assessing exercise performance. Additionally, expanding the repertoire of exercises covered within the app is crucial. This will not only improve the platform's utility but also attract a larger audience seeking diverse exercise options. To reach a broader audience, we plan to further expand our solution in several ways. Firstly, incorporating a wider range of exercises onto the platform will cater to the diverse needs of users, making it a comprehensive tool for various fitness goals and rehabilitation requirements. Partnering with multiple physical therapy clinics will enable us to assess their clients' satisfaction with our product, building trust and credibility within the healthcare community. Moreover, establishing a strong customer base through targeted marketing and outreach efforts will be essential before launching the platform into the market. By strategically expanding our solution and fostering partnerships, we aim to reach a larger audience and make a positive impact on individuals' fitness and rehabilitation journeys.