S-tardus-T

Inspiration

This project was inspired by my cousin, who is paraplegic. Watching him go through physical therapy showed me how repetitive and discouraging rehab can feel, especially for kids. I wanted to create something that turns therapy into something engaging and motivating.

What it does

S-tardus-T is an AI-powered physical therapy game where children use their body movements, captured through a webcam, to control a spaceship. Players reach for stardust and avoid obstacles, helping improve mobility while having fun. After each session, the system generates a report for therapists based on the user's movements.

How we built it

We built the game using the Canvas 2D API and vanilla JavaScript for the gameplay. MediaPipe Pose was used to track body movements in real time through a webcam. We mapped hip movement to steering and wrist movement to interaction. We also implemented telemetry tracking and used an AI API to generate post-session clinical summaries.

Challenges we ran into

One of the biggest challenges was ensuring accurate and responsive movement tracking using only a webcam. Small delays or inconsistencies could affect gameplay. Another challenge was designing the game to be accessible for users with different ranges of motion.

Accomplishments that we're proud of

We successfully created a working prototype that combines real-time body tracking with an interactive game. We also built a system that turns gameplay data into meaningful feedback for therapists.

What we learned

We learned how to integrate computer vision with game development, as well as how important accessibility and adaptability are in design. We also improved our collaboration using structured GitHub workflows.

What's next for S-tardus-T

We plan to improve accuracy, add more game levels, and expand customization for different therapy needs. We also want to partner with therapists to test and refine the system in real-world environments.

Built With

• ai/llm-api-for-clinical-report-generation
• canvas-2d-api
• github
• html/css
• javascript-(vanilla)
• mediapipe-pose-(tensorflow.js)
• vite
• web-apis-(webcam)