RUTURO

• 

  architecture diagram

Inspiration

One of my teammates went through a difficult journey with undiagnosed OCD in his knee. Despite repeated visits, the healthcare system failed to recognize his condition, leaving him in constant pain and uncertainty. Watching him struggle, feeling unheard and unseen, made us realize how many others might be silently suffering. That experience became the spark for RUTURO. We wanted to create a personal AI health companion that truly understands people in real time, offering care and support when the system cannot.

What it does

RUTURO is an AI-powered XR health companion designed to sense, interpret, and respond like a “sixth sense” for healthcare. It monitors vital signs, recognizes emotions, tracks fatigue, and adapts to gestures and posture through Passthrough Camera Access and computer vision. Instead of just collecting data, it builds an empathetic connection, ensuring users feel supported and understood every step of the way.

How we built it

RUTURO combines robotics, edge computing, and cloud-based AI services into a seamless ecosystem. Our physical health companion, RoTM, integrates sensors, cameras, and motors powered by Raspberry Pi for real-time health analysis. BRoTM, our cross-platform app, delivers personalized dashboards, detailed reports, and actionable insights. Extending these capabilities into XR with PCA allows RUTURO to achieve real-time environmental awareness and adaptive interaction, bridging the gap between technology and human care.

Challenges we ran into

Creating a system that could detect subtle health signals with high accuracy proved complex. Maintaining low latency while processing XR data in real time required significant optimization. Balancing cost, computing power, and scalability with cloud resources was a constant tradeoff. Designing interactions that feel natural and empathetic, rather than cold and clinical, pushed us to rethink the user experience.

Accomplishments that we are proud of

We built a fully functioning prototype of a context-aware health companion. We secured cloud credits from Microsoft, AWS, and OpenAI to scale and test our solution. We were recognized as one of the Top 3 solutions nationwide in Intel’s Global AI Impact competition. We validated our concept across healthcare, industrial, and service applications.

What we learned

Healthcare is about much more than numbers. It is about empathy, context, and providing timely support. Passthrough Camera Access combined with AI has the potential to transform XR into an everyday lifesaving tool rather than a novelty. Building adaptive ecosystems requires blending robotics, AI, cloud, and human-centered design into one holistic vision.

What’s next for RUTURO

Our next steps include advancing gesture recognition and emotion analysis, forming telemedicine partnerships, and adapting RUTURO for elderly care and chronic illness management. Ultimately, our vision is to create the world’s first truly empathetic AI health companion — one that is accessible, affordable, and indispensable in everyday life.

Built With

• android
• aws-(s3
• aws-rekognition
• azure-cognitive-services
• c++
• docker-for-containerization
• ec2)
• edge-ai-deployment
• fastapi
• firebase-realtime-database-apis-and-tools:-openai-api
• flask
• github
• ios
• javascript
• lambda
• langchain-platforms:-raspberry-pi
• languages:-python
• node.js
• openai-api-databases:-mongodb
• opencv
• postgresql
• pytorch
• react
• rest-apis-other-technologies:-robotics-kits-with-servo-motors-and-sensors
• typescript-frameworks-and-libraries:-tensorflow
• vercel-for-app-deployment
• web
• webrtc
• xr-headsets-with-passthrough-camera-access-cloud-services:-microsoft-azure-ai-studio