Aria

Mobile app facilitating communication and health motivation for space-goers using gamification and a cute buddy to guide you through the entire process!

Comment

Inspiration

The squirrel outside the Nokia building... And Project Hail Mary! (As well as the recent Artemis mission)

What it does

Helps voyagers and space-goers navigate mental and physical health challenges by connecting them with memories and returning them to routine. Gifted help with Aria! A small AI agent who will help in motivating cosmos-explorers to take care of themselves and get their tasks done. Mitigates risks of heightened anxiety, depression, sleeping disorders, and physical responses such as muscle atrophy.

Design Process

  • We brainstormed an idea, talking around with teammates and doing some research
  • We then drew rough wireframes of the predicted UI and built a rough PRD
  • We audited the PRD and drew High-Fidelity Figma Mockups in collaboration with our Artist to land on a theme
  • Designed a standardized component library and implemented a modular code system using Expo (React Native) with Swift Modules for Interacting with IOS native SDK's (RealityKit, RoomPlan, ArKit and HealthKit)
  • Continued coding with the help of documentation and Continued drawing and designing (also with inspiration from UX designers and other Artists!)
  • Made the coder review the UX design of the app (because they've never seen it) and there navigation and heatmaps are important in improving it
  • Improved UX and Coding
  • Finished!

How we built it

React Native Expo, Typescript, JavaScript, Swift, Reality Kit, Room Plan SDK, Eleven Labs API, Vercel AI SDK, PostgreSQL and S3 storage across a CDN. Design and assets: Blender, Figma, Autodesk Sketchbook.

Challenges we ran into

  • First time experimenting with AR type stuff -- it was difficult to manage to get running.
  • Device testing was limited to devices with Apple's Lidar.
  • First time trying Blender (for everyone), we took a while attempting to learn how to use it and did end up with a usable model for Aria in AR mode!

Accomplishments that we're proud of

  • Getting it to work. At all.
  • Learning the ElevenLabs API
  • Succesfully bridging swift native and expo module
  • First time figma-ing everything before coding!

What we learned

  • Gained more experience with Blender and various AR tools.
  • Gained experience with working with other team member
  • React Native and Expo combining with Swift Modules!
  • Adoptive Svgs!
  • Making actual AI agents with context, memory and custom built MCP's

We genuinely learnt a lot from this hackathon, transferrable skills in particular like problem solving and teamwork. We hugely thank the organizing team and sponsors for making this happen, as well as Judges for listen to us stutter and last but not least the Volunteers who made this event happen. Thank you all!

Share this project:

Updates