AnatomyTutor

Gitlab: https://gitlab.com/studenteducation

Inspiration

As students, we’ve all struggled with trying to memorize anatomy from flat images or long videos. It’s overwhelming and sometimes hard to connect what you see on paper with real 3D structures. When we saw the Vision Pro, we thought: what if studying anatomy could feel like having your own tutor right in front of you, in AR? That’s how AnatomyTutor was born.

What it does

AnatomyTutor is an immersive study companion for medical and biology students on Vision Pro. It lets you watch recorded or built-in anatomy videos, take notes by typing or sketching, and even generate AI-powered summaries instantly. You can ask questions and get chatbot responses in real time, or explore detailed 3D anatomical models directly in augmented reality. It’s like having a personal tutor, a notebook, and a 3D anatomy lab, all in one app.”

How we built it

VisionOS + SwiftUI: Built the immersive interface for video playback, note-taking, and AR visualization.

ARKit + RealityKit: Rendered interactive 3D anatomical models that users can place and explore in their space.

Core ML + OpenAI API: Powered AI-generated notes and chatbot Q&A.

Drawing + Text Input: Combined pen-based sketching and keyboard input on the whiteboard.

Challenges we ran into

We ran into quite a few challenges with how to connect the backend that was communicating with A.I. to the front end with the VisionOS.

Accomplishments that we're proud of

We're proud that even though this was something nowhere near anything we've ever attempted before, we still gave it our best shot and learned about all new possibilities.

What we learned

We learnt quite a bit about how different languages and backend/frontend can communicate. We also learned how to work as a team and split up our tasks accordingly to our strong suits. We mixed the beloved and well-known Python and Visual Studio Code IDE with Swift and XCode which is a lot less utilized by students.

What's next for AnatomyTutor

We would love to continue developing this app with electronic components that students could practice building circuits while watching videos on how to do it so they could preform as many technical workshops as they want!