Here is a solid, student-hacker style Devpost submission template for your team. It hits all your key technologies, keeps that authentic tone, and perfectly captures the scope of your project.
Inspiration We built an interactive, 3D neurosurgery simulator because studying from flat textbooks just doesn't cut it for medical students trying to prep for the real world. So here is the sign in, you can login to continously train and build repition and practice under high stress. We really wanted to create a platform that turns passive studying into verifiable mastery. We wanted to build something that bridges the gap between theory and the operating table.
What it does NeuroSim Pro (SurgiSim) is a fully interactive 3D surgical training platform. Once you log in, you enter a virtual operating room where you can interact with a 3D brain model. If you get stuck, you can hit the "AI Advice" or "Hint" buttons, which fires up a real-time AI mentor that speaks to you with low-latency audio to guide you through the procedure. Every interaction is logged and scored on a global leaderboard. Finally, when you successfully complete a module, the platform mints a verifiable NFT certificate directly to your crypto wallet to prove you've mastered that specific surgery.
How we built it We also implemented Gemma 4, ElevenLabs, Solana, Snowflake, Auth0, and MongoDB in our project. To keep everything fast, we bypassed a traditional backend and orchestrated everything using Supabase Edge Functions:
Auth0: Handles the initial user login and profile generation before you even hit the simulator.
Gemma 4 & ElevenLabs: When you ask for help, our surgical-coach edge function hits Gemma 4 for step-by-step guidance, and immediately fires up ElevenLabs to read it out loud in real-time.
Snowflake & MongoDB Atlas: Having a logging system is essential in every app. For every interaction, we essentially have the processes run in a way where the simulation starts and tool selections runs our log analytics edge function straight into Snowflake. Meanwhile, MongoDB Atlas saves your final session score and time.
Solana Web3: Our mint-certificate edge function connects to the Solana network to mint an NFT to your Phantom wallet when you pass.
Challenges we ran into The testing part of our application took us the longest! Getting seven different cutting-edge technologies to talk to each other inside a serverless edge architecture was a massive challenge. We also ran into huge Vite build errors when trying to get the Solana wallet adapters to work with our frontend, which required us to manually inject Buffer polyfills. Lastly, managing and securing all those different API keys and database credentials under hackathon time constraints was definitely a stressful learning experience.
Accomplishments that we're proud of We are super proud of it, especially the fact that we got the entire "demo arc" working end-to-end. Going from a secure login, into a fully interactive 3D canvas, getting real-time AI voice generation, and finishing with an automated blockchain transaction is a massive data flow. We're also incredibly proud of our serverless architecture using Supabase Edge Functions made the app incredibly snappy and eliminated a ton of server hosting headaches.
What we learned We learned how to string together multiple AI models (text-generation and text-to-speech) with minimal latency. We also learned how critical it is to have a robust logging system without Snowflake and MongoDB capturing every click and event, our leaderboards and scoring system wouldn't exist. On the Web3 side, we learned how to securely execute Solana RPC calls from a backend burner wallet to a user's frontend wallet adapter.
What's next for NeuroSim Pro Thank you and lets keep people safe. It's important doctors understand and build the muscle memory to perform these critical scenarios and make it more interactive. Next, we want to expand the library of surgeries, introduce multiplayer OR rooms so an attending physician can spectate a student live, and eventually port the whole 3D experience into fully immersive VR.
Built With
- auth0aiagents
- elevenlabs
- gemma
- javascript
- mongodbatlas
- postgresql
- react
- snowflake
- solana
- supabase
- tailwindcss
- three.js
- typescript
- vite
Log in or sign up for Devpost to join the conversation.