Inspiration
I'm a nerd who always wanted to play D&D but didn't have friends to play with. This hackathon gave me the opportunity to build the perfect solo D&D experience. Now any nerd can have epic adventures with AI companions anytime.
What it does
NeuroDungeon lets you speak naturally to AI D&D companions with unique voices powered by MiniMax Speech-02-HD. Real-time D&D content via Linkup.so provides rules, monsters, and campaign inspiration. Auth0 handles secure user profiles while autonomous AI party members (dwarf, elf, rogue, cleric) create immersive adventures.
How I built it
Used python pytorch anthropic to build multi agentic system and multimodal for craeting different players andsystems.Next.js frontend with Web Speech APIs for voice interaction, FastAPI backend for game logic. MiniMax Speech-02-HD generates unique character voices, Linkup.so provides real-time D&D content. Custom AI prompt engineering creates distinct personalities for each companion. Ampify to scrape data through website to get different scenarios and all.
Challenges I ran into
Synchronizing voice generation with real-time gameplay without audio overlap or delays. Making speech-to-text feel conversational rather than robotic command input. Integrating 4 different sponsor APIs (MiniMax, Linkup.so, Auth0, Apify) seamlessly in one experience.
Accomplishments that I'm proud of
Revolutionary voice interaction - players speak directly to AI companions naturally like real conversations. Successfully integrated 4 sponsor technologies creating the ultimate solo D&D experience. Created immersive audio with unique character voices that feel authentic.
What I learned
Speech recognition transforms gaming when implemented thoughtfully for natural conversation. AI companions need distinct personalities and voices to feel authentic in roleplay. Real-time voice generation requires careful queue management for smooth dialogue flow.
What's next for NeuroDungeon
Campaign persistence to save long-term adventures across sessions. Full D&D character progression with leveling, stats, and abilities. Multiplayer expansion allowing human friends to join AI party members.
Log in or sign up for Devpost to join the conversation.