Inspiration
🧩 Project Story – RealmWeaver 🎮 About the Project RealmWeaver is an asymmetrical multiplayer puzzle game where one VR Game Master dynamically crafts the world in real time, while multiple mobile players interact, collaborate, and survive using AR, voice commands, and clues.
The experience blends immersive technologies like Virtual Reality, Augmented Reality, and WebSockets to create a unique cross-device, cross-reality game.
💡 Inspiration The idea sparked from observing how escape rooms, puzzle adventures, and co-op games often lack asymmetry in roles. What if one player could be the god-like creator (using VR), and the others, regular humans navigating that world — with only limited information, clues, and collaboration tools?
Combining:
👁️🗨️ VR (for world manipulation)
🕵️ AR (for real-world overlay)
🗣️ Voice (for immersive coordination) …felt like the perfect tech-fusion to experiment with.
🛠️ How We Built It ⚙️ Technologies: Backend: FastAPI + WebSockets for real-time messaging
Mobile Client: React + Vite + TypeScript (PWA-ready)
AR Layer: WebRTC for live camera feed with React overlays
Voice Input: Web Speech API for speech-to-text commands
VR Client: Unity + C# (with WebSocketSharp) for Game Master interaction
🧱 Architecture: The VR Game Master joins or creates a session
Mobile players join with a room code
The GM manipulates the world (moves puzzle objects, sends clues)
Players receive live updates, use voice input to request help, and solve tasks using visual overlays in AR mode
🧠 What We Learned How to manage real-time sync between multiple platforms (VR & mobile)
Deep dive into WebSocket communication for custom multiplayer logic
Integrating camera access and AR overlays in mobile web apps
Creating scalable, modular game logic between Unity (VR) and Web (mobile)
Managing speech recognition in browser environments and syncing it with a game server
🔥 Challenges Faced Ensuring smooth communication between Unity (C#) and FastAPI (Python) via WebSockets
Handling camera permissions and browser inconsistencies for AR view
Managing voice command accuracy and latency
Keeping the experience lightweight enough to run smoothly on mid-tier phones and VR systems
Designing gameplay mechanics that remain fun despite device asymmetry
🌟 What's Next? 3D AR marker detection for richer clue experience
Spectator mode + replay recording
Leaderboards, progression system, and cosmetic unlocks
Community scenario builder for GMs
Voice output from GM (text-to-speech or mic input)
Log in or sign up for Devpost to join the conversation.