AaireelXR - Mixed Reality Communication Platform

My MR panel for Meta that brings loved once closer, my inspiration is millions of people work far from families and feel lost in this world. May be my idea is very simple to bring all together happy

Comment 1

Inspiration

Iam trying to solve the problem that happend with me, as we know Millions of people live far from their families and loved ones, facing emotional distance despite video calls. Traditional video calls lack the natural presence and emotional connection that physical proximity offers. Inspired by this, AaireelXR was created to build a minimal-setup, immersive mixed reality communication experience that feels like a loved one is standing right in front of you — with natural gestures, emotional effects, and simple controls designed for all generations.

What It Does AaireelXR enables families to connect through real-time, interactive video presence within Horizon Worlds. Key features include: Emotion-triggered visual effects to enhance connection and interactivity. Hologram-style avatars representing family members in shared mobile-friendly spaces. Memory capture features, allowing users to save special moments as snapshots or short clips. Simple, mobile-optimized controls designed for fast engagement on Horizon mobile.

All interactions are native to Horizon Worlds, ensuring a seamless, low-latency experience on mobile devices, while leveraging NoesisUI for interface, TypeScript APIs for scripting interactions, and World Broadcast for real-time multi-user events.

How We Built It (Competition-Aligned Tech Stack): World Development: Meta Horizon Worlds desktop editor, scripted using TypeScript APIs. UI/UX: NoesisUI for mobile-optimized menus, dialogs, and interactive panels. Real-time Interaction: Horizon World Broadcast API for connecting multiple users in the same shared space. Gesture & Interaction: Scripted avatar movement and touch-based gestures for mobile devices. Data Handling: Minimal client-side storage for captured memories; future cloud integration planned. Security & Privacy: All user interactions occur within Horizon Worlds; no external storage of sensitive keys or video streams.

Challenges Encountered: Integrating real-time avatar interactions with gestures and visual effects in Horizon Worlds while ensuring mobile responsiveness. Implementing emotion-triggered visual effects in a multi-user environment with Horizon’s current scripting API limitations. Structuring a cross-user interaction system without traditional backend services. Despite being a solo effort, the foundation has been set to iteratively build this experience into a fully immersive and mobile-friendly Horizon World.

Accomplishments: Developed a mobile-first Horizon World prototype demonstrating live presence and interactive avatars. Implemented basic emotion-triggered visual cues and memory capture features. Achieved cross-user real-time interaction using Horizon Worlds native broadcast features. Designed a lightweight, scalable architecture to allow future features like group sessions, push notifications, and AR overlays.

Lessons Learned: Meta Horizon Worlds scripting enables rich multi-user experiences without external servers, but careful optimization is required for performance on mobile devices. Simple, intuitive interactions are key for adoption by families of all ages. Privacy and security must remain fully contained within the Horizon World to ensure compliance with Meta policies. What's Next for AaireelXR If this MVP proves valuable, the roadmap includes:

Group video/avatar sessions with live multi-user interaction. Advanced passthrough and hand gesture interaction to enhance immersion. Enhanced memory capture, including cloud sync and optional sharing features. AR filters and emoji-based interaction overlays for richer emotional expression. AI-driven emotion detection, providing richer feedback during interactions. Multi-language support and accessibility optimizations for families worldwide.

AaireelXR as a Horizon World provides a unique, immersive, and mobile-first family connection experience, fully aligned with Meta Horizon Worlds’ competition requirements and mobile innovation guidelines. Project work is in progress .... Stay tuned on Git hub link https://github.com/rauttech/aireelxr-meta-horizon

Built With

  • bcrypt
  • expo-cli
  • fastapi-(python)
  • jwt
  • meta-xr-sdk
  • mongodb-(motor-async-driver)
  • node.js
  • python-3.11+
  • react
  • react-native-(expo)
  • socket.io
  • socket.io-signaling
  • unity-2022-lts
  • vite
  • webrtc
  • yarn
Share this project:

Updates