Inspiration

Metaverse & AI is the hot stuffs these days. We're trying to integrate them together to bring a fantastic experience.

What it does

  1. Video conference (It's not available to stream as the Quest can't get access to the camera feed, it can on other XR glasses)
  2. Live broadcasting
  3. eSports broadcasting (Encode the keyboard & mouse states with video with webpage or customized OBS plugin, please check the screenshots and video. When it's playing, it can sync the keyboard & mouse actions with the video. The code feature is implemented. Later, it will use IK to restore the hand motions to the characters)
  4. Clothes & Hair swap
  5. Building placement
  6. Chat
  7. Account & Permission
  8. Live broadcasting assistant, you can ask about the live stream with voice
  9. Desktop Assistant & Mobile Wallpapers
  10. Cross platform(Meta Quest 3 MR/Meta Quest 3 VR/Rayneo X2 MR/Web/Android/iOS/OpenHarmony)

How we built it

Just build it with out thoughts

Challenges we ran into

  1. Limited time
  2. Complicated features

Accomplishments that we're proud of

We did it for MR & VR on Quest 3

What we learned

A lot, coding, experience optimizing and so on

What's next for Ciyuan

A lot to go to make it a full feature AI Metaverse Other features like gifts and open platform for live interactive games The architecture is able to implement such features easily

Past works for XR & UGC:

https://twitter.com/kaibakc

https://space.bilibili.com/23910

Share this project:

Updates