Cosmic AI

Answer player question
Ask non linear question
Jupiter snapshot
Mercury snapshot
Information card of planet
earth and moon
AR main menu

Inspiration

When I gaze at the night sky, I am captivated by the brilliance of the stars above. Each one holds the promise of countless planets, stars, and galaxies yet to be explored, and mysteries waiting to be unraveled by humanity. My vision is to create a virtual cosmic space that simulates the accurate relative positions and appearances of celestial bodies—from our solar system to distant galaxies and even black holes. Within this immersive universe, an AI-powered chatbot would serve as a guide, capable of answering any question about the cosmos. This would allow individuals who share my deep fascination with the universe to journey through space and satisfy their boundless curiosity.

What it does

It has several features:

AI-powered chatbot that was trained with the knowledges about solar system, coming from NASA official website, will answer every question within the context.
The stars/planet in the solar system in this simulation ranging from Sun, mercury to Pluto.
Each planet is interactable using the VR controller to view the different angles / faces of the planets, and some snapshots of the wonders of the planets.
AR to VR teleportation
voice controlled scene change

How we built it

Using Unity engine to build the simulation scene
Import Convai plugin to have an AI NPC acted as the interactive AI chat robot.
Import Meta interactive toolkit and XR package to enable Meta quest passthrough feature

Challenges we ran into

As a solo participants in the challenges, who do not know how to draw the 3D model and change the existing 3D model, find difficulties to have a realistic planet.
The AI chat robot is connected to the Convai server, which delays the respond time
The voice to text (user speak to AI) feature sometimes identify the words wrongly, the clarity depends on the quality of the headphone.

Accomplishments that we're proud of

Voice controlled scene change is definitely a scalable feature that has the potential to apply in many industries use cases, such as factory visit, classroom simulation for teachers training purpose or even interactive art in the art gallery.

What we learned

To integrate AI and XR interactive toolkit and packages in the Unity project through online self study.
Work independently while balancing with time with a full time job

What's next for Cosmic AI

Expand to more cosmic body in the universe.
The planet 3D model can have an exploded view to see the core, and understand the elements that forms the stars/planet
Have a image generated / video generated AI feature based on the answer from the AI chat robot.