Inspiration

Building on the AVP we sense the disruptive and world changing the power of talking to 3D avatar Ais.

What it does

Talk to your favorite Ai in 3d.

In the web application create a new avatar by the following steps:

  1. Enter the name and description of the avatar.
  2. Upload PDFs to the knowledge base.
  3. In the Apple Vision Pro Select the avatar and start chatting.

The Steve Jobs theater was created using Luma Labs from a screen recording. There is an option to call use the on device llm, good for when there is no internet connection. The app talks to the NextJS backend, where Fireworks.ai functions are invoked to animate the face. Animations of the avatar were created using Maya and a model from Ready Player Me.

How we built it

Swift and NextJS.

Challenges we ran into

bugs. No time.

Accomplishments that we're proud of

A ton of code was written and so many things learned. We worked as a team and had a blast.

What we learned

Learned about running llms on AVP device, on using Maya for animations, on using nextjs.

What's next for 3D Ai Avatar

To the app store.

Built With

Share this project:

Updates