Virtual companion

We are bringing virtual companion on chain so that their emotion state can be saved on blockchain based on your conversation.

Comment

Inspiration

Build a virtual companion that lives on chain that can evolve into your friendly autonomous agent

What it does

Virtual companion will have a conversation with you and it will change emotions based on the conversation. Their emotions will be reflected on the facial expression of the virtual companion. Users can decide to save the emotion at any point on blockchain as if you are playing a game in a form of NFT. This form enables your virtual companion to live on blockchain forever.

How we built it

  1. We used dreamstudio from stability ai to create an avatar that represents the virtual companion.
  2. We used chatgpt4 api for conversational bot
  3. We used sentiment analysis (https://huggingface.co/bhadresh-savani/distilbert-base-uncased-emotion) to analyze the response of the virtual companion, which can be categorized into 6 different emotions: joy, anger, sadness, fear, surprise, love
  4. We let users save the emotion state of the virtual companion on chain.
  5. Virtual companion will continue the conversation with the emotion state once saved on chain.

Challenges we ran into

Most LLM models are finetuned so that they are not able to express specific emotions, so extracting emotion out of a virtual companion has been difficult.

Accomplishments that we're proud of

Create dynamic NFT that has variable emotion traits attached to it based on the conversation

What we learned

We learned that it is difficult for LLM to directly interact with traits derived from smart contracts

What's next for Virtual companion

Make the experience more robust and expand more visual variations based on the conversations

Built With

Share this project:

Updates