Inspiration

Businesses today face complex challenges that require personalized, adaptive, and socially responsible digital transformation strategies. According to Gartner, 91% of businesses are engaged in some form of digital initiative, and 87% of senior business leaders say digitalization is a priority. Moreover, McKinsey notes that companies with an engaged Chief Digital Officer are 1.6 times more likely to achieve their business goals than their competitors.

But digital transformation in the AI era, is not just about technology; it's also a cultural change that requires organizations to continually challenge the status quo, experiment, and become more agile in their ability to respond to customers and competitors.

And this is why, our project aims to empower small and medium businesses to accelerate their digital transformation processes using AI technologies.

What it does

1- Personalized Business Assessment

The Digital Human conducts personalized business assessments by engaging in interactive conversations with businesses. It asks targeted questions related to the business's current operations, challenges, and goals. This approach allows it to gather comprehensive data on the business's unique needs, pain points, and aspirations, to provide ai recommendations for digital transformation initiatives.

Agent Builder

2- Dynamic Market Analysis

Based on the conversation with the businesses, the digital human do dynamic market analysis to gather insights about the business's industry, competitors, and market trends.

3- Adaptive Technology Roadmap

The Digital Human, assists businesses in developing AI adaptive technology roadmaps. It engages in detailed discussions with stakeholders to understand the business's existing technology infrastructure, future goals, and operational requirements. Using this information, it generates customized technology roadmaps that guide the business through its digital transformation journey.

4- Agile Change Management Framework

Finally, the Digital Human helps businesses implement agile change management frameworks. It engages in insightful conversations about the business's organizational structure, employee capabilities, and change readiness. Based on this data, it recommends agile change management strategies and tactics to facilitate a smooth AI digital transformation process.

Agent Builder

How we built it

We prompt engineered Gemini Pro 1.0 model in Generator of Dialogflow CX, that are powered by the Vertex AI Agent Builder, and trained the LLM to be an expert in Digital Transformation of Businesses using AI tools. With this trained model we integrate the conversational features to the Digital Human created with Metahuman.

  • Step 1: We created an Agent Builder Powered by Vertex AI adding multiple data sources for the training of our agent. Agent Builder

Docs: Vertex AI Agent Builder

  • Step 2: Once the agent was built in GCP > we were redirect to Dialogflow CX > In the Manage Section we prompt tuned the Gemini Pro 1.0 model for each user query

Generators

Docs: DF CX Generators

Docs: Prompt Design and Engineering

  • Step 3: In GCP we created a Service Account of our project > Create a New Key > Download as a JSON file to integrate the conversational model to the Avatar.

Credentials

Challenges I ran into

  • We couldn't find to many documentation and samples on how to use parameters in the responses created by the DF CX Generators.
  • Integrate the language models with the Metahuman tool.
  • Limit the token used per interaction, so that the metahuman can process it and don't crash the time response.

Accomplishments that we are proud of

  • Try our Live Demo: https://theaihumansdev.github.io/gemini/

  • Responsible AI Practices: In our project, we incorporate responsible AI practices by implementing methods such as banning specific words and phrases. This helps ensure that Gemini 1.0 Pro model doesn't generate content that is inappropriate or potentially harmful, and promote a safer and more respectful environment for users.

What we learned

  • Potential of Gemini Models in Vertex AI.
  • Agent Builder has access to multiple models, including Gemini.

What's next for AI Hackathons

  • Integrate the multimodal features for the Digital Humans, to show also images in the responses.

Additional Requirements

Alt text

Built With

Share this project:

Updates