Chatter Monkey

Inspiration

Nobody likes taking surveys, The uncertain possibility that your opinion would be taken into consideration and improve a company, often does not overcome the hassle of time investment to read, answer and formulate constructive feedback. How can AI be used to incentivize the public into taking more surveys?

Audio Call Survey Format Targeting an Cafe Experience Survey.

What makes Coffee shops a Good Place for Audio Call Survey Format?

Grab and Go; fast-pace environment where traditional surveys are obsolete (commuters holding coffee cannot read and click and interact with surveys)
Community atmosphere, Regulars can give constructive feedback to the shop.

What it does

A QR code on the cup/table or exit door can be scanned by a customer on their way out of the shop. This will open an audio call with the chatter monkey. Survey will take place and the customer will answer as much questions as they want and end at their own request. The transcribed answers will be fed to Gemini AI to analyze results, and send feedback to the Café Dashboard.

How Does this Impact the Community?

An informal conversation structure, is more appealing for the public
After a call, customers should feel like that have a larger impact in their community
Live Dashboard for coffeeshops to see their ratings and customer expectations.

How we built it

The Monkey Interface that communicates to the Customer is a web based UI that mimics an Audio Call. The monkey is controlled by a Gemini API which is constrained to Conversation Guidelines for Intelligent Phone Survey and Response Rules which will guide the AI through the based on its response rules.

The Voice of the Monkey was created from Eleven Labs bringing the monkey to life with a realistic, engaging TTS(text to speech).

The Customers Response is transcribed live via STT(Speech to Text), there is no storage of the audio for privacy.

The Transcript of the Call is analyzed with an Gemini AI API that is prompted to fill a standardized JSON File with relevant data and take into consideration variations of customers verbiage.

This JSON File is added to the Dashboard to display Results.

Challenges we ran into

Latency Issues Between the TTS --> Gemini Response Time --> STT.

Instability of Web Interface API Calls on mobile Device.

Linking The Monkey to the Dashboard.

Accomplishments that we're proud of

Full Conversationalist Chatter Monkey. That can follow the provided Script and Dynamically Respond to the Customer.

What we learned

Paving the road before building houses is important.

What's next for Chatter Monkey

Implement the chatter monkey in multiple different market sectors ( ex. Self Service Checkouts In Shoppers Drug Mart or Online retailers ) Improve the dynamic conversational capabilities of the chatter monkey. More analytical results for Businesses using Chatter Monkey.