Inspiration

Physical stores often miss potential customers — static posters and promotions go unnoticed, and human promoters are costly and limited. We wanted to create a solution that actively engages foot traffic in a fun and personalized way.

What it does

Heyobo is an AI storefront ambassador that detects customer interest, starts conversations, personalizes interactions, and invites users to play interactive games for rewards or discounts, turning passive visitors into active customers.

How we built it

We combined computer vision for gaze and trait detection, a real-time AI assistant for natural conversation, and an interactive mini-game. Rewards are delivered via QR codes.

Challenges we ran into

  • Accurately detecting emotions and customer traits using computer vision
  • Designing mini-games that are engaging but quick to implement

Accomplishments that we're proud of

  • Created a fully functional AI ambassador prototype
  • Designed a personalized interaction flow that feels natural
  • Developed a concept flexible for screens or physical robots

What we learned

  • Real-time AI can make physical retail interactions more engaging
  • Small design details, like mascot personality and conversational tone, make a huge difference
  • Interactive gamification significantly increases user engagement

What's next for Heyobo

  • Expand to more retail environments beyond coffee shops
  • Test different types of games and reward systems
  • Explore different robot implementations (eg. physical) for a more immersive experience

Built With

Share this project:

Updates