Only 37% of consumers believe current loyalty programmes are effective in earning their favour. 95% of UK shoppers want brands to seek new ways to reward their loyalty. Offline purchase won't always allow us to access to the apps loyalty programs. Toby is a virtual assistant that rewards your purchase of products by scanning your shopping tickets and getting rewarded directly from brands!

What it does

The virtual assistant rewards through our AI Loyalty program, all your purchase of products such as: food, beverage and many others products.

How it works? Testing Instructions 🤖


  • 1) As simple as starting the conversation with Toby:
  • 2) Take a picture of your purchase.
  • 3) Get points!
  • 4) Redeem your points instantly!

How I built it

Through NLP entities we extract users intention from the conversation, and guide them about our loyalty program on how to get rewarded and where. We also integrate to the model a computer vision (OCR library) to extract the text from the image and identify: products, brands and purchase patterns. For the messaging service, we built it on top of a end-to-end encrypted platform, with the goal of procuring the privacy of the users data.

Challenges I ran into

  • Multilingual models.

Accomplishments that I'm proud of

Live Bot:

What's next for Toby Bot

  • MassChallenge Switzerland Program 2021
  • User Documents validation
  • Growth the Affiliated Brands to the Loyalty Program
+ 26 more
Share this project: