Inspiration

Did not want to call Cosmos to order a pizza and wondered whether we could make an AI program to do it. Also, wanted to see if we could build a DIY version of Google Duplex

What it does

Call Me Maybe (CMM), is a framework that acts as the core API server with several in built integrations. For example, for the demo we interfaced it with a phone number, and an iOS Shortcut.

How we built it

  • LangChain
  • Open-AI
  • Twilio

Challenges we ran into

LangChain provided inconsistent responses, differences between GPT-3.5 and 4.0 were greater than expected. Bedrock had trouble interpreting models and lost track of prompts in ways that GPT easily handled.

Accomplishments that we're proud of

We were able to initiate a call with Cosmos Pizza and CMM order a pizza on our behalf. Prank call our friends Act as a clerk at a pirate themed pizza restaurant.

What we learned

The tools available in the AI sphere are immature and have a long way to go but with crafty engineering and perseverance impressive results can be achieved with some regularity.

What's next for Call Me Maybe

Improve handoff between tools to enable longer and more complex chains of actions.

Built With

Share this project:

Updates