Chatlytics

Inspiration - Our Story

Meet Harsha, he’s a sports enthusiast and a first-time solo founder. Harsha’s mission is to empower sports leagues and tournament managers across the globe with a comprehensive technology platform to deliver superior customer experience. He’s just getting started on his journey and has set-up an account with Amplitude Analytics to gauge initial interest in his product and is optimizing his website. He has not been a data scientist , growth marketer or a product manager. But having consumed 1000s of hours of YCombinator and Start-up podcast content, he knows that he needs to build a data-driven product and business but doesn’t exactly know how.

We also reviewed G2 user reviews for Amplitude Analytics and built this companion app product in response to user's feedback that Amplitude could improve it's self-serve and training functionality https://www.g2.com/products/amplitude-analytics/reviews?utf8=✓&filters%5Bnps_score%5D=3#survey-response-7400475

Meet Chatlytics - a self-serve chatbot which helps users like Harsha who are busy founders, PMs or Growth Marketers to quickly learn best practices for tracking user data, defining the right metrics, and making code changes in the digital product for better data tracking and decision-making

Inspiration - Why it matters?

Why this app? Why did we choose a ChatGPT plugin?
- ChatGPT has a huge user base ~300 million and growing rapidly everyday
- The Plugin store is a new and emerging app distribution platform. The store was launched 1 month back and already has more than 250 apps on there
- Minimal additional cost to launch and maintain the plugin (currently at least)
- Ease of developing, setting up and launching self-serve functionality through the plugin store
Benefits of the plugin
- Ease of adoption and self-serve option requiring no/little investment from Amplitude staff
- 90% reduction in the time to value from user’s investment in Amplitude
- Ease of use Fits into current workflows

What it does

Chatlytics is a companion chat app for Amplitude users to interact with and learn about navigating Amplitude. The app is currently available through the

It currently supports 3 key functionality essential for Amplitude user to onboard onto the platform. These functionalities enable users to easily find answers to some of the sample questions we have listed below:

Learning about User behavior data tracking best practices:
- What are the best practices for tracking product metrics?
- Why should I do it?
- What are the key considerations I should be aware of?
Guidance on configuring Amplitude instance:
- What are the essential features?
- How to set-up events in Amplitude?
- How to set-up cohorts in Amplitude?
- How to track user journeys in Amplitude?
End-to-end support for code generation to metric identification:
- How to quickly make changes in the website so the right events are logged and can be visualized in Amplitude?
- What is the best North Star metric to track in this stage of my product journey?
- How do I use configure this North Star metric in

How we built it - Tech, Model and Data stack

- RAG with long-term memory
    - **text-embedding-ada-002**
    - Chroma embedded database
- ChatGPT Plugins with GPT-4
- Amplitude API
- Amplitude Developer Documentation
- Amplitude and User data best practices documentation

Challenges we ran into

We encountered some 404 errors with Amplitude. We were eventually able to resolve them through trial and error
We faced challenges getting the events and feature related data out of Amplitude. We had to pivot away from “chat with my data” functionality.
LanceDB documentation has scope for improvement as the company grows and onboards more developers

Accomplishments that we're proud of

We believe we would be able to reduce the onboarding time for a new user to derive value from Amplitude Analytics by at least 2-3 hours (~90%). Using our self-serve tool,
We implemented an end to end working demo powered by the most current models and tech tools in less than 24 hours
We were able to successfully query and integrate Amplitude developer docs and APIs

What we learned

Our initial vision was to build a "chat with my data" or "auto insights" functionality by leveraging Wolfram Alpha and Amplitude Plugins in conjunction. However, we did not evaluate the data grain available through Amplitude APIs to validate feasibility of executing this vision. We later discovered this and had to pivot to the current product. Going forward, we would proactively reference the API documentation to evaluate feasibility early on and not having to pivot last minute

What's next for Chatlytics

Enhanced functionality (a) Enhance the documentation and Amplitude specific code samples leveraged by Chatlytics to broaden the scope of questions that the Chatlytics can answer and help Amplitude users onboard faster (b) Install observability

Marketing We would like to launch this new functionality for Amplitude users through the AI Partner Design program that Amplitude is launching soon

Monetization We would like to partner with Amplitude to offer this self-serve functionality for Amplitude users and co-develop this app as an Amplitude Partner. We are also open to acquisition offers :)