Inspiration

We were inspired by the daily struggle of navigating complex websites—lost in menus, unsure how to achieve goals. Kip was born to bridge Intercom-style chat with Fullstory-like screen awareness, guiding users with AI-powered pointers in just 48 hours.

The name Kip comes from the british word kip that means talking a short nap. Kip is chilling on the side of the website and helps you achieve your goals.

What it does

Kip is an AI chat you add to any site with <script src="kip.js">. Ask it, “How can I buy a Premium,” and it says points you all the steps you need to follow by highlighting elements step-by-step. It’s your chill, smart sidekick for web tasks.

NOTHING IS SCIPTED, EVERYTHING HAPPENS LIVE.

How we built it

We crafted Kip in vanilla JS, in order to be easy to put it on your website. We used Gemini API for the AI logic and ElevenLabs for voice, but focused on a fast, working prototype, where everything lives on the browser. Gemini has access to tools that can use to highlight and unhighlight elements.

It uses:

  • html2canvas for screenshot
  • Gemini API for AI and tool usage
  • ElevenLabs for voice

Team Info

Out team consists of two members:

Challenges we ran into

CORS blocked live website tests, slowing Gemini API calls. We build a static local website to demonstrate kip to meet the deadline. Balancing speed (48 hours) and polish was tough, but we prioritized a demo-able core.

Accomplishments that we're proud of

We built Kip from scratch in two days, creating a unique, botty experience with animated pointers and a sleek human-y logo. It’s scalable, user-friendly, and hits the AI agent theme—ready to guide anyone on any site, even without full AI/voice yet.

What we learned

We mastered rapid prototyping under pressure, navigating CORS, and DOM manipulation. We discovered Gemini’s latency quirks and how to optimize for live sites. Teamwork on Discord kept us on track, and we now know ElevenLabs’ potential for voice-driven agents.

What's next for Kip AI

Kip should go on a backend service that can serve any website without CORS issues. We need to improve screenshot abilities and package the whole kip.js into a new lighteweight package. We’ll refine UX with animations, test scalability, and explore other APIs for richer features.

Built With

Share this project:

Updates

posted an update

We are now experimenting how to force Gemini use tools more reliable, because it's context window is remarkable and perfect for our use case, but tools usage needs more work.

Next feature will be to crawl all the top level pages (using Firecrawl) of each website to provide more context to Kip.

Log in or sign up for Devpost to join the conversation.