CHAAP: Chat With Any Anonymous Page

CHAAP: The Chrome extension chatbot that offers private, smart web interactions. Anonymize and converse with ease for secure form filling and browsing.

Comment

Inspiration

We wanted to build a chatbot that could respect private data constraints and still deliver value. As such, we built an extension that can talk to anything, working with any website you can think of and scraping the data in a way that completely anonymizes data. We were inspired by works like Nightshade and other chatbots to guide our development.

What it does

CHAAP is a Chrome extension that can talk to any webpage you're on, performing reasoning and inference over the webpage. CHAAP allows you to talk to any LLM you want, ranging from AWS to OLLaMA to GPT. Additionally, if you're using proprietary LLMs, our HEMLock algorithm protects your data and prevents LLM providers from using your data for pretraining their models and stealing your work.

How we built it

We built CHAAP with several technologies, using technologies like Tembo for RAG, AWS for LLM inference, HuggingFace and Presidio for Anonymization, JS and HTML for the frontend, and countless other libraries. This library intricately weaves together a number of LLM systems to deliver secure and effective chatbot integrations.

Challenges we ran into

Chrome was a particularly hard thing to work with, as well as configuring Tembo to do vector database work. However we ended up implementing both.

Accomplishments that we're proud of

Delivering the project was an accomplishment we're quite proud of, as well as the anonymization algorithm we developed.

What we learned

Chrome is mean.

What's next for CHAAP: Chat With Any Anonymous Page

Image integration, stronger anonymization, potential decentralized protocol for LLM routing.

Built With

Share this project:

Updates