Inspiration
During TheTokenCompany's presentation we thought the product was innovative and we believed there was a better way to implement it for everyday usage.
What it does
User inputs a prompt and TinyToken use's TheTokenCompany's API to handle compression of the input, then automatically sends a chat to web LLM's
How we built it
Using a TypeScript chrome-based extension ( check if works on other browsers), and a Python backend
Challenges we ran into
The first challenge was getting the auto filling and submitting chat's to work reliably, next we ran into issues with a state bug when changing the aggressiveness slider.
Accomplishments that we're proud of
Making the extension actually easy to use without issues Completing our first hackathon
What we learned
We learned how to build a chrome extension, and how token compression works and how much it can improve efficiency.
What's next for TinyToken
In the future, TinyToken could be implemented into multiple platforms, including IDE's CLI tools and additional browsers.
Log in or sign up for Devpost to join the conversation.