Inspiration
Anyone who spends time watching Twitch knows that every streamer has a community with its own stories, inside jokes, memorable moments, and running jokes. Some moments become iconic, but eventually they get buried in hours of VODs and scattered clips.
We felt there was something missing. There are wikis for games, shows, and even Reddit communities, but there isn't really a similar way to explore the history of a Twitch community through the actual videos where things happened.
That's where Echoes came from. We wanted to create a place where a streamer's history doesn't just disappear into old VODs.
What it does
Echoes is a video encyclopedia for Twitch streamers and their communities.
It turns livestream content into searchable, wiki-style knowledge. Important events, memorable moments, inside jokes, recurring characters, topics, and community stories can be organized into individual entries.
Users can explore a streamer's history, search for a particular moment, understand the context behind an inside joke, or ask questions about something that happened in an older stream.
What makes it different is that entries are connected to their original video sources and timestamps. So instead of just reading about a moment, you can go back and watch it yourself.
We also envision Echoes as something the community can contribute to, allowing viewers to suggest edits and add missing context.
How we built it
We approached Echoes by combining Twitch integration with AI-powered video understanding and a searchable knowledge system.
The platform uses Twitch-related data to connect streamers and their content. Authorized video content can then go through a processing pipeline involving transcription and AI-based information extraction.
We use language models to identify meaningful events, topics, and entities, and organize them into structured wiki entries. These entries retain their video references and timestamps, making it possible to trace information back to its source.
For discovery, we use semantic search so users can search naturally, even when they don't remember the exact words used in a stream.
Our focus throughout development has been making the experience simple: users shouldn't have to dig through hours of recordings just to find one moment.
Challenges we ran into
One of our biggest challenges was figuring out how to extract useful information from livestreams. Streams can run for hours, and most of the content isn't necessarily important. Identifying meaningful moments without losing their context is not as straightforward as generating a summary.
Another challenge was maintaining accurate timestamps and making sure every generated entry could be traced back to the original content.
We also had to account for Twitch's API and content access limitations. Accessing video metadata doesn't automatically mean having access to the actual video, so supporting authorized media processing was an important part of our approach.
Accomplishments that we're proud of
We're proud of taking an idea that started with a simple question — "What if every Twitch streamer had their own wiki?" — and turning it into something with the potential to change how people explore Twitch communities.
We're particularly excited about the video-first approach. Instead of creating another platform for organizing clips, we wanted to connect moments, stories, people, and events into a larger picture of a community's history.
We also wanted to make sure that the original videos remain part of the experience, rather than letting AI-generated text replace them.
What we learned
Building Echoes gave us a better understanding of how different AI technologies can work together. We explored concepts like transcription, structured information extraction, embeddings, semantic search, and knowledge organization.
We also learned that building an AI-powered product isn't just about getting a model to generate an answer. The information needs to be useful, organized, traceable, and presented in a way that people can trust.
Most importantly, we realized just how much community history is hidden inside livestreams and how interesting it could be to make that history accessible.
What's next for Echoes
We see Echoes growing into a dedicated knowledge hub for Twitch communities.
Some things we'd like to explore next include deeper community contributions, better connections between events and recurring characters, richer timelines, and more ways to discover stories across a streamer's history.
We'd also love to make it easier for streamers to manage and customize their own wikis, while allowing their communities to help build them.
Ultimately, we want Echoes to become the place people visit not just to watch what a streamer is doing now, but to understand everything that happened before.
Built With
- docker
- fastapi
- ffmpeg
- machine-learning
- natural-language-processing
- next.js
- postgresql
- python
- react
- restapi
- semantic-search
- typescript
Log in or sign up for Devpost to join the conversation.