Inspiration

Watching NoPixel means following a story spread across dozens of streams. Your streamer meets someone new, a nearby event starts unfolding, or another camera catches something you missed, but finding that perspective takes you away from the moment.

I built Sidetracked to make those connections easier. We wanted viewers to discover the people around their favorite streamer and give streamers a simpler way to coordinate multiple POVs.

What it does

Sidetracked brings stream discovery, a live map, and community updates into one place.

Viewers can explore the map, select a streamer, find nearby perspectives, and open their Twitch channels. They can also follow streamers and share text-only city reports, with likes and sorting to help surface recent or popular updates.

A Twitch overlay extension puts the map and city reports directly alongside the stream. For streamers, editors, and moderators, the studio provides tools to arrange muted POVs for OBS and manage viewer requests. Moderators can prepare a studio that its streamer can later claim without rebuilding the setup.

How we built it

We built the website with React and TypeScript, the backend with Fastify, and persistent storage with PostgreSQL. MapLibre powers the interactive map, while shared components keep the website and Twitch extension consistent.

Twitch OAuth and APIs provide account identities, profile images, live status, and viewer counts. A Python computer-vision pipeline reads supported gameplay HUD imagery to estimate in-game positions. The map receives compact updates and retains each eligible channel’s latest accepted position in memory.

We deploy through GitHub checks and Railway.

Challenges we ran into

The hardest problem was connecting reliable location recognition with a responsive map. Gameplay imagery changes constantly, recognition can temporarily fail, and tracking multiple live sources introduces significant processing demands.

The interface also needed several iterations. A panel that worked on desktop covered too much of the map on a phone. We replaced it with a collapsible drawer so viewers can browse streamers and reports, then return to the map without losing their place.

Twitch integration introduced another layer: website accounts, extension identities, studio permissions, and OBS access each needed their own authorization flow.

Accomplishments that we're proud of

We connected map discovery, nearby POVs, community reports, and production tools into a working experience.

We’re especially proud of the small interactions: selecting a map marker opens that streamer’s details, nearby examples keep consistent perspectives instead of constantly switching, and mobile viewers can collapse the interface to explore freely.

The project has unlocked ton of discovery for previously unknown streamers to be easily discovered.

What we learned

Location data is only useful when people can understand and act on it. Reliable updates matter, but so do readable identities, clear controls, and preserving context between interactions.

We also learned how different viewers’ and production teams’ needs are. Sharing infrastructure works well, forcing both audiences into the same interface does not.

What's next for sidetracked

We want to expand Sidetracked to more games and servers, helping more communities discover streamers and follow stories across different perspectives. Along the way, we’ll improve location recognition and tracking coverage, test with more viewers and streamer teams, and refine discovery through real usage. We also plan to strengthen community moderation and make the Twitch extension more widely available in other communities and games.

Built With

Share this project:

Updates

Submission history