Inspiration

Twitch already lets creators share conversations through Shared Chat. But their broadcasts still behave as separate spaces. What if an object could leave one stream and enter another without becoming a copy?

CROSSFRAME explores that idea: independent Twitch overlays act as neighboring viewports into one continuous, server-authoritative world.

What it does

In CROSSFRAME's first experience, Signal Relay, viewers use Twitch chat to influence a luminous Signal. It travels toward the edge of a broadcast, crosses the boundary, and appears in the next spatial region carrying the same identity, velocity, visual seed, and transfer history.

That is the central mechanic. CROSSFRAME does not merely synchronize two identical animations. Each viewport displays a different region of the same underlying simulation.

A transfer changes which region contains the Signal. In the full two-broadcaster collaboration design, Twitch Shared Chat source-channel metadata determines which community may influence it while it is in that region. Three successful transfers establish the link and trigger a coordinated finale.

What you can try today

Launch CROSSFRAME

The demonstrated SOLO PREVIEW mode uses one real authenticated Twitch broadcaster and an explicitly labeled SIMULATED PARTNER in the second region. The broadcaster's actual !launch, !up, and !reverse chat messages were received via Twitch EventSub and accepted by the authoritative simulation. The Signal crossed between the two viewports; the simulated partner supplied the return action. The third crossing triggered the server's completion state.

This is not a claim that two real creators completed a Shared Chat session. The two-broadcaster implementation has been tested with synthetic EventSub fixtures but has not yet been verified with two live broadcasters. In particular, independent Twitch video players may have different delivery delays, so the project guarantees consistent world state, not perfectly synchronized video playback.

How we built it

CROSSFRAME uses TypeScript, Node.js, Fastify, React, Vite, Canvas 2D, WebSockets, Twitch OAuth, and Twitch EventSub.

A fixed-step simulation on the server determines the Signal's position, velocity, command acceptance, and boundary transitions. Two transparent browser-source renderers display separate regions. Input normalization and deduplication prevent one Shared Chat message, forwarded across subscriptions, from acting twice.

Encrypted PostgreSQL checkpoints persist the world, overlay capabilities, and session state. A hosted redeployment recovered the same Signal and transfer history, with real Twitch commands accepted afterward.

The original visual system uses procedural geometry, orbital rings, trails, edge effects, and a coordinated LINK ESTABLISHED completion.

How we used OpenAI Codex

OpenAI Codex was the primary development agent, contributing from the initial empty workspace through architecture, implementation, debugging, testing, and delivery.

Codex built the Twitch adapters, authoritative simulation, React dashboard, transparent Canvas renderers, PostgreSQL recovery, browser tests, and deployment configuration. It wrote and executed tests for identity-preserving transfers, Shared Chat provenance and deduplication, invalid input, and WebSocket reconnect behavior.

A concrete debugging example: browser offline emulation failed to interrupt an existing WebSocket, so Codex revised the test to explicitly close and block the socket connection before verifying renderer recovery.

The project does not call a language model at runtime. Codex was used to engineer and test the experience.

Challenges and lessons

The hardest problem was keeping separate overlays honest about one object: animations must never determine authoritative crossings. Twitch Shared Chat also forwards messages between channels, requiring original-source attribution and idempotent processing. Persistence matters because free hosting can restart, and a reconnecting overlay must recover the existing world rather than silently creating another Signal.

We separate real Twitch evidence from fixture-based tests and clearly label the simulated partner.

What comes next

Signal Relay is a proof of a broader interaction primitive. Spatially connected Twitch broadcasts could eventually support multi-stream boss fights, collaborative art, puzzles, game shows, and performances without requiring creators to run the same game.

Twitch already merged the chat. We merged the space.

Links: Live application ยท Submission repository

Built With

Share this project:

Updates

Submission history