Inspiration
People who enjoy watching theater will watch bootleg videos of audience members secretly recording during the play. People stitch these videos together to make the best-quality full video, for theater fans who don't want to pay for tickets or online versions, or for those who want to personally enjoy the authenticity of live recordings. We wanted to leverage that technology.
What it does
- Capture: Lightweight in-app camera (no filters, no editing). Record a short clip, tap submit. GPS coordinates and timestamp are auto-attached.
- Cluster: On the backend, incoming clips are embedded using Twelve Labs Marengo 3.0.
- Compile: A multi-agent AI pipeline takes each event cluster and produces a news segment: selects the best angles, orders clips coherently, generates a caption with date/location, and publishes to the local feed
- Produce: a clean, modern news feed shows local events as multi-angle video segments.
How we built it
Tech Stack: FastAPI backend, Vite Frontend, Twelve Labs Marengo for video embeddings, Claude Agent SDK agent orchestration, Gemini 2.5 Flash video captioning.
Challenges we ran into
Compiling, how are we deciding which clips are the "best". How to choose angles, segments, etc.
Accomplishments that we're proud of
Staying up until 5am building. Not getting into a fight with claude.
What we learned
Working on a tight deadline, how to pivot ideas fast, the importance of quick and meaningful decision making.
What's next for NewZ
Outsource to more users in order to have a fully active feed, the idea is that people are able to get news instantly without having to wait from other sources. Paying people who post creative and unique videos, with high view counts.
Built With
- claude
- fastapi
- gemini
- python
- railway
- twelve-labs-marengo-for-video-embeddings
- twelvelabs
- typescript
- vercel
- vite
- vite-frontend
Log in or sign up for Devpost to join the conversation.