Inspiration
Desire for a custom live journalist
What it does
“To provide hyperpersonalized sports updates that keep fans connected to the action they care most about.” Using video segmentation AI models livesteam sports can be segmented and a live news feed can be created. The live news feed can be augmented with AI chat prompting to have the news feed focus on specific events/topics of interest. The live news feed broadcast can be subscription based to different channels and partners .
How we built it
React front end Python flask backend Firebase database Twelve Labs Video Segmentation Service Llama Index
Challenges we ran into
A live-stream cannot be processed after-the-fact. We overcame the challenge of creating video summaries for non-continuous videos by keeping a history of previous summaries and adding the context to the video summary.
Need to figure out rate limits with 12labs
Next Steps Need to implement a microservice that chunks a livestream video into 5-10 second chunks.
Accomplishments that we're proud of
We made a working demo product using a mix of new and old technologies. Successfully collaborated as a team and delivered results.
What we learned
A bunch of new technologies including the 12labs api and llama index.
What's next for Pulse Live
Depending on interest, this could be a product of that we may develop further.
Log in or sign up for Devpost to join the conversation.