SportRecap

Inspiration

Sports press conferences can be long and dry. We want to develop an AI-powered tool that can generate short highlight reels from these videos.

What it does

The tool analyzes the press conference video provided and the text prompt, detects the relevant content in the video, output the timestamp of the start and end of the video section, cut the video to generate highlight.

How we build it

The team brainstormed the approach and divided the tasks among the 4 team members. Yurko and Daniel focused on developing the backend and fronted. Mel isa and Suxi focused on testing the Twelve Labs tool and various prompts.

Challenges we ran into

Get familiar with Twelve Labs APIs, integrate the tools.

Accomplishments that we are proud of

Working effectively as a team and developing a functional AI-powered tool.

What we learned

We learned how to use Twelve Labs APIs, how to prompt video effectively.

What’s next for SportRecap

Integrate other tools to identify who is speaking in the video; incorporate news with a RAG system to generate more relevant highlights; build a smart engine to identify highlights from the press conference video without specific prompt.

Develop an AI-powered tool that can automatically generate concise summaries and engaging highlight reels from sports press conference videos. The goal is to help fans and media quickly grasp the key takeaways and most memorable moments without watching the entire press conference.

Built With

• chatgpt
• github
• lambda
• nextjs
• remotion
• twelvelabs
• typescript