Inspiration

It started with exam prep. I was stuck scrubbing through an hour of recorded lectures trying to find the ten minutes where a concept was actually explained. I knew what was said, just not when. That gap between "I remember this" and "I can't find it" is the problem mined.it solves.

We moved to gaming clips as our main use case because the pain is bigger there. Streamers and competitive players record hours of footage a day and most of it never gets touched, because finding a clippable moment means rewatching everything. People get paid just to do that scrubbing by hand. Same search problem, bigger audience, more urgency. The core idea, find the moment not the file, was never gaming-specific though.

What it does

Upload a video, search it in plain language ("the clutch 1v4 near the end," "where he explains recursion"), and get taken straight to the timestamp. For creators we built further on top: automatic highlight detection, a virality score per clip, a forecast of how a clip is likely to perform and earn before you post it, and one-click export to YouTube with an auto-generated title, caption, and summary.

How we built it

Every video runs through ffmpeg twice: once for scene-change keyframes so hard cuts aren't missed, once for a uniform one-frame-per-second sample so nothing static gets skipped. Frames get embedded with CLIP, Whisper handles transcription, and both get indexed together so a query can match on what's said, what's shown, or plain keywords.

Search results carry a breakdown of which signal fired (visual, transcript, keyword), blended and reranked with Gemini for final relevance. The forecasting model looks at a clip's score and the creator's recent view velocity and projects views and earnings out 15, 30, and 60 days. The YouTube export reuses the same transcript and vision data from indexing to write the title, description, and caption automatically.

Challenges

Confidence tuning nearly broke the whole approach. We set match thresholds strict at first to avoid garbage results, strict enough that we were returning nothing for a lot of real queries. We fixed this by replacing one hard cutoff with proper match tiers (strong, moderate, weak, no reliable match) and calibrating each signal before blending, so the system reports both a result and how sure it is. Past that, the real work was speed (indexing long VODs fast enough to be usable) and consistency (keeping search reliable while clips were still processing).

What we learned

Video search is harder than it looks from the outside. Text search is solved; video search means fusing signals that don't naturally agree, what's said, what's shown, what someone typed, and that fusion took more iteration than the embeddings themselves. The real ask from a tool like this isn't more AI. It's confidence that when it says "here's your moment," that's actually the moment.

Built With

Share this project:

Updates

Submission history