Inspiration

Screenshots have quietly become a second camera roll.

We use them to save products we want to buy, conversations we want to remember, places we want to visit, recipes, tickets, ideas, reference material, and random bits of information we know we'll need later. The problem is that once a screenshot lands in Photos, most of that context disappears.

Screenbase started with a simple idea: what if screenshots were treated as information instead of images?

We wanted to build a screenshot manager that could understand what was on your screen, organize it automatically, and make everything you've captured searchable later — without requiring you to manually file things into folders.

What it does

Screenbase turns your screenshot library into a searchable, organized knowledge base.

It can automatically import screenshots and use on-device and AI-powered analysis to understand their contents. Screenshots can be grouped when they belong together, enriched with semantic information, and searched based on what they actually contain rather than just when they were taken.

Instead of scrolling through thousands of images trying to remember when you took a screenshot, you can search for what you remember about it.

Screenbase is built around a few core ideas:

  • Automatic organization — screenshots are organized without requiring a manual filing system.
  • Semantic search — find screenshots based on their contents and meaning.
  • Screenshot grouping — related screenshots can be grouped together, including screenshots captured from the same flow or piece of content.
  • Annotations — add context and notes without destroying the original screenshot.
  • Privacy-first processing — we designed the app to keep as much processing and user data on-device as possible.
  • Native iPhone experience — Screenbase is built specifically around the way people capture and use screenshots on iOS.

How we built it

Screenbase is a native iOS application built in Swift and SwiftUI.

One of the biggest architectural decisions was treating each screenshot as an individual piece of information rather than simply another photo. From there, we built an ingestion pipeline that can analyze imported screenshots, extract useful information, generate semantic representations, and make that information available to search and organization features throughout the app.

We also spent a lot of time on the interaction between automatic organization and user control. Screenbase should do the tedious work automatically, but users still need to be able to group, annotate, search, and manage their screenshots themselves.

The result is an experience that feels much closer to a personal search engine for things you've seen than a traditional photo organizer.

Challenges we ran into

Screenshots look simple until you try to understand them.

They can contain text, photos, app interfaces, conversations, maps, products, websites, and several completely different kinds of information at once. Two screenshots taken seconds apart may belong together, while two visually similar screenshots taken months apart may have nothing to do with each other.

That made grouping and semantic organization particularly interesting problems. We had to balance signals from the screenshot itself with contextual information while avoiding organization that felt unpredictable to the user.

We also cared heavily about performance. Screenshot libraries can contain thousands or tens of thousands of images, so analysis, indexing, storage, and search all have to remain fast without turning the app into a battery, memory, or storage hog.

Accomplishments that we're proud of

We're particularly proud that Screenbase became a real, shipping iOS product rather than just a prototype.

The core experience works across the entire lifecycle: importing screenshots, understanding them, organizing them, searching them, annotating them, and getting back to something you captured weeks or months earlier.

We're also proud of how little work the organization system asks from the user. The best version of Screenbase isn't one where you meticulously maintain another database — it's one where you keep taking screenshots exactly as you already do and Screenbase makes them dramatically more useful.

What we learned

The biggest lesson was that screenshots are a surprisingly rich personal data format.

A screenshot often represents intent: "remember this," "look at this later," "send this to someone," or "I might need this." The image itself is only part of the information.

That changed how we thought about the product. Screenbase isn't really about managing images. It's about recovering the intent and information trapped inside them.

What's next for Screenbase

We're continuing to push Screenbase toward becoming a true personal visual knowledge base.

That means better automatic grouping, richer semantic understanding, faster search, improved annotations, and support for more kinds of captured content. We're also exploring ways to extend the same model beyond individual screenshots while keeping the experience fast, private, and native.

The long-term goal is simple: if you've seen it on your screen and saved it, you should be able to find it again.

Built With

Share this project:

Updates