Inspiration
I love using AI to upscale my photos, but face repair tools always seem to change it too much. Suddenly I don't even recognize my own kids. So I set out to fix that, combining the results from popular models using algorithms like SSIM to preserve the facial structure.
What it does
Identifies faces and repairs them with GFPGAN and CodeFormer. It then allows the user to prioritize structure or color / detail to give a final result that improves the original while preserving the identity of the subject.
How we built it
I used RooCode! Also, I adapted code for the basic model functions from Stable Diffusion WebUI, then wrote a custom algorithm that combines MSE of HSV values with SSIM for structural integrity.
Challenges we ran into
Not enough time!
Accomplishments that we're proud of
Although the interface has a few minor bugs, the merging algorithm seems to break new ground. It preserves facial structure better than any AI can do alone, and vastly improves the look of faces in photos.
What we learned
I learned that tweaking an proprietary algorithm takes a lot of effort and time.
What's next for bff - Better Face Fixer
I will continue to build features, including batch processing and smart automatic settings to make it easier to use.
Log in or sign up for Devpost to join the conversation.