Henry the Fox Goes to Town

I've fully illustrated a 50 page children's book with Flux models. I used Flux1 for the initial generation and then Flux Kontext to make all characters, clothes and scenes consistent.

Comment

Inspiration

I was inspired by the potential in Flux's capabilities and by classic children books. I have studied 100 years of classic children's books as well as the current market and made a book as long as the classics which are no longer made, but illustrated like never before.

What it does

It's a 50 page children's book fully illustrated with Flux1 and Flux Kontext. I believe there is no other book which uses AI to this extent.

How we built it

Everything was done locally on my machine with an NVIDIA RTX 4080 Super. I used Flux models in ComfyUI with numerous workflows. I collected vintage children's books and trained loras in FluxGym with them to invent the style then used Flux Kontext to fix errors, make all the clothing and characters and scenes consistent.

Challenges we ran into

Keeping style and characters consistent with AI is very difficult. I had to try very hard. Kontext helped tremendously and I couldn't have completed the project without it.

One challenge that I couldn't overcome is that Flux's attention maxes and errors are made, but workflow development and Kontext coming out while I was making my project helped me a lot.

Accomplishments that we're proud of

I finished the whole 50 page book, I don't think any other book is illustrated with AI to this extent and quality.

What we learned

So many lessons that are hard to list. I started with no knowledge of advanced illustration with generative AI. I evaluated models, I trained loras, I fused styles, I tried and made 100+ workflows, I did 4 passes on each of the pages of the images to get them to this quality.

What's next for Henry the Fox Goes to Town

I am trying to get the book marketed then I am writing the sequel. When I am done with the trilogy I am hoping the AI models for video will be advanced enough so that I can animate it into a movie. I have an ambitious plan for an AI powered publishing house and animation studio with many titles in the works already or planned.

Built With

Share this project:

Updates