Inspiration

In the age of short form content, people struggle with paying attention to long pieces of literature. We would like to provide a solution, particularly for children and young adults, that allows them to convert a story into a picture book.

What it does

Our app takes in an input of a block of text, and it allows the user to select and generate images for specific portions of the text and to convert it into a picture book.

How we built it

We built the app using streamlit, React, and the Dall-E API. Streamlit allowed us to easily jumpstart our frontend and with a little bit of creative hacking, we were able to integrate react components within our streamlit UI to allow users to select text and generate images easily.

Challenges we ran into

Integrating the React component within streamlit was a bit of a hurdle. It required hosting our needed component locally, and in order to deploy we had to package the component with the frontend.

Accomplishments that we're proud of

We were able to create a functional application that can create a visual story out of an input text. It serves as an MVP and will allow us to build on this for future features.

What we learned

We were able to learn about many new technologies including streamlit, the OpenAI API, and React. This allowed us to learn how to rapidly bootstrap an AI application, and it will allow us to more easily deploy applications in the future.

What's next for PictureBook AI

There are a handful of features we are planning on the future including but not limited to the following:

  • We will create a new feature that lets people give the application a prompt and create a picture book.

Built With

Share this project:

Updates