MagiPad

• 

  minecraft

• 

  nature

Inspiration

As the world's AI models advanced, we were inspired to create a medium that could seamlessly integrate voice and drawing as modalities.

What it does

MagiPad is an iPad application that allows users to draw on a canvas, create textboxes, and through the power of the Dall E 2 API, turn those text boxes into art.

How we built it

We used Swift, specifically UIKit, and PencilKit for the core functionality of the sketchpad.

Challenges we ran into

Creating textboxes that were easy to navigate into and out of proved to be a challenge. The solution involved adding proper touch recognition, and making sure we were displaying the different views of our app at the right times.

Accomplishments that we're proud of

We are proud of the user experience that the end product delivers, and found the app to be quite fun to mess around with.

What we learned

We learned the fundamentals of Swift, UIKit, PencilKit, and how to send API requests in an app.

What's next for MagiPad

The possibilities are endless. Some ideas include integrating different models, such as one powered by a ControlNet to convert scribbles to images, better and more seamless voice recognition, adding text powered AI such as GPTs into our textbox interface, and much more. We are excited by the possibility of continuing to develop MagiPad.

Built With

• openai
• swift