glyph

Glyph

Inspiration

Our team has been users of Adobe Express for a while, using it to create designs for schoolwork, extracurriculars, and often personal designs such as music covers. Seeing the opportunity to make a plugin as a challenge piqued our interests, and we thought it'd be a suitable project to introduce creative features that leverage artificial intelligence to improve our own user experience.

What it does

Glyph is a suite of plugins that will improve your designs & marketing experience. It comes with the following suite of products:

moshfilters: A group of filters that create unique filter type of designs, making use of technologies such as data moshing, vaporwave, and microwave.
captionate: A plugin capable of downloading your current design and generating captions with keywords specified by the user to maximize social media attention.
ai sticker: A plugin intended to use GPT 4's newly released vision API to have the ability to insert stickers with ease whenever the user intends, further maximizing ability for design creativity.

How we built it

Our suite of plugins are built with modern and scalable technologies. We made use of Adobe Express's add-on CLI to start with the base of our add-on, made use of React to create our frontend components, along with other frameworks such as MaterialUI. Our backend is largely composed of Adobe's Document Sandbox API as well as their Communication API, which allows our frontend to directly interact with the Express's document. It also makes use of Axios as our promise based HTTP request library.

Challenges we ran into

Struggled getting onboarded with the Express Communication API, and figuring out how the server architecture would look, specifically with the placement & location of our calls -- we intended to maintain clean code, however, at times it was a challenge. Adobe Express's documentation was largely helpful throughout.

Our suite of plugins often make external API calls to different artificial intelligence models, such as OpenAI's GPT4; however, cross origin policy issues would often arise as we're making calls from an Adobe hostname to external APIs.

Accomplishments that we're proud of

Implementing arithmetic to perform pixel manipulation to create unique filters.
User Interface making use of standard practices with respect to UX principles and accessible design.
Leveraging artificial intelligence APIs, such as GPT4 Vision, and Segmind VegaRT to create unique functionality within Adobe Express. 😁