Sketch style image generator

Inspired by picture editor

Generates sketches for students

Used llama 3.2 1b Instruct because its fine tuned on a custom dataset to give design related ideas and 1b parameter to ensure fast generation compared to 8b parameters

Used Facebook bart/cnn to summarise generated ideas cause wiki art v2 cannot take in more than 70 tokens and will result in loss of information Used wikiart- v2 Fine tuned on wiki art dataset due to limited time we couldn't fine tune. It consist of more than 27 different kinds of artistic styles. Created a frontend using gradio as serverless platforms are too large to fit the 1b model. facebook/bart-large-cnn valhalla/sd-wikiart-v2 meta-llama/Llama-3.2-1B

Difficult to fine tune the wikiart dataset because it was too big and took too long to load.

We are able to ensure that the model can accurately generate sketches that matches the prompt given

How to use open-sourced models to generate output and make it a complete workflow

What's next for Sketch style image generator, we want to explore more options on how to generate better and multiple images at the same time.

Built With

• facebook/bart-large-cnn
• meta-llama/llama-3.2-1b
• valhalla/sd-wikiart-v2