Knit & Purl

A funky and fun AI powered app that uses the Vertex AI to generate knitting pattern instructions and supply lists based on the natural language descriptions users provide. A low code solution.

Comment

Inspiration

I am a long time knitting enthusiast and often have the problem of having to combine multiple sets of instructions to create the specific item I want to make. For example I might imagine making a wonderful pom-pom covered striped jumper, but can only find patterns for striped jumpers or pom-pom jumpers, so am forced to combine the two patterns. Whilst this is possible, it is something I would rather not have to do when sitting down to relax.

This is where Knit & Purl comes in!

I have tried to create an app that helps solve this problem, and reduce the time taken to complete the more tedious parts of a new knitting project (finding a project); allowing more time for the actual knitting.

What it does

Knit & Purl is an app that has two main ways of using it.

  1. A user provides a description of an item they want instructions on how to knit, for example, a 'yellow baby blanket with a heart pattern around the edges measuring 100cm x 80cm'.
  2. A user can select 'Get Random Pattern' to receive instructions on how to made a random item chosen by the AI.

In both instances, when the 'Get Pattern'/'Get Random Pattern' button is clicked a query is sent to the AI asking for the instructions, equipment list and a suggested gauge. In the case of the random pattern the project is also marked as 'beginner' or 'intermediate'.

How I built it

The submission is a low code submission with appsmith_ being used as the main tool, the app is connected to Vertex AI.

The first stage of the project was to find an appropriate model within the Google Cloud project. I tested different knitting requests to find a match that provided clear and accurate descriptions.

After I had decided on a model I spent some time researching the available low code tools that have intergration with Google AIs. Appsmith_ stood out to me because of its simple UI, good range of developer documents and it intuitive interface.

I spent some time designing the app UI on Appsmith_. I wanted to create a fun and bold app that matched the creative spirit behind Knit & Purl. I chose a colour scheme of yellow and purple to meet this fun theme but also to be accessible for those who may suffer from colour blindness. Similarly, I chose to keep the text black for ease of use and accessibility.

Once the majority of the UI had been designed I started to set up the functionality of the app. I created queries on Appsmith_ which formed the basis for the API calls to the Google Vertex AI. I set up two main queries, one which had a variable for user input and a second query that asked for a random set of knitting instructions.

The main screen offers users the chance to either describe a project they would like to make or ask for a random project. Once this has been selected users are directed to the AI generated instructions! Appsmith allows onClick actions to be set up for the buttons. In this case the actions were set to navigate to the instruction page and to send a query to Google Vertex AI.

The app also featues a number of help screens that help users get the most of the AI by providing tips on making better prompts. The second provides confirmation that the instructions are AI generated and provides an email address that users can use to direct any concerns, as well as links to UNESCO guidence on ethical AI.

I imagine the app to be used mainly on mobile devices, and as such created a number of screens that navigated to one another, with small amounts of information on each.

Potential Value to Communities & Businesses

I imagine a two key markets for Knit & Purl.

  1. Casual hobbyists - users who may pick up the app a few times a year, potentially for the novelty element.
  2. Serious crafters, influencers, youtubers, small businesses - people who want to move quickly on from project to project.

I see a small amount of potential for Knit & Purl with group one, especially the novelty element. I can imagine small communities like craft clubs and community groups using Knit & Purl to reduce the more 'administrative' side of knitting by quickly generating patterns before meetings - allowing more time for the social and relaxing sides of knitting and crafting! The app is also designed to be accessible to all so would be of great use to beginner crafters. Features like the difficulty rating on the random pattern generation are great for this market.

I imagine huge potential in the second group of people, as these are people who quickly want creative ideas and instructions and will be confident if following the technical terminology used in the app. Within this group Knit & Purl could potentially provide a huge time saving which could be used to either create more projects or improve work-life balance. Ultimately, Knit & Purl could be used by this group to increase productivity and creativity and reduce the time taken on administrative tasks.

Creativity & Originality

  • Bringing AI into a fairly untechnical field such as knitting is a novel and exciting idea. Knit & Purl brings a technological, modern aspect to knitting whilst also keeping it fun and creative! If anything, Knit & Purl increases creativity, as any item a user can think of can be put into the app for a set of instructions, whereas previously knitters had to make it up themselves or search through 1000s of internet blogs!
  • The 'Get Random Pattern' is an especially original feature that really harnesses the power of AI and allows it to take on some of the manual work of humans and free up users time.

Challenges I ran into

  • I spent a lot longer than anticipated researching to model to use and testing prompts.
  • Originally planned a full technical solution, but time became an issue so I chose to switch to a low-code solution to ensure I was able to submit a complete project.
  • Too many ideas and ambitions when it came to app features, narrowing down to an initially proof of concept was challenging.
  • The UI options on appsmith_ were sometimes limited compared to a fully coded solution, particularly in the area of fonts and typography. There were however enough choices to create this MVP.
  • On finishing the project I also believe that using appsmith_ has created a barrier to entry for users as there is now a third party between developer and user. For this app to be fully launched I think it would eventually have to be transferred to a fully coded solution.

Accomplishments that I am proud of

  • Submitting a full project.
  • Creating an app that I would actually use and that I see a gap in the market for!
  • Creating an app with a fun UI which I hope will stand out in the hackathon.
  • Learning more about responsible and ethical AI principles.

Skills, tools and areas I developed in the hackathon

  • Google Vertex AI.
  • Appsmith.
  • Google Cloud Console.
  • Accessible design principles.
  • Ethical and responsible AI principles.
  • Project and time management.

What's next for Knit & Purl

  • My next task will be to optimise the formatting of the AI instructions to improve UX, readability and accessibility. I would like clearer headings and sections and perhaps a less bold font. Unfortunately there was a more limited font selection on appsmith_ compared to if I had hardcoded the application.
  • The ability to save and download patterns. This is a key enhancement to the app as it will allow for better usability. It is rare for a knitting project to be completed in one sitting so users need to be able to save the instructions easily to refer back to.
  • The ability to get instructions to fix items, rather than just make new ones. This will add an element of sustainability to Knit & Purl, as fixing items, rather than purchasing or making new, is an excellent way to live more sustainably.
  • Expand beyond knitting into sewing and crochet.

Built With

Share this project:

Updates