Inspiration
People in our team are huge fans of Formula One and racing in general and designing a track built for exciting racing is something we dream of.
What it does
The app considers four pieces of criteria (track name, location, length, and description) and creates a detailed, cohesive track based upon it.
How we built it
We remixed an existing project on PartyRock about creating schedules and formatted the code blocks into code related to our app. Then, we created a block that compiles the information from the criteria mentioned above and uses the Claude AI LLM to create a thorough description of the created track. Finally, we created a code block that generates an image of the newly-created track using the Stable Diffusion XL AI LLM. We wrote code that told the image generator block to create the image from the track descriptions created by the Claude LLM.
Challenges we ran into
At first, we had trouble adding the image generator to our app because we did not know what AI model to use when generating AI images. Additionally, the image generator sometimes did not output any image to the screen. Also, we were unable to have the AI generate an image of the full racetrack. Finally, we had trouble choosing the right seed and CFG value that allowed for the best track output.
Accomplishments that we're proud of
We are proud of how we coded the description creation block because we implemented Claude AI very well in order to create a detailed, comprehensive layout of the racetrack. The idea to also create separate blocks that ask for the user's input was also critical in how the AI performed because getting different values from different code blocks allowed the AI to function in a more structured way. Overall, it made the track description more vivid.
What we learned
One powerful aspect of AI we learned from this project was how we could have different AI collaborate to create a well-developed product. In our project, the full track description was created using Claude AI and the image generator created the image from the descriptions by Claude.
What's next for Racetrack Builder
A way to expand this app would be to add more variables that are considered by Claude AI while creating the racetrack. A potential variable could be adding specific team colors or names so that the cars look better and the user can make it more personal.
Built With
- classifier-free-guidance
- claude
- llm
- stable-diffusion
Log in or sign up for Devpost to join the conversation.