Speckle AI

Speckle Model to AI

Inspiration

Less than 12 hours before the hackathon started, fal.ai released a ComfyUI API. I figured it would be fun to try integrating that into Speckle Web Viewer

What it does

Takes a snapshot of your Speckle model (from the web viewer) and sends it to a custom ComfyUI AI model to render out a high quality image. That image is presented back within 5 seconds next to your model

How we built it

Speckle Web, fal.ai

Challenges we ran into

Some ComfyUI components were not supported by fal.ai, CORS errors, and publishing the web app.

Accomplishments that we're proud of

Getting the Speckle Viewer connected to the fal.ai API

What we learned

Using new technology for the first time is hard.

What's next for Speckle AI

Suggest multiple AI models, allow users to add their own ComfyUI workflows, use Speckle data to suggest prompts, use Speckle Automate to auto-gen AI imagery, use AI results to texture model, etc.