ArtJam / ArtFusion

Inspiration

ArtJam was inspired by a combination of multiplayer creativity tools like Gartic Phone, the expressive potential of AI (especially sketch-to-image generation), and the idea that anyone should be able to create and own digital art — together.

I wanted to explore what happens when you combine real-time collaboration with mobile-first design, AI creativity, and blockchain ownership. The result is a fast, social, and accessible experience that turns simple sketches into valuable digital assets.

What it does

ArtJam lets users create collaborative art in real time — starting with a shared sketch canvas and text prompts. Once everyone finishes, the app uses AI (ControlNet) to generate four image variations based on the combined input.

Participants vote on their favorite version, name the piece, and then mint it as an NFT on Solana. Royalties are automatically split between contributors, and the artwork can be listed on a marketplace or auctioned to fans and collectors.

The whole flow — from sketch to mint — can be done entirely on mobile.

How we built it

I built the app solo in under 24 hours during the AI3 App Challenge.

• The frontend is mobile-first, designed for quick sketching and voting.
• AI generation is powered by Replicate’s ControlNet model, combining sketch + prompt inputs.
• NFT minting is done via Solana AppKit, with metadata stored on IPFS.
• Voting and session state are managed in lightweight frontend logic.
• The app is deployed on Vercel, with AI and wallet interactions handled via API calls and blockchain transactions.

I focused on delivering a working end-to-end experience that feels intuitive and joyful.

Challenges we ran into

• Converting rough sketches into usable ControlNet inputs in a short time
• Cleaning and exporting canvas drawings to generate consistent image results
• Managing a full creative flow (drawing → prompt → generate → vote → mint) on a small screen
• Integrating live AI generation with real blockchain minting under time pressure
• Balancing UX simplicity with technical complexity while solo building

Editing the pitch video while debugging wallet interactions at 2am was also a personal highlight.

Accomplishments that we're proud of

• Built a fully functional mobile app with real-time collaboration, AI art generation, and Solana NFT minting — solo, in 24 hours
• Integrated ControlNet successfully for sketch-based generation
• Delivered a clean, user-friendly flow from start to finish
• Designed something creative, playful, and real — not just a tech demo
• Told a story that ties together AI, art, community, and ownership

What we learned

• How to integrate sketch inputs with AI image models effectively
• How to build fast with Solana tooling (AppKit, wallet adapters)
• How to guide users through a multi-step, collaborative creative process without confusion
• The power of combining mobile UX with blockchain permanence
• The importance of having fun with what you’re building — especially under pressure

What's next for ArtJam / ArtFusion

There are several directions I'd love to take ArtJam:

• Streamer integrations: Let creators host live ArtJams and auction co-created NFTs in real time
• Remixing tools: Allow users to fork and remix each other’s artworks
• Community events: Run themed sketch sessions or branded art drops
• Creator profiles and galleries: Let users build public portfolios and track co-creation history
• Live auctions and token gating: Deeper monetization for creators and fans

Ultimately, I’d love to grow ArtJam into a creative playground — where people don’t just use AI to make art, but use it together, and walk away owning something meaningful.

Built With

• next.js
• react
• redi
• solana