ARtistry

Sketch here!
Gemini AI detects what item drawn is!
WOW, a 3D model is created that I can rotate about!

ARtistry

Inspiration: We were inspired by the idea of making art interactive and tangible. Many people enjoy sketching, but translating a 2D drawing into a 3D model is difficult for non-experts. We wanted to empower anyone to create 3D content from simple sketches and experience it in augmented reality.

What it does: ARtistry lets users draw 2D sketches on a web canvas and instantly convert them into 3D models (.glb format) using AI. The generated 3D models can be viewed in AR, allowing users to interact with their creations in a virtual space.

How we built it: Frontend: React and Tailwind CSS for an intuitive drawing interface Backend: FastAPI to handle requests and manage 3D model generation AI Model: Stable-Fast-3D from Hugging Face to convert 2D sketches into 3D meshes 3D Viewer: Three.js / model-viewer to display models in AR

Challenges we ran into: Converting 2D sketches into high-fidelity 3D models while preserving user intent Optimizing performance to reduce waiting time for mesh generation Handling edge cases where sketches were too minimal or ambiguous for the AI model

Accomplishments that we're proud of: Successfully integrated a full 2D to 3D to AR pipeline Users can instantly see their sketches as interactive 3D models Implemented a user-friendly drawing interface that works on both desktop and mobile

What we learned: Working with 2D-to-3D models requires careful preprocessing to get reliable results Combining AI, web interfaces, and AR requires cross-disciplinary knowledge Rapid prototyping is key for hackathon projects, especially when integrating multiple technologies

What's next for ARtistry: Allow multi-angle sketches to generate more accurate 3D meshes Add color and texture prediction from sketches for richer AR experiences Enable real-time AR preview while drawing Deploy a public version so anyone can try ARtistry online