## Inspiration Art has always been a bridge across cultures and centuries, but traditional museums are often static and inaccessible for many. We were inspired by the idea of democratizing art education using AI, making it interactive and emotionally resonant. We wanted everyone — from a child in a small town to a professional in a bustling city — to feel a personal connection with art by letting it speak directly to them through technology.
What it does
MuseAI Whisper turns any artwork into a conversation. Users can upload a photo or scan an artwork with their device. The app uses AI to instantly analyze the piece and generate an engaging, story-rich explanation about its history, style, artist, and cultural significance. It also produces a modern reinterpretation of the artwork using DALL·E, imagining how it might look if created today. Additionally, it features a 3D living gallery where artworks transform over time, giving users a dynamic, immersive experience that evolves with each visit.
How we built it
We began by designing the app’s flow and user interface in Figma, focusing on clean layouts, smooth animations, and accessibility. Using Bolt.new, we constructed a multi-screen app with a splash animation, home, upload, results, and gallery screens. For the backend, we built Python-based cloud functions for calling OpenAI GPT to generate text explanations and DALL·E to create modern versions of artworks. We connected these APIs to Bolt workflows with secure HTTP requests. To provide a premium feel, we applied the Lora font and custom 3D animations created in After Effects, exported as Lottie files for web performance. Our team also designed a database schema in Airtable to store user sessions, artwork data, and generated images for persistent galleries.
Challenges we ran into
One of our biggest hurdles was integrating multiple real-time APIs within Bolt workflows while maintaining a seamless user experience. We encountered Tailwind CSS build errors like missing bg-background and border-border classes that caused Vite to fail; solving them required deep dives into our styling layers. Optimizing the performance of DALL·E image generation was another challenge, as API calls could be slow or inconsistent; we implemented caching strategies and fallback responses to keep users engaged. Coordinating between team members working remotely across different time zones added complexity to version control and testing.
Accomplishments that we're proud of
We’re incredibly proud of delivering a fully functional, end-to-end AI-powered experience that transforms how users interact with art. Our 3D living gallery brings artworks to life in a way we haven’t seen before. We achieved a polished, futuristic user interface complete with animations and smooth transitions, matching our goal of creating a “2050-ready” art experience. We also successfully integrated multiple APIs and overcame major technical hurdles to produce an app that’s both innovative and reliable.
What we learned
We gained hands-on experience orchestrating complex AI workflows and building robust real-time integrations with OpenAI GPT and DALL·E. We learned advanced Tailwind CSS debugging techniques, performance optimization for image-heavy apps, and how to create captivating user experiences with micro-animations. Our team honed skills in managing collaborative development and iterative design, ensuring every component aligned with our mission to make art accessible, modern, and engaging.
What's next for MuseAI Whisper
Looking ahead, we plan to integrate AR capabilities, allowing users to point their phone camera at real-world artworks and receive live AI explanations overlaid on their screen. We aim to build an AI-powered recommendation engine that suggests new art pieces based on user interests and emotional responses. We want to add social features so users can share their experiences, favorite artworks, and AI-generated modern versions, building a global community around interactive, AI-driven art exploration. Finally, we plan to partner with museums and galleries to bring MuseAI Whisper into physical spaces, transforming how people learn about and engage with art worldwide. proud of
Built With
- after-effects
- airtable
- css
- figma
- google-cloud
- html
- javascript
- lora-font
- lottie
- netlify
- openai-dall?e
- openai-gpt
- tailwind-css
- three.js
Log in or sign up for Devpost to join the conversation.