ART extended with AR + AI

Try AR Effect on the image example!

Inspiration

Art has always been a window into different worlds, but what if we could open that window even wider? My inspiration came from the desire to bring people closer to art by using technology to uncover hidden dimensions. I wanted to make it possible to explore art in ways that were previously unimaginable.

What it does

The project allows users to experience art in new ways. While using AR+AI, you can look behind the canvas, explore parts of the artwork usually hidden from view, and interact with it in real time. It provides an experience that goes beyond traditional observation.

How we built it

The project was built using the generative AI model Rodin, which helped us create 3D extensions of the artwork. These were further refined manually to ensure authenticity and quality. The AR experience was developed using Lens Studio. To make it available to everyone, I made the experience as Web AR, so anyone with a device that has a camera and internet connection can try it out instantly.

While trying the AR tool I developed, find Van Gogh's Portrait de l'artiste painting and aim your back camera. Tap the screen to see the hidden back part of the canvas. The background is blurred and unsaturated to make you focus on the AR experience!

AR Effect in the Musée d’Orsay

Challenges we ran into

The main challenge was balancing the file size of AR effects to allow instant access while maintaining visual quality and preserving the essence of the original artwork.

Accomplishments that we're proud of

Seeing museum visitors noticing the AR effect and them being visibly suprised while discovering hidden parts of a painting was a highlight of the project.

What we learned

Working on this project provided valuable insights into integrating technology with art. Visiting the Musée d’Orsay and observing real-time reactions to the AR effect confirmed the potential of these tools to enhance cultural experiences.

What's next for ART extended with AR + AI

In the near future, I plan to integrate AR glasses into the project, creating even more immersive experiences. For now, the technology is fully functional on smartphones, allowing users to get a glimpse of how AR glasses will enhance art exploration. Additionally, I'd love to add a museum AI assistant to provide real-time insights, fun facts, and historical context, making every interaction with art more engaging and educational.