Museum Muse

Let's make art and museums accessible to everybody.

Comment

Inspiration

I love wandering around in museums to learn about culture and art. However, I have always felt that museums should be more accessible to people from different nationalities, languages, and physical needs.

What it does

The application allows the user to take a photo with the camera or the meta rayban glasses of any art inside or outside the museum and reads to the user information that goes beyond the curator's note next to the art piece. The user is able to ask with the AI Guide additional questions to learn more. It also provides a history of the art works the user can review and an art map of where the photo was taken to help the user remember their journey.

How we built it

Using XCode, Gemini API, Gemini Cloud, and Eleven Labs Voice API.

Challenges we ran into

Integrating the API into the application and getting the voice API to work.

Accomplishments that we're proud of

The app is fully functional and can provide the user with information on objects found inside the museum and outside.

What we learned

Gemini paired with a good voice is a very engaging conversation partner.

What's next for Museum Muse

Contact museums and see if they are interested in a pilot.

Built With

Share this project:

Updates