Museums are rich with history and culture, but many visitors—especially students and younger audiences—struggle to stay engaged. Traditional exhibits often lack interactivity, and educational value is lost when learning feels passive. The broader challenge is: how can we make cultural learning more accessible, interactive, and enjoyable for everyone, regardless of background, age, or ability?
In parallel, digital inclusion in educational and cultural spaces remains uneven. Many existing solutions are either cost-prohibitive or lack integration with emerging AI technologies and real-time connectivity.
Overview — ARtifact
ARtifact is a mobile museum companion app that transforms in-person museum visits into interactive, personalized adventures — supported end-to-end by AWS infrastructure and AI services. Built using React Native, Expo, and a robust suite of AWS services, ARtifact combines augmented reality, image recognition, and gamified learning to create a more inclusive and impactful museum experience.
With ARtifact, users can:
- Scan artworks in real time using their mobile camera.
- Receive instant recognition and context via Amazon Rekognition, which identifies the art piece and unlocks a wealth of educational content.
- Engage in quests and challenges, earning XP and climbing ranks through cultural exploration.
- Experience 3D and AR content, making history feel alive and immersive.
- Track favorites and visited pieces, turning each visit into a personalized learning journey.
All of this is supported by a cohesive AWS backend — Amplify, Cognito, AppSync + GraphQL, DynamoDB, Lambda, Rekognition, API Gateway, IAM, S3, and CloudWatch — which work in tandem to provide a secure, scalable, and responsive infrastructure.
Rekognition as the Core Enabler
Amazon Rekognition plays a pivotal role in ARtifact’s innovation. It enables real-time artwork identification through custom-trained labels, allowing users to scan sculptures, paintings, or objects and instantly unlock contextual information. By leveraging the power of AI-driven computer vision, ARtifact creates a direct bridge between the physical and digital world — enhancing education by making content more visual, contextual, and interactive.
Foundational AI services like Rekognition can drive discovery and meaning in cultural education — especially when paired with telecommunications networks and edge technologies.
Potential Impact
On Education & Society:
ARtifact directly addresses the challenge of educational disengagement by making learning active, visual, and personalized. It offers a scalable model that museums, schools, and cultural institutions can adopt to improve learning outcomes and accessibility. By tapping into familiar mobile interactions and the magic of AI, it invites curiosity, sparks discovery, and helps users of all ages connect more deeply with history, culture, and art.
On Digital Inclusion:
ARtifact shows how telecommunications networks (5G/WiFi) and AI can work together to deliver real-time experiences — even in large, crowded environments like museums. This demonstrates a future where intelligent digital layers enhance physical spaces, making them more inclusive and engaging for everyone.
Impact Beyond the Target Community
While ARtifact may seem to be designed for museum-goers, its architecture and approach extend far beyond the gallery. Its ability to make physical environments more accessible, more engaging, and more educational has relevance in:
- K–12 and higher education, where learning can be enhanced through interactive, place-based exploration
- Cultural preservation, by making hard-to-access artifacts digitally available in immersive formats
- Tourism and public spaces, transforming cities into interactive classrooms
- Accessibility and inclusion, enabling visual and spatial learners, language-diverse users, and differently-abled visitors to interact with content on their own terms
ARtifact shows that AI doesn’t need to replace human experiences — it can elevate them, making spaces more meaningful and knowledge more available. The impact isn’t just technological — it’s emotional, educational, and cultural.
Conclusion
ARtifact tackles a real problem in education and cultural accessibility by reimagining how we explore museums. With AWS Rekognition at its core and a full stack of AWS services behind it, ARtifact turns physical visits into engaging digital journeys.
Built With
- amazon-cloudwatch
- amplify
- api-gateway
- appsync-+-graphql
- cognito
- dynamodb
- expo.io
- iam
- lambda
- node.js
- react-native
- rekognition
- s3
- typescript
Log in or sign up for Devpost to join the conversation.