Palace in Wonderland

**Palace in Wonderland** helps Alzheimer's patients revisit memories through an AI-guided, interactive journey with voice narration, visuals, and a whimsical guide.

Comment

Wonderland Memory Palace: An AI-Powered Memory Enhancement Tool for Alzheimer's Patients

Inspiration

Alzheimer's disease affects millions worldwide, gradually eroding precious memories and connections. Inspired by Alice in Wonderland and ancient memory palace techniques, we created a tool that helps users preserve and revisit their memories in an engaging, multi-sensory way.

What it does

Wonderland Memory Palace combines journaling with AI-generated memory palace experiences to help users with memory impairments:

  1. Memory Journaling: Users record memories with basic details (title, date, location) and whatever fragments they recall.

  2. AI Memory Palace Generation: Our system transforms these memory fragments into an immersive "memory palace" - a classic memory enhancement technique reimagined with AI.

  3. Multi-sensory Experience:

    • Text narrative in second-person ("You walk into...")
    • Voice narration that guides users through their memories
    • Interactive 2D map with a character (our rabbit guide) moving between memory checkpoints
    • Visual indicators connecting physical spaces to memory details

How we built it

  • Frontend: React with Tailwind CSS and Framer Motion for smooth animations
  • AI Integration: OpenAI GPT-4 API with specialized prompting
  • Voice Synthesis: Web Speech API for narration
  • Interactive Map: Custom visualization with animated paths and checkpoints

The system takes a user's memory journal entry and transforms it into a structured journey through a house, where each room contains objects and details from their memory. The AI carefully bridges gaps in memory while maintaining authenticity.

Challenges we ran into

  • Creating a voice experience that felt natural and engaging rather than robotic
  • Designing an interface that's accessible for elderly users with potential cognitive challenges
  • Structuring AI prompts to generate consistent, meaningful memory palaces
  • Synchronizing the visual journey with the audio narration

Accomplishments that we're proud of

  • Creating a seamless integration between journaling and AI-generated memory palaces
  • Developing a multi-sensory experience that engages different learning modalities
  • Building an intuitive interface inspired by Alice in Wonderland's whimsical aesthetic
  • Successfully implementing the character journey visualization that brings memories to life

What we learned

  • The power of memory palace techniques for cognitive enhancement
  • How AI can help bridge gaps in memory without replacing authentic recollection
  • Design considerations for users with cognitive impairments
  • The technical challenges of synchronizing visual and audio experiences

What's next for Wonderland Memory Palace

  • Expanded customization of the character and environment
  • Family collaboration features to help relatives contribute memory details
  • Integration with smart home devices for ambient memory experience
  • Machine learning to improve memory palace generation based on user engagement
  • Clinical trials to measure cognitive benefits for early-stage Alzheimer's patients

Built With

  • react
  • tailwind-css
  • framer-motion
  • openai-gpt4
  • web-speech-api

README TEMPLATE LINK:

Built With

  • authentication
  • control:
  • express.js
  • firebase
  • framer-motion-voice-narration:-web-speech-api-ai-integration:-openai-gpt-4-api-interactive-map:-custom-visualization-with-animated-paths-backend-&-hosting:-node.js
  • frontend:-react
  • github
  • tailwind-css
  • vercel-(for-deployment)-database:-firebase-(for-memory-storage)-cloud-services:-aws-s3-(media-storage)
  • version
Share this project:

Updates