MemoryScape

Inspiration

In the developer's personal experience, the poignant story of a beloved aunt with dementia ignited the mission to create an app that leverages Virtual Reality (VR) to reignite old memories. Research on using VR as a tool for individuals with dementia provided insights into the potential of offering novel stimuli and immersive experiences to unlock inaccessible memories.

What it does

MemoryScape allows users to select a photo, share a brief memory description, and, using generative AI (specifically DALL-E), transforms the image into a captivating VR panorama filled with the emotions of the original moment.

How we built it

Frontend: Vanilla HTML, CSS, JS
Backend: Python, Flask framework
Cloud Services: Firebase Storage, Firestore
AI: OpenAI API (DALL-E)
Other APIs: Google Maps API, Panolens API

Challenges we ran into

The development team encountered several challenges, including issues with Panolens integration, React compatibility with Panolens, frontend/backend WiFi issues, image storage, image conversion, and delays in panorama generation.

Accomplishments that we're proud of

Key achievements include seamless panorama creation using DALL-E and image stitching, quick adaptation to tech pivots due to depreciated software, implementation of a share memory feature, addressing gyro request issues, successful deployment on GitHub Pages, and effective handling of base64 image conversion.

What we learned

The development team gained insights into Gyro IOS 13+ privacy policies, progressive web app development, Firestore authentication, and the usage of the Google Colab platform.