Mind Palace

Inspiration

We wanted to gamify the Language Learning using visual feedback.

What it does

Using a companion ios app, you can add words of a different language with your list as you go about your day using ocr. This data is synced across devices so when you put on your quest 3, you see the words associated with the images and you have to match the words with the images

How we built it

We used swift ui for ios front end and in the backend we use aws for auth and storage along with stability ai on bedrock to generate media. On quest 3 we use unity to fetch the data and display it

Challenges we ran into

We ran into some issues mostly on the unity side of things with auth in cognito where it doesn’t have the associated dll files.

Accomplishments that we're proud of

Having a fully functional backend on aws to generate the media and being able to create a shared Vr experience

What we learned

We learned about auth issues that we can run into using cofnito with unity and we also learned how they can be solved. It unlocked a bunch of ideas to build up upon in the future