• Kore Meta harnesses the power of Meta Presence Platform to innovate language learning. Our vision is to transform users' spaces into a vibrant cultural and educational mixed reality for immersive learning. Our team has crafted a gamified Japanese alphabet learning MR app inspired by the iconic sushi conveyor belt experience. Here, users become master sushi chefs, serving up delicious Hiragana dishes to a diverse cast of multiverse customers.

• Become the Sushi Chef of Japanese Alphabet: Multiverse Kaitenzushi

Put on your sushi chef's hat and dive into a multiverse of flavors with Multiverse Kaitenzushi! Learn to masterfully craft the perfect dish of Japanese hiragana, blending motivation and fun in an immersive MR experience. As the head chef of your learning journey, you'll stir up a storm of knowledge and become a master of the Japanese alphabet in no time!

During the hackathon, we enhanced our project by leveraging the collective expertise of our team members and merging our passion for Mixed Reality (MR) experiences with language learning by using Meta Presence Platform. We brainstormed innovative ideas, synergizing our diverse skill sets to create a cohesive project. We rapidly prototyped our concept using Shapes XR, testing the methodology's effectiveness. For technical refinement, we collaborated with Meta mentors, iterating on interaction options and refining the UI/UX experience to achieve a more intuitive and user-friendly interface. Our goal is to continue optimizing the UX for future iterations.

Our experience with Meta Presence Platform: Benefits: • Interaction SDK works well and enables effective interactions within the MR environment.

• Audio SDK samples are helpful for guidance and enhance the immersive experience in MR. • Voice SDK has potential for language learning applications with further development. Considerations: • Pinching and grabbing recognition can be sensitive, leading to unintended interactions. (Suggestion: Implement a sensitivity adjustment feature or refine the recognition algorithm.) • Voice SDK struggles with languages that use multiple alphabets, making it challenging to achieve accurate matches. (Suggestion: Develop more advanced language recognition capabilities or provide additional training data for languages with complex alphabets.) • Guardian boundary has a 10M2 limit, which may restrict the use of the platform for larger physical activities. • Passthrough can experience occasional distortion or delay, affecting the overall MR experience. • Metal All-in-One SDK Version 64 has some issues, forcing a revert to Version 63.

Built With

Share this project:

Updates