Meta101

Inspiration

The inspiration behind Meta101 stems from the desire to explore and showcase the potential of marker-based WebAR in creating an immersive metaverse experience. By leveraging cutting-edge technologies like MindAR, TensorFlow.js, and Fingerpose.js, we aim to push the boundaries of augmented reality and provide users with an educational and dynamic adventure.

What it does

Meta101 is a marker-based WebAR project that takes users on a captivating journey through the metaverse. It utilizes MindAR to seamlessly integrate virtual elements into the real world, creating an interactive experience. Users can control audio and navigate through the metaverse using intuitive hand gestures, powered by TensorFlow.js and Fingerpose.js. The core technologies of HTML, CSS, and JavaScript form the foundation, driving the structure, style, and overall functionality of this innovative WebAR project.

How we built it

The foundation of Meta101 lies in the integration of MindAR, TensorFlow.js, and Fingerpose.js. MindAR facilitates marker-based augmented reality, ensuring a smooth blend of virtual and real-world elements. TensorFlow.js empowers interactive hand gestures, enabling users to control audio and navigate seamlessly. Fingerpose.js enhances hand tracking, allowing for gestures like palm movements for audio control and pointing for navigation. The project's structure, style, and functionality are driven by HTML, CSS, and JavaScript, providing a cohesive and engaging user experience.

Challenges we ran into

While developing Meta101, we faced various challenges, including optimizing the performance of MindAR to ensure real-time and accurate marker-based augmented reality. Integrating TensorFlow.js and Fingerpose.js posed technical intricacies, requiring us to fine-tune the hand gesture recognition for precise control. Additionally, balancing the educational and dynamic aspects of the adventure presented design challenges that demanded creative solutions.

Accomplishments that we're proud of

Despite the challenges, we are proud to have successfully created a marker-based WebAR project that seamlessly blends the real and virtual worlds. The integration of MindAR, TensorFlow.js, and Fingerpose.js has resulted in an interactive and educational metaverse journey. Our achievement lies in delivering a project that not only showcases technological prowess but also provides users with a unique and immersive experience.

What we learned

Throughout the development of Meta101, we gained valuable insights into optimizing augmented reality performance, fine-tuning gesture recognition, and balancing educational content with dynamic experiences. The collaborative use of MindAR, TensorFlow.js, and Fingerpose.js has broadened our understanding of creating compelling and interactive WebAR projects.

What's next for Meta101

Looking ahead, we envision expanding Meta101 by incorporating more educational content, diverse environments, and enhancing gesture controls. We aim to refine the user experience, exploring additional features and integrations to further push the boundaries of marker-based WebAR. Additionally, community feedback will play a crucial role in shaping the future developments of Meta101, ensuring it continues to evolve as a groundbreaking metaverse experience.

Built With

• css3
• fingerpose.js
• html5
• javascript
• mindar
• tensorflow.js
• three.js