Inspiration
KU Hackfest 2023 beckoned us with its promise of innovation and camaraderie. Fueled by the pressing need for accessible labs in Nepal's education system, our project was born. In a nation where physical labs are a rarity, we harnessed the power of augmented reality to create a Virtual Lab (Prayogshala Anveshan). This breakthrough solution empowers students and researchers to experience experiments remotely, revolutionizing education in Nepal. Competing at KU Hackfest drove us to transform this vision into reality, while the event's vibrant knowledge exchange nurtured our growth.It could be the platform for us to engage, participate and build up some socio-relation with every new face around us. What attracted us was the sharing of knowledge & experience everyone have would be the charm.
What it does
Our project, the Prayogshala Anveshan, serves as an innovative solution to the pressing issue of limited access to physical laboratories in Nepal's education system. Its core functionality revolves around providing students and researchers with a means to conduct and visualize lab experiments remotely through augmented reality (AR) technology.
For instance, in the field of physics, the Prayogshala Anveshan could offer a transformative learning experience. Students could use AR to simulate experiments related to the conservation of momentum, a fundamental principle in physics. They could interact with virtual objects, each with its own mass and velocity, and observe how momentum is conserved in collisions or interactions. This immersive experience not only enhances their understanding of physics concepts but also eliminates the need for physical labs that may not be readily available.
Furthermore, AR technology can extend beyond traditional science experiments. As an illustration, consider the application of AR in simulating surgical procedures. Medical students can use AR to visualize and interact with a virtual patient's anatomy, providing a safe and immersive environment for practicing complex surgical techniques. This not only enhances their surgical skills but also ensures patient safety by allowing students to refine their expertise without performing procedures on real patients.
AR can help students to visualize and understand complex concepts and develop practical skills. Here are some of the benefits of using a Prayogshala Anveshan:
- Safety: AR allows students to perform experiments and procedures that would be dangerous or difficult to perform in a traditional laboratory setting.
- Efficiency: Prayogshala Anveshan can save time and resources, as students do not need to set up and clean up physical equipment.
- Engagement: AR can create a more engaging and immersive learning experience for students.
- Research Opportunities: Researchers can use the Prayogshala Anveshan for simulations, data collection, and experimentation, fostering innovation and scientific discovery within the community.
- Skill development: AR can help students to develop practical skills, such as how to use laboratory equipment and how to perform surgical procedures.
How we built it
We built our cross-platform mobile application using Flutter and Unity. Major steps in the development process include:
- Design the UX/UI of the app: This includes designing the user task flow, layout of the screens, the navigation between screens, and the visual elements of the app. We use Figma to design and Flutter to create mockups of the app and test them.
- Develop the backend: This includes developing the APIs that will be used to manage user accounts, labs, and AR with Unity.
- Develop the AR representation: This includes developing the 3D model of the pendulum ball for physics experiment and other models as required in lab. We use Unity to develop the AR, as it provides a robust set of features for creating and displaying AR content as we implemented it using 'Vuforia’ which provides tools to make augmented objects.
- Integrate the different components: This includes integrating the Flutter app and AR. And maintain code to handle user interactions and display the AR content of lab.
- Test and deploy the app: Once you have integrated all of the components, we test the app thoroughly and deploy it to Android.
Tools and Technologies
- Figma and Flutter for UX/UI design & development
- Unity for AR development using Vuforia
Challenges we ran into
Challenges are an inherent part of any project, and our ability to adapt and keep moving forward was key to our success. Limited access to mentors and documentation forced us to become resourceful with creative problem-solving.Our team became closer and more collaborative as we tackled these challenges together. The experience with internet disconnections taught us the importance of being prepared for unforeseen circumstances. Having backup plans in place can be a lifesaver in time-sensitive situations.
Accomplishments that we're proud of
Talking about our achievements in developing this virtual project, from creating an MVP with Vuforia to simulating labs in AR, demonstrate our team's dedication, innovation, and commitment to making a positive impact. We're excited about the future of our project and the possibilities it holds for education, training, and beyond.
What we learned
Not only building the application, we also learned how to present it in an interesting manner.
What's next for Prayogshala Anveshan
Prayogshala Anveshan by Trinetra has a lot of potential to improve. Technically, we could create an entire lab space and augment it in a virtual space.The future of our project is incredibly promising, and we have ambitious plans for its continued development and growth beyond the hackathon.We intend to continuously improve the user experience and functionality of our AR lab simulations. Our vision includes building an extensive content library covering a wide range of laboratory experiments and educational topics. We plan to ensure cross-platform compatibility, allowing users to access our AR lab simulations on various devices. As we expand our project's capabilities and user base, we'll focus on scalability to ensure it can accommodate a growing number of users and laboratories.
Log in or sign up for Devpost to join the conversation.