Herbiverse

Inspiration

Our inspiration included wanting to learn technology, team collaboration, a hackathon experience, and bringing an idea to life eventhough we didn’t complete it yet.

What it does

The project is for medtech, a virtual herbal garden. It provides and interactive and immersive experience in gaining knowledge about the different medicinal plants for different types of disorders or problems one might have. With this there would be a huge surplus in the usage of herb plants leading to a healthier lifestyle

How we built it

The build is divided into 3 parts

The entire 3D environment was made using the Unity game engine
The frontend of functionalities of gemini chatbot, discussion forrum, notes, and plant scan were made using ReactJS
Our backend server running on ExpressJS

Challenges we ran into

The main challenge we faced was getting an accurate dataset containing the information regarding each plant We were finding difficulties in getting low cost, low poly grade assets into our project with good performance and minimal loading Next we ran into the issue of communication between React components and Unity components which was done by passing messages between them. Another issue we had was connecting Unity with our database i.e. MongoDB which needed to parse the response data and store it within classes.

Accomplishments that we're proud of

We were proud of being able to create an environment with Unity and Blender which we have never used before and integrate it into our React App

What we learned

This is the first time our team had worked with Unity and we were able to learn many things especially regarding 3D development. We also were able to integrate Gemini AI into the project as an assistant to the end user who will help the user in getting to know about the app.

What's next for Herbiverse

We are building the 3D models of all the plants and will be adding 2 types of gardens - main garden consisting of all the plants and a personal garden where user can place the plants they collect from the main garden into their own version of a herbal garden giving more personalisation These two gardens will be portaled in via two portals placed in the entry garden. We will make the house interactive and allow the user to go into the house which contains different types of disorders or problems faced divided into different books Each book will have the information of the plants responsible in curing the disorder and will be able to navigate from the book into the plant in the main garden

Built With

Submitted to

XR Design Challenge

Created by

I worked on building the 3D terrain containing the 3D assets in Unity and the functionalities within Unity i.e creating portals between garden switches and adding music selection for users to listen and experience.
Integrated it into the React App which was made by the other teammates

Private user
I worked on integration and making of 2 components - Gemini and Plant Scan. They involved model training and api integration with added features . I also worked on react frontend part for the layout.

Vasita Puppala
I worked on building the basic UI, Player controls, Interactable objects, and feature in which you can get plant data of different plants from the database in Unity

Sai Ram Raj Chandanagiri
I contributed to integrating and developing the notes component with full functionality. Additionally, I created a few 3D plant models using Blender.

Sri Vyshnavi Nakka
I worked on -
1.Creation of plants' database from authenticated sources.
2.Creation and Integration of discussion forum react component.

Kaushik Sai Mamidi
Srishti Turki