Inspiration

Originally i wanted to cook late at night with things i had something quick and realized that i wasn't very good at quick but with todays AR/VR and ai technology i though build a interactive app to help you learn to cook and cook something along the way. I realized that this can be worthwile for anything like cleaning up you room efficiently the ai along with virtual technology can help you be professional at anything that you have no idea even basic level. You can cook like a michelin star chef even though it's your first time in the kitchen. If i can you can to.

What it does

Reality Academy is an immersive virtual cooking classroom. Users can explore a 3D kitchen, choose recipes based on ingredients they have available, and follow step-by-step cooking lessons. The current prototype includes a virtual kitchen, 3D ingredient models, recipe matching, multiple recipe options, and an interactive cooking instruction board.

How we built it

We built the project using JavaScript, Meta's Immersive Web SDK, Three.js, UIKitML, and IWER for testing the VR experience through a desktop emulator. We created a 3D kitchen environment, added ingredient models, built a recipe matching engine, and developed a cooking lesson system that updates instructions as users move through each step.

Challenges we ran into

Learning a new VR development framework was probably the biggest challenge. We had to figure out how to create 3D objects, load them into the environment, and make the spatial UI work correctly. Getting the cooking lesson board to update dynamically also took some debugging. We also spent time experimenting with mouse and VR interaction for selecting ingredients. I basically put out the app idea and potential we can do with it and on top of what we can do in other industries and areas as well.

Accomplishments that we're proud of

We're proud that we managed to build a working virtual kitchen from scratch and get the main cooking experience running. We have multiple recipes, ingredient models appearing in the kitchen, a working recipe matching system, and an interactive lesson board that guides users through cooking steps and displays a completion message.

What we learned

We learned a lot about WebXR development, Three.js, spatial interfaces, and how to structure an immersive application. We also learned how challenging it can be to combine 3D environments with application logic and interactive UI.

What's next for Reality Academy

We want to connect Reality Academy to our mobile pantry scanning app so users can scan their fridge and cupboards, have AI recognize their ingredients, and generate recipes based on what they already have. We also want to add a virtual AI cooking instructor, more realistic ingredient interactions, hand tracking, and personalized cooking lessons.

Built With

  • 3d
  • artificial-intelligence
  • cooking
  • education
  • eta-immersive-web-sdk
  • interactive-learning
  • iwer
  • javascript
  • meta
  • recipe
  • three.js
  • uikitml
  • virtual-reality
  • webxr
Share this project:

Updates

Submission history