Inspiration
Ever since i own my first Quest i wanted to use it more than just playing amazing games. Im a 3D artist and wanted to have the full power of a 3D software in vr to take advantage of 6DOF that VR gives you, taking my years of experience with Blender and 3DsMax, and the advancements in AI i could finally start my dream project
What it does
Tupi 3D aims to be a full fledged 3D DCC, with modeling, texturing, rig, animation simulation and what not, everything you need in order to create assets to be used by game engines. For this competition i had to redesign the project to work with hands input, so this is a proof of concept for how I can implement hands into Tupi3D later on
How we built it
The project uses Godot as the engine, it relies on a c++ core for performance and gd script for ui interactions. The coding was entirely done with the help of AI, with Claude code and Deep Seek v4 Flash supporting it, while AI was used for the code, many iterations were needed to get the design right
Challenges we ran into
The main challenge for hands is the lack of precision and buttons, i need to think some crazy hands gestures to accomplish some of the key combinations you can do with the controller. The lack of force feedback was also a big challenge, i had to add some particle and sound to convey to the user that some interaction was happening.
Accomplishments that we're proud of
Im really proud of how it feels now, after spending many hours in failed attempts, the tools started to feel good to use without controller, only 2 days before the deadline, it finally start to feel useful and fun.
What we learned
For VR its better to make things tactile, before i had the tools being just gesture combinations to enable them(like button clicks), but for hands, its better to just grab the thing and use it, keep the control simple, its less efficient for speed, but it works, and the less you fight in getting the gesture shapes to read the better.
What's next for Tupi3D Hands
I need to continue working on Tupi3D itself, but this Hands proof of concept gave me ideas to start implementing the rest of the features, I could imagine this version of the app as a free to play introduction to the full Tupi3D later on, or bring some of the learning and combine it for a full Hands implementation.
My goal is to have a release date for Feb 5th(as an homage to my belated dad on his birthday).
Built With
- c++
- claude
- deepseek
- godot
- metaquest
- openxr