Inspiration
I wanted to experiment with minecraft and make a plugin or mod, this hackathon was the perfect way to expand on to codex's abilities and integrate it with minecraft
What it does
Sends ordinary text questions to a locally installed Codex CLI and displays the answer in Minecraft chat. Supports an explicit visual-context mode that can send a screenshot and 3D scan the player's environment. Stores separate conversation mappings for different world/player combinations. Provides local visual goals that can be visually checked by codex with the world context and player's environment. Provides a structured builder with preview, confirmation, verification, saved history, and undo.
How we built it
used java, fabric, gradle, codex and chatgpt
Challenges we ran into
a few errors while testing out the product.
Accomplishments that we're proud of
built a working minecraft mod that can understand user queries, can build and inspect the environment visually
What we learned
how fabric client mods interact with minecraft.
Log in or sign up for Devpost to join the conversation.