Inspiration
What it does
The Star Trek Customizable Card Game First Edition (1E) released in 1994 and was one of the first customizable card games to debut after Magic: The Gathering did in 1993. This game is beloved by a devoted and passionate group of players all around the world to this day!. Being one of the first customizable card games, this game has myriad rules and thus myriad rules comlpexity. It is not uncommon for a judge to incorrectly answer the question of a player during a tournament.
One of Generative AI's best traits is knowing the entirety of a body of text and summarizing or looking up items from it. It is the goal of this project to use the vast rules of this game and the power of Gemini to find needed rules for a complex game situation quickly and accurately.
How we built it
Fortunately, the community for the game has a well-documented set of rules on their website and adding a static copy to a data store was relatively easy. I included the text of the rule booklet and a complex glossary for good measure.
Several rules questiond and example answers were fed into the examples for the agent as well.
We are working on integration into the community's discord as well.
Challenges we ran into
The aistudio where gemini 1.5 is available was used for the original testing of this. Unfortunately, Gemini 1.5 has proven to be a much better base model for this particular agent. There are still some reasoning errors seen with some more complex questions asked of this. I look forward to Vertex AI Agents powered by ths model.
More straightforward (easy) questions seem to not be an issue for ths agent however.
Accomplishments that we're proud of
Giving players a first place to try to get their question answered is exciting. as feedback comes back I can turn it into further examples for the agent to hopefully increase accuracy!
What we learned
Few-shot examples are very helpful. We have found that even just a few cause the output of the agent to be much more accurate!
What's next for Star Trek Customizable Card Game Rules Agent
I would like to leverage the data store's ability to use websites for the data so that the data can be updated automatically when new rules are added. I will work with the game's webmasters to add that functionality.
Perhaps this could someday be a value-add to the community for premium members as well.
Gemini 1.5! More feedback! More Examples!
** You will need to be added to the allowlist of users if you wish to try this out. feel free to reach out to me directly for me to add you. I will need your google account username.
Built With
- low-code
Log in or sign up for Devpost to join the conversation.