ToolTrace — Ship WebMCP agents you can trust.

ToolTrace is an observability, CI, security, and FinOps platform for WebMCP-enabled applications. It automatically discovers the tools a website exposes to AI agents and presents them through an interactive developer console. Developers can inspect schemas, permissions, arguments, outputs, latency, failures, side effects, and invocation histories. AgentCI executes goal-based tests to verify whether an AI agent can complete real workflows correctly. It detects behavioral regressions when models, prompts, application code, or WebMCP tool definitions change. ToolTrace Security builds tool attack graphs, fuzzes exposed actions, and detects unsafe permissions, prompt injection, and dangerous tool chains. ToolTrace FinOps calculates the real cost of an agent objective across LLM calls, WebMCP tools, APIs, databases, and infrastructure. Its unified agent trace shows exactly what an agent did, why a workflow failed, how much it cost, and where security risks appeared. Developers can replay runs, compare versions, enforce cost/security budgets, and block unsafe releases directly from CI/CD. ToolTrace itself exposes WebMCP tools, allowing ChatGPT to investigate, test, secure, and optimize other WebMCP applications through natural language.

Built With

Share this project:

Updates

Submission history