๐ŸŒณ QwenTree โ€” Multimodal Tree File Agent

๐Ÿ† Global AI Hackathon Series with Qwen Cloud 2026 Track: Memory Agent

๐Ÿ’ก Inspiration

We've spent months building SHIVA, an agentic AI system with persistent memory, skills, and swarm orchestration. We learned a hard truth: most AI agents are black boxes. You give them a task, they give you an answer, but you have no idea what they can actually do or how they think.

We wanted to build something different. An agent whose capabilities are transparent, discoverable, and extensible. An agent where you can literally list its skills like files in a directory.

When we discovered the Qwen Cloud ecosystem โ€” with its incredible multimodal models (Qwen-Max, Qwen-VL, Qwen-Audio, CosyVoice, HappyHorse) all accessible through a single API โ€” we knew we had the perfect platform.

QwenTree was born: a Tree File Agent that organizes its capabilities as a living file system.

๐Ÿง  What We Built

QwenTree is a multimodal Tree File Agent where:

  • 31 skills across 10 categories (vision, audio, video, code, web, files, system, memory, media, integrations)
  • 3-tier hierarchical memory (ChromaDB + PostgreSQL + Redis) inspired by the Confucius paper
  • 6,099 memory items from 212 real development sessions โ€” the agent remembers months of actual work
  • CLI-first with a beautiful Textual TUI
  • 100% powered by Qwen Cloud models

The key differentiator? QwenTree doesn't just answer questions. It remembers. It recalls specific debugging sessions from weeks ago, the exact commands we ran, the errors we encountered, and the solutions we implemented. It's not a chatbot โ€” it's a persistent, context-aware engineering partner.

๐Ÿ—๏ธ How We Built It

Architecture:

๐Ÿง  ORCHESTRATOR (Qwen-Max) โ†’ analyzes query, routes to skills ๐ŸŒณ TREE NAVIGATOR โ†’ skills as navigable files (ls, cd, cat, exec) ๐Ÿ—„๏ธ LIVING BRAIN โ†’ 3-tier memory (ChromaDB + PostgreSQL + Redis)

We reused our existing infrastructure from months of development:

  • Memory system from our Confucius Agent implementation
  • Infrastructure running on Hetzner VPS with Docker
  • 212 real development sessions auto-ingested into the memory tiers

Tech Stack: | Component | Technology | |-----------|-----------| | Orchestrator | Qwen3.7-Max | | Vision | Qwen-VL-Max | | Audio | Qwen-Audio + CosyVoice-01 | | Video Generation | HappyHorse-1.1-T2V | | Memory | ChromaDB + PostgreSQL + Redis | | CLI | Textual (Python TUI) | | Web | Playwright + httpx | | Infra | Docker Compose + Hetzner VPS |


๐Ÿšง Challenges We Faced

  1. Memory ingestion: Processing 212 sessions into 3 tiers of structured memory required careful NLP classification to separate canonical facts from observations and raw data.

  2. True multimodality: Integrating vision, audio, video, and code execution through a unified skill tree while maintaining low latency was architecturally complex.

  3. Making it extensible: We wanted anyone to add a skill by simply creating a Python file. Achieving auto-discovery with proper tool calling integration took several iterations.

  4. The demo itself: Recording a 22-minute live demo and editing it down to 5 minutes with a proper voiceover was its own challenge!

๐Ÿ Accomplishments

  • โœ… 31 working skills across 10 categories
  • โœ… 6,099 memory items from 212 real sessions
  • โœ… 89 automated tests โ€” all passing
  • โœ… Fully open source under Apache 2.0
  • โœ… Live production demo running on Hetzner VPS
  • โœ… 3-tier hierarchical memory โ€” a first among hackathon entries

๐Ÿ“š What We Learned

  1. Memory makes the difference: A stateless chatbot is forgettable. An agent that remembers your history becomes a true partner.

  2. Qwen Cloud is powerful: One API key unlocks vision, audio, video generation, and state-of-the-art reasoning. The multimodal capabilities exceeded our expectations.

  3. CLI-first is liberating: Without the complexity of a web UI, we focused entirely on agent capabilities and terminal UX.

  4. Real data beats synthetic: Our 212 real sessions made the agent functional from day one โ€” no placeholder data needed.


๐Ÿ”ฎ What's Next for QwenTree

  • Web UI: Complementary interface for non-terminal users
  • Plugin marketplace: Community-contributed skills
  • Multi-agent collaboration: Multiple QwenTree instances coordinating
  • More integrations: Direct connections to CI/CD, monitoring, and business tools

๐Ÿ™ Acknowledgments

Built with โค๏ธ by Sebastiรกn Wagner and SHIVA (our AI development partner).

Special thanks to Alibaba Cloud and the Qwen team for:

  • Incredible multimodal models accessible through a unified API
  • The hackathon opportunity and generous credits
  • HappyHorse โ€” the #1 text-to-video model worldwide

๐ŸŒ Links:

Built With

Share this project:

Updates