Project Story: AI-Powered SDLC Testing with Multi-Agent Automation
Inspiration
During our project and internship experiences, we noticed that testing takes up more than 40% of the total SDLC time. Manually writing test cases, executing them, and debugging errors slows down the development pipeline. As students passionate about AI, we wondered — what if intelligent agents could take over the most repetitive testing tasks?
That question inspired us to build a multi-agent AI system that automates testing in the SDLC — saving time, effort, and boosting developer productivity.
What It Does
Our system, Agentic Test AI, is a collaborative set of AI agents designed to:
- Auto-generate unit and integration test cases from source code
- Execute tests and collect results automatically
- Analyze bugs and suggest fixes using LLM-based insights
- Create a smart feedback loop for developers
Each agent performs a specific role but collaborates as part of a larger system — making testing faster, smarter, and mostly hands-free.
How We Built It
We divided the system into multiple intelligent agents:
- Test Generator Agent – Uses LLMs to create test cases from Python functions
- Execution Agent – Runs tests using
pytestand captures output - Bug Analyzer Agent – Reads error messages and explains them
- Feedback Agent – Summarizes the issue and suggests code improvements
Tools & Technologies:
- Python
- OpenAI GPT-4 APIs
- LangChain for chaining agents
- FastAPI for agent orchestration
- Markdown + LaTeX for reporting
Challenges We Ran Into
- Designing how agents should communicate and share context
- Ensuring the generated test cases were relevant and didn't miss edge cases
- Prompt engineering for LLMs to handle different coding styles and errors
- Integrating everything into a working demo within limited time
Accomplishments That We're Proud Of
- Successfully created a working multi-agent system that reduced testing time by ~40% for Python projects
- Built an LLM-powered bug analyzer that provides human-readable explanations
- Collaborated effectively as a student team, learning rapidly and iterating quickly
What We Learned
- How to structure and manage multi-agent AI systems
- Real-world challenges in automated software testing
- Using LLMs effectively for code-related tasks
- The importance of prompt design, debugging, and collaboration
What's Next for AI-Powered SDLC Testing with Multi-Agent Automation
- Extend support to other languages like JavaScript, C, and Java
- Improve test case generation accuracy with domain-tuned LLMs
- Integrate with CI/CD tools like GitHub Actions and Jenkins
- Add a visual dashboard to monitor test health and agent performance
[ \text{“AgenticTest AI – Cut Testing Time, Not Corners.”} ]
Log in or sign up for Devpost to join the conversation.