cicd-pipeline-qe-orchestrator
Compare original and translation side by side
🇺🇸
Original
English🇨🇳
Translation
ChineseCI/CD Pipeline QE Orchestrator
CI/CD流水线QE编排器
<default_to_action>
When orchestrating quality across CI/CD pipeline:
- ANALYZE pipeline phases: commit, build, test, staging, production
- SELECT optimal skills and agents for each phase
- CONFIGURE quality gates with measurable thresholds
- EXECUTE with parallel agent coordination
- ADAPT strategy based on risk, complexity, and environment
Quick Phase Selection:
- Commit (Shift-Left) → TDD, code review, unit tests
- Build → Coverage analysis, mutation testing, flaky detection
- Integration → API contracts, performance, security
- Staging → Chaos testing, visual regression, accessibility
- Production (Shift-Right) → Synthetic monitoring, RUM, compliance
Critical Success Factors:
- Quality gates block bad deployments
- Agents coordinate through memory namespaces
- Adapt strategy based on risk level </default_to_action>
<default_to_action>
在CI/CD流水线中编排质量工作时:
- 分析流水线阶段:提交、构建、测试、预发布、生产
- 为每个阶段选择最优技能与Agent
- 配置可量化阈值的质量门禁
- 通过并行Agent协调执行
- 根据风险、复杂度与环境调整策略
快速阶段选择:
- 提交阶段(Shift-Left)→ TDD、代码评审、单元测试
- 构建阶段 → 覆盖率分析、变异测试、不稳定测试检测
- 集成阶段 → API契约、性能、安全测试
- 预发布阶段 → 混沌测试、视觉回归、无障碍测试
- 生产阶段(Shift-Right)→ 合成监控、真实用户监控(RUM)、合规性验证
关键成功因素:
- 质量门禁阻止不良部署
- Agent通过内存命名空间协同
- 根据风险等级调整策略 </default_to_action>
Quick Reference Card
快速参考卡片
When to Use
适用场景
- Designing pipeline test strategies
- Implementing quality gates
- Coordinating multiple QE agents
- Shift-left and shift-right testing
- 设计流水线测试策略
- 实施质量门禁
- 协调多个QE Agent
- 左移/右移测试
Phase-Agent Matrix
阶段-Agent矩阵
| Phase | Primary Agents | Key Skills |
|---|---|---|
| Commit | qe-test-generator, qe-requirements-validator | tdd-london-chicago, shift-left |
| Build | qe-test-executor, qe-coverage-analyzer, qe-flaky-test-hunter | test-automation, mutation-testing |
| Test | qe-api-contract-validator, qe-performance-tester, qe-security-scanner | api-testing, performance, security |
| Staging | qe-chaos-engineer, qe-visual-tester, qe-deployment-readiness | chaos-engineering, accessibility |
| Prod | qe-production-intelligence, qe-quality-analyzer | shift-right, compliance |
| 阶段 | 核心Agent | 关键技能 |
|---|---|---|
| 提交 | qe-test-generator, qe-requirements-validator | tdd-london-chicago, shift-left |
| 构建 | qe-test-executor, qe-coverage-analyzer, qe-flaky-test-hunter | test-automation, mutation-testing |
| 测试 | qe-api-contract-validator, qe-performance-tester, qe-security-scanner | api-testing, performance, security |
| 预发布 | qe-chaos-engineer, qe-visual-tester, qe-deployment-readiness | chaos-engineering, accessibility |
| 生产 | qe-production-intelligence, qe-quality-analyzer | shift-right, compliance |
Quality Gate Thresholds
质量门禁阈值
| Phase | Metric | Threshold | Blocking |
|---|---|---|---|
| Commit | Unit coverage | > 80% | Yes |
| Build | All tests pass | 100% | Yes |
| Build | Mutation score | > 70% | No |
| Test | API contracts | No breaking changes | Yes |
| Test | p95 response | < 200ms | Yes |
| Test | Security critical | 0 | Yes |
| Staging | Deployment readiness | > 85% | Yes |
| 阶段 | 指标 | 阈值 | 是否阻止部署 |
|---|---|---|---|
| 提交 | 单元测试覆盖率 | > 80% | 是 |
| 构建 | 所有测试通过 | 100% | 是 |
| 构建 | 变异测试得分 | > 70% | 否 |
| 测试 | API契约 | 无破坏性变更 | 是 |
| 测试 | p95响应时间 | < 200ms | 是 |
| 测试 | 严重安全漏洞 | 0 | 是 |
| 预发布 | 部署就绪度 | > 85% | 是 |
Fleet Configuration
集群配置
- Topology: hierarchical
- Max Agents: 10 per phase
- Coordination: aqe/* memory namespace
- 拓扑结构:分层式
- 最大Agent数量:每个阶段10个
- 协同方式:aqe/* 内存命名空间
Pipeline Phases
流水线阶段
Phase 1: Commit (Shift-Left)
阶段1:提交(Shift-Left)
Goal: Catch defects early, ensure testability
Agents:
- - Generate unit tests
qe-test-generator - - BDD scenarios, INVEST criteria
qe-requirements-validator
Skills: , ,
shift-left-testingtdd-london-chicagocode-review-qualityjavascript
// Parallel execution
Task("Generate Tests", "Create unit tests for new methods", "qe-test-generator")
Task("Validate Requirements", "Check BDD scenarios", "qe-requirements-validator")Gates: Unit coverage > 80%, Static analysis clean, Code review approved
目标: 尽早发现缺陷,确保可测试性
Agent:
- - 生成单元测试
qe-test-generator - - BDD场景验证、INVEST准则检查
qe-requirements-validator
技能: , ,
shift-left-testingtdd-london-chicagocode-review-qualityjavascript
// Parallel execution
Task("Generate Tests", "Create unit tests for new methods", "qe-test-generator")
Task("Validate Requirements", "Check BDD scenarios", "qe-requirements-validator")门禁要求: 单元测试覆盖率>80%、静态分析无问题、代码评审通过
Phase 2: Build
阶段2:构建
Goal: Validate integration, ensure coverage
Agents:
- - Run test suites
qe-test-executor - - Coverage gaps (O(log n))
qe-coverage-analyzer - - Detect/stabilize flaky tests
qe-flaky-test-hunter - - Minimal regression suite
qe-regression-risk-analyzer
Skills: , ,
test-automation-strategymutation-testingregression-testingjavascript
Task("Execute Tests", "Run full suite, store in aqe/test-results/*", "qe-test-executor")
Task("Coverage Analysis", "Identify gaps", "qe-coverage-analyzer")
Task("Flaky Detection", "Analyze test history", "qe-flaky-test-hunter")Gates: All tests pass, Coverage > 90% critical paths, No new flaky tests
目标: 验证集成效果,确保覆盖率达标
Agent:
- - 运行测试套件
qe-test-executor - - 检测覆盖率缺口(O(log n))
qe-coverage-analyzer - - 检测/稳定不稳定测试
qe-flaky-test-hunter - - 最小化回归测试套件
qe-regression-risk-analyzer
技能: , ,
test-automation-strategymutation-testingregression-testingjavascript
Task("Execute Tests", "Run full suite, store in aqe/test-results/*", "qe-test-executor")
Task("Coverage Analysis", "Identify gaps", "qe-coverage-analyzer")
Task("Flaky Detection", "Analyze test history", "qe-flaky-test-hunter")门禁要求: 所有测试通过、关键路径覆盖率>90%、无新增不稳定测试
Phase 3: Integration/Test
阶段3:集成/测试
Goal: Validate contracts, performance, security
Agents:
- - Breaking changes detection
qe-api-contract-validator - - Load test critical paths
qe-performance-tester - - SAST/DAST scans
qe-security-scanner - - Realistic test data (10k+/sec)
qe-test-data-architect
Skills: , ,
api-testing-patternsperformance-testingsecurity-testingjavascript
// Parallel testing
Task("API Contracts", "Validate for breaking changes", "qe-api-contract-validator")
Task("Performance", "Load test 1000 users", "qe-performance-tester")
Task("Security", "SAST/DAST scan", "qe-security-scanner")Gates: No breaking API changes, p95 < 200ms, No critical vulnerabilities
目标: 验证契约、性能与安全性
Agent:
- - 检测破坏性变更
qe-api-contract-validator - - 关键路径负载测试
qe-performance-tester - - SAST/DAST扫描
qe-security-scanner - - 生成高并发真实测试数据(10k+/秒)
qe-test-data-architect
技能: , ,
api-testing-patternsperformance-testingsecurity-testingjavascript
// Parallel testing
Task("API Contracts", "Validate for breaking changes", "qe-api-contract-validator")
Task("Performance", "Load test 1000 users", "qe-performance-tester")
Task("Security", "SAST/DAST scan", "qe-security-scanner")门禁要求: 无API破坏性变更、p95响应时间<200ms、无严重漏洞
Phase 4: Staging
阶段4:预发布
Goal: Validate production-like environment, resilience
Agents:
- - Fault injection
qe-chaos-engineer - - Visual regression
qe-visual-tester - - Risk assessment
qe-deployment-readiness
Skills: , ,
chaos-engineering-resilienceaccessibility-testingvisual-testingjavascript
Task("Chaos Testing", "Controlled failure injection", "qe-chaos-engineer")
Task("Visual Testing", "Visual regression", "qe-visual-tester")
Task("Deployment Check", "Risk assessment", "qe-deployment-readiness")Gates: Chaos tests pass, No visual regressions, Readiness > 85%
目标: 验证类生产环境的兼容性与韧性
Agent:
- - 故障注入测试
qe-chaos-engineer - - 视觉回归测试
qe-visual-tester - - 风险评估
qe-deployment-readiness
技能: , ,
chaos-engineering-resilienceaccessibility-testingvisual-testingjavascript
Task("Chaos Testing", "Controlled failure injection", "qe-chaos-engineer")
Task("Visual Testing", "Visual regression", "qe-visual-tester")
Task("Deployment Check", "Risk assessment", "qe-deployment-readiness")门禁要求: 混沌测试通过、无视觉回归、就绪度>85%
Phase 5: Production (Shift-Right)
阶段5:生产(Shift-Right)
Goal: Monitor real usage, validate compliance
Agents:
- - Incident → test scenarios
qe-production-intelligence - - Quality metrics and trends
qe-quality-analyzer
Skills: ,
shift-right-testingcompliance-testingjavascript
Task("Production Intelligence", "Convert incidents to tests", "qe-production-intelligence")
Task("Quality Analysis", "Production metrics", "qe-quality-analyzer")Gates: Synthetic monitors pass, Error rate < 0.1%, Compliance validated
目标: 监控真实用户使用情况,验证合规性
Agent:
- - 将事件转化为测试场景
qe-production-intelligence - - 分析质量指标与趋势
qe-quality-analyzer
技能: ,
shift-right-testingcompliance-testingjavascript
Task("Production Intelligence", "Convert incidents to tests", "qe-production-intelligence")
Task("Quality Analysis", "Production metrics", "qe-quality-analyzer")门禁要求: 合成监控通过、错误率<0.1%、合规性验证通过
Complete Pipeline Example
完整流水线示例
javascript
// Phase 1: Commit
Task("TDD Generation", "Generate tests for new features", "qe-test-generator")
Task("Requirements", "Validate BDD scenarios", "qe-requirements-validator")
// Phase 2: Build
Task("Execute Tests", "Full suite with coverage", "qe-test-executor")
Task("Coverage", "Analyze gaps", "qe-coverage-analyzer")
Task("Flaky Hunt", "Stabilize flaky tests", "qe-flaky-test-hunter")
// Phase 3: Integration
Task("API Contracts", "Check breaking changes", "qe-api-contract-validator")
Task("Performance", "1000 user load test", "qe-performance-tester")
Task("Security", "SAST/DAST scans", "qe-security-scanner")
// Phase 4: Staging
Task("Chaos", "Fault injection testing", "qe-chaos-engineer")
Task("Visual", "Visual regression", "qe-visual-tester")
Task("Readiness", "Deployment assessment", "qe-deployment-readiness")
// Phase 5: Production
Task("Intelligence", "Convert incidents", "qe-production-intelligence")
Task("Quality Gate", "Final validation", "qe-quality-gate")javascript
// Phase 1: Commit
Task("TDD Generation", "Generate tests for new features", "qe-test-generator")
Task("Requirements", "Validate BDD scenarios", "qe-requirements-validator")
// Phase 2: Build
Task("Execute Tests", "Full suite with coverage", "qe-test-executor")
Task("Coverage", "Analyze gaps", "qe-coverage-analyzer")
Task("Flaky Hunt", "Stabilize flaky tests", "qe-flaky-test-hunter")
// Phase 3: Integration
Task("API Contracts", "Check breaking changes", "qe-api-contract-validator")
Task("Performance", "1000 user load test", "qe-performance-tester")
Task("Security", "SAST/DAST scans", "qe-security-scanner")
// Phase 4: Staging
Task("Chaos", "Fault injection testing", "qe-chaos-engineer")
Task("Visual", "Visual regression", "qe-visual-tester")
Task("Readiness", "Deployment assessment", "qe-deployment-readiness")
// Phase 5: Production
Task("Intelligence", "Convert incidents", "qe-production-intelligence")
Task("Quality Gate", "Final validation", "qe-quality-gate")Adaptive Strategy
自适应策略
By Risk Level
按风险等级划分
| Risk | Strategy | Agents |
|---|---|---|
| Critical | All phases, manual gates | Full fleet |
| High | Automated gates, comprehensive | 10+ agents |
| Medium | Smart selection, risk-based | 5-8 agents |
| Low | Minimal regression, fast | 2-3 agents |
| 风险等级 | 策略 | Agent配置 |
|---|---|---|
| 关键 | 全阶段覆盖+人工门禁 | 完整集群 |
| 高 | 自动化门禁+全面测试 | 10+个Agent |
| 中 | 智能选择+基于风险的测试 | 5-8个Agent |
| 低 | 最小化回归测试+快速执行 | 2-3个Agent |
By Application Type
按应用类型划分
| Type | Focus Skills | Primary Agents |
|---|---|---|
| API | api-testing, contract, performance | api-contract-validator, performance-tester |
| Web UI | visual-testing, accessibility | visual-tester, accessibility |
| Mobile | mobile-testing, compatibility | performance-tester, visual-tester |
| Backend | database-testing, security | security-scanner, performance-tester |
| 类型 | 重点技能 | 核心Agent |
|---|---|---|
| API | api-testing, contract, performance | api-contract-validator, performance-tester |
| Web UI | visual-testing, accessibility | visual-tester, accessibility |
| 移动应用 | mobile-testing, compatibility | performance-tester, visual-tester |
| 后端 | database-testing, security | security-scanner, performance-tester |
Agent Coordination Hints
Agent协同提示
Memory Namespace
内存命名空间
aqe/pipeline/
├── phase-results/* - Results from each phase
├── quality-gates/* - Gate validation results
├── orchestration-plan/* - Selected skills and agents
├── test-plan/generated - Test plans
├── coverage/gaps - Coverage analysis
├── security/findings - Security results
└── performance/results - Performance dataaqe/pipeline/
├── phase-results/* - 各阶段结果
├── quality-gates/* - 门禁验证结果
├── orchestration-plan/* - 选定的技能与Agent
├── test-plan/generated - 生成的测试计划
├── coverage/gaps - 覆盖率分析缺口
├── security/findings - 安全检测结果
└── performance/results - 性能测试数据Fleet Orchestration
集群编排
typescript
Task("Fleet Orchestration",
"Coordinate 10 agents across phases: commit (2), build (3), test (3), staging (2)",
"qe-fleet-commander")typescript
Task("Fleet Orchestration",
"Coordinate 10 agents across phases: commit (2), build (3), test (3), staging (2)",
"qe-fleet-commander")Blackboard Events
黑板事件
| Event | Trigger | Subscribers |
|---|---|---|
| Commit phase done | build agents |
| Gap found | test-generator |
| Vulnerability | quality-gate |
| Gate decision | fleet-commander |
| 事件 | 触发条件 | 订阅者 |
|---|---|---|
| 提交阶段完成 | 构建阶段Agent |
| 发现覆盖率缺口 | 测试生成Agent |
| 发现严重漏洞 | 质量门禁 |
| 门禁决策完成 | 集群指挥官Agent |
Quality Gate Configuration
质量门禁配置
json
{
"commit": {
"gates": [
{ "metric": "unit_coverage", "threshold": 80, "blocking": true },
{ "metric": "static_analysis_critical", "max": 0, "blocking": true }
]
},
"build": {
"gates": [
{ "metric": "all_tests_passed", "threshold": 100, "blocking": true },
{ "metric": "mutation_score", "threshold": 70, "blocking": false }
]
},
"integration": {
"gates": [
{ "metric": "api_breaking_changes", "max": 0, "blocking": true },
{ "metric": "performance_p95_ms", "threshold": 200, "blocking": true },
{ "metric": "security_critical", "max": 0, "blocking": true }
]
}
}json
{
"commit": {
"gates": [
{ "metric": "unit_coverage", "threshold": 80, "blocking": true },
{ "metric": "static_analysis_critical", "max": 0, "blocking": true }
]
},
"build": {
"gates": [
{ "metric": "all_tests_passed", "threshold": 100, "blocking": true },
{ "metric": "mutation_score", "threshold": 70, "blocking": false }
]
},
"integration": {
"gates": [
{ "metric": "api_breaking_changes", "max": 0, "blocking": true },
{ "metric": "performance_p95_ms", "threshold": 200, "blocking": true },
{ "metric": "security_critical", "max": 0, "blocking": true }
]
}
}Troubleshooting
故障排查
| Issue | Cause | Solution |
|---|---|---|
| OOM during tests | Running all tests in parallel | Use batched execution |
| Pipeline too slow | Comprehensive testing every commit | Smart test selection |
| Gates always failing | Thresholds too strict | Analyze trends, adjust |
| 问题 | 原因 | 解决方案 |
|---|---|---|
| 测试过程中内存不足 | 并行运行所有测试 | 使用批量执行方式 |
| 流水线执行过慢 | 每次提交都执行全面测试 | 智能选择测试用例 |
| 门禁总是不通过 | 阈值设置过严 | 分析趋势,调整阈值 |
Related Skills
相关技能
- agentic-quality-engineering - Fleet coordination
- shift-left-testing - Early defect detection
- shift-right-testing - Production monitoring
- chaos-engineering-resilience - Resilience testing
- agentic-quality-engineering - 集群协同
- shift-left-testing - 早期缺陷检测
- shift-right-testing - 生产环境监控
- chaos-engineering-resilience - 韧性测试
Remember
注意事项
The CI/CD Pipeline QE Orchestrator provides:
- Phase-based strategy with optimal skill/agent selection
- Quality gates that block bad deployments
- Adaptive strategy based on risk and context
- Full fleet coordination through memory namespaces
With Agents: Use for multi-agent orchestration. Coordinate through memory namespace. Batch operations for efficiency.
qe-fleet-commanderaqe/*CI/CD流水线QE编排器提供:
- 基于阶段的策略:为每个阶段选择最优技能与Agent
- 质量门禁:阻止不良部署
- 自适应策略:根据风险与场景调整
- 完整集群协同:通过内存命名空间实现
使用Agent提示:使用进行多Agent编排。通过内存命名空间协同。采用批量操作提升效率。
qe-fleet-commanderaqe/*