cicd-pipeline-qe-orchestrator

Compare original and translation side by side

🇺🇸

Original

English
🇨🇳

Translation

Chinese

CI/CD Pipeline QE Orchestrator

CI/CD流水线QE编排器

<default_to_action> When orchestrating quality across CI/CD pipeline:
  1. ANALYZE pipeline phases: commit, build, test, staging, production
  2. SELECT optimal skills and agents for each phase
  3. CONFIGURE quality gates with measurable thresholds
  4. EXECUTE with parallel agent coordination
  5. ADAPT strategy based on risk, complexity, and environment
Quick Phase Selection:
  • Commit (Shift-Left) → TDD, code review, unit tests
  • Build → Coverage analysis, mutation testing, flaky detection
  • Integration → API contracts, performance, security
  • Staging → Chaos testing, visual regression, accessibility
  • Production (Shift-Right) → Synthetic monitoring, RUM, compliance
Critical Success Factors:
  • Quality gates block bad deployments
  • Agents coordinate through memory namespaces
  • Adapt strategy based on risk level </default_to_action>
<default_to_action> 在CI/CD流水线中编排质量工作时:
  1. 分析流水线阶段:提交、构建、测试、预发布、生产
  2. 为每个阶段选择最优技能与Agent
  3. 配置可量化阈值的质量门禁
  4. 通过并行Agent协调执行
  5. 根据风险、复杂度与环境调整策略
快速阶段选择:
  • 提交阶段(Shift-Left)→ TDD、代码评审、单元测试
  • 构建阶段 → 覆盖率分析、变异测试、不稳定测试检测
  • 集成阶段 → API契约、性能、安全测试
  • 预发布阶段 → 混沌测试、视觉回归、无障碍测试
  • 生产阶段(Shift-Right)→ 合成监控、真实用户监控(RUM)、合规性验证
关键成功因素:
  • 质量门禁阻止不良部署
  • Agent通过内存命名空间协同
  • 根据风险等级调整策略 </default_to_action>

Quick Reference Card

快速参考卡片

When to Use

适用场景

  • Designing pipeline test strategies
  • Implementing quality gates
  • Coordinating multiple QE agents
  • Shift-left and shift-right testing
  • 设计流水线测试策略
  • 实施质量门禁
  • 协调多个QE Agent
  • 左移/右移测试

Phase-Agent Matrix

阶段-Agent矩阵

PhasePrimary AgentsKey Skills
Commitqe-test-generator, qe-requirements-validatortdd-london-chicago, shift-left
Buildqe-test-executor, qe-coverage-analyzer, qe-flaky-test-huntertest-automation, mutation-testing
Testqe-api-contract-validator, qe-performance-tester, qe-security-scannerapi-testing, performance, security
Stagingqe-chaos-engineer, qe-visual-tester, qe-deployment-readinesschaos-engineering, accessibility
Prodqe-production-intelligence, qe-quality-analyzershift-right, compliance
阶段核心Agent关键技能
提交qe-test-generator, qe-requirements-validatortdd-london-chicago, shift-left
构建qe-test-executor, qe-coverage-analyzer, qe-flaky-test-huntertest-automation, mutation-testing
测试qe-api-contract-validator, qe-performance-tester, qe-security-scannerapi-testing, performance, security
预发布qe-chaos-engineer, qe-visual-tester, qe-deployment-readinesschaos-engineering, accessibility
生产qe-production-intelligence, qe-quality-analyzershift-right, compliance

Quality Gate Thresholds

质量门禁阈值

PhaseMetricThresholdBlocking
CommitUnit coverage> 80%Yes
BuildAll tests pass100%Yes
BuildMutation score> 70%No
TestAPI contractsNo breaking changesYes
Testp95 response< 200msYes
TestSecurity critical0Yes
StagingDeployment readiness> 85%Yes
阶段指标阈值是否阻止部署
提交单元测试覆盖率> 80%
构建所有测试通过100%
构建变异测试得分> 70%
测试API契约无破坏性变更
测试p95响应时间< 200ms
测试严重安全漏洞0
预发布部署就绪度> 85%

Fleet Configuration

集群配置

  • Topology: hierarchical
  • Max Agents: 10 per phase
  • Coordination: aqe/* memory namespace

  • 拓扑结构:分层式
  • 最大Agent数量:每个阶段10个
  • 协同方式:aqe/* 内存命名空间

Pipeline Phases

流水线阶段

Phase 1: Commit (Shift-Left)

阶段1:提交(Shift-Left)

Goal: Catch defects early, ensure testability
Agents:
  • qe-test-generator
    - Generate unit tests
  • qe-requirements-validator
    - BDD scenarios, INVEST criteria
Skills:
shift-left-testing
,
tdd-london-chicago
,
code-review-quality
javascript
// Parallel execution
Task("Generate Tests", "Create unit tests for new methods", "qe-test-generator")
Task("Validate Requirements", "Check BDD scenarios", "qe-requirements-validator")
Gates: Unit coverage > 80%, Static analysis clean, Code review approved

目标: 尽早发现缺陷,确保可测试性
Agent:
  • qe-test-generator
    - 生成单元测试
  • qe-requirements-validator
    - BDD场景验证、INVEST准则检查
技能:
shift-left-testing
,
tdd-london-chicago
,
code-review-quality
javascript
// Parallel execution
Task("Generate Tests", "Create unit tests for new methods", "qe-test-generator")
Task("Validate Requirements", "Check BDD scenarios", "qe-requirements-validator")
门禁要求: 单元测试覆盖率>80%、静态分析无问题、代码评审通过

Phase 2: Build

阶段2:构建

Goal: Validate integration, ensure coverage
Agents:
  • qe-test-executor
    - Run test suites
  • qe-coverage-analyzer
    - Coverage gaps (O(log n))
  • qe-flaky-test-hunter
    - Detect/stabilize flaky tests
  • qe-regression-risk-analyzer
    - Minimal regression suite
Skills:
test-automation-strategy
,
mutation-testing
,
regression-testing
javascript
Task("Execute Tests", "Run full suite, store in aqe/test-results/*", "qe-test-executor")
Task("Coverage Analysis", "Identify gaps", "qe-coverage-analyzer")
Task("Flaky Detection", "Analyze test history", "qe-flaky-test-hunter")
Gates: All tests pass, Coverage > 90% critical paths, No new flaky tests

目标: 验证集成效果,确保覆盖率达标
Agent:
  • qe-test-executor
    - 运行测试套件
  • qe-coverage-analyzer
    - 检测覆盖率缺口(O(log n))
  • qe-flaky-test-hunter
    - 检测/稳定不稳定测试
  • qe-regression-risk-analyzer
    - 最小化回归测试套件
技能:
test-automation-strategy
,
mutation-testing
,
regression-testing
javascript
Task("Execute Tests", "Run full suite, store in aqe/test-results/*", "qe-test-executor")
Task("Coverage Analysis", "Identify gaps", "qe-coverage-analyzer")
Task("Flaky Detection", "Analyze test history", "qe-flaky-test-hunter")
门禁要求: 所有测试通过、关键路径覆盖率>90%、无新增不稳定测试

Phase 3: Integration/Test

阶段3:集成/测试

Goal: Validate contracts, performance, security
Agents:
  • qe-api-contract-validator
    - Breaking changes detection
  • qe-performance-tester
    - Load test critical paths
  • qe-security-scanner
    - SAST/DAST scans
  • qe-test-data-architect
    - Realistic test data (10k+/sec)
Skills:
api-testing-patterns
,
performance-testing
,
security-testing
javascript
// Parallel testing
Task("API Contracts", "Validate for breaking changes", "qe-api-contract-validator")
Task("Performance", "Load test 1000 users", "qe-performance-tester")
Task("Security", "SAST/DAST scan", "qe-security-scanner")
Gates: No breaking API changes, p95 < 200ms, No critical vulnerabilities

目标: 验证契约、性能与安全性
Agent:
  • qe-api-contract-validator
    - 检测破坏性变更
  • qe-performance-tester
    - 关键路径负载测试
  • qe-security-scanner
    - SAST/DAST扫描
  • qe-test-data-architect
    - 生成高并发真实测试数据(10k+/秒)
技能:
api-testing-patterns
,
performance-testing
,
security-testing
javascript
// Parallel testing
Task("API Contracts", "Validate for breaking changes", "qe-api-contract-validator")
Task("Performance", "Load test 1000 users", "qe-performance-tester")
Task("Security", "SAST/DAST scan", "qe-security-scanner")
门禁要求: 无API破坏性变更、p95响应时间<200ms、无严重漏洞

Phase 4: Staging

阶段4:预发布

Goal: Validate production-like environment, resilience
Agents:
  • qe-chaos-engineer
    - Fault injection
  • qe-visual-tester
    - Visual regression
  • qe-deployment-readiness
    - Risk assessment
Skills:
chaos-engineering-resilience
,
accessibility-testing
,
visual-testing
javascript
Task("Chaos Testing", "Controlled failure injection", "qe-chaos-engineer")
Task("Visual Testing", "Visual regression", "qe-visual-tester")
Task("Deployment Check", "Risk assessment", "qe-deployment-readiness")
Gates: Chaos tests pass, No visual regressions, Readiness > 85%

目标: 验证类生产环境的兼容性与韧性
Agent:
  • qe-chaos-engineer
    - 故障注入测试
  • qe-visual-tester
    - 视觉回归测试
  • qe-deployment-readiness
    - 风险评估
技能:
chaos-engineering-resilience
,
accessibility-testing
,
visual-testing
javascript
Task("Chaos Testing", "Controlled failure injection", "qe-chaos-engineer")
Task("Visual Testing", "Visual regression", "qe-visual-tester")
Task("Deployment Check", "Risk assessment", "qe-deployment-readiness")
门禁要求: 混沌测试通过、无视觉回归、就绪度>85%

Phase 5: Production (Shift-Right)

阶段5:生产(Shift-Right)

Goal: Monitor real usage, validate compliance
Agents:
  • qe-production-intelligence
    - Incident → test scenarios
  • qe-quality-analyzer
    - Quality metrics and trends
Skills:
shift-right-testing
,
compliance-testing
javascript
Task("Production Intelligence", "Convert incidents to tests", "qe-production-intelligence")
Task("Quality Analysis", "Production metrics", "qe-quality-analyzer")
Gates: Synthetic monitors pass, Error rate < 0.1%, Compliance validated

目标: 监控真实用户使用情况,验证合规性
Agent:
  • qe-production-intelligence
    - 将事件转化为测试场景
  • qe-quality-analyzer
    - 分析质量指标与趋势
技能:
shift-right-testing
,
compliance-testing
javascript
Task("Production Intelligence", "Convert incidents to tests", "qe-production-intelligence")
Task("Quality Analysis", "Production metrics", "qe-quality-analyzer")
门禁要求: 合成监控通过、错误率<0.1%、合规性验证通过

Complete Pipeline Example

完整流水线示例

javascript
// Phase 1: Commit
Task("TDD Generation", "Generate tests for new features", "qe-test-generator")
Task("Requirements", "Validate BDD scenarios", "qe-requirements-validator")

// Phase 2: Build
Task("Execute Tests", "Full suite with coverage", "qe-test-executor")
Task("Coverage", "Analyze gaps", "qe-coverage-analyzer")
Task("Flaky Hunt", "Stabilize flaky tests", "qe-flaky-test-hunter")

// Phase 3: Integration
Task("API Contracts", "Check breaking changes", "qe-api-contract-validator")
Task("Performance", "1000 user load test", "qe-performance-tester")
Task("Security", "SAST/DAST scans", "qe-security-scanner")

// Phase 4: Staging
Task("Chaos", "Fault injection testing", "qe-chaos-engineer")
Task("Visual", "Visual regression", "qe-visual-tester")
Task("Readiness", "Deployment assessment", "qe-deployment-readiness")

// Phase 5: Production
Task("Intelligence", "Convert incidents", "qe-production-intelligence")
Task("Quality Gate", "Final validation", "qe-quality-gate")

javascript
// Phase 1: Commit
Task("TDD Generation", "Generate tests for new features", "qe-test-generator")
Task("Requirements", "Validate BDD scenarios", "qe-requirements-validator")

// Phase 2: Build
Task("Execute Tests", "Full suite with coverage", "qe-test-executor")
Task("Coverage", "Analyze gaps", "qe-coverage-analyzer")
Task("Flaky Hunt", "Stabilize flaky tests", "qe-flaky-test-hunter")

// Phase 3: Integration
Task("API Contracts", "Check breaking changes", "qe-api-contract-validator")
Task("Performance", "1000 user load test", "qe-performance-tester")
Task("Security", "SAST/DAST scans", "qe-security-scanner")

// Phase 4: Staging
Task("Chaos", "Fault injection testing", "qe-chaos-engineer")
Task("Visual", "Visual regression", "qe-visual-tester")
Task("Readiness", "Deployment assessment", "qe-deployment-readiness")

// Phase 5: Production
Task("Intelligence", "Convert incidents", "qe-production-intelligence")
Task("Quality Gate", "Final validation", "qe-quality-gate")

Adaptive Strategy

自适应策略

By Risk Level

按风险等级划分

RiskStrategyAgents
CriticalAll phases, manual gatesFull fleet
HighAutomated gates, comprehensive10+ agents
MediumSmart selection, risk-based5-8 agents
LowMinimal regression, fast2-3 agents
风险等级策略Agent配置
关键全阶段覆盖+人工门禁完整集群
自动化门禁+全面测试10+个Agent
智能选择+基于风险的测试5-8个Agent
最小化回归测试+快速执行2-3个Agent

By Application Type

按应用类型划分

TypeFocus SkillsPrimary Agents
APIapi-testing, contract, performanceapi-contract-validator, performance-tester
Web UIvisual-testing, accessibilityvisual-tester, accessibility
Mobilemobile-testing, compatibilityperformance-tester, visual-tester
Backenddatabase-testing, securitysecurity-scanner, performance-tester

类型重点技能核心Agent
APIapi-testing, contract, performanceapi-contract-validator, performance-tester
Web UIvisual-testing, accessibilityvisual-tester, accessibility
移动应用mobile-testing, compatibilityperformance-tester, visual-tester
后端database-testing, securitysecurity-scanner, performance-tester

Agent Coordination Hints

Agent协同提示

Memory Namespace

内存命名空间

aqe/pipeline/
├── phase-results/*         - Results from each phase
├── quality-gates/*         - Gate validation results
├── orchestration-plan/*    - Selected skills and agents
├── test-plan/generated     - Test plans
├── coverage/gaps           - Coverage analysis
├── security/findings       - Security results
└── performance/results     - Performance data
aqe/pipeline/
├── phase-results/*         - 各阶段结果
├── quality-gates/*         - 门禁验证结果
├── orchestration-plan/*    - 选定的技能与Agent
├── test-plan/generated     - 生成的测试计划
├── coverage/gaps           - 覆盖率分析缺口
├── security/findings       - 安全检测结果
└── performance/results     - 性能测试数据

Fleet Orchestration

集群编排

typescript
Task("Fleet Orchestration",
     "Coordinate 10 agents across phases: commit (2), build (3), test (3), staging (2)",
     "qe-fleet-commander")
typescript
Task("Fleet Orchestration",
     "Coordinate 10 agents across phases: commit (2), build (3), test (3), staging (2)",
     "qe-fleet-commander")

Blackboard Events

黑板事件

EventTriggerSubscribers
phase:commit:complete
Commit phase donebuild agents
coverage:gap:detected
Gap foundtest-generator
security:finding:critical
Vulnerabilityquality-gate
quality:gate:evaluated
Gate decisionfleet-commander

事件触发条件订阅者
phase:commit:complete
提交阶段完成构建阶段Agent
coverage:gap:detected
发现覆盖率缺口测试生成Agent
security:finding:critical
发现严重漏洞质量门禁
quality:gate:evaluated
门禁决策完成集群指挥官Agent

Quality Gate Configuration

质量门禁配置

json
{
  "commit": {
    "gates": [
      { "metric": "unit_coverage", "threshold": 80, "blocking": true },
      { "metric": "static_analysis_critical", "max": 0, "blocking": true }
    ]
  },
  "build": {
    "gates": [
      { "metric": "all_tests_passed", "threshold": 100, "blocking": true },
      { "metric": "mutation_score", "threshold": 70, "blocking": false }
    ]
  },
  "integration": {
    "gates": [
      { "metric": "api_breaking_changes", "max": 0, "blocking": true },
      { "metric": "performance_p95_ms", "threshold": 200, "blocking": true },
      { "metric": "security_critical", "max": 0, "blocking": true }
    ]
  }
}

json
{
  "commit": {
    "gates": [
      { "metric": "unit_coverage", "threshold": 80, "blocking": true },
      { "metric": "static_analysis_critical", "max": 0, "blocking": true }
    ]
  },
  "build": {
    "gates": [
      { "metric": "all_tests_passed", "threshold": 100, "blocking": true },
      { "metric": "mutation_score", "threshold": 70, "blocking": false }
    ]
  },
  "integration": {
    "gates": [
      { "metric": "api_breaking_changes", "max": 0, "blocking": true },
      { "metric": "performance_p95_ms", "threshold": 200, "blocking": true },
      { "metric": "security_critical", "max": 0, "blocking": true }
    ]
  }
}

Troubleshooting

故障排查

IssueCauseSolution
OOM during testsRunning all tests in parallelUse batched execution
Pipeline too slowComprehensive testing every commitSmart test selection
Gates always failingThresholds too strictAnalyze trends, adjust

问题原因解决方案
测试过程中内存不足并行运行所有测试使用批量执行方式
流水线执行过慢每次提交都执行全面测试智能选择测试用例
门禁总是不通过阈值设置过严分析趋势,调整阈值

Related Skills

相关技能

  • agentic-quality-engineering - Fleet coordination
  • shift-left-testing - Early defect detection
  • shift-right-testing - Production monitoring
  • chaos-engineering-resilience - Resilience testing

  • agentic-quality-engineering - 集群协同
  • shift-left-testing - 早期缺陷检测
  • shift-right-testing - 生产环境监控
  • chaos-engineering-resilience - 韧性测试

Remember

注意事项

The CI/CD Pipeline QE Orchestrator provides:
  • Phase-based strategy with optimal skill/agent selection
  • Quality gates that block bad deployments
  • Adaptive strategy based on risk and context
  • Full fleet coordination through memory namespaces
With Agents: Use
qe-fleet-commander
for multi-agent orchestration. Coordinate through
aqe/*
memory namespace. Batch operations for efficiency.
CI/CD流水线QE编排器提供:
  • 基于阶段的策略:为每个阶段选择最优技能与Agent
  • 质量门禁:阻止不良部署
  • 自适应策略:根据风险与场景调整
  • 完整集群协同:通过内存命名空间实现
使用Agent提示:使用
qe-fleet-commander
进行多Agent编排。通过
aqe/*
内存命名空间协同。采用批量操作提升效率。