PRD Automated Test Closed Loop

Overview

Main Regression Baseline + PRD Incremental Testing

automated-testing/<version>/

Workflow

1. Lock scope from PRD.

• Extract version objectives, test scope, out-of-scope items, and acceptance criteria.
• If this is an incremental change, reject "rewriting the entire test suite".

1. Define test layers and boundaries.

• Map acceptance criteria to

  Unit / Integration / E2E

  .
• Read the boundary chapter in

  references/Automated Test Encapsulation Guide.md

  and mark

  A/H/A+H

  .

1. Initialize version test directory.

• Read the initialization commands and templates in

  references/Automated Test Encapsulation Guide.md

  .
• Create

  automated-testing/<version>/

  and generate

  TEST_PLAN.md

  and

  TEST_REPORT.md

  .

1. Implement incremental testing.

• Prioritize reusing existing main regression test cases.
• Only add PRD differential test cases to

  tests/

  .
• Maintain deterministic assertions and avoid fragile UI selectors.

1. Execute AI self-test closed loop.

• Fixed order:

  Unit -> Integration -> E2E

  .
• Fix based on root cause and rerun upon failure (max 3 rounds).
• If blocked by environment, clearly record the blocking items and stop claiming pass.

1. Generate test report.

• Fill in commands, pass rate, failed items, and remaining risks according to the template.
• Output release gate conclusion:

  PASS

  or

  FAIL

  .

Rules

• Do not rebuild the entire test suite from scratch for each PRD.
• Must maintain both "Main Regression Suite + Version Incremental Suite".
• Each version must be bound to its own

  TEST_PLAN

  and

  TEST_REPORT

  .
• Must provide reproducible commands and result summaries; vague conclusions are prohibited.
• Do not claim to cover all quality risks; must list manual supplementary test items.

Automation Boundary Matrix

Suitable for Automation (Recommended AI Coverage)

• Functional correctness (state transitions, interface handling, validation rules)
• Regression paths (preventing recurrence of historical defects)
• Deterministic boundary scenarios (null values, illegal values, repeated operations)
• Stable smoke test processes (startup, key navigation, save/submit)
• Quantifiable non-functional indicators (timeout, error rate, crash rate)

Priority Manual Verification (Recommended Manual Backup)

• Usability and interaction smoothness
• Visual texture and brand consistency
• Rationality of business strategies
• Open exploration paths
• Product trade-offs and release priority judgment

Acceptance Criteria Marking Method

• A

  : Fully automatable

• H

  : Manual verification only

• A+H

  : Combined automation + manual verification

TEST_PLAN Template

# TEST_PLAN（<version>）

## 1. 测试范围
- PRD：<path>
- 范围内：
- 非范围：

## 2. 完成门槛
1. 计划内用例：<x>/<x> 通过
2. P0 用例通过率：100%
3. 连续两轮稳定通过
4. 无阻断/严重缺陷遗留

## 3. 用例清单
### Unit
- UT-xx：

### Integration
- IT-xx：

### E2E
- E2E-xx：

## 4. 执行顺序
1. Unit
2. Integration
3. E2E
4. 自动修复循环（最多 3 轮）

## 5. 输出产物
- TEST_REPORT.md
- 命令执行结果摘要

TEST_REPORT Template

# TEST_REPORT（<version>）

## 1. 结果摘要
- 日期：
- PRD：
- 结论：PASS | FAIL

## 2. 执行命令与结果
- <command>
  - result:

## 3. 分层覆盖结果
- Unit：passed/total
- Integration：passed/total
- E2E：passed/total

## 4. 失败用例
- 用例 ID：
- 现象：
- 根因：
- 修复状态：

## 5. 剩余风险（人工补测）
- 风险点：
- 自动化无法完全覆盖原因：

## 6. 发布门禁
- 门禁检查状态：
- 最终决策：

Version Directory Initialization Command

version="V0.6"
base_dir="自动化测试/$version"
mkdir -p "$base_dir/tests/unit" "$base_dir/tests/integration" "$base_dir/tests/e2e"

cat > "$base_dir/TEST_PLAN.md" <<'TPL'
# TEST_PLAN（V0.6）

## 1. 测试范围
- PRD：
- 范围内：
- 非范围：

## 2. 完成门槛
1. 计划内用例全部通过
2. P0 用例通过率 100%
3. 连续两轮稳定通过
4. 无阻断/严重缺陷遗留
TPL

cat > "$base_dir/TEST_REPORT.md" <<'RPT'
# TEST_REPORT（V0.6）

## 1. 结果摘要
- 日期：
- 结论：
RPT