codeprobe-testing
Original:🇺🇸 English
Not Translated
Audits code for test quality and coverage issues — missing tests, test smells, poor test structure, mock abuse, coverage gaps, and fragile test data. Identifies weaknesses in the test suite and generates fix prompts. Trigger phrases: "test quality", "test audit", "test review", "coverage check", "missing tests", "test quality audit".
2installs
Sourceroundingwell/codeprobe
Added on
NPX Install
npx skill4agent add roundingwell/codeprobe codeprobe-testingSKILL.md Content
Standalone Mode
If invoked directly (not via the orchestrator), you must first:
- Read for the output contract, execution modes, and constraints.
../codeprobe/shared-preamble.md - Load applicable reference files from based on the project's tech stack.
../codeprobe/references/ - Default to mode unless the user specifies otherwise.
full
Test Quality & Coverage Auditor
Domain Scope
This sub-skill detects test quality and coverage issues across six categories:
- Missing Tests — Public methods without corresponding tests, critical business logic untested.
- Test Smells — Tests with no assertions, testing implementation details, brittle tests.
- Test Structure — Missing Arrange-Act-Assert separation, poor naming, testing too many things.
- Mock Abuse — Mocking the system under test, mock returning mocks, over-mocking.
- Coverage Gaps — No tests for error paths, authorization logic, edge cases.
- Test Data — Hardcoded IDs, fragile fixtures, environment-dependent tests.
What It Does NOT Flag
- Missing tests for trivial getters/setters or pure DTOs — these add testing overhead without meaningful coverage.
- Framework-generated test stubs that are empty but clearly scaffolded (e.g., Laravel's , Create React App's
ExampleTest.php) — these are starting points, not abandoned tests.App.test.js - Integration/E2E test suites that intentionally don't follow unit test conventions — different test levels have different design constraints.
- Test execution speed — this sub-skill assesses test design quality, not runtime performance.
- Tests in ,
vendor/, or other dependency directories.node_modules/
Detection Instructions
Severity Ceiling
No finding from this sub-skill should ever be classified as Critical. Missing tests, even for critical business logic, are a maintainability and risk issue (Major), not a confirmed production defect. The highest severity this sub-skill may assign is Major. Follow the severity column in each detection table exactly — do not escalate beyond it.
Missing Tests
| ID Prefix | What to Detect | How to Detect | Severity |
|---|---|---|---|
| Public methods with no corresponding test | Scan source directories for public class methods. For each, check if a corresponding test file/method exists. Use test file naming conventions: | Major |
| Critical business logic untested | Identify classes/methods handling payments, authentication, authorization, order processing, or data mutations. Check whether these have dedicated test coverage. | Major |
| Edge cases unaddressed | When tests exist for a method, check whether they cover: null/empty inputs, boundary values (0, -1, max), error cases, and the happy path. Flag methods with only happy-path tests. | Minor |
Test Smells
| ID Prefix | What to Detect | How to Detect | Severity |
|---|---|---|---|
| Tests with no assertions | Search test methods for assertion calls ( | Major |
| Tests testing implementation details | Tests that mock every dependency and only verify call order/counts rather than outcomes. Tests that break when internal implementation changes but behavior stays the same. Look for excessive | Minor |
| Brittle tests coupled to external state | Tests that depend on database state not set up in the test, file system paths, network calls, or system time without mocking. Look for raw SQL in tests, | Minor |
| Tests dependent on execution order | Tests that pass individually but fail when run together (or vice versa). Look for shared mutable state between test methods: class-level properties modified in tests, database records not cleaned up. | Major |
Test Structure
| ID Prefix | What to Detect | How to Detect | Severity |
|---|---|---|---|
| Missing Arrange-Act-Assert separation | Test methods where setup, execution, and assertion are interleaved rather than clearly separated. Multiple act+assert cycles in one test. | Minor |
| Test names that don't describe the scenario | Test methods named | Minor |
| Single test testing too many things | Test methods with 5+ assertions on unrelated outcomes, or that test multiple scenarios in sequence. Should be split into focused tests. | Minor |
Mock Abuse
| ID Prefix | What to Detect | How to Detect | Severity |
|---|---|---|---|
| Mocking the system under test | Test creates a mock/partial mock of the class being tested. The test is testing the mock, not the actual code. Look for | Major |
| Mock returning mocks | Mock objects configured to return other mock objects, creating deep mock chains. | Major |
| Over-mocking making tests pass regardless | Tests where every dependency is mocked and the mocks return exactly what the code expects, making the test a tautology. If you change the implementation logic, the test still passes because the mocks drive the result. | Minor |
Coverage Gaps
| ID Prefix | What to Detect | How to Detect | Severity |
|---|---|---|---|
| No tests for error/exception paths | Methods with try/catch blocks or error handling where tests only cover the success path. No test triggers the catch/error branch. | Minor |
| No tests for authorization logic | Permission checks, policy methods, gate definitions, middleware authorization — code that controls access but has no dedicated tests. | Major |
| No edge case tests | Functions handling arrays/collections without tests for empty input. Numeric functions without tests for zero, negative, or boundary values. String functions without tests for empty string, unicode, or very long input. | Minor |
Test Data
| ID Prefix | What to Detect | How to Detect | Severity |
|---|---|---|---|
| Hardcoded IDs that may collide | Tests using hardcoded numeric IDs ( | Minor |
| Fragile factory/fixture setup | Tests with complex inline data setup that duplicates across multiple tests instead of using factories/fixtures/builders. | Minor |
| Tests relying on specific database state | Tests that assume certain records exist in the database without creating them in the test setup. Depends on seeders or previous test execution. | Minor |
ID Prefix & Fix Prompt Examples
All findings use the prefix, numbered sequentially: , , etc.
TEST-TEST-001TEST-002Fix Prompt Examples
- "Write a test for that covers: empty cart (expect 0), single item, multiple items, and item with discount. Use
OrderService@calculateTotalfor test data. Place inOrderFactory."tests/Unit/Services/OrderServiceTest.php - "The test at
test_user_can_loginhas no assertions — it only calls the login endpoint. Addtests/Feature/AuthTest.php:25,assertStatus(200), andassertAuthenticated()assertions."assertJsonStructure(['token']) - "In , the mock chain is mocking too deeply. Create a concrete
tests/Unit/PaymentServiceTest.php:40that implements the gateway interface and returns predictable responses instead of nested mock returns."FakePaymentGateway - "Replace the hardcoded user ID in
42withtests/Feature/OrderTest.php:15to prevent test collisions in parallel test runs."User::factory()->create()->id