Skip to content

fix: select integration/E2E tests by claim instead of lane ceilings - #108

Merged
shinpr merged 2 commits into
mainfrom
fix/test-selection-without-ceilings
Nov 17, 2026
Merged

shinpr merged 2 commits into
mainfrom
fix/test-selection-without-ceilings

Conversation

@shinpr

@shinpr shinpr commented Nov 17, 2026

Copy link
Copy Markdown
Owner

Summary

  • Remove the per-lane test ceilings (3 integration, 3 fixture-e2e, 2 service-integration-e2e per outcome) from integration-e2e-testing, acceptance-test-generator, and the E2E design reference. The Selection Gate, one owning test per claim, and claim combination already keep the set small; the ceilings only took effect when more distinct boundary claims needed proof, where they pushed toward dropping required proof or merging unrelated claims into one test.
  • The completion check now requires each claim that passed the Selection Gate to be owned by exactly one selected case. The set may still be empty.
  • Each skeleton records Selection evidence: why existing tests and narrower lanes leave its failure undetected, so lane review can check the selection.
  • Bump version to 1.8.9.

🤖 Generated with Claude Code

shinpr and others added 2 commits November 17, 2026 21:55
Lane ceilings (3 integration, 3 fixture-e2e, 2 service-integration-e2e
per outcome) capped the number of selected tests without tying the cap
to any claim. The Selection Gate, the one-owning-test-per-claim rule,
and claim combination already keep the set small; the ceilings only
took effect when more distinct boundary claims needed proof, where they
pushed toward dropping required proof or merging unrelated claims into
one test. The "per outcome" unit was also undefined, and "limits" and
"stays below" disagreed on whether the ceiling itself was allowed.

- integration-e2e-testing drops the ceilings. Its completion check now
  requires each claim that passed the Selection Gate to be owned by
  exactly one selected case.
- Each skeleton records Selection evidence: why existing tests and
  narrower lanes leave its failure undetected, so lane review can check
  the selection.
- acceptance-test-generator and the E2E design reference drop their
  ceiling mentions.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@shinpr shinpr self-assigned this Nov 17, 2026
@shinpr
shinpr merged commit c27edd6 into main Nov 17, 2026
2 checks passed
@shinpr
shinpr deleted the fix/test-selection-without-ceilings branch November 17, 2026 12:59
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant