Skip to content

Clarify evidence needed for extra defensive machinery - #420

Merged
bompus merged 1 commit into
mainfrom
docs/defensive-evidence
Oct 23, 2026
Merged

bompus merged 1 commit into
mainfrom
docs/defensive-evidence

Conversation

@bompus

@bompus bompus commented Oct 23, 2026 •

Copy link
Copy Markdown
Owner

Require a concrete failure, evidence that it can occur, and maintenance costs when proposing extra defensive machinery. The existing simplicity rule already preserves security, validation and stated requirements. The clarification adds that explanation and reserves decision requests for proposals that expand authorized scope.

This is a guidance refinement prompted by comparison with an existing speculative-complexity rule, not a measured model-behavior result. The screening fixture now removes the entire revised rule. Fresh-install output grows to 30,350 bytes; its documented budget increases from 30,200 to exactly 30,350 to accommodate the selected clarification. The paragraph ceiling is unchanged.

Validation: required format/lint/type/shell checks, Node and Bun tests, skill tests and package check; exact wording and preservation of the original rule checked separately. No host adoption or behavior campaign.

  • The checks in the README Development section pass.
  • The change has an Unreleased changelog entry.
  • The diff contains no private project, repository, local path, home directory or credential.

CodeRabbit completed its review of af76259 with no actionable findings. Cubic skipped at its monthly line limit (40,438/40,000, resets November 11); Greptile reported its 50-credit trial limit. Both capacity skips follow the existing policy.

@greptile-apps greptile-apps Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

bompus has reached the 50-credit limit for trial accounts. To continue receiving code reviews, upgrade your plan.

@coderabbitai

coderabbitai Bot commented Oct 23, 2026 •

Copy link
Copy Markdown

Review in Change Stack →

No actionable comments were generated in the recent review. 🎉

ℹ️ Recent review info
⚙️ Run configuration
📥 Commits

Reviewing files that changed from the base of the PR and between ba57586 and af76259.

📒 Files selected for processing: 4
  • CHANGELOG.md
  • evals/end-of-reply/screen/simplest-solution.md
  • rules/core.md
  • test/compose.test.mjs

Included review availability: This review used your included allowance. Your plan provides up to 1 included review per hour; 0 remain after this review.

📝 Walkthrough

The solution-selection rule and its evaluation pattern now specify criteria for proposals to add defensive machinery. The changelog records the criteria, and the fresh-install composed-rules size ceiling increases.

Changes: Defensive Machinery Proposal Rules

Layer / File(s) Summary
Proposal criteria and validation
rules/core.md, evals/end-of-reply/screen/simplest-solution.md, CHANGELOG.md, test/compose.test.mjs
The rule and evaluation pattern address concrete failure evidence, maintenance costs, speculative additions, and authorized scope. The changelog records the criteria. The fresh-install composed-rules size ceiling increases from 30,200 to 30,350 bytes.

Priority: ⬇️ Low

Merge Risk: ⚪ Minimal · up to af762

The guidance and its screening rule have no established merge-blocking issue; the change is ready for normal checks and merge.

Pre-merge checks: Passed 6
Check name Status Explanation
Title check Passed The title "Clarify evidence needed for extra defensive machinery" matches the main change: rules/core.md, the screening fixture, and the changelog now require a concrete failure, evidence it can occur…
Linked Issues check Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check Passed Check skipped because no linked issues were found for this pull request.
Suppressions Explained Passed PASS: The pull request changes only Markdown guidance, an evaluation pattern, and a test size constant. No changed line adds or broadens a lint, type-check, formatter suppression, or ignore configurat…
Rule Changes Documented Passed rules/core.md changed in the PR, and CHANGELOG.md adds a matching entry under ## Unreleased describing concrete failure evidence, maintenance costs, and authorized scope. No modifier or skill wa…
Description check Passed The pull request description is complete and follows the repository template. It explains the change and rationale, identifies the existing alternative, states the evidence limits, records validation,…
Full details: Title check

Explanation

The title "Clarify evidence needed for extra defensive machinery" matches the main change: rules/core.md, the screening fixture, and the changelog now require a concrete failure, evidence it can occur, and maintenance cost before extra defensive machinery is proposed. It is specific and concise, and it does not mention the secondary changes (the decision-request scoping and the 30,200 to 30,350 byte size ceiling increase in test/compose.test.mjs).

Full details: Suppressions Explained

Explanation

PASS: The pull request changes only Markdown guidance, an evaluation pattern, and a test size constant. No changed line adds or broadens a lint, type-check, formatter suppression, or ignore configuration entry.

Full details: Rule Changes Documented

Explanation

rules/core.md changed in the PR, and CHANGELOG.md adds a matching entry under ## Unreleased describing concrete failure evidence, maintenance costs, and authorized scope. No modifier or skill was added, removed, or renamed, so no README table update is required.

Full details: Description check

Explanation

The pull request description is complete and follows the repository template. It explains the change and rationale, identifies the existing alternative, states the evidence limits, records validation, confirms the changelog entry, and confirms the absence of private paths or credentials.

✨ Finishing Touches
📝 Generate docstrings
  • Commit to this branch
  • Create a new PR
🧪 Generate unit tests (beta)
  • Commit to this branch
  • Create a new PR
  • Autofix · Keep fixing CodeRabbit findings and required CI, and resolving merge conflicts

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

@bompus

bompus commented Oct 23, 2026

Copy link
Copy Markdown
Owner Author

@coderabbitai full review

@coderabbitai

coderabbitai Bot commented Oct 23, 2026 •

Copy link
Copy Markdown
✅ Action performed

Full review finished.

@bompus
bompus merged commit af76259 into main Oct 23, 2026
4 checks passed
@bompus
bompus deleted the docs/defensive-evidence branch October 23, 2026 04:57
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant