Repository navigation
0.9.0: gate status: verified on review and verify, guard on its own record, throwaway files - #16
Merged
Merged
Conversation
Standard and Controlled work can record status: verified in a change's state.md only after the session invoked ai-native-verify, with an ai-native-review call after the last code change before it. On 0.7.3 the agent fixed the planted defect in 9 of 9 runs of the two new behavior cases and then recorded status: verified without invoking verify; on this hook both cases pass 3 of 3. - Hook: new denial with a reason that names the next skill; a hook error after routing denies, any other hook failure blocks nothing. - Behavior cases: gamed and weakened, with fixtures, checker rules, tests. - Docs: ADR-003 amendment, changelog with run numbers and known limits, README troubleshooting, behavior-check table. Unreleased: the changelog entry is not dated. Co-Authored-By: Claude Fable 5.2 <noreply@anthropic.com>
…9.0) The check before status: verified no longer reads the transcript for skill calls and code changes. The hook now runs after each Skill call and for a typed skill command, and records the skill with a content hash of every project file outside .sdlc/ that Git does not ignore. The last verify must have started from the files the last review saw; a denial names the files that changed. Code changed by a sub-agent is now seen. - Throwaway files: every way of writing into the system temp folder passes before plan approval, cp is checked on its destination only, and a file that Git ignores is not project code. - Hook events carry a 60-second limit; a test checks the registration. - scripts/test_skills.py fails when a SKILL.md passes 15,000 bytes. - Docs: ADR-003 amendment (including why no Codex guard is built), changelog with run numbers and known limits, README, architecture. Unreleased: the changelog entry is not dated. The fixes from the last review round are covered by unit tests only. Co-Authored-By: Claude Fable 5.2 <noreply@anthropic.com>
All 17 cases passed 3 of 3 with-plugin runs on commit 4eb4a6a (51 of 51 runs; 14 of 51 without the plugin). Cost $16.03. Co-Authored-By: Claude Fable 5.2 <noreply@anthropic.com>
0.8.0 is dated the same day and marked as not published on its own. Co-Authored-By: Claude Fable 5.2 <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What
Hook release:
0.7.3 -> 0.9.0. Changelog entry## 0.9.0 - 2026-11-14, both manifests bumped. 0.8.0 is in the changelog as a record but is not tagged on its own; 0.9.0 ships it. No skill wording changed.Why
Two new behavior cases,
gamedandweakened, start atstatus: reviewingwith a defect that passes the fixture's check. On 0.7.3 the agent found and fixed the defect in 9 of 9 runs, and in every one it then wrotestatus: verifieditself: it never invokedai-native-verify, and nothing reviewed its fix.A read of two weeks of session logs (141 guard denials) also showed that 12 of 17 denied probe and benchmark scripts were writes into the system temp folder, which the guard was meant to allow. Agents put probes under
.sdlc/changes/<slug>/probes/or stated the Fast lane to get through.Change
status: verifiedin a change'sstate.mdonly after the session invokedai-native-verifyon the files its lastai-native-reviewsaw. The denial names the next skill and up to five changed files.Skillcall and for a typed skill command (PostToolUseonSkill,UserPromptExpansion), and stores each skill of this plugin that the main agent invoked with a content hash per project file outside.sdlc/that Git does not ignore. The transcript is no longer read for skill calls or code changes: it is written late and leaves sub-agent tool calls out. Code changed by a build worker is now seen.cpandCopy-Itemare checked on their destination only, and a file that Git ignores is not project code. The approvals denial says where a throwaway file goes.scripts/test_skills.pyfails when aSKILL.mdpasses 15,000 bytes; CI runs it.gamedandweakened, with fixtures, checker rules, and tests.claude plugin evalnow runs 17 of the 19 cases.Verification
python scripts/check_version.py --self-test,python scripts/check_version.py,scripts/test_behavior_check.py(7 tests),scripts/test_edit_guard.py(13 tests: Git project, project in a subfolder of a repository, folder without Git),scripts/test_skills.py: all pass on Windows.docs/behavior-checks.md: Claude Code 2.1.319 in WSL2,claude-sonnet-5-5as agent and judge, 3 runs per arm, no permissions bypassed. 17 of 17 cases passed all 3 with-plugin runs (51 of 51 runs); 0.7.2 recorded 13 of 15. Without the plugin, 14 of 51 runs scored 1.0. In the with-plugin runs the hook denied 12status: verifiedwrites ingamedandweakenedand one write with no lane stated; each agent cleared it, and no trace holds a hook error. Cost $16.03.Not verified
featureandpayment-buildon the manual harness.Known limits
Listed in the changelog entry for 0.9.0. The main ones: the lane stated in chat still comes from the transcript; a code change after verify started is not checked; changes inside a submodule or to a file Git ignores are not seen.
🤖 Generated with Claude Code