Repository navigation
Add pure judge producer profile and verification API - #86
Merged
Merged
Conversation
There was a problem hiding this comment.
🟢 Approval recommended
No active review issues block approval of the opt-in judge package.
No open issues 🎉
What changed in this PR
Adds an opt-in, pure judge package for AgentSuite without changing existing schemas, evidence readers, or historical identities. Execution, credentials, content admission, and retention remain runtime responsibilities; no release or consumer integration is included.
Changes:
- Adds exact request generation, strict original-response decoding, two-score verification, and producer/configuration identities.
- Adds pinned byte fixtures and tests covering validation, quorum behavior, and compatibility with existing evidence verification.
- Documents the unreleased API and its trust boundaries, and includes the guide in the documentation site.
| File | Description |
|---|---|
testdata/judge-producer-v1/response-pass.json |
Pins a passing response envelope. |
testdata/judge-producer-v1/response-fail.json |
Pins a below-threshold response envelope. |
testdata/judge-producer-v1/request.json |
Pins exact request bytes. |
testdata/judge-producer-v1/profile.json |
Records the producer identity. |
testdata/judge-producer-v1/profile-contract.json |
Pins the hashed producer contract. |
testdata/judge-producer-v1/definition.json |
Supplies fixture judge operands. |
testdata/judge-producer-v1/configuration.json |
Pins public and private configuration digests. |
judge/judge.go |
Implements request, decoding, verification, and identity APIs. |
judge/judge_test.go |
Tests byte contracts, bounds, malformed responses, and quorum behavior. |
judge/doc.go |
Documents package scope and runtime responsibilities. |
internal/artifact/judge_producer_test.go |
Tests compatibility with existing evidence verification. |
docs/judging.md |
Defines the producer profile and trust boundaries. |
docs/index.md |
Links to the unreleased producer guide. |
docs/go.md |
Introduces the optional Go API. |
docs/.vitepress/site.test.mjs |
Includes the guide in documentation rendering checks. |
docs/.vitepress/config.mts |
Registers the guide in the site page list. |
Review effort: Balanced
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Adds an opt-in pure
judgeAPI for exact requests, original-response decoding, two-score verification and producer/configuration identities.Runtime content admission, credentials, execution and retention remain outside Suite. Existing schemas, evidence readers and historical identities are unchanged; no consumer wiring or release is included.
Includes byte fixtures and an unreleased producer-profile guide.
Verified: full Go/umask and focused race tests, vet, pinned staticcheck, module checks, gopls, docs/link checks and 11 browser regressions; no model calls.
Part of kaimahi-agents/kaimahi#678.