Skip to content

Add pure judge producer profile and verification API - #86

Merged
Tom Gamble (gambtho) merged 6 commits into
mainfrom
feat/public-judge-producer
Oct 28, 2026
Merged

Tom Gamble (gambtho) merged 6 commits into
mainfrom
feat/public-judge-producer

Conversation

@gambtho

@gambtho Tom Gamble (gambtho) commented Oct 28, 2026 •

Copy link
Copy Markdown
Member

Adds an opt-in pure judge API for exact requests, original-response decoding, two-score verification and producer/configuration identities.

Runtime content admission, credentials, execution and retention remain outside Suite. Existing schemas, evidence readers and historical identities are unchanged; no consumer wiring or release is included.

Includes byte fixtures and an unreleased producer-profile guide.
Verified: full Go/umask and focused race tests, vet, pinned staticcheck, module checks, gopls, docs/link checks and 11 browser regressions; no model calls.

Part of kaimahi-agents/kaimahi#678.

@gambtho
Tom Gamble (gambtho) requested a review from a team as a code owner October 28, 2026 17:51
Copilot AI balanced review requested due to automatic review settings October 28, 2026 17:51

Copilot AI left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🟢 Approval recommended

No active review issues block approval of the opt-in judge package.

No open issues 🎉

What changed in this PR

Adds an opt-in, pure judge package for AgentSuite without changing existing schemas, evidence readers, or historical identities. Execution, credentials, content admission, and retention remain runtime responsibilities; no release or consumer integration is included.

Changes:

  • Adds exact request generation, strict original-response decoding, two-score verification, and producer/configuration identities.
  • Adds pinned byte fixtures and tests covering validation, quorum behavior, and compatibility with existing evidence verification.
  • Documents the unreleased API and its trust boundaries, and includes the guide in the documentation site.
File Description
testdata/​judge-producer-v1/​response-pass.json Pins a passing response envelope.
testdata/​judge-producer-v1/​response-fail.json Pins a below-threshold response envelope.
testdata/​judge-producer-v1/​request.json Pins exact request bytes.
testdata/​judge-producer-v1/​profile.json Records the producer identity.
testdata/​judge-producer-v1/​profile-contract.json Pins the hashed producer contract.
testdata/​judge-producer-v1/​definition.json Supplies fixture judge operands.
testdata/​judge-producer-v1/​configuration.json Pins public and private configuration digests.
judge/​judge.go Implements request, decoding, verification, and identity APIs.
judge/​judge_test.go Tests byte contracts, bounds, malformed responses, and quorum behavior.
judge/​doc.go Documents package scope and runtime responsibilities.
internal/​artifact/​judge_producer_test.go Tests compatibility with existing evidence verification.
docs/​judging.md Defines the producer profile and trust boundaries.
docs/​index.md Links to the unreleased producer guide.
docs/​go.md Introduces the optional Go API.
docs/​.vitepress/​site.test.mjs Includes the guide in documentation rendering checks.
docs/​.vitepress/​config.mts Registers the guide in the site page list.

Review effort: Balanced

@gambtho
Tom Gamble (gambtho) merged commit b72df77 into main Oct 28, 2026
17 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants