You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
adding a new lint:eval-grader-lineage step (Build-GraderLineageMap.ps1 -Check) in between. Two documentation pages still show the pre-change command composition and do not mention the new grader-lineage check or script:
docs/architecture/workflows.md (script/workflow table row for ci:eval:lint:vally)
docs/contributing/evals-ci.md (script/workflow table and the prose describing ci:eval:lint:vally runs vally lint --eval-spec evals/ ...)
Expected Behavior
Both pages should describe the current three-step composition of ci:eval:lint:vally, including the lint:eval-grader-lineage step and a brief mention of what scripts/evals/Build-GraderLineageMap.ps1 -Check validates (grader lineage mapping), so the documented command matches package.json.
Compare against docs/architecture/workflows.md line ~445 and docs/contributing/evals-ci.md line ~280, which still describe only the Build-AgentBehaviorSpec.ps1 -WhatIf && vally lint --eval-spec evals/ composition.
Component
Documentation
Bug Description
commit 56c30bc (#2934) changed the
ci:eval:lint:vallynpm script inpackage.jsonfrom:to:
adding a new
lint:eval-grader-lineagestep (Build-GraderLineageMap.ps1 -Check) in between. Two documentation pages still show the pre-change command composition and do not mention the new grader-lineage check or script:docs/architecture/workflows.md(script/workflow table row forci:eval:lint:vally)docs/contributing/evals-ci.md(script/workflow table and the prose describingci:eval:lint:vally runs vally lint --eval-spec evals/ ...)Expected Behavior
Both pages should describe the current three-step composition of
ci:eval:lint:vally, including thelint:eval-grader-lineagestep and a brief mention of whatscripts/evals/Build-GraderLineageMap.ps1 -Checkvalidates (grader lineage mapping), so the documented command matchespackage.json.Steps to Reproduce
package.jsonchange in commit 56c30bc / PR feat(accessibility): strengthen NVDA evidence and validation #2934.docs/architecture/workflows.mdline ~445 anddocs/contributing/evals-ci.mdline ~280, which still describe only theBuild-AgentBehaviorSpec.ps1 -WhatIf && vally lint --eval-spec evals/composition.Additional Context
Related files:
package.json(ci:eval:lint:vally,lint:eval-grader-lineagescripts)scripts/evals/Build-GraderLineageMap.ps1docs/architecture/workflows.mddocs/contributing/evals-ci.md