Repository navigation
Description
Task
T-120b· Milestone M10 — Evaluation · Size S · Priority P1 · Epic #10Implements FR-EXP-003 · FR-RSK-005
Branch
spike/t-120b-run-exp-05-profile-a— one task = one branch = one PR (doc 32 §6)
Summary
Create tuned Nav2 SUT profile B informed by EXP-04 modes, run PROBE on A and B (3 seeds × 80) and compare robustness scores/volumes (journey J2); write docs/evidence/EXP-05.md.
Context / motivation
Hypothesis H6 and PRD journey J2.
Scope
In scope
configs/sut_profiles/tb4_nav2_tuned.yamlwith rationale per change.
Implementation guidance
- Derive profile B only from EXP-04 evidence (e.g. lower
vx_maxin low light, inflation radius, depth-layer settings); justify each change in YAML comments with the mode/rule that motivated it. - Run
exp05_profiles.yaml; compare robustness scores and region volumes (Wilson CIs) for A vs B, and report any new modes B introduces (trade-offs). - Standards: respect the layering contracts (doc 16 §2) and conventions in doc 34; no hard-coded tunables — thresholds/defaults come from typed settings (doc 27); no magic numbers (ruff
PLR2004); public APIs typed (mypy strict) and documented.
Acceptance criteria
- Evidence doc with robustness scores + Wilson CIs for A and B.
- Score difference with CIs and a clear statement of whether H6 is supported.
- Tests listed below added and green in CI; coverage of new code meets the gate in doc 18 §3.
- Docs, config reference and CHANGELOG
Unreleasedupdated where behaviour, keys or interfaces changed. - Definition of Done (doc 32 §3) satisfied.
Tests required
- N/A.
Dependencies
Blocked by: #210 (T-120a)
Blocks: no other task (leaf)
Parallelization notes
Files / paths owned by this task — avoid editing other paths; shared files (pyproject.toml entry points, cli/main.py, api/routers/__init__.py, router.tsx, docker/compose.yaml, ci.yml) are append-only:
docs/evidence/EXP-05.mdconfigs/sut_profiles/tb4_nav2_tuned.yaml
Sequential after T-120a.
Definition of Done
Per doc 32 §3 and AGENTS.md §5: lint, format, mypy strict and import-linter green; tests added and passing; docs updated; PR template completed with Closes #<this issue>; Conventional Commit messages referencing T-120b (doc 16 §6); commits authored only by the repository owner identity (AGENTS.md §4); CI green; reviewer checklist (doc 32 §5.1) satisfied.
References
Design docs: doc 19 §4 · doc 26 §J2 · doc 09 §5.4
Requirements: FR-EXP-003 · FR-RSK-005 (traceability: doc 28)
Metadata
Metadata
Assignees
Labels
Projects
- StatusShow more project fieldsBacklog
Activity