Skip to content

Lock 25-tick as default short horizon - #74

Merged
jkbennitt merged 1 commit into
masterfrom
cursor/lock-25-tick-horizon-9c12
Sep 8, 2026
Merged

Lock 25-tick as default short horizon#74
jkbennitt merged 1 commit into
masterfrom
cursor/lock-25-tick-horizon-9c12

Conversation

@jkbennitt

Copy link
Copy Markdown
Member

Docs-only follow-up to #73. Records the 2026-09-08 horizon sweep and locks 25 ticks as the default short horizon for composite / harness compare. No code, deps, CLI defaults, or matrix runs. Do not merge until reviewed.

What

Updates docs/bench-design-n-ticks.md and the existing one-line README pointer.

Horizon lock (2026-09-08)

Sweep: one cheap cell, N=3 × {10, 25, 50, 100} ticks.

Horizon Mean composite
t25 0.816
t50 0.806
t100 0.744
t10 (σ baseline, same three seeds) ~0.796
  • Lock 25-tick as the default short horizon for composite / harness compare.
  • 100 ticks degrades composite on average — not preferred.
  • Research stays floored at 0.226 at t10 / t25 / t50 / t100. Horizon alone does not unlock research; that is separate tooling / scenario work.
  • Force-pause re-prompt storm at 50 / 100: Dialog_NamePlayerFactionAndSettlement dismiss counts rose sharply (t25: 0; t50: 27–40; t100: 41–80 per run). Auto-dismiss works, but longer horizons thrash.

Locked sequence is unchanged: gate N=1s → variance pilot → horizon → size matrix. Horizon step now records that 25 is the chosen short horizon after this sweep.

Out of scope

No CLI/default changes. No matrix. No XAI.

Open in Web Open in Cursor 

Record the 2026-09-08 horizon sweep: t25 is the chosen short horizon
for composite/harness compare; 100 ticks degrades on average; research
stays floored; 50/100 force-pause re-prompt storms.

Co-authored-by: Jason <jkbennitt@users.noreply.github.com>
@jkbennitt
jkbennitt marked this pull request as ready for review September 8, 2026 13:50

@jkbennitt jkbennitt left a comment

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM — docs-only. Locks 25-tick as default short horizon from the 2026-09-08 sweep (t25 mean composite 0.816 best; t100 degrades; research still floored; pause storm at 50/100 noted). No code/CLI/matrix. All five CI SUCCESS on 22e2978 (run 34234488123). HOLD merge for CoS clear. (Own-PR approve blocked; will merge via org/integration bypass when CoS clears.)

@jkbennitt
jkbennitt merged commit 07d6f43 into master Sep 8, 2026
5 checks passed
@jkbennitt
jkbennitt deleted the cursor/lock-25-tick-horizon-9c12 branch September 8, 2026 14:42
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants