Skip to content

The bench runs 8 processes by default and rounds ties to even - #123

Merged
czj merged 3 commits into
mainfrom
claude/magical-noether-qcvl8n
Nov 21, 2026
Merged

czj merged 3 commits into
mainfrom
claude/magical-noether-qcvl8n

Conversation

@czj

@czj czj commented Nov 21, 2026

Copy link
Copy Markdown
Contributor

The bench balances its column order with a Williams design, which needs a multiple of the four columns to balance every round: the default of 7 repeated the first three orders. The median of an even count also always rounded ties up.

BENCH_PROCESSES now defaults to 8 and the median rounds half to even, ahead of the rebench before 2.1.0.

  • Balanced rounds: 8 processes give each order of the four columns twice.
  • Even ties: round(half: :even) for integer measures, round(1, half: :even) for times and memory.
  • Page text: docs/benchmarks.html no longer states a process count; the footnote already reads it from docs/benchmarks.json.
Check

2.5.round(half: :even) is 2, 3.5 is 4; RuboCop is clean. docs/benchmarks.json is left as is: it is measured on an idle Mac before the release.


Generated by Claude Code

gh 2.105 writes hint: lines on stderr, which run mixed into the JSON of
gh pr view, so the release crashed right after opening its pull request.
stderr is now shown only when a command fails.

Assisted-by: Claude [Claude Code]
Eight is a multiple of the four columns, so the Williams design balances
every order; seven repeated the first three. The median of an even count
now rounds half to even instead of always up.

Assisted-by: Claude [Claude Code]
@czj
czj enabled auto-merge (squash) November 21, 2026 11:40
@czj
czj merged commit d78bfed into main Nov 21, 2026
14 checks passed
@czj
czj deleted the claude/magical-noether-qcvl8n branch November 21, 2026 11:49
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants