Repository navigation
Ekbasis-Skopos-27B: the hosted switch on the release day, and the pre-launch results appended after the release - #63
Merged
Merged
Conversation
…nd decision - CHANGELOG: a "Hosted API" entry: the hosted API serves ekbasis-skopos-27b-int4-v1.3 since 2026-10-16 ⟨HH:MM⟩ UTC, on release day, with less notice than the 14 days the model-change policy promises (owner decision, results_skopos/prelaunch/RELEASE_DECISION.md); Ekbasis-27B's weights stay public; calibrated.temperature 1.67 instead of 1.55. The release entry's hosted sentence now points to it instead of the 2026-10-30 date. ⟨HH:MM⟩ stays until the switch's time is set (SWITCH_TIME). - results_skopos/prelaunch/RELEASE_DECISION.md: the record as updated with the second decision. - write_release_eval_skopos.py: a full --final build lists what was appended after the release and what was not run (PENDING.json's "not_run", with its reason). Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
…nd F not run RELEASE_EVAL_SKOPOS.md is now built with --final (no release mode): every pre-launch file PENDING.json lists is here. Appended after the release (phase B, on the evaluation machine before it was retired): P5's speed pairing (P5.json), P6's item pairing (P6.json), the identity re-runs of Ekbasis-27B for P1 and P8 (their rule outcomes stay in P1.json and P8.json), and the P12 preflight substitute on bf16 (not under the rule, never compared with published numbers). Not run, the evaluation machine having been retired on 2026-10-16: P12's same-machine intent control, the preflight substitute's INT4 pairing, P11 and P9's Ekbasis-27B re-run. No new blocker: P8's paraphrased wording remains the only one, declared. Phase B's outputs are added to results_skopos/prelaunch/out/ and the as-run compare scripts updated. Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Follow-up to #62 (Ekbasis-Skopos-27B).
The hosted API changed on the release day. It serves
ekbasis-skopos-27b-int4-v1.3since 2026-10-16 14:29 UTC, withless notice than the 14 days the model-change policy promises: the owner's decision, recorded in
results_skopos/prelaunch/RELEASE_DECISION.md("Second decision"). Ekbasis-27B's weights stay public. The CHANGELOG hasits own entry for the switch, and the release entry points to it.
Pre-launch results appended after the release, as
RELEASE_EVAL_SKOPOS.mdlisted them at release(
results_skopos/prelaunch/compare/PENDING.json):P5.json)P6.json)P1_identity.json)P8_identity_phaseB.json)P12_preflight_substitute_bf16.json)None of these files holds a release blocker; none of them could block under the rule.
Not run, each with its reason:
RELEASE_EVAL_SKOPOS.mdis rebuilt fromresults_skopos/with every pre-launch item final or reported as not run; thebattery's outputs of phase B are added to
results_skopos/prelaunch/out/.Not in this pull request: A7 of
prereg_skopos/PREREG_ADDENDUM.md(confident errors with every option's probability, onthe two INT4 builds), which runs after the switch; its results come in a later pull request.
🤖 Generated with Claude Code