琥珀式封存历史回放评测(AMBER):封进琥珀,重做当时的题 —— 真实事件回放、物理封存、预注册评分的方法规范
-
Updated
Aug 22, 2026
琥珀式封存历史回放评测(AMBER):封进琥珀,重做当时的题 —— 真实事件回放、物理封存、预注册评分的方法规范
An evaluation methodology for context-augmentation experiments: a format-matched control that separates whether added context helps because of its information or its format. Pre-registered instrument, mutation-audited scorer, worked example in SVG reference resolution.
Diagnostic of physics literacy in frontier LLMs. Evaluates induction, formulation, and prediction inside unfamiliar physics frameworks via dual-judge inter-rater reliability with human-audit resolution.
Do models catch flawed ML results? Flawed reports with byte-identical matched controls.
The instrument makes the winner: reconciling two contradictory 2026 clinical-AI evaluations (Real-POCQi vs Nature Medicine). A 2x2 instrument x rater decomposition shows the evaluation instrument (pairwise vs rubric), not the model, drives the disagreement.
MCDM using TOPSIS: A technique for multi-criteria decision making, utilizing the TOPSIS method to evaluate alternatives based on multiple criteria.
Code, data, and paper for an evaluation-protocol-adjusted residual audit of public LLM benchmark scores — predicting score variation from public metadata and using the residuals as a review queue.
An audit of how wearable stress-detection performance is measured. Three public datasets, subject-independent evaluation, and what a personal baseline actually buys.
Measurement protocol for demographic bias in vision systems: frozen pools, paired designs, mandatory intervals, pre-registered criteria.
Runtime-verifiable audit harness that falsifies coding-agent intervention claims — preregistered, oracle-checked, reports null.
JAMO — OCR-mediated Hangul rendering benchmark. Code companion to huggingface.co/datasets/Nasser4963/jamo-gold
An evidence-driven evaluation engine for AI systems in regulated financial workflows
To associate your repository with the evaluation-methodology topic, visit your repo's landing page and select "manage topics."