MQ-EVA — Independent AI Evaluation Assurance: a framework for determining whether AI performance claims can be trusted
-
Updated
Aug 13, 2026 - Python
#
benchmark-validity
Here are 3 public repositories matching this topic...
Do AI-code security benchmarks measure the code, or the checker? An execution-grounded audit of five security oracles against 96 variants whose labels are earned by running an exploit.
static-analysis cwe empirical-software-engineering construct-validity llm-code-generation benchmark-validity security-oracle
-
Updated
Aug 14, 2026 - Python
Lightweight proof-of-concept for oversight-centered metrology in coding agents: workflow-aware evaluation, interrupt channels, and claim-margin reporting beyond raw success scores.
ai proof-of-concept human-in-the-loop metrology continuous-monitoring safe-control ai-agent ai-evaluation llm-evaluation coding-agents agentic-ai socio-technical-systems ai-oversight workflow-evaluation claim-margin interrupt-channels deployment-evaluation audit-gaming benchmark-validity
-
Updated
Mar 12, 2026 - Python
Improve this page
Add a description, image, and links to the benchmark-validity topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the benchmark-validity topic, visit your repo's landing page and select "manage topics."