agent-benchmarking

Here are 10 public repositories matching this topic...

ktwu01 / benchmark-radar

Track 33,707+ AI benchmark, eval, dataset, and data-quality records from 40 public sources, with linked evidence and daily updates.

Updated Oct 31, 2026
Python

FreedomIntelligence / MyPhoneBench

Star

MyPhoneBench: Do Phone-Use Agents Respect Your Privacy?

personal-ai-agents agent-benchmarking phone-use-agents mobile-gui-agents privacy-aware-agents behavioral-privacy verifiable-evaluation

Updated Apr 3, 2026
Python

ather-techie / ai-agents-design-patterns

Star

20 runnable LLM agent design patterns in Python, benchmarked, traced, offline-compatible. ReAct, multi-agent, constitutional AI, and more.

python design-patterns multi-agent-systems anthropic claude-ai llm-agents react-agent agentic-ai agent-orchestration agent-benchmarking

Updated Sep 7, 2026
Python

sholajegede / mastra-vs-langchain

Star

The same AI agent pipeline built in Mastra and LangChain. Runs in parallel, measures everything.

real-time typescript nextjs ai-agents convex langchain anthropic llm-evaluation langgraph tavily mastra agent-benchmarking

Updated Jun 6, 2026
TypeScript

splyntra / splyntra

Star

splyntra

enterprise-solutions token-analysis agent-monitoring agent-benchmarking agent-security-tools

Updated Aug 24, 2026
TypeScript

amurlaniakea / agent-proving-ground

Star

Deterministic adversarial evaluation framework for LLM agents. Generates behavioral jailbreak scenarios and measures robustness against execution hallucination.

python cybersecurity ai-safety jailbreak-detection red-teaming adversarial-ml llm-evaluation agent-benchmarking

Updated Oct 20, 2026
Python

FlashMS / SnorkelAI-Terminus3

Star

Deterministic multi-lane evaluation domain for SnorkelAI Terminus3. Cockpit, lane orchestration, agent benchmarking, reasoning-drift detection.

python docker evaluation terminus snorkel cockpit deterministic multi-lane deterministic-evaluation agent-benchmarking snorkelai terminus3 reasoning-drift multi-lane-evaluation ml-eval

Updated Sep 28, 2026
Python

FlashMS / SnorkelAI-Terminus2

Star

SnorkelAI Terminus2 task suite with deterministic evaluators, Dockerized environments, and reproducible agent-benchmarking primitives.

python docker benchmarking evaluation terminus snorkel deterministic deterministic-evaluation agent-benchmarking snorkelai terminus2 task-engineering dockerized-evaluators ml-eval

Updated Jun 17, 2026
Python

sneakocom / agent-trajectory-profiler

Star

Correctness-gated measurement of mutation, edit payload, and semantic revisit across agent trajectories.

developer-tools ai-agents ai-research agentic-ai agent-benchmarking

Updated Sep 20, 2026
JavaScript

lirantal / coding-agent-security-benchmark

Star

A Claude Agent SDK security benchmark project

ai-agents agentic-workflow agentic-ai claude-code agent-benchmark agent-research claude-opus-4-6 agent-benchmarking

Updated Jun 14, 2026
TypeScript

Add this topic to your repo

To associate your repository with the agent-benchmarking topic, visit your repo's landing page and select "manage topics."

Learn more