From bafe0cb25789765e75511406db092b83f5e58d76 Mon Sep 17 00:00:00 2001 From: Josh Mabry Date: Fri, 6 Nov 2026 00:03:32 -0800 Subject: [PATCH 1/2] feat(evals): a tool-selection benchmark for the inventory tools (0.16.3) evals/tool_selection/ mirrors careercoach-plugin's: 53 fixed reseller prompts across every operator capability plus no-tool questions and traps, the real plugin registered on a throwaway DB for its schemas, four host decoys, the turn-only tools registered but never correct for an operator prompt. --dry-run checks the plumbing; a live run uses EVAL_BASE_URL / EVAL_API_KEY / EVAL_MODEL and writes results/