Skip to content

chore(TODO): record declared LLM test coverage as the follow-up to #240 - #241

Merged
luca-belli merged 1 commit into
mainfrom
chore/todo-declared-llm-test-coverage
Oct 1, 2026
Merged

luca-belli merged 1 commit into
mainfrom
chore/todo-declared-llm-test-coverage

Conversation

@luca-belli

Copy link
Copy Markdown
Collaborator

Adds one TODO item, the follow-up discussed on #240.

What it records: replace test_coverage.py's class-name → test-file mapping with a declared one. Each TestLLMBase subclass sets llm_class = ..., and the coverage checks compare those declarations against the discovered clients. That deletes:

It also turns the "informational for now" inheritance check into a hard requirement.

Why it's a TODO and not a PR: upstream it's about 1–2 hours. But forks whose client tests don't subclass TestLLMBase will fail CI after syncing until they migrate, so forks should get notice before it lands.

🤖 Generated with Claude Code

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@luca-belli
luca-belli merged commit 2297847 into main Oct 1, 2026
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant