Skip to content

Expand deterministic danger coverage - #39

Merged
LE0-Lin merged 1 commit into
mainfrom
feat/danger-surface-rules
Sep 5, 2026
Merged

Expand deterministic danger coverage#39
LE0-Lin merged 1 commit into
mainfrom
feat/danger-surface-rules

Conversation

@LE0-Lin

@LE0-Lin LE0-Lin commented Sep 5, 2026

Copy link
Copy Markdown
Owner

Summary

  • detect four narrowly defined high-risk command patterns: PowerShell download-and-execute, forced Git directory cleanup, aggressive Docker system prune, and Kubernetes namespace deletion
  • add nearby safe forms and explicit prohibitions as negative controls
  • expand Adversarial Benchmark v1 from 74 to 122 deterministic contracts across six instruction formats
  • keep the four unresolved semantic challenges visible

Verification

  • PYTHONPATH=src python -m unittest discover -s tests -v (126 passed)
  • PYTHONPATH=src python -m agent_config_score.cli examples/demo`n- PYTHONPATH=src python -m agent_config_score.cli . (A 100)
  • PYTHONPATH=src python scripts/run_adversarial_benchmark.py (122/122 contracts, 50/50 clean controls, 4/8 challenges detected)
  • PYTHONPATH=src python scripts/run_real_world_benchmark.py (all three pinned repositories matched reviewed expectations)

@LE0-Lin
LE0-Lin merged commit 817527c into main Sep 5, 2026
21 checks passed
@LE0-Lin
LE0-Lin deleted the feat/danger-surface-rules branch September 5, 2026 11:28
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant