Conversation
The regex rule and the keyword heuristic both fire on prose that merely discusses jailbreaks or exfiltration. Marking the session tainted on them turned every later GET (our own blog, for example) into a CRITICAL secret_exfiltration block. Taint now marks only when an LLM judge answered (semantic finding carries `judged`) or on a CRITICAL structural hit (injection hidden in HTML). Regex/heuristic findings still report as before; they just no longer poison the rest of the session. Co-Authored-By: Claude <noreply@anthropic.com>
Contributor
|
Hi @Ar9av love this approach, Minor nit: In policy_engine.py, judged is already calculated on line 2291, so the identical check on line 2306 can be removed. |
This branch has not been deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Fixes the taint-escalation false positive in #404.
Problem
An agent reads a page that merely mentions prompt injection (`jailbreak`, `exfiltration`, a quoted "ignore previous instructions"). The regex rule and the keyword heuristic both fire, the session is marked tainted, and every later network call, including a GET to our own blog, is reported as a CRITICAL `secret_exfiltration` block.
Change
Taint now marks only on a confirmed injection:
Regex and heuristic-only findings still report exactly as before. They just no longer poison the rest of the session.
Hosts with no judge configured: taint comes only from structural hits. `prismor setup` already asks for a judge; `prismor login` gives the hosted one.
Tests
Co-Authored-By: Claude noreply@anthropic.com