Prompt attachment capability introspection #1959
brandonbloom
started this conversation in
Protocol Suggestions
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
ACP v1 advertises broad prompt-content support such as image, audio, and embedded context, but a client cannot determine whether a concrete attachment is usable before attempting delivery.
For a prompt-content realization, clients need an optional capability declaration for:
Without this, an interoperable client must impose conservative local limits and treat provider-side rejections as late execution failures. It also cannot distinguish syntactically supported content from a known unsupported media type.
This proposal does not require every agent to advertise every limit. Absent information must remain unknown rather than being treated as an allowance. The shape could be a structured extension of promptCapabilities or a separately negotiated capability; the essential property is that declarations are per realization and do not make hidden uploads, conversions, or fallback behavior implicit.
Related work: #1559 proposes image-capability metadata for backend-advertised image limits. This discussion asks for a general prompt-attachment capability model that can include that image work while covering embedded resources, resource links, and the eager-versus-lazy failure boundary.
Concrete client use case: a reproducible evaluation harness needs to reject an image, PDF, or generic resource before inference when the selected agent cannot faithfully realize it, while recording a later service limit failure distinctly when the agent could not declare that ceiling.
All reactions