Skip to content

Unlisted pages appear in llms.txt #2417

Description

@honzajavorek

Activity

  1. added
    t-webIssues with this label are in the ownership of the web team.
    on Apr 10, 2026
  2. TC-MO commented on Apr 14, 2026

    @TC-MO
    Contributor

    the page (and other related) in question has been removed as it was overdue for it, but the issue still stands, we might make use of unlisted in the future,and they should not under any circumstances show up in llms.txt

  3. TC-MO commented on Apr 15, 2026

    @TC-MO
    Contributor

    @webrdaniel This is the issue I mentioned last time we spoke

  4. B4nan commented on Apr 15, 2026

    @B4nan
    Member

    I'd be surprised if this is not an upstream bug.

  5. birosrichard commented on Apr 21, 2026

    @birosrichard
    Contributor

    This is actually an upstream bug caused by the plugin we use. A few months ago I reported an issue. They told me that the fix will come in the new version. But the version is nowhere to be released yet. I created a PR that fixes this issue in their codebase.

  6. birosrichard commented on Apr 28, 2026

    @birosrichard
    Contributor

    Adding a direct link to my PR. But I don't think it will make its way to production anytime soon. As they still haven't released the new (breaking) version.

  7. B4nan commented on Apr 28, 2026

    @B4nan
    Member

    We are already patching that plugin here, I'd just include your changes directly. The sad part here is that if we want this in other docs repos (CLI, SDKs, clients), we'd need the same patch everywhere (but I feel like it's enough to fix this here, other projects have very few docs pages anyway).

    https://github.com/apify/apify-docs/tree/master/patches

  8. linked a pull request that will close this issuefix: patch the llms txt plugin #2477on Apr 29, 2026
  9. honzajavorek commented on May 13, 2026

    @honzajavorek
    CollaboratorAuthor

    Awesome, thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

medium priorityMedium priority issues to be done in a couple of sprints.t-webIssues with this label are in the ownership of the web team.

Type

No type

Projects

No projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions