CI: weekly external link-rot check (lychee) - #58
Merged
Merged
Conversation
Scheduled, not per-PR: external checks are network-flaky and a
third-party outage must never block merges. Internal links keep their
per-PR guard (check_link_graph.py); this covers the external citations
(DOJ, IC3, vendor docs, papers) that rot silently.
- scans content/**/*.md + README, https/http schemes only
- --base-url resolves root-relative links against the live site
- .lycheeignore: Pelican {filename}/{static} syntax, code-example
placeholders (localhost, host:port), bot-hostile hosts (LinkedIn/X)
- failures open/update a 'link-rot' tracking issue and fail the run
- validated locally with lychee 0.24.2: 103 OK, 0 errors, 32 excluded
rivassec
added a commit
that referenced
this pull request
Sep 12, 2026
Vendored external READMEs are not site content (ARTICLE_EXCLUDES skips them at build) and their repo-relative links (/LICENSE) resolve as false 404s against --base-url. First-week allowlist tuning, as predicted in #58. Co-authored-by: rivassec <rivassec@rivassec.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
New scheduled workflow checking every external citation in
content/for rot. Complements the per-PR internal link-graph guard, which never touches external URLs.Design
content/**/*.md+ README, https/http only;--base-url https://rivassec.comresolves root-relative links against the live site (so the 404 page's links and the tool link get checked for real)..lycheeignore: Pelican{filename}/{static}syntax (covered by the internal guard), code-example placeholders (localhost,host:port), and bot-hostile hosts (LinkedIn 999s, X gates).link-rottracking issue with the full report, then fail the run - scheduled reds otherwise go unread.Validated locally (lychee 0.24.2)
All 32 exclusions are Pelican syntax and placeholders - zero real citations excluded. DOJ links pass (they 200 even behind the Akamai interstitial).
First real run: trigger via workflow_dispatch after merge, or wait for Monday. Expect the allowlist to need a tweak or two over the first weeks - that's normal for link checkers.