data-quality P0: answer 404s + broken source URLs + validate unblock#1538
Merged
Conversation
Answer pages returning 404 on prod: - helius-vs-triton-vs-quicknode-solana.yml deleted (referenced solana-tx-landing which does not exist as a bench spec) - alchemy-vs-quicknode-vs-infura-latency + which-solana-dex-aggregator- is-the-fastest added to REMOVED_ANSWER_SLUGS (both reference benches in REMOVED_BENCH_SLUGS: rpc-keyed-latency + solana-dex-quote-latency; pages now 410 Gone instead of 404 soft-fail) Broken bench source URLs (agent audit): - nft-collection-metadata source now points at /harnesses/nft-metadata-coverage (previous URL 404'd; real dir has the actual Go harness code) - pm-api-latency source now points at /harnesses/pm-rate-limits (that is the harness that emits the pmapi_request_duration_seconds bucket metrics the spec queries against; previous URL 404'd) Unblock pnpm validate on 3 pre-existing failures (not introduced here but blocking the CI on this branch): - evm-block-builders: disclaimer + vanilla.formula shortened past the 500/240 char caps - rwa-yield-accuracy: seo_intro em-dashes stripped - validator-yield: methodology[8] trimmed under the 500 char cap Skipped from the original P0 batch: agent 2's 'cache-key drift' item was a false positive. explorer-chain-coverage, portfolio-chain-coverage and rpc-keyed-latency are correctly in REMOVED_BENCH_SLUGS (staging pipeline held back) and correctly return 410 on prod. No cache bump needed.
Flotapponnier
added a commit
that referenced
this pull request
Jul 26, 2026
…ate (#1538) (#1539) Answer pages returning 404 on prod: - helius-vs-triton-vs-quicknode-solana.yml deleted (referenced solana-tx-landing which does not exist as a bench spec) - alchemy-vs-quicknode-vs-infura-latency + which-solana-dex-aggregator- is-the-fastest added to REMOVED_ANSWER_SLUGS (both reference benches in REMOVED_BENCH_SLUGS: rpc-keyed-latency + solana-dex-quote-latency; pages now 410 Gone instead of 404 soft-fail) Broken bench source URLs (agent audit): - nft-collection-metadata source now points at /harnesses/nft-metadata-coverage (previous URL 404'd; real dir has the actual Go harness code) - pm-api-latency source now points at /harnesses/pm-rate-limits (that is the harness that emits the pmapi_request_duration_seconds bucket metrics the spec queries against; previous URL 404'd) Unblock pnpm validate on 3 pre-existing failures (not introduced here but blocking the CI on this branch): - evm-block-builders: disclaimer + vanilla.formula shortened past the 500/240 char caps - rwa-yield-accuracy: seo_intro em-dashes stripped - validator-yield: methodology[8] trimmed under the 500 char cap Skipped from the original P0 batch: agent 2's 'cache-key drift' item was a false positive. explorer-chain-coverage, portfolio-chain-coverage and rpc-keyed-latency are correctly in REMOVED_BENCH_SLUGS (staging pipeline held back) and correctly return 410 on prod. No cache bump needed.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
See commit body. 3 answer pages stop 404ing (1 delete, 2 added to REMOVED_ANSWER_SLUGS = 410 Gone). 2 bench source URLs re-pointed to real harness dirs. Also cleaned 3 pre-existing validate failures blocking CI.