Skip to content

rubric: stricter tone-deafness anchors, and the seed rescored against them - #25

Merged
Lindeneg merged 4 commits into
masterfrom
LTET-16-tone-anchors
Nov 6, 2026
Merged

Lindeneg merged 4 commits into
masterfrom
LTET-16-tone-anchors

Conversation

@Lindeneg

@Lindeneg Lindeneg commented Nov 6, 2026 •

Copy link
Copy Markdown
Owner

Closes LTET-16

Tone-deafness scored 3 or more on 95 of the 122 seed statements, so it barely told them apart. This tightens the 3 and 5 anchors and re-judges every statement's tone against them. No other category changes, and no other field changes.

The anchors (for approval)

Level Before After
3 Said to the people it costs, in the wrong room or at the wrong moment, as if it were good news. A real cost to real people, waved off or cheered while they are listening or while it still hurts.
5 Hardship sold as an opportunity, at the worst possible moment, by the man who can afford it. Their hardship sold to them as good news, while it is happening, by the man who profits from it.

Levels 0 and 1 are unchanged. A 3 now needs a real cost that someone is paying, plus the line waving it off or cheering it in front of them or while it is fresh. A boast, a forecast or optimism with nobody paying drops to 1 or 2. A 5 is kept for the three statements that sell a loss as good news while it is happening: the "enigma of success" memo after 9,000 cuts, "everything is scarce is fantastic for us" during the memory shortage, and "two cost centres" at the layoff town hall.

Distribution

Score 0 1 2 3 4 5 3 or more
Before 2 0 25 47 33 15 95
After 3 49 31 17 19 3 39

Effect on the tables

  • All time: Pichai (76) passes Amodei (74) for 5th. The rest keep their places: Altman 239, Musk 192, Zuckerberg 113, Huang 102, Pichai 76, Amodei 74, Suleyman 66, Nadella 65, Hassabis 16.
  • 23/24: Pichai passes Huang for 5th.
  • 24/25: Altman passes Amodei for 2nd, and Nadella passes Suleyman for 7th. Hassabis drops from a tie with Nadella to last.
  • 22/23, 25/26, 26/27: the order doesn't change.
  • Champions and last places are the same in every season. The Hall of Mirrors goes to the same contender in every season and all time. The other four awards don't change.
  • The Cake: ties resolve in 22/23 (the "Year of Efficiency" memo, now 12), 24/25 (customer support "totally gone", 15) and 25/26 (the "two cost centres" town hall, 14). All time and 26/27 keep altman-2026-10-ram.

Import file

prisma/seed/imports/tone-deafness.json holds the 95 edits for the live database, in the CMS bulk import format (LTET-26). Each edit sets scores.tone-deafness.score, plus scores.tone-deafness.reason where the reason changed (50 statements, every move of two or more levels among them). from is the value in the seed on master, and needs checking against the live values before import.

Checks

npm run check (0 data errors), build, unit tests (697) and e2e tests (1033) pass. No test was pinned to a seed tone score or a table order. A script confirmed that only scores.tone-deafness changed in the seed. prompts/extract.md takes its examples from the record, so it follows without a change.

Every change

Statement Old New Why
pichai-2023-01-12000-layoffs-full-responsibility 4 3 Real cost, said to the staff, but contrite; the AI cheer keeps it at 3, not 4.
nadella-2023-02-made-them-dance 2 1 A taunt at a rival; no cost to anyone outside the industry.
zuckerberg-2023-03-year-of-efficiency-10000-layoffs-memo 3 4 10,000 jobs to the people losing them, branded as efficiency while investors cheered.
pichai-2023-04-60-minutes-human-mind 4 2 A deflection of accountability, but no cost to a group in the room.
altman-2023-05-senate-licensing-agency 2 1 A policy proposal; the public pays nothing.
altman-2023-05-eu-cease-operating 3 2 An ultimatum to lawmakers, not a cost waved at the public.
altman-2023-09-median-human 4 3 Ordinary workers as the thing to replace; cheerful, but no fresh loss.
altman-2023-10-superhuman-persuasion 2 1 A vague forecast; nobody's cost is waved off.
suleyman-2024-01-davos-labor-replacing-tools 2 1 A candid, hedged warning, not a cost cheered.
zuckerberg-2024-01-open-source-agi 2 1 An announcement; the chips grate, the public pays nothing.
huang-2024-02-nobody-has-to-program 3 2 A skill loss forecast for later, to governments, not to the coders.
musk-2024-03-ai-annihilation-10-20-percent 3 2 Extinction odds waved off, but a forecast, not a cost anyone is paying.
huang-2024-03-free-chips-not-cheap-enough 3 1 A boast to rivals; no public cost.
suleyman-2024-04-ted-new-digital-species 3 1 A metaphor; no cost to anyone.
altman-2024-05-her 5 4 A wink at the actor who said no; a real cost, not hardship sold as good news.
nadella-2024-05-recall-photographic-memory 4 3 Privacy worries waved off as 'magical' while users objected.
musk-2024-06-apple-openai-ban 3 1 A spat with rivals.
musk-2024-07-fsd-shocked-next-year 2 1 An overdue promise; grates, costs nobody.
huang-2024-09-compute-one-pixel-infer-32 3 1 A tech boast; gamers' worry is minor.
altman-2024-09-few-thousand-days 3 1 Hype; no cost.
suleyman-2024-10-copilot-real-friend 4 2 Users disliked the product; a small cost, one grating line.
musk-2024-10-optimus-walk-among-you 2 1 Showbiz; no cost.
amodei-2024-10-machines-of-loving-grace 3 1 Optimism; no cost.
pichai-2024-10-quarter-of-new-code 2 1 An earnings boast; no cost waved at anyone.
zuckerberg-2024-10-new-category-ai-generated-content 3 2 A diffuse cost to feeds, cheered to investors, not to users.
huang-2025-01-rtx5070-4090-performance 3 1 A marketing claim; no cost.
huang-2025-01-quantum-15-to-30-years 2 1 Investors' loss, not the public's.
zuckerberg-2025-01-rogan-ai-mid-level-engineer 3 2 Job loss forecast to a podcast audience; not a fresh cost.
amodei-2025-01-davos-double-human-lifespan 4 1 Optimism; no cost.
amodei-2025-03-ai-writes-90-percent-of-code 2 1 A forecast; no one's cost waved off.
suleyman-2025-04-copilot-companion-lasting-relationship 3 1 A product vision; no cost.
hassabis-2025-04-60-minutes-cure-all-disease-decade 3 1 Optimism; no cost.
altman-2025-04-please-thank-you 2 1 A joke; one grating line.
zuckerberg-2025-04-ai-friends-fewer-than-three 5 4 Loneliness as a market, but not at the worst moment.
amodei-2025-05-hallucinate-less-than-humans 3 1 A defence of the product; no public cost.
amodei-2025-05-white-collar-bloodbath 3 2 A warning, not a cheer; grates because of who gives it.
pichai-2025-06-fridman-underlying-risk-pretty-high 3 1 Optimism about risk; no cost.
altman-2025-06-amd-power-on-earth 4 2 The energy cost laughed off, but not to the people paying it.
musk-2025-06-grok-rewrite-human-knowledge 4 2 Ideological, but no cost waved at the public.
musk-2025-07-grok-4-smarter-than-grad-students 5 3 Hate posts just removed, then a boast; a fresh cost cheered over.
musk-2025-07-grok-too-compliant 4 3 Blamed users for the hate posts, a day later.
zuckerberg-2025-07-hyperion-covers-part-of-manhattan 4 1 A boast about size; no cost.
amodei-2025-07-gulf-money-leaked-memo 4 2 Internal, and the cost falls on others; mostly hypocrisy.
zuckerberg-2025-07-ai-glasses-cognitive-disadvantage 4 1 A sales pitch; one grating line.
zuckerberg-2025-07-personal-superintelligence-dole 3 1 A vision letter; no cost.
suleyman-2025-08-seemingly-conscious-ai-premature-and-dangerous 2 1 A view on research; no public cost.
altman-2025-10-moral-police 4 2 A defence of a policy; the cost concerns grate but are not cheered.
musk-2025-10-grok-5-agi-10-percent 2 1 Hype; no cost.
musk-2025-10-robot-army-pay-package 5 3 A trillion-dollar ask for a robot army, to the shareholders paying.
musk-2025-10-grokipedia-orders-of-magnitude 3 1 A boast; no cost.
altman-2025-11-sell-your-shares 3 1 Testy with an investor; no public cost.
nadella-2025-10-bg2-chips-i-cant-plug-in-warm-shells 3 2 Power bills are real, but not waved off to those paying.
musk-2025-11-optimus-follow-criminals 4 2 An odd idea, not a cost to anyone now.
amodei-2025-11-60-minutes-deeply-uncomfortable 2 1 Humble, mostly.
pichai-2025-11-bbc-dont-blindly-trust-ai 3 2 Errors put on users; grates.
suleyman-2025-11-so-many-cynics 5 4 Users' complaints laughed off while fresh; not hardship sold as good news.
musk-2025-11-grok-adversarial-prompting-praise 3 1 Absurd, but no cost.
musk-2025-12-fsd-texting-while-driving 4 3 A safety cost to others waved off, fresh.
altman-2025-12-newborn-fallon 4 2 Grates with parents, but costs them nothing.
nadella-2025-12-slop-vs-sophistication 5 3 Users' complaints waved off while fresh.
musk-2026-01-dont-save-for-retirement 5 4 Savings advice from the richest man, but not at the worst moment.
huang-2026-01-doomer-narrative-not-helpful 3 1 Dismisses critics; no public cost.
musk-2026-01-grok-literally-zero 5 4 Children's images denied while fresh; not sold as good news.
musk-2026-01-dont-let-loved-ones-use-chatgpt 3 2 Deaths used against a rival; grates.
nadella-2026-01-davos-social-permission 3 1 Reads the room, mostly.
amodei-2026-01-adolescence-of-technology 3 2 'Underclass' grates; a warning, not a cheer.
altman-2026-02-super-bowl-ads 3 1 A spat with a rival.
amodei-2026-02-claude-might-be-conscious 2 1 Uncertainty; no cost.
suleyman-2026-02-white-collar-work-automated-18-months 3 2 A forecast to white-collar readers, not a fresh cost.
altman-2026-02-train-a-human 5 4 Energy costs answered by likening people to models.
altman-2026-03-intelligence-on-a-meter 4 2 A future meter, said to investors; no fresh cost.
musk-2026-03-xai-not-built-right 2 1 An internal rebuild; no public cost.
huang-2026-03-dlss5-completely-wrong 4 2 Customers corrected, not their cost waved off.
huang-2026-03-tokens-deeply-alarmed 5 2 A pay benchmark that grates; no hardship sold.
huang-2026-04-agents-micromanaging-you 4 3 Harassment pitched as job security to a hard job market.
pichai-2026-04-75-percent-new-code 2 1 An earnings boast; no cost.
musk-2026-04-terminator-situation-testimony 3 1 Doom in court; no public cost waved off.
zuckerberg-2026-04-layoffs-two-cost-centers 4 5 8,000 jobs traded for compute, told to the staff, as serving the community.
pichai-2026-05-hard-fork-boo-strategy 3 1 Corporate speak; no cost.
nadella-2026-06-build-water-single-restaurant 3 2 Water worries soothed with a brochure line; grates.
huang-2026-06-social-norms-just-go-engage-it 3 1 A sales plea; no cost.
nadella-2026-06-wsj-white-collar-weapon 2 0 Takes the public's side.
musk-2026-07-economist-ai-better-than-humans 3 1 Optimism; no cost.
altman-2026-07-singularity 2 1 Hype; no cost.
altman-2026-07-parenting-podcast 5 2 Grates widely, costs nobody.
zuckerberg-2026-08-essay-personal-agent-relationships 4 1 A product vision; no cost.
altman-2026-08-screen-watching 4 2 A future privacy cost, pitched, not fresh.
amodei-2026-08-x-reply-cure-most-disease-5-10-years 4 1 Optimism; no cost.
altman-2026-08-data-centers-hate 2 1 Concedes the public's view.
amodei-2026-09-agrees-with-coxon-ai-could-kill-us-all 3 1 A warning, not a cheer.
huang-2026-09-zero-percent-chance-end-of-world 3 1 Dismisses doom; no public cost.
huang-2026-09-klein-basic-math-does-it-matter 5 4 Lost skills waved off, but not sold as good news.
musk-2026-10-robotaxi-grey-kittens 3 1 An excuse; no cost to people.
altman-2026-10-bad-things 5 4 Harm to others waved off; not at the worst moment.
musk-2026-10-ai-psychosis 3 2 A joke about a harm others suffer; grates.

Comment thread prisma/seed/imports/tone-deafness.json Resolved
@claude

claude Bot commented Nov 6, 2026

Copy link
Copy Markdown

review: bc000a1
findings: 2

  • [must-fix] prisma/seed/imports/tone-deafness.json:7: the from values are stale. statements.json already holds the to values (pichai-2023-01-12000-layoffs-full-responsibility is already 3, not 4), so a strict apply rejects the edits and a blind apply changes nothing. Fix: drop the file or regenerate it against the current statements.json.
  • [should-fix] prisma/seed/imports/tone-deafness.json:1: nothing in src or scripts reads prisma/seed/imports, and no test covers the edits format (a missing id, a from mismatch, a score outside the range). Fix: add the loader with tests for those cases, or don't merge the file.

@claude

claude Bot commented Nov 6, 2026

Copy link
Copy Markdown

review: 5496bd5
findings: 2

  • [must-fix] prisma/seed/imports/tone-deafness.json:4: the from values do not match prisma/seed/statements.json, which already holds the to values. pichai-2023-01-12000-layoffs-full-responsibility is 3 there but the edit says from 4, nadella-2023-02-made-them-dance is 1 but the edit says 2, and zuckerberg-2023-03-year-of-efficiency-10000-layoffs-memo already has the new reason and score 4. Any applier that checks from will reject or skip these edits, and one that doesn't will re-apply stale changes. Fix: regenerate every from from the current statements.json, or drop the edits that are already applied.
  • [should-fix] prisma/seed/imports/tone-deafness.json:1: nothing in src, scripts or tests reads prisma/seed/imports, so the 95 edits are never applied or validated, and a missing id, a from mismatch or a score outside 0–5 would go unnoticed. Fix: add a unit test that loads this file and checks each id exists, each from equals the current value and each score to is an integer from 0 to 5 (and the applier, if there is none yet).

@claude

claude Bot commented Nov 6, 2026

Copy link
Copy Markdown

review: 98454cf
findings: 2

  • [should-fix] prisma/seed/imports/tone-deafness.json:807: amodei-2026-08-x-reply-cure-most-disease-5-10-years drops 4 to 1 but keeps the reason 'Doctors called it wildly off-base and impossible', which describes public backlash; rubric level 1 means 'one line that grates, in an otherwise reasonable moment', so the score and its published reason disagree. Fix: rewrite the reason to justify the new score, or keep the higher score.
  • [should-fix] prisma/seed/imports/tone-deafness.json:789: zuckerberg-2026-08-essay-personal-agent-relationships drops 4 to 1 while the reason still says critics called it exactly why people don't like AI (same pattern at :268, 4 to 1 with no reason change, and about 20 other drops of 2 or more points whose reasons are unchanged). Fix: update the reason on every edit that moves a score by 2 or more, so each published score still comes with matching reasons.

@claude

claude Bot commented Nov 6, 2026

Copy link
Copy Markdown

review: a7da271
no findings

@Lindeneg
Lindeneg merged commit f201df0 into master Nov 6, 2026
4 checks passed
@Lindeneg
Lindeneg deleted the LTET-16-tone-anchors branch November 6, 2026 23:49
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant