diff --git a/CHANGELOG.md b/CHANGELOG.md index 938cf25..2991f50 100644 --- a/CHANGELOG.md +++ b/CHANGELOG.md @@ -1,5 +1,29 @@ # Changelog +## Unreleased + +- **`gitnext learn-tests` for Java** (Maven; JUnit 5, and JUnit 4 under surefire 3.6 and newer): one test run with + the JaCoCo agent, its data taken around every test, so `tests-for`, `look`, `check` and `why` name the tests + that really run a method — 99% and 94% of the failing ones on JSON-java and jsoup (the call graph: 71% and + 29%); the run took 19 s and 69 s. What a class's static blocks run is booked to every test that touches the + class. Nothing is written into the project and nothing is downloaded: when JaCoCo is not in the local Maven + repository the message is the command that gets it. Gradle and TestNG are not learned yet. +- **`gitnext check` tells a test the change broke from a test that fails anyway.** The tests that failed are run + once more on the code as the last commit has it (the changed files are put back for that run, then the changes + return), and the answer is remembered for the commit. A test that fails both ways is named as not caused by the + change, and when nothing else fails the verdict is ok; a test that passes without the change is said to. In the + agent runs a test that cannot pass on the test machine made two models undo or abandon a correct rename. + `GITNEXT_CHECK_BEFORE=0` switches it off; changes left by a killed check come back at the next one. +- **`why ` and `check ` end with what to do**: the function to change, by name and place, and the + call that replaces it, then the check to run — small models read the failure and stopped there. +- **`edit replace` (MCP: `replace`, `replace_symbol`) given a line of the code where the name belongs makes the + edit that was meant.** A small model used to text edits writes `replace("if a == b {", "if a != b {")` or gives + the first line of the function as its name; in the agent runs every such call was refused ("symbol not found"). + Now text that stands in one place is replaced there; when the code is a whole function, the function around + that place is replaced; text in several places is answered with the places and the functions they are in. +- **A quarter less time per command on a very large repository** (Kubernetes, 5.6M lines: seven commands took + 22.4 s, now 16.9 s): the graph is read on two threads and is not taken apart when the command ends. + ## 0.3.1 — 2026-11-13 - **`gitnext look` takes a place in a file**, written the way tracebacks, test runners and models write it: diff --git a/README.md b/README.md index 63c8f05..80888e3 100644 --- a/README.md +++ b/README.md @@ -29,7 +29,7 @@ Everything here is measured on other people's code — ten open-source projects

Tasks solved by three local models: 144 of 216 with plain tools, 163 of 216 with the five gitnext tools

-Three local models (Qwen 3.5 4B, 9B and 27B), the same 72 tasks each way — find a function, list its callers, rename it, fix a seeded bug — on six projects in Python, Rust and Go, judged by the projects' own compilers and tests. With the five gitnext tools (`gitnext mcp --profile lite`) they solve 163 of 216 tasks against 144 with plain read / grep / edit / run (+9 points; the 95% interval is +1 to +17), in a median of 3–4 steps instead of 9–10, and the 27B model sends 2.4 times fewer tokens. The clear gain is a bug fixed by the larger model: 14 of 18 against 7, never the other way round. For one model alone the difference in solved tasks is inside the noise, and an earlier 24-task run that showed 4 against 15 for the 4B model did not repeat: with today's harness the plain model solves 19 of those 24. +Three local models (Qwen 3.5 4B, 9B and 27B), the same 72 tasks each way — find a function, list its callers, rename it, fix a seeded bug — on six projects in Python, Rust and Go, judged by the projects' own compilers and tests. With the five gitnext tools (`gitnext mcp --profile lite`) they solve 163 of 216 tasks against 144 with plain read / grep / edit / run (+9 points; the 95% interval is +1 to +17), in a median of 3–4 steps instead of 9–10, and the 27B model sends 2.4 times fewer tokens. The clear gain is a bug fixed by the larger model: 14 of 18 against 7, never the other way round. For one model alone the difference in solved tasks is inside the noise, and an earlier 24-task run that showed 4 against 15 for the 4B model did not repeat: with today's harness the plain model solves 19 of those 24. On a large project (Prometheus, 406 thousand lines of Go; the 4B and 27B models, 36 tasks each way, no bug fixes) the gain is larger: 62 of 72 tasks against 49 (+18 points, the 95% interval is +7 to +31), for a third of the tokens. ### A failing test leads to the function at fault @@ -49,6 +49,12 @@ Three local models (Qwen 3.5 4B, 9B and 27B), the same 72 tasks each way — fin 232 functions for callers, 338 renames, 167 functions for tests; ± is the 90% interval, a difference inside it is noise. Python has no compiler to say who calls what, so callers are not scored there. `python3 eval/run.py` repeats the run; the full table is [eval/results/latest.md](eval/results/latest.md). +What these numbers are not: + +- **The tool was tuned on these ten projects.** On fourteen projects it had never seen, measured once ([heldout.md](eval/results/heldout.md)): callers found 99%, correct 96%; rename 77%; and where a function is picked whether or not gitnext knows a caller of it, 87% of the callers are found (99% here). +- **A plain search for the name finds every caller too** — with one wrong answer in ten instead of one in a hundred. For methods whose name several types share, the search is wrong two times in three, gitnext finds 83% of the callers (73% on the unseen projects), and a language server (gopls, rust-analyzer, tsserver) 97–99% ([latest.lsp.md](eval/results/latest.lsp.md)). Where a language server is installed, `gitnext lsp` asks it once about the ambiguous calls and keeps the answers: on the Go and Rust projects that takes gitnext from 78% to 96%, and from 73% to 93% on the unseen ones ([lsp-refined.compare.md](eval/results/lsp-refined.compare.md)). +- **Ten tests picked at random catch a broken function in 61% of cases**, so 79% is 18 points above chance; with a learned coverage map the failing tests are named outright. + ### Fewer steps, less to read

Bytes of code an agent read for six tasks: 49 KB without gitnext, 29 KB recounted, 22 KB with gitnext look

@@ -57,8 +63,8 @@ Most of an agent session is the system prompt re-sent on every step, so the win ### What is checked, and what is not good yet -- 139 unit tests; parser output is pinned by fixtures in eight languages; every command and every MCP tool — 86 in all — is run on each of the ten projects (860 calls, none fails). What checks each function: [eval/results/COVERAGE.md](eval/results/COVERAGE.md). -- Java has no coverage map in the product yet (a prototype with JaCoCo finds 94–99% of the failing tests); for JS / TS it needs vitest. +- 149 unit tests; parser output is pinned by fixtures in eight languages; every command and every MCP tool — 86 in all — is run on each of the ten projects (860 calls, none fails). What checks each function: [eval/results/COVERAGE.md](eval/results/COVERAGE.md). +- The coverage map for Java needs Maven and tests that run on the JUnit Platform (JUnit 5, or JUnit 4 under surefire 3.6 and newer); Gradle is not learned. For JS / TS it needs vitest. - A rename breaks the build or the tests in 9% of cases — mostly dynamic access and names shared by unrelated types. - Small models rarely fix a seeded bug: 6 of 18 at best for the 4B and the 9B model. With the full tool list they do not start from `check ` (the 9B model never did in 18 tasks) — give them the short list. - A rename done with the tool passed the judge no more often than one done by hand (12–13 of 18 against 14): names that are also common words, and mentions in documentation — the latter are renamed now. @@ -91,8 +97,8 @@ gitnext # open the TUI | edit one function without reading the file | `gitnext edit replace -f new.py` / `replace_symbol` | | rename everywhere (imports, tests, `__all__`, `mod.func`) | `gitnext rename ` / `rename_symbol` | | what breaks, which tests to run | `gitnext impact ` · `gitnext tests-for ` (the 10 most likely to fail + one command for the rest) | -| which tests really run a function | `gitnext learn-tests` — the tests run once with coverage (Python: pytest-cov; Go; Rust: `llvm-tools-preview`; JS / TS: vitest with `@vitest/coverage-v8`); `tests-for`, `look`, `check` and `why` then use the real list | -| did my change break anything | `gitnext check` — builds and runs the tests of what changed, prints a verdict (`gitnext rename A B --check` does it right after the rename) | +| which tests really run a function | `gitnext learn-tests` — the tests run once with coverage (Python: pytest-cov; Go; Rust: `llvm-tools-preview`; JS / TS: vitest with `@vitest/coverage-v8`; Java: Maven with the JaCoCo agent); `tests-for`, `look`, `check` and `why` then use the real list | +| did my change break anything | `gitnext check` — builds and runs the tests of what changed, prints a verdict; a test that fails without the change too is named as not caused by it (`gitnext rename A B --check` does it right after the rename) | | a test fails — why | `gitnext why ` / `check` with `test` — runs it: the failure in a few lines, the code the test ran with the most likely culprit first, the lines changed since the tests passed | | a long build or test log | `cargo test 2>&1 \| gitnext digest` — what failed, where, the message (a vitest run with 35 failures: 843 lines → 12) | | error or traceback → code | `gitnext locate` (stdin) / `locate` | diff --git a/README.ru.md b/README.ru.md index 3dce4be..fd77d7e 100644 --- a/README.ru.md +++ b/README.ru.md @@ -30,7 +30,7 @@ gitnext — спутник git (`gitnext` = `git` + индекс кода). Он

Задания, решённые тремя локальными моделями: 144 из 216 с обычными инструментами, 163 из 216 с пятью инструментами gitnext

-Три локальные модели (Qwen 3.5 4B, 9B и 27B), одни и те же 72 задания в каждом режиме — найти функцию, назвать вызывающих, переименовать, починить подсаженную ошибку — на шести проектах на Python, Rust и Go; судят компилятор и тесты самих проектов. С пятью инструментами gitnext (`gitnext mcp --profile lite`) модели решают 163 задания из 216 против 144 с обычными «читать / искать / править / запускать» (+9 пунктов; 95%-й интервал от +1 до +17), за 3–4 шага вместо 9–10 (медиана), а модель 27B отправляет в 2,4 раза меньше токенов. Заметный выигрыш — починка ошибки большой моделью: 14 из 18 против 7, и ни одного случая наоборот. Для одной модели разница в числе решённых заданий не выходит за погрешность, а прежний замер на 24 заданиях, где у модели 4B было 4 против 15, не повторился: с нынешним агентом модель без gitnext решает 19 из тех же 24. +Три локальные модели (Qwen 3.5 4B, 9B и 27B), одни и те же 72 задания в каждом режиме — найти функцию, назвать вызывающих, переименовать, починить подсаженную ошибку — на шести проектах на Python, Rust и Go; судят компилятор и тесты самих проектов. С пятью инструментами gitnext (`gitnext mcp --profile lite`) модели решают 163 задания из 216 против 144 с обычными «читать / искать / править / запускать» (+9 пунктов; 95%-й интервал от +1 до +17), за 3–4 шага вместо 9–10 (медиана), а модель 27B отправляет в 2,4 раза меньше токенов. Заметный выигрыш — починка ошибки большой моделью: 14 из 18 против 7, и ни одного случая наоборот. Для одной модели разница в числе решённых заданий не выходит за погрешность, а прежний замер на 24 заданиях, где у модели 4B было 4 против 15, не повторился: с нынешним агентом модель без gitnext решает 19 из тех же 24. На большом проекте (Prometheus, 406 тысяч строк на Go; модели 4B и 27B, по 36 заданий в каждом режиме, без починки ошибок) прирост больше: 62 задания из 72 против 49 (+18 пунктов, 95-процентный интервал от +7 до +31), и на это уходит втрое меньше токенов. ### От упавшего теста — к виновной функции @@ -50,6 +50,12 @@ gitnext — спутник git (`gitnext` = `git` + индекс кода). Он 232 функции для вызывающих, 338 переименований, 167 функций для тестов; ± — интервал 90%, разница внутри него — шум. У Python нет компилятора, который скажет, кто кого вызывает, поэтому вызывающие там не оцениваются. Повторить: `python3 eval/run.py`; полная таблица — [eval/results/latest.md](eval/results/latest.md). +Чем эти цифры не являются: + +- **Инструмент доводили на этих десяти проектах.** На четырнадцати проектах, которых он не видел, с одного прогона ([heldout.md](eval/results/heldout.md)): вызывающие найдены в 99%, верны в 96%; переименование — 77%; а там, где функция берётся независимо от того, знает ли gitnext её вызывающего, найдено 87% вызывающих (здесь 99%). +- **Простой поиск по имени тоже находит всех вызывающих** — но каждый десятый его ответ лишний, а у gitnext каждый сотый. Для методов, имя которых общее у нескольких типов, поиск ошибается в двух случаях из трёх, gitnext находит 83% вызывающих (73% на новых проектах), языковой сервер (gopls, rust-analyzer, tsserver) — 97–99% ([latest.lsp.md](eval/results/latest.lsp.md)). Там, где языковой сервер установлен, `gitnext lsp` один раз спрашивает его о неоднозначных вызовах и запоминает ответы: на проектах на Go и Rust это поднимает gitnext с 78% до 96%, а на новых проектах — с 73% до 93% ([lsp-refined.compare.md](eval/results/lsp-refined.compare.md)). +- **Десять тестов наугад ловят сломанную функцию в 61% случаев**, так что 79% — это на 18 пунктов выше случайного выбора; с картой покрытия падающие тесты называются точно. + ### Меньше шагов, меньше читать

Сколько кода прочитал агент на 6 задачах

@@ -58,8 +64,8 @@ gitnext — спутник git (`gitnext` = `git` + индекс кода). Он ### Что проверено и что пока плохо -- 139 модульных тестов; вывод парсеров закреплён эталонами на восьми языках; каждая команда и каждый MCP-инструмент — всего 86 — запускаются на каждом из десяти проектов (860 вызовов, ни один не падает). Чем проверена каждая функция: [eval/results/COVERAGE.md](eval/results/COVERAGE.md). -- Для Java карты покрытия в продукте пока нет (прототип на JaCoCo находит 94–99% падающих тестов); для JS / TS нужен vitest. +- 149 модульных тестов; вывод парсеров закреплён эталонами на восьми языках; каждая команда и каждый MCP-инструмент — всего 86 — запускаются на каждом из десяти проектов (860 вызовов, ни один не падает). Чем проверена каждая функция: [eval/results/COVERAGE.md](eval/results/COVERAGE.md). +- Карте покрытия для Java нужны Maven и тесты, которые идут через JUnit Platform (JUnit 5 или JUnit 4 под surefire 3.6 и новее); Gradle пока не поддержан. Для JS / TS нужен vitest. - Переименование ломает сборку или тесты в 9% случаев — в основном динамический доступ и одинаковые имена у несвязанных типов. - Малые модели редко чинят подсаженную ошибку: в лучшем случае 6 из 18 у 4B и у 9B. С полным набором инструментов они не начинают с `check <тест>` (модель 9B — ни разу за 18 заданий): им нужен короткий набор. - Переименование инструментом проходило проверку не чаще ручного (12–13 из 18 против 14): имена, совпадающие с обычными словами, и упоминания в документации — последние теперь тоже переименовываются. @@ -92,8 +98,8 @@ gitnext # открыть TUI | поправить функцию, не читая файл | `gitnext edit replace -f new.py` / `replace_symbol` | | переименовать везде (импорты, тесты, `__all__`, `mod.func`) | `gitnext rename <старое> <новое>` / `rename_symbol` | | что сломается и какие тесты гонять | `gitnext impact ` · `gitnext tests-for ` (10 самых вероятных + одна команда на остальные) | -| какие тесты на самом деле исполняют функцию | `gitnext learn-tests` — один прогон тестов с покрытием (Python: pytest-cov; Go; Rust: `llvm-tools-preview`; JS / TS: vitest с `@vitest/coverage-v8`); `tests-for`, `look`, `check` и `why` дальше берут настоящий список | -| не сломал ли я что-то правкой | `gitnext check` — собирает проект, гонит тесты изменённого и выдаёт вердикт (`gitnext rename A B --check` — сразу после переименования) | +| какие тесты на самом деле исполняют функцию | `gitnext learn-tests` — один прогон тестов с покрытием (Python: pytest-cov; Go; Rust: `llvm-tools-preview`; JS / TS: vitest с `@vitest/coverage-v8`; Java: Maven с агентом JaCoCo); `tests-for`, `look`, `check` и `why` дальше берут настоящий список | +| не сломал ли я что-то правкой | `gitnext check` — собирает проект, гонит тесты изменённого и выдаёт вердикт; тест, который падает и без правки, назван как не её вина (`gitnext rename A B --check` — сразу после переименования) | | тест падает — почему | `gitnext why <тест>` / `check` с `test` — запускает его: сбой в нескольких строках, код, который тест запускал (самый вероятный виновник первым), строки, изменённые с тех пор, как тесты проходили | | длинный лог сборки или тестов | `cargo test 2>&1 \| gitnext digest` — что упало, где, сообщение | | ошибка или traceback → код | `gitnext locate` (stdin) / `locate` | diff --git a/crates/gitnext-cli/src/cmds.rs b/crates/gitnext-cli/src/cmds.rs index 7919aea..762d956 100644 --- a/crates/gitnext-cli/src/cmds.rs +++ b/crates/gitnext-cli/src/cmds.rs @@ -49,14 +49,18 @@ fn code_from(file: Option) -> Result { } pub fn edit(ws: &Workspace, op: EditOp, json: bool) -> Result<()> { - let g = ws.graph()?; + let g = ws.graph_once()?; let (sym, kind, code, force) = match op { EditOp::Replace { symbol, file, force } => (symbol, EditKind::Replace, code_from(file)?, force), EditOp::InsertAfter { symbol, file, force } => (symbol, EditKind::InsertAfter, code_from(file)?, force), EditOp::Delete { symbol, force } => (symbol, EditKind::Delete, String::new(), force), }; - let i = one(&g, &sym)?; - let r = edit::edit_symbol(&ws.root, &g, i, kind, &code, force)?; + let r = match one(&g, &sym) { + Ok(i) => edit::edit_symbol(&ws.root, &g, i, kind, &code, force)?, + // a line of the code where the name belongs: the edit that was meant + Err(_) if kind == EditKind::Replace && edit::is_code(&sym) => edit::replace_text(&ws.root, &g, &sym, &code, force)?, + Err(e) => return Err(e), + }; if json { println!("{}", serde_json::to_string(&r)?); } else { @@ -93,9 +97,10 @@ pub enum More { #[arg(long)] no_code: bool, }, - /// Resolve ambiguous calls precisely with language servers (rust-analyzer, pyright, clangd); cached + /// Resolve ambiguous calls precisely with the language servers installed here (gopls, rust-analyzer, pyright, + /// typescript-language-server, clangd, jdtls); the answers are kept in the index Lsp { - /// rust | python | c (default: every language in the repo) + /// go | rust | python | ts | c | java (default: every language in the repo) #[arg(long)] lang: Option, #[arg(short = 'n', long, default_value_t = 3000)] @@ -249,7 +254,7 @@ pub fn more(cwd: &Path, m: More, out: &Out) -> Result<()> { }; match m { More::Explain { path, provider, limit, dry_run } => { - let g = ws.graph()?; + let g = ws.graph_once()?; let scope = crate::norm_path(&ws, path.as_deref().unwrap_or("")); let p = match provider.as_deref() { Some(x) => Some(explain::Provider::parse(x).ok_or_else(|| anyhow::anyhow!("unknown provider `{x}`"))?), @@ -272,7 +277,7 @@ pub fn more(cwd: &Path, m: More, out: &Out) -> Result<()> { } } More::Annotate { target, summary } => { - let g = ws.graph()?; + let g = ws.graph_once()?; let text = summary.join(" "); if text.trim().is_empty() { bail!("give the summary text"); @@ -286,7 +291,7 @@ pub fn more(cwd: &Path, m: More, out: &Out) -> Result<()> { println!("✓ noted"); } More::Locate { text, no_code } => { - let g = ws.graph()?; + let g = ws.graph_once()?; let t = if text.is_empty() { let mut s = String::new(); std::io::stdin().read_to_string(&mut s)?; @@ -297,11 +302,11 @@ pub fn more(cwd: &Path, m: More, out: &Out) -> Result<()> { out.text(&gitnext_ops::locate::render_locate(&g, &ws.root, &t, !no_code)); } More::LearnTests => { - let g = ws.graph()?; + let g = ws.graph_once()?; out.text(&gitnext_ops::learn::render(&gitnext_ops::learn::learn(&ws.root, &g)?)); } More::Why { names, timeout } => { - let g = ws.graph()?; + let g = ws.graph_once()?; if names.is_empty() { bail!("which test? `gitnext why `"); } @@ -335,7 +340,7 @@ pub fn more(cwd: &Path, m: More, out: &Out) -> Result<()> { out.text(&gitnext_ops::digest::render(&gitnext_ops::digest::digest(&t), max)); } More::Check { timeout, .. } => { - let g = ws.graph()?; + let g = ws.graph_once()?; let c = gitnext_ops::check::check(&ws.root, &g, std::time::Duration::from_secs(timeout)); out.text(&gitnext_ops::check::render(&g, &c)); if !c.ok() { @@ -343,13 +348,13 @@ pub fn more(cwd: &Path, m: More, out: &Out) -> Result<()> { } } More::TestsFor { symbol, depth, all } => { - let g = ws.graph()?; + let g = ws.graph_once()?; for i in lookup(&g, &symbol)? { out.text(&gitnext_ops::locate::render_tests_for(&g, &ws.root, i, depth, all)); } } More::Lsp { lang, limit, all } => { - let g = ws.graph()?; + let g = ws.graph_once()?; let fams = match lang.as_deref() { Some(l) => vec![gitnext_ops::lsp::Family::parse(l).ok_or_else(|| anyhow::anyhow!("unknown language `{l}`"))?], None => gitnext_ops::lsp::families_in(&g), @@ -367,7 +372,7 @@ pub fn more(cwd: &Path, m: More, out: &Out) -> Result<()> { } } More::History { symbol, limit } => { - let g = ws.graph()?; + let g = ws.graph_once()?; let i = one(&g, &symbol)?; let ev = gitnext_ops::history::history(ws.repo()?, &g, i, limit)?; if out.json { @@ -376,7 +381,7 @@ pub fn more(cwd: &Path, m: More, out: &Out) -> Result<()> { out.text(&gitnext_ops::history::render_history(&g, i, &ev)); } More::Changelog { range } => { - let g = ws.graph()?; + let g = ws.graph_once()?; let c = gitnext_ops::history::changelog(ws.repo()?, &g, &range)?; if out.json { return out.json(&c); @@ -384,7 +389,7 @@ pub fn more(cwd: &Path, m: More, out: &Out) -> Result<()> { out.text(&gitnext_ops::history::render_changelog(&c)); } More::Overview => { - let g = ws.graph()?; + let g = ws.graph_once()?; out.text(&insight::overview(ws.repo.as_ref(), &g, &ws.root)); } More::Activity { limit } => { @@ -395,7 +400,7 @@ pub fn more(cwd: &Path, m: More, out: &Out) -> Result<()> { out.text(&insight::render_activity(&a)); } More::Hotspots { top } => { - let g = ws.graph()?; + let g = ws.graph_once()?; let h = insight::hotspots(ws.repo.as_ref(), &g, 500, top)?; if out.json { return out.json(&h); @@ -403,7 +408,7 @@ pub fn more(cwd: &Path, m: More, out: &Out) -> Result<()> { out.text(&insight::render_hotspots(&h)); } More::Dead => { - let g = ws.graph()?; + let g = ws.graph_once()?; let d = insight::dead(&g, &ws.root); if out.json { return out.json(&d); @@ -411,7 +416,7 @@ pub fn more(cwd: &Path, m: More, out: &Out) -> Result<()> { out.text(&insight::render_dead(&d)); } More::Cycles => { - let g = ws.graph()?; + let g = ws.graph_once()?; let c = insight::cycles(&g); if out.json { return out.json(&c); @@ -419,7 +424,7 @@ pub fn more(cwd: &Path, m: More, out: &Out) -> Result<()> { out.text(&insight::render_cycles(&g, &c)); } More::Entrypoints => { - let g = ws.graph()?; + let g = ws.graph_once()?; let e = insight::entrypoints(&g, &ws.root); if out.json { return out.json(&e); @@ -434,7 +439,7 @@ pub fn more(cwd: &Path, m: More, out: &Out) -> Result<()> { out.text(&gitnext_ops::journal::render(&j, sessions)); } More::Bench { symbols, dirs } => { - let g = ws.graph()?; + let g = ws.graph_once()?; let b = gitnext_ops::bench::run(&ws.root, &g, symbols, dirs); if out.json { return out.json(&b); @@ -457,12 +462,12 @@ pub fn more(cwd: &Path, m: More, out: &Out) -> Result<()> { list.sort(); list.dedup(); if !ws.root.join(gitnext_ops::gitnext_index::GITNEXT_DIR).is_dir() { - let g = ws.graph()?; + let g = ws.graph_once()?; ws.write_map(&g)?; } let r = ag::setup(&ws.root, &ag::SetupOpts { agents: list, hooks, command: "gitnext".into(), tools })?; // settings may change what AGENTS.md looks like - let g = ws.graph()?; + let g = ws.graph_once()?; ws.write_map(&g)?; if out.json { return out.json(&r); @@ -498,7 +503,7 @@ pub fn more(cwd: &Path, m: More, out: &Out) -> Result<()> { return out.json(&b); } let now = std::time::SystemTime::now().duration_since(std::time::UNIX_EPOCH).map(|d| d.as_secs() as i64).unwrap_or(0); - let g = ws.graph()?; + let g = ws.graph_once()?; for b in b { let pl = gitnext_ops::changes::plural; let rel = match (b.ahead, b.behind) { @@ -542,7 +547,7 @@ pub fn more(cwd: &Path, m: More, out: &Out) -> Result<()> { println!("{}", cv.draft); } More::Look { targets } => { - let g = ws.graph()?; + let g = ws.graph_once()?; out.text(&gitnext_ops::look::look_many(&ws, &g, &targets, false)); } More::Doctor => { @@ -556,11 +561,11 @@ pub fn more(cwd: &Path, m: More, out: &Out) -> Result<()> { } } More::Libs => { - let g = ws.graph()?; + let g = ws.graph_once()?; out.text(&gitnext_ops::libs::render_libraries(&ws.root, &g, 40)); } More::Brief => { - let g = ws.graph()?; + let g = ws.graph_once()?; out.text(&gitnext_ops::agents::brief(&ws, &g)); } More::Hook { event } => { @@ -581,7 +586,7 @@ pub fn more(cwd: &Path, m: More, out: &Out) -> Result<()> { let cwd = v["cwd"].as_str().map(PathBuf::from).unwrap_or_else(|| ws.root.clone()); let ws = Workspace::open(&cwd)?; if ws.root.join(gitnext_ops::gitnext_index::GITNEXT_DIR).is_dir() { - let g = ws.graph()?; + let g = ws.graph_once()?; print!("{}", gitnext_ops::agents::brief(&ws, &g)); } } diff --git a/crates/gitnext-cli/src/main.rs b/crates/gitnext-cli/src/main.rs index 48f763e..01804ed 100644 --- a/crates/gitnext-cli/src/main.rs +++ b/crates/gitnext-cli/src/main.rs @@ -371,7 +371,7 @@ fn run() -> Result<()> { } Cmd::Map { dir, print } => { let ws = Workspace::open(&cwd)?; - let g = ws.graph()?; + let g = ws.graph_once()?; if print || dir.is_some() { let d = norm_path(&ws, dir.as_deref().unwrap_or("")); let d = render::dir_for(&g, &d); @@ -403,7 +403,7 @@ fn run() -> Result<()> { } Cmd::Outline { path, all } => { let ws = Workspace::open(&cwd)?; - let g = ws.graph()?; + let g = ws.graph_once()?; let p = norm_path(&ws, path.as_deref().unwrap_or("")); let mut o = out.opts; o.all = all; @@ -411,7 +411,7 @@ fn run() -> Result<()> { } Cmd::Read { symbols } => { let ws = Workspace::open(&cwd)?; - let g = ws.graph()?; + let g = ws.graph_once()?; let mut ids = Vec::new(); for q in &symbols { ids.extend(lookup_same(&g, q)?); @@ -426,7 +426,7 @@ fn run() -> Result<()> { } Cmd::Show { symbol } => { let ws = Workspace::open(&cwd)?; - let g = ws.graph()?; + let g = ws.graph_once()?; let ids = lookup(&g, &symbol)?; if out.json { let v: Vec<_> = ids.iter().map(|&i| show_json(&g, i)).collect(); @@ -441,7 +441,7 @@ fn run() -> Result<()> { } Cmd::Search { query, limit, text } => { let ws = Workspace::open(&cwd)?; - let g = ws.graph()?; + let g = ws.graph_once()?; let q = query.join(" "); if text { let hits = gitnext_ops::look::text_hits(&g, &ws.root, &q, limit); @@ -459,7 +459,7 @@ fn run() -> Result<()> { } Cmd::Symbols { path, kind, public } => { let ws = Workspace::open(&cwd)?; - let g = ws.graph()?; + let g = ws.graph_once()?; let p = norm_path(&ws, path.as_deref().unwrap_or("")); let kind = match kind.as_deref() { Some(k) => Some(Kind::parse(k).ok_or_else(|| anyhow::anyhow!("unknown kind `{k}`"))?), @@ -477,7 +477,7 @@ fn run() -> Result<()> { } Cmd::Callers { symbols } => { let ws = Workspace::open(&cwd)?; - let g = ws.graph()?; + let g = ws.graph_once()?; // several names in one run: the graph is loaded once (it is the slow part on a big repo) let mut ids = Vec::new(); for symbol in &symbols { @@ -503,7 +503,7 @@ fn run() -> Result<()> { } Cmd::Callees { symbol } => { let ws = Workspace::open(&cwd)?; - let g = ws.graph()?; + let g = ws.graph_once()?; let ids = lookup(&g, &symbol)?; if out.json { let v: Vec<_> = ids.iter().map(|&i| callees_json(&g, i)).collect(); @@ -515,7 +515,7 @@ fn run() -> Result<()> { } Cmd::Impact { symbol, depth } => { let ws = Workspace::open(&cwd)?; - let g = ws.graph()?; + let g = ws.graph_once()?; let ids = lookup(&g, &symbol)?; if out.json { let v: Vec<_> = ids.iter().map(|&i| serde_json::json!({ "symbol": g.sym_ref(i), "impact": g.impact(i, depth) })).collect(); @@ -527,7 +527,7 @@ fn run() -> Result<()> { } Cmd::Hierarchy { symbol } => { let ws = Workspace::open(&cwd)?; - let g = ws.graph()?; + let g = ws.graph_once()?; let ids: Vec = lookup(&g, &symbol)?.into_iter().filter(|&i| g.syms[i].sym.kind.is_type()).collect(); if ids.is_empty() { bail!("`{symbol}` is not a type, class or trait"); @@ -542,7 +542,7 @@ fn run() -> Result<()> { } Cmd::Deps { dir } => { let ws = Workspace::open(&cwd)?; - let g = ws.graph()?; + let g = ws.graph_once()?; let d = render::dir_for(&g, &norm_path(&ws, dir.as_deref().unwrap_or(""))); if out.json { return out.json(&g.dir_deps(&d)); @@ -551,7 +551,7 @@ fn run() -> Result<()> { } Cmd::Context { query, tokens } => { let ws = Workspace::open(&cwd)?; - let g = ws.graph()?; + let g = ws.graph_once()?; let mut q = query.join(" "); if q.trim().is_empty() { use std::io::{IsTerminal as _, Read as _}; @@ -585,7 +585,7 @@ fn run() -> Result<()> { } Cmd::Rename { symbol, new_name, dry_run, text, check } => { let ws = Workspace::open(&cwd)?; - let g = ws.graph()?; + let g = ws.graph_once()?; let i = one(&g, &symbol)?; let _op = gitnext_ops::oplog::Group::start(&ws.root, "rename", &format!("{} → {new_name}", g.syms[i].sym.qualified)); let mut r = gitnext_ops::edit::rename(&ws.root, &g, i, &new_name, dry_run)?; @@ -597,7 +597,7 @@ fn run() -> Result<()> { } out.text(&gitnext_ops::edit::render_rename(&r)); if check && !dry_run { - let g = ws.graph()?; // the files changed: index them again + let g = ws.graph_once()?; // the files changed: index them again let c = gitnext_ops::check::check(&ws.root, &g, std::time::Duration::from_secs(600)); out.text(&gitnext_ops::check::render(&g, &c)); if !c.ok() { diff --git a/crates/gitnext-cli/src/mcp.rs b/crates/gitnext-cli/src/mcp.rs index dc7eeb3..4cf3d40 100644 --- a/crates/gitnext-cli/src/mcp.rs +++ b/crates/gitnext-cli/src/mcp.rs @@ -256,14 +256,19 @@ impl Server { gitnext_ops::render_diff(&gitnext_ops::semantic_diff(repo, mode).map_err(|e| e.to_string())?, a.get("full").and_then(Value::as_bool).unwrap_or(false)) } "replace_symbol" | "insert_after" | "delete_symbol" => { - let i = find_one(g, s_arg(a, "symbol").ok_or("missing `symbol`")?)?; + let q = s_arg(a, "symbol").ok_or("missing `symbol`")?; let code = s_arg(a, "code").unwrap_or(""); let kind = match name { "replace_symbol" => EditKind::Replace, "insert_after" => EditKind::InsertAfter, _ => EditKind::Delete, }; - let r = edit::edit_symbol(&root, g, i, kind, code, false).map_err(|e| format!("{e:#}"))?; + let r = match find_one(g, q) { + Ok(i) => edit::edit_symbol(&root, g, i, kind, code, false), + Err(_) if kind == EditKind::Replace && edit::is_code(q) => edit::replace_text(&root, g, q, code, false), + Err(e) => return Err(e), + } + .map_err(|e| format!("{e:#}"))?; edit::render_edit(&r) } "annotate" => { @@ -303,7 +308,11 @@ impl Server { let near: Vec<&str> = gitnext_ops::why::similar_tests(g, name).into_iter().map(|i| g.syms[i].sym.name.as_str()).collect(); return Err(format!("no test named `{name}`{}", if near.is_empty() { String::new() } else { format!("; close: {}", near.join(", ")) })); } - gitnext_ops::why::render(g, &root, &gitnext_ops::why::why(&root, g, &ids, std::time::Duration::from_secs(600))) + let next = gitnext_ops::why::Next { + replace: if self.profile == Profile::Lite { "replace(symbol=\"{}\", code=)" } else { "replace_symbol(symbol=\"{}\", code=)" }, + check: "check() with no arguments", + }; + gitnext_ops::why::render_for(g, &root, &gitnext_ops::why::why(&root, g, &ids, std::time::Duration::from_secs(600)), &next) } "tests_for" => { let d = a.get("depth").and_then(Value::as_u64).unwrap_or(4) as usize; @@ -337,9 +346,14 @@ impl Server { "replace" | "add_after" => { let q = any_str(a, &["symbol", "name", "function"]).ok_or("give `symbol`")?; let code = a.get("code").and_then(Value::as_str).unwrap_or(""); - let i = find_one(&self.graph, q)?; let kind = if name == "replace" { EditKind::Replace } else { EditKind::InsertAfter }; - let r = edit::edit_symbol(&root, &self.graph, i, kind, code, false).map_err(|e| format!("{e:#}"))?; + let r = match find_one(&self.graph, q) { + Ok(i) => edit::edit_symbol(&root, &self.graph, i, kind, code, false), + // a line of the code where the name belongs: the edit that was meant + Err(_) if kind == EditKind::Replace && edit::is_code(q) => edit::replace_text(&root, &self.graph, q, code, false), + Err(e) => return Err(e), + } + .map_err(|e| format!("{e:#}"))?; edit::render_edit(&r) } "overview" => gitnext_ops::insight::overview(self.ws.repo.as_ref(), g, &root), diff --git a/crates/gitnext-index/src/graph.rs b/crates/gitnext-index/src/graph.rs index 273b240..ed05564 100644 --- a/crates/gitnext-index/src/graph.rs +++ b/crates/gitnext-index/src/graph.rs @@ -154,17 +154,18 @@ impl Graph { } let mut visible: HashMap> = HashMap::new(); for (_, e) in &edges { - let from_root = e.from.split("::").next().unwrap_or("").to_string(); - let targets: Vec = match e.kind { - EdgeKind::Imports => flatten_use(&e.to), - EdgeKind::Calls | EdgeKind::Uses if e.to.contains("::") => vec![e.to.clone()], - _ => continue, - }; - for t in targets { + // this loop runs over every edge of the repo: nothing is allocated unless a new pair is found + let from_root = e.from.split("::").next().unwrap_or(""); + let mut see = |t: &str| { let root = t.split("::").next().unwrap_or(""); - if root != from_root && crate_roots.contains(root) { - visible.entry(from_root.clone()).or_default().insert(root.to_string()); + if root != from_root && crate_roots.contains(root) && !visible.get(from_root).is_some_and(|v| v.contains(root)) { + visible.entry(from_root.to_string()).or_default().insert(root.to_string()); } + }; + match e.kind { + EdgeKind::Imports => flatten_use(&e.to).iter().for_each(|t| see(t)), + EdgeKind::Calls | EdgeKind::Uses if e.to.contains("::") => see(&e.to), + _ => continue, } } // Re-exports (`pub use other_crate as x`) make visibility transitive. diff --git a/crates/gitnext-index/src/lib.rs b/crates/gitnext-index/src/lib.rs index 00dd71e..2162543 100644 --- a/crates/gitnext-index/src/lib.rs +++ b/crates/gitnext-index/src/lib.rs @@ -337,11 +337,11 @@ impl Index { FROM symbols ORDER BY file, start_line", )?; let rows = st.query_map([], |r| { - let params_json: String = r.get(9)?; + let params_json = r.get_ref(9)?.as_str()?; Ok(SymbolRow { file: r.get(0)?, sym: Symbol { - kind: Kind::parse(&r.get::<_, String>(1)?).unwrap_or(Kind::Function), + kind: Kind::parse(r.get_ref(1)?.as_str()?).unwrap_or(Kind::Function), name: r.get(2)?, qualified: r.get(3)?, parent: r.get(4)?, @@ -349,7 +349,7 @@ impl Index { start_line: r.get(6)?, end_line: r.get(7)?, signature: r.get(8)?, - params: serde_json::from_str::>(¶ms_json).unwrap_or_default(), + params: if params_json == "[]" { Vec::new() } else { serde_json::from_str::>(params_json).unwrap_or_default() }, returns: r.get(10)?, doc: r.get(11)?, summary: r.get(12)?, @@ -365,20 +365,7 @@ impl Index { } pub fn edges(&self) -> Result> { - let mut st = self.conn.prepare("SELECT file, src, dst, kind, line, col FROM edges")?; - let rows = st.query_map([], |r| { - Ok(( - r.get::<_, String>(0)?, - Edge { - from: r.get(1)?, - to: r.get(2)?, - kind: EdgeKind::parse(&r.get::<_, String>(3)?).unwrap_or(EdgeKind::Uses), - line: r.get(4)?, - col: r.get(5)?, - }, - )) - })?; - Ok(rows.collect::>()?) + read_edges(&self.conn) } /// Cache language-server answers: call site → definition (`""` target = outside the repo). @@ -409,13 +396,40 @@ impl Index { /// Load the whole index into memory for cross-reference queries. pub fn graph(&self) -> Result { - let mut g = Graph::new(self.files()?, self.symbols()?, self.edges()?); + let files = self.files()?; + // the two big tables on two threads: a second read-only connection reads the edges + let db = self.root.join(GITNEXT_DIR).join("index.db"); + let (syms, edges) = std::thread::scope(|sc| { + let h = sc.spawn(move || Connection::open_with_flags(&db, rusqlite::OpenFlags::SQLITE_OPEN_READ_ONLY).map_err(anyhow::Error::from).and_then(|c| read_edges(&c))); + let syms = self.symbols(); + // a locked or missing file: read them on this connection as before + let edges = h.join().ok().and_then(|r| r.ok()).map(Ok).unwrap_or_else(|| self.edges()); + (syms, edges) + }); + let mut g = Graph::new(files, syms?, edges?); g.apply_notes(¬es::load(&self.root)); g.links = self.links()?.into_iter().collect(); Ok(g) } } +fn read_edges(conn: &Connection) -> Result> { + let mut st = conn.prepare("SELECT file, src, dst, kind, line, col FROM edges")?; + let rows = st.query_map([], |r| { + Ok(( + r.get::<_, String>(0)?, + Edge { + from: r.get(1)?, + to: r.get(2)?, + kind: EdgeKind::parse(r.get_ref(3)?.as_str()?).unwrap_or(EdgeKind::Uses), + line: r.get(4)?, + col: r.get(5)?, + }, + )) + })?; + Ok(rows.collect::>()?) +} + fn insert_analysis(tx: &rusqlite::Transaction, path: &str, a: &FileAnalysis) -> Result<()> { let mut ins = tx.prepare_cached( "INSERT INTO symbols(file, kind, name, qualified, parent, trait_impl, start_line, end_line, diff --git a/crates/gitnext-ops/src/check.rs b/crates/gitnext-ops/src/check.rs index edf0f2a..a9a074c 100644 --- a/crates/gitnext-ops/src/check.rs +++ b/crates/gitnext-ops/src/check.rs @@ -1,9 +1,16 @@ //! `gitnext check`: after a change — build the project and run the tests of what changed, //! and answer with a verdict. One step for the agent instead of three (edit → build → tests), //! and the judgement comes from the compiler and the tests, not from the model. +//! +//! A test that fails is not always the change's doing: it may fail on the last commit too (a +//! test that needs a network, a permission, another machine). So the tests that failed are run +//! once more on the code as the last commit has it — the changed files are put back for that run +//! and the changes return when it ends — and a test that fails both ways is said to be not +//! caused by the change. Without this, models undid correct changes or went to "fix" the test. +use std::collections::BTreeSet; use std::fmt::Write as _; -use std::path::Path; +use std::path::{Path, PathBuf}; use std::process::{Command, Stdio}; use std::time::{Duration, Instant}; @@ -27,6 +34,31 @@ pub struct Step { pub digest: crate::digest::Digest, /// repo locations named anywhere in the output (`path:line`), in the order they came pub frames: Vec, + /// the tests of this step that fail on the last commit too; `None`: not looked at (the step + /// passed, or it is the build), or it could not be told + pub before: Option>, +} + +impl Step { + /// The tests that failed, by name; empty when the output is not a test run's. + fn failed_tests(&self) -> BTreeSet<&str> { + if self.what != "tests" || self.ok || self.timed_out || self.digest.kind != "tests" { + return BTreeSet::new(); + } + self.digest.failures.iter().map(|f| f.what.as_str()).collect() + } + + /// The failures the change is not the cause of: they are there without it too. + pub fn not_mine(&self) -> Vec<&str> { + let Some(before) = &self.before else { return Vec::new() }; + self.failed_tests().into_iter().filter(|t| before.contains(*t)).collect() + } + + /// Every test that fails here fails on the last commit too: the change broke nothing. + pub fn as_before(&self) -> bool { + let failed = self.failed_tests(); + !failed.is_empty() && self.not_mine().len() == failed.len() + } } pub struct Check { @@ -34,11 +66,221 @@ pub struct Check { pub changed: Vec, pub tests: usize, pub steps: Vec, + /// what the user should know: changes brought back after an interrupted check + pub notes: Vec, } impl Check { pub fn ok(&self) -> bool { - self.steps.iter().all(|s| s.ok) + self.steps.iter().all(|s| s.ok || s.as_before()) + } +} + +fn git(root: &Path, args: &[&str]) -> Option> { + let out = Command::new("git").args(args).current_dir(root).stdin(Stdio::null()).output().ok()?; + out.status.success().then_some(out.stdout) +} + +/// The changed files as the last commit has them, for the time of one test run. What was in +/// them is kept in `.gitnext/check-before-/` with a list, and comes back when this is +/// dropped — or at the next `check`, if the process was killed in between. +struct Before { + root: PathBuf, + dir: PathBuf, + /// (path in the repository, the file was there, what this wrote into it) + files: Vec<(String, bool, Vec)>, +} + +const BEFORE_DIR: &str = "check-before-"; +const MANIFEST: &str = "files.tsv"; +/// More changed files than this are not swapped: the check answers as it did. +const MAX_SWAPPED: usize = 300; + +fn second_of(t: std::time::SystemTime) -> u64 { + t.duration_since(std::time::UNIX_EPOCH).map(|d| d.as_secs()).unwrap_or(0) +} + +/// Waits until the clock's second is past the last write of these files, and gives that second. +/// Python keeps compiled code by the source's size and the second it was written in, other tools +/// by the time alone: a file swapped within the same second would run as the old one. +fn past_the_second_of(files: &[PathBuf]) -> u64 { + let last = files.iter().filter_map(|f| std::fs::metadata(f).and_then(|m| m.modified()).ok()).map(second_of).max().unwrap_or(0); + let limit = Instant::now() + Duration::from_secs(3); // a file dated in the future is not waited for + // the file system's clock runs a tick behind: a write just past the second is still dated in it + while second_of(std::time::SystemTime::now() - Duration::from_millis(60)) <= last && Instant::now() < limit { + std::thread::sleep(Duration::from_millis(20)); + } + last +} + +/// Writes the file so that it is dated in a later second than `after`. +fn write_later(file: &Path, bytes: &[u8], after: u64) -> std::io::Result<()> { + for _ in 0..50 { + std::fs::write(file, bytes)?; + if std::fs::metadata(file).and_then(|m| m.modified()).map(second_of).unwrap_or(u64::MAX) > after { + break; + } + std::thread::sleep(Duration::from_millis(20)); + } + Ok(()) +} + +impl Before { + fn take(root: &Path) -> Option { + if std::env::var("GITNEXT_CHECK_BEFORE").as_deref() == Ok("0") { + return None; + } + // modified and deleted files of the commit; new ones stay where they are + let listed = git(root, &["diff", "--name-status", "--no-renames", "--relative", "-z", "HEAD"])?; + let listed = String::from_utf8_lossy(&listed).into_owned(); + let mut parts = listed.split('\0'); + let mut paths = Vec::new(); + while let (Some(status), Some(path)) = (parts.next(), parts.next()) { + if matches!(status, "M" | "D" | "T") { + paths.push(path.to_string()); + } + } + if paths.is_empty() || paths.len() > MAX_SWAPPED { + return None; + } + let dir = root.join(gitnext_index::GITNEXT_DIR).join(format!("{BEFORE_DIR}{}", std::process::id())); + std::fs::create_dir_all(&dir).ok()?; + let mut before = Before { root: root.to_path_buf(), dir, files: Vec::new() }; + let mut manifest = String::new(); + let mut committed = Vec::new(); + for (n, path) in paths.iter().enumerate() { + let file = root.join(path); + let meta = std::fs::symlink_metadata(&file).ok(); + if meta.as_ref().is_some_and(|m| !m.is_file()) { + return None; // a link or a folder in a file's place: not something to write through + } + let was = git(root, &["show", &format!("HEAD:./{path}")])?; + if meta.is_some() { + std::fs::copy(&file, before.dir.join(n.to_string())).ok()?; + } + manifest.push_str(&format!("{n}\t{}\t{path}\n", u8::from(meta.is_some()))); + committed.push((path.clone(), meta.is_some(), was)); + } + // the list is on disk before the first file is touched + std::fs::write(before.dir.join(MANIFEST), manifest).ok()?; + let after = past_the_second_of(&committed.iter().map(|(path, _, _)| root.join(path)).collect::>()); + for (path, existed, was) in committed { + let file = root.join(&path); + if let Some(parent) = file.parent() { + let _ = std::fs::create_dir_all(parent); + } + if write_later(&file, &was, after).is_err() { + return None; // what was swapped so far comes back in `drop` + } + before.files.push((path, existed, was)); + } + Some(before) + } +} + +impl Drop for Before { + fn drop(&mut self) { + let after = past_the_second_of(&self.files.iter().map(|(path, _, _)| self.root.join(path)).collect::>()); + let mut kept = false; + for (n, (path, existed, was)) in self.files.iter().enumerate() { + let file = self.root.join(path); + // somebody wrote the file while the tests ran: theirs stays, ours is left in the folder + if std::fs::read(&file).ok().as_ref() != Some(was) { + kept |= *existed; + continue; + } + let back = if *existed { std::fs::read(self.dir.join(n.to_string())).and_then(|b| write_later(&file, &b, after)) } else { std::fs::remove_file(&file) }; + kept |= back.is_err(); + } + if !kept { + let _ = std::fs::remove_dir_all(&self.dir); + } + } +} + +/// Changes a killed `check` left in `.gitnext/check-before-/` are put back. +fn recover(root: &Path) -> Vec { + let mut notes = Vec::new(); + let Ok(entries) = std::fs::read_dir(root.join(gitnext_index::GITNEXT_DIR)) else { return notes }; + for dir in entries.flatten().map(|e| e.path()) { + let Some(pid) = dir.file_name().and_then(|n| n.to_str()).and_then(|n| n.strip_prefix(BEFORE_DIR)) else { continue }; + let alive = Command::new("kill").args(["-0", pid]).stdin(Stdio::null()).stderr(Stdio::null()).status().is_ok_and(|s| s.success()); + if alive && pid != std::process::id().to_string() { + continue; // another check is running its tests right now + } + let Ok(manifest) = std::fs::read_to_string(dir.join(MANIFEST)) else { + let _ = std::fs::remove_dir_all(&dir); // killed before any file was touched + continue; + }; + let mut back = Vec::new(); + for row in manifest.lines() { + let mut col = row.splitn(3, '\t'); + let (Some(n), Some(existed), Some(path)) = (col.next(), col.next(), col.next()) else { continue }; + let file = root.join(path); + // only a file that still is what the last commit has: anything else was written since + let committed = git(root, &["show", &format!("HEAD:./{path}")]); + if committed.is_none() || std::fs::read(&file).ok() != committed { + continue; + } + let done = if existed == "1" { std::fs::read(dir.join(n)).and_then(|b| std::fs::write(&file, b)) } else { std::fs::remove_file(&file) }; + if done.is_ok() { + back.push(path.to_string()); + } + } + if !back.is_empty() { + notes.push(format!("an earlier check was interrupted while it ran the tests on the last commit; your changes are back in {}", back.join(", "))); + } + let _ = std::fs::remove_dir_all(&dir); + } + notes +} + +/// What is known about a test command on a commit: the tests that fail there. Kept in +/// `.gitnext/check-before.tsv` (commit, command, test; a row without a test: the command was run), +/// so the same failing check asks once. +fn known_before(root: &Path, commit: &str, command: &str) -> Option> { + let text = std::fs::read_to_string(root.join(gitnext_index::GITNEXT_DIR).join("check-before.tsv")).ok()?; + let rows: Vec<&str> = text.lines().filter_map(|l| l.strip_prefix(commit)?.strip_prefix('\t')?.strip_prefix(command)?.strip_prefix('\t')).collect(); + (!rows.is_empty()).then(|| rows.into_iter().filter(|t| !t.is_empty()).map(String::from).collect()) +} + +fn remember_before(root: &Path, commit: &str, command: &str, failed: &BTreeSet) { + let file = root.join(gitnext_index::GITNEXT_DIR).join("check-before.tsv"); + // rows of other commits are of no use any more + let mut text: String = std::fs::read_to_string(&file).unwrap_or_default().lines().filter(|l| l.starts_with(commit)).map(|l| format!("{l}\n")).collect(); + for test in std::iter::once("").chain(failed.iter().map(String::as_str)) { + text.push_str(&format!("{commit}\t{command}\t{test}\n")); + } + let _ = std::fs::write(file, text); +} + +/// For the test steps that failed: which of their failures are there on the last commit too. +fn look_before(root: &Path, g: &Graph, steps: &mut [Step], timeout: Duration) { + let failing: Vec = (0..steps.len()).filter(|&i| !steps[i].failed_tests().is_empty()).collect(); + let Some(commit) = git(root, &["rev-parse", "HEAD"]).map(|b| String::from_utf8_lossy(&b).trim().to_string()).filter(|c| !c.is_empty()) else { return }; + let command_of = |s: &Step| s.command.replace(['\t', '\n'], " "); + for &i in &failing { + steps[i].before = known_before(root, &commit, &command_of(&steps[i])); + } + let unknown: Vec = failing.into_iter().filter(|&i| steps[i].before.is_none()).collect(); + if unknown.is_empty() { + return; + } + let Some(swapped) = Before::take(root) else { return }; + let runs: Vec = unknown.iter().map(|&i| run(root, g, "tests", &steps[i].command, timeout)).collect(); + drop(swapped); + for (i, was) in unknown.into_iter().zip(runs) { + // passed, or failed as a test run does; a build that breaks or a timeout tells nothing + let failed: Option> = if was.ok { + Some(BTreeSet::new()) + } else { + let names: BTreeSet = was.failed_tests().into_iter().map(String::from).collect(); + (!names.is_empty()).then_some(names) + }; + if let Some(failed) = failed { + remember_before(root, &commit, &command_of(&steps[i]), &failed); + steps[i].before = Some(failed); + } } } @@ -126,7 +368,9 @@ pub fn test_commands(g: &Graph, root: &Path, tests: &[TestRef]) -> Vec { } pub fn run(root: &Path, g: &Graph, what: &'static str, command: &str, timeout: Duration) -> Step { - let log = std::env::temp_dir().join(format!("gitnext-check-{}-{}.log", std::process::id(), what)); + // one file per run: two checks of one process (a server's, a test's) must not share it + static RUNS: std::sync::atomic::AtomicUsize = std::sync::atomic::AtomicUsize::new(0); + let log = std::env::temp_dir().join(format!("gitnext-check-{}-{}-{}.log", std::process::id(), what, RUNS.fetch_add(1, std::sync::atomic::Ordering::Relaxed))); let started = Instant::now(); let (mut ok, mut timed_out) = (false, false); if let Ok(out) = std::fs::File::create(&log) { @@ -166,11 +410,12 @@ pub fn run(root: &Path, g: &Graph, what: &'static str, command: &str, timeout: D f.file = Some(rel); } } - Step { what, command: command.to_string(), ok, timed_out, seconds: started.elapsed().as_secs_f32(), output, digest, frames } + Step { what, command: command.to_string(), ok, timed_out, seconds: started.elapsed().as_secs_f32(), output, digest, frames, before: None } } /// Build, then the tests most likely to fail for every changed symbol. Stops at a failed build. pub fn check(root: &Path, g: &Graph, timeout: Duration) -> Check { + let notes = recover(root); let changed = changed_symbols(root, g); let mut files: Vec<&str> = changed.iter().map(|&i| g.syms[i].file.as_str()).collect(); files.sort_unstable(); @@ -179,7 +424,7 @@ pub fn check(root: &Path, g: &Graph, timeout: Duration) -> Check { for c in build_commands(root, &files) { steps.push(run(root, g, "build", &c, timeout)); if !steps.last().is_some_and(|s| s.ok) { - return Check { changed, tests: 0, steps }; + return Check { changed, tests: 0, steps, notes }; } } let mut tests: Vec = Vec::new(); @@ -195,32 +440,48 @@ pub fn check(root: &Path, g: &Graph, timeout: Duration) -> Check { for c in test_commands(g, root, &tests) { steps.push(run(root, g, "tests", &c, timeout)); } - Check { changed, tests: tests.len(), steps } + look_before(root, g, &mut steps, timeout); + Check { changed, tests: tests.len(), steps, notes } } pub fn render(g: &Graph, c: &Check) -> String { + let notes: String = c.notes.iter().map(|n| format!("note: {n}\n")).collect(); if c.changed.is_empty() { - return "nothing to check: no code differs from the last commit\n".to_string(); + return format!("{notes}nothing to check: no code differs from the last commit\n"); } let names: Vec<&str> = c.changed.iter().take(8).map(|&i| g.short_name(i)).collect(); let mut s = format!("check: {} changed ({}{})\n", crate::changes::plural(c.changed.len(), "symbol"), names.join(", "), if c.changed.len() > 8 { " …" } else { "" }); + let list = |names: &[&str]| format!("{}{}", names.iter().take(5).copied().collect::>().join(", "), if names.len() > 5 { " …" } else { "" }); for st in &c.steps { - let state = if st.ok { "ok" } else if st.timed_out { "TIMED OUT" } else { "FAILED" }; + let not_mine = st.not_mine(); + let state = if st.ok { "ok" } else if st.timed_out { "TIMED OUT" } else if st.as_before() { "AS BEFORE" } else { "FAILED" }; let _ = writeln!(s, "{:<5} {:<9} {:>5.1}s {}", st.what, state, st.seconds, st.command); - if !st.ok { + if st.as_before() { + // no details: they are not this change's to fix + let _ = writeln!(s, " {} without your change too — not caused by it, leave {}: {}", if not_mine.len() == 1 { "1 test fails".to_string() } else { format!("{} tests fail", not_mine.len()) }, if not_mine.len() == 1 { "it" } else { "them" }, list(¬_mine)); + } else if !st.ok { // what failed, where, the message — not the tool's whole output let text = if st.digest.failures.is_empty() { st.output.clone() } else { crate::digest::render(&st.digest, 5) }; for l in text.lines() { let _ = writeln!(s, " {l}"); } + if !not_mine.is_empty() { + let _ = writeln!(s, " of these, failing without your change too (not caused by it): {}", list(¬_mine)); + } else if st.before.is_some() && !st.failed_tests().is_empty() { + let _ = writeln!(s, " without your change {} — the change causes this", if st.failed_tests().len() == 1 { "this test passes" } else { "these tests pass" }); + } } } + s.push_str(¬es); let file = &g.syms[c.changed[0]].file; - if let Some(bad) = c.steps.iter().find(|x| !x.ok) { + let as_before: Vec<&str> = c.steps.iter().filter(|x| x.as_before()).flat_map(|x| x.not_mine()).collect(); + if let Some(bad) = c.steps.iter().find(|x| !x.ok && !x.as_before()) { let _ = writeln!(s, "verdict: FAILED — {} ({})", bad.what, if bad.what == "build" { "the tests were not run" } else { "see the output above" }); } else if c.steps.iter().all(|x| x.what != "tests") { let _ = writeln!(s, "verdict: builds, but no test reaches the changed code through the call graph — run the project's test suite"); + } else if !as_before.is_empty() { + let _ = writeln!(s, "verdict: ok — builds, and your change breaks no test ({} before it too: {})", if as_before.len() == 1 { "1 failed".to_string() } else { format!("{} failed", as_before.len()) }, list(&as_before)); } else { let _ = writeln!(s, "verdict: ok — builds, {} pass", crate::changes::plural(c.tests, "test")); let _ = writeln!(s, "note: {}.", crate::trust::tests_note(file)); diff --git a/crates/gitnext-ops/src/edit.rs b/crates/gitnext-ops/src/edit.rs index 69a1a45..da1aa91 100644 --- a/crates/gitnext-ops/src/edit.rs +++ b/crates/gitnext-ops/src/edit.rs @@ -161,6 +161,83 @@ pub fn edit_symbol(root: &Path, g: &Graph, i: usize, kind: EditKind, code: &str, Ok(EditResult { file: r.file.clone(), lines: new_range, changes }) } +/// `replace` was given a piece of the code where the name of a symbol belongs: models used to +/// text edits write the line they want changed (`if a == b {`) or the first line of the function +/// (`def f(x):`). In the agent runs 37 of 129 `replace` calls were this, and all were refused. +pub fn is_code(q: &str) -> bool { + let q = q.trim(); + q.contains(char::is_whitespace) || q.contains(['(', '=']) +} + +/// The first line of `code` declares something (a function, a class): the code is a whole symbol. +fn declares(code: &str) -> Option<&str> { + const WORDS: [&str; 16] = ["def ", "async ", "fn ", "pub ", "func ", "class ", "function ", "public ", "private ", "protected ", "static ", "impl ", "struct ", "export ", "@", "#["]; + let first = code.lines().map(str::trim).find(|l| !l.is_empty() && !l.starts_with("//") && !l.starts_with("#[") && !l.starts_with('@') && !l.starts_with("/*") && !l.starts_with('*')); + first.filter(|l| WORDS.iter().any(|w| l.starts_with(w))) +} + +fn has_word(line: &str, word: &str) -> bool { + let is_word = |c: char| c.is_alphanumeric() || c == '_'; + line.match_indices(word).any(|(i, _)| !line[..i].chars().next_back().is_some_and(is_word) && !line[i + word.len()..].chars().next().is_some_and(is_word)) +} + +/// The edit meant by `replace` with text of the code as the name (`is_code`). The text must stand +/// in one place. When `code` is a whole function or class, the symbol around that place is +/// replaced, as if it had been named; otherwise the text itself is replaced with `code`. +pub fn replace_text(root: &Path, g: &Graph, old: &str, code: &str, force: bool) -> Result { + const HOW: &str = "replace takes the name of a function or class and its whole new code"; + let old = old.trim(); + let short: String = old.lines().next().unwrap_or("").chars().take(60).collect(); + if old.is_empty() || code.trim().is_empty() { + bail!("{HOW}"); + } + // every place the text stands in: (file, byte offset, line) + let mut places: Vec<(&str, usize, usize)> = Vec::new(); + let mut texts: BTreeMap<&str, String> = BTreeMap::new(); + for f in &g.files { + let Ok(text) = std::fs::read_to_string(root.join(&f.path)) else { continue }; + for (at, _) in text.match_indices(old) { + places.push((f.path.as_str(), at, text[..at].matches('\n').count() + 1)); + } + if places.last().is_some_and(|p| p.0 == f.path) { + texts.insert(f.path.as_str(), text); + } + } + // the innermost symbol around a line + let around = |file: &str, line: usize| { + let inside = g.syms.iter().enumerate().filter(|(_, s)| s.file == file && s.sym.start_line as usize <= line && line <= s.sym.end_line as usize && s.sym.kind != gitnext_parse::Kind::Module); + inside.min_by_key(|(_, s)| s.sym.end_line - s.sym.start_line).map(|(i, _)| i) + }; + let name_at = |file: &str, line: usize| around(file, line).map(|i| format!(" (in {}@{})", g.short_name(i), g.syms[i].sym.start_line)).unwrap_or_default(); + if places.is_empty() { + bail!("`{short}` is not the name of a function or class, and no line of the code has this text; {HOW}"); + } + if let Some(first) = declares(code) { + // a whole symbol: the one the text stands in, when the code declares that name + let mut named: Vec = places.iter().filter_map(|(f, _, l)| around(f, *l)).filter(|i| has_word(first, &g.syms[*i].sym.name)).collect(); + named.dedup(); + return match named[..] { + [i] => edit_symbol(root, g, i, EditKind::Replace, code, force), + [] => bail!("the code is a whole function or class, but `{short}` stands in another one{}; {HOW}", name_at(places[0].0, places[0].2)), + _ => bail!("`{short}` is in {} symbols: {}; name one — {HOW}", named.len(), named.iter().take(6).map(|i| format!("{}@{}", g.short_name(*i), g.syms[*i].sym.start_line)).collect::>().join(", ")), + }; + } + if places.len() > 1 { + let list: Vec = places.iter().take(6).map(|(f, _, l)| format!("{f}:{l}{}", name_at(f, *l))).collect(); + bail!("`{short}` is in {} places: {}; name the function to change — {HOW}", places.len(), list.join(", ")); + } + let (file, at, line) = places[0]; + let old_text = &texts[file]; + let line_start = old_text[..at].rfind('\n').map_or(0, |i| i + 1); + let indent = &old_text[line_start..at]; + // from the start of its line the new text takes the line's indent; inside a line it goes in as it is + let (from, new) = if indent.trim().is_empty() { (line_start, reindent(code, indent).join("\n")) } else { (at, code.trim().to_string()) }; + let new_text = format!("{}{new}{}", &old_text[..from], &old_text[at + old.len()..]); + let changes = write_checked(root, file, old_text, &new_text, force)?; + crate::oplog::record(root, "replace", &format!("{file}:{line}"), &[(file.to_string(), old_text.clone(), new_text)]); + Ok(EditResult { file: file.to_string(), lines: (line, line + new.lines().count().max(1) - 1), changes }) +} + #[derive(Debug, Serialize, Default)] pub struct RenameReport { pub old: String, diff --git a/crates/gitnext-ops/src/learn.rs b/crates/gitnext-ops/src/learn.rs index d2f09db..ec616df 100644 --- a/crates/gitnext-ops/src/learn.rs +++ b/crates/gitnext-ops/src/learn.rs @@ -12,6 +12,7 @@ use anyhow::{bail, Result}; use gitnext_index::{Graph, TestMap}; mod go; +mod java; mod js; mod python; mod rust; @@ -40,6 +41,7 @@ type Learner = fn(&Path, &Graph) -> Result; const LANGUAGES: &[(&str, &[&str], Learner)] = &[ ("Python", &[".py"], python::run), ("Go", &[".go"], go::run), ("Rust", &[".rs"], rust::run), ("JavaScript/TypeScript", &[".ts", ".tsx", ".mts", ".js", ".jsx", ".mjs", ".cjs"], js::run), + ("Java", &[".java"], java::run), ]; pub struct Learned { diff --git a/crates/gitnext-ops/src/learn/java.rs b/crates/gitnext-ops/src/learn/java.rs new file mode 100644 index 0000000..7212c7f --- /dev/null +++ b/crates/gitnext-ops/src/learn/java.rs @@ -0,0 +1,528 @@ +//! Java: Maven's own test run with the JaCoCo agent, whose data is taken and reset around every +//! test by a listener of the JUnit Platform, so each test gets the lines it ran itself. Measured on +//! JSON-java and jsoup: the map finds the failing tests of 99% and 94% of broken functions (the +//! call graph: 71% and 29%) for 2–3.5× a plain test run. +//! +//! Three small Java classes do the part that has to run inside a JVM (`learn/java/*.java`); they +//! are compiled with the project's `javac` into `.gitnext/` and removed after the run. A class's +//! static blocks run once in a JVM, in whichever test touches the class first; what they run is +//! measured apart and booked to every test that runs a line of the class's file. +//! +//! Maven only, and tests that run on the JUnit Platform: JUnit 5, and JUnit 4 under a surefire +//! that runs it there (3.6 and newer). Gradle and TestNG are not learned. The JaCoCo jars are +//! taken from the local Maven repository; nothing is downloaded here. + +use std::collections::{BTreeMap, BTreeSet, HashMap, HashSet}; +use std::path::{Path, PathBuf}; +use std::process::{Command, Stdio}; +use std::time::{Duration, Instant}; + +use anyhow::{bail, Context, Result}; +use gitnext_index::Graph; + +use super::{owners_at, Run}; + +const JACOCO: &str = "0.8.14"; +/// The ASM that JaCoCo of that version is built with. +const ASM: &str = "9.9"; +/// The JUnit Platform named when the local repository has none to compile the listener against. +const PLATFORM: &str = "1.14.4"; +const TEST_LIMIT: Duration = Duration::from_secs(3 * 3600); +const STEP_LIMIT: Duration = Duration::from_secs(1800); +/// How many names a note lists before it says "and N more". +const NAMES: usize = 5; +/// The copy of `pom.xml` the tests are run from; it has to stand next to the original. +const POM: &str = ".gitnext-pom.xml"; + +const SOURCES: [(&str, &str); 4] = [ + ("Dump", include_str!("java/Dump.java")), + ("Listener", include_str!("java/Listener.java")), + ("Analyze", include_str!("java/Analyze.java")), + ("Inits", include_str!("java/Inits.java")), +]; + +pub(super) fn run(root: &Path, g: &Graph) -> Result { + run_with("mvn", root, g) +} + +/// The compiled helpers, the coverage data and the copy of the pom; removed however `run` ends. +struct Scratch(PathBuf, PathBuf); + +impl Drop for Scratch { + fn drop(&mut self) { + let _ = std::fs::remove_dir_all(&self.0); + let _ = std::fs::remove_file(&self.1); + } +} + +/// What a command printed (stdout and stderr together) and how it ended. +struct Ran { + ok: bool, + timed_out: bool, + text: String, +} + +fn timed(cmd: &mut Command, log: &Path, limit: Duration) -> Result { + let out = std::fs::File::create(log)?; + let err = out.try_clone()?; + let mut child = cmd.stdin(Stdio::null()).stdout(out).stderr(err).spawn()?; + let started = Instant::now(); + let (ok, timed_out) = loop { + match child.try_wait()? { + Some(status) => break (status.success(), false), + None if started.elapsed() < limit => std::thread::sleep(Duration::from_millis(20)), + None => { + let _ = child.kill(); + let _ = child.wait(); + break (false, true); + } + } + }; + let text = std::fs::read(log).map(|b| String::from_utf8_lossy(&b).into_owned()).unwrap_or_default(); + let _ = std::fs::remove_file(log); + Ok(Ran { ok, timed_out, text }) +} + +/// The last lines of a build log that say what went wrong: Maven's `[ERROR]` lines, else the tail. +fn why_failed(text: &str) -> String { + let errors: Vec<&str> = text.lines().filter(|l| l.starts_with("[ERROR]") && l.len() > 8).take(4).collect(); + if errors.is_empty() { + text.lines().rev().filter(|l| !l.trim().is_empty()).take(4).collect::>().into_iter().rev().collect::>().join("\n") + } else { + errors.join("\n") + } +} + +fn some(names: &[String]) -> String { + let mut s = names.iter().take(NAMES).cloned().collect::>().join(", "); + if names.len() > NAMES { + s.push_str(&format!(" and {} more", names.len() - NAMES)); + } + s +} + +/// Learning can start: a single-module Maven project, and a `mvn` and a `javac` that run. +fn ready(mvn: &str, root: &Path) -> Result { + let Ok(pom) = std::fs::read_to_string(root.join("pom.xml")) else { + if ["build.gradle", "build.gradle.kts"].iter().any(|f| root.join(f).exists()) { + bail!("the project builds with Gradle; learn-tests knows Maven only"); + } + bail!("no pom.xml at the root of the repository"); + }; + if pom.contains("") { + bail!("a Maven project of several modules is not learned yet"); + } + for (tool, flag, what) in [(mvn, "--version", "install Maven (https://maven.apache.org)"), ("javac", "-version", "install a JDK")] { + match Command::new(tool).arg(flag).stdin(Stdio::null()).output() { + Ok(o) if o.status.success() => {} + Ok(o) => bail!("`{tool} {flag}` failed: {}", why_failed(&String::from_utf8_lossy(&o.stderr))), + Err(_) => bail!("`{tool}` is not in PATH: {what} to learn which test runs which function"), + } + } + Ok(pom) +} + +/// The local Maven repository: the folder above a jar of the test classpath that holds Maven's +/// own plugins (`org/apache/maven`), else `~/.m2/repository`. +fn repository(classpath: &[PathBuf]) -> PathBuf { + let above = classpath.iter().filter(|p| p.extension().is_some_and(|e| e == "jar")).find_map(|jar| jar.ancestors().skip(3).find(|a| a.join("org/apache/maven").is_dir()).map(Path::to_path_buf)); + above.unwrap_or_else(|| PathBuf::from(std::env::var_os("HOME").or_else(|| std::env::var_os("USERPROFILE")).unwrap_or_default()).join(".m2").join("repository")) +} + +/// The versions of an artifact the repository holds, newest last (by their numbers). +fn versions(repo: &Path, group: &str, artifact: &str) -> Vec { + let dir = repo.join(group.replace('.', "/")).join(artifact); + let mut found: Vec = std::fs::read_dir(dir).into_iter().flatten().flatten().filter_map(|e| e.file_name().into_string().ok()).collect(); + found.retain(|v| jar(repo, group, artifact, v, "").exists()); + found.sort_by_key(|v| v.split(|c: char| !c.is_ascii_digit()).filter_map(|n| n.parse::().ok()).collect::>()); + found +} + +fn jar(repo: &Path, group: &str, artifact: &str, version: &str, classifier: &str) -> PathBuf { + let dash = if classifier.is_empty() { String::new() } else { format!("-{classifier}") }; + repo.join(group.replace('.', "/")).join(artifact).join(version).join(format!("{artifact}-{version}{dash}.jar")) +} + +/// A copy of `pom.xml` whose surefire takes `${gitnext.argLine}` (the agent) and `${gitnext.cp}` +/// (the listener) on top of what the project sets itself. +fn learning_pom(pom: &str) -> Option { + const ARG: &str = "${gitnext.argLine}"; + const ELEMENTS: &str = ""; + let mut p = pom.to_string(); + let block = p.find("maven-surefire-plugin").and_then(|a| p[a..].find("").map(|e| (a, a + e))); + match block { + Some((a, e)) if p[a..e].contains("") => { + let mut b = p[a..e].to_string(); + match b.find("") { + Some(i) => b.insert_str(i, &format!(" {ARG}")), + None => b = b.replacen("", &format!("{ARG}"), 1), + } + if !b.contains(ELEMENTS) { + b = b.replacen("", &format!("{ELEMENTS}"), 1); + } + p.replace_range(a..e, &b); + } + _ => { + let plugin = format!( + "org.apache.maven.pluginsmaven-surefire-plugin{ARG}{ELEMENTS}" + ); + match p.find("").and_then(|b| p[b..].find("").map(|i| b + i + "".len())) { + Some(i) => p.insert_str(i, &plugin), + None => { + let end = p.rfind("")?; + p.insert_str(end, &format!("{plugin}")); + } + } + } + } + // every list of extra classpath elements (a profile's too: it replaces the main one) gets the listener + Some(p.replace(ELEMENTS, &format!("{ELEMENTS}${{gitnext.cp}}"))) +} + +/// `package a.b.c;` of a Java file. +fn package_of(text: &str) -> &str { + text.lines().map(str::trim).find_map(|l| l.strip_prefix("package ")?.split(';').next()).map(str::trim).unwrap_or("") +} + +/// What the agent instruments: the classes under the package all of the project's code shares. +fn includes<'a>(packages: impl Iterator) -> String { + let mut common: Option> = None; + for p in packages { + let parts: Vec<&str> = p.split('.').filter(|x| !x.is_empty()).collect(); + common = Some(match common { + None => parts, + Some(c) => c.iter().zip(&parts).take_while(|(a, b)| a == b).map(|(a, _)| *a).collect(), + }); + } + match common { + Some(c) if !c.is_empty() => format!("{}.*", c.join(".")), + _ => "*".to_string(), + } +} + +/// What `Analyze` wrote: the dump's name → source file (`org/x/A.java`) → lines that ran. +fn ran_lines(tsv: &str) -> HashMap<&str, Vec<(&str, Vec)>> { + let mut by_dump: HashMap<&str, Vec<(&str, Vec)>> = HashMap::new(); + for row in tsv.lines() { + let mut col = row.split('\t'); + if let (Some(n), Some(file), Some(lines)) = (col.next(), col.next(), col.next()) { + by_dump.entry(n).or_default().push((file, lines.split(',').filter_map(|l| l.parse().ok()).collect())); + } + } + by_dump +} + +/// The JVM tools the run needs, found in the local Maven repository. +struct Jars { + agent: PathBuf, + analyze: Vec, + /// what the listener is compiled against, on top of the test classpath + platform: Vec, +} + +/// `platform`: the version of the JUnit Platform on the test classpath, when it is there. +fn jars(repo: &Path, platform: Option<&str>) -> Result { + const GROUP: &str = "org.junit.platform"; + let agent = jar(repo, "org.jacoco", "org.jacoco.agent", JACOCO, "runtime"); + let analyze: Vec = + std::iter::once(jar(repo, "org.jacoco", "org.jacoco.core", JACOCO, "")).chain(["asm", "asm-commons", "asm-tree"].map(|a| jar(repo, "org.ow2.asm", a, ASM, ""))).collect(); + // the listener is only compiled against these; surefire brings its own, often of another version + let all = |v: &str| ["junit-platform-launcher", "junit-platform-engine", "junit-platform-commons"].map(|a| jar(repo, GROUP, a, v, "")); + let have = |v: &str| all(v).iter().all(|j| j.exists()); + let version = platform.filter(|v| have(v)).map(String::from).or_else(|| versions(repo, GROUP, "junit-platform-launcher").into_iter().rev().find(|v| have(v))); + let mut get = Vec::new(); + if !analyze.iter().all(|j| j.exists()) { + get.push(format!("org.jacoco:org.jacoco.core:{JACOCO}")); + } + if !agent.exists() { + get.push(format!("org.jacoco:org.jacoco.agent:{JACOCO}:jar:runtime")); + } + if version.is_none() { + get.push(format!("{GROUP}:junit-platform-launcher:{}", platform.unwrap_or(PLATFORM))); + } + if !get.is_empty() { + let commands: Vec = get.iter().map(|a| format!("mvn dependency:get -Dartifact={a}")).collect(); + bail!("what measures the lines a test runs (JaCoCo {JACOCO}, the JUnit Platform launcher) is not in the local Maven repository; get it once: {}", commands.join(" && ")); + } + Ok(Jars { agent, analyze, platform: version.map(|v| all(&v).to_vec()).unwrap_or_default() }) +} + +fn javac(dir: &Path, names: &[&str], classpath: &[PathBuf]) -> Result { + let (src, out) = (dir.join("src").join("gitnextlearn"), dir.join("classes")); + std::fs::create_dir_all(&src)?; + std::fs::create_dir_all(&out)?; + let mut cmd = Command::new("javac"); + cmd.args(["-nowarn", "--release", "11", "-d"]).arg(&out); + if !classpath.is_empty() { + cmd.arg("-cp").arg(std::env::join_paths(classpath)?); + } + for name in names { + let file = src.join(format!("{name}.java")); + std::fs::write(&file, SOURCES.iter().find(|(n, _)| n == name).map(|(_, text)| *text).unwrap_or_default())?; + cmd.arg(file); + } + let ran = timed(&mut cmd, &dir.join("javac.log"), STEP_LIMIT)?; + if !ran.ok { + bail!("javac could not compile the helper that splits coverage by test (a JDK 11 or newer is needed):\n{}", why_failed(&ran.text)); + } + Ok(out) +} + +/// The dumps of a directory as lines by source file: runs `Analyze` over it. +fn analyze(root: &Path, classes: &Path, jars: &Jars, dumps: &Path) -> Result { + let out = dumps.join("lines.tsv"); + let classpath = std::env::join_paths(std::iter::once(classes.to_path_buf()).chain(jars.analyze.iter().cloned()))?; + let mut cmd = Command::new("java"); + cmd.arg("-cp").arg(classpath).arg("gitnextlearn.Analyze").arg(root.join("target").join("classes")).arg(dumps).arg(&out).current_dir(root); + let ran = timed(&mut cmd, &dumps.join("analyze.log"), STEP_LIMIT)?; + if !ran.ok { + bail!("reading the coverage data failed:\n{}", why_failed(&ran.text)); + } + Ok(std::fs::read_to_string(&out).unwrap_or_default()) +} + +fn run_with(mvn: &str, root: &Path, g: &Graph) -> Result { + let pom = ready(mvn, root)?; + let started = Instant::now(); + let root_abs = root.canonicalize().unwrap_or_else(|_| root.to_path_buf()); + if root_abs.to_string_lossy().contains(char::is_whitespace) { + bail!("the path of the repository has a space in it; the JVM options of a Maven test run cannot carry it"); + } + // the Java files of the index by what the JVM calls them: `org/x/A.java` (package + file name) + let owner_of = owners_at(g, true); + let (mut by_jvm_name, mut packages): (HashMap, Vec) = (HashMap::new(), Vec::new()); + let mut files: Vec<&str> = g.files.iter().map(|f| f.path.as_str()).filter(|f| f.ends_with(".java")).collect(); + files.sort_by_key(|f| (!f.contains("src/main/"), *f)); // the code first: a test helper of the same name does not shadow it + for file in files { + let text = std::fs::read_to_string(root.join(file)).unwrap_or_default(); + let package = package_of(&text); + let name = file.rsplit('/').next().unwrap_or(file); + by_jvm_name.entry(if package.is_empty() { name.to_string() } else { format!("{}/{name}", package.replace('.', "/")) }).or_insert(file); + if owner_of.contains_key(file) && file.contains("src/main/") { + packages.push(package.to_string()); + } + } + if packages.is_empty() { + bail!("the index has no Java function under src/main/"); + } + let includes = includes(packages.iter().map(String::as_str)); + // the tests of the index: (file, method) + let tests: HashSet<(&str, &str)> = g.syms.iter().filter(|s| s.sym.test && s.file.ends_with(".java")).map(|s| (s.file.as_str(), s.sym.name.as_str())).collect(); + + let dir = root_abs.join(".gitnext").join(format!("learn-java-{}", std::process::id())); + let scratch = Scratch(dir.clone(), root.join(POM)); + std::fs::create_dir_all(&dir)?; + let cp_file = dir.join("test-cp.txt"); + let mut cmd = Command::new(mvn); + cmd.args(["-q", "-B", "dependency:build-classpath", "-Dmdep.includeScope=test"]).arg(format!("-Dmdep.outputFile={}", cp_file.display())).current_dir(root); + let ran = timed(&mut cmd, &dir.join("cp.log"), STEP_LIMIT).with_context(|| format!("running `{mvn} dependency:build-classpath`"))?; + let Ok(listed) = std::fs::read_to_string(&cp_file) else { + bail!("`{mvn} dependency:build-classpath` failed:\n{}", why_failed(&ran.text)); + }; + let classpath: Vec = std::env::split_paths(listed.trim()).collect(); + // JUnit 5 has the platform on the test classpath; JUnit 4 gets it from surefire 3.6 and newer + let platform = classpath.iter().find_map(|p| p.file_name()?.to_str()?.strip_prefix("junit-platform-engine-")?.strip_suffix(".jar").map(String::from)); + let jars = jars(&repository(&classpath), platform.as_deref())?; + + let listener = javac(&dir.join("listener"), &["Dump", "Listener"], &classpath.iter().chain(&jars.platform).cloned().collect::>())?; + std::fs::create_dir_all(listener.join("META-INF/services"))?; + std::fs::write(listener.join("META-INF/services/org.junit.platform.launcher.TestExecutionListener"), "gitnextlearn.Listener\n")?; + let analyzer = javac(&dir.join("analyze"), &["Analyze"], &jars.analyze)?; + let inits = javac(&dir.join("inits"), &["Dump", "Inits"], &[])?; + + let Some(copy) = learning_pom(&pom) else { bail!("pom.xml has no ") }; + std::fs::write(&scratch.1, copy)?; + let dumps = dir.join("tests"); + let agent = format!("-javaagent:{}=output=none,includes={includes},jmx=false", jars.agent.display()); + let mut cmd = Command::new(mvn); + cmd.args(["-B", "-f", POM, "test", "-Djacoco.skip=true"]) + .arg(format!("-Dgitnext.argLine={agent} -Dgitnext.dir={}", dumps.display())) + .arg(format!("-Dgitnext.cp={}", listener.display())) + .current_dir(root); + let test_run = timed(&mut cmd, &dir.join("test.log"), TEST_LIMIT).with_context(|| format!("running `{mvn} test`"))?; + let Ok(index) = std::fs::read_to_string(dumps.join("index.tsv")) else { + if test_run.timed_out { + bail!("`{mvn} test` with the coverage agent took longer than {} hours", TEST_LIMIT.as_secs() / 3600); + } + if platform.is_none() && test_run.text.contains("Tests run:") { + bail!("the tests ran, but not on the JUnit Platform: JUnit 4 under a surefire older than 3.6, and TestNG, are not learned"); + } + bail!("`{mvn} test` with the coverage agent recorded no test:\n{}", why_failed(&test_run.text)); + }; + let lines = analyze(root, &analyzer, &jars, &dumps)?; + let by_dump = ran_lines(&lines); + + // what initializing each class of the project runs, by the class's file + let init_dir = dir.join("inits-data"); + std::fs::create_dir_all(&init_dir)?; + let rest: Vec = classpath.iter().filter(|p| p.extension().is_some_and(|e| e == "jar")).cloned().collect(); + let mut cmd = Command::new("java"); + cmd.arg(&agent) + .arg(format!("-Dgitnext.dir={}", init_dir.display())) + .arg("-cp") + .arg(std::env::join_paths(std::iter::once(inits).chain(classpath.iter().cloned()))?) + .arg("gitnextlearn.Inits") + .arg(root_abs.join("target").join("classes")) + .arg(&init_dir) + .arg(std::env::join_paths(&rest)?) + .current_dir(root); + let mut notes = Vec::new(); + let mut init_of: HashMap<&str, BTreeSet<(&str, u32)>> = HashMap::new(); // a class's file → (file, line) its initialization runs + let init_run = timed(&mut cmd, &dir.join("inits.log"), STEP_LIMIT)?; + let init_names = std::fs::read_to_string(init_dir.join("inits.tsv")).unwrap_or_default(); + let init_lines = if init_names.is_empty() { String::new() } else { analyze(root, &analyzer, &jars, &init_dir)? }; + if init_names.is_empty() { + notes.push(format!("Java: what the classes' static blocks run was not measured ({})", why_failed(&init_run.text).lines().next().unwrap_or("no output"))); + } + let init_dumps = ran_lines(&init_lines); + for row in init_names.lines() { + let Some((n, class)) = row.split_once('\t') else { continue }; + let outer = class.split('$').next().unwrap_or(class).replace('.', "/") + ".java"; + let (Some(file), Some(ran)) = (by_jvm_name.get(&outer), init_dumps.get(format!("init-{n}").as_str())) else { continue }; + for (f, ls) in ran { + if let Some(f) = by_jvm_name.get(*f) { + init_of.entry(file).or_default().extend(ls.iter().map(|l| (*f, *l))); + } + } + } + + // a test's lines: its own dumps, and what its class ran around the tests (`@BeforeAll`, static blocks) + let mut of_test: BTreeMap<(&str, &str), BTreeSet<(&str, u32)>> = BTreeMap::new(); + let mut of_class: HashMap<&str, BTreeSet<(&str, u32)>> = HashMap::new(); + let mut failing = BTreeSet::new(); + for row in index.lines() { + let col: Vec<&str> = row.split('\t').collect(); + let [n, class, method, failed] = col[..] else { continue }; + let ran = by_dump.get(n).into_iter().flatten().filter_map(|(f, ls)| by_jvm_name.get(*f).map(|f| (*f, ls))).flat_map(|(f, ls)| ls.iter().map(move |l| (f, *l))); + if method.is_empty() { + of_class.entry(class).or_default().extend(ran); + } else { + of_test.entry((class, method)).or_default().extend(ran); + if failed == "1" { + failing.insert(format!("{}.{method}", class.rsplit('.').next().unwrap_or(class))); + } + } + } + let mut pairs = BTreeSet::new(); + let mut unknown = BTreeSet::new(); + for ((class, method), mut ran) in of_test.clone() { + let outer = class.split('$').next().unwrap_or(class); + let test_file = by_jvm_name.get(&(outer.replace('.', "/") + ".java")).copied().filter(|f| tests.contains(&(*f, method))); + let Some(test_file) = test_file else { + // inherited from a class in another file, or made at run time + unknown.insert(format!("{}.{method}", class.rsplit('.').next().unwrap_or(class))); + continue; + }; + ran.extend(of_class.get(class).into_iter().flatten().copied()); + let touched: BTreeSet<&str> = ran.iter().map(|(f, _)| *f).collect(); + for f in touched { + ran.extend(init_of.get(f).into_iter().flatten().copied()); + } + let name = format!("{}::{method}", class.rsplit('.').next().unwrap_or(class).replace('$', "::")); + for (f, l) in ran { + if let Some(Some(i)) = owner_of.get(f).and_then(|o| o.get(l as usize)) { + pairs.insert((*i, test_file.to_string(), name.clone())); + } + } + } + if test_run.timed_out { + notes.push(format!("Java: the test run took longer than {} hours and was stopped; the map holds the tests that ran until then", TEST_LIMIT.as_secs() / 3600)); + } + if !failing.is_empty() { + notes.push(format!("Java: {} tests fail (what they ran is kept): {}", failing.len(), some(&failing.into_iter().collect::>()))); + } + if !unknown.is_empty() { + notes.push(format!( + "Java: {} tests have no method of that name in their class's file (inherited or made at run time) and are not in the map: {}", + unknown.len(), + some(&unknown.iter().cloned().collect::>()) + )); + } + Ok(Run { + source: "jacoco", + command: format!("{mvn} test with the JaCoCo {JACOCO} agent (includes={includes}), its data taken around each of {} tests", of_test.len()), + seconds: started.elapsed().as_secs_f32(), + tests_failed: !test_run.ok, + pairs, + notes, + }) +} + +#[cfg(test)] +mod tests { + use super::*; + + #[test] + fn the_copy_of_the_pom_carries_the_agent_and_the_listener() { + const EL: &str = "${gitnext.cp}"; + // no surefire in the pom: the plugin is added + let p = learning_pom("maven-jar-plugin").unwrap(); + assert!(p.contains("org.apache.maven.pluginsmaven-surefire-plugin${gitnext.argLine}"), "{p}"); + assert!(p.contains(EL) && p.contains("maven-jar-plugin"), "{p}"); + // no build at all + let p = learning_pom("a").unwrap(); + assert!(p.ends_with("") && p.contains(EL), "{p}"); + // surefire with its own options: they stay, ours are added + let own = "maven-surefire-plugin-Xmx1g1\ + maven-surefire-pluginx"; + let p = learning_pom(own).unwrap(); + assert!(p.contains("-Xmx1g ${gitnext.argLine}1"), "{p}"); + assert_eq!(p.matches(EL).count(), 2, "{p}"); // the main list and the profile's + assert!(learning_pom("not a pom").is_none()); + } + + #[test] + fn the_agent_instruments_the_package_all_code_shares() { + assert_eq!(includes(["org.jsoup.nodes", "org.jsoup", "org.jsoup.parser"].into_iter()), "org.jsoup.*"); + assert_eq!(includes(["org.json"].into_iter()), "org.json.*"); + assert_eq!(includes(["a.b", "c.d"].into_iter()), "*"); + assert_eq!(includes(["", "a"].into_iter()), "*"); + assert_eq!(package_of("// c\npackage org.json ;\nimport x;"), "org.json"); + assert_eq!(package_of("class A {}"), ""); + } + + #[test] + fn the_lines_that_ran_are_read_by_dump_and_file() { + let got = ran_lines("12-0\torg/x/A.java\t3,4,9\n12-0\torg/x/B.java\t1\n12-1\torg/x/A.java\t7\nbroken\n"); + assert_eq!(got["12-0"], vec![("org/x/A.java", vec![3, 4, 9]), ("org/x/B.java", vec![1])]); + assert_eq!(got["12-1"], vec![("org/x/A.java", vec![7])]); + assert_eq!(got.len(), 2); + } + + #[test] + fn the_tools_come_from_the_repository_the_classpath_lies_in() { + let repo = std::env::temp_dir().join(format!("gitnext-learn-java-repo-{}", std::process::id())); + let _ = std::fs::remove_dir_all(&repo); + let put = |group: &str, artifact: &str, version: &str, classifier: &str| { + let j = jar(&repo, group, artifact, version, classifier); + std::fs::create_dir_all(j.parent().unwrap()).unwrap(); + std::fs::write(&j, "").unwrap(); + j + }; + std::fs::create_dir_all(repo.join("org/apache/maven/plugins")).unwrap(); + let junit = put("junit", "junit", "4.13.2", ""); + assert_eq!(repository(std::slice::from_ref(&junit)), repo); + assert!(junit.ends_with("junit/junit/4.13.2/junit-4.13.2.jar")); + // nothing there yet: one line with the commands, the platform's version a known one + let e = jars(&repo, None).err().unwrap().to_string(); + assert!(e.ends_with(&format!("get it once: mvn dependency:get -Dartifact=org.jacoco:org.jacoco.core:{JACOCO} && mvn dependency:get -Dartifact=org.jacoco:org.jacoco.agent:{JACOCO}:jar:runtime && mvn dependency:get -Dartifact=org.junit.platform:junit-platform-launcher:{PLATFORM}")), "{e}"); + put("org.jacoco", "org.jacoco.agent", JACOCO, "runtime"); + put("org.jacoco", "org.jacoco.core", JACOCO, ""); + for a in ["asm", "asm-commons", "asm-tree"] { + put("org.ow2.asm", a, ASM, ""); + } + // the project's own platform is asked for when the repository has no launcher of it + let e = jars(&repo, Some("1.11.0")).err().unwrap().to_string(); + assert!(e.ends_with("get it once: mvn dependency:get -Dartifact=org.junit.platform:junit-platform-launcher:1.11.0"), "{e}"); + for v in ["1.9.3", "1.14.4"] { + for a in ["junit-platform-launcher", "junit-platform-engine", "junit-platform-commons"] { + put("org.junit.platform", a, v, ""); + } + } + // any launcher serves to compile against: the newest by number, not by letter + let got = jars(&repo, Some("1.11.0")).unwrap(); + assert!(got.platform[0].ends_with("junit-platform-launcher/1.14.4/junit-platform-launcher-1.14.4.jar"), "{:?}", got.platform); + assert!(got.agent.ends_with(format!("org/jacoco/org.jacoco.agent/{JACOCO}/org.jacoco.agent-{JACOCO}-runtime.jar")) && got.analyze.len() == 4); + let _ = std::fs::remove_dir_all(&repo); + } +} diff --git a/crates/gitnext-ops/src/learn/java/Analyze.java b/crates/gitnext-ops/src/learn/java/Analyze.java new file mode 100644 index 0000000..6966f6a --- /dev/null +++ b/crates/gitnext-ops/src/learn/java/Analyze.java @@ -0,0 +1,66 @@ +package gitnextlearn; + +import java.nio.file.*; +import java.util.*; +import org.jacoco.core.analysis.*; +import org.jacoco.core.data.*; +import org.jacoco.core.internal.data.CRC64; +import org.jacoco.core.tools.ExecFileLoader; + +/** args: classes dir, exec dir, out file. For every `.exec` and every source file with a line that ran, + * one line: n, tab, `pkg/File.java`, tab, the lines that ran separated by commas. */ +public final class Analyze { + public static void main(String[] a) throws Exception { + Path classes = Paths.get(a[0]), dir = Paths.get(a[1]); + // a multi-release build holds a class twice (`META-INF/versions/11/…`): the one whose id the data names ran + Map> bytes = new HashMap<>(); + try (var w = Files.walk(classes)) { + for (Path p : (Iterable) w.filter(p -> p.toString().endsWith(".class"))::iterator) { + String rel = classes.relativize(p).toString().replace('\\', '/').replaceFirst("^META-INF/versions/\\d+/", ""); + bytes.computeIfAbsent(rel.substring(0, rel.length() - 6), k -> new ArrayList<>()).add(Files.readAllBytes(p)); + } + } + List execs = new ArrayList<>(); + try (var s = Files.list(dir)) { + s.filter(p -> p.toString().endsWith(".exec")).sorted().forEach(execs::add); + } + try (var out = new java.io.PrintWriter(Files.newBufferedWriter(Paths.get(a[2])))) { + for (Path e : execs) { + ExecFileLoader l = new ExecFileLoader(); + l.load(e.toFile()); + ExecutionDataStore store = l.getExecutionDataStore(); + CoverageBuilder b = new CoverageBuilder(); + Analyzer an = new Analyzer(store, b); + for (ExecutionData d : store.getContents()) { + if (!d.hasHits()) continue; + for (byte[] c : bytes.getOrDefault(d.getName(), List.of())) { + if (CRC64.classId(c) == d.getId()) { + an.analyzeClass(c, d.getName()); + break; + } + } + } + Map> lines = new TreeMap<>(); + for (IClassCoverage cc : b.getClasses()) { + if (cc.getSourceFileName() == null) continue; + String f = (cc.getPackageName().isEmpty() ? "" : cc.getPackageName() + "/") + cc.getSourceFileName(); + for (int i = cc.getFirstLine(); i > 0 && i <= cc.getLastLine(); i++) { + int st = cc.getLine(i).getStatus(); + if (st == ICounter.FULLY_COVERED || st == ICounter.PARTLY_COVERED) + lines.computeIfAbsent(f, k -> new TreeSet<>()).add(i); + } + } + String n = e.getFileName().toString().replace(".exec", ""); + for (var en : lines.entrySet()) { + StringBuilder sb = new StringBuilder(n).append('\t').append(en.getKey()).append('\t'); + String sep = ""; + for (int i : en.getValue()) { + sb.append(sep).append(i); + sep = ","; + } + out.println(sb); + } + } + } + } +} diff --git a/crates/gitnext-ops/src/learn/java/Dump.java b/crates/gitnext-ops/src/learn/java/Dump.java new file mode 100644 index 0000000..e355fd8 --- /dev/null +++ b/crates/gitnext-ops/src/learn/java/Dump.java @@ -0,0 +1,69 @@ +package gitnextlearn; + +import java.io.*; +import java.nio.file.*; + +/** The JaCoCo agent's data of every test on its own: taken, and reset, when a test starts and when it ends. */ +public final class Dump { + static final Path DIR = Paths.get(System.getProperty("gitnext.dir", "gitnext-exec")); + static final Object agent; + static final java.lang.reflect.Method get; + static int seq; + static PrintWriter index; + static { + try { + agent = Class.forName("org.jacoco.agent.rt.RT").getMethod("getAgent").invoke(null); + get = Class.forName("org.jacoco.agent.rt.IAgent").getMethod("getExecutionData", boolean.class); + Files.createDirectories(DIR); + index = new PrintWriter(new FileWriter(DIR.resolve("index.tsv").toFile(), true), true); + } catch (Exception e) { + throw new ExceptionInInitializerError(e); + } + } + + static byte[] take() { + try { + return (byte[]) get.invoke(agent, true); + } catch (Exception e) { + throw new RuntimeException(e); + } + } + + // several test JVMs write to the same directory: the pid keeps their files apart + static final String JVM = Long.toString(ProcessHandle.current().pid()); + + static void write(String cls, String method, boolean failed, byte[] data) { + String n = JVM + "-" + seq++; + try { + Files.write(DIR.resolve(n + ".exec"), data); + } catch (IOException e) { + throw new UncheckedIOException(e); + } + index.println(n + "\t" + cls + "\t" + method + "\t" + (failed ? 1 : 0)); + } + + /** A test class starts: what ran before it is no test's. Its static blocks run now, not in its first + * test: they are all of its tests'. */ + public static synchronized void classStarted(String cls) { + take(); + try { + Class.forName(cls, true, Thread.currentThread().getContextClassLoader()); + } catch (Throwable e) { + // its tests fail on their own + } + } + + /** What ran since the class started or since its last test (`@BeforeAll`, `@AfterAll`, a static block): + * all of its tests'. */ + public static synchronized void classPart(String cls) { + write(cls, "", false, take()); + } + + public static synchronized void started(String cls) { + classPart(cls); + } + + public static synchronized void finished(String cls, String method, boolean failed) { + write(cls, method, failed, take()); + } +} diff --git a/crates/gitnext-ops/src/learn/java/Inits.java b/crates/gitnext-ops/src/learn/java/Inits.java new file mode 100644 index 0000000..977c515 --- /dev/null +++ b/crates/gitnext-ops/src/learn/java/Inits.java @@ -0,0 +1,35 @@ +package gitnextlearn; + +import java.net.*; +import java.nio.file.*; +import java.util.*; + +/** args: classes dir, out dir, classpath of the rest. Every class of the project is initialized on its own, in + * a class loader of its own (so all it needs is initialized again): `init-.exec` is what its static blocks + * and field initializers ran, `inits.tsv` names the class. */ +public final class Inits { + public static void main(String[] a) throws Exception { + Path classes = Paths.get(a[0]), out = Paths.get(a[1]); + List urls = new ArrayList<>(List.of(classes.toUri().toURL())); + for (String p : a[2].split(java.io.File.pathSeparator)) if (!p.isEmpty()) urls.add(Paths.get(p).toUri().toURL()); + List names = new ArrayList<>(); + try (var w = Files.walk(classes)) { + w.filter(p -> p.toString().endsWith(".class") && !p.toString().contains("META-INF")) + .forEach(p -> { String r = classes.relativize(p).toString(); names.add(r.substring(0, r.length() - 6).replace('/', '.').replace('\\', '.')); }); + } + Collections.sort(names); + Dump.take(); + int n = 0; + try (var idx = new java.io.PrintWriter(Files.newBufferedWriter(out.resolve("inits.tsv")))) { + for (String c : names) { + try (URLClassLoader l = new URLClassLoader(urls.toArray(new URL[0]), ClassLoader.getPlatformClassLoader())) { + Class.forName(c, true, l); + } catch (Throwable e) { + // it needs what a test sets up: what ran until it threw still counts + } + Files.write(out.resolve("init-" + n + ".exec"), Dump.take()); + idx.println(n++ + "\t" + c); + } + } + } +} diff --git a/crates/gitnext-ops/src/learn/java/Listener.java b/crates/gitnext-ops/src/learn/java/Listener.java new file mode 100644 index 0000000..2057828 --- /dev/null +++ b/crates/gitnext-ops/src/learn/java/Listener.java @@ -0,0 +1,37 @@ +package gitnextlearn; + +import org.junit.platform.engine.TestExecutionResult; +import org.junit.platform.engine.support.descriptor.ClassSource; +import org.junit.platform.engine.support.descriptor.MethodSource; +import org.junit.platform.launcher.TestExecutionListener; +import org.junit.platform.launcher.TestIdentifier; + +/** Tells `Dump` when a test class and a test start and end. Found by the JUnit Platform through + * `META-INF/services`. */ +public final class Listener implements TestExecutionListener { + @Override + public void executionStarted(TestIdentifier id) { + if (id.isTest()) Dump.started(cls(id)); + else if (id.getSource().orElse(null) instanceof ClassSource) Dump.classStarted(((ClassSource) id.getSource().get()).getClassName()); + } + + static String cls(TestIdentifier id) { + Object s = id.getSource().orElse(null); + return s instanceof MethodSource ? ((MethodSource) s).getClassName() : "?"; + } + + @Override + public void executionFinished(TestIdentifier id, TestExecutionResult r) { + if (!id.isTest()) { + if (id.getSource().orElse(null) instanceof ClassSource) Dump.classPart(((ClassSource) id.getSource().get()).getClassName()); + return; + } + String cls = "?", m = id.getDisplayName(); + if (id.getSource().orElse(null) instanceof MethodSource) { + MethodSource s = (MethodSource) id.getSource().get(); + cls = s.getClassName(); + m = s.getMethodName(); + } + Dump.finished(cls, m, r.getStatus() != TestExecutionResult.Status.SUCCESSFUL); + } +} diff --git a/crates/gitnext-ops/src/lib.rs b/crates/gitnext-ops/src/lib.rs index 3d1134c..4bb0286 100644 --- a/crates/gitnext-ops/src/lib.rs +++ b/crates/gitnext-ops/src/lib.rs @@ -67,6 +67,12 @@ impl Workspace { idx.graph() } + /// The graph for a process that answers once and exits. It is never dropped: freeing a large + /// graph string by string (a quarter of a million symbols in Kubernetes) only delays the exit. + pub fn graph_once(&self) -> Result> { + self.graph().map(std::mem::ManuallyDrop::new) + } + pub fn write_map(&self, g: &Graph) -> Result { gitnext_docs::write_map(&self.root, g) } diff --git a/crates/gitnext-ops/src/why.rs b/crates/gitnext-ops/src/why.rs index cef8a39..58a2415 100644 --- a/crates/gitnext-ops/src/why.rs +++ b/crates/gitnext-ops/src/why.rs @@ -313,7 +313,20 @@ pub fn json(g: &Graph, w: &Why) -> serde_json::Value { }) } +/// How the answer words its last line, the next step: with the commands of the CLI, or with the +/// tools an agent has. `replace` has `{}` where the name of the function goes. +pub struct Next<'a> { + pub replace: &'a str, + pub check: &'a str, +} + +pub const CLI: Next<'static> = Next { replace: "`gitnext edit replace {}`", check: "`gitnext check`" }; + pub fn render(g: &Graph, root: &Path, w: &Why) -> String { + render_for(g, root, w, &CLI) +} + +pub fn render_for(g: &Graph, root: &Path, w: &Why, next: &Next) -> String { let names: Vec<&str> = w.tests.iter().map(|&t| g.syms[t].sym.name.as_str()).collect(); let mut s = String::new(); if w.steps.is_empty() { @@ -406,6 +419,16 @@ pub fn render(g: &Graph, root: &Path, w: &Why) -> String { } let _ = writeln!(s, "```"); } - let _ = writeln!(s, "next: fix the code, not the test (`gitnext edit replace `), then `gitnext check`"); + // the next step, spelled out: a small model that reads "the bug is in X" answers "the bug is in X" and stops + let first = &g.syms[w.suspects[0].symbol]; + let name = g.short_name(w.suspects[0].symbol); + let _ = writeln!( + s, + "next: fix `{name}` ({}:{}) — the code, not the test. Replace the whole function with a corrected one: {}; then {}.", + first.file, + first.sym.start_line, + next.replace.replace("{}", name), + next.check + ); s } diff --git a/crates/gitnext-ops/tests/check.rs b/crates/gitnext-ops/tests/check.rs index cff71d1..4331f52 100644 --- a/crates/gitnext-ops/tests/check.rs +++ b/crates/gitnext-ops/tests/check.rs @@ -69,3 +69,95 @@ fn build_commands_follow_the_languages_touched() { assert_eq!(check::build_commands(&dir, &["notes.md"]).len(), 0); let _ = std::fs::remove_dir_all(&dir); } + +const TESTS: &str = "import os\n\nfrom calc import Calc\n\n\ndef test_add():\n assert Calc().add(2, 3) == 5\n\n\ndef test_needs_the_other_machine():\n assert Calc().add(1, 1) == 2\n assert os.environ.get(\"GITNEXT_NEVER_SET\") == \"1\"\n"; + +fn has_pytest() -> bool { + Command::new("pytest").arg("--version").output().is_ok_and(|o| o.status.success()) +} + +fn leftovers(dir: &Path) -> Vec { + let names = std::fs::read_dir(dir.join(".gitnext")).unwrap().flatten().map(|e| e.file_name().to_string_lossy().into_owned()); + names.filter(|n| n.starts_with("check-before-")).collect() +} + +/// A test that fails on the last commit too is not the change's doing, and the check says so. +#[test] +fn a_test_that_failed_before_the_change_is_not_blamed_on_it() { + if !has_pytest() { + eprintln!("skipped: no pytest in PATH"); + return; + } + let dir = project("before", &[("calc.py", CALC), ("test_calc.py", TESTS), (".gitignore", ".gitnext/\n__pycache__/\n.pytest_cache/\n")]); + // a change that breaks nothing: the one failing test fails without it too + let harmless = CALC.replace("a + b", "a + b + 0"); + std::fs::write(dir.join("calc.py"), &harmless).unwrap(); + let g = graph(&dir); + let c = check::check(&dir, &g, Duration::from_secs(120)); + let text = check::render(&g, &c); + assert!(c.ok(), "{text}"); + assert!(text.contains("tests AS BEFORE") && text.contains("1 test fails without your change too — not caused by it, leave it: test_needs_the_other_machine"), "{text}"); + assert!(text.ends_with("verdict: ok — builds, and your change breaks no test (1 failed before it too: test_needs_the_other_machine)\n"), "{text}"); + assert!(!text.contains("AssertionError") && !text.contains("FAILED"), "{text}"); + // the change is where it was, nothing is left behind, and what was learned is kept + assert_eq!(std::fs::read_to_string(dir.join("calc.py")).unwrap(), harmless); + assert!(leftovers(&dir).is_empty(), "{:?}", leftovers(&dir)); + let known = std::fs::read_to_string(dir.join(".gitnext/check-before.tsv")).unwrap(); + assert!(known.lines().any(|l| l.ends_with("\ttest_needs_the_other_machine")), "{known}"); + + // a change that does break a test: that one is the change's, the other still is not + let broken = CALC.replace("a + b", "a - b"); + std::fs::write(dir.join("calc.py"), &broken).unwrap(); + let g = graph(&dir); + let c = check::check(&dir, &g, Duration::from_secs(120)); + let text = check::render(&g, &c); + assert!(!c.ok() && text.contains("tests FAILED") && text.contains("test_add"), "{text}"); + assert!(text.contains("of these, failing without your change too (not caused by it): test_needs_the_other_machine"), "{text}"); + assert!(text.contains("verdict: FAILED — tests"), "{text}"); + assert_eq!(std::fs::read_to_string(dir.join("calc.py")).unwrap(), broken); + let _ = std::fs::remove_dir_all(&dir); +} + +#[test] +fn a_test_the_change_broke_is_said_to_pass_without_it() { + if !has_pytest() { + eprintln!("skipped: no pytest in PATH"); + return; + } + let only_add = TESTS.split("\n\ndef test_needs").next().unwrap().to_string() + "\n"; + let dir = project("mine", &[("calc.py", CALC), ("test_calc.py", &only_add), (".gitignore", ".gitnext/\n__pycache__/\n.pytest_cache/\n")]); + let broken = CALC.replace("a + b", "a - b"); + std::fs::write(dir.join("calc.py"), &broken).unwrap(); + let g = graph(&dir); + let c = check::check(&dir, &g, Duration::from_secs(120)); + let text = check::render(&g, &c); + assert!(!c.ok() && text.contains("tests FAILED") && text.contains("without your change this test passes — the change causes this"), "{text}"); + assert_eq!(std::fs::read_to_string(dir.join("calc.py")).unwrap(), broken); + assert!(leftovers(&dir).is_empty()); + let _ = std::fs::remove_dir_all(&dir); +} + +/// A check killed while the committed files were in place: the next one puts the changes back. +#[test] +fn changes_left_by_an_interrupted_check_come_back() { + let dir = project("recover", &[("calc.py", CALC), (".gitignore", ".gitnext/\n__pycache__/\n")]); + let mine = CALC.replace("a + b", "a + b + 0"); + let _ = graph(&dir); // makes .gitnext + let left = dir.join(".gitnext/check-before-4000000"); + std::fs::create_dir_all(&left).unwrap(); + std::fs::write(left.join("0"), &mine).unwrap(); + std::fs::write(left.join("files.tsv"), "0\t1\tcalc.py\n").unwrap(); + let g = graph(&dir); + let c = check::check(&dir, &g, Duration::from_secs(60)); + assert_eq!(std::fs::read_to_string(dir.join("calc.py")).unwrap(), mine); + assert!(check::render(&g, &c).contains("note: an earlier check was interrupted while it ran the tests on the last commit; your changes are back in calc.py"), "{}", check::render(&g, &c)); + assert!(leftovers(&dir).is_empty()); + // a file written since is left alone + std::fs::create_dir_all(&left).unwrap(); + std::fs::write(left.join("0"), "old\n").unwrap(); + std::fs::write(left.join("files.tsv"), "0\t1\tcalc.py\n").unwrap(); + let c = check::check(&dir, &g, Duration::from_secs(60)); + assert_eq!(std::fs::read_to_string(dir.join("calc.py")).unwrap(), mine); + assert!(c.notes.is_empty() && leftovers(&dir).is_empty()); + let _ = std::fs::remove_dir_all(&dir); +} diff --git a/crates/gitnext-ops/tests/edit.rs b/crates/gitnext-ops/tests/edit.rs index eba5255..e982163 100644 --- a/crates/gitnext-ops/tests/edit.rs +++ b/crates/gitnext-ops/tests/edit.rs @@ -88,3 +88,52 @@ fn a_comment_that_ends_a_line_of_code_is_not_a_doc() { assert!(render::read(&g, &dir, &[i]).starts_with("src/Range.java:26-28 "), "{}", render::read(&g, &dir, &[i])); let _ = std::fs::remove_dir_all(&dir); } + +/// `replace` given a line of the code where the name belongs: the edit that was meant is made. +#[test] +fn a_line_of_the_code_given_as_the_name() { + use gitnext_ops::edit::{is_code, replace_text}; + const EVAL: &str = "pub fn matches(a: u32, b: u32) -> bool {\n if a == b {\n return true;\n }\n a > b\n}\n\npub fn other(a: u32, b: u32) -> bool {\n let same = a == b;\n same || a > b\n}\n"; + let dir = std::env::temp_dir().join(format!("gitnext-edit-text-{}", std::process::id())); + let _ = std::fs::remove_dir_all(&dir); + std::fs::create_dir_all(dir.join("src")).unwrap(); + std::fs::write(dir.join("Cargo.toml"), "[package]\nname = \"demo\"\nversion = \"0.1.0\"\nedition = \"2021\"\n").unwrap(); + std::fs::write(dir.join("src/lib.rs"), EVAL).unwrap(); + let graph = || { + let mut idx = Index::open(&dir).unwrap(); + idx.refresh().unwrap(); + idx.graph().unwrap() + }; + let read = || std::fs::read_to_string(dir.join("src/lib.rs")).unwrap(); + assert!(is_code("if a == b {") && is_code("fn matches(a: u32, b: u32)") && !is_code("eval::matches") && !is_code("Version::fmt@33")); + // one line for another: the text is replaced where it stands, at its indent + let r = replace_text(&dir, &graph(), "if a == b {", "if a != b {", false).unwrap(); + assert_eq!((r.file.as_str(), r.lines), ("src/lib.rs", (2, 2))); + assert_eq!(read(), EVAL.replace("if a == b {", "if a != b {")); + // inside a line + replace_text(&dir, &graph(), "same || a > b", "same || a < b", false).unwrap(); + assert!(read().contains(" same || a < b\n"), "{}", read()); + std::fs::write(dir.join("src/lib.rs"), EVAL).unwrap(); + // the first line of a function as the name, the whole function as the code: the function is replaced + let whole = "pub fn matches(a: u32, b: u32) -> bool {\n a >= b\n}\n"; + replace_text(&dir, &graph(), "pub fn matches(a: u32, b: u32) -> bool {", whole, false).unwrap(); + assert_eq!(read(), EVAL.replace("pub fn matches(a: u32, b: u32) -> bool {\n if a == b {\n return true;\n }\n a > b\n}\n", whole)); + std::fs::write(dir.join("src/lib.rs"), EVAL).unwrap(); + // a line inside the function as the name, the whole function as the code: the same + replace_text(&dir, &graph(), "return true;", whole, false).unwrap(); + assert!(read().starts_with(whole) && read().contains("pub fn other"), "{}", read()); + std::fs::write(dir.join("src/lib.rs"), EVAL).unwrap(); + // in two places: both are named, nothing is written + let e = replace_text(&dir, &graph(), "a == b", "a != b", false).unwrap_err().to_string(); + assert!(e.starts_with("`a == b` is in 2 places: src/lib.rs:2 (in matches@1), src/lib.rs:9 (in other@8); name the function to change"), "{e}"); + // a whole function for a line of another function is not put there + let e = replace_text(&dir, &graph(), "let same = a == b;", whole, false).unwrap_err().to_string(); + assert!(e.starts_with("the code is a whole function or class, but `let same = a == b;` stands in another one (in other@8)"), "{e}"); + let e = replace_text(&dir, &graph(), "if a <= b {", "if a < b {", false).unwrap_err().to_string(); + assert!(e.starts_with("`if a <= b {` is not the name of a function or class, and no line of the code has this text"), "{e}"); + assert_eq!(read(), EVAL); + // what would not parse is refused as with a symbol + let e = replace_text(&dir, &graph(), "if a == b {", "if a == b {{{", false).unwrap_err().to_string(); + assert!(e.contains("would not parse"), "{e}"); + let _ = std::fs::remove_dir_all(&dir); +} diff --git a/crates/gitnext-ops/tests/learn_java.rs b/crates/gitnext-ops/tests/learn_java.rs new file mode 100644 index 0000000..96faab2 --- /dev/null +++ b/crates/gitnext-ops/tests/learn_java.rs @@ -0,0 +1,83 @@ +//! `gitnext learn-tests` in a Java project on Maven: the map names the tests that really ran each +//! method. What cannot be learned is said without starting a JVM; the run itself needs Maven with +//! JUnit and JaCoCo in its local repository and is skipped unless `GITNEXT_TEST_MVN=1` (the pom's +//! copy and the reading of the coverage lines are tested without Maven in `learn/java.rs`). + +use gitnext_ops::gitnext_index::{Graph, Index, TestMap}; +use gitnext_ops::{learn, locate}; +use std::path::{Path, PathBuf}; + +fn project(name: &str, files: &[(&str, &str)]) -> PathBuf { + let dir = std::env::temp_dir().join(format!("gitnext-learn-java-{name}-{}", std::process::id())); + let _ = std::fs::remove_dir_all(&dir); + for (p, c) in files { + let f = dir.join(p); + std::fs::create_dir_all(f.parent().unwrap()).unwrap(); + std::fs::write(f, c).unwrap(); + } + dir +} + +fn graph(dir: &Path) -> Graph { + let mut idx = Index::open(dir).unwrap(); + idx.refresh().unwrap(); + idx.graph().unwrap() +} + +const POM: &str = "\n 4.0.0\n demo\n demo\n 1\n \n 11\n UTF-8\n \n \n \n org.junit.jupiter\n junit-jupiter\n 5.14.4\n test\n \n \n\n"; +const CALC: &str = "package demo;\n\npublic class Calc {\n static final int BASE = base();\n\n static int base() {\n return 10;\n }\n\n public static int add(int a, int b) {\n return a + b;\n }\n\n public static int twice(int x) {\n return add(x, x);\n }\n\n public static int unused() {\n return 0;\n }\n}\n"; +const CALC_TEST: &str = "package demo;\n\nimport static org.junit.jupiter.api.Assertions.assertEquals;\n\nimport org.junit.jupiter.api.Test;\n\nclass CalcTest {\n @Test\n void doubles() {\n assertEquals(4, Calc.twice(2));\n }\n}\n"; +const ADD_TEST: &str = "package demo;\n\nimport static org.junit.jupiter.api.Assertions.assertEquals;\n\nimport org.junit.jupiter.api.Test;\n\nclass AddTest {\n @Test\n void adds() {\n assertEquals(3, Calc.add(1, 2));\n }\n}\n"; + +fn learn_error(dir: &Path) -> String { + let g = graph(dir); + let e = learn::learn(dir, &g).err().map(|e| format!("{e:#}")).unwrap_or_default(); + let _ = std::fs::remove_dir_all(dir); + e +} + +#[test] +fn what_is_not_learned_is_said_in_one_line() { + let e = learn_error(&project("gradle", &[("build.gradle", "plugins { id 'java' }\n"), ("src/main/java/demo/Calc.java", CALC)])); + assert_eq!(e, "Java: the project builds with Gradle; learn-tests knows Maven only"); + let e = learn_error(&project("no-pom", &[("src/main/java/demo/Calc.java", CALC)])); + assert_eq!(e, "Java: no pom.xml at the root of the repository"); + let modules = POM.replace("", "core\n "); + let e = learn_error(&project("modules", &[("pom.xml", &modules), ("core/src/main/java/demo/Calc.java", CALC)])); + assert_eq!(e, "Java: a Maven project of several modules is not learned yet"); +} + +#[test] +fn a_maven_project_learns_which_test_ran_which_method() { + if std::env::var("GITNEXT_TEST_MVN").as_deref() != Ok("1") { + eprintln!("skipped: set GITNEXT_TEST_MVN=1 to run Maven with the JaCoCo agent"); + return; + } + let dir = project( + "maven", + &[("pom.xml", POM), ("src/main/java/demo/Calc.java", CALC), ("src/test/java/demo/CalcTest.java", CALC_TEST), ("src/test/java/demo/AddTest.java", ADD_TEST)], + ); + let g = graph(&dir); + let l = learn::learn(&dir, &g).unwrap(); + assert!(!l.tests_failed && l.tests == 2 && l.notes.is_empty(), "{}", learn::render(&l)); + assert!(l.command.contains("includes=demo.*") && l.command.contains("each of 2 tests"), "{}", l.command); + let tests_of = |name: &str| { + let q = g.unique_name(g.find(name)[0]); + let mut t: Vec = TestMap::open_existing(&dir).unwrap().tests_of(&q).into_iter().map(|c| format!("{} {}", c.file, c.name)).collect(); + t.sort(); + t + }; + let (add, calc) = ("src/test/java/demo/AddTest.java AddTest::adds", "src/test/java/demo/CalcTest.java CalcTest::doubles"); + assert_eq!(tests_of("twice"), [calc]); + assert_eq!(tests_of("add"), [add, calc]); + // a static initializer runs once in the JVM, in the first test that touches the class: it is both tests' + assert_eq!(tests_of("base"), [add, calc]); + assert!(tests_of("unused").is_empty()); + let (t, source) = locate::tests_for_at(&g, &dir, g.find("twice")[0], 4); + assert_eq!(source, locate::Source::Learned { stale: false }); + assert_eq!(t.iter().map(|x| g.syms[x.symbol].sym.name.as_str()).collect::>(), ["doubles"]); + // the helper classes, the coverage data and the copy of the pom are gone + let left: Vec<_> = std::fs::read_dir(dir.join(".gitnext")).unwrap().flatten().filter(|e| e.file_name().to_string_lossy().starts_with("learn-java")).collect(); + assert!(left.is_empty() && !dir.join(".gitnext-pom.xml").exists()); + let _ = std::fs::remove_dir_all(&dir); +} diff --git a/crates/gitnext-ops/tests/why.rs b/crates/gitnext-ops/tests/why.rs index c5a5d1c..5abdbc2 100644 --- a/crates/gitnext-ops/tests/why.rs +++ b/crates/gitnext-ops/tests/why.rs @@ -24,7 +24,7 @@ fn graph(dir: &Path) -> Graph { } fn failed(g: &Graph, dir: &Path, output: &str) -> Step { - Step { what: "tests", command: "the test command".into(), ok: false, timed_out: false, seconds: 0.2, output: output.into(), digest: digest::digest(output), frames: locate::frames(g, dir, output) } + Step { what: "tests", command: "the test command".into(), ok: false, timed_out: false, seconds: 0.2, output: output.into(), before: None, digest: digest::digest(output), frames: locate::frames(g, dir, output) } } const EVAL: &str = "pub fn matches(req: u32, v: u32) -> bool {\n matches_exact(req, v) || matches_greater(req, v)\n}\n\nfn matches_exact(req: u32, v: u32) -> bool {\n req == v\n}\n\nfn matches_greater(req: u32, v: u32) -> bool {\n v < req\n}\n\npub fn unrelated() -> u32 {\n 7\n}\n"; @@ -74,7 +74,16 @@ fn the_function_named_like_the_test_comes_first_with_its_code() { assert!(text.contains("tests/test_req.rs:5: assert!(matches(req, *v), \"did not match {v}\");"), "{text}"); assert!(text.contains(" 1. matches_greater src/eval.rs:9") && text.contains(" v < req\n"), "{text}"); assert!(!text.contains("req == v") && !text.contains("test result:"), "{text}"); - assert!(text.len() < 900, "{}", text.len()); + assert!(text.len() < 1000, "{}", text.len()); + // the last line is the next step, with the function to change by name + assert!( + text.ends_with("next: fix `matches_greater` (src/eval.rs:9) — the code, not the test. Replace the whole function with a corrected one: `gitnext edit replace matches_greater`; then `gitnext check`.\n"), + "{text}" + ); + // an agent is told the same in the words of its own tools + let tools = why::Next { replace: "replace(symbol=\"{}\", code=)", check: "check() with no arguments" }; + let text = why::render_for(&g, &dir, &w, &tools); + assert!(text.ends_with("corrected one: replace(symbol=\"matches_greater\", code=); then check() with no arguments.\n"), "{text}"); } #[test] @@ -112,7 +121,7 @@ fn a_passing_test_needs_no_explanation() { let dir = rust_project("pass"); let g = graph(&dir); let test = why::find_tests(&g, "test_exact"); - let ok = Step { what: "tests", command: "cargo test".into(), ok: true, timed_out: false, seconds: 0.1, output: String::new(), digest: Default::default(), frames: vec![] }; + let ok = Step { what: "tests", command: "cargo test".into(), ok: true, timed_out: false, seconds: 0.1, output: String::new(), before: None, digest: Default::default(), frames: vec![] }; let w = why::explain(&dir, &g, &test, vec![ok]); assert!(!w.failed() && w.suspects.is_empty()); assert!(why::render(&g, &dir, &w).starts_with("why: test_exact — passes")); diff --git a/eval/agent.py b/eval/agent.py index 0d2395f..8a595ff 100644 --- a/eval/agent.py +++ b/eval/agent.py @@ -29,7 +29,8 @@ find "where is X defined" → the answer names the right file callers "who calls X" → recall against the compiler's list fix a seeded bug makes tests fail → the test suite passes again - rename "rename X to Y everywhere" → it compiles and no old name is left + rename "rename X to Y everywhere" → it compiles, the old definition is gone and the new one is there + (Python, with no compiler: the old name is left nowhere) python3 eval/agent.py --host http://127.0.0.1:8080 --repos click,cobra \\ --tasks find,callers,fix,rename --modes base,gitnext,lite --repeat 3 @@ -187,7 +188,16 @@ def path(p): return ev.gx(["rename", a["old"], a["new"], "--text"], root)[1][:MAX_OUT] if name == "check": test = (a.get("test") or "").strip() - return ev.gx(["check", test] if test else ["check"], root, timeout=900)[1][-MAX_OUT if not test else None:][:MAX_OUT] + if not test: + return ev.gx(["check"], root, timeout=900)[1][-MAX_OUT:] + # why the test fails. Its last line is the next step: worded with this agent's tools, and kept when the answer is cut + out = ev.gx(["check", test], root, timeout=900)[1].rstrip() + out = re.sub(r"`gitnext edit replace ([^`]+)`", lambda m: f'{"replace" if short else "replace_symbol"}(symbol="{m.group(1)}", code=)', out) + out = out.replace("`gitnext check`", "check with no arguments") + last = out.splitlines()[-1] if out else "" + if len(out) > MAX_OUT and last.startswith("next:"): + out = out[:MAX_OUT - len(last) - 3] + "\n…\n" + last + return out[:MAX_OUT] if name in ("replace_symbol", "replace", "add_after"): kind = "insert-after" if name == "add_after" else "replace" p = subprocess.run([ev.GITNEXT, "edit", kind, a["symbol"]], input=a["code"], cwd=root, capture_output=True, text=True) @@ -434,9 +444,15 @@ def locate(err: str) -> str: # where gitnext thinks an error comes from # ---------------------------------------------------------------- tasks +OWN_FILES = {"go": ".go", "rust": ".rs", "python": ".py", "java": ".java", "typescript": (".ts", ".tsx", ".mts")} + + def make_tasks(repo: dict, root: Path, kinds: list[str], seed: int) -> list[dict]: syms = ev.symbols(root) - sample = ev.pick(syms, root, 6, seed) + # a project in several languages (a Go server with a TypeScript UI): the judge is the compiler of one of + # them, so the tasks are about that language's code + own = [s for s in syms if s["file"].endswith(OWN_FILES.get(repo["lang"], ""))] + sample = ev.pick(own, root, 6, seed) rng = random.Random(seed) tasks = [] if "find" in kinds and sample: @@ -508,7 +524,7 @@ def seed_bug(repo: dict, root: Path, syms: list[dict], rng: random.Random) -> di patch = ev.sh("git diff", root)[1] ev.restore(root) name = sorted(failed)[0] - return {"kind": "fix", "target": s["qualified"], "patch": patch, "prompt": f"The test `{name}` fails. Find the bug in the code and fix it (do not change the tests).", "failing": sorted(failed)[:10]} + return {"kind": "fix", "target": s["qualified"], "patch": patch, "prompt": f"The test `{name}` fails. Find the bug in the code and fix it (do not change the tests).", "failing": sorted(failed)[:10], "before": sorted(before)} ev.restore(root) break return None @@ -527,13 +543,24 @@ def check(task: dict, repo: dict, root: Path, res: dict) -> bool: left = ev.sh(f"git grep -nw {task['old']} -- . ':!*.md' | head -3", root)[1].strip() code, out = ev.sh(L["compile"], root, timeout=1200) res["left"] = left[:200] - return code == 0 and not left and bool(ev.sh(f"git grep -nw {task['new']} | head -1", root)[1].strip()) + if repo["lang"] == "python": + # no compiler: a use left behind shows only as the word, so the word must be gone + return code == 0 and not left and bool(ev.sh(f"git grep -nw {task['new']} | head -1", root)[1].strip()) + # With a compiler a use of a name that is not defined any more does not build: it is enough that the old + # definition is gone and the new one stands in its place. The word itself may stay — it is other things + # too (`os.Rename`, a struct field of the same name): on a large project 3 of 12 tasks could not pass. + ev.gx(["index"], root) + defined = {x["qualified"] for x in ev.symbols(root)} + new = task["target"][: len(task["target"]) - len(task["old"])] + task["new"] + res["old_defined"] = task["target"] in defined + return code == 0 and not res["old_defined"] and new in defined if task["kind"] == "fix": code, _ = ev.sh(L["compile"], root, timeout=1200) if code and repo["lang"] != "python": return False _, tout = ev.sh(L["tests"], root, timeout=1800) - return not L["failed"](tout, root) + # a test that failed before the bug was seeded is not the model's to fix (cobra has one when run as root) + return not (set(L["failed"](tout, root)) - set(task.get("before", []))) return False diff --git a/eval/agent_stats.py b/eval/agent_stats.py index 69ecbd2..fe80a59 100644 --- a/eval/agent_stats.py +++ b/eval/agent_stats.py @@ -3,12 +3,16 @@ the same task in two modes as a pair (sign test, bootstrap over tasks). python3 eval/agent_stats.py eval/results/agent-kaggle-20261113.json + python3 eval/agent_stats.py eval/results/agent-kaggle-big-20261114.json The file is a list of the rows `eval/agent.py` writes, each with `model` and `set` (the task set, 0-based) added. """ import json, sys, statistics, collections, random, math rows = json.load(open(sys.argv[1])) -MODELS = ["qwen3.5-4b", "qwen3.5-9b", "qwen3.5-27b"]; MODES = ["base", "gitnext", "lite"]; TASKS = ["find", "callers", "fix", "rename"] +# the models, kinds of task and projects are the ones the file has; models by size +MODELS = sorted({r["model"] for r in rows}, key=lambda m: (float("".join(c for c in m.rsplit("-", 1)[-1] if c.isdigit() or c == ".") or 0), m)) +MODES = ["base", "gitnext", "lite"]; TASKS = [t for t in ["find", "callers", "fix", "rename"] if any(r["task"] == t for r in rows)] +REPOS = sorted({r["repo"] for r in rows}) by = collections.defaultdict(list) for r in rows: by[(r["model"], r["task"], r["mode"])].append(r); by[(r["model"], "all", r["mode"])].append(r) @@ -37,12 +41,12 @@ def paired(m, a, b, task=None): solved = [k for k in ks if A[k]["passed"] and B[k]["passed"] and A[k].get("tokens_in") and B[k].get("tokens_in")] r2 = statistics.median(A[k]["tokens_in"] / B[k]["tokens_in"] for k in solved) if solved else 0 return len(ks), win, lose, min(1.0, p), sum(d) / len(d), bs[100], bs[3899], ratio, r2, len(solved) -print("\npaired, the same 72 tasks: n, +wins, -losses, sign-test p, diff [95% CI], median token ratio (all), (both solved, n)") +print("\npaired, the same tasks: n, +wins, -losses, sign-test p, diff [95% CI], median token ratio (all), (both solved, n)") for m in MODELS: for a, b in (("base", "gitnext"), ("base", "lite"), ("gitnext", "lite")): n, w, l, p, d, lo, hi, ra, r2, ns = paired(m, a, b) print(f" {m:12} {a:>7} -> {b:7} n={n} +{w} -{l} p={p:.4f} diff {d*100:+.0f} pp [{lo*100:+.0f}, {hi*100:+.0f}] tokens x{ra:.1f} (both solved x{r2:.1f}, n={ns})") -print("\nby repo, solved of 12 per mode:") +print("\nby repo, solved per mode:") for m in MODELS: - print(" ", m, " ".join(f"{repo}:" + "/".join(str(sum(bool(r['passed']) for r in rows if r['model'] == m and r['repo'] == repo and r['mode'] == md)) for md in MODES) for repo in ["click", "sqlparse", "semver", "indexmap", "cobra", "chi"])) + print(" ", m, " ".join(f"{repo}:" + "/".join(str(sum(bool(r['passed']) for r in rows if r['model'] == m and r['repo'] == repo and r['mode'] == md)) for md in MODES) for repo in REPOS)) print("\nguard stops:", {m: collections.Counter((r["mode"], (r.get("guard") or {}).get("stopped")) for r in rows if r["model"] == m and (r.get("guard") or {}).get("stopped")) for m in MODELS}) diff --git a/eval/agent_traces.py b/eval/agent_traces.py new file mode 100644 index 0000000..3918529 --- /dev/null +++ b/eval/agent_traces.py @@ -0,0 +1,97 @@ +#!/usr/bin/env python3 +"""What the agent does call by call, from the conversations `eval/agent.py` keeps (`*.trace.jsonl`): +what a run's calls are, which of them bring nothing, which runs never use a gitnext tool, what is lost +and won against plain tools on the same task, and how the failed runs end. + + python3 eval/agent_traces.py -r-.trace.jsonl, at any depth> +""" +import collections, glob, json, os, re, sys + +DIR = sys.argv[1] if len(sys.argv) > 1 else "." + + +def runs(): + for f in sorted(glob.glob(os.path.join(DIR, '**', 'agent-*.trace.jsonl'), recursive=True)): + m = re.search(r'agent-(?:qwen3\.5-)?([\w.]+)-r(\d+)-([\w-]+)\.trace', f) + for l in open(f): + r = json.loads(l) + r['model'] = m.group(1); r['set'] = int(m.group(2)) + yield r +def calls(r): + """(tool, args text, result text) of every call, in order.""" + out = []; ms = r['messages'] + for i, m in enumerate(ms): + if m['role'] == 'assistant': + cs = m.get('calls') or [] + res = [x['content'] for x in ms[i+1:i+1+len(cs)] if x['role'] == 'tool'] + for k, c in enumerate(cs): + t, _, a = c.partition(' ') + out.append((t, a, res[k] if k < len(res) else '')) + return out + + +R = list(runs()) +MODELS = sorted({r['model'] for r in R}, key=lambda m: (float(re.sub(r'[^\d.]', '', m) or 0), m)) +CAT = {'grep': 'search', 'list_dir': 'search', 'read_file': 'read', 'edit_file': 'edit', 'replace': 'edit', 'replace_symbol': 'edit', 'add_after': 'edit', + 'rename': 'edit', 'run': 'run', 'check': 'check', 'look': 'look', 'finish': 'finish'} +def waste(t, a, res, seen): + if res.startswith('Not run again'): return 'repeat' + if t == 'grep' and res.startswith('no matches'): return 'empty search' + if t == 'look' and res.startswith(('nothing found', 'nothing has all')): return 'empty search' + if t in ('edit_file', 'replace', 'replace_symbol', 'add_after', 'rename') and res.startswith('error'): return 'edit refused' + if t == 'read_file': + try: p = json.loads(a).get('path') + except Exception: p = a + if p in seen: return 'reread' + seen.add(p) + if t == 'run' and re.match(r"exit [1-9]\d*\n(/bin/sh|Error in sitecustomize|error: no such|bash:)", res): return 'command error' + return '' +print('== calls per run and what they are (mean per run) ==') +for task in [t for t in ('find', 'callers', 'fix', 'rename') if any(r['task'] == t for r in R)]: + for mode in ('base', 'gitnext', 'lite'): + rs = [r for r in R if r['task'] == task and r['mode'] == mode] + c = collections.Counter(); w = collections.Counter(); n = 0 + for r in rs: + seen = set() + for t, a, res in calls(r): + n += 1; c[CAT.get(t, t)] += 1 + x = waste(t, a, res, seen) + if x: w[x] += 1 + k = len(rs) + print(f"{task:8}{mode:8} pass {sum(r['passed'] for r in rs):3}/{k} calls {n/k:5.1f} | " + ' '.join(f"{a} {b/k:.1f}" for a, b in c.most_common()) + ' || wasted ' + f"{sum(w.values())/k:.1f}: " + ' '.join(f"{a} {b/k:.1f}" for a, b in w.most_common())) +print('== the same by model, all tasks: calls per run, wasted per run ==') +for model in MODELS: + for mode in ('base', 'gitnext', 'lite'): + rs = [r for r in R if r['model'] == model and r['mode'] == mode] + n = w = 0 + for r in rs: + seen = set() + for t, a, res in calls(r): + n += 1; w += bool(waste(t, a, res, seen)) + print(f"{model:4}{mode:8} calls {n/len(rs):5.1f} wasted {w/len(rs):4.1f} ({100*w/n:.0f}%)") +print('== gitnext mode (11 tools): runs that never call a gitnext tool ==') +G = {'look', 'check', 'rename', 'replace_symbol', 'insert_after'} +for model in MODELS: + rs = [r for r in R if r['model'] == model and r['mode'] == 'gitnext'] + no = [r for r in rs if not any(t in G for t, _, _ in calls(r))] + yes = [r for r in rs if r not in no] + print(model, f"no gitnext tool: {len(no)}/{len(rs)} runs, passed {sum(r['passed'] for r in no)}; with: {len(yes)}, passed {sum(r['passed'] for r in yes)}", + 'by task (no tool):', dict(collections.Counter(r['task'] for r in no))) +print('== lost and won against plain tools (same task, same set) ==') +key = lambda r: (r['model'], r['repo'], r['task'], r['target'], r['set']) +by = {(key(r), r['mode']): r for r in R} +for mode in ('gitnext', 'lite'): + lost = [k for (k, m), r in by.items() if m == 'base' and r['passed'] and (k, mode) in by and not by[(k, mode)]['passed']] + won = [k for (k, m), r in by.items() if m == 'base' and not r['passed'] and (k, mode) in by and by[(k, mode)]['passed']] + print(mode, 'lost', len(lost), dict(collections.Counter((k[0], k[2]) for k in lost)), '| won', len(won), dict(collections.Counter((k[0], k[2]) for k in won))) +print('== how failed runs end ==') +for mode in ('base', 'gitnext', 'lite'): + c = collections.Counter() + for r in R: + if r['mode'] != mode or r['passed']: continue + cs = calls(r) + fin = any(t == 'finish' for t, _, _ in cs) + ed = any(CAT.get(t) == 'edit' and not res.startswith(('error', 'Not run')) for t, _, res in cs) + steps = sum(1 for m in r['messages'] if m['role'] == 'assistant') + c[(r['task'], 'out of steps' if steps >= 25 and not fin else ('finished' if fin else 'stopped') + (', changed code' if ed else ', no change') if r['task'] in ('fix', 'rename') else ('wrong answer' if fin else 'no answer'))] += 1 + print(mode, sorted(c.items())) diff --git a/eval/baselines.py b/eval/baselines.py new file mode 100644 index 0000000..19fe562 --- /dev/null +++ b/eval/baselines.py @@ -0,0 +1,175 @@ +#!/usr/bin/env python3 +"""Baselines on the functions of a run: what the plain search for a name gives where gitnext was asked. + +The truth is the one the run kept (the compiler's uses, the tests that fail when the function throws); nothing is +compiled or run here, only `git grep` over the same commit. + + callers the functions that have the name as a word (`git grep -w`), each hit put into the function around it + tests the tests whose body has the name as a word, in the order of the files — and ten tests drawn at random + + python3 eval/baselines.py [run] # a name in eval/results (default: latest) → results/.baselines.{md,json} +""" +import json +import math +import random +import subprocess +import sys +from pathlib import Path + +import run as ev + +EXT = {"go": ["*.go"], "rust": ["*.rs"], "java": ["*.java"], "typescript": ["*.ts", "*.tsx", "*.mts"], "python": ["*.py"]} +TOP = ev.TOP +BOOT = 2000 + + +def grep(root: Path, name: str, lang: str) -> list[tuple[str, int]]: + """Every line that has the name as a word: (file, line).""" + out = subprocess.run(["git", "grep", "-nwF", "--no-color", "-e", name, "--", *EXT[lang]], cwd=root, capture_output=True, text=True).stdout + hits = [] + for row in out.splitlines(): + file, line, _ = row.split(":", 2) + hits.append((file, int(line))) + return hits + + +def half(values: list[float]) -> float: + """Half the width of the 90% bootstrap interval of the mean.""" + if len(values) < 2: + return 0.0 + rng = random.Random(1) + means = sorted(sum(rng.choice(values) for _ in values) / len(values) for _ in range(BOOT)) + return (means[int(0.95 * BOOT) - 1] - means[int(0.05 * BOOT)]) / 2 + + +def cell(values: list) -> str: + v = [x for x in values if x is not None] + return f"{100 * sum(v) / len(v):.0f}% ±{100 * half(v):.0f}" if v else "—" + + +def callers_rows(root: Path, repo: dict, syms: list[dict], rows: list[dict], hits_of=None, prefix: str = "grep") -> list[dict]: + """`hits_of(symbol)`: the places (file, line) an answerer names for the symbol; the default is the search for its name.""" + L = ev.LANG[repo["lang"]] + by_name = {x["qualified"]: x for x in syms} + modules = {x["qualified"] for x in syms if x["kind"] == "module"} + file_of = {x["qualified"]: x["file"] for x in syms} + unseen = L.get("unseen", lambda f: False) + out = [] + for r in rows: + if "truth" not in r: + continue + truth, imports = set(r["truth"]), set(r["import_files"]) + name = r["symbol"].rsplit("::", 1)[-1] + hits = hits_of(by_name[r["symbol"]]) if hits_of else grep(root, name, repo["lang"]) + if hits is None: + continue + found = {q for f, ln in hits if (q := ev.enclosing(syms, f, ln)) and q != r["symbol"] and q not in modules} + found = {q for q in found if not unseen(file_of.get(q, ""))} + ok = {q for q in found if q in truth or file_of.get(q) in imports} + out.append({ + "symbol": r["symbol"], "lang": repo["lang"], + f"{prefix}_recall": len(found & truth) / len(truth) if truth else None, f"{prefix}_precision": len(ok) / len(found) if found else None, + "recall": r["recall"], "precision": r["precision"], + }) + return out + + +def tests_rows(root: Path, repo: dict, syms: list[dict], rows: list[dict], truth_of) -> list[dict]: + L = ev.LANG[repo["lang"]] + # the tests of the project: what the index marks as test code, narrowed by the language's own naming where it has one + code, listed = ev.gx(["--json", "symbols", "--tests"], root) + marked = [s for s in (json.loads(listed) if code == 0 else []) if s.get("test")] + is_test = {"go": lambda s: s["name"].startswith("Test"), "python": lambda s: s["name"].startswith("test")}.get(repo["lang"], lambda s: True) + tests = [s for s in marked if s["kind"] in ("function", "method") and is_test(s)] + test_files = sorted({s["file"] for s in marked}) + out = [] + for r in rows: + if "truth" not in r: + continue + t = truth_of(f"{repo['name']}@{repo['commit'][:12]}:{L.get('tests_key', 'tests')}:{r['symbol']}") + if not t: + continue + key = {"file": lambda s: s["file"], "id": lambda s: f"{s['file']}::{s['name']}", "name": lambda s: s["name"]}[r["level"]] + truth = set(t["ids"] if r["level"] == "id" else t["failed"]) + universe = set(test_files) if r["level"] == "file" else {key(s) for s in tests} + name = r["symbol"].rsplit("::", 1)[-1] + lines: dict[str, set[int]] = {} + for f, ln in grep(root, name, repo["lang"]): + lines.setdefault(f, set()).add(ln) + named = sorted((s for s in tests if any(s["start_line"] <= ln <= s["end_line"] for ln in lines.get(s["file"], ()))), key=lambda s: (s["file"], s["start_line"])) + order = [f for f in test_files if f in lines] if r["level"] == "file" else list(dict.fromkeys(key(s) for s in named)) + hit = len(set(order) & truth) + total, k = max(len(universe), len(truth)), len(truth) + # at least one of ten tests drawn at random fails + chance = 1 - math.comb(total - k, TOP) / math.comb(total, TOP) if total - k >= TOP else 1.0 + out.append({ + "symbol": r["symbol"], "lang": repo["lang"], "tests_in_project": total, "failing": k, + "grep_recall": hit / k, "grep_precision": hit / len(order) if order else 0.0, "grep_caught": 1.0 if set(order[:TOP]) & truth else 0.0, + "random_caught": chance, "random_precision": k / total, "recall": r["recall"], "precision": r["precision"], "caught": r["caught"], + }) + return out + + +def main() -> None: + name = sys.argv[1] if len(sys.argv) > 1 else "latest" + results = [r for r in json.loads((ev.HERE / "results" / f"{name}.json").read_text()) if "error" not in r] + ev._load_cache() + cache = ev.CACHE if hasattr(ev, "CACHE") else json.loads(ev.CACHE_FILE.read_text()) + all_rows = {"callers": [], "callers_common": [], "callers_blind": [], "tests": []} + for r in results: + repo = {"name": r["repo"], "lang": r["lang"], "commit": r["commit"]} + root = ev.WORK / r["repo"] + head = subprocess.run(["git", "rev-parse", "HEAD"], cwd=root, capture_output=True, text=True).stdout.strip() + if not head.startswith(r["commit"]): + print(f"{r['repo']}: the checkout is at {head[:12]}, the run was at {r['commit'][:12]} — skipped") + continue + syms = ev.symbols(root) + for scope in ("callers", "callers_common", "callers_blind"): + got = callers_rows(root, repo, syms, r.get(scope, [])) + for g in got: + g["repo"] = r["repo"] + all_rows[scope] += got + got = tests_rows(root, repo, syms, r.get("tests", []), cache.get) + for g in got: + g["repo"] = r["repo"] + all_rows["tests"] += got + print(f"{r['repo']}: " + ", ".join(f"{k} {sum(1 for x in v if x['repo'] == r['repo'])}" for k, v in all_rows.items()), flush=True) + + langs = [l for l in ("go", "rust", "java", "typescript", "python") if any(x["lang"] == l for v in all_rows.values() for x in v)] + md = [f"# Baselines on the functions of the run `{name}`", "", + "The search for the name: `git grep -w ` in the files of the language; every hit is put into the function around it " + "(callers) or counted for the test whose body has it (tests). The truth is the run's own: the compiler's uses, the tests that " + "fail when the function throws. ± is half of a 90% bootstrap interval over the functions.", ""] + titles = {"callers": "Callers — names that occur once", "callers_common": "Callers — methods that share a name", + "callers_blind": "Callers — whether or not gitnext sees a caller"} + for scope, title in titles.items(): + rows = all_rows[scope] + if not rows: + continue + md += [f"## {title}", "", "| | functions | search: recall | search: precision | gitnext: recall | gitnext: precision |", "|---|---|---|---|---|---|"] + for label, part in [("all", rows)] + [(l, [x for x in rows if x["lang"] == l]) for l in langs]: + if part: + md.append(f"| {label} | {sum(x['recall'] is not None for x in part)} | {cell([x['grep_recall'] for x in part])} | {cell([x['grep_precision'] for x in part])} | " + f"{cell([x['recall'] for x in part])} | {cell([x['precision'] for x in part])} |") + md.append("") + rows = all_rows["tests"] + if rows: + md += ["## The tests of a function", "", + f"\"Caught\": at least one of the first {TOP} tests named fails when the function throws. \"Ten at random\": the chance of " + "that for ten tests drawn from all tests of the project; their precision is the share of the project's tests that fail.", "", + "| | functions | ten at random: caught | ten at random: precision | search: caught | search: recall | search: precision | gitnext: caught | gitnext: recall | gitnext: precision |", + "|---|---|---|---|---|---|---|---|---|---|"] + for label, part in [("all", rows)] + [(l, [x for x in rows if x["lang"] == l]) for l in langs]: + if part: + md.append(f"| {label} | {len(part)} | {cell([x['random_caught'] for x in part])} | {cell([x['random_precision'] for x in part])} | {cell([x['grep_caught'] for x in part])} | " + f"{cell([x['grep_recall'] for x in part])} | {cell([x['grep_precision'] for x in part])} | {cell([x['caught'] for x in part])} | " + f"{cell([x['recall'] for x in part])} | {cell([x['precision'] for x in part])} |") + md.append("") + text = "\n".join(md) + (ev.HERE / "results" / f"{name}.baselines.md").write_text(text) + (ev.HERE / "results" / f"{name}.baselines.json").write_text(json.dumps(all_rows, ensure_ascii=False, indent=1)) + print("\n" + text) + + +if __name__ == "__main__": + main() diff --git a/eval/cluster_boot.py b/eval/cluster_boot.py new file mode 100644 index 0000000..4e053e4 --- /dev/null +++ b/eval/cluster_boot.py @@ -0,0 +1,37 @@ +#!/usr/bin/env python3 +"""The same means with the project as the unit: the bootstrap draws projects, not functions. + +A run has few projects (ten), and functions of one project are alike; an interval over functions says how the number +moves with other functions of these projects, an interval over projects how it moves with other projects. + + python3 eval/cluster_boot.py [run ...] # names in eval/results (default: latest); several runs are pooled +""" +import json +import random +import sys + +import run as ev + +BOOT = 5000 +names = sys.argv[1:] or ["latest"] +results = [r for n in names for r in json.loads((ev.HERE / "results" / f"{n}.json").read_text()) if "error" not in r] +per_repo = [ev.metric_values(r) for r in results] +metrics = sorted({k for v in per_repo for k in v}) +rng = random.Random(1) +mean = lambda xs: sum(xs) / len(xs) +print(f"runs: {', '.join(names)} · {len(results)} projects · 90% intervals, {BOOT} resamples") +print(f"{'metric':28} {'functions':>9} {'mean':>6} {'over functions':>16} {'over projects':>16}") +for m in metrics: + groups = [v.get(m, []) for v in per_repo] + groups = [g for g in groups if g] + allv = [x for g in groups for x in g] + if len(allv) < 5: + continue + f = sorted(mean([rng.choice(allv) for _ in allv]) for _ in range(BOOT)) + p = [] + for _ in range(BOOT): + draw = [x for g in (rng.choice(groups) for _ in groups) for x in g] + p.append(mean(draw)) + p.sort() + lo, hi = int(0.05 * BOOT), int(0.95 * BOOT) - 1 + print(f"{m:28} {len(allv):>9} {100 * mean(allv):>5.0f}% {100 * f[lo]:>6.0f}–{100 * f[hi]:<6.0f} ±{50 * (f[hi] - f[lo]):<4.0f} {100 * p[lo]:>6.0f}–{100 * p[hi]:<6.0f} ±{50 * (p[hi] - p[lo]):.0f} ({len(groups)} projects)") diff --git a/eval/codebase_memory.py b/eval/codebase_memory.py new file mode 100644 index 0000000..7a42686 --- /dev/null +++ b/eval/codebase_memory.py @@ -0,0 +1,137 @@ +#!/usr/bin/env python3 +"""Another navigation tool on the functions of a run: Codebase-Memory (github.com/DeusData/codebase-memory-mcp), +a Tree-sitter graph served through the Model Context Protocol. It is asked who calls each sampled function and +judged by the run's own truth, the compiler's uses — as gitnext, the name search and the language servers are. + +The question: the `CALLS` edges into the function's node, taken with the tool's graph query +(`cli query_graph`); the node is the one with the function's name in the function's file, nearest to its line. +Each caller it names (name, file, line) is put onto the function gitnext has there, so that both tools are +compared in the same units. + + CBM_BIN= python3 eval/codebase_memory.py [run] # → results/.codebase-memory.{md,json} +""" +import json +import os +import re +import subprocess +import sys +from pathlib import Path + +import run as ev +from baselines import callers_rows, cell + +BIN = os.environ.get("CBM_BIN", "codebase-memory-mcp") + + +def tool(name: str, args: dict, timeout: int = 900) -> str: + return subprocess.run([BIN, "cli", "--quiet", name, json.dumps(args)], capture_output=True, text=True, timeout=timeout, errors="replace").stdout + + +def index(root: Path) -> str | None: + out = tool("index_repository", {"repo_path": str(root)}) + m = re.search(r'"project"\s*:\s*"([^"]+)"', out) + return m.group(1) if m else None + + +def hits_of(project: str, root: Path, syms: list[dict]): + by_file: dict[str, list[dict]] = {} + for s in syms: + if s["kind"] != "module": + by_file.setdefault(s["file"], []).append(s) + + def mine(name: str, file: str, line: int) -> dict | None: + """The function gitnext has for a node of the other tool: the same name in the same file, nearest by line.""" + same = [s for s in by_file.get(file, []) if s["name"] == name] + return min(same, key=lambda s: min(abs(s["start_line"] - line), abs(s["start_line"] + ev._def_offset(root, s) - line))) if same else None + + def hits(s: dict): + q = (f"MATCH (c)-[:CALLS]->(f) WHERE f.name = '{s['name']}' AND f.file_path = '{s['file']}' " + "RETURN c.name, c.file_path, c.start_line, f.start_line LIMIT 5000") + out = tool("query_graph", {"project": project, "query": q}) + if not re.search(r"^rows: \d+", out, re.M): + return None # the tool has no answer (an error), which is not "no callers" + if "has_more: true" in out: + print(f" {s['qualified']}: the answer is cut short", flush=True) + # long paths come shortened: a table of prefixes first ("rows_refs"), then `@N+suffix` in the rows + prefix = dict(re.findall(r"^ (\d+) (\S+)$", out[: out.index("\nrows: ")], re.M)) if out.startswith("rows_refs") else {} + + def path(p: str) -> str: + m = re.match(r"@(\d+)(?:\+(.*))?$", p) + return prefix[m.group(1)] + (m.group(2) or "") if m and m.group(1) in prefix else p + + rows = [] + for row in out[out.index("rows: "):].splitlines()[1:]: + m = re.match(r'\s+(\S+) (\S+) "(\d+)" "(\d+)"$', row) + if m: + rows.append((m.group(1), path(m.group(2)), int(m.group(3)), int(m.group(4)))) + # the node must be this function: another thing of the same name in the file is another node + rows = [r for r in rows if s["start_line"] <= r[3] <= s["end_line"]] + if not rows: + return [] + at = s["start_line"] + ev._def_offset(root, s) + node = min({r[3] for r in rows}, key=lambda ln: abs(ln - at)) + found = [] + for name, file, line, target in rows: + if target != node: + continue + c = mine(name, file, line) + if c: + found.append((c["file"], c["start_line"] + ev._def_offset(root, c))) + else: + found.append((file, line)) # no such function for gitnext: whatever stands at that line + return found + return hits + + +def main() -> None: + name = sys.argv[1] if len(sys.argv) > 1 else "latest" + results = [r for r in json.loads((ev.HERE / "results" / f"{name}.json").read_text()) if "error" not in r] + version = subprocess.run([BIN, "--version"], capture_output=True, text=True).stdout.strip() + all_rows = {"callers": [], "callers_common": [], "callers_blind": []} + for r in results: + if not any(r.get(k) for k in all_rows): + continue + repo = {"name": r["repo"], "lang": r["lang"], "commit": r["commit"]} + root = ev.WORK / r["repo"] + head = subprocess.run(["git", "rev-parse", "HEAD"], cwd=root, capture_output=True, text=True).stdout.strip() + if not head.startswith(r["commit"]): + print(f"{r['repo']}: the checkout is at {head[:12]}, the run was at {r['commit'][:12]} — skipped") + continue + ev.gx(["init"], root, timeout=1800) + syms = ev.symbols(root) + project = index(root) + if not project: + print(f"{r['repo']}: the other tool did not index it — skipped") + continue + ask = hits_of(project, root, syms) + for scope in all_rows: + got = callers_rows(root, repo, syms, r.get(scope, []), ask, prefix="other") + for g in got: + g["repo"] = r["repo"] + all_rows[scope] += got + print(f"{r['repo']}: " + ", ".join(f"{k} {sum(1 for x in v if x['repo'] == r['repo'])}" for k, v in all_rows.items()), flush=True) + + langs = [l for l in ("go", "rust", "java", "typescript", "python") if any(x["lang"] == l for v in all_rows.values() for x in v)] + md = [f"# Codebase-Memory on the functions of the run `{name}`", "", + f"`{version}`. Its `CALLS` edges into each sampled function against the compiler's uses, next to gitnext on the same functions. " + "± is half of a 90% bootstrap interval over the functions; precision is over the functions for which the tool names a caller.", ""] + titles = {"callers": "Callers — names that occur once", "callers_common": "Callers — methods that share a name", + "callers_blind": "Callers — whether or not gitnext sees a caller"} + for scope, title in titles.items(): + rows = all_rows[scope] + if not rows: + continue + md += [f"## {title}", "", "| | functions | Codebase-Memory: recall | Codebase-Memory: precision | gitnext: recall | gitnext: precision |", "|---|---|---|---|---|---|"] + for label, part in [("all", rows)] + [(l, [x for x in rows if x["lang"] == l]) for l in langs]: + if part: + md.append(f"| {label} | {sum(x['other_recall'] is not None for x in part)} | {cell([x['other_recall'] for x in part])} | {cell([x['other_precision'] for x in part])} | " + f"{cell([x['recall'] for x in part])} | {cell([x['precision'] for x in part])} |") + md.append("") + text = "\n".join(md) + (ev.HERE / "results" / f"{name}.codebase-memory.md").write_text(text) + (ev.HERE / "results" / f"{name}.codebase-memory.json").write_text(json.dumps(all_rows, ensure_ascii=False, indent=1)) + print("\n" + text) + + +if __name__ == "__main__": + main() diff --git a/eval/lsp_baseline.py b/eval/lsp_baseline.py new file mode 100644 index 0000000..0df2eb8 --- /dev/null +++ b/eval/lsp_baseline.py @@ -0,0 +1,217 @@ +#!/usr/bin/env python3 +"""The upper bound for callers: what a language server answers on the functions of a run. + +A language server has the compiler's own view of the code, which gitnext does without. For every function of the run +it is asked for the references of the definition (gopls: its command line; rust-analyzer: the language server protocol; +TypeScript: tsserver's own protocol); every reference is put into the function around it and compared with the run's truth. + + python3 eval/lsp_baseline.py [run] # → results/.lsp.{md,json}; a language whose server is not installed is skipped +""" +import json +import os +import re +import shutil +import subprocess +import sys +import time +from pathlib import Path + +import baselines as bl +import run as ev + + +def def_place(root: Path, s: dict) -> tuple[int, int] | None: + """Line (1-based) and column (0-based) of the name in the symbol's definition.""" + lines = (root / s["file"]).read_text(errors="replace").split("\n") + i = s["start_line"] - 1 + ev._def_offset(root, s) + col = ev.name_col(lines[i], s["name"]) if i < len(lines) else -1 + return (i + 1, col) if col >= 0 else None + + +class Wire: + """Messages with a Content-Length header over a process's pipes.""" + + def __init__(self, cmd: list[str], cwd: Path): + self.p = subprocess.Popen(cmd, cwd=cwd, stdin=subprocess.PIPE, stdout=subprocess.PIPE, stderr=subprocess.DEVNULL) + + def read(self) -> dict: + length = 0 + while True: + line = self.p.stdout.readline() + if not line: + raise RuntimeError("the server closed its output") + line = line.strip() + if not line: + if length: + break + continue + if line.lower().startswith(b"content-length:"): + length = int(line.split(b":")[1]) + return json.loads(self.p.stdout.read(length)) + + def close(self) -> None: + self.p.kill() + + +class Lsp(Wire): + def __init__(self, cmd, root: Path, options: dict | None = None): + super().__init__(cmd, root) + self.id = 0 + self.quiet = False + self.request("initialize", {"processId": os.getpid(), "rootUri": root.as_uri(), "capabilities": {"experimental": {"serverStatusNotification": True}}, + "initializationOptions": options or {}, + "workspaceFolders": [{"uri": root.as_uri(), "name": root.name}]}) + self.notify("initialized", {}) + + def send(self, msg: dict) -> None: + body = json.dumps({"jsonrpc": "2.0", **msg}).encode() + self.p.stdin.write(b"Content-Length: %d\r\n\r\n" % len(body) + body) + self.p.stdin.flush() + + def notify(self, method: str, params: dict) -> None: + self.send({"method": method, "params": params}) + + def request(self, method: str, params: dict): + self.id += 1 + self.send({"id": self.id, "method": method, "params": params}) + while True: + m = self.read() + if m.get("method") == "experimental/serverStatus": + self.quiet = bool(m["params"].get("quiescent")) + if "id" in m and "method" in m: # the server asks the client something: say there is nothing + self.send({"id": m["id"], "result": None}) + elif m.get("id") == self.id: + return m.get("result") + + def wait_ready(self, limit: int = 900) -> None: + end = time.time() + limit + while not self.quiet and time.time() < end: + m = self.read() + if m.get("method") == "experimental/serverStatus": + self.quiet = bool(m["params"].get("quiescent")) + elif "id" in m and "method" in m: + self.send({"id": m["id"], "result": None}) + + +def go_hits(root: Path): + gopls = shutil.which("gopls") or str(Path.home() / "go/bin/gopls") + if not Path(gopls).exists(): + return None + + def hits(s: dict): + at = def_place(root, s) + if not at: + return None + out = subprocess.run([gopls, "references", f"{s['file']}:{at[0]}:{at[1] + 1}"], cwd=root, capture_output=True, text=True, timeout=600).stdout + found = [] + for row in out.splitlines(): + m = re.match(r"(.+?):(\d+):\d+", row) + if m: + found.append((os.path.relpath(m.group(1), root), int(m.group(2)))) + return found + return hits, lambda: None + + +def rust_hits(root: Path): + ra = shutil.which("rust-analyzer") or subprocess.run(["rustup", "which", "rust-analyzer"], capture_output=True, text=True).stdout.strip() + if not ra or not Path(ra).exists(): + return None + # all features, as the run's compiler has them: code behind a feature is code too + server = Lsp([ra], root, {"cargo": {"features": "all"}}) + server.wait_ready() + + def hits(s: dict): + at = def_place(root, s) + if not at: + return None + got = server.request("textDocument/references", {"textDocument": {"uri": (root / s["file"]).as_uri()}, "position": {"line": at[0] - 1, "character": at[1]}, + "context": {"includeDeclaration": False}}) + return [(os.path.relpath(x["uri"].removeprefix("file://"), root), x["range"]["start"]["line"] + 1) for x in got or []] + return hits, server.close + + +def ts_hits(root: Path): + js = root / "node_modules/typescript/lib/tsserver.js" + if not js.exists(): + return None + server = Wire(["node", str(js)], root) + seq = [0] + + def ask(command: str, args: dict, answer: bool = True): + seq[0] += 1 + server.p.stdin.write((json.dumps({"seq": seq[0], "type": "request", "command": command, "arguments": args}) + "\n").encode()) + server.p.stdin.flush() + while answer: + m = server.read() + if m.get("type") == "response" and m.get("request_seq") == seq[0]: + return m.get("body") + + def hits(s: dict): + at = def_place(root, s) + if not at: + return None + file = str(root / s["file"]) + ask("open", {"file": file}, answer=False) + body = ask("references", {"file": file, "line": at[0], "offset": at[1] + 1}) + return [(os.path.relpath(x["file"], root), x["start"]["line"]) for x in (body or {}).get("refs", []) if not x.get("isDefinition")] + return hits, server.close + + +SERVERS = {"go": ("gopls", go_hits), "rust": ("rust-analyzer", rust_hits), "typescript": ("tsserver", ts_hits)} + + +def main() -> None: + name = sys.argv[1] if len(sys.argv) > 1 else "latest" + results = [r for r in json.loads((ev.HERE / "results" / f"{name}.json").read_text()) if "error" not in r and r["lang"] in SERVERS] + grep_rows = json.loads((ev.HERE / "results" / f"{name}.baselines.json").read_text()) if (ev.HERE / "results" / f"{name}.baselines.json").exists() else {} + rows = {"callers": [], "callers_common": []} + timing = {} + for r in results: + repo = {"name": r["repo"], "lang": r["lang"], "commit": r["commit"]} + root = (ev.WORK / r["repo"]).resolve() + t0 = time.time() + made = SERVERS[r["lang"]][1](root) + if made is None: + print(f"{r['repo']}: no {SERVERS[r['lang']][0]} here — skipped") + continue + hits, close = made + ready = time.time() - t0 + syms = ev.symbols(root) + n = 0 + t1 = time.time() + for scope in rows: + got = bl.callers_rows(root, repo, syms, r.get(scope, []), hits_of=hits, prefix="server") + for g in got: + g["repo"] = r["repo"] + rows[scope] += got + n += len(got) + close() + timing[r["repo"]] = {"server": SERVERS[r["lang"]][0], "ready_seconds": round(ready, 1), "seconds_per_function": round((time.time() - t1) / max(n, 1), 2)} + print(f"{r['repo']}: {n} functions, ready in {ready:.0f}s, {timing[r['repo']]['seconds_per_function']}s each", flush=True) + + md = [f"# Language servers on the functions of the run `{name}`", "", + "References of the definition, asked from gopls (Go), rust-analyzer (Rust) and tsserver (TypeScript); every reference is put into the " + "function around it. The truth is the run's own (the compiler's uses). ± is half of a 90% bootstrap interval over the functions.", ""] + for scope, title in (("callers", "Names that occur once"), ("callers_common", "Methods that share a name")): + part_all = rows[scope] + if not part_all: + continue + grep_of = {(x["repo"], x["symbol"]): x for x in grep_rows.get(scope, [])} + md += [f"## {title}", "", "| | functions | server: recall | server: precision | gitnext: recall | gitnext: precision | search: recall | search: precision |", "|---|---|---|---|---|---|---|---|"] + for label, part in [("all three", part_all)] + [(l, [x for x in part_all if x["lang"] == l]) for l in SERVERS]: + if part: + g = [grep_of[(x["repo"], x["symbol"])] for x in part if (x["repo"], x["symbol"]) in grep_of] + md.append(f"| {label} | {sum(x['recall'] is not None for x in part)} | {bl.cell([x['server_recall'] for x in part])} | {bl.cell([x['server_precision'] for x in part])} | " + f"{bl.cell([x['recall'] for x in part])} | {bl.cell([x['precision'] for x in part])} | " + f"{bl.cell([x['grep_recall'] for x in g])} | {bl.cell([x['grep_precision'] for x in g])} |") + md.append("") + md += ["## Time", "", "| project | server | ready after | per function |", "|---|---|---|---|"] + md += [f"| {k} | {v['server']} | {v['ready_seconds']} s | {v['seconds_per_function']} s |" for k, v in timing.items()] + text = "\n".join(md) + "\n" + (ev.HERE / "results" / f"{name}.lsp.md").write_text(text) + (ev.HERE / "results" / f"{name}.lsp.json").write_text(json.dumps({"rows": rows, "timing": timing}, ensure_ascii=False, indent=1)) + print("\n" + text) + + +if __name__ == "__main__": + main() diff --git a/eval/lsp_rename.py b/eval/lsp_rename.py new file mode 100644 index 0000000..84a4962 --- /dev/null +++ b/eval/lsp_rename.py @@ -0,0 +1,86 @@ +#!/usr/bin/env python3 +"""The rename of a language server on the functions of a run, judged as the tool's rename is judged: +after it the project must build and pass the tests that passed before. + +Go only: `gopls rename -w :: ` at the name in the definition. + + python3 eval/lsp_rename.py [run] # a name in eval/results (default: latest) → results/.lsp-rename.{md,json} +""" +import json +import shutil +import subprocess +import sys +from pathlib import Path + +import run as ev +import lsp_baseline as lb +from baselines import cell + + +def main() -> None: + name = sys.argv[1] if len(sys.argv) > 1 else "latest" + results = [r for r in json.loads((ev.HERE / "results" / f"{name}.json").read_text()) if "error" not in r and r["lang"] == "go"] + gopls = shutil.which("gopls") or str(Path.home() / "go/bin/gopls") + if not Path(gopls).exists(): + sys.exit("gopls is not installed") + ev._load_cache() + tool = ev.gx + rows = [] + for r in results: + repo = {"name": r["repo"], "lang": r["lang"], "commit": r["commit"]} + root = ev.WORK / r["repo"] + head = subprocess.run(["git", "rev-parse", "HEAD"], cwd=root, capture_output=True, text=True).stdout.strip() + if not head.startswith(r["commit"]): + print(f"{r['repo']}: the checkout is at {head[:12]}, the run was at {r['commit'][:12]} — skipped") + continue + L = ev.LANG[r["lang"]] + base = ev.cached(f"{repo['name']}@{repo['commit'][:12]}:baseline:{L.get('tests_key', 'tests')}", lambda: ev.baseline_tests(root, L), keep=lambda v: v["ran"]) + if not base["ran"]: + print(f"{r['repo']}: the test suite did not run — skipped") + continue + by_name = {s["qualified"]: s for s in ev.symbols(root)} + for x in r.get("rename", []): + s = by_name.get(x["symbol"]) + if not s: + continue + + def server(args, at_root, **kw): # the rename is the server's; everything else stays the tool's + if args[:1] != ["rename"]: + return tool(args, at_root, **kw) + at = lb.def_place(at_root, s) + if not at: + return 1, "the name is not on the line of the definition" + p = subprocess.run([gopls, "rename", "-w", f"{s['file']}:{at[0]}:{at[1] + 1}", args[2]], cwd=at_root, capture_output=True, text=True, timeout=600) + return p.returncode, p.stdout + p.stderr + + ev.gx = server + try: + v = ev.check_rename(root, repo, s, True, set(base["failed"])) + finally: + ev.gx = tool + rows.append({"repo": r["repo"], "symbol": x["symbol"], "server_ok": bool(v["ok"]), "server_stage": v.get("stage") or ("build" if v.get("compiled") is False else "tests" if v.get("tests_ok") is False else ""), + "server_detail": (v.get("detail") or "")[:300], "gitnext_ok": bool(x["ok"])}) + mine = [x for x in rows if x["repo"] == r["repo"]] + print(f"{r['repo']}: {len(mine)} renames, gopls {sum(x['server_ok'] for x in mine)}, gitnext {sum(x['gitnext_ok'] for x in mine)}", flush=True) + + md = [f"# The rename of a language server on the functions of the run `{name}`", "", + "`gopls rename` at the name in the definition, then the same check as for the tool: the project builds and the tests that passed " + "before still pass. ± is half of a 90% bootstrap interval over the functions.", "", + "| | renames | gopls: builds and tests pass | gitnext: builds and tests pass | both | only gopls | only gitnext | neither |", "|---|---|---|---|---|---|---|---|"] + for label, part in [("all", rows)] + [(n, [x for x in rows if x["repo"] == n]) for n in dict.fromkeys(x["repo"] for x in rows)]: + if part: + both = sum(x["server_ok"] and x["gitnext_ok"] for x in part) + md.append(f"| {label} | {len(part)} | {cell([float(x['server_ok']) for x in part])} | {cell([float(x['gitnext_ok']) for x in part])} | {both} | " + f"{sum(x['server_ok'] and not x['gitnext_ok'] for x in part)} | {sum(x['gitnext_ok'] and not x['server_ok'] for x in part)} | " + f"{sum(not x['server_ok'] and not x['gitnext_ok'] for x in part)} |") + bad = [x for x in rows if not x["server_ok"]] + if bad: + md += ["", "## Where the server's rename did not pass", ""] + [f"- `{x['repo']}` `{x['symbol']}` — {x['server_stage']}: {x['server_detail'][:160].strip()}" for x in bad] + text = "\n".join(md) + "\n" + (ev.HERE / "results" / f"{name}.lsp-rename.md").write_text(text) + (ev.HERE / "results" / f"{name}.lsp-rename.json").write_text(json.dumps(rows, ensure_ascii=False, indent=1)) + print("\n" + text) + + +if __name__ == "__main__": + main() diff --git a/eval/merge_runs.py b/eval/merge_runs.py new file mode 100644 index 0000000..5f1be72 --- /dev/null +++ b/eval/merge_runs.py @@ -0,0 +1,31 @@ +#!/usr/bin/env python3 +"""Several runs of eval/run.py over different projects as one: the per-project results joined, the summary over all. + + python3 eval/merge_runs.py ... # names in eval/results → results/.{json,noise.json,md} +""" +import json +import sys + +import run as ev + +out, parts = sys.argv[1], sys.argv[2:] +order = [r["name"] for r in json.loads((ev.HERE / "repos-heldout.json").read_text())] +results, secs, truth = [], 0, {"cached": 0, "asked": 0} +config = None +for p in parts: + results += json.loads((ev.HERE / "results" / f"{p}.json").read_text()) + n = json.loads((ev.HERE / "results" / f"{p}.noise.json").read_text()) + secs += n["seconds"] + config = config or n["config"] + for k in truth: + truth[k] += n["truth"].get(k, 0) +results.sort(key=lambda r: order.index(r["repo"]) if r["repo"] in order else len(order)) +agg = ev.scopes(results) +note = (f"Sample `{config}`. {len(results)} projects measured in {len(parts)} runs ({', '.join(parts)}); run time together: {secs // 60} min; " + f"of the compilers' and test suites' answers {truth['cached']} came from the cache, {truth['asked']} were asked.") +d = ev.HERE / "results" +(d / f"{out}.json").write_text(json.dumps(results, ensure_ascii=False, indent=1)) +(d / f"{out}.noise.json").write_text(json.dumps({"config": config, "seconds": secs, "truth": truth, "scopes": agg}, ensure_ascii=False, indent=1)) +md = ev.render_md(results, agg, note) +(d / f"{out}.md").write_text(md) +print(md) diff --git a/eval/repos-heldout.json b/eval/repos-heldout.json new file mode 100644 index 0000000..8a1d22c --- /dev/null +++ b/eval/repos-heldout.json @@ -0,0 +1,100 @@ +[ + { + "name": "pflag", + "lang": "go", + "url": "https://github.com/spf13/pflag", + "commit": "046b0d889369e6f70ae31483dffad578ffb10e2e", + "setup": "go mod download" + }, + { + "name": "mux", + "lang": "go", + "url": "https://github.com/gorilla/mux", + "commit": "db9d1d0073d27a0a2d9a8c1bc52aa0af4374d265", + "setup": "go mod download" + }, + { + "name": "itsdangerous", + "lang": "python", + "url": "https://github.com/pallets/itsdangerous", + "commit": "672971d66a2ef9f85151e53283113f33d642dabd", + "setup": "PY=$(command -v python3.13 || command -v python3.12 || command -v python3.11 || command -v python3.10 || echo python3) && rm -rf .venv && $PY -m venv .venv && .venv/bin/python -m pip -q install --upgrade pip && .venv/bin/pip -q install -e . pytest freezegun" + }, + { + "name": "more-itertools", + "lang": "python", + "url": "https://github.com/more-itertools/more-itertools", + "commit": "ceafee8ce96f4bc1eb74c528bc247c91d648a0bb", + "setup": "PY=$(command -v python3.13 || command -v python3.12 || command -v python3.11 || command -v python3.10 || echo python3) && rm -rf .venv && $PY -m venv .venv && .venv/bin/python -m pip -q install --upgrade pip && .venv/bin/pip -q install -e . pytest" + }, + { + "name": "byteorder", + "lang": "rust", + "url": "https://github.com/BurntSushi/byteorder", + "commit": "5a82625fae462e8ba64cec8146b24a372b4d75c6", + "setup": "cargo fetch -q" + }, + { + "name": "either", + "lang": "rust", + "url": "https://github.com/rayon-rs/either", + "commit": "1e4326df5972eb4a0ced66cb3b67fa0c5aca8493", + "setup": "cargo fetch -q" + }, + { + "name": "strsim", + "lang": "rust", + "url": "https://github.com/rapidfuzz/strsim-rs", + "commit": "dacc84c0dc61eff0ee0ff66962bcf2e17018ad26", + "setup": "cargo fetch -q" + }, + { + "name": "ufo", + "lang": "typescript", + "url": "https://github.com/unjs/ufo", + "commit": "f06c800d0c59f2a4a1b9ba65eb6cb61a84419be6", + "setup": "npm install --ignore-scripts --no-audit --no-fund --loglevel=error --legacy-peer-deps" + }, + { + "name": "pathe", + "lang": "typescript", + "url": "https://github.com/unjs/pathe", + "commit": "bc7477a01f0bd60ada017add8142c9f9d69ccdc5", + "setup": "npm install --ignore-scripts --no-audit --no-fund --loglevel=error --legacy-peer-deps" + }, + { + "name": "urfave-cli", + "lang": "go", + "url": "https://github.com/urfave/cli", + "commit": "d5c06cb04479eeacbbb9378ea26261b6be516320", + "setup": "go mod download" + }, + { + "name": "logrus", + "lang": "go", + "url": "https://github.com/sirupsen/logrus", + "commit": "6ef0748d1177dadaeee9aa79ffef604570f487d7", + "setup": "go mod download" + }, + { + "name": "marshmallow", + "lang": "python", + "url": "https://github.com/marshmallow-code/marshmallow", + "commit": "777ff66039fd939fc509226a33586bc3209df301", + "setup": "PY=$(command -v python3.13 || command -v python3.12 || command -v python3.11 || command -v python3.10 || echo python3) && rm -rf .venv && $PY -m venv .venv && .venv/bin/python -m pip -q install --upgrade pip && .venv/bin/pip -q install -e . pytest simplejson" + }, + { + "name": "boltons", + "lang": "python", + "url": "https://github.com/mahmoud/boltons", + "commit": "d31d821d56c8f7756af9c30a864077f2e5855321", + "setup": "PY=$(command -v python3.13 || command -v python3.12 || command -v python3.11 || command -v python3.10 || echo python3) && rm -rf .venv && $PY -m venv .venv && .venv/bin/python -m pip -q install --upgrade pip && .venv/bin/pip -q install -e . pytest" + }, + { + "name": "itertools", + "lang": "rust", + "url": "https://github.com/rust-itertools/itertools", + "commit": "8b4c6cb2732a08b3dcac681ca249ae413b998c83", + "setup": "cargo fetch -q" + } +] \ No newline at end of file diff --git a/eval/results/COVERAGE.md b/eval/results/COVERAGE.md index b88364a..a31898f 100644 --- a/eval/results/COVERAGE.md +++ b/eval/results/COVERAGE.md @@ -14,10 +14,11 @@ that the answer is right. | `rename` | the project still compiles and its tests pass | 91% ±3 (338) | | `tests-for` (and the tests part of `look`, `check`) | failing tests found; at least one of the first 10 fails | 49% ±6; 79% ±6 (167). TypeScript: 19% | | `learn-tests` (Python, Go, Rust) | the same with the learned map (`learn_tests.py`, `learn_tests_go.py`, `learn_tests_rust.py`) | 100% of the failing tests in all three (the graph: 19% on click, Go 78%, Rust 59%) | +| `learn-tests` (Java) | the map `gitnext learn-tests` writes against the tests that fail when a method raises (34 and 33 methods) | json-java 99%, jsoup 94% of the failing tests (the graph: 71% and 29%) | | `why`, `check ` | place of the function at fault for a seeded bug (`why_rank.py`, `why-rank.md`) | with the learned map the culprit is first in 81% of 57 seeded bugs (Python 90%, Go 82%, Rust 70%); from the call graph alone in 18% | | the tools as a small model uses them | `agent.py`, Qwen 3.5 4B: find / callers / rename / fix | see the agent runs in `HISTORY.md` | -## 2. Unit tests (`cargo test --workspace`, 139 tests) +## 2. Unit tests (`cargo test --workspace`, 149 tests) | function | tests | |---|---| @@ -29,6 +30,7 @@ that the answer is right. | `why` | `why.rs` (11) | | `tests-for`, the learned map | `tests_for.rs`, `testmap.rs` (8) | | `learn-tests`: Go, Rust | unit tests of the parsers of coverage output, and one end-to-end test each (skipped without `go` / `llvm-tools`) | +| `learn-tests`: Java | unit tests of the copy of the pom, the agent's filter, the jars it needs (4), what is said without a JVM, and one end-to-end test on Maven (`learn_java.rs`, skipped without `GITNEXT_TEST_MVN=1`) | | `check`, `context`, `locate`, `outline` | 3, 4, 2, 1 | | `look` (a place in a file), `edit`, `dead` | `look.rs` (3), `edit.rs` (3), `dead.rs` (1) | | semantic diff (`diff`, `since`, `changelog`), `libs`, `setup`, MCP server, TUI | 4, 3, 3, 2, 3 | diff --git a/eval/results/HISTORY.md b/eval/results/HISTORY.md index d194c28..7205ee8 100644 --- a/eval/results/HISTORY.md +++ b/eval/results/HISTORY.md @@ -5,6 +5,128 @@ Runs 1–5: five repos (one per language), one sample (seed 7, 8 functions, 4 mu From run 6 on: ten repos, 20 functions and 8 mutants per repo, three seeds, and a threshold next to every number. Since the run after run 4, a rename only counts as ok if the project's tests still pass too. +## Run 9 · baselines and projects held out from tuning + +A review of the write-up asked three things the earlier runs did not answer: what a plain search for the name gives on +the same functions, what a language server gives, and what the numbers are on projects the tool was not tuned on. +Nothing in the tool was changed in this run or because of it. + +**Baselines on the functions of run 8** (`eval/baselines.py`, `eval/lsp_baseline.py`; tables: `latest.baselines.md`, +`latest.lsp.md`). Recall / precision, %: + +| callers | functions | search for the name | gitnext | language servers | +|---|---|---|---|---| +| names that occur once | 232 | 100 / 89 ±3 | 100 / 99 ±1 | — | +| … of them Go, Rust, TypeScript | 147 | 100 / 92 ±3 | 100 / 99 ±1 | 100 / 100 | +| methods that share a name | 108 | 100 / 32 ±4 | 83 ±6 / 99 ±1 | — | +| … of them Go, Rust, TypeScript | 52 | 100 / 27 ±5 | 75 ±9 / 100 | 97 ±3 / 99 ±1 | + +- The truth for callers is a list of places where the name stands, so the search cannot miss one; what it shows is + how much the graph removes: one wrong answer in ten becomes one in a hundred, and for shared names two in three + become one in a hundred — at the price of one true caller in six. +- gopls, rust-analyzer (all features) and tsserver lose almost nothing on either side. rust-analyzer needs 10–25 s + before its first answer; gopls answers in 0.7 s per function. +- **Tests: ten at random catch a broken function in 61% ±5 of cases** — a function that fails on entry breaks 24% of + its project's tests on average. gitnext's 79% is 18 points above that, and in TypeScript below it (41% against + 90%). The search for the name in test bodies: caught 47%, recall 12%, precision 43%. gitnext: recall 49%, + precision 50% against a base rate of 24%. +- **Intervals with the project as the unit** (`eval/cluster_boot.py`): the same for callers; for tests twice as wide + (recall 49% ±14, caught 79% ±10). + +**Fourteen projects held out from tuning, measured once** (`repos-heldout.json`, `heldout.md`): pflag, mux, +urfave/cli, logrus (Go); itsdangerous, more-itertools, marshmallow, boltons (Python); byteorder, either, strsim, +itertools (Rust); ufo, pathe (TypeScript). No Java: commons-cli takes two minutes per build, javapoet does not build +with JDK 26. + +| | run 8, ten projects | held out, fourteen | +|---|---|---| +| callers: recall | 100% ±1 (232) | 99% ±1 (124) | +| callers: precision | 99% ±1 | 96% ±3 | +| callers, picked blind: recall | 99% ±1 (163) | 87% ±6 (103) | +| shared names: recall | 83% ±6 (108) | 73% ±7 (108) | +| shared names: precision | 100% ±2 | 99% ±2 | +| rename ok | 91% ±3 (338) | 77% ±5 (226) | +| tests: recall | 49% ±6 (167) | 72% ±6 (135) | +| tests: precision | 50% ±6 | 64% ±6 | +| tests: caught by the top 10 | 79% ±6 | 93% ±4 | + +- **Rename loses 14 points**: that is what the fixes of run 7 had bought on the sample they were found on. The + failures here: boltons (15, its tests), itertools (10), pathe (9, its tests import the renamed name), marshmallow (8). +- **Blind recall loses 12 points**: callers the graph does not see at all — a function passed as a value + (urfave/cli's `Action: LintActionFunc`), a getter read as a property (ufo's `$URL.href`), a trait method called + through a type parameter (byteorder's `T::from_slice_i64`). +- The baselines keep their order: the search 100 / 84 for unique names and 100 / 51 for shared ones, the language + servers 100 / 100 and 99 / 99, ten tests at random 52%. +- Over projects the intervals are ±9 for rename and ±17 for shared-name recall (six projects). +- A full disk stopped the first attempt of four projects; their cached truth was thrown away and they were run again. + +**`gitnext lsp` on the same functions** (`lsp-refined.compare.md`). The command, which the tool has had for a while, +asks a language server where each ambiguous call goes and keeps the answers in the index. Run once in cobra, chi +(gopls) and semver, indexmap (rust-analyzer) — 3 to 57 seconds per project — and the eval repeated on the functions of +run 8: + +| | functions | graph alone | after `gitnext lsp` | difference, 90% interval | +|---|---|---|---|---| +| shared names: recall | 42 | 78.0% | 96.4% | +18.5 (+9.5 … +27.4) | +| shared names: precision | 34 | 99.4% | 100.0% | +0.6 (0 … +1.8) | +| tests: recall | 59 | 69.4% | 77.9% | +8.5 (+3.4 … +13.9) | +| tests: caught by the top 10 | 59 | 79.7% | 86.4% | +6.8 (+1.7 … +11.9) | + +Nothing got worse; callers of unique names, blind recall and rename did not move. This closes most of the distance +to the language servers themselves (97%), for projects where one is installed. + +The same on the eight held-out Go and Rust projects (`heldout-lsp-refined.compare.md`; 4 to 185 seconds a project, +itertools the longest): shared names recall 72.7% → 92.7% ±4 on 108 methods (+19.9; +14.8 … +25.0), the language +servers themselves 99%. Go 70% → 93%, Rust 84% → 90% (18 methods, inside the noise). Blind recall (85%) and rename +(82%) did not move: a function passed as a value is not an ambiguous call. + +Time of one `callers` query once the index is built: 20–50 ms on eight of the ten projects, 0.16 s on json-java and +1.5 s on jsoup — the two Java ones; the graph is slow to resolve there, to be looked at. + +### A second tool on the same functions: Codebase-Memory (`eval/codebase_memory.py`) + +Codebase-Memory 0.12.1 (github.com/DeusData/codebase-memory-mcp), a Tree-sitter graph for agents, asked who calls +each sampled function: the `CALLS` edges into the function's node, read with its own `query_graph`; each caller it +names is put onto the function that stands at that place. The truth is the run's, the compiler's uses. + +| callers, recall / precision | functions | Codebase-Memory | gitnext | +|---|---|---|---| +| main, names that occur once | 232 | 85% ±4 / 96% ±2 | 100% / 99% ±1 | +| main, whether or not gitnext sees a caller | 163 | 85% ±5 / 98% ±1 | 99% ±1 / 100% | +| main, methods that share a name | 108 | 58% ±8 / 85% ±5 | 83% ±5 / 99% ±1 | +| held out, names that occur once | 124 | 71% ±6 / 85% ±5 | 99% ±1 / 95% ±3 | +| held out, whether or not gitnext sees a caller | 103 | 60% ±8 / 83% ±6 | 87% ±6 / 94% ±4 | +| held out, methods that share a name | 108 | 10% ±5 / 72% ±16 | 73% ±7 / 99% ±2 | + +By language on the main sample (names that occur once): Go 97% recall, Java 100%, TypeScript 97%, Rust 15%. +Two causes, both looked at by hand: + +- **Go: a function and a method of the same name are one node.** In pflag the call `f.FlagUsages()` inside + `FlagSet.PrintDefaults` is given to the function `PrintDefaults`; the method has no node. Hence 7% recall on + the 90 held-out Go methods that share a name. +- **Rust: a call made inside a method belongs to the file.** In indexmap the caller of `sort_unstable_keys` is the + node `set.rs`, not `IndexSet::sort_unstable_keys`; no calling function is named for 31 of the 32 sampled functions. + +The functions are drawn from gitnext's own list of symbols, which favours gitnext: this shows that the method +tells two tools apart and names the cause, it does not rank them. + + +### The language server's own rename on the same functions (Go, `eval/lsp_rename.py`) + +`gopls rename` at the name in the definition, then the same check as for the tool: the project builds and the tests +that passed before still pass. + +| | renames | gopls | gitnext | both | only gopls | only gitnext | neither | +|---|---|---|---|---|---|---|---| +| main sample: cobra, chi | 81 | 96% ±4 | 93% ±4 | 73 | 5 | 2 | 1 | +| held out: pflag, mux, urfave/cli, logrus | 41 | 88% ±9 | 78% ±10 | 28 | 8 | 4 | 1 | + +The server's rename does not reach 100% under this check either. What it leaves: a method name inside a text +template (`{{.UseLine}}`, `{{.FullName}}`, `{{.VisibleFlags}}`) or a string, an example function named after the +method (`ExampleCommand_Walk_visibleTree`, which then does not compile), and a rename it refuses because the type +would stop satisfying an interface (`flagCompError.Error`). gitnext, which replaces the name in text too, passes +6 renames that gopls does not and fails 13 that gopls passes. + ## The agent runs · a 4B local model with and without gitnext `eval/agent.py` (`sh eval/run_agent_mac.sh`): Qwen 3.5 4B on llama.cpp, the projects click (Python) and semver (Rust). @@ -105,6 +227,116 @@ What the conversations showed: the repo, a shell command, a library function), 5 a name that is not in the file given, 62 repeated an earlier call. - Rust `why` with the map after macros became symbols: the function at fault first in 17 of 20 (it was 14). +### The same 648 conversations, call by call (`eval/agent_traces.py`) + +Calls per run (mean) and what they are: + +| task | mode | solved | calls | what the calls are | calls that bring nothing | +|---|---|---|---|---|---| +| find | plain | 53 / 54 | 2.9 | search 1.7, read 0.3 | 0.6 (a search with no match) | +| find | five tools | 54 / 54 | 2.1 | look 1.0 | 0 | +| callers | plain | 37 / 54 | 8.0 | read 4.0, search 3.0 | 2.7 (2.0 are a file read again) | +| callers | five tools | 47 / 54 | 3.6 | look 2.8 | 0.4 | +| fix | plain | 14 / 54 | 20.3 | read 7.4, search 6.3, run 5.3, edit 1.0 | 5.8 (3.9 are a file read again) | +| fix | five tools | 26 / 54 | 16.3 | look 10.2, check 3.4, edit 2.2 | 4.2 (3.0 are the same call again) | +| rename | plain | 40 / 54 | 15.2 | edit 5.1, read 3.8, search 3.1, run 2.4 | 3.2 | +| rename | five tools | 36 / 54 | 6.5 | look 2.6, check 1.6, edit 1.2 | 1.0 | + +- **Where plain tools spend their calls.** A quarter to a third of them bring nothing new (4B 30%, 9B 24%, 27B 25%): + a file read again, a `grep` with no match (170 of 908), an edit refused because the old text stands in several + places (53 of 383). With the five tools it is 16–23%, and of another kind: the same call repeated. +- **A fix is lost before the first edit.** With plain tools 31 of 54 fix runs change any code at all, and the first + change comes at call 12–17 of 25; 29 of the 40 failed runs end out of steps. The 27B model with gitnext changes + code in 35 of 36 runs, at call 3. The small models do not get there with any tools (4B: 10 of 18 plain, 10 of 18 + with five tools). +- **With eleven tools, gitnext's are often not called at all:** 4B in 21 of 72 runs, 27B in 23 (nearly all are + `find`, where one `grep` is enough), 9B in 2. +- **Lost against plain tools on the same task: 13 of 216 in each gitnext mode; won: 25 and 32.** Of the 13 lost + with five tools: 5 are the sqlparse rename the judge fails for a name left in `.rst` (above); 3 are runs where the + model gave no answer at all (9 such runs in the whole set: 2 plain, 2 gitnext, 5 five tools — counted as + failures); 2 are a rename in cobra, below; 2 are callers of `contains`, a name several things have; 1 is a fix the + 4B model lost in refused `replace` calls. +- **`check` blames the change for a test that fails without it.** cobra's `TestFailGenFishCompletionFile` fails on + the test machine whatever the code (it expects a permission error, and the run is root). After a correct rename + `check` reported it as "tests FAILED"; the 27B model renamed the function back, the 4B model started rewriting + the test. cobra renames: plain 6 of 9, eleven tools 5, five tools 3. `check` now runs the failed tests on the + last commit too and says which of them fail without the change (the same rename: `tests AS BEFORE`, verdict ok). +- **`replace` is called like a text edit.** Of 129 `replace` / `add_after` calls with five tools, 66 made an edit; + 21 gave a line of code as the name of the symbol (`replace("if a == b {", "if a != b {")`), 16 a name that is + not there, 18 repeated a refused call. All of the first kind are the 4B model. `replace` now makes that edit. +- **The harness is not the same in every mode.** The guard (hints after repeated or idle steps) acts in all three. + The gate acts in the gitnext modes only: an answer given before any tool call is sent back, and with five tools + the harness also asks once for the change when no file was changed and reruns `check` after one. With five tools + it fired on every `find` and `callers` run (one more step, the answer repeated) and stands behind at most 4 of + the 163 solved tasks (3 renames through the `check` it reran, 1 fix after "no file was changed"). + With those four counted as unsolved: 159 against 144, +32 −17 (sign test p = 0.044), +6.9 points, 95% interval + −1.9 to +15.3 — it includes zero. Plain tools solved all four of these tasks as well. + +### A large project: Prometheus, 406 thousand lines of Go (two models, 12 task sets) + +Prometheus at `f4838fa` (766 Go files, 406,642 lines; indexed in 7 s; the first build takes 8.7 minutes), the gitnext +0.3.1 release binary, the 4B and 27B models, the harness of the full run. Tasks: find, callers, rename (a seeded bug +needs the test suite, which does not fit the time). 12 task sets, each task once: 36 tasks per model in every mode, +216 runs. Rows: `agent-kaggle-big-20261114.json`; tables: `eval/agent_stats.py`, `eval/agent_traces.py`. + +| solved | plain | eleven tools | five tools | +|---|---|---|---| +| 4B, of 36 | 23 | 29 | 30 | +| 27B, of 36 | 26 | 32 | 32 | +| both, of 72 | 49 | 61 | 62 | +| find, of 24 | 24 | 24 | 24 | +| callers, of 24 | 14 | 21 | 23 | +| rename, of 24 | 11 | 16 | 15 | +| median steps | 8 | 4 | 3 | +| tokens sent per task | 47.4k | 22.1k | 15.6k | + +- **Plain → five tools: +14 −1 (p = 0.001), +18.1 points, 95% interval +6.9 to +30.6** (bootstrap over the 36 tasks). + Plain → eleven tools: +14 −2 (p = 0.004), +16.7 points, +5.6 to +27.8. Each model alone, five tools: 4B +8 −1 + (p = 0.04), 27B +6 −0 (p = 0.03). On the six small projects the same comparison gave +8.8 points. +- **Callers is where a large project hurts plain tools:** 8.0 file reads per run, 5.3 of them of a file already + read; 4 of the 10 failed runs end out of steps, 6 with a wrong list. With five tools: 3.5 `look` calls, 23 of 24. +- **The 27B model sends five times fewer tokens** (53.2k → 10.5k per task) and 8% of its calls bring nothing, + against 36% with plain tools. +- **Three of the twelve renames cannot pass in any mode:** the judge's `git grep -w` finds another thing of the same + name (`os.Rename`, a struct field `IsolationDisabled`, a field `DroppedTargets`). Without them rename is 11 / 16 / + 15 of 18. + From the next run on the judge of a compiled language asks for what the compiler can tell: the project builds, + the old definition is gone and the new one is there (Python keeps the word rule: it has no compiler). +- **The gate did not make the difference:** with five tools it fired on every `find` and `callers` run (the answer + repeated) and on no rename; the eleven-tool mode has no such gate and solves 61. +- Limits: one project in one language, each task once, no bug fixes, two models of one family. + +### Three changes made after reading the conversations, measured on new tasks (two models, 12 task sets) + +After the 648 conversations were read call by call, three things were changed in the tool: `why` and `check` end +with the next line to act on, `replace` takes a line of code given in place of a name, and `check` reruns a failed +test on the code as it was before the change and says so when it failed there too. The comparison: the 0.3.1 release +("old") against the same release with these changes ("new"), five tools, Qwen 3.5 4B and 9B (Q4_K_M, one T4 each), +six projects, bug fixing and renaming, 12 task sets drawn with a new seed — 144 tasks per model, each solved with +both builds. A rename is judged by the new check (the build passes, the old definition is gone, the new one is +there). `results/agent-kaggle-ab-20261115.json`; 6.9 hours. + +| solved | old | new | gained / lost | difference | 95% interval | p | +|---|---|---|---|---|---|---| +| 4B, of 144 | 88 | 99 | +18 −7 | +7.6 | +1.4 … +14.6 | 0.043 (sign) | +| 9B, of 144 | 113 | 121 | +9 −1 | +5.6 | +1.4 … +9.7 | 0.021 (sign) | +| both, of 288 | 201 | 220 | +27 −8 | +6.6 | +2.4 … +10.8 | 0.005 (permutation by task) | +| bug fixing, both, of 144 | 72 | 85 | +21 −8 | +9.0 | +1.4 … +17.4 | 0.046 | +| renaming, both, of 144 | 129 | 135 | +6 −0 | +4.2 | +1.4 … +7.6 | 0.032 | + +- **The 4B model stops wandering.** Median steps 14 → 5, median input tokens 51.9k → 8.2k, median time 51 s → 18 s; + for 9B 5 → 4 steps and 9.2k → 6.1k tokens. The harness had to send a failed check back to the model in 17 old + runs and in 3 new ones. +- **Renames pass in 90–94% of runs under the new check** (65 and 64 of 72 old, 68 and 67 new) — against 12 of 18 + under the old one, which also wanted the old word gone from the whole project. +- **The bug-fix tasks of cobra cannot pass on this machine, in either build: 0 of 48.** The judge wanted no failing + test at all, and cobra has one that fails when the suite runs as root, before any change. The same holds for the + 27 cobra bug-fix runs of the three-model experiment above (0 in every mode). The judge now leaves out the tests + that failed before the bug was seeded (`eval/agent.py`); the numbers above are as they were measured. +- Ten pairs had a run that ended with a server error (HTTP 500) and counts as unsolved; without them 199 → 218 of + 278, p = 0.002. + + ## Run 8 · in TypeScript the test is the file; coverage maps for Go and Rust **tests-for, TypeScript.** `it('…', () => …)` is not a named function; its calls are booked to the module of the diff --git a/eval/results/agent-kaggle-ab-20261115.json b/eval/results/agent-kaggle-ab-20261115.json new file mode 100644 index 0000000..92ebe83 --- /dev/null +++ b/eval/results/agent-kaggle-ab-20261115.json @@ -0,0 +1,12884 @@ +[ +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 0, +"repo": "chi", +"task": "rename", +"target": "main::NewRouteContext", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 4972, +"tokens_out": 151, +"seconds": 9, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 0, +"repo": "chi", +"task": "fix", +"target": "middleware::parseRemoteAddr", +"mode": "lite", +"passed": false, +"steps": 25, +"tokens_in": 220787, +"tokens_out": 2677, +"seconds": 162, +"stopped": "steps", +"guard": { +"repeats": 4, +"soft_budget": 1 +}, +"tools": { +"check": 3, +"look": 21, +"replace": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 0, +"repo": "click", +"task": "rename", +"target": "click::core::iter_params_for_processing", +"mode": "lite", +"passed": true, +"steps": 3, +"tokens_in": 3123, +"tokens_out": 152, +"seconds": 9, +"guard": {}, +"tools": { +"rename": 1, +"check": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 0, +"repo": "click", +"task": "fix", +"target": "click::_compat::get_text_stdin", +"mode": "lite", +"passed": false, +"steps": 25, +"tokens_in": 169629, +"tokens_out": 1618, +"seconds": 86, +"stopped": "steps", +"guard": { +"repeats": 7, +"no_progress": 1, +"soft_budget": 1 +}, +"tools": { +"check": 2, +"look": 22, +"replace": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 0, +"repo": "cobra", +"task": "rename", +"target": "main::Command::ValidateRequiredFlags", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 5083, +"tokens_out": 179, +"seconds": 12, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 0, +"repo": "cobra", +"task": "fix", +"target": "main::Command::PersistentFlags", +"mode": "lite", +"passed": false, +"steps": 16, +"tokens_in": 66843, +"tokens_out": 560, +"seconds": 24, +"stopped": "no_progress", +"guard": { +"repeats": 8, +"no_progress": 2 +}, +"tools": { +"check": 1, +"look": 15 +} +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 0, +"repo": "indexmap", +"task": "rename", +"target": "indexmap::inner::extract::ExtractCore::remaining", +"mode": "lite", +"passed": true, +"steps": 3, +"tokens_in": 3959, +"tokens_out": 141, +"seconds": 7, +"guard": {}, +"tools": { +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 0, +"repo": "indexmap", +"task": "fix", +"target": "indexmap::inner::Core::reserve_entries", +"mode": "lite", +"passed": false, +"steps": 5, +"tokens_in": 9842, +"tokens_out": 1034, +"seconds": 35, +"guard": {}, +"tools": { +"check": 2, +"look": 1, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 0, +"repo": "semver", +"task": "rename", +"target": "semver::eval::matches_comparator", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 3891, +"tokens_out": 178, +"seconds": 6, +"guard": { +"repeats": 1 +}, +"tools": { +"rename": 1, +"check": 2, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 0, +"repo": "semver", +"task": "fix", +"target": "semver::eval::matches_greater", +"mode": "lite", +"passed": false, +"steps": 25, +"tokens_in": 184294, +"tokens_out": 5002, +"seconds": 181, +"stopped": "steps", +"guard": { +"repeats": 4, +"soft_budget": 1 +}, +"tools": { +"check": 3, +"replace": 2, +"look": 20 +} +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 0, +"repo": "sqlparse", +"task": "rename", +"target": "sqlparse::engine::grouping::group_order", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 5262, +"tokens_out": 163, +"seconds": 10, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 0, +"repo": "sqlparse", +"task": "fix", +"target": "sqlparse::filters::others::SpacesAroundOperatorsFilter::_process", +"mode": "lite", +"passed": false, +"seconds": 46, +"error": "HTTP Error 500: Internal Server Error" +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 1, +"repo": "chi", +"task": "rename", +"target": "_examples::rest::NewUserPayloadResponse", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 4108, +"tokens_out": 139, +"seconds": 8, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 1, +"repo": "chi", +"task": "fix", +"target": "main::node::findPattern", +"mode": "lite", +"passed": true, +"steps": 25, +"tokens_in": 167221, +"tokens_out": 4650, +"seconds": 171, +"stopped": "steps", +"guard": { +"repeats": 12, +"no_progress": 1, +"soft_budget": 1 +}, +"tools": { +"check": 7, +"replace": 4, +"look": 12, +"add_after": 2 +} +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 1, +"repo": "click", +"task": "rename", +"target": "examples::imagepipe::imagepipe::convert_flip", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 4300, +"tokens_out": 140, +"seconds": 7, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 1, +"repo": "click", +"task": "fix", +"target": "click::_compat::get_text_stderr", +"mode": "lite", +"passed": true, +"steps": 15, +"tokens_in": 76520, +"tokens_out": 838, +"seconds": 44, +"stopped": "no_progress", +"guard": { +"repeats": 9, +"no_progress": 2 +}, +"tools": { +"check": 2, +"look": 12, +"replace": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 1, +"repo": "cobra", +"task": "rename", +"target": "main::CheckErr", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 5080, +"tokens_out": 148, +"seconds": 17, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 1, +"repo": "cobra", +"task": "fix", +"target": "main::writeShortFlag", +"mode": "lite", +"passed": false, +"steps": 24, +"tokens_in": 168502, +"tokens_out": 3810, +"seconds": 133, +"guard": { +"repeats": 4, +"soft_budget": 1 +}, +"tools": { +"check": 4, +"replace": 1, +"look": 19 +} +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 1, +"repo": "indexmap", +"task": "rename", +"target": "indexmap::set::IndexSet::is_subset", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 4903, +"tokens_out": 166, +"seconds": 20, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 1, +"repo": "indexmap", +"task": "fix", +"target": "indexmap::inner::entry::OccupiedEntry::swap_indices", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 8348, +"tokens_out": 406, +"seconds": 19, +"guard": {}, +"tools": { +"check": 2, +"look": 1, +"replace": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 1, +"repo": "semver", +"task": "rename", +"target": "semver::identifier::Identifier::ptr_eq", +"mode": "lite", +"passed": true, +"steps": 3, +"tokens_in": 2920, +"tokens_out": 138, +"seconds": 6, +"guard": {}, +"tools": { +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 1, +"repo": "semver", +"task": "fix", +"target": "semver::display::Version::fmt", +"mode": "lite", +"passed": false, +"seconds": 45, +"error": "HTTP Error 500: Internal Server Error" +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 1, +"repo": "sqlparse", +"task": "rename", +"target": "sqlparse::lexer::Lexer::default_initialization", +"mode": "lite", +"passed": true, +"steps": 3, +"tokens_in": 3051, +"tokens_out": 143, +"seconds": 6, +"guard": {}, +"tools": { +"rename": 1, +"check": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 1, +"repo": "sqlparse", +"task": "fix", +"target": "sqlparse::engine::grouping::group_period", +"mode": "lite", +"passed": false, +"steps": 19, +"tokens_in": 103186, +"tokens_out": 3066, +"seconds": 100, +"guard": { +"repeats": 4 +}, +"tools": { +"check": 1, +"look": 16, +"finish": 1 +}, +"text_code": 1 +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 10, +"repo": "chi", +"task": "rename", +"target": "main::RegisterMethod", +"mode": "lite", +"passed": true, +"steps": 7, +"tokens_in": 13288, +"tokens_out": 387, +"seconds": 15, +"guard": {}, +"tools": { +"look": 4, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 10, +"repo": "chi", +"task": "fix", +"target": "main::Mux::handle", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 6263, +"tokens_out": 516, +"seconds": 46, +"guard": {}, +"tools": { +"check": 2, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 10, +"repo": "click", +"task": "rename", +"target": "click::core::iter_params_for_processing", +"mode": "lite", +"passed": true, +"steps": 3, +"tokens_in": 3123, +"tokens_out": 155, +"seconds": 9, +"guard": {}, +"tools": { +"rename": 1, +"check": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 10, +"repo": "click", +"task": "fix", +"target": "click::exceptions::UsageError::show", +"mode": "lite", +"passed": false, +"steps": 25, +"tokens_in": 194921, +"tokens_out": 1125, +"seconds": 124, +"stopped": "steps", +"guard": { +"repeats": 1, +"soft_budget": 1 +}, +"tools": { +"check": 1, +"look": 24 +} +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 10, +"repo": "cobra", +"task": "rename", +"target": "main::Command::CalledAs", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 4731, +"tokens_out": 175, +"seconds": 9, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 10, +"repo": "cobra", +"task": "fix", +"target": "main::Command::getHelpTemplateFunc", +"mode": "lite", +"passed": false, +"steps": 25, +"tokens_in": 169746, +"tokens_out": 3943, +"seconds": 150, +"stopped": "steps", +"guard": { +"repeats": 2, +"soft_budget": 1 +}, +"tools": { +"check": 3, +"replace": 1, +"look": 21 +} +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 10, +"repo": "indexmap", +"task": "rename", +"target": "indexmap::inner::extract::ExtractCore::remaining", +"mode": "lite", +"passed": true, +"steps": 3, +"tokens_in": 3959, +"tokens_out": 134, +"seconds": 7, +"guard": {}, +"tools": { +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 10, +"repo": "indexmap", +"task": "fix", +"target": "indexmap::map::IndexMap::with_capacity_and_hasher", +"mode": "lite", +"passed": false, +"steps": 15, +"tokens_in": 51195, +"tokens_out": 1568, +"seconds": 56, +"stopped": "no_progress", +"guard": { +"repeats": 9, +"no_progress": 2 +}, +"tools": { +"check": 7, +"look": 5, +"replace": 2, +"add_after": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 10, +"repo": "semver", +"task": "rename", +"target": "semver::identifier::Identifier::ptr_eq", +"mode": "lite", +"passed": true, +"steps": 3, +"tokens_in": 2920, +"tokens_out": 138, +"seconds": 6, +"guard": {}, +"tools": { +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 10, +"repo": "semver", +"task": "fix", +"target": "semver::identifier::Identifier::is_empty", +"mode": "lite", +"passed": true, +"steps": 5, +"tokens_in": 8350, +"tokens_out": 485, +"seconds": 16, +"guard": {}, +"tools": { +"check": 2, +"look": 1, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 10, +"repo": "sqlparse", +"task": "rename", +"target": "sqlparse::lexer::Lexer::add_keywords", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 4891, +"tokens_out": 171, +"seconds": 7, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 10, +"repo": "sqlparse", +"task": "fix", +"target": "sqlparse::sql::TokenList::get_parent_name", +"mode": "lite", +"passed": false, +"steps": 25, +"tokens_in": 124942, +"tokens_out": 2201, +"seconds": 73, +"stopped": "steps", +"guard": { +"soft_budget": 1 +}, +"tools": { +"check": 1, +"look": 24 +} +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 11, +"repo": "chi", +"task": "rename", +"target": "main::RegisterMethod", +"mode": "lite", +"passed": true, +"steps": 7, +"tokens_in": 13276, +"tokens_out": 335, +"seconds": 14, +"guard": {}, +"tools": { +"look": 4, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 11, +"repo": "chi", +"task": "fix", +"target": "middleware::RequestID", +"mode": "lite", +"passed": true, +"steps": 14, +"tokens_in": 42569, +"tokens_out": 1227, +"seconds": 66, +"guard": { +"repeats": 1 +}, +"tools": { +"check": 3, +"look": 9, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 11, +"repo": "click", +"task": "rename", +"target": "click::formatting::HelpFormatter::dedent", +"mode": "lite", +"passed": false, +"steps": 4, +"tokens_in": 5126, +"tokens_out": 202, +"seconds": 10, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 11, +"repo": "click", +"task": "fix", +"target": "click::core::Option::add_to_parser", +"mode": "lite", +"passed": true, +"steps": 25, +"tokens_in": 191346, +"tokens_out": 1673, +"seconds": 156, +"stopped": "steps", +"guard": { +"repeats": 1, +"soft_budget": 1 +}, +"tools": { +"check": 2, +"replace": 1, +"look": 22 +} +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 11, +"repo": "cobra", +"task": "rename", +"target": "main::Command::PersistentFlags", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 6510, +"tokens_out": 172, +"seconds": 16, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 11, +"repo": "cobra", +"task": "fix", +"target": "doc::GenMan", +"mode": "lite", +"passed": false, +"steps": 25, +"tokens_in": 132630, +"tokens_out": 1136, +"seconds": 43, +"stopped": "steps", +"guard": { +"repeats": 1, +"soft_budget": 1 +}, +"tools": { +"check": 1, +"look": 24 +} +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 11, +"repo": "indexmap", +"task": "rename", +"target": "indexmap::util::try_simplify_range", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 5304, +"tokens_out": 184, +"seconds": 11, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 11, +"repo": "indexmap", +"task": "fix", +"target": "indexmap::map::IndexMap::replace_index", +"mode": "lite", +"passed": false, +"steps": 24, +"tokens_in": 208724, +"tokens_out": 5806, +"seconds": 228, +"gate": { +"nochange": 1 +}, +"guard": { +"repeats": 3, +"soft_budget": 1 +}, +"tools": { +"check": 3, +"look": 20, +"replace": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 11, +"repo": "semver", +"task": "rename", +"target": "semver::identifier::Identifier::empty", +"mode": "lite", +"passed": true, +"steps": 3, +"tokens_in": 3730, +"tokens_out": 136, +"seconds": 7, +"guard": {}, +"tools": { +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 11, +"repo": "semver", +"task": "fix", +"target": "semver::identifier::Identifier::is_empty", +"mode": "lite", +"passed": false, +"seconds": 174, +"error": "HTTP Error 500: Internal Server Error" +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 11, +"repo": "sqlparse", +"task": "rename", +"target": "benchmarks::bench_lexer_delimiters::unmatched_dollar_quotes", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 3991, +"tokens_out": 206, +"seconds": 6, +"guard": { +"repeats": 1 +}, +"tools": { +"rename": 1, +"check": 2, +"finish": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 11, +"repo": "sqlparse", +"task": "fix", +"target": "sqlparse::cli::main", +"mode": "lite", +"passed": true, +"steps": 23, +"tokens_in": 112554, +"tokens_out": 1590, +"seconds": 56, +"stopped": "no_progress", +"guard": { +"repeats": 12, +"no_progress": 2, +"soft_budget": 1 +}, +"tools": { +"check": 12, +"replace": 1, +"look": 10 +} +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 2, +"repo": "chi", +"task": "rename", +"target": "_examples::fileserver::FileServer", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 4213, +"tokens_out": 247, +"seconds": 9, +"guard": { +"repeats": 1 +}, +"tools": { +"rename": 1, +"check": 2, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 2, +"repo": "chi", +"task": "fix", +"target": "middleware::GetHead", +"mode": "lite", +"passed": true, +"steps": 11, +"tokens_in": 44213, +"tokens_out": 2558, +"seconds": 100, +"guard": { +"repeats": 2 +}, +"tools": { +"check": 4, +"replace": 1, +"look": 5, +"finish": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 2, +"repo": "click", +"task": "rename", +"target": "click::core::Command::get_help_option_names", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 5397, +"tokens_out": 184, +"seconds": 10, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 2, +"repo": "click", +"task": "fix", +"target": "click::utils::_make_default_short_help", +"mode": "lite", +"passed": false, +"steps": 12, +"tokens_in": 58609, +"tokens_out": 3939, +"seconds": 117, +"guard": { +"repeats": 3 +}, +"tools": { +"check": 4, +"look": 6, +"replace": 2 +} +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 2, +"repo": "cobra", +"task": "rename", +"target": "main::Command::Name", +"mode": "lite", +"passed": true, +"steps": 17, +"tokens_in": 108523, +"tokens_out": 1350, +"seconds": 55, +"gate": { +"check": 1 +}, +"guard": { +"repeats": 3 +}, +"tools": { +"rename": 1, +"look": 7, +"replace": 7, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 2, +"repo": "cobra", +"task": "fix", +"target": "main::Command::hasNameOrAliasPrefix", +"mode": "lite", +"passed": false, +"steps": 25, +"tokens_in": 160954, +"tokens_out": 5506, +"seconds": 192, +"stopped": "steps", +"guard": { +"repeats": 3, +"soft_budget": 1 +}, +"tools": { +"check": 4, +"replace": 1, +"look": 20 +} +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 2, +"repo": "indexmap", +"task": "rename", +"target": "indexmap::map::IndexMap::sort_unstable_keys", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 4625, +"tokens_out": 155, +"seconds": 11, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 2, +"repo": "indexmap", +"task": "fix", +"target": "indexmap::inner::Core::decrement_indices", +"mode": "lite", +"passed": false, +"steps": 20, +"tokens_in": 146769, +"tokens_out": 3314, +"seconds": 122, +"gate": { +"nochange": 1 +}, +"guard": { +"repeats": 1, +"soft_budget": 1 +}, +"tools": { +"check": 3, +"look": 17 +} +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 2, +"repo": "semver", +"task": "rename", +"target": "semver::identifier::Identifier::ptr_eq", +"mode": "lite", +"passed": true, +"steps": 3, +"tokens_in": 2920, +"tokens_out": 135, +"seconds": 6, +"guard": {}, +"tools": { +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 2, +"repo": "semver", +"task": "fix", +"target": "semver::display::Version::fmt", +"mode": "lite", +"passed": false, +"steps": 20, +"tokens_in": 143407, +"tokens_out": 6234, +"seconds": 175, +"gate": { +"nochange": 1 +}, +"guard": { +"repeats": 9, +"no_progress": 1, +"soft_budget": 1 +}, +"tools": { +"check": 2, +"look": 17, +"replace": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 2, +"repo": "sqlparse", +"task": "rename", +"target": "sqlparse::lexer::Lexer::default_initialization", +"mode": "lite", +"passed": true, +"steps": 3, +"tokens_in": 3051, +"tokens_out": 148, +"seconds": 6, +"guard": {}, +"tools": { +"rename": 1, +"check": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 2, +"repo": "sqlparse", +"task": "fix", +"target": "sqlparse::engine::grouping::group_values", +"mode": "lite", +"passed": false, +"steps": 24, +"tokens_in": 127948, +"tokens_out": 2613, +"seconds": 81, +"stopped": "no_progress", +"guard": { +"repeats": 13, +"no_progress": 2, +"soft_budget": 1 +}, +"tools": { +"check": 5, +"look": 12, +"replace": 4, +"add_after": 3 +} +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 3, +"repo": "chi", +"task": "rename", +"target": "main::RegisterMethod", +"mode": "lite", +"passed": true, +"steps": 7, +"tokens_in": 13278, +"tokens_out": 344, +"seconds": 18, +"guard": {}, +"tools": { +"look": 4, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 3, +"repo": "chi", +"task": "fix", +"target": "main::URLParamFromCtx", +"mode": "lite", +"passed": true, +"steps": 5, +"tokens_in": 8206, +"tokens_out": 500, +"seconds": 47, +"guard": {}, +"tools": { +"check": 2, +"look": 1, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 3, +"repo": "click", +"task": "rename", +"target": "click::formatting::HelpFormatter::dedent", +"mode": "lite", +"passed": false, +"steps": 4, +"tokens_in": 5126, +"tokens_out": 165, +"seconds": 10, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 3, +"repo": "click", +"task": "fix", +"target": "click::core::Context::find_object", +"mode": "lite", +"passed": true, +"steps": 11, +"tokens_in": 29938, +"tokens_out": 1247, +"seconds": 47, +"guard": { +"repeats": 1 +}, +"tools": { +"check": 3, +"replace": 2, +"look": 5, +"finish": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 3, +"repo": "cobra", +"task": "rename", +"target": "doc::GenMarkdownTreeCustom", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 5101, +"tokens_out": 178, +"seconds": 9, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 3, +"repo": "cobra", +"task": "fix", +"target": "doc::GenMan", +"mode": "lite", +"passed": false, +"steps": 25, +"tokens_in": 164125, +"tokens_out": 3702, +"seconds": 114, +"stopped": "steps", +"guard": { +"repeats": 6, +"soft_budget": 1 +}, +"tools": { +"check": 4, +"look": 18, +"replace": 3 +} +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 3, +"repo": "indexmap", +"task": "rename", +"target": "indexmap::util::try_simplify_range", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 5304, +"tokens_out": 195, +"seconds": 12, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 3, +"repo": "indexmap", +"task": "fix", +"target": "indexmap::inner::erase_index", +"mode": "lite", +"passed": true, +"steps": 13, +"tokens_in": 44133, +"tokens_out": 2995, +"seconds": 86, +"guard": { +"repeats": 2 +}, +"tools": { +"check": 2, +"replace": 3, +"look": 7, +"add_after": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 3, +"repo": "semver", +"task": "rename", +"target": "semver::eval::matches_comparator", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 3891, +"tokens_out": 175, +"seconds": 6, +"guard": { +"repeats": 1 +}, +"tools": { +"rename": 1, +"check": 2, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 3, +"repo": "semver", +"task": "fix", +"target": "semver::eval::matches_req", +"mode": "lite", +"passed": true, +"steps": 25, +"tokens_in": 131003, +"tokens_out": 3203, +"seconds": 94, +"stopped": "steps", +"guard": { +"repeats": 6, +"soft_budget": 1 +}, +"tools": { +"check": 2, +"replace": 1, +"look": 22 +} +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 3, +"repo": "sqlparse", +"task": "rename", +"target": "sqlparse::sql::TokenList::get_name", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 5517, +"tokens_out": 170, +"seconds": 8, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 3, +"repo": "sqlparse", +"task": "fix", +"target": "sqlparse::filters::reindent::ReindentFilter::_process_case", +"mode": "lite", +"passed": true, +"steps": 25, +"tokens_in": 152017, +"tokens_out": 2094, +"seconds": 82, +"stopped": "steps", +"guard": { +"repeats": 1, +"soft_budget": 1 +}, +"tools": { +"check": 2, +"replace": 1, +"look": 22 +} +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 4, +"repo": "chi", +"task": "rename", +"target": "_examples::fileserver::FileServer", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 4820, +"tokens_out": 132, +"seconds": 7, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 4, +"repo": "chi", +"task": "fix", +"target": "main::RegisterMethod", +"mode": "lite", +"passed": false, +"steps": 24, +"tokens_in": 183240, +"tokens_out": 4557, +"seconds": 184, +"gate": { +"nochange": 1 +}, +"guard": { +"repeats": 5, +"no_progress": 1, +"soft_budget": 1 +}, +"tools": { +"check": 2, +"look": 22 +} +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 4, +"repo": "click", +"task": "rename", +"target": "click::testing::CliRunner::make_env", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 4892, +"tokens_out": 167, +"seconds": 9, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 4, +"repo": "click", +"task": "fix", +"target": "click::decorators::pass_meta_key", +"mode": "lite", +"passed": true, +"steps": 19, +"tokens_in": 110434, +"tokens_out": 2825, +"seconds": 97, +"guard": { +"repeats": 9, +"no_progress": 1, +"soft_budget": 1 +}, +"tools": { +"check": 6, +"replace": 1, +"look": 11, +"finish": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 4, +"repo": "cobra", +"task": "rename", +"target": "main::Command::LocalFlags", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 5937, +"tokens_out": 174, +"seconds": 11, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 4, +"repo": "cobra", +"task": "fix", +"target": "main::Command::IsAdditionalHelpTopicCommand", +"mode": "lite", +"passed": false, +"steps": 25, +"tokens_in": 112712, +"tokens_out": 869, +"seconds": 35, +"stopped": "steps", +"guard": { +"repeats": 1, +"soft_budget": 1 +}, +"tools": { +"check": 1, +"look": 24 +} +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 4, +"repo": "indexmap", +"task": "rename", +"target": "indexmap::rayon::set::IndexSet::par_difference", +"mode": "lite", +"passed": true, +"steps": 3, +"tokens_in": 3081, +"tokens_out": 142, +"seconds": 9, +"guard": {}, +"tools": { +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 4, +"repo": "indexmap", +"task": "fix", +"target": "indexmap::inner::Core::try_reserve_entries", +"mode": "lite", +"passed": false, +"steps": 25, +"tokens_in": 147334, +"tokens_out": 3005, +"seconds": 99, +"stopped": "steps", +"guard": { +"soft_budget": 1 +}, +"tools": { +"check": 2, +"look": 22, +"replace": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 4, +"repo": "semver", +"task": "rename", +"target": "semver::identifier::Identifier::ptr_eq", +"mode": "lite", +"passed": true, +"steps": 3, +"tokens_in": 2920, +"tokens_out": 135, +"seconds": 6, +"guard": {}, +"tools": { +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 4, +"repo": "semver", +"task": "fix", +"target": "semver::parse::op", +"mode": "lite", +"passed": true, +"steps": 25, +"tokens_in": 141810, +"tokens_out": 3125, +"seconds": 92, +"stopped": "steps", +"guard": { +"repeats": 6, +"soft_budget": 1 +}, +"tools": { +"check": 7, +"replace": 3, +"look": 14, +"add_after": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 4, +"repo": "sqlparse", +"task": "rename", +"target": "sqlparse::engine::grouping::group_typed_literal", +"mode": "lite", +"passed": true, +"steps": 3, +"tokens_in": 3115, +"tokens_out": 155, +"seconds": 10, +"guard": {}, +"tools": { +"rename": 1, +"check": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 4, +"repo": "sqlparse", +"task": "fix", +"target": "sqlparse::engine::grouping::group_tzcasts", +"mode": "lite", +"passed": false, +"steps": 18, +"tokens_in": 83048, +"tokens_out": 2267, +"seconds": 71, +"stopped": "no_progress", +"guard": { +"repeats": 8, +"no_progress": 2 +}, +"tools": { +"check": 1, +"look": 16, +"replace": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 5, +"repo": "chi", +"task": "rename", +"target": "main::node::FindRoute", +"mode": "lite", +"passed": true, +"steps": 7, +"tokens_in": 21480, +"tokens_out": 367, +"seconds": 22, +"guard": {}, +"tools": { +"look": 4, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 5, +"repo": "chi", +"task": "fix", +"target": "middleware::prettyStack::parse", +"mode": "lite", +"passed": false, +"steps": 15, +"tokens_in": 67498, +"tokens_out": 2229, +"seconds": 94, +"stopped": "no_progress", +"guard": { +"repeats": 8, +"no_progress": 2 +}, +"tools": { +"check": 1, +"look": 12, +"replace": 2 +} +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 5, +"repo": "click", +"task": "rename", +"target": "click::utils::format_filename", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 6729, +"tokens_out": 174, +"seconds": 11, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 5, +"repo": "click", +"task": "fix", +"target": "click::core::Context::_default_map_has", +"mode": "lite", +"passed": true, +"steps": 25, +"tokens_in": 182691, +"tokens_out": 2262, +"seconds": 145, +"stopped": "steps", +"guard": { +"repeats": 1, +"soft_budget": 1 +}, +"tools": { +"check": 2, +"look": 22, +"replace": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 5, +"repo": "cobra", +"task": "rename", +"target": "main::Command::ParseFlags", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 5331, +"tokens_out": 141, +"seconds": 13, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 5, +"repo": "cobra", +"task": "fix", +"target": "main::stringInSlice", +"mode": "lite", +"passed": false, +"steps": 25, +"tokens_in": 163299, +"tokens_out": 2011, +"seconds": 72, +"stopped": "steps", +"guard": { +"repeats": 1, +"soft_budget": 1 +}, +"tools": { +"check": 2, +"replace": 1, +"look": 22 +} +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 5, +"repo": "indexmap", +"task": "rename", +"target": "indexmap::map::raw_entry_v1::RawOccupiedEntryMut::into_key_value_mut", +"mode": "lite", +"passed": true, +"steps": 3, +"tokens_in": 2859, +"tokens_out": 124, +"seconds": 9, +"guard": {}, +"tools": { +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 5, +"repo": "indexmap", +"task": "fix", +"target": "indexmap::inner::Core::move_index", +"mode": "lite", +"passed": false, +"steps": 25, +"tokens_in": 145376, +"tokens_out": 2071, +"seconds": 75, +"stopped": "steps", +"guard": { +"soft_budget": 1 +}, +"tools": { +"check": 1, +"look": 24 +} +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 5, +"repo": "semver", +"task": "rename", +"target": "semver::identifier::Identifier::ptr_eq", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 4584, +"tokens_out": 163, +"seconds": 6, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 5, +"repo": "semver", +"task": "fix", +"target": "semver::display::Version::fmt", +"mode": "lite", +"passed": false, +"steps": 25, +"tokens_in": 155012, +"tokens_out": 7287, +"seconds": 221, +"stopped": "steps", +"guard": { +"repeats": 11, +"no_progress": 1, +"soft_budget": 1 +}, +"tools": { +"check": 6, +"look": 16, +"replace": 3 +} +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 5, +"repo": "sqlparse", +"task": "rename", +"target": "examples::extract_table_names::extract_from_part", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 4282, +"tokens_out": 168, +"seconds": 5, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 5, +"repo": "sqlparse", +"task": "fix", +"target": "sqlparse::engine::grouping::group_where", +"mode": "lite", +"passed": false, +"steps": 17, +"tokens_in": 86089, +"tokens_out": 921, +"seconds": 36, +"stopped": "no_progress", +"guard": { +"repeats": 8, +"no_progress": 2 +}, +"tools": { +"check": 1, +"look": 16 +} +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 6, +"repo": "chi", +"task": "rename", +"target": "main::RouteContext", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 5191, +"tokens_out": 153, +"seconds": 8, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 6, +"repo": "chi", +"task": "fix", +"target": "main::RegisterMethod", +"mode": "lite", +"passed": false, +"steps": 18, +"tokens_in": 96042, +"tokens_out": 1082, +"seconds": 67, +"stopped": "no_progress", +"guard": { +"repeats": 8, +"no_progress": 2 +}, +"tools": { +"check": 1, +"look": 17 +} +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 6, +"repo": "click", +"task": "rename", +"target": "click::decorators::pass_context", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 6341, +"tokens_out": 181, +"seconds": 12, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 6, +"repo": "click", +"task": "fix", +"target": "click::parser::_Option::__init__", +"mode": "lite", +"passed": true, +"steps": 25, +"tokens_in": 187296, +"tokens_out": 2071, +"seconds": 123, +"stopped": "steps", +"guard": { +"repeats": 2, +"soft_budget": 1 +}, +"tools": { +"check": 2, +"replace": 2, +"look": 21 +} +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 6, +"repo": "cobra", +"task": "rename", +"target": "main::Command::UseLine", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 5431, +"tokens_out": 144, +"seconds": 8, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 6, +"repo": "cobra", +"task": "fix", +"target": "main::processFlagForGroupAnnotation", +"mode": "lite", +"passed": false, +"steps": 25, +"tokens_in": 181512, +"tokens_out": 5282, +"seconds": 212, +"guard": { +"repeats": 8, +"no_progress": 1, +"soft_budget": 1 +}, +"tools": { +"check": 8, +"look": 12, +"replace": 4 +}, +"text_code": 1 +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 6, +"repo": "indexmap", +"task": "rename", +"target": "indexmap::util::assert_index_lt", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 5392, +"tokens_out": 174, +"seconds": 12, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 6, +"repo": "indexmap", +"task": "fix", +"target": "indexmap::map::slice::Slice::eq", +"mode": "lite", +"passed": true, +"steps": 7, +"tokens_in": 14763, +"tokens_out": 696, +"seconds": 27, +"guard": { +"repeats": 1 +}, +"tools": { +"check": 3, +"look": 1, +"replace": 2, +"finish": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 6, +"repo": "semver", +"task": "rename", +"target": "semver::identifier::Identifier::empty", +"mode": "lite", +"passed": true, +"steps": 3, +"tokens_in": 3730, +"tokens_out": 114, +"seconds": 6, +"guard": {}, +"tools": { +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 6, +"repo": "semver", +"task": "fix", +"target": "semver::eval::matches_req", +"mode": "lite", +"passed": false, +"steps": 25, +"tokens_in": 130249, +"tokens_out": 3478, +"seconds": 100, +"stopped": "steps", +"guard": { +"repeats": 7, +"no_progress": 1, +"soft_budget": 1 +}, +"tools": { +"check": 3, +"replace": 2, +"look": 20 +} +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 6, +"repo": "sqlparse", +"task": "rename", +"target": "sqlparse::engine::grouping::group_over", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 5235, +"tokens_out": 165, +"seconds": 10, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 6, +"repo": "sqlparse", +"task": "fix", +"target": "sqlparse::filters::aligned_indent::AlignedIndentFilter::_process_default", +"mode": "lite", +"passed": false, +"steps": 22, +"tokens_in": 128277, +"tokens_out": 4865, +"seconds": 144, +"stopped": "no_progress", +"gate": { +"check": 1 +}, +"guard": { +"repeats": 12, +"no_progress": 2, +"soft_budget": 1 +}, +"tools": { +"check": 6, +"look": 11, +"replace": 5 +} +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 7, +"repo": "chi", +"task": "rename", +"target": "middleware::NewWrapResponseWriter", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 5056, +"tokens_out": 183, +"seconds": 37, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 7, +"repo": "chi", +"task": "fix", +"target": "middleware::encoderDeflate", +"mode": "lite", +"passed": true, +"steps": 5, +"tokens_in": 8155, +"tokens_out": 348, +"seconds": 41, +"guard": { +"repeats": 1 +}, +"tools": { +"check": 3, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 7, +"repo": "click", +"task": "rename", +"target": "click::formatting::HelpFormatter::indentation", +"mode": "lite", +"passed": false, +"steps": 3, +"tokens_in": 3280, +"tokens_out": 147, +"seconds": 9, +"guard": {}, +"tools": { +"rename": 1, +"check": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 7, +"repo": "click", +"task": "fix", +"target": "click::shell_completion::_is_incomplete_option", +"mode": "lite", +"passed": false, +"steps": 25, +"tokens_in": 176356, +"tokens_out": 4984, +"seconds": 199, +"stopped": "steps", +"guard": { +"repeats": 9, +"soft_budget": 1 +}, +"tools": { +"check": 2, +"look": 22, +"replace": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 7, +"repo": "cobra", +"task": "rename", +"target": "main::Command::GenPowerShellCompletionWithDesc", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 4856, +"tokens_out": 199, +"seconds": 17, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 7, +"repo": "cobra", +"task": "fix", +"target": "main::Command::getVersionTemplateFunc", +"mode": "lite", +"passed": false, +"steps": 17, +"tokens_in": 77653, +"tokens_out": 1701, +"seconds": 56, +"stopped": "no_progress", +"guard": { +"repeats": 8, +"no_progress": 2 +}, +"tools": { +"check": 3, +"look": 11, +"replace": 3 +} +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 7, +"repo": "indexmap", +"task": "rename", +"target": "indexmap::map::raw_entry_v1::RawVacantEntryMut::shift_insert_hashed_nocheck", +"mode": "lite", +"passed": true, +"steps": 3, +"tokens_in": 2913, +"tokens_out": 134, +"seconds": 10, +"guard": {}, +"tools": { +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 7, +"repo": "indexmap", +"task": "fix", +"target": "indexmap::inner::Core::move_index", +"mode": "lite", +"passed": true, +"steps": 25, +"tokens_in": 153146, +"tokens_out": 2695, +"seconds": 106, +"stopped": "steps", +"guard": { +"repeats": 1, +"soft_budget": 1 +}, +"tools": { +"check": 2, +"look": 22, +"replace": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 7, +"repo": "semver", +"task": "rename", +"target": "semver::identifier::Identifier::new_unchecked", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 7684, +"tokens_out": 333, +"seconds": 12, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 7, +"repo": "semver", +"task": "fix", +"target": "semver::display::Version::fmt", +"mode": "lite", +"passed": false, +"steps": 13, +"tokens_in": 53413, +"tokens_out": 2165, +"seconds": 61, +"stopped": "no_progress", +"gate": { +"nochange": 1 +}, +"guard": { +"repeats": 8, +"no_progress": 2 +}, +"tools": { +"check": 1, +"look": 12 +} +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 7, +"repo": "sqlparse", +"task": "rename", +"target": "sqlparse::sql::TokenList::token_not_matching", +"mode": "lite", +"passed": false, +"steps": 3, +"tokens_in": 2994, +"tokens_out": 146, +"seconds": 9, +"guard": {}, +"tools": { +"rename": 1, +"check": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 7, +"repo": "sqlparse", +"task": "fix", +"target": "sqlparse::lexer::Lexer::get_default_instance", +"mode": "lite", +"passed": true, +"steps": 18, +"tokens_in": 63587, +"tokens_out": 966, +"seconds": 35, +"stopped": "no_progress", +"guard": { +"repeats": 8, +"no_progress": 2 +}, +"tools": { +"check": 10, +"look": 6, +"replace": 2 +} +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 8, +"repo": "chi", +"task": "rename", +"target": "_examples::rest::ErrInvalidRequest", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 4269, +"tokens_out": 148, +"seconds": 7, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 8, +"repo": "chi", +"task": "fix", +"target": "main::Mux::nextRoutePath", +"mode": "lite", +"passed": true, +"steps": 25, +"tokens_in": 133156, +"tokens_out": 2027, +"seconds": 95, +"stopped": "steps", +"guard": { +"repeats": 4, +"soft_budget": 1 +}, +"tools": { +"check": 4, +"replace": 2, +"look": 19 +} +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 8, +"repo": "click", +"task": "rename", +"target": "click::types::Path::coerce_path_result", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 5054, +"tokens_out": 181, +"seconds": 10, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 8, +"repo": "click", +"task": "fix", +"target": "click::core::Parameter::get_default", +"mode": "lite", +"passed": true, +"steps": 14, +"tokens_in": 57485, +"tokens_out": 1213, +"seconds": 50, +"stopped": "no_progress", +"guard": { +"repeats": 8, +"no_progress": 2 +}, +"tools": { +"check": 9, +"look": 4, +"replace": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 8, +"repo": "cobra", +"task": "rename", +"target": "main::Command::CalledAs", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 4731, +"tokens_out": 177, +"seconds": 11, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 8, +"repo": "cobra", +"task": "fix", +"target": "main::Command::SetHelpCommandGroupID", +"mode": "lite", +"passed": false, +"steps": 13, +"tokens_in": 38509, +"tokens_out": 1461, +"seconds": 47, +"guard": { +"repeats": 5, +"no_progress": 1 +}, +"tools": { +"check": 4, +"look": 6, +"replace": 2, +"finish": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 8, +"repo": "indexmap", +"task": "rename", +"target": "indexmap::serde::cautious_capacity", +"mode": "lite", +"passed": true, +"steps": 3, +"tokens_in": 2890, +"tokens_out": 126, +"seconds": 5, +"guard": {}, +"tools": { +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 8, +"repo": "indexmap", +"task": "fix", +"target": "indexmap::inner::entry::OccupiedEntry::move_index", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 7685, +"tokens_out": 362, +"seconds": 17, +"guard": {}, +"tools": { +"check": 2, +"look": 1, +"replace": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 8, +"repo": "semver", +"task": "rename", +"target": "semver::identifier::Identifier::empty", +"mode": "lite", +"passed": true, +"steps": 3, +"tokens_in": 3730, +"tokens_out": 139, +"seconds": 6, +"guard": {}, +"tools": { +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 8, +"repo": "semver", +"task": "fix", +"target": "semver::error::QuotedChar::fmt", +"mode": "lite", +"passed": true, +"steps": 25, +"tokens_in": 137892, +"tokens_out": 3750, +"seconds": 110, +"stopped": "steps", +"guard": { +"repeats": 5, +"soft_budget": 1 +}, +"tools": { +"check": 2, +"look": 22, +"replace": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 8, +"repo": "sqlparse", +"task": "rename", +"target": "examples::extract_table_names::is_subselect", +"mode": "lite", +"passed": true, +"steps": 5, +"tokens_in": 5489, +"tokens_out": 199, +"seconds": 6, +"guard": { +"repeats": 1 +}, +"tools": { +"look": 1, +"rename": 1, +"check": 2, +"finish": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 8, +"repo": "sqlparse", +"task": "fix", +"target": "sqlparse::filters::others::StripWhitespaceFilter::process", +"mode": "lite", +"passed": true, +"steps": 9, +"tokens_in": 22300, +"tokens_out": 822, +"seconds": 27, +"guard": { +"repeats": 2 +}, +"tools": { +"check": 3, +"look": 4, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 9, +"repo": "chi", +"task": "rename", +"target": "middleware::WithLogEntry", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 4518, +"tokens_out": 173, +"seconds": 11, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 9, +"repo": "chi", +"task": "fix", +"target": "main::nodes::tailSort", +"mode": "lite", +"passed": false, +"seconds": 56, +"error": "HTTP Error 500: Internal Server Error" +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 9, +"repo": "click", +"task": "rename", +"target": "click::types::File::resolve_lazy_flag", +"mode": "lite", +"passed": true, +"steps": 3, +"tokens_in": 2909, +"tokens_out": 140, +"seconds": 10, +"guard": {}, +"tools": { +"rename": 1, +"check": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 9, +"repo": "click", +"task": "fix", +"target": "click::types::Choice::__init__", +"mode": "lite", +"passed": true, +"steps": 20, +"tokens_in": 102761, +"tokens_out": 1739, +"seconds": 71, +"stopped": "no_progress", +"guard": { +"repeats": 11, +"no_progress": 2, +"soft_budget": 1 +}, +"tools": { +"check": 4, +"look": 15, +"replace": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 9, +"repo": "cobra", +"task": "rename", +"target": "main::Command::HasPersistentFlags", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 4526, +"tokens_out": 179, +"seconds": 14, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 9, +"repo": "cobra", +"task": "fix", +"target": "main::Command::PersistentFlags", +"mode": "lite", +"passed": false, +"steps": 16, +"tokens_in": 75303, +"tokens_out": 683, +"seconds": 28, +"stopped": "no_progress", +"guard": { +"repeats": 8, +"no_progress": 2 +}, +"tools": { +"check": 1, +"look": 15 +} +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 9, +"repo": "indexmap", +"task": "rename", +"target": "indexmap::map::raw_entry_v1::RawVacantEntryMut::insert_hashed_nocheck", +"mode": "lite", +"passed": true, +"steps": 2, +"tokens_in": 1765, +"tokens_out": 126, +"seconds": 7, +"guard": {}, +"tools": { +"rename": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 9, +"repo": "indexmap", +"task": "fix", +"target": "indexmap::inner::Core::move_index", +"mode": "lite", +"passed": true, +"steps": 25, +"tokens_in": 173762, +"tokens_out": 5323, +"seconds": 176, +"stopped": "steps", +"guard": { +"repeats": 3, +"soft_budget": 1 +}, +"tools": { +"check": 3, +"look": 20, +"replace": 2 +} +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 9, +"repo": "semver", +"task": "rename", +"target": "semver::identifier::Identifier::new_unchecked", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 7680, +"tokens_out": 307, +"seconds": 10, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 9, +"repo": "semver", +"task": "fix", +"target": "semver::eval::matches_caret", +"mode": "lite", +"passed": true, +"steps": 5, +"tokens_in": 12220, +"tokens_out": 1706, +"seconds": 47, +"guard": { +"repeats": 1 +}, +"tools": { +"check": 2, +"look": 2, +"replace": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 9, +"repo": "sqlparse", +"task": "rename", +"target": "sqlparse::engine::grouping::group_as", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 5271, +"tokens_out": 164, +"seconds": 10, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "new", +"set": 9, +"repo": "sqlparse", +"task": "fix", +"target": "sqlparse::filters::others::StripTrailingSemicolonFilter::process", +"mode": "lite", +"passed": true, +"steps": 21, +"tokens_in": 91504, +"tokens_out": 2310, +"seconds": 71, +"stopped": "no_progress", +"guard": { +"repeats": 13, +"no_progress": 2, +"soft_budget": 1 +}, +"tools": { +"check": 4, +"look": 9, +"replace": 5, +"add_after": 3 +} +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 0, +"repo": "chi", +"task": "rename", +"target": "main::NewRouteContext", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 4972, +"tokens_out": 179, +"seconds": 15, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 0, +"repo": "chi", +"task": "fix", +"target": "middleware::parseRemoteAddr", +"mode": "lite", +"passed": false, +"steps": 25, +"tokens_in": 177003, +"tokens_out": 2863, +"seconds": 119, +"stopped": "steps", +"guard": { +"repeats": 4, +"soft_budget": 1 +}, +"tools": { +"check": 2, +"look": 23 +} +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 0, +"repo": "click", +"task": "rename", +"target": "click::core::iter_params_for_processing", +"mode": "lite", +"passed": true, +"steps": 3, +"tokens_in": 3123, +"tokens_out": 143, +"seconds": 9, +"guard": {}, +"tools": { +"rename": 1, +"check": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 0, +"repo": "click", +"task": "fix", +"target": "click::_compat::get_text_stdin", +"mode": "lite", +"passed": true, +"steps": 25, +"tokens_in": 165040, +"tokens_out": 3240, +"seconds": 129, +"stopped": "steps", +"guard": { +"repeats": 7, +"soft_budget": 1 +}, +"tools": { +"check": 5, +"look": 16, +"replace": 4 +} +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 0, +"repo": "cobra", +"task": "rename", +"target": "main::Command::ValidateRequiredFlags", +"mode": "lite", +"passed": true, +"steps": 25, +"tokens_in": 119377, +"tokens_out": 3662, +"seconds": 114, +"gate": { +"check": 1 +}, +"guard": { +"repeats": 9, +"soft_budget": 1 +}, +"tools": { +"look": 13, +"rename": 1, +"check": 9, +"finish": 1, +"replace": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 0, +"repo": "cobra", +"task": "fix", +"target": "main::Command::PersistentFlags", +"mode": "lite", +"passed": false, +"steps": 25, +"tokens_in": 176556, +"tokens_out": 4436, +"seconds": 182, +"stopped": "steps", +"guard": { +"repeats": 2, +"soft_budget": 1 +}, +"tools": { +"check": 1, +"look": 23, +"replace": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 0, +"repo": "indexmap", +"task": "rename", +"target": "indexmap::inner::extract::ExtractCore::remaining", +"mode": "lite", +"passed": true, +"steps": 2, +"tokens_in": 3959, +"tokens_out": 111, +"seconds": 9, +"guard": {}, +"tools": { +"rename": 1, +"check": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 0, +"repo": "indexmap", +"task": "fix", +"target": "indexmap::inner::Core::reserve_entries", +"mode": "lite", +"passed": false, +"steps": 25, +"tokens_in": 213348, +"tokens_out": 3084, +"seconds": 140, +"stopped": "steps", +"guard": { +"soft_budget": 1 +}, +"tools": { +"check": 1, +"look": 24 +} +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 0, +"repo": "semver", +"task": "rename", +"target": "semver::eval::matches_comparator", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 5470, +"tokens_out": 157, +"seconds": 7, +"guard": { +"repeats": 1 +}, +"tools": { +"look": 1, +"rename": 1, +"check": 2 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 0, +"repo": "semver", +"task": "fix", +"target": "semver::eval::matches_greater", +"mode": "lite", +"passed": false, +"steps": 25, +"tokens_in": 103331, +"tokens_out": 2939, +"seconds": 87, +"stopped": "steps", +"guard": { +"repeats": 6, +"soft_budget": 1 +}, +"tools": { +"check": 1, +"replace": 8, +"look": 12, +"add_after": 4 +} +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 0, +"repo": "sqlparse", +"task": "rename", +"target": "sqlparse::engine::grouping::group_order", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 5262, +"tokens_out": 165, +"seconds": 10, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 0, +"repo": "sqlparse", +"task": "fix", +"target": "sqlparse::filters::others::SpacesAroundOperatorsFilter::_process", +"mode": "lite", +"passed": true, +"steps": 12, +"tokens_in": 50019, +"tokens_out": 3126, +"seconds": 86, +"guard": {}, +"tools": { +"check": 2, +"replace": 4, +"look": 4, +"add_after": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 1, +"repo": "chi", +"task": "rename", +"target": "_examples::rest::NewUserPayloadResponse", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 4108, +"tokens_out": 150, +"seconds": 7, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 1, +"repo": "chi", +"task": "fix", +"target": "main::node::findPattern", +"mode": "lite", +"passed": false, +"steps": 25, +"tokens_in": 125754, +"tokens_out": 2493, +"seconds": 75, +"stopped": "steps", +"guard": { +"repeats": 10, +"no_progress": 1, +"soft_budget": 1 +}, +"tools": { +"check": 1, +"replace": 12, +"look": 6, +"add_after": 6 +} +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 1, +"repo": "click", +"task": "rename", +"target": "examples::imagepipe::imagepipe::convert_flip", +"mode": "lite", +"passed": true, +"steps": 5, +"tokens_in": 5702, +"tokens_out": 233, +"seconds": 10, +"guard": { +"repeats": 1 +}, +"tools": { +"look": 1, +"rename": 1, +"check": 2, +"finish": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 1, +"repo": "click", +"task": "fix", +"target": "click::_compat::get_text_stderr", +"mode": "lite", +"passed": false, +"steps": 25, +"tokens_in": 198180, +"tokens_out": 2485, +"seconds": 123, +"stopped": "steps", +"guard": { +"repeats": 1, +"soft_budget": 1 +}, +"tools": { +"check": 1, +"look": 20, +"replace": 2, +"add_after": 2 +} +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 1, +"repo": "cobra", +"task": "rename", +"target": "main::CheckErr", +"mode": "lite", +"passed": true, +"steps": 25, +"tokens_in": 142134, +"tokens_out": 6339, +"seconds": 191, +"gate": { +"check": 1 +}, +"guard": { +"repeats": 8, +"no_progress": 1, +"soft_budget": 1 +}, +"tools": { +"look": 10, +"rename": 1, +"check": 1, +"finish": 1, +"replace": 4, +"add_after": 8 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 1, +"repo": "cobra", +"task": "fix", +"target": "main::writeShortFlag", +"mode": "lite", +"passed": false, +"steps": 9, +"tokens_in": 21686, +"tokens_out": 1039, +"seconds": 31, +"guard": { +"repeats": 1 +}, +"tools": { +"check": 2, +"look": 3, +"replace": 2, +"add_after": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 1, +"repo": "indexmap", +"task": "rename", +"target": "indexmap::set::IndexSet::is_subset", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 4903, +"tokens_out": 165, +"seconds": 11, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 1, +"repo": "indexmap", +"task": "fix", +"target": "indexmap::inner::entry::OccupiedEntry::swap_indices", +"mode": "lite", +"passed": false, +"steps": 25, +"tokens_in": 153817, +"tokens_out": 3166, +"seconds": 95, +"stopped": "steps", +"guard": { +"repeats": 8, +"soft_budget": 1 +}, +"tools": { +"check": 2, +"replace": 9, +"look": 9, +"add_after": 5 +} +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 1, +"repo": "semver", +"task": "rename", +"target": "semver::identifier::Identifier::ptr_eq", +"mode": "lite", +"passed": true, +"steps": 3, +"tokens_in": 2920, +"tokens_out": 135, +"seconds": 6, +"guard": {}, +"tools": { +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 1, +"repo": "semver", +"task": "fix", +"target": "semver::display::Version::fmt", +"mode": "lite", +"passed": false, +"steps": 17, +"tokens_in": 120152, +"tokens_out": 5258, +"seconds": 145, +"stopped": "no_progress", +"gate": { +"nochange": 1, +"check": 2 +}, +"guard": { +"repeats": 8, +"no_progress": 2 +}, +"tools": { +"check": 2, +"look": 12, +"replace": 3 +} +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 1, +"repo": "sqlparse", +"task": "rename", +"target": "sqlparse::lexer::Lexer::default_initialization", +"mode": "lite", +"passed": true, +"steps": 3, +"tokens_in": 3051, +"tokens_out": 130, +"seconds": 6, +"guard": {}, +"tools": { +"rename": 1, +"check": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 1, +"repo": "sqlparse", +"task": "fix", +"target": "sqlparse::engine::grouping::group_period", +"mode": "lite", +"passed": false, +"steps": 22, +"tokens_in": 144110, +"tokens_out": 1147, +"seconds": 50, +"stopped": "no_progress", +"guard": { +"repeats": 9, +"no_progress": 2, +"soft_budget": 1 +}, +"tools": { +"check": 1, +"look": 21 +} +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 10, +"repo": "chi", +"task": "rename", +"target": "main::RegisterMethod", +"mode": "lite", +"passed": true, +"steps": 7, +"tokens_in": 13309, +"tokens_out": 371, +"seconds": 14, +"guard": {}, +"tools": { +"look": 4, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 10, +"repo": "chi", +"task": "fix", +"target": "main::Mux::handle", +"mode": "lite", +"passed": false, +"steps": 25, +"tokens_in": 165771, +"tokens_out": 3090, +"seconds": 94, +"stopped": "steps", +"guard": { +"repeats": 10, +"no_progress": 1, +"soft_budget": 1 +}, +"tools": { +"check": 1, +"replace": 10, +"look": 12, +"add_after": 2 +} +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 10, +"repo": "click", +"task": "rename", +"target": "click::core::iter_params_for_processing", +"mode": "lite", +"passed": true, +"steps": 3, +"tokens_in": 3123, +"tokens_out": 155, +"seconds": 9, +"guard": {}, +"tools": { +"rename": 1, +"check": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 10, +"repo": "click", +"task": "fix", +"target": "click::exceptions::UsageError::show", +"mode": "lite", +"passed": false, +"steps": 25, +"tokens_in": 180623, +"tokens_out": 2120, +"seconds": 113, +"stopped": "steps", +"guard": { +"repeats": 6, +"no_progress": 1, +"soft_budget": 1 +}, +"tools": { +"check": 1, +"look": 23, +"replace": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 10, +"repo": "cobra", +"task": "rename", +"target": "main::Command::CalledAs", +"mode": "lite", +"passed": true, +"steps": 25, +"tokens_in": 162677, +"tokens_out": 1904, +"seconds": 88, +"gate": { +"check": 1 +}, +"guard": { +"repeats": 3, +"soft_budget": 1 +}, +"tools": { +"rename": 1, +"check": 2, +"look": 21, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 10, +"repo": "cobra", +"task": "fix", +"target": "main::Command::getHelpTemplateFunc", +"mode": "lite", +"passed": false, +"steps": 6, +"tokens_in": 10587, +"tokens_out": 629, +"seconds": 22, +"guard": {}, +"tools": { +"check": 2, +"replace": 2, +"look": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 10, +"repo": "indexmap", +"task": "rename", +"target": "indexmap::inner::extract::ExtractCore::remaining", +"mode": "lite", +"passed": true, +"steps": 3, +"tokens_in": 3959, +"tokens_out": 167, +"seconds": 8, +"guard": {}, +"tools": { +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 10, +"repo": "indexmap", +"task": "fix", +"target": "indexmap::map::IndexMap::with_capacity_and_hasher", +"mode": "lite", +"passed": false, +"steps": 25, +"tokens_in": 150532, +"tokens_out": 3360, +"seconds": 106, +"stopped": "steps", +"guard": { +"repeats": 5, +"soft_budget": 1 +}, +"tools": { +"check": 5, +"replace": 6, +"look": 13, +"add_after": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 10, +"repo": "semver", +"task": "rename", +"target": "semver::identifier::Identifier::ptr_eq", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 4584, +"tokens_out": 167, +"seconds": 7, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 10, +"repo": "semver", +"task": "fix", +"target": "semver::identifier::Identifier::is_empty", +"mode": "lite", +"passed": true, +"steps": 7, +"tokens_in": 14636, +"tokens_out": 801, +"seconds": 23, +"guard": {}, +"tools": { +"check": 2, +"look": 2, +"replace": 2, +"finish": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 10, +"repo": "sqlparse", +"task": "rename", +"target": "sqlparse::lexer::Lexer::add_keywords", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 4891, +"tokens_out": 177, +"seconds": 7, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 10, +"repo": "sqlparse", +"task": "fix", +"target": "sqlparse::sql::TokenList::get_parent_name", +"mode": "lite", +"passed": true, +"steps": 15, +"tokens_in": 56832, +"tokens_out": 1765, +"seconds": 55, +"guard": { +"repeats": 5 +}, +"tools": { +"check": 5, +"look": 8, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 11, +"repo": "chi", +"task": "rename", +"target": "main::RegisterMethod", +"mode": "lite", +"passed": true, +"steps": 7, +"tokens_in": 13272, +"tokens_out": 342, +"seconds": 14, +"guard": {}, +"tools": { +"look": 4, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 11, +"repo": "chi", +"task": "fix", +"target": "middleware::RequestID", +"mode": "lite", +"passed": true, +"steps": 25, +"tokens_in": 126394, +"tokens_out": 3377, +"seconds": 126, +"stopped": "steps", +"guard": { +"repeats": 9, +"no_progress": 1, +"soft_budget": 1 +}, +"tools": { +"check": 6, +"replace": 9, +"look": 8, +"add_after": 2 +} +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 11, +"repo": "click", +"task": "rename", +"target": "click::formatting::HelpFormatter::dedent", +"mode": "lite", +"passed": false, +"steps": 3, +"tokens_in": 3294, +"tokens_out": 212, +"seconds": 11, +"guard": {}, +"tools": { +"rename": 1, +"check": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 11, +"repo": "click", +"task": "fix", +"target": "click::core::Option::add_to_parser", +"mode": "lite", +"passed": false, +"steps": 25, +"tokens_in": 149071, +"tokens_out": 1667, +"seconds": 88, +"stopped": "steps", +"guard": { +"repeats": 1, +"soft_budget": 1 +}, +"tools": { +"check": 1, +"look": 22, +"replace": 2 +} +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 11, +"repo": "cobra", +"task": "rename", +"target": "main::Command::PersistentFlags", +"mode": "lite", +"passed": true, +"steps": 25, +"tokens_in": 189594, +"tokens_out": 5864, +"seconds": 233, +"stopped": "steps", +"guard": { +"repeats": 5, +"soft_budget": 1 +}, +"tools": { +"look": 21, +"rename": 1, +"check": 3 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 11, +"repo": "cobra", +"task": "fix", +"target": "doc::GenMan", +"mode": "lite", +"passed": false, +"steps": 25, +"tokens_in": 146599, +"tokens_out": 3244, +"seconds": 102, +"guard": { +"soft_budget": 1 +}, +"tools": { +"check": 2, +"look": 22 +}, +"text_code": 1 +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 11, +"repo": "indexmap", +"task": "rename", +"target": "indexmap::util::try_simplify_range", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 5304, +"tokens_out": 183, +"seconds": 11, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 11, +"repo": "indexmap", +"task": "fix", +"target": "indexmap::map::IndexMap::replace_index", +"mode": "lite", +"passed": true, +"steps": 16, +"tokens_in": 84559, +"tokens_out": 2684, +"seconds": 83, +"stopped": "no_progress", +"guard": { +"repeats": 7, +"no_progress": 2 +}, +"tools": { +"check": 4, +"look": 7, +"replace": 4, +"add_after": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 11, +"repo": "semver", +"task": "rename", +"target": "semver::identifier::Identifier::empty", +"mode": "lite", +"passed": true, +"steps": 3, +"tokens_in": 3730, +"tokens_out": 143, +"seconds": 6, +"guard": {}, +"tools": { +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 11, +"repo": "semver", +"task": "fix", +"target": "semver::identifier::Identifier::is_empty", +"mode": "lite", +"passed": true, +"steps": 25, +"tokens_in": 120545, +"tokens_out": 1757, +"seconds": 57, +"stopped": "steps", +"guard": { +"repeats": 1, +"soft_budget": 1 +}, +"tools": { +"check": 2, +"look": 22, +"replace": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 11, +"repo": "sqlparse", +"task": "rename", +"target": "benchmarks::bench_lexer_delimiters::unmatched_dollar_quotes", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 3991, +"tokens_out": 210, +"seconds": 6, +"guard": { +"repeats": 1 +}, +"tools": { +"rename": 1, +"check": 2, +"finish": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 11, +"repo": "sqlparse", +"task": "fix", +"target": "sqlparse::cli::main", +"mode": "lite", +"passed": true, +"steps": 25, +"tokens_in": 138118, +"tokens_out": 3352, +"seconds": 100, +"stopped": "steps", +"guard": { +"repeats": 10, +"no_progress": 1, +"soft_budget": 1 +}, +"tools": { +"check": 8, +"look": 13, +"replace": 4 +} +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 2, +"repo": "chi", +"task": "rename", +"target": "_examples::fileserver::FileServer", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 4820, +"tokens_out": 187, +"seconds": 9, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 2, +"repo": "chi", +"task": "fix", +"target": "middleware::GetHead", +"mode": "lite", +"passed": true, +"steps": 12, +"tokens_in": 44374, +"tokens_out": 2929, +"seconds": 108, +"guard": { +"repeats": 2 +}, +"tools": { +"check": 4, +"look": 6, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 2, +"repo": "click", +"task": "rename", +"target": "click::core::Command::get_help_option_names", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 5397, +"tokens_out": 188, +"seconds": 10, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 2, +"repo": "click", +"task": "fix", +"target": "click::utils::_make_default_short_help", +"mode": "lite", +"passed": false, +"steps": 18, +"tokens_in": 136233, +"tokens_out": 1472, +"seconds": 88, +"stopped": "no_progress", +"guard": { +"repeats": 9, +"no_progress": 2 +}, +"tools": { +"check": 1, +"look": 17 +} +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 2, +"repo": "cobra", +"task": "rename", +"target": "main::Command::Name", +"mode": "lite", +"passed": false, +"steps": 25, +"tokens_in": 164170, +"tokens_out": 2253, +"seconds": 76, +"stopped": "steps", +"guard": { +"repeats": 8, +"soft_budget": 1 +}, +"tools": { +"rename": 1, +"check": 1, +"look": 12, +"replace": 7, +"add_after": 4 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 2, +"repo": "cobra", +"task": "fix", +"target": "main::Command::hasNameOrAliasPrefix", +"mode": "lite", +"passed": false, +"steps": 12, +"tokens_in": 38604, +"tokens_out": 1494, +"seconds": 47, +"guard": { +"repeats": 2 +}, +"tools": { +"check": 3, +"look": 7, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 2, +"repo": "indexmap", +"task": "rename", +"target": "indexmap::map::IndexMap::sort_unstable_keys", +"mode": "lite", +"passed": true, +"steps": 7, +"tokens_in": 10308, +"tokens_out": 389, +"seconds": 17, +"guard": {}, +"tools": { +"look": 4, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 2, +"repo": "indexmap", +"task": "fix", +"target": "indexmap::inner::Core::decrement_indices", +"mode": "lite", +"passed": true, +"steps": 7, +"tokens_in": 17210, +"tokens_out": 1495, +"seconds": 62, +"guard": { +"repeats": 1 +}, +"tools": { +"check": 2, +"look": 3, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 2, +"repo": "semver", +"task": "rename", +"target": "semver::identifier::Identifier::ptr_eq", +"mode": "lite", +"passed": true, +"steps": 3, +"tokens_in": 2920, +"tokens_out": 138, +"seconds": 6, +"guard": {}, +"tools": { +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 2, +"repo": "semver", +"task": "fix", +"target": "semver::display::Version::fmt", +"mode": "lite", +"passed": false, +"seconds": 98, +"error": "HTTP Error 500: Internal Server Error" +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 2, +"repo": "sqlparse", +"task": "rename", +"target": "sqlparse::lexer::Lexer::default_initialization", +"mode": "lite", +"passed": true, +"steps": 3, +"tokens_in": 3051, +"tokens_out": 149, +"seconds": 6, +"guard": {}, +"tools": { +"rename": 1, +"check": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 2, +"repo": "sqlparse", +"task": "fix", +"target": "sqlparse::engine::grouping::group_values", +"mode": "lite", +"passed": true, +"steps": 25, +"tokens_in": 123205, +"tokens_out": 2712, +"seconds": 81, +"stopped": "steps", +"guard": { +"repeats": 4, +"no_progress": 1, +"soft_budget": 1 +}, +"tools": { +"check": 2, +"look": 11, +"replace": 8, +"add_after": 4 +} +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 3, +"repo": "chi", +"task": "rename", +"target": "main::RegisterMethod", +"mode": "lite", +"passed": true, +"steps": 7, +"tokens_in": 12668, +"tokens_out": 328, +"seconds": 13, +"guard": {}, +"tools": { +"look": 4, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 3, +"repo": "chi", +"task": "fix", +"target": "main::URLParamFromCtx", +"mode": "lite", +"passed": true, +"steps": 25, +"tokens_in": 149849, +"tokens_out": 1820, +"seconds": 99, +"stopped": "steps", +"guard": { +"repeats": 2, +"soft_budget": 1 +}, +"tools": { +"check": 2, +"look": 21, +"replace": 2 +} +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 3, +"repo": "click", +"task": "rename", +"target": "click::formatting::HelpFormatter::dedent", +"mode": "lite", +"passed": false, +"steps": 4, +"tokens_in": 5126, +"tokens_out": 227, +"seconds": 11, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 3, +"repo": "click", +"task": "fix", +"target": "click::core::Context::find_object", +"mode": "lite", +"passed": true, +"steps": 25, +"tokens_in": 147306, +"tokens_out": 3406, +"seconds": 111, +"stopped": "steps", +"guard": { +"repeats": 8, +"no_progress": 1, +"soft_budget": 1 +}, +"tools": { +"check": 3, +"look": 11, +"replace": 6, +"add_after": 5 +} +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 3, +"repo": "cobra", +"task": "rename", +"target": "doc::GenMarkdownTreeCustom", +"mode": "lite", +"passed": false, +"steps": 25, +"tokens_in": 99551, +"tokens_out": 2652, +"seconds": 78, +"stopped": "steps", +"guard": { +"repeats": 9, +"no_progress": 1, +"soft_budget": 1 +}, +"tools": { +"look": 9, +"replace": 14, +"check": 1, +"rename": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 3, +"repo": "cobra", +"task": "fix", +"target": "doc::GenMan", +"mode": "lite", +"passed": false, +"steps": 19, +"tokens_in": 133287, +"tokens_out": 5187, +"seconds": 156, +"gate": { +"nochange": 1 +}, +"guard": { +"repeats": 2, +"soft_budget": 1 +}, +"tools": { +"check": 2, +"look": 17 +} +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 3, +"repo": "indexmap", +"task": "rename", +"target": "indexmap::util::try_simplify_range", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 5304, +"tokens_out": 181, +"seconds": 10, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 3, +"repo": "indexmap", +"task": "fix", +"target": "indexmap::inner::erase_index", +"mode": "lite", +"passed": true, +"steps": 21, +"tokens_in": 110189, +"tokens_out": 2107, +"seconds": 73, +"stopped": "no_progress", +"guard": { +"repeats": 13, +"no_progress": 2, +"soft_budget": 1 +}, +"tools": { +"check": 7, +"replace": 4, +"look": 7, +"add_after": 3 +} +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 3, +"repo": "semver", +"task": "rename", +"target": "semver::eval::matches_comparator", +"mode": "lite", +"passed": true, +"steps": 2, +"tokens_in": 2747, +"tokens_out": 94, +"seconds": 4, +"guard": {}, +"tools": { +"rename": 1, +"check": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 3, +"repo": "semver", +"task": "fix", +"target": "semver::eval::matches_req", +"mode": "lite", +"passed": false, +"steps": 25, +"tokens_in": 131896, +"tokens_out": 4338, +"seconds": 122, +"stopped": "steps", +"guard": { +"repeats": 7, +"soft_budget": 1 +}, +"tools": { +"check": 1, +"replace": 7, +"look": 12, +"add_after": 5 +} +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 3, +"repo": "sqlparse", +"task": "rename", +"target": "sqlparse::sql::TokenList::get_name", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 5517, +"tokens_out": 170, +"seconds": 7, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 3, +"repo": "sqlparse", +"task": "fix", +"target": "sqlparse::filters::reindent::ReindentFilter::_process_case", +"mode": "lite", +"passed": true, +"steps": 17, +"tokens_in": 76184, +"tokens_out": 2707, +"seconds": 81, +"guard": { +"repeats": 2, +"no_progress": 1 +}, +"tools": { +"check": 2, +"look": 6, +"replace": 5, +"add_after": 3, +"finish": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 4, +"repo": "chi", +"task": "rename", +"target": "_examples::fileserver::FileServer", +"mode": "lite", +"passed": true, +"steps": 3, +"tokens_in": 2946, +"tokens_out": 182, +"seconds": 8, +"guard": {}, +"tools": { +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 4, +"repo": "chi", +"task": "fix", +"target": "main::RegisterMethod", +"mode": "lite", +"passed": false, +"steps": 25, +"tokens_in": 184467, +"tokens_out": 4111, +"seconds": 172, +"stopped": "steps", +"guard": { +"repeats": 1, +"soft_budget": 1 +}, +"tools": { +"check": 3, +"look": 22 +} +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 4, +"repo": "click", +"task": "rename", +"target": "click::testing::CliRunner::make_env", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 4892, +"tokens_out": 163, +"seconds": 9, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 4, +"repo": "click", +"task": "fix", +"target": "click::decorators::pass_meta_key", +"mode": "lite", +"passed": false, +"steps": 25, +"tokens_in": 168052, +"tokens_out": 4059, +"seconds": 127, +"stopped": "steps", +"guard": { +"repeats": 4, +"soft_budget": 1 +}, +"tools": { +"check": 1, +"replace": 6, +"look": 11, +"add_after": 7 +} +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 4, +"repo": "cobra", +"task": "rename", +"target": "main::Command::LocalFlags", +"mode": "lite", +"passed": true, +"steps": 25, +"tokens_in": 165593, +"tokens_out": 1577, +"seconds": 70, +"gate": { +"check": 1 +}, +"guard": { +"soft_budget": 1 +}, +"tools": { +"look": 22, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 4, +"repo": "cobra", +"task": "fix", +"target": "main::Command::IsAdditionalHelpTopicCommand", +"mode": "lite", +"passed": false, +"steps": 25, +"tokens_in": 172386, +"tokens_out": 4646, +"seconds": 171, +"stopped": "steps", +"guard": { +"repeats": 1, +"soft_budget": 1 +}, +"tools": { +"check": 1, +"look": 18, +"replace": 4, +"add_after": 2 +} +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 4, +"repo": "indexmap", +"task": "rename", +"target": "indexmap::rayon::set::IndexSet::par_difference", +"mode": "lite", +"passed": true, +"steps": 3, +"tokens_in": 3081, +"tokens_out": 143, +"seconds": 9, +"guard": {}, +"tools": { +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 4, +"repo": "indexmap", +"task": "fix", +"target": "indexmap::inner::Core::try_reserve_entries", +"mode": "lite", +"passed": false, +"steps": 14, +"tokens_in": 73810, +"tokens_out": 4128, +"seconds": 122, +"gate": { +"nochange": 1 +}, +"guard": { +"repeats": 1 +}, +"tools": { +"check": 1, +"look": 13 +} +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 4, +"repo": "semver", +"task": "rename", +"target": "semver::identifier::Identifier::ptr_eq", +"mode": "lite", +"passed": true, +"steps": 3, +"tokens_in": 2920, +"tokens_out": 135, +"seconds": 6, +"guard": {}, +"tools": { +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 4, +"repo": "semver", +"task": "fix", +"target": "semver::parse::op", +"mode": "lite", +"passed": true, +"steps": 18, +"tokens_in": 88357, +"tokens_out": 3346, +"seconds": 91, +"guard": { +"repeats": 3 +}, +"tools": { +"check": 2, +"look": 6, +"replace": 9, +"finish": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 4, +"repo": "sqlparse", +"task": "rename", +"target": "sqlparse::engine::grouping::group_typed_literal", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 5797, +"tokens_out": 187, +"seconds": 11, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 4, +"repo": "sqlparse", +"task": "fix", +"target": "sqlparse::engine::grouping::group_tzcasts", +"mode": "lite", +"passed": false, +"steps": 17, +"tokens_in": 84720, +"tokens_out": 757, +"seconds": 34, +"stopped": "no_progress", +"guard": { +"repeats": 8, +"no_progress": 2 +}, +"tools": { +"check": 1, +"look": 16 +} +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 5, +"repo": "chi", +"task": "rename", +"target": "main::node::FindRoute", +"mode": "lite", +"passed": false, +"steps": 25, +"tokens_in": 126000, +"tokens_out": 2074, +"seconds": 65, +"stopped": "steps", +"guard": { +"repeats": 6, +"soft_budget": 1 +}, +"tools": { +"look": 14, +"replace": 6, +"check": 1, +"add_after": 3, +"rename": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 5, +"repo": "chi", +"task": "fix", +"target": "middleware::prettyStack::parse", +"mode": "lite", +"passed": false, +"steps": 25, +"tokens_in": 128400, +"tokens_out": 3139, +"seconds": 117, +"stopped": "steps", +"guard": { +"repeats": 10, +"no_progress": 1, +"soft_budget": 1 +}, +"tools": { +"check": 1, +"replace": 6, +"look": 8, +"add_after": 10 +} +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 5, +"repo": "click", +"task": "rename", +"target": "click::utils::format_filename", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 6729, +"tokens_out": 179, +"seconds": 10, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 5, +"repo": "click", +"task": "fix", +"target": "click::core::Context::_default_map_has", +"mode": "lite", +"passed": false, +"steps": 25, +"tokens_in": 201810, +"tokens_out": 3834, +"seconds": 151, +"stopped": "steps", +"guard": { +"repeats": 8, +"no_progress": 1, +"soft_budget": 1 +}, +"tools": { +"check": 1, +"look": 11, +"replace": 9, +"add_after": 4 +} +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 5, +"repo": "cobra", +"task": "rename", +"target": "main::Command::ParseFlags", +"mode": "lite", +"passed": true, +"steps": 25, +"tokens_in": 121737, +"tokens_out": 1785, +"seconds": 63, +"gate": { +"check": 1 +}, +"guard": { +"repeats": 2, +"soft_budget": 1 +}, +"tools": { +"look": 21, +"rename": 1, +"check": 2, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 5, +"repo": "cobra", +"task": "fix", +"target": "main::stringInSlice", +"mode": "lite", +"passed": false, +"steps": 15, +"tokens_in": 59889, +"tokens_out": 1039, +"seconds": 35, +"guard": { +"repeats": 1 +}, +"tools": { +"check": 3, +"replace": 1, +"look": 10, +"finish": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 5, +"repo": "indexmap", +"task": "rename", +"target": "indexmap::map::raw_entry_v1::RawOccupiedEntryMut::into_key_value_mut", +"mode": "lite", +"passed": true, +"steps": 3, +"tokens_in": 2859, +"tokens_out": 125, +"seconds": 9, +"guard": {}, +"tools": { +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 5, +"repo": "indexmap", +"task": "fix", +"target": "indexmap::inner::Core::move_index", +"mode": "lite", +"passed": false, +"steps": 21, +"tokens_in": 160841, +"tokens_out": 4563, +"seconds": 147, +"stopped": "no_progress", +"guard": { +"repeats": 7, +"no_progress": 2, +"soft_budget": 1 +}, +"tools": { +"check": 1, +"look": 12, +"replace": 5, +"add_after": 1 +}, +"text_code": 2 +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 5, +"repo": "semver", +"task": "rename", +"target": "semver::identifier::Identifier::ptr_eq", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 4584, +"tokens_out": 165, +"seconds": 7, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 5, +"repo": "semver", +"task": "fix", +"target": "semver::display::Version::fmt", +"mode": "lite", +"passed": false, +"steps": 11, +"tokens_in": 45402, +"tokens_out": 3092, +"seconds": 85, +"gate": { +"nochange": 1 +}, +"guard": {}, +"tools": { +"check": 1, +"look": 10 +} +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 5, +"repo": "sqlparse", +"task": "rename", +"target": "examples::extract_table_names::extract_from_part", +"mode": "lite", +"passed": true, +"steps": 5, +"tokens_in": 5688, +"tokens_out": 224, +"seconds": 7, +"guard": { +"repeats": 1 +}, +"tools": { +"look": 1, +"rename": 1, +"check": 2, +"finish": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 5, +"repo": "sqlparse", +"task": "fix", +"target": "sqlparse::engine::grouping::group_where", +"mode": "lite", +"passed": false, +"seconds": 35, +"error": "HTTP Error 500: Internal Server Error" +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 6, +"repo": "chi", +"task": "rename", +"target": "main::RouteContext", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 5191, +"tokens_out": 139, +"seconds": 14, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 6, +"repo": "chi", +"task": "fix", +"target": "main::RegisterMethod", +"mode": "lite", +"passed": false, +"steps": 25, +"tokens_in": 167273, +"tokens_out": 1450, +"seconds": 83, +"stopped": "steps", +"guard": { +"soft_budget": 1 +}, +"tools": { +"check": 1, +"look": 24 +} +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 6, +"repo": "click", +"task": "rename", +"target": "click::decorators::pass_context", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 6341, +"tokens_out": 181, +"seconds": 12, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 6, +"repo": "click", +"task": "fix", +"target": "click::parser::_Option::__init__", +"mode": "lite", +"passed": false, +"steps": 25, +"tokens_in": 193358, +"tokens_out": 4210, +"seconds": 136, +"stopped": "steps", +"guard": { +"repeats": 6, +"soft_budget": 1 +}, +"tools": { +"check": 1, +"look": 11, +"replace": 10, +"add_after": 3 +} +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 6, +"repo": "cobra", +"task": "rename", +"target": "main::Command::UseLine", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 5431, +"tokens_out": 145, +"seconds": 13, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 6, +"repo": "cobra", +"task": "fix", +"target": "main::processFlagForGroupAnnotation", +"mode": "lite", +"passed": false, +"steps": 14, +"tokens_in": 55098, +"tokens_out": 1149, +"seconds": 45, +"stopped": "no_progress", +"guard": { +"repeats": 8, +"no_progress": 2 +}, +"tools": { +"check": 10, +"look": 2, +"replace": 2 +} +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 6, +"repo": "indexmap", +"task": "rename", +"target": "indexmap::util::assert_index_lt", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 5392, +"tokens_out": 180, +"seconds": 12, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 6, +"repo": "indexmap", +"task": "fix", +"target": "indexmap::map::slice::Slice::eq", +"mode": "lite", +"passed": true, +"steps": 20, +"tokens_in": 96635, +"tokens_out": 2414, +"seconds": 81, +"guard": { +"repeats": 4, +"soft_budget": 1 +}, +"tools": { +"check": 2, +"look": 7, +"replace": 8, +"add_after": 2, +"finish": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 6, +"repo": "semver", +"task": "rename", +"target": "semver::identifier::Identifier::empty", +"mode": "lite", +"passed": true, +"steps": 3, +"tokens_in": 3730, +"tokens_out": 142, +"seconds": 6, +"guard": {}, +"tools": { +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 6, +"repo": "semver", +"task": "fix", +"target": "semver::eval::matches_req", +"mode": "lite", +"passed": false, +"steps": 25, +"tokens_in": 134044, +"tokens_out": 3643, +"seconds": 102, +"stopped": "steps", +"guard": { +"repeats": 6, +"no_progress": 1, +"soft_budget": 1 +}, +"tools": { +"check": 2, +"replace": 11, +"look": 9, +"add_after": 3 +} +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 6, +"repo": "sqlparse", +"task": "rename", +"target": "sqlparse::engine::grouping::group_over", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 5235, +"tokens_out": 165, +"seconds": 10, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 6, +"repo": "sqlparse", +"task": "fix", +"target": "sqlparse::filters::aligned_indent::AlignedIndentFilter::_process_default", +"mode": "lite", +"passed": false, +"steps": 25, +"tokens_in": 112094, +"tokens_out": 2471, +"seconds": 77, +"stopped": "steps", +"guard": { +"repeats": 6, +"soft_budget": 1 +}, +"tools": { +"check": 1, +"look": 11, +"replace": 6, +"add_after": 7 +} +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 7, +"repo": "chi", +"task": "rename", +"target": "middleware::NewWrapResponseWriter", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 5055, +"tokens_out": 154, +"seconds": 8, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 7, +"repo": "chi", +"task": "fix", +"target": "middleware::encoderDeflate", +"mode": "lite", +"passed": true, +"steps": 6, +"tokens_in": 10567, +"tokens_out": 397, +"seconds": 43, +"guard": { +"repeats": 1 +}, +"tools": { +"check": 3, +"look": 1, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 7, +"repo": "click", +"task": "rename", +"target": "click::formatting::HelpFormatter::indentation", +"mode": "lite", +"passed": false, +"steps": 3, +"tokens_in": 3280, +"tokens_out": 142, +"seconds": 9, +"guard": {}, +"tools": { +"rename": 1, +"check": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 7, +"repo": "click", +"task": "fix", +"target": "click::shell_completion::_is_incomplete_option", +"mode": "lite", +"passed": false, +"steps": 25, +"tokens_in": 177335, +"tokens_out": 4841, +"seconds": 181, +"stopped": "steps", +"guard": { +"repeats": 2, +"soft_budget": 1 +}, +"tools": { +"check": 1, +"look": 10, +"replace": 9, +"add_after": 5 +} +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 7, +"repo": "cobra", +"task": "rename", +"target": "main::Command::GenPowerShellCompletionWithDesc", +"mode": "lite", +"passed": true, +"steps": 25, +"tokens_in": 109020, +"tokens_out": 1797, +"seconds": 62, +"gate": { +"check": 1 +}, +"guard": { +"repeats": 9, +"no_progress": 1, +"soft_budget": 1 +}, +"tools": { +"look": 16, +"rename": 1, +"check": 7, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 7, +"repo": "cobra", +"task": "fix", +"target": "main::Command::getVersionTemplateFunc", +"mode": "lite", +"passed": false, +"steps": 25, +"tokens_in": 159436, +"tokens_out": 2752, +"seconds": 95, +"stopped": "steps", +"guard": { +"repeats": 9, +"no_progress": 1, +"soft_budget": 1 +}, +"tools": { +"check": 5, +"look": 16, +"replace": 4 +} +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 7, +"repo": "indexmap", +"task": "rename", +"target": "indexmap::map::raw_entry_v1::RawVacantEntryMut::shift_insert_hashed_nocheck", +"mode": "lite", +"passed": true, +"steps": 3, +"tokens_in": 2913, +"tokens_out": 134, +"seconds": 9, +"guard": {}, +"tools": { +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 7, +"repo": "indexmap", +"task": "fix", +"target": "indexmap::inner::Core::move_index", +"mode": "lite", +"passed": false, +"steps": 25, +"tokens_in": 163616, +"tokens_out": 4493, +"seconds": 146, +"stopped": "steps", +"guard": { +"repeats": 2, +"soft_budget": 1 +}, +"tools": { +"check": 2, +"look": 22, +"replace": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 7, +"repo": "semver", +"task": "rename", +"target": "semver::identifier::Identifier::new_unchecked", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 7659, +"tokens_out": 354, +"seconds": 12, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 7, +"repo": "semver", +"task": "fix", +"target": "semver::display::Version::fmt", +"mode": "lite", +"passed": false, +"steps": 25, +"tokens_in": 116381, +"tokens_out": 3030, +"seconds": 86, +"stopped": "steps", +"guard": { +"repeats": 3, +"soft_budget": 1 +}, +"tools": { +"check": 1, +"look": 13, +"replace": 4, +"add_after": 7 +} +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 7, +"repo": "sqlparse", +"task": "rename", +"target": "sqlparse::sql::TokenList::token_not_matching", +"mode": "lite", +"passed": false, +"steps": 3, +"tokens_in": 2994, +"tokens_out": 141, +"seconds": 8, +"guard": {}, +"tools": { +"rename": 1, +"check": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 7, +"repo": "sqlparse", +"task": "fix", +"target": "sqlparse::lexer::Lexer::get_default_instance", +"mode": "lite", +"passed": false, +"steps": 25, +"tokens_in": 131269, +"tokens_out": 2134, +"seconds": 67, +"stopped": "steps", +"guard": { +"repeats": 5, +"soft_budget": 1 +}, +"tools": { +"check": 1, +"look": 16, +"replace": 5, +"add_after": 3 +} +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 8, +"repo": "chi", +"task": "rename", +"target": "_examples::rest::ErrInvalidRequest", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 4269, +"tokens_out": 148, +"seconds": 7, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 8, +"repo": "chi", +"task": "fix", +"target": "main::Mux::nextRoutePath", +"mode": "lite", +"passed": false, +"steps": 19, +"tokens_in": 99623, +"tokens_out": 1613, +"seconds": 81, +"stopped": "no_progress", +"guard": { +"repeats": 10, +"no_progress": 2, +"soft_budget": 1 +}, +"tools": { +"check": 1, +"look": 12, +"replace": 4, +"add_after": 2 +} +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 8, +"repo": "click", +"task": "rename", +"target": "click::types::Path::coerce_path_result", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 5054, +"tokens_out": 183, +"seconds": 11, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 8, +"repo": "click", +"task": "fix", +"target": "click::core::Parameter::get_default", +"mode": "lite", +"passed": true, +"steps": 14, +"tokens_in": 77138, +"tokens_out": 3373, +"seconds": 104, +"guard": { +"repeats": 2 +}, +"tools": { +"check": 3, +"look": 10, +"replace": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 8, +"repo": "cobra", +"task": "rename", +"target": "main::Command::CalledAs", +"mode": "lite", +"passed": true, +"steps": 25, +"tokens_in": 122829, +"tokens_out": 3488, +"seconds": 110, +"gate": { +"check": 1 +}, +"guard": { +"repeats": 8, +"soft_budget": 1 +}, +"tools": { +"look": 12, +"rename": 1, +"check": 7, +"finish": 1, +"replace": 4 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 8, +"repo": "cobra", +"task": "fix", +"target": "main::Command::SetHelpCommandGroupID", +"mode": "lite", +"passed": false, +"steps": 14, +"tokens_in": 45677, +"tokens_out": 1079, +"seconds": 42, +"guard": { +"repeats": 6, +"no_progress": 1 +}, +"tools": { +"check": 4, +"look": 6, +"replace": 2, +"add_after": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 8, +"repo": "indexmap", +"task": "rename", +"target": "indexmap::serde::cautious_capacity", +"mode": "lite", +"passed": true, +"steps": 3, +"tokens_in": 2890, +"tokens_out": 126, +"seconds": 6, +"guard": {}, +"tools": { +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 8, +"repo": "indexmap", +"task": "fix", +"target": "indexmap::inner::entry::OccupiedEntry::move_index", +"mode": "lite", +"passed": true, +"steps": 8, +"tokens_in": 17719, +"tokens_out": 997, +"seconds": 34, +"guard": { +"repeats": 1 +}, +"tools": { +"check": 2, +"look": 3, +"replace": 2, +"finish": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 8, +"repo": "semver", +"task": "rename", +"target": "semver::identifier::Identifier::empty", +"mode": "lite", +"passed": true, +"steps": 3, +"tokens_in": 3730, +"tokens_out": 136, +"seconds": 6, +"guard": {}, +"tools": { +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 8, +"repo": "semver", +"task": "fix", +"target": "semver::error::QuotedChar::fmt", +"mode": "lite", +"passed": false, +"steps": 16, +"tokens_in": 87057, +"tokens_out": 3621, +"seconds": 108, +"gate": { +"nochange": 1 +}, +"guard": {}, +"tools": { +"check": 1, +"look": 15 +} +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 8, +"repo": "sqlparse", +"task": "rename", +"target": "examples::extract_table_names::is_subselect", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 4134, +"tokens_out": 136, +"seconds": 4, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 8, +"repo": "sqlparse", +"task": "fix", +"target": "sqlparse::filters::others::StripWhitespaceFilter::process", +"mode": "lite", +"passed": true, +"steps": 16, +"tokens_in": 53877, +"tokens_out": 1815, +"seconds": 53, +"guard": { +"repeats": 2 +}, +"tools": { +"check": 2, +"replace": 5, +"look": 7, +"add_after": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 9, +"repo": "chi", +"task": "rename", +"target": "middleware::WithLogEntry", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 4518, +"tokens_out": 152, +"seconds": 8, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 9, +"repo": "chi", +"task": "fix", +"target": "main::nodes::tailSort", +"mode": "lite", +"passed": false, +"steps": 25, +"tokens_in": 204966, +"tokens_out": 2758, +"seconds": 143, +"stopped": "steps", +"guard": { +"repeats": 3, +"soft_budget": 1 +}, +"tools": { +"check": 1, +"look": 18, +"replace": 4, +"add_after": 2 +} +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 9, +"repo": "click", +"task": "rename", +"target": "click::types::File::resolve_lazy_flag", +"mode": "lite", +"passed": true, +"steps": 3, +"tokens_in": 2909, +"tokens_out": 146, +"seconds": 9, +"guard": {}, +"tools": { +"rename": 1, +"check": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 9, +"repo": "click", +"task": "fix", +"target": "click::types::Choice::__init__", +"mode": "lite", +"passed": true, +"steps": 21, +"tokens_in": 112351, +"tokens_out": 2256, +"seconds": 82, +"guard": { +"repeats": 9, +"no_progress": 1, +"soft_budget": 1 +}, +"tools": { +"check": 5, +"look": 14, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 9, +"repo": "cobra", +"task": "rename", +"target": "main::Command::HasPersistentFlags", +"mode": "lite", +"passed": true, +"steps": 24, +"tokens_in": 146700, +"tokens_out": 3111, +"seconds": 101, +"gate": { +"check": 1 +}, +"guard": { +"repeats": 7, +"soft_budget": 1 +}, +"tools": { +"look": 19, +"rename": 1, +"check": 3, +"replace": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 9, +"repo": "cobra", +"task": "fix", +"target": "main::Command::PersistentFlags", +"mode": "lite", +"passed": false, +"steps": 25, +"tokens_in": 227811, +"tokens_out": 1854, +"seconds": 145, +"stopped": "steps", +"guard": { +"repeats": 2, +"soft_budget": 1 +}, +"tools": { +"check": 1, +"look": 24 +} +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 9, +"repo": "indexmap", +"task": "rename", +"target": "indexmap::map::raw_entry_v1::RawVacantEntryMut::insert_hashed_nocheck", +"mode": "lite", +"passed": true, +"steps": 3, +"tokens_in": 2912, +"tokens_out": 156, +"seconds": 9, +"guard": {}, +"tools": { +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 9, +"repo": "indexmap", +"task": "fix", +"target": "indexmap::inner::Core::move_index", +"mode": "lite", +"passed": false, +"steps": 25, +"tokens_in": 151301, +"tokens_out": 4091, +"seconds": 143, +"guard": { +"soft_budget": 1 +}, +"tools": { +"check": 1, +"look": 21, +"replace": 2 +}, +"text_code": 1 +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 9, +"repo": "semver", +"task": "rename", +"target": "semver::identifier::Identifier::new_unchecked", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 7684, +"tokens_out": 306, +"seconds": 11, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 9, +"repo": "semver", +"task": "fix", +"target": "semver::eval::matches_caret", +"mode": "lite", +"passed": false, +"steps": 18, +"tokens_in": 73508, +"tokens_out": 2736, +"seconds": 76, +"stopped": "no_progress", +"guard": { +"repeats": 8, +"no_progress": 2 +}, +"tools": { +"check": 1, +"look": 4, +"replace": 5, +"add_after": 8 +} +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 9, +"repo": "sqlparse", +"task": "rename", +"target": "sqlparse::engine::grouping::group_as", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 5271, +"tokens_out": 165, +"seconds": 10, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-4b", +"version": "old", +"set": 9, +"repo": "sqlparse", +"task": "fix", +"target": "sqlparse::filters::others::StripTrailingSemicolonFilter::process", +"mode": "lite", +"passed": true, +"steps": 20, +"tokens_in": 79106, +"tokens_out": 2305, +"seconds": 72, +"guard": { +"repeats": 3, +"soft_budget": 1 +}, +"tools": { +"check": 2, +"look": 8, +"replace": 8, +"add_after": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 0, +"repo": "chi", +"task": "rename", +"target": "main::NewRouteContext", +"mode": "lite", +"passed": true, +"steps": 5, +"tokens_in": 6980, +"tokens_out": 266, +"seconds": 17, +"guard": { +"repeats": 1 +}, +"tools": { +"look": 1, +"rename": 1, +"check": 2, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 0, +"repo": "chi", +"task": "fix", +"target": "middleware::parseRemoteAddr", +"mode": "lite", +"passed": true, +"steps": 23, +"tokens_in": 157139, +"tokens_out": 3378, +"seconds": 204, +"guard": { +"repeats": 6, +"soft_budget": 1 +}, +"tools": { +"check": 5, +"look": 15, +"replace": 2, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 0, +"repo": "click", +"task": "rename", +"target": "click::core::iter_params_for_processing", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 5620, +"tokens_out": 295, +"seconds": 19, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 0, +"repo": "click", +"task": "fix", +"target": "click::_compat::get_text_stdin", +"mode": "lite", +"passed": true, +"steps": 5, +"tokens_in": 8055, +"tokens_out": 524, +"seconds": 38, +"guard": {}, +"tools": { +"check": 2, +"look": 1, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 0, +"repo": "cobra", +"task": "rename", +"target": "main::Command::ValidateRequiredFlags", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 5159, +"tokens_out": 256, +"seconds": 17, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 0, +"repo": "cobra", +"task": "fix", +"target": "main::Command::PersistentFlags", +"mode": "lite", +"passed": false, +"steps": 25, +"tokens_in": 126058, +"tokens_out": 2118, +"seconds": 118, +"stopped": "steps", +"guard": { +"repeats": 3, +"soft_budget": 1 +}, +"tools": { +"check": 3, +"replace": 1, +"look": 21 +} +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 0, +"repo": "indexmap", +"task": "rename", +"target": "indexmap::inner::extract::ExtractCore::remaining", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 5410, +"tokens_out": 245, +"seconds": 18, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 0, +"repo": "indexmap", +"task": "fix", +"target": "indexmap::inner::Core::reserve_entries", +"mode": "lite", +"passed": true, +"steps": 5, +"tokens_in": 9119, +"tokens_out": 659, +"seconds": 41, +"guard": {}, +"tools": { +"check": 2, +"look": 1, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 0, +"repo": "semver", +"task": "rename", +"target": "semver::eval::matches_comparator", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 4212, +"tokens_out": 222, +"seconds": 11, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 0, +"repo": "semver", +"task": "fix", +"target": "semver::eval::matches_greater", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 5764, +"tokens_out": 427, +"seconds": 21, +"guard": {}, +"tools": { +"check": 2, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 0, +"repo": "sqlparse", +"task": "rename", +"target": "sqlparse::engine::grouping::group_order", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 5327, +"tokens_out": 258, +"seconds": 17, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 0, +"repo": "sqlparse", +"task": "fix", +"target": "sqlparse::filters::others::SpacesAroundOperatorsFilter::_process", +"mode": "lite", +"passed": false, +"steps": 5, +"tokens_in": 20744, +"tokens_out": 2537, +"seconds": 125, +"gate": { +"nochange": 1 +}, +"guard": { +"repeats": 1 +}, +"tools": { +"check": 1, +"look": 4 +} +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 1, +"repo": "chi", +"task": "rename", +"target": "_examples::rest::NewUserPayloadResponse", +"mode": "lite", +"passed": true, +"steps": 9, +"tokens_in": 16930, +"tokens_out": 411, +"seconds": 24, +"guard": {}, +"tools": { +"look": 6, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 1, +"repo": "chi", +"task": "fix", +"target": "main::node::findPattern", +"mode": "lite", +"passed": true, +"steps": 25, +"tokens_in": 180880, +"tokens_out": 2017, +"seconds": 212, +"stopped": "steps", +"guard": { +"repeats": 7, +"soft_budget": 1 +}, +"tools": { +"check": 6, +"look": 17, +"replace": 2 +} +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 1, +"repo": "click", +"task": "rename", +"target": "examples::imagepipe::imagepipe::convert_flip", +"mode": "lite", +"passed": true, +"steps": 7, +"tokens_in": 10277, +"tokens_out": 588, +"seconds": 32, +"guard": { +"repeats": 1 +}, +"tools": { +"look": 2, +"replace": 2, +"rename": 1, +"check": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 1, +"repo": "click", +"task": "fix", +"target": "click::_compat::get_text_stderr", +"mode": "lite", +"passed": true, +"steps": 20, +"tokens_in": 77186, +"tokens_out": 1382, +"seconds": 89, +"guard": { +"soft_budget": 1 +}, +"tools": { +"check": 2, +"look": 16, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 1, +"repo": "cobra", +"task": "rename", +"target": "main::CheckErr", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 5146, +"tokens_out": 215, +"seconds": 20, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 1, +"repo": "cobra", +"task": "fix", +"target": "main::writeShortFlag", +"mode": "lite", +"passed": false, +"steps": 4, +"tokens_in": 5893, +"tokens_out": 368, +"seconds": 24, +"guard": {}, +"tools": { +"check": 2, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 1, +"repo": "indexmap", +"task": "rename", +"target": "indexmap::set::IndexSet::is_subset", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 4969, +"tokens_out": 226, +"seconds": 20, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 1, +"repo": "indexmap", +"task": "fix", +"target": "indexmap::inner::entry::OccupiedEntry::swap_indices", +"mode": "lite", +"passed": true, +"steps": 5, +"tokens_in": 8378, +"tokens_out": 522, +"seconds": 34, +"guard": {}, +"tools": { +"check": 2, +"look": 1, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 1, +"repo": "semver", +"task": "rename", +"target": "semver::identifier::Identifier::ptr_eq", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 4651, +"tokens_out": 229, +"seconds": 13, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 1, +"repo": "semver", +"task": "fix", +"target": "semver::display::Version::fmt", +"mode": "lite", +"passed": false, +"seconds": 57, +"error": "HTTP Error 500: Internal Server Error" +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 1, +"repo": "sqlparse", +"task": "rename", +"target": "sqlparse::lexer::Lexer::default_initialization", +"mode": "lite", +"passed": true, +"steps": 7, +"tokens_in": 9836, +"tokens_out": 357, +"seconds": 20, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 4, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 1, +"repo": "sqlparse", +"task": "fix", +"target": "sqlparse::engine::grouping::group_period", +"mode": "lite", +"passed": false, +"seconds": 109, +"error": "HTTP Error 500: Internal Server Error" +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 10, +"repo": "chi", +"task": "rename", +"target": "main::RegisterMethod", +"mode": "lite", +"passed": true, +"steps": 9, +"tokens_in": 16720, +"tokens_out": 399, +"seconds": 23, +"guard": {}, +"tools": { +"look": 6, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 10, +"repo": "chi", +"task": "fix", +"target": "main::Mux::handle", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 6309, +"tokens_out": 569, +"seconds": 61, +"guard": {}, +"tools": { +"check": 2, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 10, +"repo": "click", +"task": "rename", +"target": "click::core::iter_params_for_processing", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 5627, +"tokens_out": 281, +"seconds": 18, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 10, +"repo": "click", +"task": "fix", +"target": "click::exceptions::UsageError::show", +"mode": "lite", +"passed": true, +"steps": 5, +"tokens_in": 9502, +"tokens_out": 701, +"seconds": 46, +"guard": {}, +"tools": { +"check": 2, +"look": 1, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 10, +"repo": "cobra", +"task": "rename", +"target": "main::Command::CalledAs", +"mode": "lite", +"passed": true, +"steps": 25, +"tokens_in": 141519, +"tokens_out": 3066, +"seconds": 155, +"stopped": "steps", +"guard": { +"repeats": 8, +"soft_budget": 1 +}, +"tools": { +"look": 19, +"replace": 4, +"check": 2 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 10, +"repo": "cobra", +"task": "fix", +"target": "main::Command::getHelpTemplateFunc", +"mode": "lite", +"passed": false, +"steps": 4, +"tokens_in": 5997, +"tokens_out": 374, +"seconds": 21, +"guard": {}, +"tools": { +"check": 2, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 10, +"repo": "indexmap", +"task": "rename", +"target": "indexmap::inner::extract::ExtractCore::remaining", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 5460, +"tokens_out": 236, +"seconds": 14, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 10, +"repo": "indexmap", +"task": "fix", +"target": "indexmap::map::IndexMap::with_capacity_and_hasher", +"mode": "lite", +"passed": true, +"steps": 6, +"tokens_in": 10658, +"tokens_out": 757, +"seconds": 44, +"guard": {}, +"tools": { +"check": 2, +"look": 2, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 10, +"repo": "semver", +"task": "rename", +"target": "semver::identifier::Identifier::ptr_eq", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 4653, +"tokens_out": 243, +"seconds": 13, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 10, +"repo": "semver", +"task": "fix", +"target": "semver::identifier::Identifier::is_empty", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 5801, +"tokens_out": 400, +"seconds": 21, +"guard": {}, +"tools": { +"check": 2, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 10, +"repo": "sqlparse", +"task": "rename", +"target": "sqlparse::lexer::Lexer::add_keywords", +"mode": "lite", +"passed": false, +"steps": 25, +"tokens_in": 117647, +"tokens_out": 2194, +"seconds": 116, +"gate": { +"check": 1 +}, +"guard": { +"repeats": 4, +"soft_budget": 1 +}, +"tools": { +"look": 15, +"replace": 3, +"check": 5, +"finish": 1, +"rename": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 10, +"repo": "sqlparse", +"task": "fix", +"target": "sqlparse::sql::TokenList::get_parent_name", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 5790, +"tokens_out": 352, +"seconds": 21, +"guard": {}, +"tools": { +"check": 2, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 11, +"repo": "chi", +"task": "rename", +"target": "main::RegisterMethod", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 4783, +"tokens_out": 231, +"seconds": 14, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 11, +"repo": "chi", +"task": "fix", +"target": "middleware::RequestID", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 5849, +"tokens_out": 406, +"seconds": 51, +"guard": {}, +"tools": { +"check": 2, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 11, +"repo": "click", +"task": "rename", +"target": "click::formatting::HelpFormatter::dedent", +"mode": "lite", +"passed": false, +"steps": 10, +"tokens_in": 15979, +"tokens_out": 288, +"seconds": 18, +"stopped": "no_progress", +"guard": { +"repeats": 8, +"no_progress": 2 +}, +"tools": { +"look": 10 +} +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 11, +"repo": "click", +"task": "fix", +"target": "click::core::Option::add_to_parser", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 6934, +"tokens_out": 638, +"seconds": 43, +"guard": {}, +"tools": { +"check": 2, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 11, +"repo": "cobra", +"task": "rename", +"target": "main::Command::PersistentFlags", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 6581, +"tokens_out": 223, +"seconds": 20, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 11, +"repo": "cobra", +"task": "fix", +"target": "doc::GenMan", +"mode": "lite", +"passed": false, +"steps": 21, +"tokens_in": 80735, +"tokens_out": 1231, +"seconds": 72, +"guard": { +"repeats": 2, +"soft_budget": 1 +}, +"tools": { +"check": 2, +"look": 17, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 11, +"repo": "indexmap", +"task": "rename", +"target": "indexmap::util::try_simplify_range", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 5398, +"tokens_out": 232, +"seconds": 15, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 11, +"repo": "indexmap", +"task": "fix", +"target": "indexmap::map::IndexMap::replace_index", +"mode": "lite", +"passed": true, +"steps": 8, +"tokens_in": 20459, +"tokens_out": 1373, +"seconds": 71, +"guard": { +"repeats": 1 +}, +"tools": { +"check": 3, +"look": 3, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 11, +"repo": "semver", +"task": "rename", +"target": "semver::identifier::Identifier::empty", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 5872, +"tokens_out": 254, +"seconds": 14, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 11, +"repo": "semver", +"task": "fix", +"target": "semver::identifier::Identifier::is_empty", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 5829, +"tokens_out": 393, +"seconds": 21, +"guard": {}, +"tools": { +"check": 2, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 11, +"repo": "sqlparse", +"task": "rename", +"target": "benchmarks::bench_lexer_delimiters::unmatched_dollar_quotes", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 4229, +"tokens_out": 195, +"seconds": 10, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 11, +"repo": "sqlparse", +"task": "fix", +"target": "sqlparse::cli::main", +"mode": "lite", +"passed": true, +"steps": 5, +"tokens_in": 8368, +"tokens_out": 476, +"seconds": 28, +"guard": { +"repeats": 1 +}, +"tools": { +"check": 3, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 2, +"repo": "chi", +"task": "rename", +"target": "_examples::fileserver::FileServer", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 4995, +"tokens_out": 344, +"seconds": 18, +"guard": {}, +"tools": { +"look": 1, +"replace": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 2, +"repo": "chi", +"task": "fix", +"target": "middleware::GetHead", +"mode": "lite", +"passed": true, +"steps": 9, +"tokens_in": 22712, +"tokens_out": 986, +"seconds": 79, +"guard": { +"repeats": 1 +}, +"tools": { +"check": 3, +"look": 4, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 2, +"repo": "click", +"task": "rename", +"target": "click::core::Command::get_help_option_names", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 5470, +"tokens_out": 230, +"seconds": 16, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 2, +"repo": "click", +"task": "fix", +"target": "click::utils::_make_default_short_help", +"mode": "lite", +"passed": true, +"steps": 5, +"tokens_in": 10665, +"tokens_out": 879, +"seconds": 54, +"guard": {}, +"tools": { +"check": 2, +"look": 1, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 2, +"repo": "cobra", +"task": "rename", +"target": "main::Command::Name", +"mode": "lite", +"passed": true, +"steps": 22, +"tokens_in": 169148, +"tokens_out": 1686, +"seconds": 104, +"stopped": "no_progress", +"guard": { +"repeats": 12, +"no_progress": 2, +"soft_budget": 1 +}, +"tools": { +"look": 16, +"rename": 1, +"check": 4, +"replace": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 2, +"repo": "cobra", +"task": "fix", +"target": "main::Command::hasNameOrAliasPrefix", +"mode": "lite", +"passed": false, +"steps": 6, +"tokens_in": 11703, +"tokens_out": 820, +"seconds": 42, +"guard": {}, +"tools": { +"check": 2, +"look": 2, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 2, +"repo": "indexmap", +"task": "rename", +"target": "indexmap::map::IndexMap::sort_unstable_keys", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 4607, +"tokens_out": 267, +"seconds": 18, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 2, +"repo": "indexmap", +"task": "fix", +"target": "indexmap::inner::Core::decrement_indices", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 6319, +"tokens_out": 523, +"seconds": 42, +"guard": {}, +"tools": { +"check": 2, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 2, +"repo": "semver", +"task": "rename", +"target": "semver::identifier::Identifier::ptr_eq", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 4651, +"tokens_out": 229, +"seconds": 13, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 2, +"repo": "semver", +"task": "fix", +"target": "semver::display::Version::fmt", +"mode": "lite", +"passed": true, +"steps": 17, +"tokens_in": 99943, +"tokens_out": 5570, +"seconds": 257, +"gate": { +"nochange": 1 +}, +"guard": { +"repeats": 3 +}, +"tools": { +"check": 5, +"look": 9, +"replace": 3 +} +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 2, +"repo": "sqlparse", +"task": "rename", +"target": "sqlparse::lexer::Lexer::default_initialization", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 4945, +"tokens_out": 217, +"seconds": 12, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 2, +"repo": "sqlparse", +"task": "fix", +"target": "sqlparse::engine::grouping::group_values", +"mode": "lite", +"passed": false, +"steps": 6, +"tokens_in": 12769, +"tokens_out": 720, +"seconds": 41, +"guard": {}, +"tools": { +"check": 2, +"look": 2, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 3, +"repo": "chi", +"task": "rename", +"target": "main::RegisterMethod", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 4758, +"tokens_out": 210, +"seconds": 17, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 3, +"repo": "chi", +"task": "fix", +"target": "main::URLParamFromCtx", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 5513, +"tokens_out": 381, +"seconds": 50, +"guard": {}, +"tools": { +"check": 2, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 3, +"repo": "click", +"task": "rename", +"target": "click::formatting::HelpFormatter::dedent", +"mode": "lite", +"passed": false, +"steps": 13, +"tokens_in": 29038, +"tokens_out": 412, +"seconds": 26, +"stopped": "no_progress", +"guard": { +"repeats": 9, +"no_progress": 2 +}, +"tools": { +"look": 12, +"replace": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 3, +"repo": "click", +"task": "fix", +"target": "click::core::Context::find_object", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 5824, +"tokens_out": 367, +"seconds": 31, +"guard": {}, +"tools": { +"check": 2, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 3, +"repo": "cobra", +"task": "rename", +"target": "doc::GenMarkdownTreeCustom", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 5174, +"tokens_out": 226, +"seconds": 14, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 3, +"repo": "cobra", +"task": "fix", +"target": "doc::GenMan", +"mode": "lite", +"passed": false, +"steps": 20, +"tokens_in": 109075, +"tokens_out": 2234, +"seconds": 122, +"guard": { +"repeats": 5, +"no_progress": 1, +"soft_budget": 1 +}, +"tools": { +"check": 3, +"look": 14, +"replace": 2, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 3, +"repo": "indexmap", +"task": "rename", +"target": "indexmap::util::try_simplify_range", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 5378, +"tokens_out": 236, +"seconds": 17, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 3, +"repo": "indexmap", +"task": "fix", +"target": "indexmap::inner::erase_index", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 5680, +"tokens_out": 316, +"seconds": 23, +"guard": {}, +"tools": { +"check": 2, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 3, +"repo": "semver", +"task": "rename", +"target": "semver::eval::matches_comparator", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 4208, +"tokens_out": 214, +"seconds": 11, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 3, +"repo": "semver", +"task": "fix", +"target": "semver::eval::matches_req", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 5890, +"tokens_out": 403, +"seconds": 23, +"guard": {}, +"tools": { +"check": 2, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 3, +"repo": "sqlparse", +"task": "rename", +"target": "sqlparse::sql::TokenList::get_name", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 5623, +"tokens_out": 249, +"seconds": 14, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 3, +"repo": "sqlparse", +"task": "fix", +"target": "sqlparse::filters::reindent::ReindentFilter::_process_case", +"mode": "lite", +"passed": true, +"steps": 5, +"tokens_in": 9691, +"tokens_out": 739, +"seconds": 41, +"guard": {}, +"tools": { +"check": 2, +"look": 1, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 4, +"repo": "chi", +"task": "rename", +"target": "_examples::fileserver::FileServer", +"mode": "lite", +"passed": true, +"steps": 7, +"tokens_in": 10335, +"tokens_out": 398, +"seconds": 22, +"guard": {}, +"tools": { +"look": 4, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 4, +"repo": "chi", +"task": "fix", +"target": "main::RegisterMethod", +"mode": "lite", +"passed": false, +"steps": 25, +"tokens_in": 170063, +"tokens_out": 3208, +"seconds": 195, +"stopped": "steps", +"guard": { +"repeats": 1, +"soft_budget": 1 +}, +"tools": { +"check": 2, +"look": 23 +} +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 4, +"repo": "click", +"task": "rename", +"target": "click::testing::CliRunner::make_env", +"mode": "lite", +"passed": true, +"steps": 7, +"tokens_in": 21466, +"tokens_out": 392, +"seconds": 28, +"guard": {}, +"tools": { +"look": 4, +"rename": 1, +"check": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 4, +"repo": "click", +"task": "fix", +"target": "click::decorators::pass_meta_key", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 6433, +"tokens_out": 606, +"seconds": 39, +"guard": {}, +"tools": { +"check": 2, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 4, +"repo": "cobra", +"task": "rename", +"target": "main::Command::LocalFlags", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 6006, +"tokens_out": 225, +"seconds": 19, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 4, +"repo": "cobra", +"task": "fix", +"target": "main::Command::IsAdditionalHelpTopicCommand", +"mode": "lite", +"passed": false, +"steps": 25, +"tokens_in": 176100, +"tokens_out": 3906, +"seconds": 217, +"stopped": "steps", +"guard": { +"repeats": 2, +"soft_budget": 1 +}, +"tools": { +"check": 2, +"look": 22, +"replace": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 4, +"repo": "indexmap", +"task": "rename", +"target": "indexmap::rayon::set::IndexSet::par_difference", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 5238, +"tokens_out": 228, +"seconds": 16, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 4, +"repo": "indexmap", +"task": "fix", +"target": "indexmap::inner::Core::try_reserve_entries", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 6529, +"tokens_out": 555, +"seconds": 35, +"guard": {}, +"tools": { +"check": 2, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 4, +"repo": "semver", +"task": "rename", +"target": "semver::identifier::Identifier::ptr_eq", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 4652, +"tokens_out": 207, +"seconds": 12, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 4, +"repo": "semver", +"task": "fix", +"target": "semver::parse::op", +"mode": "lite", +"passed": true, +"steps": 5, +"tokens_in": 8852, +"tokens_out": 608, +"seconds": 30, +"guard": { +"repeats": 1 +}, +"tools": { +"check": 3, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 4, +"repo": "sqlparse", +"task": "rename", +"target": "sqlparse::engine::grouping::group_typed_literal", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 5894, +"tokens_out": 273, +"seconds": 18, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 4, +"repo": "sqlparse", +"task": "fix", +"target": "sqlparse::engine::grouping::group_tzcasts", +"mode": "lite", +"passed": true, +"steps": 17, +"tokens_in": 67089, +"tokens_out": 1807, +"seconds": 91, +"guard": { +"repeats": 2 +}, +"tools": { +"check": 6, +"look": 9, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 5, +"repo": "chi", +"task": "rename", +"target": "main::node::FindRoute", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 5423, +"tokens_out": 221, +"seconds": 23, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 5, +"repo": "chi", +"task": "fix", +"target": "middleware::prettyStack::parse", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 6814, +"tokens_out": 608, +"seconds": 62, +"guard": {}, +"tools": { +"check": 2, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 5, +"repo": "click", +"task": "rename", +"target": "click::utils::format_filename", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 6834, +"tokens_out": 246, +"seconds": 18, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 5, +"repo": "click", +"task": "fix", +"target": "click::core::Context::_default_map_has", +"mode": "lite", +"passed": true, +"steps": 25, +"tokens_in": 154698, +"tokens_out": 3262, +"seconds": 231, +"stopped": "steps", +"guard": { +"repeats": 7, +"no_progress": 1, +"soft_budget": 1 +}, +"tools": { +"check": 7, +"look": 17, +"replace": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 5, +"repo": "cobra", +"task": "rename", +"target": "main::Command::ParseFlags", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 5425, +"tokens_out": 258, +"seconds": 21, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 5, +"repo": "cobra", +"task": "fix", +"target": "main::stringInSlice", +"mode": "lite", +"passed": false, +"steps": 5, +"tokens_in": 8179, +"tokens_out": 399, +"seconds": 24, +"guard": { +"repeats": 1 +}, +"tools": { +"check": 3, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 5, +"repo": "indexmap", +"task": "rename", +"target": "indexmap::map::raw_entry_v1::RawOccupiedEntryMut::into_key_value_mut", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 4632, +"tokens_out": 274, +"seconds": 18, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 5, +"repo": "indexmap", +"task": "fix", +"target": "indexmap::inner::Core::move_index", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 6170, +"tokens_out": 558, +"seconds": 38, +"guard": {}, +"tools": { +"check": 2, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 5, +"repo": "semver", +"task": "rename", +"target": "semver::identifier::Identifier::ptr_eq", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 4645, +"tokens_out": 248, +"seconds": 13, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 5, +"repo": "semver", +"task": "fix", +"target": "semver::display::Version::fmt", +"mode": "lite", +"passed": true, +"steps": 10, +"tokens_in": 28202, +"tokens_out": 1654, +"seconds": 77, +"guard": { +"repeats": 1 +}, +"tools": { +"check": 3, +"look": 4, +"replace": 2, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 5, +"repo": "sqlparse", +"task": "rename", +"target": "examples::extract_table_names::extract_from_part", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 4282, +"tokens_out": 168, +"seconds": 9, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 5, +"repo": "sqlparse", +"task": "fix", +"target": "sqlparse::engine::grouping::group_where", +"mode": "lite", +"passed": false, +"steps": 25, +"tokens_in": 150590, +"tokens_out": 3362, +"seconds": 176, +"stopped": "steps", +"guard": { +"repeats": 9, +"soft_budget": 1 +}, +"tools": { +"check": 5, +"look": 17, +"replace": 3 +} +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 6, +"repo": "chi", +"task": "rename", +"target": "main::RouteContext", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 5283, +"tokens_out": 227, +"seconds": 16, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 6, +"repo": "chi", +"task": "fix", +"target": "main::RegisterMethod", +"mode": "lite", +"passed": true, +"steps": 19, +"tokens_in": 120552, +"tokens_out": 2138, +"seconds": 150, +"guard": { +"repeats": 3, +"soft_budget": 1 +}, +"tools": { +"check": 4, +"look": 13, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 6, +"repo": "click", +"task": "rename", +"target": "click::decorators::pass_context", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 6437, +"tokens_out": 245, +"seconds": 18, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 6, +"repo": "click", +"task": "fix", +"target": "click::parser::_Option::__init__", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 6637, +"tokens_out": 544, +"seconds": 40, +"guard": {}, +"tools": { +"check": 2, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 6, +"repo": "cobra", +"task": "rename", +"target": "main::Command::UseLine", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 5499, +"tokens_out": 230, +"seconds": 16, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 6, +"repo": "cobra", +"task": "fix", +"target": "main::processFlagForGroupAnnotation", +"mode": "lite", +"passed": false, +"steps": 25, +"tokens_in": 168747, +"tokens_out": 4259, +"seconds": 264, +"stopped": "steps", +"guard": { +"repeats": 8, +"soft_budget": 1 +}, +"tools": { +"check": 7, +"look": 17, +"replace": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 6, +"repo": "indexmap", +"task": "rename", +"target": "indexmap::util::assert_index_lt", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 5464, +"tokens_out": 212, +"seconds": 17, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 6, +"repo": "indexmap", +"task": "fix", +"target": "indexmap::map::slice::Slice::eq", +"mode": "lite", +"passed": true, +"steps": 5, +"tokens_in": 8442, +"tokens_out": 473, +"seconds": 30, +"guard": {}, +"tools": { +"check": 2, +"replace": 2, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 6, +"repo": "semver", +"task": "rename", +"target": "semver::identifier::Identifier::empty", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 5880, +"tokens_out": 282, +"seconds": 15, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 6, +"repo": "semver", +"task": "fix", +"target": "semver::eval::matches_req", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 5930, +"tokens_out": 433, +"seconds": 22, +"guard": {}, +"tools": { +"check": 2, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 6, +"repo": "sqlparse", +"task": "rename", +"target": "sqlparse::engine::grouping::group_over", +"mode": "lite", +"passed": true, +"steps": 5, +"tokens_in": 7700, +"tokens_out": 286, +"seconds": 18, +"guard": {}, +"tools": { +"look": 2, +"rename": 1, +"check": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 6, +"repo": "sqlparse", +"task": "fix", +"target": "sqlparse::filters::aligned_indent::AlignedIndentFilter::_process_default", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 6297, +"tokens_out": 384, +"seconds": 24, +"guard": {}, +"tools": { +"check": 2, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 7, +"repo": "chi", +"task": "rename", +"target": "middleware::NewWrapResponseWriter", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 5135, +"tokens_out": 220, +"seconds": 44, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 7, +"repo": "chi", +"task": "fix", +"target": "middleware::encoderDeflate", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 6089, +"tokens_out": 352, +"seconds": 49, +"guard": {}, +"tools": { +"check": 2, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 7, +"repo": "click", +"task": "rename", +"target": "click::formatting::HelpFormatter::indentation", +"mode": "lite", +"passed": false, +"steps": 4, +"tokens_in": 5429, +"tokens_out": 324, +"seconds": 20, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 7, +"repo": "click", +"task": "fix", +"target": "click::shell_completion::_is_incomplete_option", +"mode": "lite", +"passed": true, +"steps": 14, +"tokens_in": 68260, +"tokens_out": 3377, +"seconds": 171, +"guard": { +"repeats": 1 +}, +"tools": { +"check": 2, +"look": 11, +"replace": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 7, +"repo": "cobra", +"task": "rename", +"target": "main::Command::GenPowerShellCompletionWithDesc", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 4960, +"tokens_out": 257, +"seconds": 21, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 7, +"repo": "cobra", +"task": "fix", +"target": "main::Command::getVersionTemplateFunc", +"mode": "lite", +"passed": false, +"steps": 4, +"tokens_in": 6614, +"tokens_out": 322, +"seconds": 21, +"guard": {}, +"tools": { +"check": 2, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 7, +"repo": "indexmap", +"task": "rename", +"target": "indexmap::map::raw_entry_v1::RawVacantEntryMut::shift_insert_hashed_nocheck", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 4936, +"tokens_out": 266, +"seconds": 18, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 7, +"repo": "indexmap", +"task": "fix", +"target": "indexmap::inner::Core::move_index", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 6058, +"tokens_out": 498, +"seconds": 33, +"guard": {}, +"tools": { +"check": 2, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 7, +"repo": "semver", +"task": "rename", +"target": "semver::identifier::Identifier::new_unchecked", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 7708, +"tokens_out": 315, +"seconds": 17, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 7, +"repo": "semver", +"task": "fix", +"target": "semver::display::Version::fmt", +"mode": "lite", +"passed": true, +"steps": 11, +"tokens_in": 48031, +"tokens_out": 3953, +"seconds": 182, +"gate": { +"nochange": 1 +}, +"guard": { +"repeats": 2 +}, +"tools": { +"check": 2, +"look": 7, +"replace": 2 +} +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 7, +"repo": "sqlparse", +"task": "rename", +"target": "sqlparse::sql::TokenList::token_not_matching", +"mode": "lite", +"passed": false, +"steps": 4, +"tokens_in": 5119, +"tokens_out": 237, +"seconds": 16, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 7, +"repo": "sqlparse", +"task": "fix", +"target": "sqlparse::lexer::Lexer::get_default_instance", +"mode": "lite", +"passed": true, +"steps": 25, +"tokens_in": 171400, +"tokens_out": 2053, +"seconds": 133, +"stopped": "steps", +"guard": { +"repeats": 4, +"no_progress": 1, +"soft_budget": 1 +}, +"tools": { +"check": 3, +"look": 20, +"replace": 2 +} +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 8, +"repo": "chi", +"task": "rename", +"target": "_examples::rest::ErrInvalidRequest", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 4358, +"tokens_out": 283, +"seconds": 16, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 8, +"repo": "chi", +"task": "fix", +"target": "main::Mux::nextRoutePath", +"mode": "lite", +"passed": true, +"steps": 25, +"tokens_in": 142777, +"tokens_out": 1828, +"seconds": 133, +"stopped": "steps", +"guard": { +"repeats": 2, +"soft_budget": 1 +}, +"tools": { +"check": 4, +"look": 20, +"replace": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 8, +"repo": "click", +"task": "rename", +"target": "click::types::Path::coerce_path_result", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 5128, +"tokens_out": 261, +"seconds": 17, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 8, +"repo": "click", +"task": "fix", +"target": "click::core::Parameter::get_default", +"mode": "lite", +"passed": true, +"steps": 25, +"tokens_in": 197379, +"tokens_out": 2816, +"seconds": 233, +"stopped": "steps", +"guard": { +"repeats": 4, +"soft_budget": 1 +}, +"tools": { +"check": 3, +"look": 20, +"replace": 2 +} +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 8, +"repo": "cobra", +"task": "rename", +"target": "main::Command::CalledAs", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 4797, +"tokens_out": 226, +"seconds": 19, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 8, +"repo": "cobra", +"task": "fix", +"target": "main::Command::SetHelpCommandGroupID", +"mode": "lite", +"passed": false, +"steps": 4, +"tokens_in": 5785, +"tokens_out": 422, +"seconds": 26, +"guard": {}, +"tools": { +"check": 2, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 8, +"repo": "indexmap", +"task": "rename", +"target": "indexmap::serde::cautious_capacity", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 5035, +"tokens_out": 235, +"seconds": 13, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 8, +"repo": "indexmap", +"task": "fix", +"target": "indexmap::inner::entry::OccupiedEntry::move_index", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 5548, +"tokens_out": 326, +"seconds": 23, +"guard": {}, +"tools": { +"check": 2, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 8, +"repo": "semver", +"task": "rename", +"target": "semver::identifier::Identifier::empty", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 5876, +"tokens_out": 320, +"seconds": 17, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 8, +"repo": "semver", +"task": "fix", +"target": "semver::error::QuotedChar::fmt", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 6035, +"tokens_out": 444, +"seconds": 23, +"guard": {}, +"tools": { +"check": 2, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 8, +"repo": "sqlparse", +"task": "rename", +"target": "examples::extract_table_names::is_subselect", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 4223, +"tokens_out": 269, +"seconds": 13, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 8, +"repo": "sqlparse", +"task": "fix", +"target": "sqlparse::filters::others::StripWhitespaceFilter::process", +"mode": "lite", +"passed": true, +"steps": 5, +"tokens_in": 8203, +"tokens_out": 443, +"seconds": 28, +"guard": {}, +"tools": { +"check": 2, +"look": 1, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 9, +"repo": "chi", +"task": "rename", +"target": "middleware::WithLogEntry", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 4588, +"tokens_out": 240, +"seconds": 17, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 9, +"repo": "chi", +"task": "fix", +"target": "main::nodes::tailSort", +"mode": "lite", +"passed": true, +"steps": 24, +"tokens_in": 193293, +"tokens_out": 5020, +"seconds": 363, +"guard": { +"repeats": 3, +"soft_budget": 1 +}, +"tools": { +"check": 3, +"look": 20, +"replace": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 9, +"repo": "click", +"task": "rename", +"target": "click::types::File::resolve_lazy_flag", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 4856, +"tokens_out": 271, +"seconds": 18, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 9, +"repo": "click", +"task": "fix", +"target": "click::types::Choice::__init__", +"mode": "lite", +"passed": true, +"steps": 25, +"tokens_in": 169151, +"tokens_out": 2925, +"seconds": 205, +"stopped": "steps", +"guard": { +"repeats": 6, +"soft_budget": 1 +}, +"tools": { +"check": 4, +"look": 20, +"replace": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 9, +"repo": "cobra", +"task": "rename", +"target": "main::Command::HasPersistentFlags", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 4635, +"tokens_out": 224, +"seconds": 20, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 9, +"repo": "cobra", +"task": "fix", +"target": "main::Command::PersistentFlags", +"mode": "lite", +"passed": false, +"steps": 4, +"tokens_in": 5589, +"tokens_out": 360, +"seconds": 22, +"guard": {}, +"tools": { +"check": 2, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 9, +"repo": "indexmap", +"task": "rename", +"target": "indexmap::map::raw_entry_v1::RawVacantEntryMut::insert_hashed_nocheck", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 4727, +"tokens_out": 252, +"seconds": 17, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 9, +"repo": "indexmap", +"task": "fix", +"target": "indexmap::inner::Core::move_index", +"mode": "lite", +"passed": true, +"steps": 5, +"tokens_in": 8466, +"tokens_out": 580, +"seconds": 37, +"guard": {}, +"tools": { +"check": 2, +"look": 1, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 9, +"repo": "semver", +"task": "rename", +"target": "semver::identifier::Identifier::new_unchecked", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 7701, +"tokens_out": 312, +"seconds": 17, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 9, +"repo": "semver", +"task": "fix", +"target": "semver::eval::matches_caret", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 6269, +"tokens_out": 506, +"seconds": 25, +"guard": {}, +"tools": { +"check": 2, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 9, +"repo": "sqlparse", +"task": "rename", +"target": "sqlparse::engine::grouping::group_as", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 5336, +"tokens_out": 247, +"seconds": 18, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "new", +"set": 9, +"repo": "sqlparse", +"task": "fix", +"target": "sqlparse::filters::others::StripTrailingSemicolonFilter::process", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 6474, +"tokens_out": 334, +"seconds": 21, +"guard": {}, +"tools": { +"check": 2, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 0, +"repo": "chi", +"task": "rename", +"target": "main::NewRouteContext", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 5042, +"tokens_out": 206, +"seconds": 23, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 0, +"repo": "chi", +"task": "fix", +"target": "middleware::parseRemoteAddr", +"mode": "lite", +"passed": false, +"steps": 19, +"tokens_in": 103547, +"tokens_out": 2317, +"seconds": 150, +"stopped": "no_progress", +"gate": { +"check": 1 +}, +"guard": { +"repeats": 7, +"no_progress": 2, +"soft_budget": 1 +}, +"tools": { +"check": 4, +"look": 9, +"replace": 5, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 0, +"repo": "click", +"task": "rename", +"target": "click::core::iter_params_for_processing", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 5656, +"tokens_out": 318, +"seconds": 17, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 0, +"repo": "click", +"task": "fix", +"target": "click::_compat::get_text_stdin", +"mode": "lite", +"passed": true, +"steps": 22, +"tokens_in": 113221, +"tokens_out": 1532, +"seconds": 88, +"guard": { +"repeats": 2, +"soft_budget": 1 +}, +"tools": { +"check": 3, +"replace": 2, +"look": 16, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 0, +"repo": "cobra", +"task": "rename", +"target": "main::Command::ValidateRequiredFlags", +"mode": "lite", +"passed": true, +"steps": 15, +"tokens_in": 58620, +"tokens_out": 1595, +"seconds": 97, +"gate": { +"check": 3 +}, +"guard": { +"repeats": 2 +}, +"tools": { +"look": 7, +"rename": 1, +"check": 3, +"finish": 4 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 0, +"repo": "cobra", +"task": "fix", +"target": "main::Command::PersistentFlags", +"mode": "lite", +"passed": false, +"steps": 25, +"tokens_in": 142719, +"tokens_out": 1746, +"seconds": 109, +"stopped": "steps", +"guard": { +"repeats": 4, +"soft_budget": 1 +}, +"tools": { +"check": 4, +"replace": 2, +"look": 19 +} +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 0, +"repo": "indexmap", +"task": "rename", +"target": "indexmap::inner::extract::ExtractCore::remaining", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 5507, +"tokens_out": 278, +"seconds": 17, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 0, +"repo": "indexmap", +"task": "fix", +"target": "indexmap::inner::Core::reserve_entries", +"mode": "lite", +"passed": true, +"steps": 6, +"tokens_in": 11147, +"tokens_out": 654, +"seconds": 40, +"guard": { +"repeats": 1 +}, +"tools": { +"check": 3, +"look": 1, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 0, +"repo": "semver", +"task": "rename", +"target": "semver::eval::matches_comparator", +"mode": "lite", +"passed": true, +"steps": 10, +"tokens_in": 16177, +"tokens_out": 486, +"seconds": 24, +"guard": {}, +"tools": { +"look": 7, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 0, +"repo": "semver", +"task": "fix", +"target": "semver::eval::matches_greater", +"mode": "lite", +"passed": true, +"steps": 6, +"tokens_in": 11266, +"tokens_out": 907, +"seconds": 45, +"guard": {}, +"tools": { +"check": 2, +"look": 1, +"replace": 2, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 0, +"repo": "sqlparse", +"task": "rename", +"target": "sqlparse::engine::grouping::group_order", +"mode": "lite", +"passed": true, +"steps": 5, +"tokens_in": 7747, +"tokens_out": 286, +"seconds": 19, +"guard": {}, +"tools": { +"look": 2, +"rename": 1, +"check": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 0, +"repo": "sqlparse", +"task": "fix", +"target": "sqlparse::filters::others::SpacesAroundOperatorsFilter::_process", +"mode": "lite", +"passed": true, +"steps": 8, +"tokens_in": 25313, +"tokens_out": 2248, +"seconds": 105, +"guard": { +"repeats": 1 +}, +"tools": { +"check": 3, +"look": 3, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 1, +"repo": "chi", +"task": "rename", +"target": "_examples::rest::NewUserPayloadResponse", +"mode": "lite", +"passed": true, +"steps": 9, +"tokens_in": 16582, +"tokens_out": 372, +"seconds": 21, +"guard": {}, +"tools": { +"look": 6, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 1, +"repo": "chi", +"task": "fix", +"target": "main::node::findPattern", +"mode": "lite", +"passed": true, +"steps": 5, +"tokens_in": 10600, +"tokens_out": 624, +"seconds": 63, +"guard": { +"repeats": 1 +}, +"tools": { +"check": 3, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 1, +"repo": "click", +"task": "rename", +"target": "examples::imagepipe::imagepipe::convert_flip", +"mode": "lite", +"passed": false, +"steps": 4, +"tokens_in": 4510, +"tokens_out": 254, +"seconds": 15, +"guard": {}, +"tools": { +"look": 1, +"replace": 1, +"check": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 1, +"repo": "click", +"task": "fix", +"target": "click::_compat::get_text_stderr", +"mode": "lite", +"passed": false, +"steps": 25, +"tokens_in": 135137, +"tokens_out": 1010, +"seconds": 104, +"stopped": "steps", +"guard": { +"soft_budget": 1 +}, +"tools": { +"check": 1, +"look": 24 +} +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 1, +"repo": "cobra", +"task": "rename", +"target": "main::CheckErr", +"mode": "lite", +"passed": true, +"steps": 17, +"tokens_in": 62078, +"tokens_out": 2034, +"seconds": 110, +"gate": { +"check": 3 +}, +"guard": { +"repeats": 1 +}, +"tools": { +"look": 10, +"rename": 1, +"check": 2, +"finish": 4 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 1, +"repo": "cobra", +"task": "fix", +"target": "main::writeShortFlag", +"mode": "lite", +"passed": false, +"steps": 25, +"tokens_in": 178707, +"tokens_out": 4228, +"seconds": 234, +"stopped": "steps", +"guard": { +"repeats": 3, +"soft_budget": 1 +}, +"tools": { +"check": 3, +"look": 21, +"replace": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 1, +"repo": "indexmap", +"task": "rename", +"target": "indexmap::set::IndexSet::is_subset", +"mode": "lite", +"passed": true, +"steps": 25, +"tokens_in": 146214, +"tokens_out": 2340, +"seconds": 134, +"guard": { +"repeats": 4, +"soft_budget": 1 +}, +"tools": { +"look": 17, +"replace": 4, +"check": 3, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 1, +"repo": "indexmap", +"task": "fix", +"target": "indexmap::inner::entry::OccupiedEntry::swap_indices", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 5894, +"tokens_out": 407, +"seconds": 26, +"guard": {}, +"tools": { +"check": 2, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 1, +"repo": "semver", +"task": "rename", +"target": "semver::identifier::Identifier::ptr_eq", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 4673, +"tokens_out": 227, +"seconds": 12, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 1, +"repo": "semver", +"task": "fix", +"target": "semver::display::Version::fmt", +"mode": "lite", +"passed": false, +"seconds": 57, +"error": "HTTP Error 500: Internal Server Error" +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 1, +"repo": "sqlparse", +"task": "rename", +"target": "sqlparse::lexer::Lexer::default_initialization", +"mode": "lite", +"passed": true, +"steps": 5, +"tokens_in": 6288, +"tokens_out": 297, +"seconds": 15, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 2, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 1, +"repo": "sqlparse", +"task": "fix", +"target": "sqlparse::engine::grouping::group_period", +"mode": "lite", +"passed": false, +"steps": 5, +"tokens_in": 9711, +"tokens_out": 755, +"seconds": 42, +"guard": {}, +"tools": { +"check": 2, +"look": 1, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 10, +"repo": "chi", +"task": "rename", +"target": "main::RegisterMethod", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 4758, +"tokens_out": 258, +"seconds": 15, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 10, +"repo": "chi", +"task": "fix", +"target": "main::Mux::handle", +"mode": "lite", +"passed": true, +"steps": 21, +"tokens_in": 107865, +"tokens_out": 2693, +"seconds": 172, +"guard": { +"repeats": 9, +"no_progress": 1, +"soft_budget": 1 +}, +"tools": { +"check": 6, +"replace": 3, +"look": 11, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 10, +"repo": "click", +"task": "rename", +"target": "click::core::iter_params_for_processing", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 5620, +"tokens_out": 274, +"seconds": 17, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 10, +"repo": "click", +"task": "fix", +"target": "click::exceptions::UsageError::show", +"mode": "lite", +"passed": true, +"steps": 25, +"tokens_in": 199874, +"tokens_out": 1910, +"seconds": 205, +"stopped": "steps", +"guard": { +"repeats": 3, +"soft_budget": 1 +}, +"tools": { +"check": 2, +"look": 22, +"replace": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 10, +"repo": "cobra", +"task": "rename", +"target": "main::Command::CalledAs", +"mode": "lite", +"passed": true, +"steps": 25, +"tokens_in": 168750, +"tokens_out": 3138, +"seconds": 202, +"stopped": "steps", +"guard": { +"repeats": 5, +"soft_budget": 1 +}, +"tools": { +"look": 15, +"replace": 3, +"check": 4, +"rename": 3 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 10, +"repo": "cobra", +"task": "fix", +"target": "main::Command::getHelpTemplateFunc", +"mode": "lite", +"passed": false, +"steps": 5, +"tokens_in": 8983, +"tokens_out": 590, +"seconds": 32, +"guard": {}, +"tools": { +"check": 2, +"look": 1, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 10, +"repo": "indexmap", +"task": "rename", +"target": "indexmap::inner::extract::ExtractCore::remaining", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 5492, +"tokens_out": 277, +"seconds": 16, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 10, +"repo": "indexmap", +"task": "fix", +"target": "indexmap::map::IndexMap::with_capacity_and_hasher", +"mode": "lite", +"passed": true, +"steps": 5, +"tokens_in": 7933, +"tokens_out": 630, +"seconds": 40, +"guard": {}, +"tools": { +"check": 2, +"look": 1, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 10, +"repo": "semver", +"task": "rename", +"target": "semver::identifier::Identifier::ptr_eq", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 4650, +"tokens_out": 240, +"seconds": 13, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 10, +"repo": "semver", +"task": "fix", +"target": "semver::identifier::Identifier::is_empty", +"mode": "lite", +"passed": true, +"steps": 6, +"tokens_in": 10577, +"tokens_out": 600, +"seconds": 32, +"guard": { +"repeats": 1 +}, +"tools": { +"check": 3, +"look": 1, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 10, +"repo": "sqlparse", +"task": "rename", +"target": "sqlparse::lexer::Lexer::add_keywords", +"mode": "lite", +"passed": false, +"steps": 5, +"tokens_in": 5655, +"tokens_out": 214, +"seconds": 11, +"guard": { +"repeats": 1 +}, +"tools": { +"look": 1, +"replace": 1, +"check": 2, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 10, +"repo": "sqlparse", +"task": "fix", +"target": "sqlparse::sql::TokenList::get_parent_name", +"mode": "lite", +"passed": true, +"steps": 6, +"tokens_in": 10493, +"tokens_out": 608, +"seconds": 35, +"guard": {}, +"tools": { +"check": 2, +"replace": 2, +"look": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 11, +"repo": "chi", +"task": "rename", +"target": "main::RegisterMethod", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 4784, +"tokens_out": 229, +"seconds": 14, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 11, +"repo": "chi", +"task": "fix", +"target": "middleware::RequestID", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 5800, +"tokens_out": 450, +"seconds": 53, +"guard": {}, +"tools": { +"check": 2, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 11, +"repo": "click", +"task": "rename", +"target": "click::formatting::HelpFormatter::dedent", +"mode": "lite", +"passed": false, +"steps": 25, +"tokens_in": 105785, +"tokens_out": 1466, +"seconds": 83, +"stopped": "steps", +"guard": { +"repeats": 8, +"soft_budget": 1 +}, +"tools": { +"look": 13, +"replace": 3, +"check": 9 +} +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 11, +"repo": "click", +"task": "fix", +"target": "click::core::Option::add_to_parser", +"mode": "lite", +"passed": true, +"steps": 25, +"tokens_in": 146687, +"tokens_out": 4123, +"seconds": 268, +"stopped": "steps", +"guard": { +"repeats": 1, +"soft_budget": 1 +}, +"tools": { +"check": 1, +"look": 23, +"replace": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 11, +"repo": "cobra", +"task": "rename", +"target": "main::Command::PersistentFlags", +"mode": "lite", +"passed": true, +"steps": 25, +"tokens_in": 167475, +"tokens_out": 2848, +"seconds": 183, +"gate": { +"check": 2 +}, +"guard": { +"repeats": 3, +"soft_budget": 1 +}, +"tools": { +"look": 19, +"rename": 1, +"check": 3, +"finish": 2 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 11, +"repo": "cobra", +"task": "fix", +"target": "doc::GenMan", +"mode": "lite", +"passed": false, +"steps": 9, +"tokens_in": 23661, +"tokens_out": 906, +"seconds": 48, +"guard": { +"repeats": 4, +"no_progress": 1 +}, +"tools": { +"check": 3, +"look": 3, +"replace": 2, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 11, +"repo": "indexmap", +"task": "rename", +"target": "indexmap::util::try_simplify_range", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 5400, +"tokens_out": 256, +"seconds": 16, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 11, +"repo": "indexmap", +"task": "fix", +"target": "indexmap::map::IndexMap::replace_index", +"mode": "lite", +"passed": true, +"steps": 5, +"tokens_in": 9301, +"tokens_out": 791, +"seconds": 45, +"guard": {}, +"tools": { +"check": 2, +"look": 1, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 11, +"repo": "semver", +"task": "rename", +"target": "semver::identifier::Identifier::empty", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 5852, +"tokens_out": 250, +"seconds": 15, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 11, +"repo": "semver", +"task": "fix", +"target": "semver::identifier::Identifier::is_empty", +"mode": "lite", +"passed": true, +"steps": 6, +"tokens_in": 10684, +"tokens_out": 625, +"seconds": 32, +"guard": { +"repeats": 1 +}, +"tools": { +"check": 3, +"look": 1, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 11, +"repo": "sqlparse", +"task": "rename", +"target": "benchmarks::bench_lexer_delimiters::unmatched_dollar_quotes", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 4306, +"tokens_out": 247, +"seconds": 12, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 11, +"repo": "sqlparse", +"task": "fix", +"target": "sqlparse::cli::main", +"mode": "lite", +"passed": true, +"steps": 13, +"tokens_in": 37200, +"tokens_out": 1346, +"seconds": 68, +"guard": { +"repeats": 2 +}, +"tools": { +"check": 3, +"replace": 2, +"look": 7, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 2, +"repo": "chi", +"task": "rename", +"target": "_examples::fileserver::FileServer", +"mode": "lite", +"passed": true, +"steps": 5, +"tokens_in": 7135, +"tokens_out": 368, +"seconds": 21, +"guard": {}, +"tools": { +"look": 2, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 2, +"repo": "chi", +"task": "fix", +"target": "middleware::GetHead", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 6283, +"tokens_out": 535, +"seconds": 58, +"guard": {}, +"tools": { +"check": 2, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 2, +"repo": "click", +"task": "rename", +"target": "click::core::Command::get_help_option_names", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 5470, +"tokens_out": 230, +"seconds": 16, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 2, +"repo": "click", +"task": "fix", +"target": "click::utils::_make_default_short_help", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 7145, +"tokens_out": 632, +"seconds": 43, +"guard": {}, +"tools": { +"check": 2, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 2, +"repo": "cobra", +"task": "rename", +"target": "main::Command::Name", +"mode": "lite", +"passed": true, +"steps": 21, +"tokens_in": 145632, +"tokens_out": 1864, +"seconds": 114, +"stopped": "no_progress", +"guard": { +"repeats": 10, +"no_progress": 2, +"soft_budget": 1 +}, +"tools": { +"look": 15, +"rename": 1, +"check": 3, +"replace": 2 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 2, +"repo": "cobra", +"task": "fix", +"target": "main::Command::hasNameOrAliasPrefix", +"mode": "lite", +"passed": false, +"steps": 6, +"tokens_in": 10492, +"tokens_out": 552, +"seconds": 31, +"guard": { +"repeats": 1 +}, +"tools": { +"check": 3, +"look": 1, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 2, +"repo": "indexmap", +"task": "rename", +"target": "indexmap::map::IndexMap::sort_unstable_keys", +"mode": "lite", +"passed": true, +"steps": 9, +"tokens_in": 15108, +"tokens_out": 597, +"seconds": 36, +"guard": { +"repeats": 1 +}, +"tools": { +"look": 5, +"replace": 2, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 2, +"repo": "indexmap", +"task": "fix", +"target": "indexmap::inner::Core::decrement_indices", +"mode": "lite", +"passed": true, +"steps": 5, +"tokens_in": 9013, +"tokens_out": 761, +"seconds": 45, +"guard": {}, +"tools": { +"check": 2, +"look": 1, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 2, +"repo": "semver", +"task": "rename", +"target": "semver::identifier::Identifier::ptr_eq", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 4689, +"tokens_out": 241, +"seconds": 13, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 2, +"repo": "semver", +"task": "fix", +"target": "semver::display::Version::fmt", +"mode": "lite", +"passed": true, +"steps": 8, +"tokens_in": 30074, +"tokens_out": 3351, +"seconds": 153, +"gate": { +"nochange": 1 +}, +"guard": { +"repeats": 1 +}, +"tools": { +"check": 2, +"look": 4, +"replace": 2 +} +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 2, +"repo": "sqlparse", +"task": "rename", +"target": "sqlparse::lexer::Lexer::default_initialization", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 4945, +"tokens_out": 217, +"seconds": 12, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 2, +"repo": "sqlparse", +"task": "fix", +"target": "sqlparse::engine::grouping::group_values", +"mode": "lite", +"passed": false, +"steps": 7, +"tokens_in": 16553, +"tokens_out": 965, +"seconds": 51, +"guard": {}, +"tools": { +"check": 2, +"look": 3, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 3, +"repo": "chi", +"task": "rename", +"target": "main::RegisterMethod", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 4760, +"tokens_out": 217, +"seconds": 14, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 3, +"repo": "chi", +"task": "fix", +"target": "main::URLParamFromCtx", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 5402, +"tokens_out": 327, +"seconds": 48, +"guard": {}, +"tools": { +"check": 2, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 3, +"repo": "click", +"task": "rename", +"target": "click::formatting::HelpFormatter::dedent", +"mode": "lite", +"passed": false, +"steps": 21, +"tokens_in": 86686, +"tokens_out": 1994, +"seconds": 106, +"stopped": "no_progress", +"guard": { +"repeats": 8, +"no_progress": 2, +"soft_budget": 1 +}, +"tools": { +"look": 13, +"replace": 5, +"check": 3 +} +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 3, +"repo": "click", +"task": "fix", +"target": "click::core::Context::find_object", +"mode": "lite", +"passed": true, +"steps": 6, +"tokens_in": 10393, +"tokens_out": 573, +"seconds": 38, +"guard": {}, +"tools": { +"check": 2, +"replace": 2, +"look": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 3, +"repo": "cobra", +"task": "rename", +"target": "doc::GenMarkdownTreeCustom", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 5186, +"tokens_out": 234, +"seconds": 14, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 3, +"repo": "cobra", +"task": "fix", +"target": "doc::GenMan", +"mode": "lite", +"passed": false, +"steps": 5, +"tokens_in": 9968, +"tokens_out": 598, +"seconds": 34, +"guard": {}, +"tools": { +"check": 2, +"look": 1, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 3, +"repo": "indexmap", +"task": "rename", +"target": "indexmap::util::try_simplify_range", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 5378, +"tokens_out": 218, +"seconds": 17, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 3, +"repo": "indexmap", +"task": "fix", +"target": "indexmap::inner::erase_index", +"mode": "lite", +"passed": true, +"steps": 11, +"tokens_in": 27933, +"tokens_out": 1013, +"seconds": 58, +"guard": { +"repeats": 1 +}, +"tools": { +"check": 3, +"replace": 3, +"look": 4, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 3, +"repo": "semver", +"task": "rename", +"target": "semver::eval::matches_comparator", +"mode": "lite", +"passed": true, +"steps": 7, +"tokens_in": 11399, +"tokens_out": 321, +"seconds": 16, +"guard": {}, +"tools": { +"look": 4, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 3, +"repo": "semver", +"task": "fix", +"target": "semver::eval::matches_req", +"mode": "lite", +"passed": false, +"steps": 25, +"tokens_in": 148253, +"tokens_out": 4126, +"seconds": 199, +"stopped": "steps", +"guard": { +"repeats": 3, +"soft_budget": 1 +}, +"tools": { +"check": 2, +"replace": 8, +"look": 12, +"add_after": 2, +"rename": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 3, +"repo": "sqlparse", +"task": "rename", +"target": "sqlparse::sql::TokenList::get_name", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 5583, +"tokens_out": 199, +"seconds": 12, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 3, +"repo": "sqlparse", +"task": "fix", +"target": "sqlparse::filters::reindent::ReindentFilter::_process_case", +"mode": "lite", +"passed": true, +"steps": 7, +"tokens_in": 20751, +"tokens_out": 1872, +"seconds": 89, +"guard": {}, +"tools": { +"check": 2, +"replace": 3, +"look": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 4, +"repo": "chi", +"task": "rename", +"target": "_examples::fileserver::FileServer", +"mode": "lite", +"passed": true, +"steps": 5, +"tokens_in": 7147, +"tokens_out": 398, +"seconds": 21, +"guard": {}, +"tools": { +"look": 2, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 4, +"repo": "chi", +"task": "fix", +"target": "main::RegisterMethod", +"mode": "lite", +"passed": false, +"steps": 25, +"tokens_in": 198913, +"tokens_out": 2602, +"seconds": 248, +"stopped": "steps", +"guard": { +"repeats": 6, +"soft_budget": 1 +}, +"tools": { +"check": 3, +"look": 20, +"replace": 2 +} +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 4, +"repo": "click", +"task": "rename", +"target": "click::testing::CliRunner::make_env", +"mode": "lite", +"passed": false, +"steps": 25, +"tokens_in": 131359, +"tokens_out": 2135, +"seconds": 119, +"stopped": "steps", +"guard": { +"repeats": 9, +"soft_budget": 1 +}, +"tools": { +"look": 17, +"replace": 8 +} +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 4, +"repo": "click", +"task": "fix", +"target": "click::decorators::pass_meta_key", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 6331, +"tokens_out": 644, +"seconds": 41, +"guard": {}, +"tools": { +"check": 2, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 4, +"repo": "cobra", +"task": "rename", +"target": "main::Command::LocalFlags", +"mode": "lite", +"passed": true, +"steps": 25, +"tokens_in": 132591, +"tokens_out": 2868, +"seconds": 164, +"gate": { +"check": 3 +}, +"guard": { +"repeats": 7, +"no_progress": 1, +"soft_budget": 1 +}, +"tools": { +"look": 14, +"rename": 1, +"check": 5, +"finish": 3, +"replace": 2 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 4, +"repo": "cobra", +"task": "fix", +"target": "main::Command::IsAdditionalHelpTopicCommand", +"mode": "lite", +"passed": false, +"steps": 25, +"tokens_in": 136697, +"tokens_out": 1164, +"seconds": 73, +"stopped": "steps", +"guard": { +"soft_budget": 1 +}, +"tools": { +"check": 1, +"look": 24 +} +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 4, +"repo": "indexmap", +"task": "rename", +"target": "indexmap::rayon::set::IndexSet::par_difference", +"mode": "lite", +"passed": false, +"steps": 5, +"tokens_in": 7114, +"tokens_out": 378, +"seconds": 22, +"guard": { +"repeats": 1 +}, +"tools": { +"look": 1, +"replace": 1, +"check": 2, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 4, +"repo": "indexmap", +"task": "fix", +"target": "indexmap::inner::Core::try_reserve_entries", +"mode": "lite", +"passed": true, +"steps": 5, +"tokens_in": 9801, +"tokens_out": 1055, +"seconds": 56, +"guard": {}, +"tools": { +"check": 2, +"look": 1, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 4, +"repo": "semver", +"task": "rename", +"target": "semver::identifier::Identifier::ptr_eq", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 4652, +"tokens_out": 230, +"seconds": 13, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 4, +"repo": "semver", +"task": "fix", +"target": "semver::parse::op", +"mode": "lite", +"passed": true, +"steps": 5, +"tokens_in": 9150, +"tokens_out": 657, +"seconds": 34, +"guard": {}, +"tools": { +"check": 2, +"look": 1, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 4, +"repo": "sqlparse", +"task": "rename", +"target": "sqlparse::engine::grouping::group_typed_literal", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 5896, +"tokens_out": 238, +"seconds": 17, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 4, +"repo": "sqlparse", +"task": "fix", +"target": "sqlparse::engine::grouping::group_tzcasts", +"mode": "lite", +"passed": true, +"steps": 5, +"tokens_in": 9151, +"tokens_out": 594, +"seconds": 35, +"guard": {}, +"tools": { +"check": 2, +"look": 1, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 5, +"repo": "chi", +"task": "rename", +"target": "main::node::FindRoute", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 5428, +"tokens_out": 226, +"seconds": 15, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 5, +"repo": "chi", +"task": "fix", +"target": "middleware::prettyStack::parse", +"mode": "lite", +"passed": true, +"steps": 5, +"tokens_in": 9117, +"tokens_out": 758, +"seconds": 67, +"guard": {}, +"tools": { +"check": 2, +"look": 1, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 5, +"repo": "click", +"task": "rename", +"target": "click::utils::format_filename", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 6836, +"tokens_out": 253, +"seconds": 17, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 5, +"repo": "click", +"task": "fix", +"target": "click::core::Context::_default_map_has", +"mode": "lite", +"passed": true, +"steps": 25, +"tokens_in": 138502, +"tokens_out": 3192, +"seconds": 174, +"stopped": "steps", +"guard": { +"repeats": 8, +"no_progress": 1, +"soft_budget": 1 +}, +"tools": { +"check": 6, +"look": 18, +"replace": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 5, +"repo": "cobra", +"task": "rename", +"target": "main::Command::ParseFlags", +"mode": "lite", +"passed": true, +"steps": 25, +"tokens_in": 123141, +"tokens_out": 3214, +"seconds": 170, +"gate": { +"check": 2 +}, +"guard": { +"repeats": 8, +"no_progress": 1, +"soft_budget": 1 +}, +"tools": { +"look": 13, +"rename": 1, +"check": 7, +"finish": 2, +"replace": 2 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 5, +"repo": "cobra", +"task": "fix", +"target": "main::stringInSlice", +"mode": "lite", +"passed": false, +"steps": 6, +"tokens_in": 10122, +"tokens_out": 482, +"seconds": 27, +"guard": {}, +"tools": { +"check": 2, +"replace": 2, +"look": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 5, +"repo": "indexmap", +"task": "rename", +"target": "indexmap::map::raw_entry_v1::RawOccupiedEntryMut::into_key_value_mut", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 4635, +"tokens_out": 278, +"seconds": 20, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 5, +"repo": "indexmap", +"task": "fix", +"target": "indexmap::inner::Core::move_index", +"mode": "lite", +"passed": true, +"steps": 6, +"tokens_in": 11951, +"tokens_out": 843, +"seconds": 50, +"guard": {}, +"tools": { +"check": 2, +"replace": 2, +"look": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 5, +"repo": "semver", +"task": "rename", +"target": "semver::identifier::Identifier::ptr_eq", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 4650, +"tokens_out": 236, +"seconds": 13, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 5, +"repo": "semver", +"task": "fix", +"target": "semver::display::Version::fmt", +"mode": "lite", +"passed": true, +"steps": 14, +"tokens_in": 63267, +"tokens_out": 3212, +"seconds": 151, +"gate": { +"nochange": 1 +}, +"guard": { +"repeats": 5 +}, +"tools": { +"check": 3, +"look": 9, +"replace": 2 +} +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 5, +"repo": "sqlparse", +"task": "rename", +"target": "examples::extract_table_names::extract_from_part", +"mode": "lite", +"passed": true, +"steps": 7, +"tokens_in": 9858, +"tokens_out": 498, +"seconds": 25, +"guard": {}, +"tools": { +"look": 2, +"replace": 3, +"check": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 5, +"repo": "sqlparse", +"task": "fix", +"target": "sqlparse::engine::grouping::group_where", +"mode": "lite", +"passed": false, +"steps": 9, +"tokens_in": 27334, +"tokens_out": 1430, +"seconds": 70, +"guard": { +"repeats": 2 +}, +"tools": { +"check": 4, +"look": 2, +"replace": 2, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 6, +"repo": "chi", +"task": "rename", +"target": "main::RouteContext", +"mode": "lite", +"passed": true, +"steps": 5, +"tokens_in": 7286, +"tokens_out": 255, +"seconds": 24, +"guard": { +"repeats": 1 +}, +"tools": { +"look": 1, +"rename": 1, +"check": 2, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 6, +"repo": "chi", +"task": "fix", +"target": "main::RegisterMethod", +"mode": "lite", +"passed": true, +"steps": 16, +"tokens_in": 120149, +"tokens_out": 1581, +"seconds": 115, +"guard": { +"repeats": 3 +}, +"tools": { +"check": 4, +"look": 10, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 6, +"repo": "click", +"task": "rename", +"target": "click::decorators::pass_context", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 6409, +"tokens_out": 235, +"seconds": 18, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 6, +"repo": "click", +"task": "fix", +"target": "click::parser::_Option::__init__", +"mode": "lite", +"passed": false, +"seconds": 145, +"error": "HTTP Error 500: Internal Server Error" +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 6, +"repo": "cobra", +"task": "rename", +"target": "main::Command::UseLine", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 5499, +"tokens_out": 219, +"seconds": 20, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 6, +"repo": "cobra", +"task": "fix", +"target": "main::processFlagForGroupAnnotation", +"mode": "lite", +"passed": false, +"steps": 25, +"tokens_in": 159999, +"tokens_out": 4284, +"seconds": 247, +"stopped": "steps", +"guard": { +"repeats": 13, +"no_progress": 1, +"soft_budget": 1 +}, +"tools": { +"check": 9, +"look": 12, +"replace": 3, +"add_after": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 6, +"repo": "indexmap", +"task": "rename", +"target": "indexmap::util::assert_index_lt", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 5486, +"tokens_out": 222, +"seconds": 17, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 6, +"repo": "indexmap", +"task": "fix", +"target": "indexmap::map::slice::Slice::eq", +"mode": "lite", +"passed": true, +"steps": 11, +"tokens_in": 28187, +"tokens_out": 904, +"seconds": 53, +"guard": { +"repeats": 4 +}, +"tools": { +"check": 5, +"look": 3, +"replace": 2, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 6, +"repo": "semver", +"task": "rename", +"target": "semver::identifier::Identifier::empty", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 5852, +"tokens_out": 250, +"seconds": 14, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 6, +"repo": "semver", +"task": "fix", +"target": "semver::eval::matches_req", +"mode": "lite", +"passed": true, +"steps": 7, +"tokens_in": 15577, +"tokens_out": 925, +"seconds": 44, +"guard": { +"repeats": 1 +}, +"tools": { +"check": 3, +"replace": 2, +"look": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 6, +"repo": "sqlparse", +"task": "rename", +"target": "sqlparse::engine::grouping::group_over", +"mode": "lite", +"passed": true, +"steps": 25, +"tokens_in": 107431, +"tokens_out": 2301, +"seconds": 116, +"stopped": "steps", +"guard": { +"repeats": 10, +"soft_budget": 1 +}, +"tools": { +"look": 22, +"replace": 3 +} +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 6, +"repo": "sqlparse", +"task": "fix", +"target": "sqlparse::filters::aligned_indent::AlignedIndentFilter::_process_default", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 6141, +"tokens_out": 360, +"seconds": 21, +"guard": {}, +"tools": { +"check": 2, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 7, +"repo": "chi", +"task": "rename", +"target": "middleware::NewWrapResponseWriter", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 5131, +"tokens_out": 240, +"seconds": 15, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 7, +"repo": "chi", +"task": "fix", +"target": "middleware::encoderDeflate", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 6079, +"tokens_out": 358, +"seconds": 50, +"guard": {}, +"tools": { +"check": 2, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 7, +"repo": "click", +"task": "rename", +"target": "click::formatting::HelpFormatter::indentation", +"mode": "lite", +"passed": false, +"steps": 25, +"tokens_in": 105067, +"tokens_out": 1917, +"seconds": 100, +"gate": { +"check": 1 +}, +"guard": { +"repeats": 3, +"soft_budget": 1 +}, +"tools": { +"look": 17, +"replace": 4, +"check": 3, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 7, +"repo": "click", +"task": "fix", +"target": "click::shell_completion::_is_incomplete_option", +"mode": "lite", +"passed": true, +"steps": 24, +"tokens_in": 184006, +"tokens_out": 5001, +"seconds": 292, +"gate": { +"nochange": 1 +}, +"guard": { +"repeats": 1, +"soft_budget": 1 +}, +"tools": { +"check": 2, +"look": 11, +"replace": 1, +"add_after": 10 +} +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 7, +"repo": "cobra", +"task": "rename", +"target": "main::Command::GenPowerShellCompletionWithDesc", +"mode": "lite", +"passed": true, +"steps": 25, +"tokens_in": 144371, +"tokens_out": 2727, +"seconds": 151, +"gate": { +"check": 2 +}, +"guard": { +"repeats": 5, +"soft_budget": 1 +}, +"tools": { +"look": 11, +"rename": 1, +"check": 7, +"finish": 2, +"replace": 4 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 7, +"repo": "cobra", +"task": "fix", +"target": "main::Command::getVersionTemplateFunc", +"mode": "lite", +"passed": false, +"steps": 4, +"tokens_in": 6856, +"tokens_out": 547, +"seconds": 28, +"guard": {}, +"tools": { +"check": 2, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 7, +"repo": "indexmap", +"task": "rename", +"target": "indexmap::map::raw_entry_v1::RawVacantEntryMut::shift_insert_hashed_nocheck", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 4923, +"tokens_out": 281, +"seconds": 18, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 7, +"repo": "indexmap", +"task": "fix", +"target": "indexmap::inner::Core::move_index", +"mode": "lite", +"passed": true, +"steps": 6, +"tokens_in": 12270, +"tokens_out": 961, +"seconds": 54, +"guard": {}, +"tools": { +"check": 2, +"look": 2, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 7, +"repo": "semver", +"task": "rename", +"target": "semver::identifier::Identifier::new_unchecked", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 7702, +"tokens_out": 309, +"seconds": 17, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 7, +"repo": "semver", +"task": "fix", +"target": "semver::display::Version::fmt", +"mode": "lite", +"passed": false, +"seconds": 64, +"error": "HTTP Error 500: Internal Server Error" +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 7, +"repo": "sqlparse", +"task": "rename", +"target": "sqlparse::sql::TokenList::token_not_matching", +"mode": "lite", +"passed": false, +"steps": 4, +"tokens_in": 5119, +"tokens_out": 223, +"seconds": 15, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 7, +"repo": "sqlparse", +"task": "fix", +"target": "sqlparse::lexer::Lexer::get_default_instance", +"mode": "lite", +"passed": true, +"steps": 7, +"tokens_in": 14631, +"tokens_out": 708, +"seconds": 41, +"guard": {}, +"tools": { +"check": 2, +"look": 3, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 8, +"repo": "chi", +"task": "rename", +"target": "_examples::rest::ErrInvalidRequest", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 4360, +"tokens_out": 233, +"seconds": 13, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 8, +"repo": "chi", +"task": "fix", +"target": "main::Mux::nextRoutePath", +"mode": "lite", +"passed": true, +"steps": 15, +"tokens_in": 79053, +"tokens_out": 4433, +"seconds": 244, +"gate": { +"nochange": 1 +}, +"guard": { +"repeats": 1 +}, +"tools": { +"check": 3, +"look": 11, +"replace": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 8, +"repo": "click", +"task": "rename", +"target": "click::types::Path::coerce_path_result", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 5136, +"tokens_out": 254, +"seconds": 17, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 8, +"repo": "click", +"task": "fix", +"target": "click::core::Parameter::get_default", +"mode": "lite", +"passed": true, +"steps": 25, +"tokens_in": 178046, +"tokens_out": 3081, +"seconds": 253, +"stopped": "steps", +"guard": { +"repeats": 3, +"soft_budget": 1 +}, +"tools": { +"check": 5, +"look": 19, +"replace": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 8, +"repo": "cobra", +"task": "rename", +"target": "main::Command::CalledAs", +"mode": "lite", +"passed": true, +"steps": 25, +"tokens_in": 152489, +"tokens_out": 3114, +"seconds": 165, +"gate": { +"check": 1 +}, +"guard": { +"repeats": 8, +"soft_budget": 1 +}, +"tools": { +"look": 18, +"replace": 3, +"check": 3, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 8, +"repo": "cobra", +"task": "fix", +"target": "main::Command::SetHelpCommandGroupID", +"mode": "lite", +"passed": false, +"steps": 4, +"tokens_in": 5643, +"tokens_out": 386, +"seconds": 23, +"guard": {}, +"tools": { +"check": 2, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 8, +"repo": "indexmap", +"task": "rename", +"target": "indexmap::serde::cautious_capacity", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 5035, +"tokens_out": 205, +"seconds": 12, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 8, +"repo": "indexmap", +"task": "fix", +"target": "indexmap::inner::entry::OccupiedEntry::move_index", +"mode": "lite", +"passed": true, +"steps": 5, +"tokens_in": 7652, +"tokens_out": 484, +"seconds": 32, +"guard": {}, +"tools": { +"check": 2, +"look": 1, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 8, +"repo": "semver", +"task": "rename", +"target": "semver::identifier::Identifier::empty", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 5852, +"tokens_out": 243, +"seconds": 13, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 8, +"repo": "semver", +"task": "fix", +"target": "semver::error::QuotedChar::fmt", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 6470, +"tokens_out": 716, +"seconds": 34, +"guard": {}, +"tools": { +"check": 2, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 8, +"repo": "sqlparse", +"task": "rename", +"target": "examples::extract_table_names::is_subselect", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 4203, +"tokens_out": 245, +"seconds": 12, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 8, +"repo": "sqlparse", +"task": "fix", +"target": "sqlparse::filters::others::StripWhitespaceFilter::process", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 5785, +"tokens_out": 350, +"seconds": 22, +"guard": {}, +"tools": { +"check": 2, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 9, +"repo": "chi", +"task": "rename", +"target": "middleware::WithLogEntry", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 4581, +"tokens_out": 239, +"seconds": 15, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 9, +"repo": "chi", +"task": "fix", +"target": "main::nodes::tailSort", +"mode": "lite", +"passed": true, +"steps": 7, +"tokens_in": 13396, +"tokens_out": 695, +"seconds": 66, +"guard": { +"repeats": 1 +}, +"tools": { +"check": 3, +"look": 2, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 9, +"repo": "click", +"task": "rename", +"target": "click::types::File::resolve_lazy_flag", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 4856, +"tokens_out": 284, +"seconds": 17, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 9, +"repo": "click", +"task": "fix", +"target": "click::types::Choice::__init__", +"mode": "lite", +"passed": false, +"steps": 19, +"tokens_in": 117018, +"tokens_out": 5640, +"seconds": 284, +"gate": { +"nochange": 1 +}, +"guard": { +"repeats": 7, +"soft_budget": 1 +}, +"tools": { +"check": 2, +"look": 17 +} +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 9, +"repo": "cobra", +"task": "rename", +"target": "main::Command::HasPersistentFlags", +"mode": "lite", +"passed": true, +"steps": 25, +"tokens_in": 185340, +"tokens_out": 4615, +"seconds": 285, +"stopped": "steps", +"guard": { +"repeats": 7, +"soft_budget": 1 +}, +"tools": { +"look": 18, +"replace": 5, +"check": 2 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 9, +"repo": "cobra", +"task": "fix", +"target": "main::Command::PersistentFlags", +"mode": "lite", +"passed": false, +"steps": 7, +"tokens_in": 12837, +"tokens_out": 708, +"seconds": 37, +"guard": { +"repeats": 2 +}, +"tools": { +"check": 4, +"replace": 1, +"look": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 9, +"repo": "indexmap", +"task": "rename", +"target": "indexmap::map::raw_entry_v1::RawVacantEntryMut::insert_hashed_nocheck", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 4707, +"tokens_out": 236, +"seconds": 16, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 9, +"repo": "indexmap", +"task": "fix", +"target": "indexmap::inner::Core::move_index", +"mode": "lite", +"passed": true, +"steps": 5, +"tokens_in": 8809, +"tokens_out": 523, +"seconds": 33, +"guard": {}, +"tools": { +"check": 2, +"look": 1, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 9, +"repo": "semver", +"task": "rename", +"target": "semver::identifier::Identifier::new_unchecked", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 7695, +"tokens_out": 276, +"seconds": 16, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"old_defined": false +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 9, +"repo": "semver", +"task": "fix", +"target": "semver::eval::matches_caret", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 6265, +"tokens_out": 605, +"seconds": 29, +"guard": {}, +"tools": { +"check": 2, +"replace": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 9, +"repo": "sqlparse", +"task": "rename", +"target": "sqlparse::engine::grouping::group_as", +"mode": "lite", +"passed": true, +"steps": 4, +"tokens_in": 5336, +"tokens_out": 243, +"seconds": 16, +"guard": {}, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +} +}, +{ +"model": "qwen3.5-9b", +"version": "old", +"set": 9, +"repo": "sqlparse", +"task": "fix", +"target": "sqlparse::filters::others::StripTrailingSemicolonFilter::process", +"mode": "lite", +"passed": true, +"steps": 6, +"tokens_in": 11263, +"tokens_out": 531, +"seconds": 32, +"guard": {}, +"tools": { +"check": 2, +"replace": 2, +"look": 1, +"finish": 1 +} +} +] \ No newline at end of file diff --git a/eval/results/agent-kaggle-big-20261114.json b/eval/results/agent-kaggle-big-20261114.json new file mode 100644 index 0000000..a333c92 --- /dev/null +++ b/eval/results/agent-kaggle-big-20261114.json @@ -0,0 +1,4508 @@ +[ +{ +"tokens_in": 1462, +"tokens_out": 77, +"steps": 2, +"tools": { +"grep": 1, +"finish": 1 +}, +"guard": {}, +"passed": true, +"repo": "prometheus", +"task": "find", +"target": "tsdb::index::NewSymbols", +"mode": "base", +"seconds": 10, +"model": "qwen3.5-27b", +"set": 0 +}, +{ +"tokens_in": 2198, +"tokens_out": 77, +"steps": 2, +"tools": { +"grep": 1, +"finish": 1 +}, +"guard": {}, +"passed": true, +"repo": "prometheus", +"task": "find", +"target": "tsdb::index::NewSymbols", +"mode": "gitnext", +"seconds": 10, +"model": "qwen3.5-27b", +"set": 0 +}, +{ +"tokens_in": 3660, +"tokens_out": 96, +"steps": 2, +"tools": { +"look": 1, +"finish": 1 +}, +"guard": {}, +"gate": { +"nochange": 1 +}, +"passed": true, +"repo": "prometheus", +"task": "find", +"target": "tsdb::index::NewSymbols", +"mode": "lite", +"seconds": 27, +"model": "qwen3.5-27b", +"set": 0 +}, +{ +"tokens_in": 14600, +"tokens_out": 750, +"steps": 7, +"tools": { +"grep": 1, +"read_file": 5, +"finish": 1 +}, +"guard": {}, +"recall": 1.0, +"passed": true, +"repo": "prometheus", +"task": "callers", +"target": "model::textparse::NewOpenMetricsParser", +"mode": "base", +"seconds": 76, +"model": "qwen3.5-27b", +"set": 0 +}, +{ +"tokens_in": 17031, +"tokens_out": 468, +"steps": 7, +"tools": { +"grep": 1, +"look": 1, +"read_file": 4, +"finish": 1 +}, +"guard": {}, +"recall": 1.0, +"passed": true, +"repo": "prometheus", +"task": "callers", +"target": "model::textparse::NewOpenMetricsParser", +"mode": "gitnext", +"seconds": 63, +"model": "qwen3.5-27b", +"set": 0 +}, +{ +"tokens_in": 3554, +"tokens_out": 99, +"steps": 1, +"tools": { +"look": 1 +}, +"guard": {}, +"gate": { +"nochange": 1 +}, +"recall": 1.0, +"passed": true, +"repo": "prometheus", +"task": "callers", +"target": "model::textparse::NewOpenMetricsParser", +"mode": "lite", +"seconds": 25, +"model": "qwen3.5-27b", +"set": 0 +}, +{ +"tokens_in": 35134, +"tokens_out": 979, +"steps": 11, +"tools": { +"grep": 4, +"read_file": 2, +"edit_file": 3, +"run": 1, +"finish": 1 +}, +"guard": {}, +"left": "cmd/prometheus/query_log_test.go:384:\trequire.NoError(t, os.Rename(queryLogFile.Name(), newFile.Name()))\ndiscovery/file/file_test.go:95:// an open handle on dst (which would make os.Rename fail on Win", +"passed": false, +"repo": "prometheus", +"task": "rename", +"target": "tsdb::fileutil::Rename", +"mode": "base", +"seconds": 166, +"model": "qwen3.5-27b", +"set": 0 +}, +{ +"tokens_in": 4461, +"tokens_out": 245, +"steps": 3, +"tools": { +"rename": 1, +"run": 1, +"finish": 1 +}, +"guard": {}, +"left": "cmd/prometheus/query_log_test.go:384:\trequire.NoError(t, os.Rename(queryLogFile.Name(), newFile.Name()))\ndiscovery/file/file_test.go:115:\t\terr = os.Rename(tmp.Name(), dst)\ndocumentation/examples/custo", +"passed": false, +"repo": "prometheus", +"task": "rename", +"target": "tsdb::fileutil::Rename", +"mode": "gitnext", +"seconds": 68, +"model": "qwen3.5-27b", +"set": 0 +}, +{ +"tokens_in": 6338, +"tokens_out": 298, +"steps": 4, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"guard": {}, +"left": "cmd/prometheus/query_log_test.go:384:\trequire.NoError(t, os.Rename(queryLogFile.Name(), newFile.Name()))\ndiscovery/file/file_test.go:115:\t\terr = os.Rename(tmp.Name(), dst)\ndocumentation/examples/custo", +"passed": false, +"repo": "prometheus", +"task": "rename", +"target": "tsdb::fileutil::Rename", +"mode": "lite", +"seconds": 186, +"model": "qwen3.5-27b", +"set": 0 +}, +{ +"tokens_in": 1461, +"tokens_out": 83, +"steps": 2, +"tools": { +"grep": 1, +"finish": 1 +}, +"guard": {}, +"passed": true, +"repo": "prometheus", +"task": "find", +"target": "tsdb::chunks::WithSegmentSize", +"mode": "base", +"seconds": 11, +"model": "qwen3.5-27b", +"set": 1 +}, +{ +"tokens_in": 2197, +"tokens_out": 83, +"steps": 2, +"tools": { +"grep": 1, +"finish": 1 +}, +"guard": {}, +"passed": true, +"repo": "prometheus", +"task": "find", +"target": "tsdb::chunks::WithSegmentSize", +"mode": "gitnext", +"seconds": 11, +"model": "qwen3.5-27b", +"set": 1 +}, +{ +"tokens_in": 3404, +"tokens_out": 106, +"steps": 2, +"tools": { +"look": 1, +"finish": 1 +}, +"guard": {}, +"gate": { +"nochange": 1 +}, +"passed": true, +"repo": "prometheus", +"task": "find", +"target": "tsdb::chunks::WithSegmentSize", +"mode": "lite", +"seconds": 27, +"model": "qwen3.5-27b", +"set": 1 +}, +{ +"tokens_in": 50453, +"tokens_out": 1335, +"steps": 12, +"tools": { +"grep": 2, +"read_file": 9, +"finish": 1 +}, +"guard": {}, +"recall": 1.0, +"passed": true, +"repo": "prometheus", +"task": "callers", +"target": "tsdb::OverlappingBlocks", +"mode": "base", +"seconds": 143, +"model": "qwen3.5-27b", +"set": 1 +}, +{ +"tokens_in": 32407, +"tokens_out": 591, +"steps": 10, +"tools": { +"grep": 1, +"look": 1, +"read_file": 7, +"finish": 1 +}, +"guard": {}, +"recall": 1.0, +"passed": true, +"repo": "prometheus", +"task": "callers", +"target": "tsdb::OverlappingBlocks", +"mode": "gitnext", +"seconds": 79, +"model": "qwen3.5-27b", +"set": 1 +}, +{ +"tokens_in": 4227, +"tokens_out": 84, +"steps": 1, +"tools": { +"look": 1 +}, +"guard": {}, +"gate": { +"nochange": 1 +}, +"recall": 1.0, +"passed": true, +"repo": "prometheus", +"task": "callers", +"target": "tsdb::OverlappingBlocks", +"mode": "lite", +"seconds": 30, +"model": "qwen3.5-27b", +"set": 1 +}, +{ +"tokens_in": 146588, +"tokens_out": 3111, +"steps": 25, +"tools": { +"grep": 4, +"read_file": 9, +"edit_file": 12 +}, +"guard": { +"soft_budget": 1 +}, +"stopped": "steps", +"handoff": "Task: Rename the function `AsErrors` to `AsErrorsV2` everywhere in the project (definition and every use). The project must still compile.\nStopped: ran out of steps.\nTried (distinct actions):\n step 10: edit_file {\"new\": \"\\t\\twarnings := rs.Warnings().AsErrorsV2()\\n\\t\\trequire.Len(t, warnings, 1)\\n\\t\\trequire.Contains(t, warnings[0].Error(),\n step 11: read_file {\"end\": 1970, \"path\": \"storage/merge_test.go\", \"start\": 1958}\n step 12: edit_file {\"new\": \"\\t\\twarnings := rs.Warnings().AsErrorsV2()\\n\\t\\trequire.Len(t, warnings, 1)\\n\\t\\trequire.Contains(t, warnings[0].Error(),\n step 13: read_file {\"end\": 2010, \"path\": \"storage/merge_test.go\", \"start\": 1958}\n step 14: edit_file {\"new\": \"\\t\\trequire.NoError(t, rs.Err())\\n\\t\\twarnings := rs.Warnings().AsErrorsV2()\\n\\t\\trequire.Len(t, warnings, 1)\\n\\t\\trequir\n step 15: edit_file {\"new\": \"\\t\\trequire.NoError(t, rs.Err())\\n\\t\\twarnings := rs.Warnings().AsErrorsV2()\\n\\t\\trequire.Len(t, warnings, 1)\\n\\t\\trequir\n step 16: read_file {\"end\": 2015, \"path\": \"storage/merge_test.go\", \"start\": 1998}\n step 17: edit_file {\"new\": \"\\t\\trs := merged.(Searcher).SearchLabelValues(ctx, \\\"env\\\", nil)\\n\\t\\tfor rs.Next() {\\n\\t\\t}\\n\\t\\trequire.NoError(t, rs.E\n step 19: read_file {\"end\": 2200, \"path\": \"storage/merge_test.go\", \"start\": 2190}\n step 20: edit_file {\"new\": \"\\t\\trequire.False(t, rs.Next())\\n\\t\\trequire.NoError(t, rs.Err())\\n\\t\\twarnings := rs.Warnings().AsErrorsV2()\\n\\t\\trequir\n step 21: read_file {\"end\": 2248, \"path\": \"storage/merge_test.go\", \"start\": 2236}\n step 22: edit_file {\"new\": \"\\t\\trequire.Error(t, rs.Err())\\n\\t\\trequire.Contains(t, rs.Err().Error(), \\\"score path failure\\\")\\n\\t\\twarnings := rs.War\n step 23: read_file {\"end\": 2296, \"path\": \"storage/merge_test.go\", \"start\": 2284}\n step 24: edit_file {\"new\": \"\\t\\trequire.Error(t, rs.Err())\\n\\t\\trequire.Contains(t, rs.Err().Error(), \\\"primary failure\\\")\\n\\t\\t// Warnings from the \n step 25: grep {\"path\": \"storage/fanout_test.go\", \"pattern\": \"AsErrors\\\\(\\\\)\"}\nFiles changed so far:\nstorage/generic_test.go | 2 +-\n storage/merge_test.go | 12 ++++++------\n storage/remote/read_test.go | 2 +-\n util/annotations/annotations.go | 4 ++--\n 4 files changed, 10 insertions(+), 10 deletions(-)\nNo failing command was seen.", +"left": "cmd/promtool/tsdb.go:755:\t\treturn errors.Join(ws.AsErrors()...)\npromql/estimate_resource_test.go:73:\t\t\trequire.Len(t, annos.AsErrors(), 1, \"fallback warning is deduplicated\")\npromql/estimate_resource_", +"passed": false, +"repo": "prometheus", +"task": "rename", +"target": "util::annotations::Annotations::AsErrors", +"mode": "base", +"seconds": 359, +"model": "qwen3.5-27b", +"set": 1 +}, +{ +"tokens_in": 27844, +"tokens_out": 677, +"steps": 8, +"tools": { +"rename": 1, +"read_file": 2, +"grep": 2, +"edit_file": 1, +"check": 1, +"finish": 1 +}, +"guard": {}, +"left": "", +"passed": true, +"repo": "prometheus", +"task": "rename", +"target": "util::annotations::Annotations::AsErrors", +"mode": "gitnext", +"seconds": 193, +"model": "qwen3.5-27b", +"set": 1 +}, +{ +"tokens_in": 131628, +"tokens_out": 2875, +"steps": 25, +"tools": { +"look": 14, +"rename": 1, +"check": 6, +"replace": 4 +}, +"guard": { +"repeats": 6, +"soft_budget": 1 +}, +"stopped": "steps", +"handoff": "Task: Rename the function `AsErrors` to `AsErrorsV2` everywhere in the project (definition and every use). The project must still compile.\nStopped: ran out of steps.\nTried (distinct actions):\n step 5: replace {\"code\": \"func TestNewSearchResultSetFromSliceAndError(t *testing.T) {\\n\\tt.Parallel()\\n\\tresults := []string{\\\"a\\\", \\\"b\\\", \\\"c\\\"}\\n\n step 7: look {\"what\": \"storage/generic_test.go:257\"}\n step 9: check {\"test\": \"TestNewSearchResultSetFromSliceAndError\"}\n step 10: look {\"what\": \"storage/generic_test.go\"}\n step 11: look {\"what\": \"storage/generic_test.go:1-30\"}\n step 12: look {\"what\": \"storage/generic_test.go:231-270\"}\n step 13: look {\"what\": \"storage/generic.go:241-250\"}\n step 15: replace {\"code\": \"func TestNewSearchResultSetFromSliceAndError(t *testing.T) {\\n\\tt.Parallel()\\n\\tresults := []string{\\\"a\\\", \\\"b\\\", \\\"c\\\"}\\n\n step 18: look {\"what\": \"storage/generic_test.go:231-260\"}\n step 20: look {\"what\": \"util/annotations/annotations.go:75-83\"}\n step 21: look {\"what\": \"storage/generic_test.go:14-28\"}\n step 22: replace {\"code\": \"func TestNewSearchResultSetFromSliceAndError(t *testing.T) {\\n\\tt.Parallel()\\n\\tresults := []string{\\\"a\\\", \\\"b\\\", \\\"c\\\"}\\n\n step 23: look {\"what\": \"AsErrors()\"}\n step 24: look {\"what\": \".AsErrors\"}\n step 25: replace {\"code\": \"func TestNewSearchResultSetFromSliceAndError(t *testing.T) {\\n\\tt.Parallel()\\n\\tresults := []string{\\\"a\\\", \\\"b\\\", \\\"c\\\"}\\n\nFiles changed so far:\ncmd/promtool/tsdb.go | 2 +-\n promql/estimate_resource_test.go | 8 ++++----\n promql/estimate_test.go | 8 ++++----\n promql/promqltest/test.go | 4 ++--\n promql/query_cost_duration_test.go | 4 ++--\n storage/fanout_test.go | 6 +++---\n storage/generic_test.go | 30 ++++++++++++------------------\n storage/merge_test.go | 12 ++++++------\n storage/remote/read_test.go | 2 +-\n util/annotations/annotations.go | 4 ++--\n web/api/v1/api_test.go | 4 ++--\n 11 files changed, 39 insertions(+), 45 deletions(-)\nLast error: build FAILED N.Ns go build ./... && go test -count=N -run '^$' ./... >/dev/null | build: N error | \u2717 error storage/generic_test.go:N", +"left": "", +"passed": false, +"repo": "prometheus", +"task": "rename", +"target": "util::annotations::Annotations::AsErrors", +"mode": "lite", +"seconds": 415, +"model": "qwen3.5-27b", +"set": 1 +}, +{ +"tokens_in": 1479, +"tokens_out": 89, +"steps": 2, +"tools": { +"grep": 1, +"finish": 1 +}, +"guard": {}, +"passed": true, +"repo": "prometheus", +"task": "find", +"target": "util::annotations::NewNativeHistogramFractionNaNsInfo", +"mode": "base", +"seconds": 11, +"model": "qwen3.5-27b", +"set": 10 +}, +{ +"tokens_in": 2215, +"tokens_out": 89, +"steps": 2, +"tools": { +"grep": 1, +"finish": 1 +}, +"guard": {}, +"passed": true, +"repo": "prometheus", +"task": "find", +"target": "util::annotations::NewNativeHistogramFractionNaNsInfo", +"mode": "gitnext", +"seconds": 11, +"model": "qwen3.5-27b", +"set": 10 +}, +{ +"tokens_in": 3178, +"tokens_out": 115, +"steps": 2, +"tools": { +"look": 1, +"finish": 1 +}, +"guard": {}, +"gate": { +"nochange": 1 +}, +"passed": true, +"repo": "prometheus", +"task": "find", +"target": "util::annotations::NewNativeHistogramFractionNaNsInfo", +"mode": "lite", +"seconds": 26, +"model": "qwen3.5-27b", +"set": 10 +}, +{ +"tokens_in": 224049, +"tokens_out": 2006, +"steps": 25, +"tools": { +"grep": 3, +"read_file": 22 +}, +"guard": { +"soft_budget": 1 +}, +"stopped": "steps", +"handoff": "Task: Which functions or methods call `GetCounter`? Answer with their names, one per line.\nStopped: ran out of steps.\nTried (distinct actions):\n step 11: read_file {\"end\": 120, \"path\": \"model/textparse/protobufparse.go\", \"start\": 85}\n step 12: read_file {\"end\": 360, \"path\": \"model/textparse/protobufparse.go\", \"start\": 335}\n step 13: read_file {\"end\": 345, \"path\": \"model/textparse/protobufparse.go\", \"start\": 310}\n step 14: read_file {\"end\": 425, \"path\": \"model/textparse/protobufparse.go\", \"start\": 400}\n step 15: read_file {\"end\": 3060, \"path\": \"promql/engine_test.go\", \"start\": 3035}\n step 16: read_file {\"end\": 3050, \"path\": \"promql/engine_test.go\", \"start\": 3020}\n step 17: read_file {\"end\": 1015, \"path\": \"cmd/prometheus/main_test.go\", \"start\": 990}\n step 18: read_file {\"end\": 1005, \"path\": \"cmd/prometheus/main_test.go\", \"start\": 970}\n step 19: read_file {\"end\": 135, \"path\": \"util/fmtutil/format.go\", \"start\": 110}\n step 20: read_file {\"end\": 120, \"path\": \"util/fmtutil/format.go\", \"start\": 90}\n step 21: read_file {\"end\": 175, \"path\": \"prompb/io/prometheus/client/decoder_test.go\", \"start\": 160}\n step 22: read_file {\"end\": 165, \"path\": \"prompb/io/prometheus/client/decoder_test.go\", \"start\": 130}\n step 23: read_file {\"end\": 135, \"path\": \"prompb/io/prometheus/client/decoder_test.go\", \"start\": 90}\n step 24: read_file {\"end\": 860, \"path\": \"prompb/io/prometheus/client/metrics.pb.go\", \"start\": 845}\n step 25: grep {\"pattern\": \"GetCounter\\\\(\\\\)\"}\nNo file was changed.\nNo failing command was seen.", +"recall": 0.0, +"passed": false, +"repo": "prometheus", +"task": "callers", +"target": "prompb::io::prometheus::client::Metric::GetCounter", +"mode": "base", +"seconds": 287, +"model": "qwen3.5-27b", +"set": 10 +}, +{ +"tokens_in": 4418, +"tokens_out": 191, +"steps": 3, +"tools": { +"grep": 1, +"look": 1, +"finish": 1 +}, +"guard": {}, +"recall": 1.0, +"passed": true, +"repo": "prometheus", +"task": "callers", +"target": "prompb::io::prometheus::client::Metric::GetCounter", +"mode": "gitnext", +"seconds": 35, +"model": "qwen3.5-27b", +"set": 10 +}, +{ +"tokens_in": 3335, +"tokens_out": 160, +"steps": 2, +"tools": { +"look": 1, +"finish": 1 +}, +"guard": {}, +"gate": { +"nochange": 1 +}, +"recall": 1.0, +"passed": true, +"repo": "prometheus", +"task": "callers", +"target": "prompb::io::prometheus::client::Metric::GetCounter", +"mode": "lite", +"seconds": 32, +"model": "qwen3.5-27b", +"set": 10 +}, +{ +"tokens_in": 119607, +"tokens_out": 2252, +"steps": 24, +"tools": { +"grep": 3, +"read_file": 9, +"edit_file": 9, +"run": 2, +"finish": 1 +}, +"guard": { +"repeats": 1, +"soft_budget": 1 +}, +"left": "", +"passed": true, +"repo": "prometheus", +"task": "rename", +"target": "util::notifications::Notifications::DeleteNotification", +"mode": "base", +"seconds": 297, +"model": "qwen3.5-27b", +"set": 10 +}, +{ +"tokens_in": 5846, +"tokens_out": 212, +"steps": 4, +"tools": { +"rename": 1, +"check": 1, +"run": 1, +"finish": 1 +}, +"guard": {}, +"left": "", +"passed": true, +"repo": "prometheus", +"task": "rename", +"target": "util::notifications::Notifications::DeleteNotification", +"mode": "gitnext", +"seconds": 118, +"model": "qwen3.5-27b", +"set": 10 +}, +{ +"tokens_in": 3209, +"tokens_out": 138, +"steps": 3, +"tools": { +"rename": 1, +"check": 1, +"finish": 1 +}, +"guard": {}, +"left": "", +"passed": true, +"repo": "prometheus", +"task": "rename", +"target": "util::notifications::Notifications::DeleteNotification", +"mode": "lite", +"seconds": 167, +"model": "qwen3.5-27b", +"set": 10 +}, +{ +"tokens_in": 1466, +"tokens_out": 83, +"steps": 2, +"tools": { +"grep": 1, +"finish": 1 +}, +"guard": {}, +"passed": true, +"repo": "prometheus", +"task": "find", +"target": "model::labels::AppendOpenMetricsFloat", +"mode": "base", +"seconds": 10, +"model": "qwen3.5-27b", +"set": 11 +}, +{ +"tokens_in": 2202, +"tokens_out": 83, +"steps": 2, +"tools": { +"grep": 1, +"finish": 1 +}, +"guard": {}, +"passed": true, +"repo": "prometheus", +"task": "find", +"target": "model::labels::AppendOpenMetricsFloat", +"mode": "gitnext", +"seconds": 11, +"model": "qwen3.5-27b", +"set": 11 +}, +{ +"tokens_in": 3682, +"tokens_out": 106, +"steps": 2, +"tools": { +"look": 1, +"finish": 1 +}, +"guard": {}, +"gate": { +"nochange": 1 +}, +"passed": true, +"repo": "prometheus", +"task": "find", +"target": "model::labels::AppendOpenMetricsFloat", +"mode": "lite", +"seconds": 28, +"model": "qwen3.5-27b", +"set": 11 +}, +{ +"tokens_in": 183434, +"tokens_out": 1686, +"steps": 25, +"tools": { +"grep": 2, +"read_file": 23 +}, +"guard": { +"soft_budget": 1 +}, +"stopped": "steps", +"handoff": "Task: Which functions or methods call `NewRefreshMetrics`? Answer with their names, one per line.\nStopped: ran out of steps.\nTried (distinct actions):\n step 11: read_file {\"end\": 100, \"path\": \"cmd/promtool/sd.go\", \"start\": 70}\n step 12: read_file {\"end\": 75, \"path\": \"cmd/promtool/sd.go\", \"start\": 30}\n step 13: read_file {\"end\": 60, \"path\": \"discovery/marathon/marathon_test.go\", \"start\": 30}\n step 14: read_file {\"end\": 150, \"path\": \"discovery/marathon/marathon_test.go\", \"start\": 120}\n step 15: read_file {\"end\": 120, \"path\": \"discovery/refresh/refresh_test.go\", \"start\": 60}\n step 16: read_file {\"end\": 275, \"path\": \"discovery/dns/dns_test.go\", \"start\": 240}\n step 17: read_file {\"end\": 260, \"path\": \"discovery/dns/dns_test.go\", \"start\": 180}\n step 18: read_file {\"end\": 185, \"path\": \"discovery/dns/dns_test.go\", \"start\": 130}\n step 19: read_file {\"end\": 135, \"path\": \"discovery/dns/dns_test.go\", \"start\": 100}\n step 20: read_file {\"end\": 105, \"path\": \"discovery/dns/dns_test.go\", \"start\": 50}\n step 21: read_file {\"end\": 60, \"path\": \"discovery/dns/dns_test.go\", \"start\": 20}\n step 22: read_file {\"end\": 100, \"path\": \"discovery/triton/triton_test.go\", \"start\": 70}\n step 23: read_file {\"end\": 75, \"path\": \"discovery/vultr/vultr_test.go\", \"start\": 40}\n step 24: read_file {\"end\": 185, \"path\": \"discovery/file/file_test.go\", \"start\": 155}\n step 25: read_file {\"end\": 160, \"path\": \"discovery/file/file_test.go\", \"start\": 120}\nNo file was changed.\nNo failing command was seen.", +"recall": 0.0, +"passed": false, +"repo": "prometheus", +"task": "callers", +"target": "discovery::NewRefreshMetrics", +"mode": "base", +"seconds": 221, +"model": "qwen3.5-27b", +"set": 11 +}, +{ +"tokens_in": 26416, +"tokens_out": 1078, +"steps": 8, +"tools": { +"grep": 2, +"read_file": 4, +"look": 1, +"finish": 1 +}, +"guard": {}, +"recall": 1.0, +"passed": true, +"repo": "prometheus", +"task": "callers", +"target": "discovery::NewRefreshMetrics", +"mode": "gitnext", +"seconds": 121, +"model": "qwen3.5-27b", +"set": 11 +}, +{ +"tokens_in": 4002, +"tokens_out": 72, +"steps": 1, +"tools": { +"look": 1 +}, +"guard": {}, +"gate": { +"nochange": 1 +}, +"recall": 1.0, +"passed": true, +"repo": "prometheus", +"task": "callers", +"target": "discovery::NewRefreshMetrics", +"mode": "lite", +"seconds": 27, +"model": "qwen3.5-27b", +"set": 11 +}, +{ +"tokens_in": 41738, +"tokens_out": 1382, +"steps": 14, +"tools": { +"grep": 3, +"read_file": 3, +"edit_file": 4, +"run": 3, +"finish": 1 +}, +"guard": {}, +"left": "web/api/v1/api.go:1727:\tDroppedTargets []*DroppedTarget `json:\"droppedTargets\"`\nweb/api/v1/api.go:1893:\t\tres.DroppedTargets = make([]*DroppedTarget, 0, numTargets)\nweb/api/v1/api.go:1899:\t\t\t\tres.", +"passed": false, +"repo": "prometheus", +"task": "rename", +"target": "scrape::scrapePool::DroppedTargets", +"mode": "base", +"seconds": 216, +"model": "qwen3.5-27b", +"set": 11 +}, +{ +"tokens_in": 24373, +"tokens_out": 902, +"steps": 7, +"tools": { +"rename": 1, +"read_file": 2, +"grep": 2, +"run": 1, +"finish": 1 +}, +"guard": {}, +"left": "web/api/v1/api.go:1727:\tDroppedTargets []*DroppedTarget `json:\"droppedTargets\"`\nweb/api/v1/api.go:1893:\t\tres.DroppedTargets = make([]*DroppedTarget, 0, numTargets)\nweb/api/v1/api.go:1899:\t\t\t\tres.", +"passed": false, +"repo": "prometheus", +"task": "rename", +"target": "scrape::scrapePool::DroppedTargets", +"mode": "gitnext", +"seconds": 138, +"model": "qwen3.5-27b", +"set": 11 +}, +{ +"tokens_in": 5510, +"tokens_out": 410, +"steps": 4, +"tools": { +"rename": 1, +"look": 1, +"check": 1, +"finish": 1 +}, +"guard": {}, +"left": "web/api/v1/api.go:1727:\tDroppedTargets []*DroppedTarget `json:\"droppedTargets\"`\nweb/api/v1/api.go:1893:\t\tres.DroppedTargets = make([]*DroppedTarget, 0, numTargets)\nweb/api/v1/api.go:1899:\t\t\t\tres.", +"passed": false, +"repo": "prometheus", +"task": "rename", +"target": "scrape::scrapePool::DroppedTargets", +"mode": "lite", +"seconds": 183, +"model": "qwen3.5-27b", +"set": 11 +}, +{ +"tokens_in": 2420, +"tokens_out": 142, +"steps": 3, +"tools": { +"grep": 2, +"finish": 1 +}, +"guard": {}, +"passed": true, +"repo": "prometheus", +"task": "find", +"target": "model::labels::nameTable::ToName", +"mode": "base", +"seconds": 16, +"model": "qwen3.5-27b", +"set": 2 +}, +{ +"tokens_in": 3524, +"tokens_out": 142, +"steps": 3, +"tools": { +"grep": 2, +"finish": 1 +}, +"guard": {}, +"passed": true, +"repo": "prometheus", +"task": "find", +"target": "model::labels::nameTable::ToName", +"mode": "gitnext", +"seconds": 17, +"model": "qwen3.5-27b", +"set": 2 +}, +{ +"tokens_in": 3316, +"tokens_out": 118, +"steps": 2, +"tools": { +"look": 1, +"finish": 1 +}, +"guard": {}, +"gate": { +"nochange": 1 +}, +"passed": true, +"repo": "prometheus", +"task": "find", +"target": "model::labels::nameTable::ToName", +"mode": "lite", +"seconds": 27, +"model": "qwen3.5-27b", +"set": 2 +}, +{ +"tokens_in": 22489, +"tokens_out": 731, +"steps": 9, +"tools": { +"grep": 1, +"read_file": 7, +"finish": 1 +}, +"guard": {}, +"recall": 1.0, +"passed": true, +"repo": "prometheus", +"task": "callers", +"target": "prompb::io::prometheus::client::Histogram::GetPositiveDelta", +"mode": "base", +"seconds": 75, +"model": "qwen3.5-27b", +"set": 2 +}, +{ +"tokens_in": 4190, +"tokens_out": 142, +"steps": 3, +"tools": { +"grep": 1, +"look": 1, +"finish": 1 +}, +"guard": {}, +"recall": 1.0, +"passed": true, +"repo": "prometheus", +"task": "callers", +"target": "prompb::io::prometheus::client::Histogram::GetPositiveDelta", +"mode": "gitnext", +"seconds": 25, +"model": "qwen3.5-27b", +"set": 2 +}, +{ +"tokens_in": 3175, +"tokens_out": 76, +"steps": 1, +"tools": { +"look": 1 +}, +"guard": {}, +"gate": { +"nochange": 1 +}, +"recall": 1.0, +"passed": true, +"repo": "prometheus", +"task": "callers", +"target": "prompb::io::prometheus::client::Histogram::GetPositiveDelta", +"mode": "lite", +"seconds": 21, +"model": "qwen3.5-27b", +"set": 2 +}, +{ +"tokens_in": 18964, +"tokens_out": 1018, +"steps": 11, +"tools": { +"grep": 2, +"read_file": 3, +"edit_file": 3, +"run": 2, +"finish": 1 +}, +"guard": {}, +"left": "", +"passed": true, +"repo": "prometheus", +"task": "rename", +"target": "tsdb::tombstones::ReadTombstones", +"mode": "base", +"seconds": 142, +"model": "qwen3.5-27b", +"set": 2 +}, +{ +"tokens_in": 3751, +"tokens_out": 204, +"steps": 3, +"tools": { +"rename": 1, +"check": 1, +"finish": 1 +}, +"guard": {}, +"left": "", +"passed": true, +"repo": "prometheus", +"task": "rename", +"target": "tsdb::tombstones::ReadTombstones", +"mode": "gitnext", +"seconds": 108, +"model": "qwen3.5-27b", +"set": 2 +}, +{ +"tokens_in": 6043, +"tokens_out": 170, +"steps": 4, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"guard": {}, +"left": "", +"passed": true, +"repo": "prometheus", +"task": "rename", +"target": "tsdb::tombstones::ReadTombstones", +"mode": "lite", +"seconds": 172, +"model": "qwen3.5-27b", +"set": 2 +}, +{ +"tokens_in": 1475, +"tokens_out": 87, +"steps": 2, +"tools": { +"grep": 1, +"finish": 1 +}, +"guard": {}, +"passed": true, +"repo": "prometheus", +"task": "find", +"target": "storage::remote::googleiam::NewRoundTripper", +"mode": "base", +"seconds": 11, +"model": "qwen3.5-27b", +"set": 3 +}, +{ +"tokens_in": 2211, +"tokens_out": 87, +"steps": 2, +"tools": { +"grep": 1, +"finish": 1 +}, +"guard": {}, +"passed": true, +"repo": "prometheus", +"task": "find", +"target": "storage::remote::googleiam::NewRoundTripper", +"mode": "gitnext", +"seconds": 11, +"model": "qwen3.5-27b", +"set": 3 +}, +{ +"tokens_in": 3802, +"tokens_out": 112, +"steps": 2, +"tools": { +"look": 1, +"finish": 1 +}, +"guard": {}, +"gate": { +"nochange": 1 +}, +"passed": true, +"repo": "prometheus", +"task": "find", +"target": "storage::remote::googleiam::NewRoundTripper", +"mode": "lite", +"seconds": 28, +"model": "qwen3.5-27b", +"set": 3 +}, +{ +"tokens_in": 1699, +"tokens_out": 147, +"steps": 2, +"tools": { +"grep": 1, +"finish": 1 +}, +"guard": {}, +"recall": 1.0, +"passed": true, +"repo": "prometheus", +"task": "callers", +"target": "cmd::promtool::PushMetrics", +"mode": "base", +"seconds": 16, +"model": "qwen3.5-27b", +"set": 3 +}, +{ +"tokens_in": 121016, +"tokens_out": 1292, +"steps": 16, +"tools": { +"grep": 2, +"read_file": 13, +"finish": 1 +}, +"guard": { +"repeats": 1 +}, +"recall": 1.0, +"passed": true, +"repo": "prometheus", +"task": "callers", +"target": "cmd::promtool::PushMetrics", +"mode": "gitnext", +"seconds": 208, +"model": "qwen3.5-27b", +"set": 3 +}, +{ +"tokens_in": 4289, +"tokens_out": 42, +"steps": 1, +"tools": { +"look": 1 +}, +"guard": {}, +"gate": { +"nochange": 1 +}, +"recall": 1.0, +"passed": true, +"repo": "prometheus", +"task": "callers", +"target": "cmd::promtool::PushMetrics", +"mode": "lite", +"seconds": 27, +"model": "qwen3.5-27b", +"set": 3 +}, +{ +"tokens_in": 137058, +"tokens_out": 2723, +"steps": 25, +"tools": { +"grep": 2, +"read_file": 10, +"edit_file": 12, +"run": 1 +}, +"guard": { +"repeats": 2, +"soft_budget": 1 +}, +"stopped": "steps", +"handoff": "Task: Rename the function `IsTypeEmpty` to `IsTypeEmptyV2` everywhere in the project (definition and every use). The project must still compile.\nStopped: ran out of steps.\nTried (distinct actions):\n step 9: edit_file {\"new\": \"func (m Metadata) IsEmptyFor(labelName string) bool {\\n\\tswitch labelName {\\n\\tcase model.MetricNameLabel:\\n\\t\\treturn m.\n step 10: edit_file {\"new\": \"func (m Metadata) AddToLabels(b *labels.ScratchBuilder) {\\n\\tif m.Name != \\\"\\\" {\\n\\t\\tb.Add(model.MetricNameLabel, m.Name\n step 11: edit_file {\"new\": \"func (m Metadata) SetToLabels(b *labels.Builder) {\\n\\tb.Set(model.MetricNameLabel, m.Name)\\n\\tif m.IsTypeEmptyV2() {\\n\\t\\\n step 12: read_file {\"end\": 330, \"path\": \"model/textparse/openmetrics2parse.go\", \"start\": 315}\n step 13: edit_file {\"new\": \"\\tif !m.IsTypeEmptyV2() {\\n\\t\\t\\t\\t\\tpos += 1 + len(model.MetricTypeLabel) + 1 + len(p.mtype)\\n\\t\\t\\t\\t}\", \"old\": \"\\tif !\n step 14: read_file {\"end\": 325, \"path\": \"model/textparse/openmetrics2parse.go\", \"start\": 318}\n step 15: edit_file {\"new\": \"\\t\\t\\tif p.enableTypeAndUnitLabels {\\n\\t\\t\\t\\tif !m.IsTypeEmptyV2() {\\n\\t\\t\\t\\t\\tpos += 1 + len(model.MetricTypeLabel) + \n step 17: edit_file {\"new\": \"\\t\\t\\tif !m.IsTypeEmptyV2() {\\n\\t\\t\\t\\tpos += 1 + len(model.MetricTypeLabel) + 1 + len(p.mtype)\\n\\t\\t\\t}\", \"old\": \"\\t\\t\\t\n step 18: read_file {\"end\": 565, \"path\": \"rules/group.go\", \"start\": 555}\n step 19: edit_file {\"new\": \"\\t\\t\\tif !sm.IsTypeEmptyV2() || sm.Unit != \\\"\\\" {\\n\\t\\t\\t\\tlb := labels.NewBuilder(labels.EmptyLabels())\", \"old\": \"\\t\\t\\t\n step 20: read_file {\"end\": 85, \"path\": \"schema/labels_test.go\", \"start\": 75}\n step 21: edit_file {\"new\": \"\\t\\t\\t\\trequire.Equal(t, tcase.emptyType, expectedMeta.IsTypeEmptyV2())\", \"old\": \"\\t\\t\\t\\trequire.Equal(t, tcase.emptyTyp\n step 22: read_file {\"end\": 115, \"path\": \"schema/labels_test.go\", \"start\": 105}\n step 23: edit_file {\"new\": \"\\t\\trequire.True(t, invalidMeta.IsTypeEmptyV2())\", \"old\": \"\\t\\trequire.True(t, invalidMeta.IsTypeEmpty())\", \"path\": \"sche\n step 25: run {\"command\": \"go build ./...\"}\nFiles changed so far:\nmodel/textparse/openmetrics2parse.go | 2 +-\n rules/group.go | 2 +-\n schema/labels.go | 10 +++++-----\n schema/labels_test.go | 4 ++--\n 4 files changed, 9 insertions(+), 9 deletions(-)\nNo failing command was seen.", +"left": "", +"passed": true, +"repo": "prometheus", +"task": "rename", +"target": "schema::Metadata::IsTypeEmpty", +"mode": "base", +"seconds": 330, +"model": "qwen3.5-27b", +"set": 3 +}, +{ +"tokens_in": 3615, +"tokens_out": 161, +"steps": 3, +"tools": { +"rename": 1, +"run": 1, +"finish": 1 +}, +"guard": {}, +"left": "", +"passed": true, +"repo": "prometheus", +"task": "rename", +"target": "schema::Metadata::IsTypeEmpty", +"mode": "gitnext", +"seconds": 62, +"model": "qwen3.5-27b", +"set": 3 +}, +{ +"tokens_in": 3309, +"tokens_out": 155, +"steps": 3, +"tools": { +"rename": 1, +"check": 1, +"finish": 1 +}, +"guard": {}, +"left": "", +"passed": true, +"repo": "prometheus", +"task": "rename", +"target": "schema::Metadata::IsTypeEmpty", +"mode": "lite", +"seconds": 166, +"model": "qwen3.5-27b", +"set": 3 +}, +{ +"tokens_in": 2785, +"tokens_out": 157, +"steps": 3, +"tools": { +"grep": 2, +"finish": 1 +}, +"guard": {}, +"passed": true, +"repo": "prometheus", +"task": "find", +"target": "scrape::scrapePool::ActiveTargets", +"mode": "base", +"seconds": 19, +"model": "qwen3.5-27b", +"set": 4 +}, +{ +"tokens_in": 3886, +"tokens_out": 154, +"steps": 3, +"tools": { +"grep": 2, +"finish": 1 +}, +"guard": {}, +"passed": true, +"repo": "prometheus", +"task": "find", +"target": "scrape::scrapePool::ActiveTargets", +"mode": "gitnext", +"seconds": 19, +"model": "qwen3.5-27b", +"set": 4 +}, +{ +"tokens_in": 3362, +"tokens_out": 125, +"steps": 3, +"tools": { +"look": 1, +"finish": 2 +}, +"guard": {}, +"gate": { +"nochange": 1 +}, +"passed": true, +"repo": "prometheus", +"task": "find", +"target": "scrape::scrapePool::ActiveTargets", +"mode": "lite", +"seconds": 28, +"model": "qwen3.5-27b", +"set": 4 +}, +{ +"tokens_in": 166094, +"tokens_out": 1411, +"steps": 21, +"tools": { +"grep": 4, +"read_file": 15, +"list_dir": 1, +"finish": 1 +}, +"guard": { +"soft_budget": 1 +}, +"recall": 1.0, +"passed": true, +"repo": "prometheus", +"task": "callers", +"target": "tsdb::Head::Init", +"mode": "base", +"seconds": 200, +"model": "qwen3.5-27b", +"set": 4 +}, +{ +"tokens_in": 28570, +"tokens_out": 386, +"steps": 6, +"tools": { +"grep": 2, +"read_file": 2, +"look": 1, +"finish": 1 +}, +"guard": {}, +"recall": 0.25, +"passed": false, +"repo": "prometheus", +"task": "callers", +"target": "tsdb::Head::Init", +"mode": "gitnext", +"seconds": 70, +"model": "qwen3.5-27b", +"set": 4 +}, +{ +"tokens_in": 82748, +"tokens_out": 516, +"steps": 12, +"tools": { +"look": 11, +"finish": 1 +}, +"guard": { +"repeats": 1 +}, +"gate": { +"nochange": 1 +}, +"recall": 1.0, +"passed": true, +"repo": "prometheus", +"task": "callers", +"target": "tsdb::Head::Init", +"mode": "lite", +"seconds": 167, +"model": "qwen3.5-27b", +"set": 4 +}, +{ +"tokens_in": 19428, +"tokens_out": 919, +"steps": 10, +"tools": { +"grep": 2, +"read_file": 2, +"edit_file": 2, +"run": 3, +"finish": 1 +}, +"guard": {}, +"left": "", +"passed": true, +"repo": "prometheus", +"task": "rename", +"target": "promql::evaluator::VectorUnless", +"mode": "base", +"seconds": 173, +"model": "qwen3.5-27b", +"set": 4 +}, +{ +"tokens_in": 5272, +"tokens_out": 246, +"steps": 4, +"tools": { +"rename": 1, +"check": 1, +"run": 1, +"finish": 1 +}, +"guard": {}, +"left": "", +"passed": true, +"repo": "prometheus", +"task": "rename", +"target": "promql::evaluator::VectorUnless", +"mode": "gitnext", +"seconds": 146, +"model": "qwen3.5-27b", +"set": 4 +}, +{ +"tokens_in": 2978, +"tokens_out": 190, +"steps": 3, +"tools": { +"rename": 1, +"check": 1, +"finish": 1 +}, +"guard": {}, +"left": "", +"passed": true, +"repo": "prometheus", +"task": "rename", +"target": "promql::evaluator::VectorUnless", +"mode": "lite", +"seconds": 162, +"model": "qwen3.5-27b", +"set": 4 +}, +{ +"tokens_in": 2526, +"tokens_out": 150, +"steps": 3, +"tools": { +"grep": 2, +"finish": 1 +}, +"guard": {}, +"passed": true, +"repo": "prometheus", +"task": "find", +"target": "schema::Metadata::IsEmptyFor", +"mode": "base", +"seconds": 17, +"model": "qwen3.5-27b", +"set": 5 +}, +{ +"tokens_in": 3630, +"tokens_out": 150, +"steps": 3, +"tools": { +"grep": 2, +"finish": 1 +}, +"guard": {}, +"passed": true, +"repo": "prometheus", +"task": "find", +"target": "schema::Metadata::IsEmptyFor", +"mode": "gitnext", +"seconds": 18, +"model": "qwen3.5-27b", +"set": 5 +}, +{ +"tokens_in": 3392, +"tokens_out": 92, +"steps": 2, +"tools": { +"look": 1, +"finish": 1 +}, +"guard": {}, +"gate": { +"nochange": 1 +}, +"passed": true, +"repo": "prometheus", +"task": "find", +"target": "schema::Metadata::IsEmptyFor", +"mode": "lite", +"seconds": 25, +"model": "qwen3.5-27b", +"set": 5 +}, +{ +"tokens_in": 10353, +"tokens_out": 397, +"steps": 6, +"tools": { +"grep": 1, +"read_file": 4, +"finish": 1 +}, +"guard": {}, +"recall": 1.0, +"passed": true, +"repo": "prometheus", +"task": "callers", +"target": "tsdb::index::ReadPostingsOffsetTable", +"mode": "base", +"seconds": 41, +"model": "qwen3.5-27b", +"set": 5 +}, +{ +"tokens_in": 17826, +"tokens_out": 450, +"steps": 6, +"tools": { +"grep": 1, +"read_file": 3, +"look": 1, +"finish": 1 +}, +"guard": {}, +"recall": 1.0, +"passed": true, +"repo": "prometheus", +"task": "callers", +"target": "tsdb::index::ReadPostingsOffsetTable", +"mode": "gitnext", +"seconds": 62, +"model": "qwen3.5-27b", +"set": 5 +}, +{ +"tokens_in": 3892, +"tokens_out": 118, +"steps": 2, +"tools": { +"look": 1, +"finish": 1 +}, +"guard": {}, +"gate": { +"nochange": 1 +}, +"recall": 1.0, +"passed": true, +"repo": "prometheus", +"task": "callers", +"target": "tsdb::index::ReadPostingsOffsetTable", +"mode": "lite", +"seconds": 27, +"model": "qwen3.5-27b", +"set": 5 +}, +{ +"tokens_in": 96380, +"tokens_out": 2354, +"steps": 25, +"tools": { +"list_dir": 1, +"grep": 4, +"read_file": 9, +"edit_file": 10, +"run": 1 +}, +"guard": { +"soft_budget": 1 +}, +"stopped": "steps", +"handoff": "Task: Rename the function `FromData` to `FromDataV2` everywhere in the project (definition and every use). The project must still compile.\nStopped: ran out of steps.\nTried (distinct actions):\n step 11: read_file {\"end\": 1445, \"path\": \"tsdb/head_wal.go\", \"start\": 1415}\n step 12: edit_file {\"new\": \"\\tchk, err := chunkenc.FromDataV2(enc, bytes.Clone(dec.UvarintBytes()))\", \"old\": \"\\tchk, err := chunkenc.FromData(enc, by\n step 13: edit_file {\"new\": \"\\t\\t// Guard against a new encoding added to chunkenc.FromDataV2 without a corresponding case here.\", \"old\": \"\\t\\t// Guar\n step 14: read_file {\"end\": 898, \"path\": \"storage/remote/codec_test.go\", \"start\": 890}\n step 15: edit_file {\"new\": \"\\tchunk, err := chunkenc.FromDataV2(chunkenc.Encoding(one.Type), one.Data)\", \"old\": \"\\tchunk, err := chunkenc.FromData(ch\n step 16: read_file {\"end\": 816, \"path\": \"storage/remote/codec.go\", \"start\": 807}\n step 17: edit_file {\"new\": \"\\t\\tdecodedChunk, err := chunkenc.FromDataV2(chunkenc.Encoding(chunk.Type), chunk.Data)\", \"old\": \"\\t\\tdecodedChunk, err :\n step 18: read_file {\"end\": 1183, \"path\": \"storage/remote/read_handler_test.go\", \"start\": 1175}\n step 19: edit_file {\"new\": \"\\t\\t\\t\\t\\tdecodedChunk, err := chunkenc.FromDataV2(encoding, chunk.Data)\", \"old\": \"\\t\\t\\t\\t\\tdecodedChunk, err := chunken\n step 20: read_file {\"end\": 1430, \"path\": \"storage/remote/read_handler_test.go\", \"start\": 1420}\n step 21: edit_file {\"new\": \"\\t\\t\\t\\tdecoded, err := chunkenc.FromDataV2(chunkenc.Encoding(chunk.Type), chunk.Data)\", \"old\": \"\\t\\t\\t\\tdecoded, err := \n step 22: grep {\"pattern\": \"chunkenc\\\\.FromData[^V]\"}\n step 23: grep {\"pattern\": \"\\\\bFromData\\\\(\"}\n step 24: grep {\"pattern\": \"FromDataV2\"}\n step 25: run {\"command\": \"go build ./...\"}\nFiles changed so far:\nstorage/remote/codec.go | 2 +-\n storage/remote/codec_test.go | 2 +-\n storage/remote/read_handler_test.go | 4 ++--\n tsdb/chunkenc/chunk.go | 4 ++--\n tsdb/chunkenc/chunk_test.go | 2 +-\n tsdb/chunkenc/xor2_test.go | 2 +-\n tsdb/head_wal.go | 4 ++--\n tsdb/mocks_test.go | 2 +-\n 8 files changed, 11 insertions(+), 11 deletions(-)\nNo failing command was seen.", +"left": "", +"passed": true, +"repo": "prometheus", +"task": "rename", +"target": "tsdb::chunkenc::FromData", +"mode": "base", +"seconds": 287, +"model": "qwen3.5-27b", +"set": 5 +}, +{ +"tokens_in": 4217, +"tokens_out": 155, +"steps": 3, +"tools": { +"rename": 1, +"check": 1, +"finish": 1 +}, +"guard": {}, +"left": "", +"passed": true, +"repo": "prometheus", +"task": "rename", +"target": "tsdb::chunkenc::FromData", +"mode": "gitnext", +"seconds": 109, +"model": "qwen3.5-27b", +"set": 5 +}, +{ +"tokens_in": 6100, +"tokens_out": 187, +"steps": 4, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"guard": {}, +"left": "", +"passed": true, +"repo": "prometheus", +"task": "rename", +"target": "tsdb::chunkenc::FromData", +"mode": "lite", +"seconds": 180, +"model": "qwen3.5-27b", +"set": 5 +}, +{ +"tokens_in": 3071, +"tokens_out": 155, +"steps": 3, +"tools": { +"grep": 2, +"finish": 1 +}, +"guard": {}, +"passed": true, +"repo": "prometheus", +"task": "find", +"target": "model::histogram::FloatHistogram::DetectReset", +"mode": "base", +"seconds": 20, +"model": "qwen3.5-27b", +"set": 6 +}, +{ +"tokens_in": 4173, +"tokens_out": 163, +"steps": 3, +"tools": { +"grep": 2, +"finish": 1 +}, +"guard": {}, +"passed": true, +"repo": "prometheus", +"task": "find", +"target": "model::histogram::FloatHistogram::DetectReset", +"mode": "gitnext", +"seconds": 21, +"model": "qwen3.5-27b", +"set": 6 +}, +{ +"tokens_in": 5210, +"tokens_out": 103, +"steps": 2, +"tools": { +"look": 1, +"finish": 1 +}, +"guard": {}, +"gate": { +"nochange": 1 +}, +"passed": true, +"repo": "prometheus", +"task": "find", +"target": "model::histogram::FloatHistogram::DetectReset", +"mode": "lite", +"seconds": 31, +"model": "qwen3.5-27b", +"set": 6 +}, +{ +"tokens_in": 8988, +"tokens_out": 245, +"steps": 3, +"tools": { +"grep": 1, +"read_file": 2 +}, +"guard": {}, +"recall": 1.0, +"passed": true, +"repo": "prometheus", +"task": "callers", +"target": "storage::NewListSeriesIterator", +"mode": "base", +"seconds": 29, +"model": "qwen3.5-27b", +"set": 6 +}, +{ +"tokens_in": 24419, +"tokens_out": 977, +"steps": 7, +"tools": { +"grep": 3, +"read_file": 2, +"look": 1, +"finish": 1 +}, +"guard": {}, +"recall": 1.0, +"passed": true, +"repo": "prometheus", +"task": "callers", +"target": "storage::NewListSeriesIterator", +"mode": "gitnext", +"seconds": 108, +"model": "qwen3.5-27b", +"set": 6 +}, +{ +"tokens_in": 3216, +"tokens_out": 69, +"steps": 1, +"tools": { +"look": 1 +}, +"guard": {}, +"gate": { +"nochange": 1 +}, +"recall": 1.0, +"passed": true, +"repo": "prometheus", +"task": "callers", +"target": "storage::NewListSeriesIterator", +"mode": "lite", +"seconds": 21, +"model": "qwen3.5-27b", +"set": 6 +}, +{ +"tokens_in": 89923, +"tokens_out": 2023, +"steps": 25, +"tools": { +"grep": 1, +"read_file": 13, +"edit_file": 11 +}, +"guard": { +"soft_budget": 1 +}, +"stopped": "steps", +"handoff": "Task: Rename the function `NewProtobufParser` to `NewProtobufParserV2` everywhere in the project (definition and every use). The project must still compile.\nStopped: ran out of steps.\nTried (distinct actions):\n step 11: edit_file {\"new\": \"\\t\\t\\tparser: NewProtobufParserV2(inputBuf.Bytes(), false, false, false, false, labels.NewSymbolTable()),\", \"old\": \"\\t\\t\\\n step 12: read_file {\"end\": 1490, \"path\": \"model/textparse/protobufparse_test.go\", \"start\": 1475}\n step 13: edit_file {\"new\": \"\\t\\t\\tparser: NewProtobufParserV2(inputBuf.Bytes(), false, false, false, true, labels.NewSymbolTable()),\", \"old\": \"\\t\\t\\t\n step 14: read_file {\"end\": 2160, \"path\": \"model/textparse/protobufparse_test.go\", \"start\": 2148}\n step 15: edit_file {\"new\": \"\\t\\t\\tparser: NewProtobufParserV2(inputBuf.Bytes(), false, true, false, false, labels.NewSymbolTable()),\", \"old\": \"\\t\\t\\t\n step 16: read_file {\"end\": 3225, \"path\": \"model/textparse/protobufparse_test.go\", \"start\": 3210}\n step 17: edit_file {\"new\": \"\\t\\t\\tparser: NewProtobufParserV2(inputBuf.Bytes(), true, false, false, false, labels.NewSymbolTable()),\", \"old\": \"\\t\\t\\t\n step 18: read_file {\"end\": 5755, \"path\": \"model/textparse/protobufparse_test.go\", \"start\": 5740}\n step 19: edit_file {\"new\": \"\\t\\t\\tp := NewProtobufParserV2(data, tc.ignoreNative, tc.keepClassic, true, tc.typeAndUnit, labels.NewSymbolTable())\", \"o\n step 20: read_file {\"end\": 5800, \"path\": \"model/textparse/protobufparse_test.go\", \"start\": 5785}\n step 21: edit_file {\"new\": \"\\t\\t\\tp := NewProtobufParserV2(b, false, parseClassicHistogram, false, enableTypeAndUnitLabels, st)\", \"old\": \"\\t\\t\\tp := \n step 22: read_file {\"end\": 5938, \"path\": \"model/textparse/protobufparse_test.go\", \"start\": 5923}\n step 23: edit_file {\"new\": \"\\tp := NewProtobufParserV2(buf.Bytes(), false, false, false, false, labels.NewSymbolTable())\", \"old\": \"\\tp := NewProtobuf\n step 24: read_file {\"end\": 5940, \"path\": \"model/textparse/protobufparse_test.go\", \"start\": 5920}\n step 25: read_file {\"end\": 6012, \"path\": \"model/textparse/protobufparse_test.go\", \"start\": 5996}\nFiles changed so far:\nmodel/textparse/benchmark_test.go | 4 ++--\n model/textparse/interface.go | 2 +-\n model/textparse/protobufparse.go | 4 ++--\n model/textparse/protobufparse_test.go | 12 ++++++------\n 4 files changed, 11 insertions(+), 11 deletions(-)\nNo failing command was seen.", +"left": "model/textparse/protobufparse_test.go:5929:\tp := NewProtobufParser(buf.Bytes(), false, false, false, false, labels.NewSymbolTable())\nmodel/textparse/protobufparse_test.go:6002:\t\t\tp := NewProtobufParse", +"passed": false, +"repo": "prometheus", +"task": "rename", +"target": "model::textparse::NewProtobufParser", +"mode": "base", +"seconds": 255, +"model": "qwen3.5-27b", +"set": 6 +}, +{ +"tokens_in": 6321, +"tokens_out": 234, +"steps": 4, +"tools": { +"rename": 1, +"check": 1, +"run": 1, +"finish": 1 +}, +"guard": {}, +"left": "", +"passed": true, +"repo": "prometheus", +"task": "rename", +"target": "model::textparse::NewProtobufParser", +"mode": "gitnext", +"seconds": 299, +"model": "qwen3.5-27b", +"set": 6 +}, +{ +"tokens_in": 3400, +"tokens_out": 116, +"steps": 3, +"tools": { +"rename": 1, +"check": 1, +"finish": 1 +}, +"guard": {}, +"left": "", +"passed": true, +"repo": "prometheus", +"task": "rename", +"target": "model::textparse::NewProtobufParser", +"mode": "lite", +"seconds": 157, +"model": "qwen3.5-27b", +"set": 6 +}, +{ +"tokens_in": 1526, +"tokens_out": 83, +"steps": 2, +"tools": { +"grep": 1, +"finish": 1 +}, +"guard": {}, +"passed": true, +"repo": "prometheus", +"task": "find", +"target": "promql::evaluator::VectorUnless", +"mode": "base", +"seconds": 11, +"model": "qwen3.5-27b", +"set": 7 +}, +{ +"tokens_in": 2262, +"tokens_out": 83, +"steps": 2, +"tools": { +"grep": 1, +"finish": 1 +}, +"guard": {}, +"passed": true, +"repo": "prometheus", +"task": "find", +"target": "promql::evaluator::VectorUnless", +"mode": "gitnext", +"seconds": 11, +"model": "qwen3.5-27b", +"set": 7 +}, +{ +"tokens_in": 3570, +"tokens_out": 121, +"steps": 3, +"tools": { +"look": 1, +"finish": 2 +}, +"guard": {}, +"gate": { +"nochange": 1 +}, +"passed": true, +"repo": "prometheus", +"task": "find", +"target": "promql::evaluator::VectorUnless", +"mode": "lite", +"seconds": 28, +"model": "qwen3.5-27b", +"set": 7 +}, +{ +"tokens_in": 179911, +"tokens_out": 1372, +"steps": 25, +"tools": { +"grep": 4, +"read_file": 20, +"list_dir": 1 +}, +"guard": { +"soft_budget": 1 +}, +"stopped": "steps", +"handoff": "Task: Which functions or methods call `EngineQueryFunc`? Answer with their names, one per line.\nStopped: ran out of steps.\nTried (distinct actions):\n step 11: grep {\"path\": \"cmd/prometheus/main.go\", \"pattern\": \"func runServer\"}\n step 12: read_file {\"end\": 950, \"path\": \"cmd/prometheus/main.go\", \"start\": 900}\n step 13: read_file {\"end\": 870, \"path\": \"cmd/prometheus/main.go\", \"start\": 830}\n step 14: read_file {\"end\": 800, \"path\": \"cmd/prometheus/main.go\", \"start\": 750}\n step 15: read_file {\"end\": 700, \"path\": \"cmd/prometheus/main.go\", \"start\": 650}\n step 16: read_file {\"end\": 620, \"path\": \"cmd/prometheus/main.go\", \"start\": 580}\n step 17: read_file {\"end\": 540, \"path\": \"cmd/prometheus/main.go\", \"start\": 500}\n step 18: read_file {\"end\": 460, \"path\": \"cmd/prometheus/main.go\", \"start\": 420}\n step 19: read_file {\"end\": 400, \"path\": \"cmd/prometheus/main.go\", \"start\": 360}\n step 20: read_file {\"end\": 270, \"path\": \"cmd/promtool/unittest.go\", \"start\": 245}\n step 21: read_file {\"end\": 220, \"path\": \"cmd/promtool/unittest.go\", \"start\": 180}\n step 22: read_file {\"end\": 175, \"path\": \"cmd/promtool/unittest.go\", \"start\": 130}\n step 23: read_file {\"end\": 130, \"path\": \"cmd/promtool/unittest.go\", \"start\": 80}\n step 24: read_file {\"end\": 280, \"path\": \"web/api/v1/query.go\", \"start\": 250}\n step 25: list_dir {\"path\": \"web/api/v1\"}\nNo file was changed.\nNo failing command was seen.", +"recall": 0.0, +"passed": false, +"repo": "prometheus", +"task": "callers", +"target": "rules::EngineQueryFunc", +"mode": "base", +"seconds": 223, +"model": "qwen3.5-27b", +"set": 7 +}, +{ +"tokens_in": 51038, +"tokens_out": 853, +"steps": 11, +"tools": { +"grep": 4, +"look": 1, +"read_file": 5, +"finish": 1 +}, +"guard": {}, +"recall": 1.0, +"passed": true, +"repo": "prometheus", +"task": "callers", +"target": "rules::EngineQueryFunc", +"mode": "gitnext", +"seconds": 111, +"model": "qwen3.5-27b", +"set": 7 +}, +{ +"tokens_in": 21851, +"tokens_out": 710, +"steps": 6, +"tools": { +"look": 5, +"finish": 1 +}, +"guard": {}, +"gate": { +"nochange": 1 +}, +"recall": 1.0, +"passed": true, +"repo": "prometheus", +"task": "callers", +"target": "rules::EngineQueryFunc", +"mode": "lite", +"seconds": 112, +"model": "qwen3.5-27b", +"set": 7 +}, +{ +"tokens_in": 204665, +"tokens_out": 2221, +"steps": 25, +"tools": { +"grep": 1, +"read_file": 7, +"edit_file": 8, +"run": 9 +}, +"guard": { +"repeats": 4, +"soft_budget": 1 +}, +"stopped": "steps", +"handoff": "Task: Rename the function `IsolationDisabled` to `IsolationDisabledV2` everywhere in the project (definition and every use). The project must still compile.\nStopped: ran out of steps.\nTried (distinct actions):\n step 7: edit_file {\"new\": \"func (i *isolationState) IsolationDisabledV2() bool {\\n\\treturn i.isolation.disabled\\n}\", \"old\": \"func (i *isolationState\n step 8: edit_file {\"new\": \"\\t// defaultIsolationDisabledV2 is true if isolation is disabled by default.\\n\\tdefaultIsolationDisabledV2 = false\", \"old\n step 9: edit_file {\"new\": \"\\tIsolationDisabledV2 bool\", \"old\": \"\\tIsolationDisabled bool\", \"path\": \"tsdb/head.go\"}\n step 10: edit_file {\"new\": \"\\t\\t\\tIsolationDisabledV2: defaultIsolationDisabledV2,\", \"old\": \"\\t\\t\\tIsolationDisabled: defaultIsolationDisabled,\n step 11: read_file {\"end\": 295, \"path\": \"tsdb/head.go\", \"start\": 280}\n step 13: run {\"command\": \"grep -n \\\"IsolationDisabled\\\" tsdb/head.go | head -20\"}\n step 15: run {\"command\": \"sed -n '284p' tsdb/head.go | cat -A\"}\n step 17: read_file {\"end\": 284, \"path\": \"tsdb/head.go\", \"start\": 284}\n step 19: run {\"command\": \"sed -i 's/IsolationDisabled:/IsolationDisabledV2:/g' tsdb/head.go && sed -i 's/defaultIsolationDisabled,/defaultIsolationDi\n step 20: run {\"command\": \"sed -i 's/h\\\\.opts\\\\.IsolationDisabled/h.opts.IsolationDisabledV2/g' tsdb/head.go\"}\n step 21: run {\"command\": \"sed -i 's/NewRangeHeadWithIsolationDisabled/NewRangeHeadWithIsolationDisabledV2/g' tsdb/head.go\"}\n step 22: run {\"command\": \"sed -i 's/IsolationDisabled:/IsolationDisabledV2:/g' tsdb/db.go && sed -i 's/defaultIsolationDisabled,/defaultIsolationDisa\n step 23: run {\"command\": \"sed -i 's/IsolationDisabled()/IsolationDisabledV2()/g' tsdb/head_read.go\"}\n step 24: run {\"command\": \"sed -i 's/defaultIsolationDisabled/defaultIsolationDisabledV2/g' tsdb/db_test.go && sed -i 's/opts\\\\.IsolationDisabled/opts\n step 25: run {\"command\": \"sed -i 's/defaultIsolationDisabled/defaultIsolationDisabledV2/g' tsdb/head_append_v2_test.go && sed -i 's/defaultIsolationD\nFiles changed so far:\ntsdb/db.go | 12 ++++++------\n tsdb/db_append_v2_test.go | 4 ++--\n tsdb/db_test.go | 6 +++---\n tsdb/head.go | 16 ++++++++--------\n tsdb/head_append_v2_test.go | 8 ++++----\n tsdb/head_read.go | 6 +++---\n tsdb/head_test.go | 24 ++++++++++++------------\n tsdb/isolation.go | 2 +-\n 8 files changed, 39 insertions(+), 39 deletions(-)\nNo failing command was seen.", +"left": "storage/remote/read_handler_test.go:1227:\t\t\t\t\topts.IsolationDisabled = tc.isolationDisabled\ntsdb/db.go:196:\tIsolationDisabled bool\ntsdb/head_read_test.go:497:\topts.IsolationDisabled = false", +"passed": false, +"repo": "prometheus", +"task": "rename", +"target": "tsdb::isolationState::IsolationDisabled", +"mode": "base", +"seconds": 284, +"model": "qwen3.5-27b", +"set": 7 +}, +{ +"tokens_in": 11124, +"tokens_out": 544, +"steps": 6, +"tools": { +"rename": 1, +"look": 1, +"run": 1, +"grep": 2, +"finish": 1 +}, +"guard": {}, +"left": "storage/remote/read_handler_test.go:1227:\t\t\t\t\topts.IsolationDisabled = tc.isolationDisabled\ntsdb/db.go:95:\t\tIsolationDisabled: defaultIsolationDisabled,\ntsdb/db.go:196:\tIsolationDisabled boo", +"passed": false, +"repo": "prometheus", +"task": "rename", +"target": "tsdb::isolationState::IsolationDisabled", +"mode": "gitnext", +"seconds": 114, +"model": "qwen3.5-27b", +"set": 7 +}, +{ +"tokens_in": 13084, +"tokens_out": 788, +"steps": 7, +"tools": { +"rename": 1, +"look": 3, +"check": 2, +"finish": 1 +}, +"guard": { +"repeats": 1 +}, +"left": "storage/remote/read_handler_test.go:1227:\t\t\t\t\topts.IsolationDisabled = tc.isolationDisabled\ntsdb/db.go:95:\t\tIsolationDisabled: defaultIsolationDisabled,\ntsdb/db.go:196:\tIsolationDisabled boo", +"passed": false, +"repo": "prometheus", +"task": "rename", +"target": "tsdb::isolationState::IsolationDisabled", +"mode": "lite", +"seconds": 233, +"model": "qwen3.5-27b", +"set": 7 +}, +{ +"tokens_in": 1591, +"tokens_out": 98, +"steps": 2, +"tools": { +"grep": 1, +"finish": 1 +}, +"guard": {}, +"passed": true, +"repo": "prometheus", +"task": "find", +"target": "util::fuzzing::GetCorpusForFuzzXOR2Chunk", +"mode": "base", +"seconds": 12, +"model": "qwen3.5-27b", +"set": 8 +}, +{ +"tokens_in": 2327, +"tokens_out": 98, +"steps": 2, +"tools": { +"grep": 1, +"finish": 1 +}, +"guard": {}, +"passed": true, +"repo": "prometheus", +"task": "find", +"target": "util::fuzzing::GetCorpusForFuzzXOR2Chunk", +"mode": "gitnext", +"seconds": 13, +"model": "qwen3.5-27b", +"set": 8 +}, +{ +"tokens_in": 3577, +"tokens_out": 97, +"steps": 1, +"tools": { +"look": 1 +}, +"guard": {}, +"gate": { +"nochange": 1 +}, +"passed": true, +"repo": "prometheus", +"task": "find", +"target": "util::fuzzing::GetCorpusForFuzzXOR2Chunk", +"mode": "lite", +"seconds": 26, +"model": "qwen3.5-27b", +"set": 8 +}, +{ +"tokens_in": 6182, +"tokens_out": 336, +"steps": 5, +"tools": { +"grep": 1, +"read_file": 3, +"finish": 1 +}, +"guard": {}, +"recall": 1.0, +"passed": true, +"repo": "prometheus", +"task": "callers", +"target": "tsdb::NewExemplarMetrics", +"mode": "base", +"seconds": 33, +"model": "qwen3.5-27b", +"set": 8 +}, +{ +"tokens_in": 12606, +"tokens_out": 483, +"steps": 6, +"tools": { +"grep": 1, +"look": 1, +"read_file": 3, +"finish": 1 +}, +"guard": {}, +"recall": 1.0, +"passed": true, +"repo": "prometheus", +"task": "callers", +"target": "tsdb::NewExemplarMetrics", +"mode": "gitnext", +"seconds": 59, +"model": "qwen3.5-27b", +"set": 8 +}, +{ +"tokens_in": 7957, +"tokens_out": 168, +"steps": 3, +"tools": { +"look": 2, +"finish": 1 +}, +"guard": {}, +"gate": { +"nochange": 1 +}, +"recall": 1.0, +"passed": true, +"repo": "prometheus", +"task": "callers", +"target": "tsdb::NewExemplarMetrics", +"mode": "lite", +"seconds": 49, +"model": "qwen3.5-27b", +"set": 8 +}, +{ +"tokens_in": 11530, +"tokens_out": 683, +"steps": 9, +"tools": { +"grep": 2, +"read_file": 2, +"edit_file": 2, +"run": 2, +"finish": 1 +}, +"guard": {}, +"left": "", +"passed": true, +"repo": "prometheus", +"task": "rename", +"target": "scrape::ContextWithTarget", +"mode": "base", +"seconds": 136, +"model": "qwen3.5-27b", +"set": 8 +}, +{ +"tokens_in": 5168, +"tokens_out": 237, +"steps": 4, +"tools": { +"rename": 1, +"check": 1, +"run": 1, +"finish": 1 +}, +"guard": {}, +"left": "", +"passed": true, +"repo": "prometheus", +"task": "rename", +"target": "scrape::ContextWithTarget", +"mode": "gitnext", +"seconds": 141, +"model": "qwen3.5-27b", +"set": 8 +}, +{ +"tokens_in": 2898, +"tokens_out": 117, +"steps": 3, +"tools": { +"rename": 1, +"check": 1, +"finish": 1 +}, +"guard": {}, +"left": "", +"passed": true, +"repo": "prometheus", +"task": "rename", +"target": "scrape::ContextWithTarget", +"mode": "lite", +"seconds": 150, +"model": "qwen3.5-27b", +"set": 8 +}, +{ +"tokens_in": 1505, +"tokens_out": 85, +"steps": 2, +"tools": { +"grep": 1, +"finish": 1 +}, +"guard": {}, +"passed": true, +"repo": "prometheus", +"task": "find", +"target": "tsdb::wlog::NewSegmentBufReader", +"mode": "base", +"seconds": 11, +"model": "qwen3.5-27b", +"set": 9 +}, +{ +"tokens_in": 2241, +"tokens_out": 85, +"steps": 2, +"tools": { +"grep": 1, +"finish": 1 +}, +"guard": {}, +"passed": true, +"repo": "prometheus", +"task": "find", +"target": "tsdb::wlog::NewSegmentBufReader", +"mode": "gitnext", +"seconds": 11, +"model": "qwen3.5-27b", +"set": 9 +}, +{ +"tokens_in": 3596, +"tokens_out": 139, +"steps": 3, +"tools": { +"look": 1, +"finish": 2 +}, +"guard": {}, +"gate": { +"nochange": 1 +}, +"passed": true, +"repo": "prometheus", +"task": "find", +"target": "tsdb::wlog::NewSegmentBufReader", +"mode": "lite", +"seconds": 29, +"model": "qwen3.5-27b", +"set": 9 +}, +{ +"tokens_in": 4724, +"tokens_out": 449, +"steps": 4, +"tools": { +"grep": 1, +"read_file": 2, +"finish": 1 +}, +"guard": {}, +"recall": 0.5, +"passed": false, +"repo": "prometheus", +"task": "callers", +"target": "tsdb::record::Encoder::EncodeExemplarsIntoBuffer", +"mode": "base", +"seconds": 43, +"model": "qwen3.5-27b", +"set": 9 +}, +{ +"tokens_in": 4118, +"tokens_out": 151, +"steps": 3, +"tools": { +"grep": 1, +"look": 1, +"finish": 1 +}, +"guard": {}, +"recall": 1.0, +"passed": true, +"repo": "prometheus", +"task": "callers", +"target": "tsdb::record::Encoder::EncodeExemplarsIntoBuffer", +"mode": "gitnext", +"seconds": 29, +"model": "qwen3.5-27b", +"set": 9 +}, +{ +"tokens_in": 3708, +"tokens_out": 111, +"steps": 2, +"tools": { +"look": 1, +"finish": 1 +}, +"guard": {}, +"gate": { +"nochange": 1 +}, +"recall": 1.0, +"passed": true, +"repo": "prometheus", +"task": "callers", +"target": "tsdb::record::Encoder::EncodeExemplarsIntoBuffer", +"mode": "lite", +"seconds": 26, +"model": "qwen3.5-27b", +"set": 9 +}, +{ +"tokens_in": 99792, +"tokens_out": 3553, +"steps": 25, +"tools": { +"grep": 1, +"read_file": 4, +"edit_file": 17, +"run": 3 +}, +"guard": { +"repeats": 3, +"soft_budget": 1 +}, +"stopped": "steps", +"handoff": "Task: Rename the function `IsZeroHandle` to `IsZeroHandleV2` everywhere in the project (definition and every use). The project must still compile.\nStopped: ran out of steps.\nTried (distinct actions):\n step 8: edit_file {\"new\": \"\\t\\t\\t\\trequire.False(t, metadata.IsZeroHandleV2(s100.meta))\", \"old\": \"\\t\\t\\t\\trequire.False(t, metadata.IsZeroHandle(s10\n step 9: edit_file {\"new\": \"\\trequire.True(t, metadata.IsZeroHandleV2(series4.meta))\", \"old\": \"\\trequire.True(t, metadata.IsZeroHandle(series4.meta))\n step 10: edit_file {\"new\": \"\\thasNewMetadata := metadata.IsZeroHandleV2(s.meta) || s.meta.Value() != meta\", \"old\": \"\\thasNewMetadata := metadata.IsZe\n step 11: edit_file {\"new\": \"\\t\\trequire.True(t, metadata.IsZeroHandleV2(memS.Metadata()))\", \"old\": \"\\t\\trequire.True(t, metadata.IsZeroHandle(memS.Me\n step 12: edit_file {\"new\": \"\\t\\tif !metadata.IsZeroHandleV2(g.Metadata()) {\", \"old\": \"\\t\\tif !metadata.IsZeroHandle(g.Metadata()) {\", \"path\": \"tsdb/a\n step 13: edit_file {\"new\": \"\\t\\t\\tif mh := sm.Metadata(); !metadata.IsZeroHandleV2(mh) {\", \"old\": \"\\t\\t\\tif mh := sm.Metadata(); !metadata.IsZeroHand\n step 14: read_file {\"end\": 290, \"path\": \"tsdb/agent/checkpoint.go\", \"start\": 230}\n step 15: edit_file {\"new\": \"\\t\\t\\tif sm, ok := series.(ActiveSeriesWithMetadata); ok {\\n\\t\\t\\t\\tif mh := sm.Metadata(); !metadata.IsZeroHandleV2(mh) \n step 16: read_file {\"end\": 250, \"path\": \"tsdb/agent/checkpoint.go\", \"start\": 234}\n step 19: edit_file {\"new\": \"\\t\\t\\tif sm, ok := series.(ActiveSeriesWithMetadata); ok {\\n\\t\\t\\t\\tif mh := sm.Metadata(); !metadata.IsZeroHandleV2(mh) \n step 20: run {\"command\": \"sed -n '235,246p' tsdb/agent/checkpoint.go | cat -A\"}\n step 21: edit_file {\"new\": \"\\t\\tif mh := sm.Metadata(); !metadata.IsZeroHandleV2(mh) {\\n\\t\\t\\t\\t\\tif m := mh.Value(); !m.IsEmpty() {\\n\\t\\t\\t\\t\\t\\tcf.\n step 23: edit_file {\"new\": \"\\t\\t\\t\\tif mh := sm.Metadata(); !metadata.IsZeroHandleV2(mh) {\\n\\t\\t\\t\\t\\tif m := mh.Value(); !m.IsEmpty() {\\n\\t\\t\\t\\t\\t\\\n step 24: run {\"command\": \"sed -i 's/metadata\\\\.IsZeroHandle(/metadata.IsZeroHandleV2(/g' tsdb/agent/checkpoint.go\"}\n step 25: run {\"command\": \"sed -i 's/metadata\\\\.IsZeroHandle(/metadata.IsZeroHandleV2(/g' tsdb/agent/db_append_v2.go tsdb/agent/db.go tsdb/agent/db_ap\nFiles changed so far:\nmodel/metadata/metadata.go | 4 ++--\n scrape/scrape.go | 2 +-\n scrape/scrape_append_v2.go | 4 ++--\n storage/remote/queue_manager.go | 4 ++--\n tsdb/agent/checkpoint.go | 4 ++--\n tsdb/agent/checkpoint_test.go | 2 +-\n tsdb/agent/db.go | 4 ++--\n tsdb/agent/db_append_v2.go | 2 +-\n tsdb/agent/db_append_v2_test.go | 2 +-\n tsdb/agent/db_test.go | 2 +-\n tsdb/db_append_v2_test.go | 2 +-\n tsdb/head_append.go | 2 +-\n tsdb/head_append_v2.go | 2 +-\n tsdb/head_test.go | 2 +-\n 14 files changed, 19 insertions(+), 19 deletions(-)\nNo failing command was seen.", +"left": "model/metadata/metadata_test.go:26:\trequire.True(t, IsZeroHandle(h))\nmodel/metadata/metadata_test.go:27:\trequire.False(t, IsZeroHandle(unique.Make(Metadata{Type: model.MetricTypeCounter})))", +"passed": false, +"repo": "prometheus", +"task": "rename", +"target": "model::metadata::IsZeroHandle", +"mode": "base", +"seconds": 382, +"model": "qwen3.5-27b", +"set": 9 +}, +{ +"tokens_in": 4374, +"tokens_out": 160, +"steps": 3, +"tools": { +"rename": 1, +"check": 1, +"finish": 1 +}, +"guard": {}, +"left": "", +"passed": true, +"repo": "prometheus", +"task": "rename", +"target": "model::metadata::IsZeroHandle", +"mode": "gitnext", +"seconds": 111, +"model": "qwen3.5-27b", +"set": 9 +}, +{ +"tokens_in": 3662, +"tokens_out": 195, +"steps": 3, +"tools": { +"rename": 1, +"check": 1, +"finish": 1 +}, +"guard": {}, +"left": "", +"passed": true, +"repo": "prometheus", +"task": "rename", +"target": "model::metadata::IsZeroHandle", +"mode": "lite", +"seconds": 169, +"model": "qwen3.5-27b", +"set": 9 +}, +{ +"tokens_in": 1586, +"tokens_out": 76, +"steps": 2, +"tools": { +"grep": 1, +"finish": 1 +}, +"guard": {}, +"passed": true, +"repo": "prometheus", +"task": "find", +"target": "tsdb::index::NewSymbols", +"mode": "base", +"seconds": 3, +"model": "qwen3.5-4b", +"set": 0 +}, +{ +"tokens_in": 2322, +"tokens_out": 46, +"steps": 1, +"tools": { +"grep": 1 +}, +"guard": {}, +"passed": true, +"repo": "prometheus", +"task": "find", +"target": "tsdb::index::NewSymbols", +"mode": "gitnext", +"seconds": 2, +"model": "qwen3.5-4b", +"set": 0 +}, +{ +"tokens_in": 3660, +"tokens_out": 125, +"steps": 3, +"tools": { +"look": 1, +"finish": 2 +}, +"guard": {}, +"gate": { +"nochange": 1 +}, +"passed": true, +"repo": "prometheus", +"task": "find", +"target": "tsdb::index::NewSymbols", +"mode": "lite", +"seconds": 16, +"model": "qwen3.5-4b", +"set": 0 +}, +{ +"tokens_in": 20371, +"tokens_out": 853, +"steps": 8, +"tools": { +"grep": 2, +"read_file": 5, +"finish": 1 +}, +"guard": {}, +"recall": 0.6666666666666666, +"passed": false, +"repo": "prometheus", +"task": "callers", +"target": "model::textparse::NewOpenMetricsParser", +"mode": "base", +"seconds": 21, +"model": "qwen3.5-4b", +"set": 0 +}, +{ +"tokens_in": 13502, +"tokens_out": 415, +"steps": 5, +"tools": { +"grep": 1, +"look": 1, +"read_file": 3 +}, +"guard": {}, +"recall": 1.0, +"passed": true, +"repo": "prometheus", +"task": "callers", +"target": "model::textparse::NewOpenMetricsParser", +"mode": "gitnext", +"seconds": 23, +"model": "qwen3.5-4b", +"set": 0 +}, +{ +"tokens_in": 3562, +"tokens_out": 122, +"steps": 1, +"tools": { +"look": 1 +}, +"guard": {}, +"gate": { +"nochange": 1 +}, +"recall": 1.0, +"passed": true, +"repo": "prometheus", +"task": "callers", +"target": "model::textparse::NewOpenMetricsParser", +"mode": "lite", +"seconds": 15, +"model": "qwen3.5-4b", +"set": 0 +}, +{ +"tokens_in": 29232, +"tokens_out": 802, +"steps": 11, +"tools": { +"grep": 4, +"read_file": 1, +"edit_file": 3, +"run": 2, +"finish": 1 +}, +"guard": {}, +"left": "cmd/prometheus/query_log_test.go:384:\trequire.NoError(t, os.Rename(queryLogFile.Name(), newFile.Name()))\ndiscovery/file/file_test.go:95:// an open handle on dst (which would make os.Rename fail on Win", +"passed": false, +"repo": "prometheus", +"task": "rename", +"target": "tsdb::fileutil::Rename", +"mode": "base", +"seconds": 161, +"model": "qwen3.5-4b", +"set": 0 +}, +{ +"tokens_in": 34574, +"tokens_out": 783, +"steps": 12, +"tools": { +"look": 1, +"grep": 1, +"replace_symbol": 2, +"check": 3, +"read_file": 2, +"edit_file": 2, +"finish": 1 +}, +"guard": {}, +"left": "cmd/prometheus/query_log_test.go:384:\trequire.NoError(t, os.Rename(queryLogFile.Name(), newFile.Name()))\ndiscovery/file/file_test.go:95:// an open handle on dst (which would make os.Rename fail on Win", +"passed": false, +"repo": "prometheus", +"task": "rename", +"target": "tsdb::fileutil::Rename", +"mode": "gitnext", +"seconds": 195, +"model": "qwen3.5-4b", +"set": 0 +}, +{ +"tokens_in": 3940, +"tokens_out": 135, +"steps": 3, +"tools": { +"rename": 1, +"check": 1, +"finish": 1 +}, +"guard": {}, +"left": "cmd/prometheus/query_log_test.go:384:\trequire.NoError(t, os.Rename(queryLogFile.Name(), newFile.Name()))\ndiscovery/file/file_test.go:115:\t\terr = os.Rename(tmp.Name(), dst)\ndocumentation/examples/custo", +"passed": false, +"repo": "prometheus", +"task": "rename", +"target": "tsdb::fileutil::Rename", +"mode": "lite", +"seconds": 145, +"model": "qwen3.5-4b", +"set": 0 +}, +{ +"tokens_in": 1625, +"tokens_out": 82, +"steps": 2, +"tools": { +"grep": 1, +"finish": 1 +}, +"guard": {}, +"passed": true, +"repo": "prometheus", +"task": "find", +"target": "tsdb::chunks::WithSegmentSize", +"mode": "base", +"seconds": 3, +"model": "qwen3.5-4b", +"set": 1 +}, +{ +"tokens_in": 2361, +"tokens_out": 50, +"steps": 1, +"tools": { +"grep": 1 +}, +"guard": {}, +"passed": true, +"repo": "prometheus", +"task": "find", +"target": "tsdb::chunks::WithSegmentSize", +"mode": "gitnext", +"seconds": 2, +"model": "qwen3.5-4b", +"set": 1 +}, +{ +"tokens_in": 3404, +"tokens_out": 136, +"steps": 3, +"tools": { +"look": 1, +"finish": 2 +}, +"guard": {}, +"gate": { +"nochange": 1 +}, +"passed": true, +"repo": "prometheus", +"task": "find", +"target": "tsdb::chunks::WithSegmentSize", +"mode": "lite", +"seconds": 16, +"model": "qwen3.5-4b", +"set": 1 +}, +{ +"tokens_in": 52173, +"tokens_out": 1597, +"steps": 12, +"tools": { +"grep": 4, +"read_file": 7, +"finish": 1 +}, +"guard": {}, +"recall": 1.0, +"passed": true, +"repo": "prometheus", +"task": "callers", +"target": "tsdb::OverlappingBlocks", +"mode": "base", +"seconds": 44, +"model": "qwen3.5-4b", +"set": 1 +}, +{ +"tokens_in": 2992, +"tokens_out": 85, +"steps": 1, +"tools": { +"look": 1 +}, +"guard": {}, +"recall": 1.0, +"passed": true, +"repo": "prometheus", +"task": "callers", +"target": "tsdb::OverlappingBlocks", +"mode": "gitnext", +"seconds": 14, +"model": "qwen3.5-4b", +"set": 1 +}, +{ +"tokens_in": 4294, +"tokens_out": 134, +"steps": 2, +"tools": { +"look": 1, +"finish": 1 +}, +"guard": {}, +"gate": { +"nochange": 1 +}, +"recall": 1.0, +"passed": true, +"repo": "prometheus", +"task": "callers", +"target": "tsdb::OverlappingBlocks", +"mode": "lite", +"seconds": 16, +"model": "qwen3.5-4b", +"set": 1 +}, +{ +"tokens_in": 135710, +"tokens_out": 2799, +"steps": 25, +"tools": { +"grep": 3, +"read_file": 11, +"edit_file": 11 +}, +"guard": { +"repeats": 2, +"soft_budget": 1 +}, +"stopped": "steps", +"handoff": "Task: Rename the function `AsErrors` to `AsErrorsV2` everywhere in the project (definition and every use). The project must still compile.\nStopped: ran out of steps.\nTried (distinct actions):\n step 9: edit_file {\"new\": \"\\t\\t\\trs := merged.(Searcher).SearchLabelNames(ctx, nil)\\n\\t\\t\\tgot := collectSearchResults(t, rs)\\n\\t\\t\\trequire.Equal(t\n step 10: read_file {\"end\": 1972, \"path\": \"storage/merge_test.go\", \"start\": 1958}\n step 11: edit_file {\"new\": \"\\t\\t\\trs := merged.(Searcher).SearchLabelNames(ctx, nil)\\n\\t\\t\\tfor rs.Next() {\\n\\t\\t\\t}\\n\\t\\t\\trequire.NoError(t, rs.Err\n step 12: read_file {\"end\": 1946, \"path\": \"storage/merge_test.go\", \"start\": 1938}\n step 13: edit_file {\"new\": \"\\t\\t\\tgot := collectSearchResults(t, rs)\\n\\t\\t\\trequire.Equal(t, []SearchResult{{Value: \\\"env\\\", Score: 1.0}}, got)\\n\\t\\t\n step 14: read_file {\"end\": 1943, \"path\": \"storage/merge_test.go\", \"start\": 1942}\n step 15: edit_file {\"new\": \"\\twarnings := rs.Warnings().AsErrorsV2()\", \"old\": \"\\twarnings := rs.Warnings().AsErrors()\", \"path\": \"storage/merge_test.g\n step 16: read_file {\"end\": 1948, \"path\": \"storage/merge_test.go\", \"start\": 1935}\n step 17: read_file {\"end\": 1970, \"path\": \"storage/merge_test.go\", \"start\": 1956}\n step 18: read_file {\"end\": 2015, \"path\": \"storage/merge_test.go\", \"start\": 2000}\n step 19: edit_file {\"new\": \"\\t\\t\\trs := merged.(Searcher).SearchLabelNames(ctx, nil)\\n\\t\\t\\tfor rs.Next() {\\n\\t\\t\\t}\\n\\t\\t\\trequire.NoError(t, rs.Err\n step 20: read_file {\"end\": 1970, \"path\": \"storage/merge_test.go\", \"start\": 1950}\n step 21: edit_file {\"new\": \"\\t\\t\\tsecondary := &partialErrSearchQuerier{\\n\\t\\t\\t\\tnames: []SearchResult{{Value: \\\"zone\\\", Score: 0.5}},\\n\\t\\t\\t\\terr:\n step 22: read_file {\"end\": 1968, \"path\": \"storage/merge_test.go\", \"start\": 1958}\n step 24: grep {\"path\": \"storage/merge_test.go\", \"pattern\": \"partial secondary failure\\\"\"}\nFiles changed so far:\nstorage/generic_test.go | 2 +-\n storage/remote/read_test.go | 2 +-\n util/annotations/annotations.go | 4 ++--\n 3 files changed, 4 insertions(+), 4 deletions(-)\nNo failing command was seen.", +"left": "cmd/promtool/tsdb.go:755:\t\treturn errors.Join(ws.AsErrors()...)\npromql/estimate_resource_test.go:73:\t\t\trequire.Len(t, annos.AsErrors(), 1, \"fallback warning is deduplicated\")\npromql/estimate_resource_", +"passed": false, +"repo": "prometheus", +"task": "rename", +"target": "util::annotations::Annotations::AsErrors", +"mode": "base", +"seconds": 131, +"model": "qwen3.5-4b", +"set": 1 +}, +{ +"tokens_in": 122980, +"tokens_out": 1989, +"steps": 25, +"tools": { +"look": 1, +"grep": 3, +"replace_symbol": 1, +"check": 1, +"edit_file": 9, +"read_file": 10 +}, +"guard": { +"repeats": 3, +"soft_budget": 1 +}, +"stopped": "steps", +"handoff": "Task: Rename the function `AsErrors` to `AsErrorsV2` everywhere in the project (definition and every use). The project must still compile.\nStopped: ran out of steps.\nTried (distinct actions):\n step 8: edit_file {\"new\": \"\\tgotWarnings := rs.Warnings().AsErrorsV2()\", \"old\": \"\\tgotWarnings := rs.Warnings().AsErrors()\", \"path\": \"storage/generi\n step 9: edit_file {\"new\": \"\\t\\t\\t\\t\\t\\t\\twarnings := rs.Warnings().AsErrorsV2()\", \"old\": \"\\t\\t\\t\\t\\t\\t\\twarnings := rs.Warnings().AsErrors()\", \"path\n step 10: edit_file {\"new\": \"\\t\\twarnings := rs.Warnings().AsErrorsV2()\", \"old\": \"\\t\\twarnings := rs.Warnings().AsErrors()\", \"path\": \"storage/merge_te\n step 11: grep {\"path\": \"storage/merge_test.go\", \"pattern\": \"AsErrors\\\\(\\\\)\"}\n step 12: read_file {\"end\": 1950, \"path\": \"storage/merge_test.go\", \"start\": 1940}\n step 14: read_file {\"path\": \"storage/merge_test.go\"}\n step 16: read_file {\"end\": 1970, \"path\": \"storage/merge_test.go\", \"start\": 1960}\n step 17: read_file {\"end\": 2013, \"path\": \"storage/merge_test.go\", \"start\": 2003}\n step 18: read_file {\"end\": 2202, \"path\": \"storage/merge_test.go\", \"start\": 2192}\n step 19: read_file {\"end\": 2248, \"path\": \"storage/merge_test.go\", \"start\": 2238}\n step 20: read_file {\"end\": 2296, \"path\": \"storage/merge_test.go\", \"start\": 2286}\n step 21: edit_file {\"new\": \"\\t\\t\\twarnings := rs.Warnings().AsErrorsV2()\", \"old\": \"\\t\\t\\twarnings := rs.Warnings().AsErrors()\", \"path\": \"storage/merg\n step 23: edit_file {\"new\": \"\\t\\t\\tgot := collectSearchResults(t, rs)\\n\\t\\t\\trequire.Equal(t, []SearchResult{{Value: \\\"env\\\", Score: 1.0}}, got)\\n\\t\\t\n step 24: grep {\"pattern\": \"AsErrors\\\\(\\\\)\"}\n step 25: read_file {\"end\": 1950, \"path\": \"storage/merge_test.go\", \"start\": 1938}\nFiles changed so far:\ncmd/promtool/tsdb.go | 2 +-\n promql/promqltest/test.go | 4 ++--\n storage/generic_test.go | 2 +-\n storage/remote/read_test.go | 2 +-\n util/annotations/annotations.go | 4 ++--\n 5 files changed, 7 insertions(+), 7 deletions(-)\nLast error: build FAILED N.Ns go build ./... && go test -count=N -run '^$' ./... >/dev/null | \u2717 error promql/promqltest/test.go:N (\u00d7N) | annos.AsErrors undefined (type annotations.Annotations has no field or method AsErrors)", +"left": "promql/estimate_resource_test.go:73:\t\t\trequire.Len(t, annos.AsErrors(), 1, \"fallback warning is deduplicated\")\npromql/estimate_resource_test.go:74:\t\t\trequire.Contains(t, annos.AsErrors()[0].Error(), \"", +"passed": false, +"repo": "prometheus", +"task": "rename", +"target": "util::annotations::Annotations::AsErrors", +"mode": "gitnext", +"seconds": 156, +"model": "qwen3.5-4b", +"set": 1 +}, +{ +"tokens_in": 96343, +"tokens_out": 1844, +"steps": 25, +"tools": { +"look": 9, +"rename": 1, +"check": 1, +"replace": 6, +"add_after": 8 +}, +"guard": { +"repeats": 8, +"soft_budget": 1 +}, +"stopped": "steps", +"handoff": "Task: Rename the function `AsErrors` to `AsErrorsV2` everywhere in the project (definition and every use). The project must still compile.\nStopped: ran out of steps.\nTried (distinct actions):\n step 3: check {}\n step 4: look {\"what\": \"storage/generic_test.go:257\"}\n step 5: replace {\"code\": \"gotWarnings := rs.Warnings().AsErrorsV2()\", \"symbol\": \"gotWarnings := rs.Warnings().AsErrors()\"}\n step 6: add_after {\"code\": \"\\n\\t// Warnings still reflect the upstream payload after iteration ended.\\n\\tgotWarnings := rs.Warnings().AsErrorsV2()\\n\n step 7: look {\"what\": \"storage/generic_test.go\"}\n step 8: look {\"what\": \"storage/generic_test.go:257-260\"}\n step 10: look {\"what\": \"storage/generic_test.go:256-261\"}\n step 11: add_after {\"code\": \"\\tgotWarnings := rs.Warnings().AsErrorsV2()\\n\\trequire.Len(t, gotWarnings, 1)\\n\\trequire.Contains(t, gotWarnings[0].Erro\n step 14: replace {\"code\": \"rs.Warnings().AsErrorsV2()\", \"symbol\": \"rs.Warnings().AsErrors()\"}\n step 15: look {\"what\": \"storage/generic_test.go AsErrors\"}\n step 16: look {\"what\": \"storage/generic_test.go:231-262\"}\n step 18: replace {\"code\": \"gotWarnings := rs.Warnings().AsErrorsV2()\", \"symbol\": \"storage/generic_test.go:257-257 gotWarnings := rs.Warnings().AsErro\n step 19: add_after {\"code\": \"\\n\\tgotWarnings := rs.Warnings().AsErrorsV2()\\n\\trequire.Len(t, gotWarnings, 1)\\n\\trequire.Contains(t, gotWarnings[0].Er\n step 20: look {\"what\": \"storage/generic_test.go:256-258\"}\n step 23: replace {\"code\": \"\\t\\tgotWarnings := rs.Warnings().AsErrorsV2()\", \"symbol\": \"\\t\\tgotWarnings := rs.Warnings().AsErrors()\"}\nFiles changed so far:\ncmd/promtool/tsdb.go | 2 +-\n promql/estimate_resource_test.go | 8 ++++----\n promql/estimate_test.go | 8 ++++----\n promql/promqltest/test.go | 4 ++--\n promql/query_cost_duration_test.go | 4 ++--\n storage/fanout_test.go | 6 +++---\n storage/merge_test.go | 12 ++++++------\n storage/remote/read_test.go | 2 +-\n util/annotations/annotations.go | 4 ++--\n web/api/v1/api_test.go | 4 ++--\n 10 files changed, 27 insertions(+), 27 deletions(-)\nLast error: build FAILED N.Ns go build ./... && go test -count=N -run '^$' ./... >/dev/null | build: N error | \u2717 error storage/generic_test.go:N", +"left": "storage/generic_test.go:257:\tgotWarnings := rs.Warnings().AsErrors()", +"passed": false, +"repo": "prometheus", +"task": "rename", +"target": "util::annotations::Annotations::AsErrors", +"mode": "lite", +"seconds": 208, +"model": "qwen3.5-4b", +"set": 1 +}, +{ +"tokens_in": 1509, +"tokens_out": 88, +"steps": 2, +"tools": { +"grep": 1, +"finish": 1 +}, +"guard": {}, +"passed": true, +"repo": "prometheus", +"task": "find", +"target": "util::annotations::NewNativeHistogramFractionNaNsInfo", +"mode": "base", +"seconds": 3, +"model": "qwen3.5-4b", +"set": 10 +}, +{ +"tokens_in": 2245, +"tokens_out": 57, +"steps": 1, +"tools": { +"grep": 1 +}, +"guard": {}, +"passed": true, +"repo": "prometheus", +"task": "find", +"target": "util::annotations::NewNativeHistogramFractionNaNsInfo", +"mode": "gitnext", +"seconds": 2, +"model": "qwen3.5-4b", +"set": 10 +}, +{ +"tokens_in": 3178, +"tokens_out": 144, +"steps": 3, +"tools": { +"look": 1, +"finish": 2 +}, +"guard": {}, +"gate": { +"nochange": 1 +}, +"passed": true, +"repo": "prometheus", +"task": "find", +"target": "util::annotations::NewNativeHistogramFractionNaNsInfo", +"mode": "lite", +"seconds": 16, +"model": "qwen3.5-4b", +"set": 10 +}, +{ +"tokens_in": 113857, +"tokens_out": 1724, +"steps": 18, +"tools": { +"grep": 7, +"read_file": 10, +"finish": 1 +}, +"guard": { +"repeats": 3 +}, +"recall": 1.0, +"passed": true, +"repo": "prometheus", +"task": "callers", +"target": "prompb::io::prometheus::client::Metric::GetCounter", +"mode": "base", +"seconds": 49, +"model": "qwen3.5-4b", +"set": 10 +}, +{ +"tokens_in": 220560, +"tokens_out": 1814, +"steps": 22, +"tools": { +"grep": 4, +"look": 8, +"read_file": 9, +"finish": 1 +}, +"guard": { +"repeats": 1, +"soft_budget": 1 +}, +"recall": 0.3333333333333333, +"passed": false, +"repo": "prometheus", +"task": "callers", +"target": "prompb::io::prometheus::client::Metric::GetCounter", +"mode": "gitnext", +"seconds": 103, +"model": "qwen3.5-4b", +"set": 10 +}, +{ +"tokens_in": 3282, +"tokens_out": 100, +"steps": 1, +"tools": { +"look": 1 +}, +"guard": {}, +"gate": { +"nochange": 1 +}, +"recall": 1.0, +"passed": true, +"repo": "prometheus", +"task": "callers", +"target": "prompb::io::prometheus::client::Metric::GetCounter", +"mode": "lite", +"seconds": 14, +"model": "qwen3.5-4b", +"set": 10 +}, +{ +"tokens_in": 29244, +"tokens_out": 1522, +"steps": 14, +"tools": { +"grep": 2, +"read_file": 3, +"edit_file": 7, +"run": 1, +"finish": 1 +}, +"guard": {}, +"left": "", +"passed": true, +"repo": "prometheus", +"task": "rename", +"target": "util::notifications::Notifications::DeleteNotification", +"mode": "base", +"seconds": 139, +"model": "qwen3.5-4b", +"set": 10 +}, +{ +"tokens_in": 82445, +"tokens_out": 2224, +"steps": 20, +"tools": { +"look": 1, +"grep": 2, +"edit_file": 10, +"read_file": 5, +"check": 1, +"finish": 1 +}, +"guard": { +"repeats": 2, +"soft_budget": 1 +}, +"left": "", +"passed": true, +"repo": "prometheus", +"task": "rename", +"target": "util::notifications::Notifications::DeleteNotification", +"mode": "gitnext", +"seconds": 200, +"model": "qwen3.5-4b", +"set": 10 +}, +{ +"tokens_in": 163270, +"tokens_out": 1297, +"steps": 25, +"tools": { +"look": 21, +"replace": 2, +"check": 1, +"rename": 1 +}, +"guard": { +"repeats": 2, +"soft_budget": 1 +}, +"stopped": "steps", +"handoff": "Task: Rename the function `DeleteNotification` to `DeleteNotificationV2` everywhere in the project (definition and every use). The project must still compile.\nStopped: ran out of steps.\nTried (distinct actions):\n step 9: look {\"what\": \"notifs.DeleteNotification\"}\n step 10: rename {\"new\": \"DeleteNotificationV2\", \"old\": \"DeleteNotification\"}\n step 12: replace {\"code\": \"notifs.DeleteNotificationV2\", \"symbol\": \"notifs.DeleteNotification\"}\n step 13: look {\"what\": \"cmd/prometheus/main.go:1450-1452\"}\n step 14: look {\"what\": \"cmd/prometheus/main.go:1448-1452\"}\n step 15: look {\"what\": \"cmd/prometheus/main.go:1430-1460\"}\n step 16: look {\"what\": \"cmd/prometheus/main.go:1400-1435\"}\n step 17: look {\"what\": \"cmd/prometheus/main.go:1200-1240\"}\n step 18: look {\"what\": \"cmd/prometheus/main.go:1080-1120\"}\n step 19: look {\"what\": \"cmd/prometheus/main.go:1300-1350\"}\n step 20: look {\"what\": \"cmd/prometheus/main.go:1260-1300\"}\n step 21: look {\"what\": \"cmd/prometheus/main.go:1240-1260\"}\n step 23: look {\"what\": \"cmd/prometheus/main.go:1230-1250\"}\n step 24: look {\"what\": \"cmd/prometheus/main.go:1220-1240\"}\n step 25: look {\"what\": \"cmd/prometheus/main.go:1200-1220\"}\nFiles changed so far:\nutil/notifications/notifications.go | 4 ++--\n 1 file changed, 2 insertions(+), 2 deletions(-)\nLast error: build FAILED N.Ns go build ./... && go test -count=N -run '^$' ./... >/dev/null | \u2717 error cmd/prometheus/main.go:N (\u00d7N) | notifs.DeleteNotification undefined (type *notifications.Notifications has no field or method DeleteNotification)", +"left": "cmd/prometheus/main.go:1450:\t\t\t\tnotifs.DeleteNotification(notifications.ConfigurationUnsuccessful)\ncmd/prometheus/main.go:1537:\t\t\t\tnotifs.DeleteNotification(notifications.StartingUp)\nutil/notification", +"passed": false, +"repo": "prometheus", +"task": "rename", +"target": "util::notifications::Notifications::DeleteNotification", +"mode": "lite", +"seconds": 112, +"model": "qwen3.5-4b", +"set": 10 +}, +{ +"tokens_in": 1619, +"tokens_out": 82, +"steps": 2, +"tools": { +"grep": 1, +"finish": 1 +}, +"guard": {}, +"passed": true, +"repo": "prometheus", +"task": "find", +"target": "model::labels::AppendOpenMetricsFloat", +"mode": "base", +"seconds": 3, +"model": "qwen3.5-4b", +"set": 11 +}, +{ +"tokens_in": 2355, +"tokens_out": 82, +"steps": 2, +"tools": { +"grep": 1, +"finish": 1 +}, +"guard": {}, +"passed": true, +"repo": "prometheus", +"task": "find", +"target": "model::labels::AppendOpenMetricsFloat", +"mode": "gitnext", +"seconds": 3, +"model": "qwen3.5-4b", +"set": 11 +}, +{ +"tokens_in": 3682, +"tokens_out": 135, +"steps": 3, +"tools": { +"look": 1, +"finish": 2 +}, +"guard": {}, +"gate": { +"nochange": 1 +}, +"passed": true, +"repo": "prometheus", +"task": "find", +"target": "model::labels::AppendOpenMetricsFloat", +"mode": "lite", +"seconds": 16, +"model": "qwen3.5-4b", +"set": 11 +}, +{ +"tokens_in": 156362, +"tokens_out": 1900, +"steps": 18, +"tools": { +"grep": 8, +"read_file": 9, +"finish": 1 +}, +"guard": {}, +"recall": 1.0, +"passed": true, +"repo": "prometheus", +"task": "callers", +"target": "discovery::NewRefreshMetrics", +"mode": "base", +"seconds": 81, +"model": "qwen3.5-4b", +"set": 11 +}, +{ +"tokens_in": 2877, +"tokens_out": 120, +"steps": 2, +"tools": { +"look": 1, +"finish": 1 +}, +"guard": {}, +"recall": 1.0, +"passed": true, +"repo": "prometheus", +"task": "callers", +"target": "discovery::NewRefreshMetrics", +"mode": "gitnext", +"seconds": 14, +"model": "qwen3.5-4b", +"set": 11 +}, +{ +"tokens_in": 4072, +"tokens_out": 135, +"steps": 2, +"tools": { +"look": 1, +"finish": 1 +}, +"guard": {}, +"gate": { +"nochange": 1 +}, +"recall": 1.0, +"passed": true, +"repo": "prometheus", +"task": "callers", +"target": "discovery::NewRefreshMetrics", +"mode": "lite", +"seconds": 15, +"model": "qwen3.5-4b", +"set": 11 +}, +{ +"tokens_in": 95655, +"tokens_out": 1970, +"steps": 23, +"tools": { +"grep": 5, +"read_file": 6, +"edit_file": 6, +"run": 5, +"finish": 1 +}, +"guard": { +"repeats": 2, +"soft_budget": 1 +}, +"left": "web/api/v1/api.go:1727:\tDroppedTargets []*DroppedTarget `json:\"droppedTargets\"`\nweb/api/v1/api.go:1893:\t\tres.DroppedTargets = make([]*DroppedTarget, 0, numTargets)\nweb/api/v1/api.go:1899:\t\t\t\tres.", +"passed": false, +"repo": "prometheus", +"task": "rename", +"target": "scrape::scrapePool::DroppedTargets", +"mode": "base", +"seconds": 181, +"model": "qwen3.5-4b", +"set": 11 +}, +{ +"tokens_in": 27800, +"tokens_out": 959, +"steps": 13, +"tools": { +"look": 1, +"replace_symbol": 2, +"read_file": 1, +"edit_file": 4, +"grep": 2, +"run": 1, +"check": 1, +"finish": 1 +}, +"guard": {}, +"left": "web/api/v1/api.go:1727:\tDroppedTargets []*DroppedTarget `json:\"droppedTargets\"`\nweb/api/v1/api.go:1893:\t\tres.DroppedTargets = make([]*DroppedTarget, 0, numTargets)\nweb/api/v1/api.go:1899:\t\t\t\tres.", +"passed": false, +"repo": "prometheus", +"task": "rename", +"target": "scrape::scrapePool::DroppedTargets", +"mode": "gitnext", +"seconds": 166, +"model": "qwen3.5-4b", +"set": 11 +}, +{ +"tokens_in": 52689, +"tokens_out": 719, +"steps": 18, +"tools": { +"look": 11, +"replace": 6, +"check": 1 +}, +"guard": { +"repeats": 8, +"no_progress": 2 +}, +"stopped": "no_progress", +"handoff": "Task: Rename the function `DroppedTargets` to `DroppedTargetsV2` everywhere in the project (definition and every use). The project must still compile.\nStopped: no_progress.\nTried (distinct actions):\n step 1: look {\"what\": \"DroppedTargets\"}\n step 2: replace {\"code\": \"// Return dropped targets, subject to KeepDroppedTargets limit.\\nfunc (sp *scrapePool) DroppedTargetsV2() []*Target {\\n\\ts\n step 3: check {}\n step 4: look {\"what\": \"manager.go:484\"}\n step 5: look {\"what\": \"manager.go\"}\n step 6: look {\"what\": \"scrape/manager.go\"}\n step 7: look {\"what\": \"TargetsDropped\"}\n step 8: look {\"what\": \"scrape/manager.go:514-520\"}\n step 9: replace {\"code\": \"sp.DroppedTargetsV2()\", \"symbol\": \"sp.DroppedTargets()\"}\n step 10: look {\"what\": \"scrape/manager.go:514-523\"}\nFiles changed so far:\nscrape/scrape.go | 2 +-\n 1 file changed, 1 insertion(+), 1 deletion(-)\nLast error: build FAILED N.Ns go build ./... && go test -count=N -run '^$' ./... >/dev/null | \u2717 error scrape/manager.go:N (\u00d7N) | sp.DroppedTargets undefined (type *scrapePool has no field or method DroppedTargets, but does have field droppedTargets)", +"left": "scrape/manager.go:484:\t\ttargets[tset] = append(sp.ActiveTargets(), sp.DroppedTargets()...)\nscrape/manager.go:520:\t\ttargets[tset] = sp.DroppedTargets()\nscrape/scrape_test.go:1354:\tdropped := sp.Dropped", +"passed": false, +"repo": "prometheus", +"task": "rename", +"target": "scrape::scrapePool::DroppedTargets", +"mode": "lite", +"seconds": 60, +"model": "qwen3.5-4b", +"set": 11 +}, +{ +"tokens_in": 1620, +"tokens_out": 90, +"steps": 2, +"tools": { +"grep": 1, +"finish": 1 +}, +"guard": {}, +"passed": true, +"repo": "prometheus", +"task": "find", +"target": "model::labels::nameTable::ToName", +"mode": "base", +"seconds": 3, +"model": "qwen3.5-4b", +"set": 2 +}, +{ +"tokens_in": 2356, +"tokens_out": 54, +"steps": 1, +"tools": { +"grep": 1 +}, +"guard": {}, +"passed": true, +"repo": "prometheus", +"task": "find", +"target": "model::labels::nameTable::ToName", +"mode": "gitnext", +"seconds": 2, +"model": "qwen3.5-4b", +"set": 2 +}, +{ +"tokens_in": 3269, +"tokens_out": 79, +"steps": 1, +"tools": { +"look": 1 +}, +"guard": {}, +"gate": { +"nochange": 1 +}, +"passed": true, +"repo": "prometheus", +"task": "find", +"target": "model::labels::nameTable::ToName", +"mode": "lite", +"seconds": 15, +"model": "qwen3.5-4b", +"set": 2 +}, +{ +"tokens_in": 42092, +"tokens_out": 1018, +"steps": 12, +"tools": { +"grep": 1, +"read_file": 10, +"finish": 1 +}, +"guard": {}, +"recall": 1.0, +"passed": true, +"repo": "prometheus", +"task": "callers", +"target": "prompb::io::prometheus::client::Histogram::GetPositiveDelta", +"mode": "base", +"seconds": 29, +"model": "qwen3.5-4b", +"set": 2 +}, +{ +"tokens_in": 2468, +"tokens_out": 99, +"steps": 1, +"tools": { +"look": 1 +}, +"guard": {}, +"recall": 1.0, +"passed": true, +"repo": "prometheus", +"task": "callers", +"target": "prompb::io::prometheus::client::Histogram::GetPositiveDelta", +"mode": "gitnext", +"seconds": 14, +"model": "qwen3.5-4b", +"set": 2 +}, +{ +"tokens_in": 3216, +"tokens_out": 105, +"steps": 1, +"tools": { +"look": 1 +}, +"guard": {}, +"gate": { +"nochange": 1 +}, +"recall": 1.0, +"passed": true, +"repo": "prometheus", +"task": "callers", +"target": "prompb::io::prometheus::client::Histogram::GetPositiveDelta", +"mode": "lite", +"seconds": 14, +"model": "qwen3.5-4b", +"set": 2 +}, +{ +"tokens_in": 8075, +"tokens_out": 476, +"steps": 6, +"tools": { +"grep": 1, +"read_file": 1, +"edit_file": 3, +"run": 1 +}, +"guard": {}, +"left": "", +"passed": true, +"repo": "prometheus", +"task": "rename", +"target": "tsdb::tombstones::ReadTombstones", +"mode": "base", +"seconds": 139, +"model": "qwen3.5-4b", +"set": 2 +}, +{ +"tokens_in": 13871, +"tokens_out": 425, +"steps": 7, +"tools": { +"look": 1, +"grep": 1, +"edit_file": 3, +"check": 1, +"finish": 1 +}, +"guard": {}, +"left": "", +"passed": true, +"repo": "prometheus", +"task": "rename", +"target": "tsdb::tombstones::ReadTombstones", +"mode": "gitnext", +"seconds": 153, +"model": "qwen3.5-4b", +"set": 2 +}, +{ +"tokens_in": 6043, +"tokens_out": 179, +"steps": 4, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"guard": {}, +"left": "", +"passed": true, +"repo": "prometheus", +"task": "rename", +"target": "tsdb::tombstones::ReadTombstones", +"mode": "lite", +"seconds": 159, +"model": "qwen3.5-4b", +"set": 2 +}, +{ +"tokens_in": 1475, +"tokens_out": 87, +"steps": 2, +"tools": { +"grep": 1, +"finish": 1 +}, +"guard": {}, +"passed": true, +"repo": "prometheus", +"task": "find", +"target": "storage::remote::googleiam::NewRoundTripper", +"mode": "base", +"seconds": 3, +"model": "qwen3.5-4b", +"set": 3 +}, +{ +"tokens_in": 2211, +"tokens_out": 54, +"steps": 1, +"tools": { +"grep": 1 +}, +"guard": {}, +"passed": true, +"repo": "prometheus", +"task": "find", +"target": "storage::remote::googleiam::NewRoundTripper", +"mode": "gitnext", +"seconds": 2, +"model": "qwen3.5-4b", +"set": 3 +}, +{ +"tokens_in": 3802, +"tokens_out": 112, +"steps": 2, +"tools": { +"look": 1, +"finish": 1 +}, +"guard": {}, +"gate": { +"nochange": 1 +}, +"passed": true, +"repo": "prometheus", +"task": "find", +"target": "storage::remote::googleiam::NewRoundTripper", +"mode": "lite", +"seconds": 16, +"model": "qwen3.5-4b", +"set": 3 +}, +{ +"tokens_in": 15862, +"tokens_out": 1393, +"steps": 9, +"tools": { +"grep": 7, +"read_file": 1, +"finish": 1 +}, +"guard": {}, +"recall": 0.0, +"passed": false, +"repo": "prometheus", +"task": "callers", +"target": "cmd::promtool::PushMetrics", +"mode": "base", +"seconds": 34, +"model": "qwen3.5-4b", +"set": 3 +}, +{ +"tokens_in": 17273, +"tokens_out": 712, +"steps": 6, +"tools": { +"grep": 3, +"read_file": 2, +"look": 1 +}, +"guard": {}, +"recall": 1.0, +"passed": true, +"repo": "prometheus", +"task": "callers", +"target": "cmd::promtool::PushMetrics", +"mode": "gitnext", +"seconds": 30, +"model": "qwen3.5-4b", +"set": 3 +}, +{ +"tokens_in": 4363, +"tokens_out": 106, +"steps": 2, +"tools": { +"look": 1, +"finish": 1 +}, +"guard": {}, +"gate": { +"nochange": 1 +}, +"recall": 1.0, +"passed": true, +"repo": "prometheus", +"task": "callers", +"target": "cmd::promtool::PushMetrics", +"mode": "lite", +"seconds": 15, +"model": "qwen3.5-4b", +"set": 3 +}, +{ +"tokens_in": 104655, +"tokens_out": 1545, +"steps": 21, +"tools": { +"grep": 2, +"read_file": 5, +"edit_file": 14 +}, +"guard": { +"repeats": 11, +"no_progress": 2, +"soft_budget": 1 +}, +"stopped": "no_progress", +"handoff": "Task: Rename the function `IsTypeEmpty` to `IsTypeEmptyV2` everywhere in the project (definition and every use). The project must still compile.\nStopped: no_progress.\nTried (distinct actions):\n step 1: grep {\"pattern\": \"IsTypeEmpty\"}\n step 2: read_file {\"path\": \"schema/labels.go\"}\n step 3: read_file {\"path\": \"schema/labels.go\", \"start\": 134}\n step 4: edit_file {\"new\": \"// IsTypeEmptyV2 returns true if the metric type is empty or unrecognized.\\nfunc (m Metadata) IsTypeEmptyV2() bool {\\n\\tr\n step 5: edit_file {\"new\": \"\\t\\tcase model.MetricTypeLabel:\\n\\t\\t\\treturn m.IsTypeEmptyV2()\", \"old\": \"\\t\\tcase model.MetricTypeLabel:\\n\\t\\t\\treturn m\n step 6: read_file {\"end\": 120, \"path\": \"schema/labels.go\", \"start\": 104}\n step 7: edit_file {\"new\": \"\\tcase model.MetricTypeLabel:\\n\\t\\t\\treturn m.IsTypeEmptyV2()\", \"old\": \"\\tcase model.MetricTypeLabel:\\n\\t\\t\\treturn m.IsT\n step 9: read_file {\"end\": 120, \"path\": \"schema/labels.go\", \"start\": 107}\n step 11: grep {\"path\": \"schema/labels.go\", \"pattern\": \"IsTypeEmpty\"}\nFiles changed so far:\nschema/labels.go | 4 ++--\n 1 file changed, 2 insertions(+), 2 deletions(-)\nNo failing command was seen.", +"left": "model/textparse/openmetrics2parse.go:321:\t\t\tif !m.IsTypeEmpty() {\nrules/group.go:560:\t\t\tif !sm.IsTypeEmpty() || sm.Unit != \"\" {\nschema/labels.go:112:\t\treturn m.IsTypeEmpty()", +"passed": false, +"repo": "prometheus", +"task": "rename", +"target": "schema::Metadata::IsTypeEmpty", +"mode": "base", +"seconds": 65, +"model": "qwen3.5-4b", +"set": 3 +}, +{ +"tokens_in": 6360, +"tokens_out": 190, +"steps": 4, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"guard": {}, +"left": "", +"passed": true, +"repo": "prometheus", +"task": "rename", +"target": "schema::Metadata::IsTypeEmpty", +"mode": "gitnext", +"seconds": 239, +"model": "qwen3.5-4b", +"set": 3 +}, +{ +"tokens_in": 5347, +"tokens_out": 181, +"steps": 4, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"guard": {}, +"left": "", +"passed": true, +"repo": "prometheus", +"task": "rename", +"target": "schema::Metadata::IsTypeEmpty", +"mode": "lite", +"seconds": 163, +"model": "qwen3.5-4b", +"set": 3 +}, +{ +"tokens_in": 1985, +"tokens_out": 76, +"steps": 2, +"tools": { +"grep": 1, +"finish": 1 +}, +"guard": {}, +"passed": true, +"repo": "prometheus", +"task": "find", +"target": "scrape::scrapePool::ActiveTargets", +"mode": "base", +"seconds": 3, +"model": "qwen3.5-4b", +"set": 4 +}, +{ +"tokens_in": 2721, +"tokens_out": 76, +"steps": 2, +"tools": { +"grep": 1, +"finish": 1 +}, +"guard": {}, +"passed": true, +"repo": "prometheus", +"task": "find", +"target": "scrape::scrapePool::ActiveTargets", +"mode": "gitnext", +"seconds": 3, +"model": "qwen3.5-4b", +"set": 4 +}, +{ +"tokens_in": 3362, +"tokens_out": 125, +"steps": 3, +"tools": { +"look": 1, +"finish": 2 +}, +"guard": {}, +"gate": { +"nochange": 1 +}, +"passed": true, +"repo": "prometheus", +"task": "find", +"target": "scrape::scrapePool::ActiveTargets", +"mode": "lite", +"seconds": 16, +"model": "qwen3.5-4b", +"set": 4 +}, +{ +"tokens_in": 126539, +"tokens_out": 1537, +"steps": 19, +"tools": { +"grep": 10, +"read_file": 8, +"finish": 1 +}, +"guard": { +"repeats": 7, +"no_progress": 1, +"soft_budget": 1 +}, +"recall": 0.5, +"passed": false, +"repo": "prometheus", +"task": "callers", +"target": "tsdb::Head::Init", +"mode": "base", +"seconds": 53, +"model": "qwen3.5-4b", +"set": 4 +}, +{ +"tokens_in": 35946, +"tokens_out": 252, +"steps": 9, +"tools": { +"grep": 9 +}, +"guard": { +"repeats": 8, +"no_progress": 2 +}, +"stopped": "no_progress", +"handoff": "Task: Which functions or methods call `Init`? Answer with their names, one per line.\nStopped: no_progress.\nTried (distinct actions):\n step 1: grep {\"pattern\": \"\\\\.Init\\\\(\"}\nNo file was changed.\nNo failing command was seen.", +"recall": 0.0, +"passed": false, +"repo": "prometheus", +"task": "callers", +"target": "tsdb::Head::Init", +"mode": "gitnext", +"seconds": 12, +"model": "qwen3.5-4b", +"set": 4 +}, +{ +"tokens_in": 60650, +"tokens_out": 415, +"steps": 14, +"tools": { +"look": 14 +}, +"guard": { +"repeats": 8, +"no_progress": 2 +}, +"stopped": "no_progress", +"handoff": "Task: Which functions or methods call `Init`? Answer with their names, one per line.\nStopped: no_progress.\nTried (distinct actions):\n step 1: look {\"what\": \"Init\"}\n step 2: look {\"what\": \"who calls Init\"}\n step 5: look {\"what\": \"Init (method)\"}\n step 6: look {\"what\": \"tsdb/head.go\"}\n step 7: look {\"what\": \"Init (method) tsdb/head.go:777\"}\n step 9: look {\"what\": \"Init (method) tsdb/head.go\"}\nNo file was changed.\nNo failing command was seen.", +"recall": 0.0, +"passed": false, +"repo": "prometheus", +"task": "callers", +"target": "tsdb::Head::Init", +"mode": "lite", +"seconds": 29, +"model": "qwen3.5-4b", +"set": 4 +}, +{ +"tokens_in": 12345, +"tokens_out": 563, +"steps": 8, +"tools": { +"grep": 2, +"read_file": 2, +"edit_file": 2, +"run": 1, +"finish": 1 +}, +"guard": {}, +"left": "", +"passed": true, +"repo": "prometheus", +"task": "rename", +"target": "promql::evaluator::VectorUnless", +"mode": "base", +"seconds": 89, +"model": "qwen3.5-4b", +"set": 4 +}, +{ +"tokens_in": 10530, +"tokens_out": 359, +"steps": 6, +"tools": { +"look": 1, +"grep": 1, +"edit_file": 2, +"check": 1, +"finish": 1 +}, +"guard": {}, +"left": "", +"passed": true, +"repo": "prometheus", +"task": "rename", +"target": "promql::evaluator::VectorUnless", +"mode": "gitnext", +"seconds": 181, +"model": "qwen3.5-4b", +"set": 4 +}, +{ +"tokens_in": 5332, +"tokens_out": 162, +"steps": 4, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"guard": {}, +"left": "", +"passed": true, +"repo": "prometheus", +"task": "rename", +"target": "promql::evaluator::VectorUnless", +"mode": "lite", +"seconds": 158, +"model": "qwen3.5-4b", +"set": 4 +}, +{ +"tokens_in": 1724, +"tokens_out": 74, +"steps": 2, +"tools": { +"grep": 1, +"finish": 1 +}, +"guard": {}, +"passed": true, +"repo": "prometheus", +"task": "find", +"target": "schema::Metadata::IsEmptyFor", +"mode": "base", +"seconds": 3, +"model": "qwen3.5-4b", +"set": 5 +}, +{ +"tokens_in": 2460, +"tokens_out": 74, +"steps": 2, +"tools": { +"grep": 1, +"finish": 1 +}, +"guard": {}, +"passed": true, +"repo": "prometheus", +"task": "find", +"target": "schema::Metadata::IsEmptyFor", +"mode": "gitnext", +"seconds": 3, +"model": "qwen3.5-4b", +"set": 5 +}, +{ +"tokens_in": 3392, +"tokens_out": 121, +"steps": 3, +"tools": { +"look": 1, +"finish": 2 +}, +"guard": {}, +"gate": { +"nochange": 1 +}, +"passed": true, +"repo": "prometheus", +"task": "find", +"target": "schema::Metadata::IsEmptyFor", +"mode": "lite", +"seconds": 16, +"model": "qwen3.5-4b", +"set": 5 +}, +{ +"tokens_in": 12896, +"tokens_out": 512, +"steps": 5, +"tools": { +"grep": 2, +"read_file": 3 +}, +"guard": {}, +"recall": 1.0, +"passed": true, +"repo": "prometheus", +"task": "callers", +"target": "tsdb::index::ReadPostingsOffsetTable", +"mode": "base", +"seconds": 14, +"model": "qwen3.5-4b", +"set": 5 +}, +{ +"tokens_in": 4384, +"tokens_out": 186, +"steps": 3, +"tools": { +"grep": 1, +"look": 1, +"finish": 1 +}, +"guard": {}, +"recall": 1.0, +"passed": true, +"repo": "prometheus", +"task": "callers", +"target": "tsdb::index::ReadPostingsOffsetTable", +"mode": "gitnext", +"seconds": 16, +"model": "qwen3.5-4b", +"set": 5 +}, +{ +"tokens_in": 3885, +"tokens_out": 113, +"steps": 2, +"tools": { +"look": 1, +"finish": 1 +}, +"guard": {}, +"gate": { +"nochange": 1 +}, +"recall": 1.0, +"passed": true, +"repo": "prometheus", +"task": "callers", +"target": "tsdb::index::ReadPostingsOffsetTable", +"mode": "lite", +"seconds": 15, +"model": "qwen3.5-4b", +"set": 5 +}, +{ +"tokens_in": 41584, +"tokens_out": 1449, +"steps": 16, +"tools": { +"grep": 2, +"read_file": 1, +"edit_file": 10, +"run": 2, +"finish": 1 +}, +"guard": {}, +"left": "", +"passed": true, +"repo": "prometheus", +"task": "rename", +"target": "tsdb::chunkenc::FromData", +"mode": "base", +"seconds": 383, +"model": "qwen3.5-4b", +"set": 5 +}, +{ +"tokens_in": 13390, +"tokens_out": 314, +"steps": 6, +"tools": { +"look": 1, +"grep": 1, +"rename": 1, +"run": 1, +"check": 1, +"finish": 1 +}, +"guard": {}, +"left": "", +"passed": true, +"repo": "prometheus", +"task": "rename", +"target": "tsdb::chunkenc::FromData", +"mode": "gitnext", +"seconds": 129, +"model": "qwen3.5-4b", +"set": 5 +}, +{ +"tokens_in": 6100, +"tokens_out": 165, +"steps": 4, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"guard": {}, +"left": "", +"passed": true, +"repo": "prometheus", +"task": "rename", +"target": "tsdb::chunkenc::FromData", +"mode": "lite", +"seconds": 160, +"model": "qwen3.5-4b", +"set": 5 +}, +{ +"tokens_in": 4393, +"tokens_out": 105, +"steps": 2, +"tools": { +"grep": 1, +"read_file": 1 +}, +"guard": {}, +"passed": true, +"repo": "prometheus", +"task": "find", +"target": "model::histogram::FloatHistogram::DetectReset", +"mode": "base", +"seconds": 4, +"model": "qwen3.5-4b", +"set": 6 +}, +{ +"tokens_in": 3005, +"tokens_out": 80, +"steps": 2, +"tools": { +"grep": 1, +"finish": 1 +}, +"guard": {}, +"passed": true, +"repo": "prometheus", +"task": "find", +"target": "model::histogram::FloatHistogram::DetectReset", +"mode": "gitnext", +"seconds": 3, +"model": "qwen3.5-4b", +"set": 6 +}, +{ +"tokens_in": 5168, +"tokens_out": 69, +"steps": 1, +"tools": { +"look": 1 +}, +"guard": {}, +"gate": { +"nochange": 1 +}, +"passed": true, +"repo": "prometheus", +"task": "find", +"target": "model::histogram::FloatHistogram::DetectReset", +"mode": "lite", +"seconds": 16, +"model": "qwen3.5-4b", +"set": 6 +}, +{ +"tokens_in": 3026, +"tokens_out": 141, +"steps": 2, +"tools": { +"grep": 1, +"finish": 1 +}, +"guard": {}, +"recall": 0.0, +"passed": false, +"repo": "prometheus", +"task": "callers", +"target": "storage::NewListSeriesIterator", +"mode": "base", +"seconds": 4, +"model": "qwen3.5-4b", +"set": 6 +}, +{ +"tokens_in": 48897, +"tokens_out": 1508, +"steps": 11, +"tools": { +"grep": 2, +"look": 4, +"read_file": 3, +"list_dir": 1, +"finish": 1 +}, +"guard": {}, +"recall": 1.0, +"passed": true, +"repo": "prometheus", +"task": "callers", +"target": "storage::NewListSeriesIterator", +"mode": "gitnext", +"seconds": 88, +"model": "qwen3.5-4b", +"set": 6 +}, +{ +"tokens_in": 15481, +"tokens_out": 360, +"steps": 6, +"tools": { +"look": 4, +"finish": 2 +}, +"guard": { +"repeats": 1 +}, +"gate": { +"nochange": 1 +}, +"recall": 1.0, +"passed": true, +"repo": "prometheus", +"task": "callers", +"target": "storage::NewListSeriesIterator", +"mode": "lite", +"seconds": 35, +"model": "qwen3.5-4b", +"set": 6 +}, +{ +"tokens_in": 71261, +"tokens_out": 2254, +"steps": 25, +"tools": { +"grep": 4, +"read_file": 6, +"edit_file": 15 +}, +"guard": { +"repeats": 1, +"soft_budget": 1 +}, +"stopped": "steps", +"handoff": "Task: Rename the function `NewProtobufParser` to `NewProtobufParserV2` everywhere in the project (definition and every use). The project must still compile.\nStopped: ran out of steps.\nTried (distinct actions):\n step 10: edit_file {\"new\": \"\\t\\t\\tparser: NewProtobufParserV2(inputBuf.Bytes(), true, false, false, false, labels.NewSymbolTable()),\", \"old\": \"\\t\\t\\t\n step 11: edit_file {\"new\": \"\\tp := NewProtobufParserV2(data, tc.ignoreNative, tc.keepClassic, true, tc.typeAndUnit, labels.NewSymbolTable())\", \"old\":\n step 12: edit_file {\"new\": \"\\tp := NewProtobufParserV2(b, false, parseClassicHistogram, false, enableTypeAndUnitLabels, st)\", \"old\": \"\\tp := NewProto\n step 13: edit_file {\"new\": \"\\tp := NewProtobufParserV2(buf.Bytes(), false, false, false, false, labels.NewSymbolTable())\", \"old\": \"\\tp := NewProtobuf\n step 14: grep {\"path\": \"model/textparse/protobufparse_test.go\", \"pattern\": \"NewProtobufParser\\\\(buf.Bytes\\\\(\\\\)\\\\)\"}\n step 15: grep {\"path\": \"model/textparse/protobufparse_test.go\", \"pattern\": \"NewProtobufParser\\\\(buf\\\\.Bytes\\\\(\\\\)\\\\)\"}\n step 16: grep {\"pattern\": \"NewProtobufParser\\\\(buf\\\\.Bytes\\\\(\\\\)\\\\)\"}\n step 17: read_file {\"end\": 5940, \"path\": \"model/textparse/protobufparse_test.go\", \"start\": 5920}\n step 18: read_file {\"end\": 6015, \"path\": \"model/textparse/protobufparse_test.go\", \"start\": 6000}\n step 20: read_file {\"end\": 5930, \"path\": \"model/textparse/protobufparse_test.go\", \"start\": 5928}\n step 21: edit_file {\"new\": \"\\tp := NewProtobufParserV2(buf.Bytes(), false, false, false, false, labels.NewSymbolTable())\\n\\trequire.NotPanics(t, func\n step 22: read_file {\"end\": 6004, \"path\": \"model/textparse/protobufparse_test.go\", \"start\": 6001}\n step 23: edit_file {\"new\": \"\\tbuf := metricFamiliesToProtobuf(t, []string{tc.input})\\n\\tp := NewProtobufParserV2(buf.Bytes(), false, false, false, fa\n step 24: read_file {\"end\": 6005, \"path\": \"model/textparse/protobufparse_test.go\", \"start\": 6001}\n step 25: edit_file {\"new\": \"\\tp := NewProtobufParserV2(buf.Bytes(), false, false, false, false, labels.NewSymbolTable())\\n\\tvar gotErr error\", \"old\":\nFiles changed so far:\nmodel/textparse/benchmark_test.go | 4 ++--\n model/textparse/interface.go | 2 +-\n model/textparse/protobufparse.go | 4 ++--\n model/textparse/protobufparse_test.go | 14 +++++++-------\n 4 files changed, 12 insertions(+), 12 deletions(-)\nNo failing command was seen.", +"left": "model/textparse/protobufparse_test.go:6002:\t\t\tp := NewProtobufParser(buf.Bytes(), false, false, false, false, labels.NewSymbolTable())\nmodel/textparse/protobufparse_test.go:6069:\t\t\tp := NewProtobufPar", +"passed": false, +"repo": "prometheus", +"task": "rename", +"target": "model::textparse::NewProtobufParser", +"mode": "base", +"seconds": 127, +"model": "qwen3.5-4b", +"set": 6 +}, +{ +"tokens_in": 13724, +"tokens_out": 310, +"steps": 6, +"tools": { +"look": 1, +"grep": 1, +"rename": 1, +"run": 1, +"check": 1, +"finish": 1 +}, +"guard": {}, +"left": "", +"passed": true, +"repo": "prometheus", +"task": "rename", +"target": "model::textparse::NewProtobufParser", +"mode": "gitnext", +"seconds": 185, +"model": "qwen3.5-4b", +"set": 6 +}, +{ +"tokens_in": 3400, +"tokens_out": 166, +"steps": 3, +"tools": { +"rename": 1, +"check": 1, +"finish": 1 +}, +"guard": {}, +"left": "", +"passed": true, +"repo": "prometheus", +"task": "rename", +"target": "model::textparse::NewProtobufParser", +"mode": "lite", +"seconds": 148, +"model": "qwen3.5-4b", +"set": 6 +}, +{ +"tokens_in": 1517, +"tokens_out": 45, +"steps": 1, +"tools": { +"grep": 1 +}, +"guard": {}, +"passed": true, +"repo": "prometheus", +"task": "find", +"target": "promql::evaluator::VectorUnless", +"mode": "base", +"seconds": 2, +"model": "qwen3.5-4b", +"set": 7 +}, +{ +"tokens_in": 2253, +"tokens_out": 45, +"steps": 1, +"tools": { +"grep": 1 +}, +"guard": {}, +"passed": true, +"repo": "prometheus", +"task": "find", +"target": "promql::evaluator::VectorUnless", +"mode": "gitnext", +"seconds": 2, +"model": "qwen3.5-4b", +"set": 7 +}, +{ +"tokens_in": 3570, +"tokens_out": 121, +"steps": 3, +"tools": { +"look": 1, +"finish": 2 +}, +"guard": {}, +"gate": { +"nochange": 1 +}, +"passed": true, +"repo": "prometheus", +"task": "find", +"target": "promql::evaluator::VectorUnless", +"mode": "lite", +"seconds": 16, +"model": "qwen3.5-4b", +"set": 7 +}, +{ +"tokens_in": 224594, +"tokens_out": 1722, +"steps": 25, +"tools": { +"grep": 3, +"read_file": 22 +}, +"guard": { +"soft_budget": 1 +}, +"stopped": "steps", +"handoff": "Task: Which functions or methods call `EngineQueryFunc`? Answer with their names, one per line.\nStopped: ran out of steps.\nTried (distinct actions):\n step 11: read_file {\"end\": 945, \"path\": \"cmd/prometheus/main.go\", \"start\": 890}\n step 12: read_file {\"end\": 895, \"path\": \"cmd/prometheus/main.go\", \"start\": 800}\n step 13: read_file {\"end\": 760, \"path\": \"cmd/prometheus/main.go\", \"start\": 700}\n step 14: read_file {\"end\": 705, \"path\": \"cmd/prometheus/main.go\", \"start\": 620}\n step 15: read_file {\"end\": 625, \"path\": \"cmd/prometheus/main.go\", \"start\": 540}\n step 16: read_file {\"end\": 545, \"path\": \"cmd/prometheus/main.go\", \"start\": 450}\n step 17: read_file {\"end\": 455, \"path\": \"cmd/prometheus/main.go\", \"start\": 380}\n step 18: read_file {\"end\": 385, \"path\": \"cmd/prometheus/main.go\", \"start\": 320}\n step 19: grep {\"pattern\": \"func.*\\\\(.*\\\\).*{[^}]*EngineQueryFunc|\\\\.EngineQueryFunc\\\\(\"}\n step 20: read_file {\"end\": 920, \"path\": \"web/web.go\", \"start\": 840}\n step 21: read_file {\"end\": 850, \"path\": \"web/web.go\", \"start\": 800}\n step 22: read_file {\"end\": 400, \"path\": \"web/api/v1/api_test.go\", \"start\": 350}\n step 23: read_file {\"end\": 365, \"path\": \"web/api/v1/api_test.go\", \"start\": 320}\n step 24: read_file {\"end\": 325, \"path\": \"web/api/v1/api_test.go\", \"start\": 280}\n step 25: read_file {\"end\": 285, \"path\": \"web/api/v1/api_test.go\", \"start\": 200}\nNo file was changed.\nNo failing command was seen.", +"recall": 0.0, +"passed": false, +"repo": "prometheus", +"task": "callers", +"target": "rules::EngineQueryFunc", +"mode": "base", +"seconds": 122, +"model": "qwen3.5-4b", +"set": 7 +}, +{ +"tokens_in": 231065, +"tokens_out": 1843, +"steps": 25, +"tools": { +"grep": 1, +"look": 1, +"read_file": 22, +"finish": 1 +}, +"guard": { +"soft_budget": 1 +}, +"recall": 1.0, +"passed": true, +"repo": "prometheus", +"task": "callers", +"target": "rules::EngineQueryFunc", +"mode": "gitnext", +"seconds": 134, +"model": "qwen3.5-4b", +"set": 7 +}, +{ +"tokens_in": 137853, +"tokens_out": 1235, +"steps": 18, +"tools": { +"look": 17, +"finish": 1 +}, +"guard": { +"repeats": 8, +"no_progress": 1 +}, +"gate": { +"nochange": 1 +}, +"recall": 1.0, +"passed": true, +"repo": "prometheus", +"task": "callers", +"target": "rules::EngineQueryFunc", +"mode": "lite", +"seconds": 117, +"model": "qwen3.5-4b", +"set": 7 +}, +{ +"tokens_in": 46633, +"tokens_out": 928, +"steps": 11, +"tools": { +"grep": 3, +"read_file": 1, +"edit_file": 4, +"run": 2, +"finish": 1 +}, +"guard": {}, +"left": "storage/remote/read_handler_test.go:1227:\t\t\t\t\topts.IsolationDisabled = tc.isolationDisabled\ntsdb/db.go:95:\t\tIsolationDisabled: defaultIsolationDisabled,\ntsdb/db.go:196:\tIsolationDisabled boo", +"passed": false, +"repo": "prometheus", +"task": "rename", +"target": "tsdb::isolationState::IsolationDisabled", +"mode": "base", +"seconds": 250, +"model": "qwen3.5-4b", +"set": 7 +}, +{ +"tokens_in": 28290, +"tokens_out": 681, +"steps": 12, +"tools": { +"look": 1, +"replace_symbol": 1, +"check": 3, +"read_file": 3, +"edit_file": 3, +"finish": 1 +}, +"guard": {}, +"left": "storage/remote/read_handler_test.go:1227:\t\t\t\t\topts.IsolationDisabled = tc.isolationDisabled\ntsdb/db.go:95:\t\tIsolationDisabled: defaultIsolationDisabled,\ntsdb/db.go:196:\tIsolationDisabled boo", +"passed": false, +"repo": "prometheus", +"task": "rename", +"target": "tsdb::isolationState::IsolationDisabled", +"mode": "gitnext", +"seconds": 158, +"model": "qwen3.5-4b", +"set": 7 +}, +{ +"tokens_in": 5680, +"tokens_out": 126, +"steps": 3, +"tools": { +"look": 1, +"rename": 1, +"check": 1 +}, +"guard": {}, +"left": "storage/remote/read_handler_test.go:1227:\t\t\t\t\topts.IsolationDisabled = tc.isolationDisabled\ntsdb/db.go:95:\t\tIsolationDisabled: defaultIsolationDisabled,\ntsdb/db.go:196:\tIsolationDisabled boo", +"passed": false, +"repo": "prometheus", +"task": "rename", +"target": "tsdb::isolationState::IsolationDisabled", +"mode": "lite", +"seconds": 156, +"model": "qwen3.5-4b", +"set": 7 +}, +{ +"tokens_in": 1591, +"tokens_out": 98, +"steps": 2, +"tools": { +"grep": 1, +"finish": 1 +}, +"guard": {}, +"passed": true, +"repo": "prometheus", +"task": "find", +"target": "util::fuzzing::GetCorpusForFuzzXOR2Chunk", +"mode": "base", +"seconds": 3, +"model": "qwen3.5-4b", +"set": 8 +}, +{ +"tokens_in": 2327, +"tokens_out": 65, +"steps": 1, +"tools": { +"grep": 1 +}, +"guard": {}, +"passed": true, +"repo": "prometheus", +"task": "find", +"target": "util::fuzzing::GetCorpusForFuzzXOR2Chunk", +"mode": "gitnext", +"seconds": 3, +"model": "qwen3.5-4b", +"set": 8 +}, +{ +"tokens_in": 3575, +"tokens_out": 95, +"steps": 1, +"tools": { +"look": 1 +}, +"guard": {}, +"gate": { +"nochange": 1 +}, +"passed": true, +"repo": "prometheus", +"task": "find", +"target": "util::fuzzing::GetCorpusForFuzzXOR2Chunk", +"mode": "lite", +"seconds": 15, +"model": "qwen3.5-4b", +"set": 8 +}, +{ +"tokens_in": 8564, +"tokens_out": 493, +"steps": 5, +"tools": { +"grep": 3, +"read_file": 2 +}, +"guard": { +"repeats": 1 +}, +"recall": 1.0, +"passed": true, +"repo": "prometheus", +"task": "callers", +"target": "tsdb::NewExemplarMetrics", +"mode": "base", +"seconds": 13, +"model": "qwen3.5-4b", +"set": 8 +}, +{ +"tokens_in": 15123, +"tokens_out": 495, +"steps": 7, +"tools": { +"grep": 3, +"look": 1, +"read_file": 2, +"finish": 1 +}, +"guard": {}, +"recall": 1.0, +"passed": true, +"repo": "prometheus", +"task": "callers", +"target": "tsdb::NewExemplarMetrics", +"mode": "gitnext", +"seconds": 25, +"model": "qwen3.5-4b", +"set": 8 +}, +{ +"tokens_in": 32770, +"tokens_out": 497, +"steps": 8, +"tools": { +"look": 6, +"finish": 2 +}, +"guard": { +"repeats": 2 +}, +"gate": { +"nochange": 1 +}, +"recall": 1.0, +"passed": true, +"repo": "prometheus", +"task": "callers", +"target": "tsdb::NewExemplarMetrics", +"mode": "lite", +"seconds": 66, +"model": "qwen3.5-4b", +"set": 8 +}, +{ +"tokens_in": 8342, +"tokens_out": 459, +"steps": 7, +"tools": { +"grep": 1, +"read_file": 2, +"edit_file": 2, +"run": 1, +"finish": 1 +}, +"guard": {}, +"left": "", +"passed": true, +"repo": "prometheus", +"task": "rename", +"target": "scrape::ContextWithTarget", +"mode": "base", +"seconds": 128, +"model": "qwen3.5-4b", +"set": 8 +}, +{ +"tokens_in": 13551, +"tokens_out": 467, +"steps": 8, +"tools": { +"look": 1, +"grep": 1, +"edit_file": 3, +"read_file": 1, +"check": 1, +"finish": 1 +}, +"guard": {}, +"left": "", +"passed": true, +"repo": "prometheus", +"task": "rename", +"target": "scrape::ContextWithTarget", +"mode": "gitnext", +"seconds": 154, +"model": "qwen3.5-4b", +"set": 8 +}, +{ +"tokens_in": 4543, +"tokens_out": 140, +"steps": 4, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"guard": {}, +"left": "", +"passed": true, +"repo": "prometheus", +"task": "rename", +"target": "scrape::ContextWithTarget", +"mode": "lite", +"seconds": 154, +"model": "qwen3.5-4b", +"set": 8 +}, +{ +"tokens_in": 1700, +"tokens_out": 84, +"steps": 2, +"tools": { +"grep": 1, +"finish": 1 +}, +"guard": {}, +"passed": true, +"repo": "prometheus", +"task": "find", +"target": "tsdb::wlog::NewSegmentBufReader", +"mode": "base", +"seconds": 3, +"model": "qwen3.5-4b", +"set": 9 +}, +{ +"tokens_in": 2436, +"tokens_out": 84, +"steps": 2, +"tools": { +"grep": 1, +"finish": 1 +}, +"guard": {}, +"passed": true, +"repo": "prometheus", +"task": "find", +"target": "tsdb::wlog::NewSegmentBufReader", +"mode": "gitnext", +"seconds": 3, +"model": "qwen3.5-4b", +"set": 9 +}, +{ +"tokens_in": 3554, +"tokens_out": 75, +"steps": 1, +"tools": { +"look": 1 +}, +"guard": {}, +"gate": { +"nochange": 1 +}, +"passed": true, +"repo": "prometheus", +"task": "find", +"target": "tsdb::wlog::NewSegmentBufReader", +"mode": "lite", +"seconds": 15, +"model": "qwen3.5-4b", +"set": 9 +}, +{ +"tokens_in": 5272, +"tokens_out": 266, +"steps": 4, +"tools": { +"grep": 1, +"read_file": 2, +"finish": 1 +}, +"guard": {}, +"recall": 0.5, +"passed": false, +"repo": "prometheus", +"task": "callers", +"target": "tsdb::record::Encoder::EncodeExemplarsIntoBuffer", +"mode": "base", +"seconds": 8, +"model": "qwen3.5-4b", +"set": 9 +}, +{ +"tokens_in": 12257, +"tokens_out": 510, +"steps": 6, +"tools": { +"grep": 1, +"look": 1, +"read_file": 3, +"finish": 1 +}, +"guard": {}, +"recall": 1.0, +"passed": true, +"repo": "prometheus", +"task": "callers", +"target": "tsdb::record::Encoder::EncodeExemplarsIntoBuffer", +"mode": "gitnext", +"seconds": 25, +"model": "qwen3.5-4b", +"set": 9 +}, +{ +"tokens_in": 70156, +"tokens_out": 2420, +"steps": 9, +"tools": { +"look": 9 +}, +"guard": { +"repeats": 2 +}, +"gate": { +"nochange": 1 +}, +"recall": 1.0, +"passed": true, +"repo": "prometheus", +"task": "callers", +"target": "tsdb::record::Encoder::EncodeExemplarsIntoBuffer", +"mode": "lite", +"seconds": 108, +"model": "qwen3.5-4b", +"set": 9 +}, +{ +"tokens_in": 111878, +"tokens_out": 2883, +"steps": 25, +"tools": { +"grep": 1, +"read_file": 6, +"edit_file": 18 +}, +"guard": { +"repeats": 2, +"soft_budget": 1 +}, +"stopped": "steps", +"handoff": "Task: Rename the function `IsZeroHandle` to `IsZeroHandleV2` everywhere in the project (definition and every use). The project must still compile.\nStopped: ran out of steps.\nTried (distinct actions):\n step 9: edit_file {\"new\": \"\\t\\tif !hasFamilyMeta && !metadata.IsZeroHandleV2(origMeta) && origMD.Type == model.MetricTypeUnknown && hasTypeSuffixFor\n step 10: edit_file {\"new\": \"\\tmetaChanged := metadata.IsZeroHandleV2(s.meta) || !s.meta.Value().Equals(opts.Metadata)\", \"old\": \"\\tmetaChanged := meta\n step 11: edit_file {\"new\": \"\\t\\t\\t\\trequire.False(t, metadata.IsZeroHandleV2(s100.meta))\", \"old\": \"\\t\\t\\t\\trequire.False(t, metadata.IsZeroHandle(s10\n step 12: edit_file {\"new\": \"\\trequire.True(t, metadata.IsZeroHandleV2(series4.meta))\", \"old\": \"\\trequire.True(t, metadata.IsZeroHandle(series4.meta))\n step 13: edit_file {\"new\": \"\\thasNewMetadata := metadata.IsZeroHandleV2(s.meta) || s.meta.Value() != meta\", \"old\": \"\\thasNewMetadata := metadata.IsZe\n step 14: edit_file {\"new\": \"\\t\\trequire.True(t, metadata.IsZeroHandleV2(memS.Metadata()))\", \"old\": \"\\t\\trequire.True(t, metadata.IsZeroHandle(memS.Me\n step 15: edit_file {\"new\": \"\\t\\tif !metadata.IsZeroHandleV2(g.Metadata()) {\", \"old\": \"\\t\\tif !metadata.IsZeroHandle(g.Metadata()) {\", \"path\": \"tsdb/a\n step 16: edit_file {\"new\": \"\\t\\t\\tif mh := sm.Metadata(); !metadata.IsZeroHandleV2(mh) {\", \"old\": \"\\t\\t\\tif mh := sm.Metadata(); !metadata.IsZeroHand\n step 17: read_file {\"end\": 290, \"path\": \"tsdb/agent/checkpoint.go\", \"start\": 230}\n step 18: edit_file {\"new\": \"\\tif sm, ok := series.(ActiveSeriesWithMetadata); ok {\\n\\t\\t\\t\\tif mh := sm.Metadata(); !metadata.IsZeroHandleV2(mh) {\\n\\\n step 20: read_file {\"end\": 246, \"path\": \"tsdb/agent/checkpoint.go\", \"start\": 235}\n step 22: edit_file {\"new\": \"\\tif mh := sm.Metadata(); !metadata.IsZeroHandleV2(mh) {\", \"old\": \"\\tif mh := sm.Metadata(); !metadata.IsZeroHandle(mh) {\n step 23: edit_file {\"new\": \"\\tif mh := sm.Metadata(); !metadata.IsZeroHandleV2(mh) {\\n\\t\\t\\t\\t\\tif m := mh.Value(); !m.IsEmpty() {\\n\\t\\t\\t\\t\\t\\tcf.me\n step 24: read_file {\"path\": \"tsdb/agent/checkpoint.go\"}\n step 25: read_file {\"end\": 295, \"path\": \"tsdb/agent/checkpoint.go\", \"start\": 230}\nFiles changed so far:\nmodel/metadata/metadata.go | 4 ++--\n model/metadata/metadata_test.go | 6 +++---\n scrape/scrape.go | 2 +-\n scrape/scrape_append_v2.go | 4 ++--\n tsdb/agent/checkpoint_test.go | 2 +-\n tsdb/agent/db_test.go | 2 +-\n tsdb/db_append_v2_test.go | 2 +-\n tsdb/head_append.go | 2 +-\n tsdb/head_append_v2.go | 2 +-\n tsdb/head_test.go | 2 +-\n 10 files changed, 14 insertions(+), 14 deletions(-)\nNo failing command was seen.", +"left": "storage/remote/queue_manager.go:795:\tif !metadata.IsZeroHandle(meta) {\nstorage/remote/queue_manager.go:2427:\t\tif !metadata.IsZeroHandle(d.metadata) {\ntsdb/agent/checkpoint.go:236:\t\t\tif mh := sm.Metada", +"passed": false, +"repo": "prometheus", +"task": "rename", +"target": "model::metadata::IsZeroHandle", +"mode": "base", +"seconds": 125, +"model": "qwen3.5-4b", +"set": 9 +}, +{ +"tokens_in": 104036, +"tokens_out": 2421, +"steps": 25, +"tools": { +"look": 1, +"grep": 3, +"replace_symbol": 2, +"check": 1, +"rename": 1, +"edit_file": 14, +"read_file": 3 +}, +"guard": { +"repeats": 1, +"soft_budget": 1 +}, +"stopped": "steps", +"handoff": "Task: Rename the function `IsZeroHandle` to `IsZeroHandleV2` everywhere in the project (definition and every use). The project must still compile.\nStopped: ran out of steps.\nTried (distinct actions):\n step 11: edit_file {\"new\": \"\\t\\tif !hasFamilyMeta && !metadata.IsZeroHandleV2(origMeta) && origMD.Type == model.MetricTypeUnknown && hasTypeSuffixFor\n step 12: edit_file {\"new\": \"\\tmetaChanged := metadata.IsZeroHandleV2(s.meta) || !s.meta.Value().Equals(opts.Metadata)\", \"old\": \"\\tmetaChanged := meta\n step 13: edit_file {\"new\": \"\\t\\t\\t\\trequire.False(t, metadata.IsZeroHandleV2(s100.meta))\", \"old\": \"\\t\\t\\t\\trequire.False(t, metadata.IsZeroHandle(s10\n step 14: edit_file {\"new\": \"\\trequire.True(t, metadata.IsZeroHandleV2(series4.meta))\", \"old\": \"\\trequire.True(t, metadata.IsZeroHandle(series4.meta))\n step 15: edit_file {\"new\": \"\\thasNewMetadata := metadata.IsZeroHandleV2(s.meta) || s.meta.Value() != meta\", \"old\": \"\\thasNewMetadata := metadata.IsZe\n step 16: edit_file {\"new\": \"\\t\\trequire.True(t, metadata.IsZeroHandleV2(memS.Metadata()))\", \"old\": \"\\t\\trequire.True(t, metadata.IsZeroHandle(memS.Me\n step 17: edit_file {\"new\": \"\\t\\tif !metadata.IsZeroHandleV2(g.Metadata()) {\", \"old\": \"\\t\\tif !metadata.IsZeroHandle(g.Metadata()) {\", \"path\": \"tsdb/a\n step 18: edit_file {\"new\": \"\\t\\t\\tif mh := sm.Metadata(); !metadata.IsZeroHandleV2(mh) {\", \"old\": \"\\t\\t\\tif mh := sm.Metadata(); !metadata.IsZeroHand\n step 19: read_file {\"end\": 285, \"path\": \"tsdb/agent/checkpoint.go\", \"start\": 230}\n step 20: edit_file {\"new\": \"\\t\\t\\tif sm, ok := series.(ActiveSeriesWithMetadata); ok {\\n\\t\\t\\t\\tif mh := sm.Metadata(); !metadata.IsZeroHandleV2(mh) \n step 21: read_file {\"end\": 246, \"path\": \"tsdb/agent/checkpoint.go\", \"start\": 235}\n step 22: edit_file {\"new\": \"\\tif mh := sm.Metadata(); !metadata.IsZeroHandleV2(mh) {\", \"old\": \"\\tif mh := sm.Metadata(); !metadata.IsZeroHandle(mh) {\n step 23: grep {\"path\": \"tsdb/agent/checkpoint.go\", \"pattern\": \"metadata.IsZeroHandle\"}\n step 24: read_file {\"end\": 285, \"path\": \"tsdb/agent/checkpoint.go\", \"start\": 275}\n step 25: edit_file {\"new\": \"\\tif sm, ok := series.(ActiveSeriesWithMetadata); ok {\\n\\t\\t\\t\\tif mh := sm.Metadata(); !metadata.IsZeroHandleV2(mh) {\\n\\\nFiles changed so far:\nscrape/scrape.go | 2 +-\n scrape/scrape_append_v2.go | 4 ++--\n tsdb/agent/checkpoint_test.go | 2 +-\n tsdb/agent/db_test.go | 2 +-\n tsdb/db_append_v2_test.go | 2 +-\n tsdb/head_append.go | 2 +-\n tsdb/head_append_v2.go | 2 +-\n tsdb/head_test.go | 2 +-\n 8 files changed, 9 insertions(+), 9 deletions(-)\nLast error: build FAILED N.Ns go build ./... && go test -count=N -run '^$' ./... >/dev/null | \u2717 error scrape/scrape.go:N (\u00d7N) | undefined: metadata.IsZeroHandle", +"left": "model/metadata/metadata.go:23:// IsZeroHandle returns true if h is the zero handle, i.e. no metadata was set.\nmodel/metadata/metadata.go:24:func IsZeroHandle(h unique.Handle[Metadata]) bool {\nmodel/me", +"passed": false, +"repo": "prometheus", +"task": "rename", +"target": "model::metadata::IsZeroHandle", +"mode": "gitnext", +"seconds": 102, +"model": "qwen3.5-4b", +"set": 9 +}, +{ +"tokens_in": 5847, +"tokens_out": 173, +"steps": 4, +"tools": { +"look": 1, +"rename": 1, +"check": 1, +"finish": 1 +}, +"guard": {}, +"left": "", +"passed": true, +"repo": "prometheus", +"task": "rename", +"target": "model::metadata::IsZeroHandle", +"mode": "lite", +"seconds": 296, +"model": "qwen3.5-4b", +"set": 9 +} +] \ No newline at end of file diff --git a/eval/results/heldout-lsp-refined.compare.md b/eval/results/heldout-lsp-refined.compare.md new file mode 100644 index 0000000..e782c21 --- /dev/null +++ b/eval/results/heldout-lsp-refined.compare.md @@ -0,0 +1,102 @@ +# heldout (A) → heldout-lsp-refined (B) + +Paired: each function is measured by both versions, the difference B − A is taken per function, and the 90% interval comes from drawing the functions again (within each repo). `better` / `worse`: the whole interval is on one side of zero. `can't tell`: it covers zero. `same`: no function changed. `< 0.5 pt`: the whole interval is within half a point. `changed`: functions whose value differs — a difference rests on them alone, read them below. `± alone`: the noise of one version on its own (as in latest.md): two separate runs would need a difference that large. + +Not paired: +- boltons: only in A (or failed in the other run) — left out +- itsdangerous: only in A (or failed in the other run) — left out +- marshmallow: only in A (or failed in the other run) — left out +- more-itertools: only in A (or failed in the other run) — left out +- pathe: only in A (or failed in the other run) — left out +- ufo: only in A (or failed in the other run) — left out + +## All repos + +| metric | functions | changed | A | B | B − A, points | 90% interval | ± alone | verdict | +|---|---:|---:|---:|---:|---:|---:|---:|---| +| callers recall | 85 | 0 | 98.9% | 98.9% | +0.0 | +0.0 … +0.0 | ±1.1 | **same** | +| callers precision | 85 | 0 | 94.1% | 94.1% | +0.0 | +0.0 … +0.0 | ±3.6 | **same** | +| callers recall, picked blind | 66 | 0 | 85.3% | 85.3% | +0.0 | +0.0 … +0.0 | ±7.0 | **same** | +| shared names: recall | 108 | 23 | 72.7% | 92.7% | +19.9 | +14.8 … +25.0 | ±6.4 | **better** | +| shared names: recall with maybe | 108 | 0 | 93.6% | 93.6% | +0.0 | +0.0 … +0.0 | ±3.1 | **same** | +| shared names: precision | 86 | 1 | 98.8% | 98.6% | -0.2 | -0.7 … +0.0 | ±1.7 | **can't tell** | +| rename ok (tests pass) | 103 | 0 | 81.6% | 81.6% | +0.0 | +0.0 … +0.0 | ±6.3 | **same** | +| tests recall | 63 | 11 | 68.2% | 71.7% | +3.4 | +1.3 … +5.9 | ±8.0 | **better** | +| tests precision | 63 | 15 | 64.1% | 67.6% | +3.5 | +0.1 … +7.2 | ±7.9 | **better** | +| top-10 that fail | 63 | 7 | 69.6% | 73.3% | +3.7 | +0.4 … +7.5 | ±7.9 | **better** | +| … best possible order | 63 | 6 | 73.6% | 77.6% | +4.0 | +0.7 … +7.8 | ±7.7 | **better** | +| caught by the top 10 | 63 | 4 | 92.1% | 98.4% | +6.3 | +1.6 … +11.1 | ±5.6 | **better** | +| look / file | 103 | 29 | 14.3% | 14.9% | +0.7 | +0.2 … +1.3 | ±3.7 | **better** | + +## go + +| metric | functions | changed | A | B | B − A, points | 90% interval | ± alone | verdict | +|---|---:|---:|---:|---:|---:|---:|---:|---| +| callers recall | 39 | 0 | 97.6% | 97.6% | +0.0 | +0.0 … +0.0 | ±2.2 | **same** | +| callers precision | 39 | 0 | 93.8% | 93.8% | +0.0 | +0.0 … +0.0 | ±4.9 | **same** | +| callers recall, picked blind | 30 | 0 | 84.3% | 84.3% | +0.0 | +0.0 … +0.0 | ±10.5 | **same** | +| shared names: recall | 90 | 22 | 70.4% | 93.2% | +22.8 | +17.2 … +28.3 | ±7.2 | **better** | +| shared names: recall with maybe | 90 | 0 | 94.3% | 94.3% | +0.0 | +0.0 … +0.0 | ±3.3 | **same** | +| shared names: precision | 69 | 1 | 98.6% | 98.3% | -0.3 | -0.9 … +0.0 | ±2.2 | **can't tell** | +| rename ok (tests pass) | 41 | 0 | 78.0% | 78.0% | +0.0 | +0.0 … +0.0 | ±11.0 | **same** | +| tests recall | 29 | 7 | 62.1% | 66.6% | +4.5 | +0.4 … +9.4 | ±11.9 | **better** | +| tests precision | 29 | 8 | 59.2% | 58.0% | -1.1 | -3.1 … -0.1 | ±11.7 | **worse** | +| top-10 that fail | 29 | 1 | 65.4% | 64.7% | -0.7 | -2.1 … +0.0 | ±11.4 | **can't tell** | +| … best possible order | 29 | 0 | 71.6% | 71.6% | +0.0 | +0.0 … +0.0 | ±11.0 | **same** | +| caught by the top 10 | 29 | 0 | 100.0% | 100.0% | +0.0 | +0.0 … +0.0 | ±0.0 | **same** | +| look / file | 41 | 19 | 11.8% | 11.9% | +0.1 | +0.0 … +0.2 | ±3.5 | **< 0.5 pt** | + +## rust + +| metric | functions | changed | A | B | B − A, points | 90% interval | ± alone | verdict | +|---|---:|---:|---:|---:|---:|---:|---:|---| +| callers recall | 46 | 0 | 100.0% | 100.0% | +0.0 | +0.0 … +0.0 | ±0.0 | **same** | +| callers precision | 46 | 0 | 94.3% | 94.3% | +0.0 | +0.0 … +0.0 | ±5.0 | **same** | +| callers recall, picked blind | 36 | 0 | 86.1% | 86.1% | +0.0 | +0.0 … +0.0 | ±9.7 | **same** | +| shared names: recall | 18 | 1 | 84.3% | 89.8% | +5.6 | +0.0 … +16.7 | ±11.1 | **can't tell** | +| shared names: recall with maybe | 18 | 0 | 89.8% | 89.8% | +0.0 | +0.0 … +0.0 | ±7.9 | **same** | +| shared names: precision | 17 | 0 | 100.0% | 100.0% | +0.0 | +0.0 … +0.0 | ±0.0 | **same** | +| rename ok (tests pass) | 62 | 0 | 83.9% | 83.9% | +0.0 | +0.0 … +0.0 | ±8.1 | **same** | +| tests recall | 34 | 4 | 73.5% | 76.0% | +2.5 | +0.6 … +4.9 | ±11.1 | **better** | +| tests precision | 34 | 7 | 68.4% | 75.8% | +7.4 | +1.1 … +15.1 | ±10.8 | **better** | +| top-10 that fail | 34 | 6 | 73.2% | 80.7% | +7.5 | +1.2 … +15.1 | ±10.9 | **better** | +| … best possible order | 34 | 6 | 75.3% | 82.7% | +7.5 | +1.2 … +15.1 | ±10.7 | **better** | +| caught by the top 10 | 34 | 4 | 85.3% | 97.1% | +11.8 | +2.9 … +20.6 | ±10.3 | **better** | +| look / file | 62 | 10 | 15.9% | 16.9% | +1.1 | +0.2 … +2.1 | ±5.6 | **better** | + +## Per repo (metrics where a function changed) + +| repo | metric | functions | changed | A | B | B − A | 90% interval | verdict | +|---|---|---:|---:|---:|---:|---:|---:|---| +| itertools | shared names: recall | 13 | 1 | 88.5% | 96.2% | +7.7 | +0.0 … +23.1 | can't tell | +| itertools | tests recall | 23 | 4 | 60.8% | 64.5% | +3.7 | +0.9 … +7.2 | better | +| itertools | tests precision | 23 | 7 | 65.2% | 76.1% | +11.0 | +1.6 … +21.8 | better | +| itertools | top-10 that fail | 23 | 6 | 65.4% | 76.4% | +11.0 | +1.7 … +21.9 | better | +| itertools | … best possible order | 23 | 6 | 68.4% | 79.5% | +11.0 | +1.7 … +21.9 | better | +| itertools | caught by the top 10 | 23 | 4 | 78.3% | 95.7% | +17.4 | +4.3 … +30.4 | better | +| itertools | look / file | 47 | 10 | 19.5% | 20.9% | +1.4 | +0.3 … +2.7 | better | +| logrus | shared names: recall | 41 | 20 | 48.8% | 93.9% | +45.1 | +34.1 … +57.3 | better | +| logrus | shared names: precision | 22 | 1 | 100.0% | 99.1% | -0.9 | -2.7 … +0.0 | can't tell | +| logrus | tests recall | 5 | 3 | 59.0% | 66.7% | +7.8 | +0.4 … +21.1 | better | +| logrus | tests precision | 5 | 3 | 64.7% | 63.9% | -0.8 | -1.3 … -0.2 | worse | +| logrus | look / file | 6 | 4 | 8.6% | 8.6% | -0.1 | -0.1 … -0.0 | < 0.5 pt | +| mux | tests recall | 4 | 1 | 68.5% | 89.8% | +21.2 | +0.0 … +42.5 | can't tell | +| mux | tests precision | 4 | 1 | 100.0% | 92.6% | -7.4 | -14.7 … +0.0 | can't tell | +| mux | top-10 that fail | 4 | 1 | 100.0% | 95.0% | -5.0 | -10.0 … +0.0 | can't tell | +| mux | look / file | 5 | 1 | 4.4% | 4.7% | +0.3 | +0.0 … +1.0 | can't tell | +| pflag | look / file | 11 | 7 | 10.0% | 10.0% | +0.0 | -0.1 … +0.1 | < 0.5 pt | +| urfave-cli | shared names: recall | 5 | 2 | 60.0% | 100.0% | +40.0 | +0.0 … +80.0 | can't tell | +| urfave-cli | tests recall | 13 | 3 | 40.9% | 41.5% | +0.6 | +0.1 … +1.1 | better | +| urfave-cli | tests precision | 13 | 4 | 41.9% | 41.9% | -0.0 | -0.0 … +0.0 | < 0.5 pt | +| urfave-cli | look / file | 19 | 7 | 15.9% | 15.9% | +0.1 | +0.0 … +0.1 | < 0.5 pt | + +## Functions that changed (up to 10 per metric, largest first) + +- **shared names: recall** (23): itertools `itertools::Itertools::minmax_by` 0% → 100%; logrus `main::Logger::Panicln` 0% → 100%; logrus `main::Logger::Infoln` 0% → 100%; logrus `main::Logger::Errorln` 0% → 100%; logrus `main::Logger::Info` 0% → 100%; logrus `main::Logger::WithField` 0% → 100%; logrus `main::Logger::Println` 0% → 100%; logrus `main::Logger::WithContext` 0% → 100%; logrus `main::Logger::Debugf` 0% → 100%; logrus `main::Logger::Error` 0% → 100% +- **shared names: precision** (1): logrus `main::Level::String` 100% → 80% +- **tests recall** (11): mux `main::Route::GetHandlerWithMiddlewares` 5% → 90%; logrus `main::NewEntry` 50% → 85%; itertools `itertools::size_hint::mul_scalar` 0% → 33%; itertools `itertools::adaptors::checked_binomial` 0% → 27%; itertools `itertools::minmax::minmax_impl` 0% → 20%; itertools `itertools::lazy_buffer::LazyBuffer::get_at` 0% → 6%; urfave-cli `main::Command::Walk` 93% → 96%; urfave-cli `main::Command::Lineage` 28% → 30%; urfave-cli `main::HandleExitCoder` 98% → 100%; logrus `main::mutexWrap::Lock` 60% → 62% +- **tests precision** (15): itertools `itertools::minmax::minmax_impl` 0% → 100%; itertools `itertools::adaptors::checked_binomial` 0% → 80%; itertools `itertools::lazy_buffer::LazyBuffer::get_at` 0% → 50%; itertools `itertools::size_hint::mul_scalar` 0% → 50%; mux `main::Route::GetHandlerWithMiddlewares` 100% → 71%; itertools `itertools::heap::sift_down` 100% → 83%; itertools `itertools::next_array::ArrayBuilder::push` 60% → 50%; logrus `main::mutexWrap::Lock` 84% → 82%; logrus `main::mutexWrap::Unlock` 84% → 82%; itertools `itertools::next_array::ArrayBuilder::take` 7% → 6% +- **top-10 that fail** (7): itertools `itertools::minmax::minmax_impl` 0% → 100%; itertools `itertools::adaptors::checked_binomial` 0% → 80%; itertools `itertools::lazy_buffer::LazyBuffer::get_at` 0% → 50%; itertools `itertools::size_hint::mul_scalar` 0% → 50%; mux `main::Route::GetHandlerWithMiddlewares` 100% → 80%; itertools `itertools::heap::sift_down` 100% → 83%; itertools `itertools::next_array::ArrayBuilder::push` 60% → 50% +- **… best possible order** (6): itertools `itertools::minmax::minmax_impl` 0% → 100%; itertools `itertools::adaptors::checked_binomial` 0% → 80%; itertools `itertools::lazy_buffer::LazyBuffer::get_at` 0% → 50%; itertools `itertools::size_hint::mul_scalar` 0% → 50%; itertools `itertools::heap::sift_down` 100% → 83%; itertools `itertools::next_array::ArrayBuilder::push` 60% → 50% +- **caught by the top 10** (4): itertools `itertools::adaptors::checked_binomial` 0% → 100%; itertools `itertools::lazy_buffer::LazyBuffer::get_at` 0% → 100%; itertools `itertools::size_hint::mul_scalar` 0% → 100%; itertools `itertools::minmax::minmax_impl` 0% → 100% +- **look / file** (29): itertools `itertools::lazy_buffer::LazyBuffer::get_next` 50% → 78%; itertools `itertools::size_hint::add_scalar` 41% → 58%; itertools `itertools::lazy_buffer::LazyBuffer::get_at` 29% → 40%; itertools `itertools::size_hint::mul_scalar` 26% → 31%; itertools `itertools::minmax::minmax_impl` 72% → 74%; mux `main::Route::GetHandlerWithMiddlewares` 4% → 5%; itertools `itertools::adaptors::checked_binomial` 4% → 5%; itertools `itertools::either_or_both::EitherOrBoth::or_else` 9% → 10%; itertools `itertools::heap::sift_down` 114% → 115%; urfave-cli `main::ValueSourceChain::EnvKeys` 16% → 17% diff --git a/eval/results/heldout-lsp-refined.json b/eval/results/heldout-lsp-refined.json new file mode 100644 index 0000000..8ab0c55 --- /dev/null +++ b/eval/results/heldout-lsp-refined.json @@ -0,0 +1,12365 @@ +[ + { + "repo": "pflag", + "lang": "go", + "commit": "046b0d889369", + "index_seconds": 0.1, + "symbols": 756, + "files": 44, + "seeds": [ + 7, + 8, + 9 + ], + "edges": 4738, + "sample": [ + "main::FlagSet::Output", + "main::NewFlagSet", + "main::FlagSet::FlagUsagesWrapped", + "main::FlagSet::GetNormalizeFunc", + "main::FlagSet::FlagUsages", + "main::FlagSet::AddGoFlag", + "main::PFlagFromGoFlag", + "main::FlagSet::VarPF", + "main::FlagSet::AddFlag", + "main::UnquoteUsage", + "main::ParseIPv4Mask" + ], + "sample_common": [ + "main::FlagSet::StringToIntVarP", + "main::FlagSet::BoolVarP", + "main::FlagSet::StringArrayVarP", + "main::FlagSet::IPNetSliceVarP", + "main::InvalidValueError::Error", + "main::FlagSet::StringSliceVarP", + "main::FlagSet::Uint16VarP", + "main::FlagSet::IntVar", + "main::FlagSet::Lookup", + "main::FlagSet::Float32VarP", + "main::FlagSet::Int64Var", + "main::FlagSet::StringToInt64VarP", + "main::FlagSet::Uint64VarP", + "main::FlagSet::Uint64Var", + "main::FlagSet::Uint32VarP", + "main::FlagSet::DurationSliceVarP", + "main::FlagSet::Float64SliceVarP", + "main::FlagSet::Parse", + "main::FlagSet::BoolP", + "main::FlagSet::IntVarP", + "main::FlagSet::IPNetVarP", + "main::FlagSet::IPVarP", + "main::unknownFlagError::Error", + "main::FlagSet::UintVar", + "main::FlagSet::BytesBase64VarP", + "main::FlagSet::StringToStringVarP", + "main::FlagSet::Int64VarP", + "main::FlagSet::DurationVarP", + "main::FlagSet::StringVar", + "main::FlagSet::Int16VarP", + "main::FlagSet::StringVarP", + "main::InvalidSyntaxError::Error", + "main::FlagSet::Float64Var", + "main::FlagSet::UintSliceVarP", + "main::FlagSet::TimeVarP", + "main::FlagSet::Int8VarP", + "main::FlagSet::VarP", + "main::FlagSet::Float32SliceVarP", + "main::FlagSet::TimeP", + "main::FlagSet::BoolSliceVarP", + "main::FlagSet::UintVarP", + "main::FlagSet::IPSliceVarP", + "main::FlagSet::PrintDefaults" + ], + "samples": { + "7": [ + "main::FlagSet::Output", + "main::NewFlagSet", + "main::FlagSet::FlagUsagesWrapped", + "main::FlagSet::GetNormalizeFunc", + "main::FlagSet::FlagUsages", + "main::FlagSet::AddGoFlag", + "main::PFlagFromGoFlag", + "main::FlagSet::VarPF", + "main::FlagSet::AddFlag", + "main::UnquoteUsage", + "main::ParseIPv4Mask" + ], + "8": [ + "main::FlagSet::AddFlag", + "main::UnquoteUsage", + "main::FlagSet::GetNormalizeFunc", + "main::PFlagFromGoFlag", + "main::FlagSet::VarPF", + "main::FlagSet::Output", + "main::FlagSet::AddGoFlag", + "main::ParseIPv4Mask", + "main::FlagSet::FlagUsages", + "main::FlagSet::FlagUsagesWrapped", + "main::NewFlagSet" + ], + "9": [ + "main::FlagSet::AddGoFlag", + "main::FlagSet::GetNormalizeFunc", + "main::FlagSet::VarPF", + "main::FlagSet::Output", + "main::ParseIPv4Mask", + "main::FlagSet::FlagUsages", + "main::FlagSet::AddFlag", + "main::FlagSet::FlagUsagesWrapped", + "main::PFlagFromGoFlag", + "main::NewFlagSet", + "main::UnquoteUsage" + ] + }, + "samples_common": { + "7": [ + "main::FlagSet::StringToIntVarP", + "main::FlagSet::BoolVarP", + "main::FlagSet::StringArrayVarP", + "main::FlagSet::IPNetSliceVarP", + "main::InvalidValueError::Error", + "main::FlagSet::StringSliceVarP", + "main::FlagSet::Uint16VarP", + "main::FlagSet::IntVar", + "main::FlagSet::Lookup", + "main::FlagSet::Float32VarP", + "main::FlagSet::Int64Var", + "main::FlagSet::StringToInt64VarP", + "main::FlagSet::Uint64VarP", + "main::FlagSet::Uint64Var", + "main::FlagSet::Uint32VarP", + "main::FlagSet::DurationSliceVarP", + "main::FlagSet::Float64SliceVarP", + "main::FlagSet::Parse", + "main::FlagSet::BoolP", + "main::FlagSet::IntVarP" + ], + "8": [ + "main::FlagSet::IPNetVarP", + "main::FlagSet::IPNetSliceVarP", + "main::FlagSet::IPVarP", + "main::unknownFlagError::Error", + "main::FlagSet::Float32VarP", + "main::FlagSet::UintVar", + "main::FlagSet::BytesBase64VarP", + "main::FlagSet::StringToStringVarP", + "main::FlagSet::Int64VarP", + "main::FlagSet::DurationVarP", + "main::FlagSet::Lookup", + "main::FlagSet::StringVar", + "main::FlagSet::Int16VarP", + "main::FlagSet::Uint16VarP", + "main::FlagSet::Parse", + "main::FlagSet::StringToInt64VarP", + "main::FlagSet::StringVarP", + "main::FlagSet::IntVarP", + "main::FlagSet::Uint64Var", + "main::FlagSet::BoolP" + ], + "9": [ + "main::InvalidSyntaxError::Error", + "main::FlagSet::Float64Var", + "main::FlagSet::StringToStringVarP", + "main::FlagSet::IPNetVarP", + "main::FlagSet::StringSliceVarP", + "main::FlagSet::UintSliceVarP", + "main::FlagSet::TimeVarP", + "main::FlagSet::StringVarP", + "main::FlagSet::Int8VarP", + "main::FlagSet::VarP", + "main::FlagSet::DurationVarP", + "main::FlagSet::Float32SliceVarP", + "main::FlagSet::TimeP", + "main::FlagSet::IntVarP", + "main::FlagSet::UintVar", + "main::FlagSet::BoolSliceVarP", + "main::FlagSet::DurationSliceVarP", + "main::FlagSet::UintVarP", + "main::FlagSet::IPSliceVarP", + "main::FlagSet::PrintDefaults" + ] + }, + "samples_blind": { + "7": [ + "main::FlagSet::SetNormalizeFunc", + "main::FlagSet::Init", + "main::FlagSet::GetBoolSlice", + "main::FlagSet::GetIPSlice", + "main::FlagSet::Output", + "main::NewFlagSet", + "main::FlagSet::FlagUsagesWrapped", + "main::FlagSet::Changed", + "main::FlagSet::GetUint8", + "main::FlagSet::GetStringSlice", + "main::FlagSet::GetInt32Slice", + "main::FlagSet::HasAvailableFlags", + "main::FlagSet::GetTime", + "main::FlagSet::GetBool", + "main::ParseSkippedFlags", + "main::FlagSet::GetFloat64", + "main::FlagSet::GetStringToString", + "main::FlagSet::GetNormalizeFunc", + "main::FlagSet::GetText", + "main::FlagSet::MarkHidden" + ], + "8": [ + "main::FlagSet::MarkDeprecated", + "main::FlagSet::GetInt32Slice", + "main::FlagSet::GetBool", + "main::FlagSet::MarkHidden", + "main::FlagSet::AddFlag", + "main::FlagSet::GetStringArray", + "main::FlagSet::GetStringToString", + "main::ParseSkippedFlags", + "main::UnquoteUsage", + "main::FlagSet::GetIPNetSlice", + "main::InvalidSyntaxError::GetSpecifiedFlag", + "main::FlagSet::GetIPSlice", + "main::FlagSet::AddFlagSet", + "main::FlagSet::GetNormalizeFunc", + "main::FlagSet::Changed", + "main::PFlagFromGoFlag", + "main::FlagSet::GetInt64", + "main::FlagSet::GetInt32", + "main::FlagSet::GetStringSlice", + "main::FlagSet::CopyToGoFlagSet" + ], + "9": [ + "main::FlagSet::GetInt16", + "main::InvalidSyntaxError::GetSpecifiedFlag", + "main::FlagSet::GetString", + "main::FlagSet::GetUint", + "main::FlagSet::Changed", + "main::FlagSet::AddGoFlag", + "main::FlagSet::GetFloat32", + "main::FlagSet::GetNormalizeFunc", + "main::FlagSet::HasAvailableFlags", + "main::FlagSet::MarkShorthandDeprecated", + "main::FlagSet::GetInt", + "main::FlagSet::GetFloat64", + "main::FlagSet::GetIPv4Mask", + "main::FlagSet::GetIPNet", + "main::FlagSet::GetUint32", + "main::FlagSet::Init", + "main::FlagSet::MarkHidden", + "main::FlagSet::GetIPSlice", + "main::FlagSet::GetText", + "main::FlagSet::VarPF" + ] + }, + "baseline_failing_tests": [], + "callers": [ + { + "symbol": "main::FlagSet::Output", + "truth": [ + "main::FlagSet::AddFlag", + "main::FlagSet::Parse", + "main::FlagSet::ParseAll", + "main::FlagSet::PrintDefaults", + "main::FlagSet::Set", + "main::FlagSet::ShorthandLookup", + "main::FlagSet::parseSingleShortArg", + "main::defaultUsage" + ], + "found": [ + "main::FlagSet::AddFlag", + "main::FlagSet::Parse", + "main::FlagSet::ParseAll", + "main::FlagSet::PrintDefaults", + "main::FlagSet::Set", + "main::FlagSet::ShorthandLookup", + "main::FlagSet::parseSingleShortArg", + "main::defaultUsage" + ], + "maybe": [], + "import_files": [ + "flag.go" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::NewFlagSet", + "truth": [], + "found": [ + "main" + ], + "maybe": [], + "import_files": [ + "bool_func_go1.21_test.go", + "flag.go", + "func_go1.21_test.go" + ], + "recall": null, + "precision": 0.0, + "recall_with_maybe": null + }, + { + "symbol": "main::FlagSet::FlagUsagesWrapped", + "truth": [ + "main::FlagSet::FlagUsages" + ], + "found": [ + "main::FlagSet::FlagUsages" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::FlagSet::GetNormalizeFunc", + "truth": [ + "main::FlagSet::normalizeFlagName" + ], + "found": [ + "main::FlagSet::normalizeFlagName" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::FlagSet::FlagUsages", + "truth": [ + "main::FlagSet::PrintDefaults" + ], + "found": [ + "main::FlagSet::PrintDefaults" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::FlagSet::AddGoFlag", + "truth": [ + "main::FlagSet::AddGoFlagSet" + ], + "found": [ + "main::FlagSet::AddGoFlagSet" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::PFlagFromGoFlag", + "truth": [ + "main::FlagSet::AddGoFlag" + ], + "found": [ + "main::FlagSet::AddGoFlag" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::FlagSet::VarPF", + "truth": [ + "main::BoolVarP", + "main::FlagSet::BoolFuncP", + "main::FlagSet::BoolVarP", + "main::FlagSet::CountVarP", + "main::FlagSet::VarP" + ], + "found": [ + "main::FlagSet::BoolFuncP", + "main::FlagSet::BoolVarP", + "main::FlagSet::CountVarP", + "main::FlagSet::VarP" + ], + "maybe": [], + "import_files": [], + "recall": 0.8, + "precision": 1.0, + "recall_with_maybe": 0.8 + }, + { + "symbol": "main::FlagSet::AddFlag", + "truth": [ + "main::FlagSet::AddFlagSet", + "main::FlagSet::AddGoFlag", + "main::FlagSet::VarPF" + ], + "found": [ + "main::FlagSet::AddFlagSet", + "main::FlagSet::AddGoFlag", + "main::FlagSet::VarPF" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::UnquoteUsage", + "truth": [ + "main::FlagSet::FlagUsagesWrapped" + ], + "found": [ + "main::FlagSet::FlagUsagesWrapped" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::ParseIPv4Mask", + "truth": [ + "main::ipMaskValue::Set", + "main::parseIPv4Mask" + ], + "found": [ + "main::ipMaskValue::Set", + "main::parseIPv4Mask" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + } + ], + "callers_common": [ + { + "symbol": "main::FlagSet::StringToIntVarP", + "truth": [ + "main::FlagSet::StringToInt", + "main::FlagSet::StringToIntP" + ], + "found": [ + "main::FlagSet::StringToInt", + "main::FlagSet::StringToIntP" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::FlagSet::BoolVarP", + "truth": [ + "main::FlagSet::BoolP", + "main::FlagSet::BoolVar" + ], + "found": [ + "main::FlagSet::BoolP", + "main::FlagSet::BoolVar" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::FlagSet::StringArrayVarP", + "truth": [ + "main::FlagSet::StringArray", + "main::FlagSet::StringArrayP" + ], + "found": [ + "main::FlagSet::StringArray", + "main::FlagSet::StringArrayP" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::FlagSet::IPNetSliceVarP", + "truth": [ + "main::FlagSet::IPNetSlice", + "main::FlagSet::IPNetSliceP" + ], + "found": [ + "main::FlagSet::IPNetSlice", + "main::FlagSet::IPNetSliceP" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::InvalidValueError::Error", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::FlagSet::StringSliceVarP", + "truth": [ + "main::FlagSet::StringSlice", + "main::FlagSet::StringSliceP" + ], + "found": [ + "main::FlagSet::StringSlice", + "main::FlagSet::StringSliceP" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::FlagSet::Uint16VarP", + "truth": [ + "main::FlagSet::Uint16", + "main::FlagSet::Uint16P" + ], + "found": [ + "main::FlagSet::Uint16", + "main::FlagSet::Uint16P" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::FlagSet::IntVar", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::FlagSet::Lookup", + "truth": [ + "main::FlagSet::AddFlagSet", + "main::FlagSet::AddGoFlag", + "main::FlagSet::Changed", + "main::FlagSet::GetText", + "main::FlagSet::GetTime", + "main::FlagSet::MarkDeprecated", + "main::FlagSet::MarkHidden", + "main::FlagSet::MarkShorthandDeprecated", + "main::FlagSet::getFlagType", + "main::Lookup" + ], + "found": [ + "main::FlagSet::AddFlagSet", + "main::FlagSet::AddGoFlag", + "main::FlagSet::Changed", + "main::FlagSet::GetText", + "main::FlagSet::GetTime", + "main::FlagSet::MarkDeprecated", + "main::FlagSet::MarkHidden", + "main::FlagSet::MarkShorthandDeprecated", + "main::FlagSet::getFlagType" + ], + "maybe": [], + "import_files": [], + "recall": 0.9, + "precision": 1.0, + "recall_with_maybe": 0.9 + }, + { + "symbol": "main::FlagSet::Float32VarP", + "truth": [ + "main::FlagSet::Float32", + "main::FlagSet::Float32P" + ], + "found": [ + "main::FlagSet::Float32", + "main::FlagSet::Float32P" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::FlagSet::Int64Var", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::FlagSet::StringToInt64VarP", + "truth": [ + "main::FlagSet::StringToInt64", + "main::FlagSet::StringToInt64P" + ], + "found": [ + "main::FlagSet::StringToInt64", + "main::FlagSet::StringToInt64P" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::FlagSet::Uint64VarP", + "truth": [ + "main::FlagSet::Uint64", + "main::FlagSet::Uint64P" + ], + "found": [ + "main::FlagSet::Uint64", + "main::FlagSet::Uint64P" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::FlagSet::Uint64Var", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::FlagSet::Uint32VarP", + "truth": [ + "main::FlagSet::Uint32", + "main::FlagSet::Uint32P" + ], + "found": [ + "main::FlagSet::Uint32", + "main::FlagSet::Uint32P" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::FlagSet::DurationSliceVarP", + "truth": [ + "main::FlagSet::DurationSlice", + "main::FlagSet::DurationSliceP" + ], + "found": [ + "main::FlagSet::DurationSlice", + "main::FlagSet::DurationSliceP" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::FlagSet::Float64SliceVarP", + "truth": [ + "main::FlagSet::Float64Slice", + "main::FlagSet::Float64SliceP" + ], + "found": [ + "main::FlagSet::Float64Slice", + "main::FlagSet::Float64SliceP" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::FlagSet::Parse", + "truth": [ + "main::Parse" + ], + "found": [ + "main::ParseSkippedFlags" + ], + "maybe": [], + "import_files": [], + "recall": 0.0, + "precision": 0.0, + "recall_with_maybe": 0.0 + }, + { + "symbol": "main::FlagSet::BoolP", + "truth": [ + "main::BoolP", + "main::FlagSet::Bool" + ], + "found": [ + "main::FlagSet::Bool" + ], + "maybe": [], + "import_files": [], + "recall": 0.5, + "precision": 1.0, + "recall_with_maybe": 0.5 + }, + { + "symbol": "main::FlagSet::IntVarP", + "truth": [ + "main::FlagSet::Int", + "main::FlagSet::IntP" + ], + "found": [ + "main::FlagSet::Int", + "main::FlagSet::IntP" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::FlagSet::IPNetVarP", + "truth": [ + "main::FlagSet::IPNet", + "main::FlagSet::IPNetP" + ], + "found": [ + "main::FlagSet::IPNet", + "main::FlagSet::IPNetP" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::FlagSet::IPVarP", + "truth": [ + "main::FlagSet::IP", + "main::FlagSet::IPP" + ], + "found": [ + "main::FlagSet::IP", + "main::FlagSet::IPP" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::unknownFlagError::Error", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::FlagSet::UintVar", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::FlagSet::BytesBase64VarP", + "truth": [ + "main::FlagSet::BytesBase64", + "main::FlagSet::BytesBase64P" + ], + "found": [ + "main::FlagSet::BytesBase64", + "main::FlagSet::BytesBase64P" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::FlagSet::StringToStringVarP", + "truth": [ + "main::FlagSet::StringToString", + "main::FlagSet::StringToStringP" + ], + "found": [ + "main::FlagSet::StringToString", + "main::FlagSet::StringToStringP" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::FlagSet::Int64VarP", + "truth": [ + "main::FlagSet::Int64", + "main::FlagSet::Int64P" + ], + "found": [ + "main::FlagSet::Int64", + "main::FlagSet::Int64P" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::FlagSet::DurationVarP", + "truth": [ + "main::FlagSet::Duration", + "main::FlagSet::DurationP" + ], + "found": [ + "main::FlagSet::Duration", + "main::FlagSet::DurationP" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::FlagSet::StringVar", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::FlagSet::Int16VarP", + "truth": [ + "main::FlagSet::Int16", + "main::FlagSet::Int16P" + ], + "found": [ + "main::FlagSet::Int16", + "main::FlagSet::Int16P" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::FlagSet::StringVarP", + "truth": [ + "main::FlagSet::String", + "main::FlagSet::StringP" + ], + "found": [ + "main::FlagSet::String", + "main::FlagSet::StringP" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::InvalidSyntaxError::Error", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::FlagSet::Float64Var", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::FlagSet::UintSliceVarP", + "truth": [ + "main::FlagSet::UintSlice", + "main::FlagSet::UintSliceP" + ], + "found": [ + "main::FlagSet::UintSlice", + "main::FlagSet::UintSliceP" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::FlagSet::TimeVarP", + "truth": [ + "main::FlagSet::TimeP", + "main::FlagSet::TimeVar", + "main::TimeVar" + ], + "found": [ + "main::FlagSet::TimeP", + "main::FlagSet::TimeVar" + ], + "maybe": [], + "import_files": [], + "recall": 0.6666666666666666, + "precision": 1.0, + "recall_with_maybe": 0.6666666666666666 + }, + { + "symbol": "main::FlagSet::Int8VarP", + "truth": [ + "main::FlagSet::Int8", + "main::FlagSet::Int8P" + ], + "found": [ + "main::FlagSet::Int8", + "main::FlagSet::Int8P" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::FlagSet::VarP", + "truth": [ + "main::BoolSliceVar", + "main::BoolSliceVarP", + "main::BytesBase64Var", + "main::BytesBase64VarP", + "main::BytesHexVar", + "main::BytesHexVarP", + "main::DurationSliceVar", + "main::DurationSliceVarP", + "main::DurationVar", + "main::DurationVarP", + "main::FlagSet::BoolSliceVar", + "main::FlagSet::BoolSliceVarP", + "main::FlagSet::BytesBase64Var", + "main::FlagSet::BytesBase64VarP", + "main::FlagSet::BytesHexVar", + "main::FlagSet::BytesHexVarP", + "main::FlagSet::DurationSliceVar", + "main::FlagSet::DurationSliceVarP", + "main::FlagSet::DurationVar", + "main::FlagSet::DurationVarP", + "main::FlagSet::Float32SliceVar", + "main::FlagSet::Float32SliceVarP", + "main::FlagSet::Float32Var", + "main::FlagSet::Float32VarP", + "main::FlagSet::Float64SliceVar", + "main::FlagSet::Float64SliceVarP", + "main::FlagSet::Float64Var", + "main::FlagSet::Float64VarP", + "main::FlagSet::FuncP", + "main::FlagSet::IPMaskVar", + "main::FlagSet::IPMaskVarP", + "main::FlagSet::IPNetSliceVar", + "main::FlagSet::IPNetSliceVarP", + "main::FlagSet::IPNetVar", + "main::FlagSet::IPNetVarP", + "main::FlagSet::IPSliceVar", + "main::FlagSet::IPSliceVarP", + "main::FlagSet::IPVar", + "main::FlagSet::IPVarP", + "main::FlagSet::Int16Var", + "main::FlagSet::Int16VarP", + "main::FlagSet::Int32SliceVar", + "main::FlagSet::Int32SliceVarP", + "main::FlagSet::Int32Var", + "main::FlagSet::Int32VarP", + "main::FlagSet::Int64SliceVar", + "main::FlagSet::Int64SliceVarP", + "main::FlagSet::Int64Var", + "main::FlagSet::Int64VarP", + "main::FlagSet::Int8Var", + "main::FlagSet::Int8VarP", + "main::FlagSet::IntSliceVar", + "main::FlagSet::IntSliceVarP", + "main::FlagSet::IntVar", + "main::FlagSet::IntVarP", + "main::FlagSet::StringArrayVar", + "main::FlagSet::StringArrayVarP", + "main::FlagSet::StringSliceVar", + "main::FlagSet::StringSliceVarP", + "main::FlagSet::StringToInt64Var", + "main::FlagSet::StringToInt64VarP", + "main::FlagSet::StringToIntVar", + "main::FlagSet::StringToIntVarP", + "main::FlagSet::StringToStringVar", + "main::FlagSet::StringToStringVarP", + "main::FlagSet::StringVar", + "main::FlagSet::StringVarP", + "main::FlagSet::TextVar", + "main::FlagSet::TextVarP", + "main::FlagSet::TimeVarP", + "main::FlagSet::Uint16Var", + "main::FlagSet::Uint16VarP", + "main::FlagSet::Uint32Var", + "main::FlagSet::Uint32VarP", + "main::FlagSet::Uint64Var", + "main::FlagSet::Uint64VarP", + "main::FlagSet::Uint8Var", + "main::FlagSet::Uint8VarP", + "main::FlagSet::UintSliceVar", + "main::FlagSet::UintSliceVarP", + "main::FlagSet::UintVar", + "main::FlagSet::UintVarP", + "main::FlagSet::Var", + "main::Float32SliceVar", + "main::Float32SliceVarP", + "main::Float32Var", + "main::Float32VarP", + "main::Float64SliceVar", + "main::Float64SliceVarP", + "main::Float64Var", + "main::Float64VarP", + "main::IPMaskVar", + "main::IPMaskVarP", + "main::IPNetSliceVar", + "main::IPNetSliceVarP", + "main::IPNetVar", + "main::IPNetVarP", + "main::IPSliceVar", + "main::IPSliceVarP", + "main::IPVar", + "main::IPVarP", + "main::Int16Var", + "main::Int16VarP", + "main::Int32SliceVar", + "main::Int32SliceVarP", + "main::Int32Var", + "main::Int32VarP", + "main::Int64SliceVar", + "main::Int64SliceVarP", + "main::Int64Var", + "main::Int64VarP", + "main::Int8Var", + "main::Int8VarP", + "main::IntSliceVar", + "main::IntSliceVarP", + "main::IntVar", + "main::IntVarP", + "main::StringArrayVar", + "main::StringArrayVarP", + "main::StringSliceVar", + "main::StringSliceVarP", + "main::StringToInt64Var", + "main::StringToInt64VarP", + "main::StringToIntVar", + "main::StringToIntVarP", + "main::StringToStringVar", + "main::StringToStringVarP", + "main::StringVar", + "main::StringVarP", + "main::TextVar", + "main::TextVarP", + "main::TimeVarP", + "main::Uint16Var", + "main::Uint16VarP", + "main::Uint32Var", + "main::Uint32VarP", + "main::Uint64Var", + "main::Uint64VarP", + "main::Uint8Var", + "main::Uint8VarP", + "main::UintSliceVar", + "main::UintSliceVarP", + "main::UintVar", + "main::UintVarP", + "main::Var", + "main::VarP" + ], + "found": [ + "main::FlagSet::BoolSliceVar", + "main::FlagSet::BoolSliceVarP", + "main::FlagSet::BytesBase64Var", + "main::FlagSet::BytesBase64VarP", + "main::FlagSet::BytesHexVar", + "main::FlagSet::BytesHexVarP", + "main::FlagSet::DurationSliceVar", + "main::FlagSet::DurationSliceVarP", + "main::FlagSet::DurationVar", + "main::FlagSet::DurationVarP", + "main::FlagSet::Float32SliceVar", + "main::FlagSet::Float32SliceVarP", + "main::FlagSet::Float32Var", + "main::FlagSet::Float32VarP", + "main::FlagSet::Float64SliceVar", + "main::FlagSet::Float64SliceVarP", + "main::FlagSet::Float64Var", + "main::FlagSet::Float64VarP", + "main::FlagSet::FuncP", + "main::FlagSet::IPMaskVar", + "main::FlagSet::IPMaskVarP", + "main::FlagSet::IPNetSliceVar", + "main::FlagSet::IPNetSliceVarP", + "main::FlagSet::IPNetVar", + "main::FlagSet::IPNetVarP", + "main::FlagSet::IPSliceVar", + "main::FlagSet::IPSliceVarP", + "main::FlagSet::IPVar", + "main::FlagSet::IPVarP", + "main::FlagSet::Int16Var", + "main::FlagSet::Int16VarP", + "main::FlagSet::Int32SliceVar", + "main::FlagSet::Int32SliceVarP", + "main::FlagSet::Int32Var", + "main::FlagSet::Int32VarP", + "main::FlagSet::Int64SliceVar", + "main::FlagSet::Int64SliceVarP", + "main::FlagSet::Int64Var", + "main::FlagSet::Int64VarP", + "main::FlagSet::Int8Var", + "main::FlagSet::Int8VarP", + "main::FlagSet::IntSliceVar", + "main::FlagSet::IntSliceVarP", + "main::FlagSet::IntVar", + "main::FlagSet::IntVarP", + "main::FlagSet::StringArrayVar", + "main::FlagSet::StringArrayVarP", + "main::FlagSet::StringSliceVar", + "main::FlagSet::StringSliceVarP", + "main::FlagSet::StringToInt64Var", + "main::FlagSet::StringToInt64VarP", + "main::FlagSet::StringToIntVar", + "main::FlagSet::StringToIntVarP", + "main::FlagSet::StringToStringVar", + "main::FlagSet::StringToStringVarP", + "main::FlagSet::StringVar", + "main::FlagSet::StringVarP", + "main::FlagSet::TextVar", + "main::FlagSet::TextVarP", + "main::FlagSet::TimeVarP", + "main::FlagSet::Uint16Var", + "main::FlagSet::Uint16VarP", + "main::FlagSet::Uint32Var", + "main::FlagSet::Uint32VarP", + "main::FlagSet::Uint64Var", + "main::FlagSet::Uint64VarP", + "main::FlagSet::Uint8Var", + "main::FlagSet::Uint8VarP", + "main::FlagSet::UintSliceVar", + "main::FlagSet::UintSliceVarP", + "main::FlagSet::UintVar", + "main::FlagSet::UintVarP", + "main::FlagSet::Var" + ], + "maybe": [], + "import_files": [], + "recall": 0.5, + "precision": 1.0, + "recall_with_maybe": 0.5 + }, + { + "symbol": "main::FlagSet::Float32SliceVarP", + "truth": [ + "main::FlagSet::Float32Slice", + "main::FlagSet::Float32SliceP" + ], + "found": [ + "main::FlagSet::Float32Slice", + "main::FlagSet::Float32SliceP" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::FlagSet::TimeP", + "truth": [ + "main::FlagSet::Time", + "main::Time", + "main::TimeP" + ], + "found": [ + "main::FlagSet::Time" + ], + "maybe": [], + "import_files": [], + "recall": 0.3333333333333333, + "precision": 1.0, + "recall_with_maybe": 0.3333333333333333 + }, + { + "symbol": "main::FlagSet::BoolSliceVarP", + "truth": [ + "main::FlagSet::BoolSlice", + "main::FlagSet::BoolSliceP" + ], + "found": [ + "main::FlagSet::BoolSlice", + "main::FlagSet::BoolSliceP" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::FlagSet::UintVarP", + "truth": [ + "main::FlagSet::Uint", + "main::FlagSet::UintP" + ], + "found": [ + "main::FlagSet::Uint", + "main::FlagSet::UintP" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::FlagSet::IPSliceVarP", + "truth": [ + "main::FlagSet::IPSlice", + "main::FlagSet::IPSliceP" + ], + "found": [ + "main::FlagSet::IPSlice", + "main::FlagSet::IPSliceP" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::FlagSet::PrintDefaults", + "truth": [ + "main::PrintDefaults", + "main::defaultUsage" + ], + "found": [ + "main::defaultUsage" + ], + "maybe": [], + "import_files": [], + "recall": 0.5, + "precision": 1.0, + "recall_with_maybe": 0.5 + } + ], + "callers_blind": [ + { + "symbol": "main::FlagSet::SetNormalizeFunc", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::FlagSet::Init", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::FlagSet::GetBoolSlice", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::FlagSet::GetIPSlice", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::FlagSet::Output", + "truth": [ + "main::FlagSet::AddFlag", + "main::FlagSet::Parse", + "main::FlagSet::ParseAll", + "main::FlagSet::PrintDefaults", + "main::FlagSet::Set", + "main::FlagSet::ShorthandLookup", + "main::FlagSet::parseSingleShortArg", + "main::defaultUsage" + ], + "found": [ + "main::FlagSet::AddFlag", + "main::FlagSet::Parse", + "main::FlagSet::ParseAll", + "main::FlagSet::PrintDefaults", + "main::FlagSet::Set", + "main::FlagSet::ShorthandLookup", + "main::FlagSet::parseSingleShortArg", + "main::defaultUsage" + ], + "maybe": [], + "import_files": [ + "flag.go" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::NewFlagSet", + "truth": [], + "found": [ + "main" + ], + "maybe": [], + "import_files": [ + "bool_func_go1.21_test.go", + "flag.go", + "func_go1.21_test.go" + ], + "recall": null, + "precision": 0.0, + "recall_with_maybe": null + }, + { + "symbol": "main::FlagSet::FlagUsagesWrapped", + "truth": [ + "main::FlagSet::FlagUsages" + ], + "found": [ + "main::FlagSet::FlagUsages" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::FlagSet::Changed", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::FlagSet::GetUint8", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::FlagSet::GetStringSlice", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::FlagSet::GetInt32Slice", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::FlagSet::HasAvailableFlags", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::FlagSet::GetTime", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::FlagSet::GetBool", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::ParseSkippedFlags", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::FlagSet::GetFloat64", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::FlagSet::GetStringToString", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::FlagSet::GetNormalizeFunc", + "truth": [ + "main::FlagSet::normalizeFlagName" + ], + "found": [ + "main::FlagSet::normalizeFlagName" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::FlagSet::GetText", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::FlagSet::MarkHidden", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::FlagSet::MarkDeprecated", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::FlagSet::AddFlag", + "truth": [ + "main::FlagSet::AddFlagSet", + "main::FlagSet::AddGoFlag", + "main::FlagSet::VarPF" + ], + "found": [ + "main::FlagSet::AddFlagSet", + "main::FlagSet::AddGoFlag", + "main::FlagSet::VarPF" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::FlagSet::GetStringArray", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::UnquoteUsage", + "truth": [ + "main::FlagSet::FlagUsagesWrapped" + ], + "found": [ + "main::FlagSet::FlagUsagesWrapped" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::FlagSet::GetIPNetSlice", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::InvalidSyntaxError::GetSpecifiedFlag", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::FlagSet::AddFlagSet", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::PFlagFromGoFlag", + "truth": [ + "main::FlagSet::AddGoFlag" + ], + "found": [ + "main::FlagSet::AddGoFlag" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::FlagSet::GetInt64", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::FlagSet::GetInt32", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::FlagSet::CopyToGoFlagSet", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::FlagSet::GetInt16", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::FlagSet::GetString", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::FlagSet::GetUint", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::FlagSet::AddGoFlag", + "truth": [ + "main::FlagSet::AddGoFlagSet" + ], + "found": [ + "main::FlagSet::AddGoFlagSet" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::FlagSet::GetFloat32", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::FlagSet::MarkShorthandDeprecated", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::FlagSet::GetInt", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::FlagSet::GetIPv4Mask", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::FlagSet::GetIPNet", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::FlagSet::GetUint32", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::FlagSet::VarPF", + "truth": [ + "main::BoolVarP", + "main::FlagSet::BoolFuncP", + "main::FlagSet::BoolVarP", + "main::FlagSet::CountVarP", + "main::FlagSet::VarP" + ], + "found": [ + "main::FlagSet::BoolFuncP", + "main::FlagSet::BoolVarP", + "main::FlagSet::CountVarP", + "main::FlagSet::VarP" + ], + "maybe": [], + "import_files": [], + "recall": 0.8, + "precision": 1.0, + "recall_with_maybe": 0.8 + } + ], + "rename": [ + { + "symbol": "main::FlagSet::Output", + "ok": false, + "compiled": false, + "tests_ok": null, + "tests_failed": [], + "old_name_left": "example_test.go:58:\t// Output: map[a:2 b:2 d:4]\nexample_test.go:70:\t// Output:\nflag.go:300:// Output returns the destination for usage and error messages. os.Stderr is returned if\nflag.go:876:\t_, _ = fmt.Fprintf(CommandLine.Output(), \"Usage of %s:\\n\", os.Args[0])", + "detail": "# github.com/spf13/pflag [github.com/spf13/pflag.test]\n./flag.go:876:33: CommandLine.Output undefined (type *FlagSet has no field or method Output, but does have field output)\nFAIL\tgithub.com/spf13/pflag [build failed]\nFAIL\n" + }, + { + "symbol": "main::NewFlagSet", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "bool_func_go1.21_test.go:48:\t\tstdFSet := flag.NewFlagSet(\"std test\", flag.ContinueOnError)\nbool_func_go1.21_test.go:75:\t\tstdFSet := flag.NewFlagSet(\"std test\", flag.ContinueOnError)\nfunc_go1.21_test.go:40:\t\tstdFSet := flag.NewFlagSet(\"std test\", flag.ContinueOnError)\nfunc_go1.21_test.go:67:\t\tstdFSet", + "detail": "" + }, + { + "symbol": "main::FlagSet::FlagUsagesWrapped", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "main::FlagSet::GetNormalizeFunc", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "main::FlagSet::FlagUsages", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "main::FlagSet::AddGoFlag", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "main::PFlagFromGoFlag", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "golangflag.go:74:func PFlagFromGoFlagGnx(goflag *goflag.Flag) *Flag { //nolint:revive // ignore \"func name will be used as pflag.PFlagFromGoFlag by other packages, and that stutters\"", + "detail": "" + }, + { + "symbol": "main::FlagSet::VarPF", + "ok": false, + "compiled": false, + "tests_ok": null, + "tests_failed": [], + "old_name_left": "bool.go:80:\tflag := CommandLine.VarPF(newBoolValue(value, p), name, shorthand, usage)", + "detail": "# github.com/spf13/pflag [github.com/spf13/pflag.test]\n./bool.go:80:22: CommandLine.VarPF undefined (type *FlagSet has no field or method VarPF)\nFAIL\tgithub.com/spf13/pflag [build failed]\nFAIL\n" + }, + { + "symbol": "main::FlagSet::AddFlag", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "main::UnquoteUsage", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "main::ParseIPv4Mask", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + } + ], + "mutants": { + "7": [ + "main::FlagSet::Output", + "main::NewFlagSet", + "main::FlagSet::FlagUsagesWrapped", + "main::FlagSet::GetNormalizeFunc", + "main::FlagSet::FlagUsages", + "main::FlagSet::AddGoFlag", + "main::PFlagFromGoFlag", + "main::FlagSet::VarPF", + "main::FlagSet::AddFlag", + "main::UnquoteUsage", + "main::ParseIPv4Mask" + ], + "8": [ + "main::FlagSet::AddFlag", + "main::UnquoteUsage", + "main::FlagSet::GetNormalizeFunc", + "main::PFlagFromGoFlag", + "main::FlagSet::VarPF", + "main::FlagSet::Output", + "main::FlagSet::AddGoFlag", + "main::ParseIPv4Mask", + "main::FlagSet::FlagUsages", + "main::FlagSet::FlagUsagesWrapped", + "main::NewFlagSet" + ], + "9": [ + "main::FlagSet::AddGoFlag", + "main::FlagSet::GetNormalizeFunc", + "main::FlagSet::VarPF", + "main::FlagSet::Output", + "main::ParseIPv4Mask", + "main::FlagSet::FlagUsages", + "main::FlagSet::AddFlag", + "main::FlagSet::FlagUsagesWrapped", + "main::PFlagFromGoFlag", + "main::NewFlagSet", + "main::UnquoteUsage" + ] + }, + "tests": [ + { + "symbol": "main::FlagSet::Output", + "level": "name", + "truth": 12, + "predicted": 169, + "recall": 1.0, + "precision": 0.07100591715976332, + "top_hits": 1, + "top_n": 10, + "top_precision": 0.1, + "top_best": 1.0, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "main::NewFlagSet", + "skipped": "mutant does not compile" + }, + { + "symbol": "main::FlagSet::FlagUsagesWrapped", + "level": "name", + "truth": 13, + "predicted": 13, + "recall": 1.0, + "precision": 1.0, + "top_hits": 10, + "top_n": 10, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "main::FlagSet::GetNormalizeFunc", + "skipped": "mutant does not compile" + }, + { + "symbol": "main::FlagSet::FlagUsages", + "level": "name", + "truth": 9, + "predicted": 10, + "recall": 1.0, + "precision": 0.9, + "top_hits": 9, + "top_n": 10, + "top_precision": 0.9, + "top_best": 0.9, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "main::FlagSet::AddGoFlag", + "level": "name", + "truth": 1, + "predicted": 3, + "recall": 1.0, + "precision": 0.3333333333333333, + "top_hits": 1, + "top_n": 3, + "top_precision": 0.3333333333333333, + "top_best": 0.3333333333333333, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "main::PFlagFromGoFlag", + "level": "name", + "truth": 1, + "predicted": 3, + "recall": 1.0, + "precision": 0.3333333333333333, + "top_hits": 1, + "top_n": 3, + "top_precision": 0.3333333333333333, + "top_best": 0.3333333333333333, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "main::FlagSet::VarPF", + "skipped": "mutant does not compile" + }, + { + "symbol": "main::FlagSet::AddFlag", + "skipped": "mutant does not compile" + }, + { + "symbol": "main::UnquoteUsage", + "level": "name", + "truth": 11, + "predicted": 13, + "recall": 1.0, + "precision": 0.8461538461538461, + "top_hits": 8, + "top_n": 10, + "top_precision": 0.8, + "top_best": 1.0, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "main::ParseIPv4Mask", + "level": "name", + "truth": 4, + "predicted": 4, + "recall": 1.0, + "precision": 1.0, + "top_hits": 4, + "top_n": 4, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [], + "recall_graph_only": 0.75 + } + ], + "look": [ + { + "symbol": "main::FlagSet::Output", + "look_tokens": 271, + "file_tokens": 10645 + }, + { + "symbol": "main::NewFlagSet", + "look_tokens": 306, + "file_tokens": 10645 + }, + { + "symbol": "main::FlagSet::FlagUsagesWrapped", + "look_tokens": 775, + "file_tokens": 10645 + }, + { + "symbol": "main::FlagSet::GetNormalizeFunc", + "look_tokens": 320, + "file_tokens": 10645 + }, + { + "symbol": "main::FlagSet::FlagUsages", + "look_tokens": 264, + "file_tokens": 10645 + }, + { + "symbol": "main::FlagSet::AddGoFlag", + "look_tokens": 183, + "file_tokens": 1209 + }, + { + "symbol": "main::PFlagFromGoFlag", + "look_tokens": 379, + "file_tokens": 1209 + }, + { + "symbol": "main::FlagSet::VarPF", + "look_tokens": 316, + "file_tokens": 10645 + }, + { + "symbol": "main::FlagSet::AddFlag", + "look_tokens": 549, + "file_tokens": 10645 + }, + { + "symbol": "main::UnquoteUsage", + "look_tokens": 503, + "file_tokens": 10645 + }, + { + "symbol": "main::ParseIPv4Mask", + "look_tokens": 336, + "file_tokens": 1026 + } + ], + "seconds": 3, + "summary": { + "callers_recall": 0.98, + "callers_precision": 1.0, + "callers_checked": 10, + "blind_recall": 0.975, + "blind_checked": 8, + "common_recall": 0.894, + "common_precision": 0.971, + "common_recall_with_maybe": 0.894, + "common_checked": 34, + "rename_ok": 0.818, + "rename_checked": 11, + "tests_recall": 1.0, + "tests_precision": 0.641, + "tests_top10_precision": 0.638, + "tests_top10_best": 0.795, + "tests_caught": 1.0, + "tests_checked": 7, + "look_vs_file": 0.1 + }, + "summary_seeds": { + "7": { + "callers_recall": 0.98, + "callers_precision": 1.0, + "callers_checked": 10, + "blind_recall": 1.0, + "blind_checked": 3, + "common_recall": 0.9, + "common_precision": 0.938, + "common_recall_with_maybe": 0.9, + "common_checked": 16, + "rename_ok": 0.818, + "rename_checked": 11, + "tests_recall": 1.0, + "tests_precision": 0.641, + "tests_top10_precision": 0.638, + "tests_top10_best": 0.795, + "tests_caught": 1.0, + "tests_checked": 7, + "look_vs_file": 0.1 + }, + "8": { + "callers_recall": 0.98, + "callers_precision": 1.0, + "callers_checked": 10, + "blind_recall": 1.0, + "blind_checked": 4, + "common_recall": 0.9, + "common_precision": 0.938, + "common_recall_with_maybe": 0.9, + "common_checked": 16, + "rename_ok": 0.818, + "rename_checked": 11, + "tests_recall": 1.0, + "tests_precision": 0.641, + "tests_top10_precision": 0.638, + "tests_top10_best": 0.795, + "tests_caught": 1.0, + "tests_checked": 7, + "look_vs_file": 0.1 + }, + "9": { + "callers_recall": 0.98, + "callers_precision": 1.0, + "callers_checked": 10, + "blind_recall": 0.933, + "blind_checked": 3, + "common_recall": 0.882, + "common_precision": 1.0, + "common_recall_with_maybe": 0.882, + "common_checked": 17, + "rename_ok": 0.818, + "rename_checked": 11, + "tests_recall": 1.0, + "tests_precision": 0.641, + "tests_top10_precision": 0.638, + "tests_top10_best": 0.795, + "tests_caught": 1.0, + "tests_checked": 7, + "look_vs_file": 0.1 + } + }, + "noise": { + "callers_recall": { + "mean": 0.98, + "functions": 10, + "boot_lo": 0.94, + "boot_hi": 1.0, + "boot_half": 0.03, + "seeds": [ + 0.98, + 0.98, + 0.98 + ], + "seed_sd": 0.0, + "threshold": 0.1 + }, + "callers_precision": { + "mean": 1.0, + "functions": 10, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.1 + }, + "blind_recall": { + "mean": 0.975, + "functions": 8, + "boot_lo": 0.925, + "boot_hi": 1.0, + "boot_half": 0.037, + "seeds": [ + 1.0, + 1.0, + 0.933 + ], + "seed_sd": 0.038, + "threshold": 0.13 + }, + "common_recall": { + "mean": 0.894, + "functions": 34, + "boot_lo": 0.824, + "boot_hi": 0.956, + "boot_half": 0.066, + "seeds": [ + 0.9, + 0.9, + 0.882 + ], + "seed_sd": 0.01, + "threshold": 0.07 + }, + "common_recall_with_maybe": { + "mean": 0.894, + "functions": 34, + "boot_lo": 0.824, + "boot_hi": 0.956, + "boot_half": 0.066, + "seeds": [ + 0.9, + 0.9, + 0.882 + ], + "seed_sd": 0.01, + "threshold": 0.07 + }, + "common_precision": { + "mean": 0.971, + "functions": 34, + "boot_lo": 0.912, + "boot_hi": 1.0, + "boot_half": 0.044, + "seeds": [ + 0.938, + 0.938, + 1.0 + ], + "seed_sd": 0.036, + "threshold": 0.05 + }, + "rename_ok": { + "mean": 0.818, + "functions": 11, + "boot_lo": 0.636, + "boot_hi": 1.0, + "boot_half": 0.182, + "seeds": [ + 0.818, + 0.818, + 0.818 + ], + "seed_sd": 0.0, + "threshold": 0.19 + }, + "tests_recall": { + "mean": 1.0, + "functions": 7, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.15 + }, + "tests_precision": { + "mean": 0.641, + "functions": 7, + "boot_lo": 0.405, + "boot_hi": 0.854, + "boot_half": 0.225, + "seeds": [ + 0.641, + 0.641, + 0.641 + ], + "seed_sd": 0.0, + "threshold": 0.23 + }, + "tests_top10_precision": { + "mean": 0.638, + "functions": 7, + "boot_lo": 0.41, + "boot_hi": 0.848, + "boot_half": 0.219, + "seeds": [ + 0.638, + 0.638, + 0.638 + ], + "seed_sd": 0.0, + "threshold": 0.22 + }, + "tests_top10_best": { + "mean": 0.795, + "functions": 7, + "boot_lo": 0.605, + "boot_hi": 0.986, + "boot_half": 0.19, + "seeds": [ + 0.795, + 0.795, + 0.795 + ], + "seed_sd": 0.0, + "threshold": 0.2 + }, + "tests_caught": { + "mean": 1.0, + "functions": 7, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.15 + }, + "look_vs_file": { + "mean": 0.1, + "functions": 11, + "boot_lo": 0.049, + "boot_hi": 0.16, + "boot_half": 0.055, + "seeds": [ + 0.1, + 0.1, + 0.1 + ], + "seed_sd": 0.0, + "threshold": 0.06 + } + } + }, + { + "repo": "mux", + "lang": "go", + "commit": "db9d1d0073d2", + "index_seconds": 0.0, + "symbols": 128, + "files": 5, + "seeds": [ + 7, + 8, + 9 + ], + "edges": 2589, + "sample": [ + "main::Router::NewRoute", + "main::Route::Handler", + "main::Route::GetMethods", + "main::Route::HandlerFunc", + "main::Route::GetHandlerWithMiddlewares" + ], + "sample_common": [ + "main::Route::Path", + "main::Route::Schemes", + "main::Route::Host", + "main::Route::Headers", + "main::Route::BuildVarsFunc", + "main::Route::Queries", + "main::Route::PathPrefix", + "main::Route::Name", + "main::Route::MatcherFunc", + "main::MiddlewareFunc::Middleware", + "main::Route::Methods" + ], + "samples": { + "7": [ + "main::Router::NewRoute", + "main::Route::Handler", + "main::Route::GetMethods", + "main::Route::HandlerFunc", + "main::Route::GetHandlerWithMiddlewares" + ], + "8": [ + "main::Route::GetMethods", + "main::Route::Handler", + "main::Route::GetHandlerWithMiddlewares", + "main::Router::NewRoute", + "main::Route::HandlerFunc" + ], + "9": [ + "main::Route::GetHandlerWithMiddlewares", + "main::Route::Handler", + "main::Route::GetMethods", + "main::Router::NewRoute", + "main::Route::HandlerFunc" + ] + }, + "samples_common": { + "7": [ + "main::Route::Path", + "main::Route::Schemes", + "main::Route::Host", + "main::Route::Headers", + "main::Route::BuildVarsFunc", + "main::Route::Queries", + "main::Route::PathPrefix", + "main::Route::Name", + "main::Route::MatcherFunc", + "main::MiddlewareFunc::Middleware", + "main::Route::Methods" + ], + "8": [ + "main::Route::MatcherFunc", + "main::Route::Host", + "main::Route::Methods", + "main::Route::Schemes", + "main::Route::Name", + "main::Route::BuildVarsFunc", + "main::MiddlewareFunc::Middleware", + "main::Route::Path", + "main::Route::Headers", + "main::Route::Queries", + "main::Route::PathPrefix" + ], + "9": [ + "main::Route::Name", + "main::Route::Path", + "main::Route::Host", + "main::Route::Queries", + "main::Route::MatcherFunc", + "main::Route::BuildVarsFunc", + "main::Route::Methods", + "main::Route::Schemes", + "main::MiddlewareFunc::Middleware", + "main::Route::PathPrefix", + "main::Route::Headers" + ] + }, + "samples_blind": { + "7": [ + "main::Router::OmitRouteFromContext", + "main::Route::GetVarNames", + "main::Route::Subrouter", + "main::Router::NewRoute", + "main::Route::GetQueriesRegexp", + "main::Route::GetError", + "main::Route::MetadataContains", + "main::Router::Walk", + "main::Route::HeadersRegexp", + "main::Route::URLPath", + "main::Vars", + "main::CORSMethodMiddleware", + "main::Route::GetHostTemplate", + "main::CurrentRouter", + "main::Router::HandleFunc", + "main::Route::GetMetadataValueOr", + "main::Route::GetQueriesTemplates", + "main::Route::GetName", + "main::Route::GetPathTemplate", + "main::Route::Metadata" + ], + "8": [ + "main::NewRouter", + "main::Router::Handle", + "main::Router::HandleFunc", + "main::Route::GetMetadata", + "main::Router::Walk", + "main::Route::GetPathTemplate", + "main::CurrentRoute", + "main::Route::GetMethods", + "main::Route::Metadata", + "main::Route::GetQueriesTemplates", + "main::Route::URLPath", + "main::Route::GetHostTemplate", + "main::Route::HeadersRegexp", + "main::Router::GetRoute", + "main::Route::URLHost", + "main::Route::GetPathRegexp", + "main::Route::MetadataContains", + "main::Route::GetName", + "main::Route::GetMetadataValueOr", + "main::Route::Subrouter" + ], + "9": [ + "main::Route::GetHandlerWithMiddlewares", + "main::Route::GetMetadata", + "main::Router::StrictSlash", + "main::Route::GetQueriesRegexp", + "main::Route::GetHandler", + "main::Route::GetError", + "main::Router::UseEncodedPath", + "main::Router::OmitRouterFromContext", + "main::Route::GetMetadataValue", + "main::Router::Handle", + "main::Route::GetQueriesTemplates", + "main::Route::GetName", + "main::Route::GetPathTemplate", + "main::Route::GetPathRegexp", + "main::Router::GetRoute", + "main::Route::URLPath", + "main::Route::GetHostTemplate", + "main::CurrentRoute", + "main::Route::GetVarNames", + "main::Router::OmitRouteFromContext" + ] + }, + "baseline_failing_tests": [], + "callers": [ + { + "symbol": "main::Router::NewRoute", + "truth": [ + "main::Router::BuildVarsFunc", + "main::Router::Handle", + "main::Router::HandleFunc", + "main::Router::Headers", + "main::Router::Host", + "main::Router::MatcherFunc", + "main::Router::Methods", + "main::Router::Name", + "main::Router::Path", + "main::Router::PathPrefix", + "main::Router::Queries", + "main::Router::Schemes" + ], + "found": [ + "main::Router::BuildVarsFunc", + "main::Router::Handle", + "main::Router::HandleFunc", + "main::Router::Headers", + "main::Router::Host", + "main::Router::MatcherFunc", + "main::Router::Methods", + "main::Router::Name", + "main::Router::Path", + "main::Router::PathPrefix", + "main::Router::Queries", + "main::Router::Schemes" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Route::Handler", + "truth": [ + "main::Route::HandlerFunc", + "main::Router::Handle" + ], + "found": [ + "main::Route::HandlerFunc", + "main::Router::Handle" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Route::GetMethods", + "truth": [ + "main::getAllMethodsForRoute" + ], + "found": [ + "main::getAllMethodsForRoute" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Route::HandlerFunc", + "truth": [ + "main::Router::HandleFunc" + ], + "found": [ + "main::Router::HandleFunc" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Route::GetHandlerWithMiddlewares", + "truth": [ + "main::Route::Match" + ], + "found": [ + "main::Route::Match" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + } + ], + "callers_common": [ + { + "symbol": "main::Route::Path", + "truth": [ + "main::Router::Handle", + "main::Router::HandleFunc", + "main::Router::Path" + ], + "found": [ + "main::Router::Handle", + "main::Router::HandleFunc", + "main::Router::Path" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Route::Schemes", + "truth": [ + "main::Router::Schemes" + ], + "found": [ + "main::Router::Schemes" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Route::Host", + "truth": [ + "main::Router::Host" + ], + "found": [ + "main::Router::Host" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Route::Headers", + "truth": [ + "main::Router::Headers" + ], + "found": [ + "main::Router::Headers" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Route::BuildVarsFunc", + "truth": [ + "main::Router::BuildVarsFunc" + ], + "found": [ + "main::Router::BuildVarsFunc" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Route::Queries", + "truth": [ + "main::Router::Queries" + ], + "found": [ + "main::Router::Queries" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Route::PathPrefix", + "truth": [ + "main::Router::PathPrefix" + ], + "found": [ + "main::Router::PathPrefix" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Route::Name", + "truth": [ + "main::Router::Name" + ], + "found": [ + "main::Router::Name" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Route::MatcherFunc", + "truth": [ + "main::Router::MatcherFunc" + ], + "found": [ + "main::Router::MatcherFunc" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::MiddlewareFunc::Middleware", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Route::Methods", + "truth": [ + "main::Router::Methods" + ], + "found": [ + "main::Router::Methods" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + } + ], + "callers_blind": [ + { + "symbol": "main::Router::OmitRouteFromContext", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Route::GetVarNames", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Route::Subrouter", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Router::NewRoute", + "truth": [ + "main::Router::BuildVarsFunc", + "main::Router::Handle", + "main::Router::HandleFunc", + "main::Router::Headers", + "main::Router::Host", + "main::Router::MatcherFunc", + "main::Router::Methods", + "main::Router::Name", + "main::Router::Path", + "main::Router::PathPrefix", + "main::Router::Queries", + "main::Router::Schemes" + ], + "found": [ + "main::Router::BuildVarsFunc", + "main::Router::Handle", + "main::Router::HandleFunc", + "main::Router::Headers", + "main::Router::Host", + "main::Router::MatcherFunc", + "main::Router::Methods", + "main::Router::Name", + "main::Router::Path", + "main::Router::PathPrefix", + "main::Router::Queries", + "main::Router::Schemes" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Route::GetQueriesRegexp", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Route::GetError", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Route::MetadataContains", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Router::Walk", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Route::HeadersRegexp", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Route::URLPath", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Vars", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::CORSMethodMiddleware", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Route::GetHostTemplate", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::CurrentRouter", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Router::HandleFunc", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Route::GetMetadataValueOr", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Route::GetQueriesTemplates", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Route::GetName", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Route::GetPathTemplate", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Route::Metadata", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::NewRouter", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Router::Handle", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Route::GetMetadata", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::CurrentRoute", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Route::GetMethods", + "truth": [ + "main::getAllMethodsForRoute" + ], + "found": [ + "main::getAllMethodsForRoute" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Router::GetRoute", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Route::URLHost", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Route::GetPathRegexp", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Route::GetHandlerWithMiddlewares", + "truth": [ + "main::Route::Match" + ], + "found": [ + "main::Route::Match" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Router::StrictSlash", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Route::GetHandler", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Router::UseEncodedPath", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Router::OmitRouterFromContext", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Route::GetMetadataValue", + "skipped": "compiler reported no uses" + } + ], + "rename": [ + { + "symbol": "main::Router::NewRoute", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "main::Route::Handler", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "doc.go:163:\t\t\tHandler: r,\nexample_authentication_middleware_test.go:24:func (amw *authenticationMiddleware) Middleware(next http.Handler) http.Handler {\nmiddleware.go:11:type MiddlewareFunc func(http.Handler) http.Handler\nmiddleware.go:15:\tMiddleware(handler http.Handler) http.Handler\nmiddlewar", + "detail": "" + }, + { + "symbol": "main::Route::GetMethods", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "main::Route::HandlerFunc", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "example_authentication_middleware_test.go:25:\treturn http.HandlerFunc(func(w http.ResponseWriter, r *http.Request) {\nmiddleware.go:57:\t\treturn http.HandlerFunc(func(w http.ResponseWriter, req *http.Request) {\nmiddleware_test.go:15:\treturn http.HandlerFunc(func(w http.ResponseWriter, r *http.Request)", + "detail": "" + }, + { + "symbol": "main::Route::GetHandlerWithMiddlewares", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + } + ], + "mutants": { + "7": [ + "main::Router::NewRoute", + "main::Route::Handler", + "main::Route::GetMethods", + "main::Route::HandlerFunc", + "main::Route::GetHandlerWithMiddlewares" + ], + "8": [ + "main::Route::GetMethods", + "main::Route::Handler", + "main::Route::GetHandlerWithMiddlewares", + "main::Router::NewRoute", + "main::Route::HandlerFunc" + ], + "9": [ + "main::Route::GetHandlerWithMiddlewares", + "main::Route::Handler", + "main::Route::GetMethods", + "main::Router::NewRoute", + "main::Route::HandlerFunc" + ] + }, + "tests": [ + { + "symbol": "main::Router::NewRoute", + "skipped": "mutant does not compile" + }, + { + "symbol": "main::Route::Handler", + "level": "name", + "truth": 36, + "predicted": 35, + "recall": 0.9722222222222222, + "precision": 1.0, + "top_hits": 10, + "top_n": 10, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [ + "ExampleCORSMethodMiddleware" + ], + "recall_graph_only": 0.9722222222222222 + }, + { + "symbol": "main::Route::GetMethods", + "level": "name", + "truth": 4, + "predicted": 3, + "recall": 0.75, + "precision": 1.0, + "top_hits": 3, + "top_n": 3, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [ + "ExampleCORSMethodMiddleware" + ], + "recall_graph_only": 0.75 + }, + { + "symbol": "main::Route::HandlerFunc", + "level": "name", + "truth": 33, + "predicted": 32, + "recall": 0.9696969696969697, + "precision": 1.0, + "top_hits": 10, + "top_n": 10, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [ + "ExampleCORSMethodMiddleware" + ], + "recall_graph_only": 0.9696969696969697 + }, + { + "symbol": "main::Route::GetHandlerWithMiddlewares", + "level": "name", + "truth": 40, + "predicted": 51, + "recall": 0.9, + "precision": 0.7058823529411765, + "top_hits": 8, + "top_n": 10, + "top_precision": 0.8, + "top_best": 1.0, + "caught": 1.0, + "missed": [ + "ExampleCORSMethodMiddleware", + "ExampleRoute_HeadersRegexp", + "ExampleRoute_HeadersRegexp_exactMatch", + "TestSchemeMatchers" + ], + "recall_graph_only": 0.9 + } + ], + "look": [ + { + "symbol": "main::Router::NewRoute", + "look_tokens": 324, + "file_tokens": 4980 + }, + { + "symbol": "main::Route::Handler", + "look_tokens": 225, + "file_tokens": 6100 + }, + { + "symbol": "main::Route::GetMethods", + "look_tokens": 251, + "file_tokens": 6100 + }, + { + "symbol": "main::Route::HandlerFunc", + "look_tokens": 246, + "file_tokens": 6100 + }, + { + "symbol": "main::Route::GetHandlerWithMiddlewares", + "look_tokens": 325, + "file_tokens": 6100 + } + ], + "seconds": 2, + "summary": { + "callers_recall": 1.0, + "callers_precision": 1.0, + "callers_checked": 5, + "blind_recall": 1.0, + "blind_checked": 3, + "common_recall": 1.0, + "common_precision": 1.0, + "common_recall_with_maybe": 1.0, + "common_checked": 10, + "rename_ok": 1.0, + "rename_checked": 5, + "tests_recall": 0.898, + "tests_precision": 0.926, + "tests_top10_precision": 0.95, + "tests_top10_best": 1.0, + "tests_caught": 1.0, + "tests_checked": 4, + "look_vs_file": 0.047 + }, + "summary_seeds": { + "7": { + "callers_recall": 1.0, + "callers_precision": 1.0, + "callers_checked": 5, + "blind_recall": 1.0, + "blind_checked": 1, + "common_recall": 1.0, + "common_precision": 1.0, + "common_recall_with_maybe": 1.0, + "common_checked": 10, + "rename_ok": 1.0, + "rename_checked": 5, + "tests_recall": 0.898, + "tests_precision": 0.926, + "tests_top10_precision": 0.95, + "tests_top10_best": 1.0, + "tests_caught": 1.0, + "tests_checked": 4, + "look_vs_file": 0.047 + }, + "8": { + "callers_recall": 1.0, + "callers_precision": 1.0, + "callers_checked": 5, + "blind_recall": 1.0, + "blind_checked": 1, + "common_recall": 1.0, + "common_precision": 1.0, + "common_recall_with_maybe": 1.0, + "common_checked": 10, + "rename_ok": 1.0, + "rename_checked": 5, + "tests_recall": 0.898, + "tests_precision": 0.926, + "tests_top10_precision": 0.95, + "tests_top10_best": 1.0, + "tests_caught": 1.0, + "tests_checked": 4, + "look_vs_file": 0.047 + }, + "9": { + "callers_recall": 1.0, + "callers_precision": 1.0, + "callers_checked": 5, + "blind_recall": 1.0, + "blind_checked": 1, + "common_recall": 1.0, + "common_precision": 1.0, + "common_recall_with_maybe": 1.0, + "common_checked": 10, + "rename_ok": 1.0, + "rename_checked": 5, + "tests_recall": 0.898, + "tests_precision": 0.926, + "tests_top10_precision": 0.95, + "tests_top10_best": 1.0, + "tests_caught": 1.0, + "tests_checked": 4, + "look_vs_file": 0.047 + } + }, + "noise": { + "callers_recall": { + "mean": 1.0, + "functions": 5, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.2 + }, + "callers_precision": { + "mean": 1.0, + "functions": 5, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.2 + }, + "blind_recall": { + "mean": 1.0, + "functions": 3, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.34 + }, + "common_recall": { + "mean": 1.0, + "functions": 10, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.1 + }, + "common_recall_with_maybe": { + "mean": 1.0, + "functions": 10, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.1 + }, + "common_precision": { + "mean": 1.0, + "functions": 10, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.1 + }, + "rename_ok": { + "mean": 1.0, + "functions": 5, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.2 + }, + "tests_recall": { + "mean": 0.898, + "functions": 4, + "boot_lo": 0.825, + "boot_hi": 0.97, + "boot_half": 0.073, + "seeds": [ + 0.898, + 0.898, + 0.898 + ], + "seed_sd": 0.0, + "threshold": 0.25 + }, + "tests_precision": { + "mean": 0.926, + "functions": 4, + "boot_lo": 0.853, + "boot_hi": 1.0, + "boot_half": 0.074, + "seeds": [ + 0.926, + 0.926, + 0.926 + ], + "seed_sd": 0.0, + "threshold": 0.25 + }, + "tests_top10_precision": { + "mean": 0.95, + "functions": 4, + "boot_lo": 0.9, + "boot_hi": 1.0, + "boot_half": 0.05, + "seeds": [ + 0.95, + 0.95, + 0.95 + ], + "seed_sd": 0.0, + "threshold": 0.25 + }, + "tests_top10_best": { + "mean": 1.0, + "functions": 4, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.25 + }, + "tests_caught": { + "mean": 1.0, + "functions": 4, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.25 + }, + "look_vs_file": { + "mean": 0.047, + "functions": 5, + "boot_lo": 0.04, + "boot_hi": 0.055, + "boot_half": 0.008, + "seeds": [ + 0.047, + 0.047, + 0.047 + ], + "seed_sd": 0.0, + "threshold": 0.01 + } + } + }, + { + "repo": "byteorder", + "lang": "rust", + "commit": "5a82625fae46", + "index_seconds": 0.0, + "symbols": 198, + "files": 3, + "seeds": [ + 7, + 8, + 9 + ], + "edges": 738, + "sample": [], + "sample_common": [ + "byteorder::io::ReadBytesExt::read_f64_into", + "byteorder::ByteOrder::read_f32_into", + "byteorder::ByteOrder::read_int", + "byteorder::ByteOrder::write_int", + "byteorder::ByteOrder::read_f64_into" + ], + "samples": { + "7": [], + "8": [], + "9": [] + }, + "samples_common": { + "7": [ + "byteorder::io::ReadBytesExt::read_f64_into", + "byteorder::ByteOrder::read_f32_into", + "byteorder::ByteOrder::read_int", + "byteorder::ByteOrder::write_int" + ], + "8": [ + "byteorder::ByteOrder::read_f64_into", + "byteorder::ByteOrder::write_int", + "byteorder::ByteOrder::read_f32_into", + "byteorder::ByteOrder::read_int" + ], + "9": [ + "byteorder::ByteOrder::write_int", + "byteorder::io::ReadBytesExt::read_f64_into", + "byteorder::ByteOrder::read_int", + "byteorder::ByteOrder::read_f32_into" + ] + }, + "samples_blind": { + "7": [ + "byteorder::io::WriteBytesExt::write_u8", + "byteorder::ByteOrder::from_slice_i64", + "byteorder::ByteOrder::write_i32_into", + "byteorder::ByteOrder::write_i128_into", + "byteorder::ByteOrder::from_slice_i32", + "byteorder::ByteOrder::write_f64_into", + "byteorder::io::WriteBytesExt::write_i8", + "byteorder::ByteOrder::write_i8_into", + "byteorder::ByteOrder::from_slice_i16", + "byteorder::ByteOrder::write_i64_into", + "byteorder::io::ReadBytesExt::read_i8", + "byteorder::io::ReadBytesExt::read_u8", + "byteorder::ByteOrder::from_slice_i128", + "byteorder::ByteOrder::write_i16_into", + "byteorder::io::ReadBytesExt::read_i8_into", + "byteorder::ByteOrder::write_f32_into" + ], + "8": [ + "byteorder::ByteOrder::from_slice_i64", + "byteorder::ByteOrder::write_f32_into", + "byteorder::ByteOrder::write_i64_into", + "byteorder::ByteOrder::from_slice_i128", + "byteorder::ByteOrder::write_i128_into", + "byteorder::io::WriteBytesExt::write_i8", + "byteorder::ByteOrder::from_slice_i32", + "byteorder::ByteOrder::write_f64_into", + "byteorder::ByteOrder::from_slice_i16", + "byteorder::io::ReadBytesExt::read_i8", + "byteorder::io::ReadBytesExt::read_u8", + "byteorder::io::WriteBytesExt::write_u8", + "byteorder::io::ReadBytesExt::read_i8_into", + "byteorder::ByteOrder::write_i16_into", + "byteorder::ByteOrder::write_i8_into", + "byteorder::ByteOrder::write_i32_into" + ], + "9": [ + "byteorder::io::WriteBytesExt::write_u8", + "byteorder::io::ReadBytesExt::read_i8", + "byteorder::ByteOrder::write_i16_into", + "byteorder::ByteOrder::write_i64_into", + "byteorder::ByteOrder::write_f32_into", + "byteorder::ByteOrder::from_slice_i128", + "byteorder::ByteOrder::from_slice_i16", + "byteorder::ByteOrder::write_i32_into", + "byteorder::ByteOrder::from_slice_i32", + "byteorder::io::ReadBytesExt::read_u8", + "byteorder::ByteOrder::write_f64_into", + "byteorder::io::ReadBytesExt::read_i8_into", + "byteorder::io::WriteBytesExt::write_i8", + "byteorder::ByteOrder::write_i8_into", + "byteorder::ByteOrder::write_i128_into", + "byteorder::ByteOrder::from_slice_i64" + ] + }, + "baseline_failing_tests": [], + "callers": [], + "callers_common": [ + { + "symbol": "byteorder::io::ReadBytesExt::read_f64_into", + "truth": [ + "byteorder::ByteOrder::read_f64_into", + "byteorder::ByteOrder::read_f64_into_unchecked", + "byteorder::io::ReadBytesExt::read_f64_into_unchecked" + ], + "found": [ + "byteorder::io::ReadBytesExt::read_f64_into_unchecked" + ], + "maybe": [], + "import_files": [ + "src/lib.rs" + ], + "recall": 0.3333333333333333, + "precision": 1.0, + "recall_with_maybe": 0.3333333333333333 + }, + { + "symbol": "byteorder::ByteOrder::read_f32_into", + "truth": [ + "byteorder::ByteOrder::read_f32_into_unchecked" + ], + "found": [ + "byteorder::ByteOrder::read_f32_into_unchecked" + ], + "maybe": [], + "import_files": [ + "src/lib.rs" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "byteorder::ByteOrder::read_int", + "truth": [ + "byteorder::ByteOrder::read_i24", + "byteorder::ByteOrder::read_i48", + "byteorder::io::ReadBytesExt::read_int" + ], + "found": [ + "byteorder::ByteOrder::read_i24", + "byteorder::ByteOrder::read_i48" + ], + "maybe": [], + "import_files": [ + "src/lib.rs" + ], + "recall": 0.6666666666666666, + "precision": 1.0, + "recall_with_maybe": 0.6666666666666666 + }, + { + "symbol": "byteorder::ByteOrder::write_int", + "truth": [ + "byteorder::ByteOrder::write_i24", + "byteorder::ByteOrder::write_i48", + "byteorder::io::WriteBytesExt::write_int" + ], + "found": [ + "byteorder::ByteOrder::write_i24", + "byteorder::ByteOrder::write_i48" + ], + "maybe": [], + "import_files": [ + "src/lib.rs" + ], + "recall": 0.6666666666666666, + "precision": 1.0, + "recall_with_maybe": 0.6666666666666666 + }, + { + "symbol": "byteorder::ByteOrder::read_f64_into", + "truth": [ + "byteorder::ByteOrder::read_f64_into_unchecked" + ], + "found": [ + "byteorder::ByteOrder::read_f64_into_unchecked" + ], + "maybe": [], + "import_files": [ + "src/lib.rs" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + } + ], + "callers_blind": [ + { + "symbol": "byteorder::io::WriteBytesExt::write_u8", + "skipped": "compiler reported no uses" + }, + { + "symbol": "byteorder::ByteOrder::from_slice_i64", + "truth": [ + "byteorder::io::ReadBytesExt::read_i64_into" + ], + "found": [], + "maybe": [], + "import_files": [], + "recall": 0.0, + "precision": null, + "recall_with_maybe": 0.0 + }, + { + "symbol": "byteorder::ByteOrder::write_i32_into", + "truth": [], + "found": [], + "maybe": [], + "import_files": [ + "src/lib.rs" + ], + "recall": null, + "precision": null, + "recall_with_maybe": null + }, + { + "symbol": "byteorder::ByteOrder::write_i128_into", + "truth": [], + "found": [], + "maybe": [], + "import_files": [ + "src/lib.rs" + ], + "recall": null, + "precision": null, + "recall_with_maybe": null + }, + { + "symbol": "byteorder::ByteOrder::from_slice_i32", + "truth": [ + "byteorder::io::ReadBytesExt::read_i32_into" + ], + "found": [], + "maybe": [], + "import_files": [], + "recall": 0.0, + "precision": null, + "recall_with_maybe": 0.0 + }, + { + "symbol": "byteorder::ByteOrder::write_f64_into", + "truth": [], + "found": [], + "maybe": [], + "import_files": [ + "src/lib.rs" + ], + "recall": null, + "precision": null, + "recall_with_maybe": null + }, + { + "symbol": "byteorder::io::WriteBytesExt::write_i8", + "skipped": "compiler reported no uses" + }, + { + "symbol": "byteorder::ByteOrder::write_i8_into", + "skipped": "compiler reported no uses" + }, + { + "symbol": "byteorder::ByteOrder::from_slice_i16", + "truth": [ + "byteorder::io::ReadBytesExt::read_i16_into" + ], + "found": [], + "maybe": [], + "import_files": [], + "recall": 0.0, + "precision": null, + "recall_with_maybe": 0.0 + }, + { + "symbol": "byteorder::ByteOrder::write_i64_into", + "truth": [], + "found": [], + "maybe": [], + "import_files": [ + "src/lib.rs" + ], + "recall": null, + "precision": null, + "recall_with_maybe": null + }, + { + "symbol": "byteorder::io::ReadBytesExt::read_i8", + "skipped": "compiler reported no uses" + }, + { + "symbol": "byteorder::io::ReadBytesExt::read_u8", + "skipped": "compiler reported no uses" + }, + { + "symbol": "byteorder::ByteOrder::from_slice_i128", + "truth": [ + "byteorder::io::ReadBytesExt::read_i128_into" + ], + "found": [], + "maybe": [], + "import_files": [], + "recall": 0.0, + "precision": null, + "recall_with_maybe": 0.0 + }, + { + "symbol": "byteorder::ByteOrder::write_i16_into", + "truth": [], + "found": [], + "maybe": [], + "import_files": [ + "src/lib.rs" + ], + "recall": null, + "precision": null, + "recall_with_maybe": null + }, + { + "symbol": "byteorder::io::ReadBytesExt::read_i8_into", + "skipped": "compiler reported no uses" + }, + { + "symbol": "byteorder::ByteOrder::write_f32_into", + "truth": [], + "found": [], + "maybe": [], + "import_files": [ + "src/lib.rs" + ], + "recall": null, + "precision": null, + "recall_with_maybe": null + } + ], + "rename": [], + "mutants": { + "7": [], + "8": [], + "9": [] + }, + "tests": [], + "look": [], + "seconds": 1, + "summary": { + "callers_recall": null, + "callers_precision": null, + "callers_checked": 0, + "blind_recall": 0.0, + "blind_checked": 4, + "common_recall": 0.733, + "common_precision": 1.0, + "common_recall_with_maybe": 0.733, + "common_checked": 5, + "rename_ok": null, + "rename_checked": 0, + "tests_recall": null, + "tests_precision": null, + "tests_top10_precision": null, + "tests_top10_best": null, + "tests_caught": null, + "tests_checked": 0, + "look_vs_file": null + }, + "summary_seeds": { + "7": { + "callers_recall": null, + "callers_precision": null, + "callers_checked": 0, + "blind_recall": 0.0, + "blind_checked": 4, + "common_recall": 0.667, + "common_precision": 1.0, + "common_recall_with_maybe": 0.667, + "common_checked": 4, + "rename_ok": null, + "rename_checked": 0, + "tests_recall": null, + "tests_precision": null, + "tests_top10_precision": null, + "tests_top10_best": null, + "tests_caught": null, + "tests_checked": 0, + "look_vs_file": null + }, + "8": { + "callers_recall": null, + "callers_precision": null, + "callers_checked": 0, + "blind_recall": 0.0, + "blind_checked": 4, + "common_recall": 0.833, + "common_precision": 1.0, + "common_recall_with_maybe": 0.833, + "common_checked": 4, + "rename_ok": null, + "rename_checked": 0, + "tests_recall": null, + "tests_precision": null, + "tests_top10_precision": null, + "tests_top10_best": null, + "tests_caught": null, + "tests_checked": 0, + "look_vs_file": null + }, + "9": { + "callers_recall": null, + "callers_precision": null, + "callers_checked": 0, + "blind_recall": 0.0, + "blind_checked": 4, + "common_recall": 0.667, + "common_precision": 1.0, + "common_recall_with_maybe": 0.667, + "common_checked": 4, + "rename_ok": null, + "rename_checked": 0, + "tests_recall": null, + "tests_precision": null, + "tests_top10_precision": null, + "tests_top10_best": null, + "tests_caught": null, + "tests_checked": 0, + "look_vs_file": null + } + }, + "noise": { + "callers_recall": null, + "callers_precision": null, + "blind_recall": { + "mean": 0.0, + "functions": 4, + "boot_lo": 0.0, + "boot_hi": 0.0, + "boot_half": 0.0, + "seeds": [ + 0.0, + 0.0, + 0.0 + ], + "seed_sd": 0.0, + "threshold": 0.25 + }, + "common_recall": { + "mean": 0.733, + "functions": 5, + "boot_lo": 0.533, + "boot_hi": 0.933, + "boot_half": 0.2, + "seeds": [ + 0.667, + 0.833, + 0.667 + ], + "seed_sd": 0.096, + "threshold": 0.2 + }, + "common_recall_with_maybe": { + "mean": 0.733, + "functions": 5, + "boot_lo": 0.533, + "boot_hi": 0.933, + "boot_half": 0.2, + "seeds": [ + 0.667, + 0.833, + 0.667 + ], + "seed_sd": 0.096, + "threshold": 0.2 + }, + "common_precision": { + "mean": 1.0, + "functions": 5, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.2 + }, + "rename_ok": null, + "tests_recall": null, + "tests_precision": null, + "tests_top10_precision": null, + "tests_top10_best": null, + "tests_caught": null, + "look_vs_file": null + } + }, + { + "repo": "either", + "lang": "rust", + "commit": "1e4326df5972", + "index_seconds": 0.0, + "symbols": 150, + "files": 5, + "seeds": [ + 7, + 8, + 9 + ], + "edges": 512, + "sample": [ + "either::Either::as_pin_mut", + "either::Either::is_left" + ], + "sample_common": [], + "samples": { + "7": [ + "either::Either::as_pin_mut", + "either::Either::is_left" + ], + "8": [ + "either::Either::as_pin_mut", + "either::Either::is_left" + ], + "9": [ + "either::Either::is_left", + "either::Either::as_pin_mut" + ] + }, + "samples_common": { + "7": [], + "8": [], + "9": [] + }, + "samples_blind": { + "7": [ + "either::Either::inspect_left", + "either::Either::right_or_default", + "either::Either::map_left_or", + "either::Either::map_right_or", + "either::Either::as_pin_mut", + "either::Either::factor_second", + "either::Either::flip", + "either::Either::map_either", + "either::Either::left_or_else", + "either::Either::unwrap_right", + "either::Either::inspect_right", + "either::Either::factor_none", + "either::Either::factor_iter_mut", + "either::Either::right", + "either::into_either::IntoEither::into_either_with", + "either::Either::right_and_then", + "either::Either::left_and", + "either::Either::map_left", + "either::Either::factor_first", + "either::Either::iter" + ], + "8": [ + "either::Either::either_into", + "either::Either::is_left_or", + "either::Either::as_pin_mut", + "either::Either::right_and", + "either::Either::factor_second", + "either::Either::expect_right", + "either::Either::unwrap_right", + "either::Either::right_and_then", + "either::Either::map_either_with", + "either::Either::flip", + "either::Either::as_pin_ref", + "either::Either::factor_iter_mut", + "either::Either::into_inner", + "either::Either::left_and", + "either::Either::unwrap_left", + "either::Either::left_and_then", + "either::Either::is_right_and", + "either::Either::factor_iter", + "either::Either::right_or_default", + "either::Either::expect_left" + ], + "9": [ + "either::Either::factor_err", + "either::Either::unwrap_right", + "either::Either::factor_into_iter", + "either::Either::map_left_or", + "either::Either::either_into", + "either::Either::iter_mut", + "either::Either::left_and", + "either::Either::right_and", + "either::Either::left_or_else", + "either::Either::right_and_then", + "either::Either::right_or_default", + "either::Either::map_right_or", + "either::Either::factor_none", + "either::Either::factor_ok", + "either::Either::factor_second", + "either::Either::is_right", + "either::Either::as_pin_ref", + "either::Either::expect_right", + "either::Either::map_left", + "either::Either::right_or_else" + ] + }, + "baseline_failing_tests": [], + "callers": [ + { + "symbol": "either::Either::as_pin_mut", + "truth": [ + "either::Either::poll" + ], + "found": [ + "either::Either::poll" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "either::Either::is_left", + "truth": [ + "either::Either::is_right" + ], + "found": [ + "either::Either::is_right" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + } + ], + "callers_common": [], + "callers_blind": [ + { + "symbol": "either::Either::inspect_left", + "skipped": "compiler reported no uses" + }, + { + "symbol": "either::Either::right_or_default", + "skipped": "compiler reported no uses" + }, + { + "symbol": "either::Either::map_left_or", + "skipped": "compiler reported no uses" + }, + { + "symbol": "either::Either::map_right_or", + "skipped": "compiler reported no uses" + }, + { + "symbol": "either::Either::as_pin_mut", + "truth": [ + "either::Either::poll" + ], + "found": [ + "either::Either::poll" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "either::Either::factor_second", + "skipped": "compiler reported no uses" + }, + { + "symbol": "either::Either::flip", + "skipped": "compiler reported no uses" + }, + { + "symbol": "either::Either::map_either", + "skipped": "compiler reported no uses" + }, + { + "symbol": "either::Either::left_or_else", + "skipped": "compiler reported no uses" + }, + { + "symbol": "either::Either::unwrap_right", + "skipped": "compiler reported no uses" + }, + { + "symbol": "either::Either::inspect_right", + "skipped": "compiler reported no uses" + }, + { + "symbol": "either::Either::factor_none", + "skipped": "compiler reported no uses" + }, + { + "symbol": "either::Either::factor_iter_mut", + "skipped": "compiler reported no uses" + }, + { + "symbol": "either::Either::right", + "truth": [], + "found": [], + "maybe": [], + "import_files": [ + "src/lib.rs" + ], + "recall": null, + "precision": null, + "recall_with_maybe": null + }, + { + "symbol": "either::into_either::IntoEither::into_either_with", + "skipped": "compiler reported no uses" + }, + { + "symbol": "either::Either::right_and_then", + "skipped": "compiler reported no uses" + }, + { + "symbol": "either::Either::left_and", + "skipped": "compiler reported no uses" + }, + { + "symbol": "either::Either::map_left", + "skipped": "compiler reported no uses" + }, + { + "symbol": "either::Either::factor_first", + "skipped": "compiler reported no uses" + }, + { + "symbol": "either::Either::iter", + "skipped": "compiler reported no uses" + }, + { + "symbol": "either::Either::either_into", + "skipped": "compiler reported no uses" + }, + { + "symbol": "either::Either::is_left_or", + "skipped": "compiler reported no uses" + }, + { + "symbol": "either::Either::right_and", + "skipped": "compiler reported no uses" + }, + { + "symbol": "either::Either::expect_right", + "skipped": "compiler reported no uses" + }, + { + "symbol": "either::Either::map_either_with", + "skipped": "compiler reported no uses" + }, + { + "symbol": "either::Either::as_pin_ref", + "skipped": "compiler reported no uses" + }, + { + "symbol": "either::Either::into_inner", + "skipped": "compiler reported no uses" + }, + { + "symbol": "either::Either::unwrap_left", + "skipped": "compiler reported no uses" + }, + { + "symbol": "either::Either::left_and_then", + "skipped": "compiler reported no uses" + }, + { + "symbol": "either::Either::is_right_and", + "skipped": "compiler reported no uses" + }, + { + "symbol": "either::Either::factor_iter", + "skipped": "compiler reported no uses" + }, + { + "symbol": "either::Either::expect_left", + "skipped": "compiler reported no uses" + }, + { + "symbol": "either::Either::factor_err", + "skipped": "compiler reported no uses" + }, + { + "symbol": "either::Either::factor_into_iter", + "skipped": "compiler reported no uses" + }, + { + "symbol": "either::Either::iter_mut", + "skipped": "compiler reported no uses" + }, + { + "symbol": "either::Either::factor_ok", + "skipped": "compiler reported no uses" + }, + { + "symbol": "either::Either::is_right", + "skipped": "compiler reported no uses" + }, + { + "symbol": "either::Either::right_or_else", + "skipped": "compiler reported no uses" + } + ], + "rename": [ + { + "symbol": "either::Either::as_pin_mut", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "either::Either::is_left", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + } + ], + "mutants": { + "7": [ + "either::Either::as_pin_mut", + "either::Either::is_left" + ], + "8": [ + "either::Either::as_pin_mut", + "either::Either::is_left" + ], + "9": [ + "either::Either::is_left", + "either::Either::as_pin_mut" + ] + }, + "tests": [ + { + "symbol": "either::Either::as_pin_mut", + "skipped": "no test fails when it throws", + "predicted": 8 + }, + { + "symbol": "either::Either::is_left", + "skipped": "no test fails when it throws", + "predicted": 8 + } + ], + "look": [ + { + "symbol": "either::Either::as_pin_mut", + "look_tokens": 306, + "file_tokens": 13434 + }, + { + "symbol": "either::Either::is_left", + "look_tokens": 213, + "file_tokens": 13434 + } + ], + "seconds": 1, + "summary": { + "callers_recall": 1.0, + "callers_precision": 1.0, + "callers_checked": 2, + "blind_recall": 1.0, + "blind_checked": 1, + "common_recall": null, + "common_precision": null, + "common_recall_with_maybe": null, + "common_checked": 0, + "rename_ok": 1.0, + "rename_checked": 2, + "tests_recall": null, + "tests_precision": null, + "tests_top10_precision": null, + "tests_top10_best": null, + "tests_caught": null, + "tests_checked": 0, + "look_vs_file": 0.019 + }, + "summary_seeds": { + "7": { + "callers_recall": 1.0, + "callers_precision": 1.0, + "callers_checked": 2, + "blind_recall": 1.0, + "blind_checked": 1, + "common_recall": null, + "common_precision": null, + "common_recall_with_maybe": null, + "common_checked": 0, + "rename_ok": 1.0, + "rename_checked": 2, + "tests_recall": null, + "tests_precision": null, + "tests_top10_precision": null, + "tests_top10_best": null, + "tests_caught": null, + "tests_checked": 0, + "look_vs_file": 0.019 + }, + "8": { + "callers_recall": 1.0, + "callers_precision": 1.0, + "callers_checked": 2, + "blind_recall": 1.0, + "blind_checked": 1, + "common_recall": null, + "common_precision": null, + "common_recall_with_maybe": null, + "common_checked": 0, + "rename_ok": 1.0, + "rename_checked": 2, + "tests_recall": null, + "tests_precision": null, + "tests_top10_precision": null, + "tests_top10_best": null, + "tests_caught": null, + "tests_checked": 0, + "look_vs_file": 0.019 + }, + "9": { + "callers_recall": 1.0, + "callers_precision": 1.0, + "callers_checked": 2, + "blind_recall": null, + "blind_checked": 0, + "common_recall": null, + "common_precision": null, + "common_recall_with_maybe": null, + "common_checked": 0, + "rename_ok": 1.0, + "rename_checked": 2, + "tests_recall": null, + "tests_precision": null, + "tests_top10_precision": null, + "tests_top10_best": null, + "tests_caught": null, + "tests_checked": 0, + "look_vs_file": 0.019 + } + }, + "noise": { + "callers_recall": { + "mean": 1.0, + "functions": 2, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.5 + }, + "callers_precision": { + "mean": 1.0, + "functions": 2, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.5 + }, + "blind_recall": { + "mean": 1.0, + "functions": 1, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 1.0 + }, + "common_recall": null, + "common_recall_with_maybe": null, + "common_precision": null, + "rename_ok": { + "mean": 1.0, + "functions": 2, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.5 + }, + "tests_recall": null, + "tests_precision": null, + "tests_top10_precision": null, + "tests_top10_best": null, + "tests_caught": null, + "look_vs_file": { + "mean": 0.019, + "functions": 2, + "boot_lo": 0.016, + "boot_hi": 0.023, + "boot_half": 0.003, + "seeds": [ + 0.019, + 0.019, + 0.019 + ], + "seed_sd": 0.0, + "threshold": 0.01 + } + } + }, + { + "repo": "strsim", + "lang": "rust", + "commit": "dacc84c0dc61", + "index_seconds": 0.0, + "symbols": 48, + "files": 2, + "seeds": [ + 7, + 8, + 9 + ], + "edges": 430, + "sample": [ + "strsim::jaro", + "strsim::damerau_levenshtein", + "strsim::sorensen_dice", + "strsim::levenshtein", + "strsim::osa_distance", + "strsim::generic_jaro_winkler", + "strsim::normalized_damerau_levenshtein", + "strsim::normalized_levenshtein", + "strsim::hamming", + "strsim::generic_hamming", + "strsim::generic_levenshtein", + "strsim::generic_jaro", + "strsim::jaro_winkler" + ], + "sample_common": [], + "samples": { + "7": [ + "strsim::jaro", + "strsim::damerau_levenshtein", + "strsim::sorensen_dice", + "strsim::levenshtein", + "strsim::osa_distance", + "strsim::generic_jaro_winkler", + "strsim::normalized_damerau_levenshtein", + "strsim::normalized_levenshtein", + "strsim::hamming", + "strsim::generic_hamming", + "strsim::generic_levenshtein", + "strsim::generic_jaro", + "strsim::jaro_winkler" + ], + "8": [ + "strsim::normalized_levenshtein", + "strsim::osa_distance", + "strsim::normalized_damerau_levenshtein", + "strsim::generic_jaro_winkler", + "strsim::damerau_levenshtein", + "strsim::levenshtein", + "strsim::hamming", + "strsim::generic_hamming", + "strsim::sorensen_dice", + "strsim::generic_jaro", + "strsim::generic_levenshtein", + "strsim::jaro_winkler", + "strsim::jaro" + ], + "9": [ + "strsim::generic_levenshtein", + "strsim::damerau_levenshtein", + "strsim::hamming", + "strsim::sorensen_dice", + "strsim::jaro", + "strsim::normalized_levenshtein", + "strsim::generic_hamming", + "strsim::normalized_damerau_levenshtein", + "strsim::generic_jaro", + "strsim::generic_jaro_winkler", + "strsim::jaro_winkler", + "strsim::osa_distance", + "strsim::levenshtein" + ] + }, + "samples_common": { + "7": [], + "8": [], + "9": [] + }, + "samples_blind": { + "7": [ + "strsim::jaro", + "strsim::damerau_levenshtein", + "strsim::sorensen_dice", + "strsim::levenshtein", + "strsim::osa_distance", + "strsim::generic_jaro_winkler", + "strsim::normalized_damerau_levenshtein", + "strsim::normalized_levenshtein", + "strsim::hamming", + "strsim::generic_hamming", + "strsim::generic_damerau_levenshtein", + "strsim::generic_levenshtein", + "strsim::generic_jaro", + "strsim::jaro_winkler" + ], + "8": [ + "strsim::generic_damerau_levenshtein", + "strsim::normalized_levenshtein", + "strsim::osa_distance", + "strsim::normalized_damerau_levenshtein", + "strsim::generic_jaro_winkler", + "strsim::damerau_levenshtein", + "strsim::levenshtein", + "strsim::hamming", + "strsim::generic_hamming", + "strsim::sorensen_dice", + "strsim::generic_jaro", + "strsim::generic_levenshtein", + "strsim::jaro_winkler", + "strsim::jaro" + ], + "9": [ + "strsim::generic_levenshtein", + "strsim::damerau_levenshtein", + "strsim::hamming", + "strsim::sorensen_dice", + "strsim::jaro", + "strsim::generic_damerau_levenshtein", + "strsim::normalized_levenshtein", + "strsim::generic_hamming", + "strsim::normalized_damerau_levenshtein", + "strsim::generic_jaro", + "strsim::generic_jaro_winkler", + "strsim::jaro_winkler", + "strsim::osa_distance", + "strsim::levenshtein" + ] + }, + "baseline_failing_tests": [], + "callers": [ + { + "symbol": "strsim::jaro", + "truth": [], + "found": [], + "maybe": [], + "import_files": [ + "src/lib.rs" + ], + "recall": null, + "precision": null, + "recall_with_maybe": null + }, + { + "symbol": "strsim::damerau_levenshtein", + "truth": [], + "found": [], + "maybe": [], + "import_files": [ + "src/lib.rs" + ], + "recall": null, + "precision": null, + "recall_with_maybe": null + }, + { + "symbol": "strsim::sorensen_dice", + "truth": [], + "found": [], + "maybe": [], + "import_files": [ + "src/lib.rs" + ], + "recall": null, + "precision": null, + "recall_with_maybe": null + }, + { + "symbol": "strsim::levenshtein", + "truth": [ + "strsim::normalized_levenshtein" + ], + "found": [ + "strsim::normalized_levenshtein" + ], + "maybe": [], + "import_files": [ + "src/lib.rs" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "strsim::osa_distance", + "truth": [], + "found": [], + "maybe": [], + "import_files": [ + "src/lib.rs" + ], + "recall": null, + "precision": null, + "recall_with_maybe": null + }, + { + "symbol": "strsim::generic_jaro_winkler", + "truth": [ + "strsim::jaro_winkler" + ], + "found": [ + "strsim::jaro_winkler" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "strsim::normalized_damerau_levenshtein", + "truth": [], + "found": [], + "maybe": [], + "import_files": [ + "src/lib.rs" + ], + "recall": null, + "precision": null, + "recall_with_maybe": null + }, + { + "symbol": "strsim::normalized_levenshtein", + "truth": [], + "found": [], + "maybe": [], + "import_files": [ + "src/lib.rs" + ], + "recall": null, + "precision": null, + "recall_with_maybe": null + }, + { + "symbol": "strsim::hamming", + "truth": [], + "found": [], + "maybe": [], + "import_files": [ + "src/lib.rs" + ], + "recall": null, + "precision": null, + "recall_with_maybe": null + }, + { + "symbol": "strsim::generic_hamming", + "truth": [ + "strsim::hamming" + ], + "found": [ + "strsim::hamming" + ], + "maybe": [], + "import_files": [ + "src/lib.rs" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "strsim::generic_levenshtein", + "truth": [ + "strsim::levenshtein" + ], + "found": [ + "strsim::levenshtein" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "strsim::generic_jaro", + "truth": [ + "strsim::generic_jaro_winkler", + "strsim::jaro" + ], + "found": [ + "strsim::generic_jaro_winkler", + "strsim::jaro" + ], + "maybe": [], + "import_files": [ + "src/lib.rs" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "strsim::jaro_winkler", + "truth": [], + "found": [], + "maybe": [], + "import_files": [ + "src/lib.rs" + ], + "recall": null, + "precision": null, + "recall_with_maybe": null + } + ], + "callers_common": [], + "callers_blind": [ + { + "symbol": "strsim::jaro", + "truth": [], + "found": [], + "maybe": [], + "import_files": [ + "src/lib.rs" + ], + "recall": null, + "precision": null, + "recall_with_maybe": null + }, + { + "symbol": "strsim::damerau_levenshtein", + "truth": [], + "found": [], + "maybe": [], + "import_files": [ + "src/lib.rs" + ], + "recall": null, + "precision": null, + "recall_with_maybe": null + }, + { + "symbol": "strsim::sorensen_dice", + "truth": [], + "found": [], + "maybe": [], + "import_files": [ + "src/lib.rs" + ], + "recall": null, + "precision": null, + "recall_with_maybe": null + }, + { + "symbol": "strsim::levenshtein", + "truth": [ + "strsim::normalized_levenshtein" + ], + "found": [ + "strsim::normalized_levenshtein" + ], + "maybe": [], + "import_files": [ + "src/lib.rs" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "strsim::osa_distance", + "truth": [], + "found": [], + "maybe": [], + "import_files": [ + "src/lib.rs" + ], + "recall": null, + "precision": null, + "recall_with_maybe": null + }, + { + "symbol": "strsim::generic_jaro_winkler", + "truth": [ + "strsim::jaro_winkler" + ], + "found": [ + "strsim::jaro_winkler" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "strsim::normalized_damerau_levenshtein", + "truth": [], + "found": [], + "maybe": [], + "import_files": [ + "src/lib.rs" + ], + "recall": null, + "precision": null, + "recall_with_maybe": null + }, + { + "symbol": "strsim::normalized_levenshtein", + "truth": [], + "found": [], + "maybe": [], + "import_files": [ + "src/lib.rs" + ], + "recall": null, + "precision": null, + "recall_with_maybe": null + }, + { + "symbol": "strsim::hamming", + "truth": [], + "found": [], + "maybe": [], + "import_files": [ + "src/lib.rs" + ], + "recall": null, + "precision": null, + "recall_with_maybe": null + }, + { + "symbol": "strsim::generic_hamming", + "truth": [ + "strsim::hamming" + ], + "found": [ + "strsim::hamming" + ], + "maybe": [], + "import_files": [ + "src/lib.rs" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "strsim::generic_damerau_levenshtein", + "skipped": "compiler reported no uses" + }, + { + "symbol": "strsim::generic_levenshtein", + "truth": [ + "strsim::levenshtein" + ], + "found": [ + "strsim::levenshtein" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "strsim::generic_jaro", + "truth": [ + "strsim::generic_jaro_winkler", + "strsim::jaro" + ], + "found": [ + "strsim::generic_jaro_winkler", + "strsim::jaro" + ], + "maybe": [], + "import_files": [ + "src/lib.rs" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "strsim::jaro_winkler", + "truth": [], + "found": [], + "maybe": [], + "import_files": [ + "src/lib.rs" + ], + "recall": null, + "precision": null, + "recall_with_maybe": null + } + ], + "rename": [ + { + "symbol": "strsim::jaro", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "src/lib.rs:831: assert_eq!(0.0, jaro_gnx(\"\", \"jaro\"));\nsrc/lib.rs:841: assert_eq!(1.0, jaro_gnx(\"jaro\", \"jaro\"));\nsrc/lib.rs:907: assert_eq!(0.0, jaro_winkler(\"\", \"jaro-winkler\"));", + "detail": "" + }, + { + "symbol": "strsim::damerau_levenshtein", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "strsim::sorensen_dice", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "strsim::levenshtein", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "src/lib.rs:683:/// assert!((normalized_damerau_levenshtein(\"levenshtein\", \"löwenbräu\") - 0.27272).abs() < 0.00001);\nsrc/lib.rs:992: assert_eq!(0, levenshtein_gnx(\"levenshtein\", \"levenshtein\"));\nsrc/lib.rs:1223: normalized_damerau_levenshtein(\"levenshtein\", \"löwenbräu\")\ntests/lib.rs", + "detail": "" + }, + { + "symbol": "strsim::osa_distance", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "strsim::generic_jaro_winkler", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "strsim::normalized_damerau_levenshtein", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "strsim::normalized_levenshtein", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "strsim::hamming", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "src/lib.rs:78:/// use strsim::{hamming, StrSimError::DifferentLengthArgs};\nsrc/lib.rs:80:/// assert_eq!(Ok(3), hamming_gnx(\"hamming\", \"hammers\"));\nsrc/lib.rs:82:/// assert_eq!(Err(DifferentLengthArgs), hamming_gnx(\"hamming\", \"ham\"));\nsrc/lib.rs:793: assert_hamming_dist(0, \"hamming\", \"hamming\"", + "detail": "" + }, + { + "symbol": "strsim::generic_hamming", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "strsim::generic_levenshtein", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "strsim::generic_jaro", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "strsim::jaro_winkler", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + } + ], + "mutants": { + "7": [ + "strsim::jaro", + "strsim::damerau_levenshtein", + "strsim::sorensen_dice", + "strsim::levenshtein", + "strsim::osa_distance", + "strsim::generic_jaro_winkler", + "strsim::normalized_damerau_levenshtein", + "strsim::normalized_levenshtein" + ], + "8": [ + "strsim::normalized_levenshtein", + "strsim::osa_distance", + "strsim::normalized_damerau_levenshtein", + "strsim::generic_jaro_winkler", + "strsim::damerau_levenshtein", + "strsim::levenshtein", + "strsim::hamming", + "strsim::generic_hamming" + ], + "9": [ + "strsim::generic_levenshtein", + "strsim::damerau_levenshtein", + "strsim::hamming", + "strsim::sorensen_dice", + "strsim::jaro", + "strsim::normalized_levenshtein", + "strsim::generic_hamming", + "strsim::normalized_damerau_levenshtein" + ] + }, + "tests": [ + { + "symbol": "strsim::jaro", + "level": "name", + "truth": 14, + "predicted": 31, + "recall": 1.0, + "precision": 0.45161290322580644, + "top_hits": 10, + "top_n": 10, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "strsim::damerau_levenshtein", + "level": "name", + "truth": 17, + "predicted": 23, + "recall": 1.0, + "precision": 0.7391304347826086, + "top_hits": 10, + "top_n": 10, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "strsim::sorensen_dice", + "level": "name", + "truth": 1, + "predicted": 96, + "recall": 1.0, + "precision": 0.010416666666666666, + "top_hits": 1, + "top_n": 10, + "top_precision": 0.1, + "top_best": 0.1, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "strsim::levenshtein", + "level": "name", + "truth": 14, + "predicted": 38, + "recall": 1.0, + "precision": 0.3684210526315789, + "top_hits": 10, + "top_n": 10, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "strsim::osa_distance", + "level": "name", + "truth": 17, + "predicted": 17, + "recall": 1.0, + "precision": 1.0, + "top_hits": 10, + "top_n": 10, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "strsim::generic_jaro_winkler", + "level": "name", + "truth": 16, + "predicted": 16, + "recall": 1.0, + "precision": 1.0, + "top_hits": 10, + "top_n": 10, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "strsim::normalized_damerau_levenshtein", + "level": "name", + "truth": 6, + "predicted": 6, + "recall": 1.0, + "precision": 1.0, + "top_hits": 6, + "top_n": 6, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "strsim::normalized_levenshtein", + "level": "name", + "truth": 6, + "predicted": 6, + "recall": 1.0, + "precision": 1.0, + "top_hits": 6, + "top_n": 6, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "strsim::hamming", + "level": "name", + "truth": 6, + "predicted": 8, + "recall": 1.0, + "precision": 0.75, + "top_hits": 6, + "top_n": 8, + "top_precision": 0.75, + "top_best": 0.75, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "strsim::generic_hamming", + "level": "name", + "truth": 8, + "predicted": 8, + "recall": 1.0, + "precision": 1.0, + "top_hits": 8, + "top_n": 8, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "strsim::generic_levenshtein", + "level": "name", + "truth": 14, + "predicted": 15, + "recall": 1.0, + "precision": 0.9333333333333333, + "top_hits": 10, + "top_n": 10, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + } + ], + "look": [ + { + "symbol": "strsim::jaro", + "look_tokens": 289, + "file_tokens": 9272 + }, + { + "symbol": "strsim::damerau_levenshtein", + "look_tokens": 373, + "file_tokens": 9272 + }, + { + "symbol": "strsim::sorensen_dice", + "look_tokens": 563, + "file_tokens": 9272 + }, + { + "symbol": "strsim::levenshtein", + "look_tokens": 335, + "file_tokens": 9272 + }, + { + "symbol": "strsim::osa_distance", + "look_tokens": 676, + "file_tokens": 9272 + }, + { + "symbol": "strsim::generic_jaro_winkler", + "look_tokens": 400, + "file_tokens": 9272 + }, + { + "symbol": "strsim::normalized_damerau_levenshtein", + "look_tokens": 516, + "file_tokens": 9272 + }, + { + "symbol": "strsim::normalized_levenshtein", + "look_tokens": 426, + "file_tokens": 9272 + }, + { + "symbol": "strsim::hamming", + "look_tokens": 286, + "file_tokens": 9272 + }, + { + "symbol": "strsim::generic_hamming", + "look_tokens": 358, + "file_tokens": 9272 + }, + { + "symbol": "strsim::generic_levenshtein", + "look_tokens": 511, + "file_tokens": 9272 + }, + { + "symbol": "strsim::generic_jaro", + "look_tokens": 756, + "file_tokens": 9272 + }, + { + "symbol": "strsim::jaro_winkler", + "look_tokens": 329, + "file_tokens": 9272 + } + ], + "seconds": 2, + "summary": { + "callers_recall": 1.0, + "callers_precision": 1.0, + "callers_checked": 5, + "blind_recall": 1.0, + "blind_checked": 5, + "common_recall": null, + "common_precision": null, + "common_recall_with_maybe": null, + "common_checked": 0, + "rename_ok": 1.0, + "rename_checked": 13, + "tests_recall": 1.0, + "tests_precision": 0.75, + "tests_top10_precision": 0.895, + "tests_top10_best": 0.895, + "tests_caught": 1.0, + "tests_checked": 11, + "look_vs_file": 0.048 + }, + "summary_seeds": { + "7": { + "callers_recall": 1.0, + "callers_precision": 1.0, + "callers_checked": 5, + "blind_recall": 1.0, + "blind_checked": 5, + "common_recall": null, + "common_precision": null, + "common_recall_with_maybe": null, + "common_checked": 0, + "rename_ok": 1.0, + "rename_checked": 13, + "tests_recall": 1.0, + "tests_precision": 0.696, + "tests_top10_precision": 0.887, + "tests_top10_best": 0.887, + "tests_caught": 1.0, + "tests_checked": 8, + "look_vs_file": 0.048 + }, + "8": { + "callers_recall": 1.0, + "callers_precision": 1.0, + "callers_checked": 5, + "blind_recall": 1.0, + "blind_checked": 5, + "common_recall": null, + "common_precision": null, + "common_recall_with_maybe": null, + "common_checked": 0, + "rename_ok": 1.0, + "rename_checked": 13, + "tests_recall": 1.0, + "tests_precision": 0.857, + "tests_top10_precision": 0.969, + "tests_top10_best": 0.969, + "tests_caught": 1.0, + "tests_checked": 8, + "look_vs_file": 0.048 + }, + "9": { + "callers_recall": 1.0, + "callers_precision": 1.0, + "callers_checked": 5, + "blind_recall": 1.0, + "blind_checked": 5, + "common_recall": null, + "common_precision": null, + "common_recall_with_maybe": null, + "common_checked": 0, + "rename_ok": 1.0, + "rename_checked": 13, + "tests_recall": 1.0, + "tests_precision": 0.736, + "tests_top10_precision": 0.856, + "tests_top10_best": 0.856, + "tests_caught": 1.0, + "tests_checked": 8, + "look_vs_file": 0.048 + } + }, + "noise": { + "callers_recall": { + "mean": 1.0, + "functions": 5, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.2 + }, + "callers_precision": { + "mean": 1.0, + "functions": 5, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.2 + }, + "blind_recall": { + "mean": 1.0, + "functions": 5, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.2 + }, + "common_recall": null, + "common_recall_with_maybe": null, + "common_precision": null, + "rename_ok": { + "mean": 1.0, + "functions": 13, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.08 + }, + "tests_recall": { + "mean": 1.0, + "functions": 11, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.1 + }, + "tests_precision": { + "mean": 0.75, + "functions": 11, + "boot_lo": 0.583, + "boot_hi": 0.903, + "boot_half": 0.16, + "seeds": [ + 0.696, + 0.857, + 0.736 + ], + "seed_sd": 0.084, + "threshold": 0.17 + }, + "tests_top10_precision": { + "mean": 0.895, + "functions": 11, + "boot_lo": 0.732, + "boot_hi": 1.0, + "boot_half": 0.134, + "seeds": [ + 0.887, + 0.969, + 0.856 + ], + "seed_sd": 0.058, + "threshold": 0.14 + }, + "tests_top10_best": { + "mean": 0.895, + "functions": 11, + "boot_lo": 0.732, + "boot_hi": 1.0, + "boot_half": 0.134, + "seeds": [ + 0.887, + 0.969, + 0.856 + ], + "seed_sd": 0.058, + "threshold": 0.14 + }, + "tests_caught": { + "mean": 1.0, + "functions": 11, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.1 + }, + "look_vs_file": { + "mean": 0.048, + "functions": 13, + "boot_lo": 0.042, + "boot_hi": 0.056, + "boot_half": 0.007, + "seeds": [ + 0.048, + 0.048, + 0.048 + ], + "seed_sd": 0.0, + "threshold": 0.01 + } + } + }, + { + "repo": "urfave-cli", + "lang": "go", + "commit": "d5c06cb04479", + "index_seconds": 0.1, + "symbols": 703, + "files": 45, + "seeds": [ + 7, + 8, + 9 + ], + "edges": 8526, + "sample": [ + "main::ValueSourceChain::LookupWithSource", + "main::Command::VisibleFlagCategories", + "main::Command::VisibleFlags", + "main::Exit", + "main::ShowVersion", + "main::ValueSourceChain::EnvKeys", + "main::Command::Walk", + "main::Command::Path", + "main::File", + "main::Command::FullName", + "main::Command::Bool", + "main::EnvVar", + "main::Command::LocalFlagNames", + "main::Command::VisiblePersistentFlags", + "main::HandleExitCoder", + "main::EnvVars", + "main::DefaultCompleteWithFlags", + "main::Command::Lineage", + "main::Command::Root" + ], + "sample_common": [ + "main::extFlag::Names", + "main::ValueSourceChain::GoString", + "main::genericValue::IsBoolFlag", + "main::Command::VisibleCategories", + "main::FlagBase::GetEnvVars", + "main::BoolWithInverseFlag::IsDefaultVisible", + "main::FlagBase::IsLocal", + "main::stringSliceArgs::First", + "main::BoolWithInverseFlag::TakesValue", + "main::BoolWithInverseFlag::GetCategory", + "main::BoolWithInverseFlag::RunAction", + "main::commandCategory::Name", + "main::FlagBase::SetStringer", + "main::extFlag::GetDefaultText", + "main::stringSliceArgs::Present", + "main::BoolWithInverseFlag::IsRequired", + "main::exitError::ExitCode", + "main::mutuallyExclusiveGroup::Error", + "main::FlagBase::IsVisible", + "main::Command::HasName", + "main::extFlag::SetCategory", + "main::mapSource::GoString", + "main::extFlag::GetCategory", + "main::FlagBase::IsSet", + "main::commandCategory::VisibleCommands", + "main::FlagBase::GetValue", + "main::extFlag::GetEnvVars", + "main::extFlag::IsBoolFlag", + "main::extFlag::IsLocal", + "main::MapBase::Value", + "main::FlagBase::PreParse", + "main::BoolWithInverseFlag::GetDeprecated", + "main::BoolWithInverseFlag::GetUsage", + "main::FlagBase::IsDefaultVisible", + "main::ArgumentsBase::Parse", + "main::BoolWithInverseFlag::TypeName", + "main::BoolWithInverseFlag::IsVisible", + "main::FlagBase::Names", + "main::envVarValueSource::IsFromEnv", + "main::BoolWithInverseFlag::IsSet", + "main::mutuallyExclusiveGroupRequiredFlag::Error", + "main::defaultVisibleFlagCategory::Name" + ], + "samples": { + "7": [ + "main::ValueSourceChain::LookupWithSource", + "main::Command::VisibleFlagCategories", + "main::Command::VisibleFlags", + "main::Exit", + "main::ShowVersion", + "main::ValueSourceChain::EnvKeys", + "main::Command::Walk", + "main::Command::Path", + "main::File", + "main::Command::FullName", + "main::Command::Bool", + "main::EnvVar", + "main::Command::LocalFlagNames", + "main::Command::VisiblePersistentFlags", + "main::HandleExitCoder", + "main::EnvVars", + "main::DefaultCompleteWithFlags", + "main::Command::Lineage", + "main::Command::Root" + ], + "8": [ + "main::Exit", + "main::Command::VisibleFlagCategories", + "main::DefaultCompleteWithFlags", + "main::Command::Walk", + "main::Command::Lineage", + "main::Command::FullName", + "main::ShowVersion", + "main::ValueSourceChain::EnvKeys", + "main::ValueSourceChain::LookupWithSource", + "main::Command::Root", + "main::EnvVar", + "main::Command::VisibleFlags", + "main::HandleExitCoder", + "main::Command::Bool", + "main::EnvVars", + "main::Command::LocalFlagNames", + "main::Command::VisiblePersistentFlags", + "main::Command::Path", + "main::File" + ], + "9": [ + "main::EnvVars", + "main::Command::Walk", + "main::ValueSourceChain::LookupWithSource", + "main::ValueSourceChain::EnvKeys", + "main::Command::VisibleFlags", + "main::ShowVersion", + "main::HandleExitCoder", + "main::DefaultCompleteWithFlags", + "main::Command::Lineage", + "main::File", + "main::Command::FullName", + "main::Command::Root", + "main::Command::Bool", + "main::Command::VisiblePersistentFlags", + "main::Command::LocalFlagNames", + "main::Command::VisibleFlagCategories", + "main::Exit", + "main::Command::Path", + "main::EnvVar" + ] + }, + "samples_common": { + "7": [ + "main::extFlag::Names", + "main::ValueSourceChain::GoString", + "main::genericValue::IsBoolFlag", + "main::Command::VisibleCategories", + "main::FlagBase::GetEnvVars", + "main::BoolWithInverseFlag::IsDefaultVisible", + "main::FlagBase::IsLocal", + "main::stringSliceArgs::First", + "main::BoolWithInverseFlag::TakesValue", + "main::BoolWithInverseFlag::GetCategory", + "main::BoolWithInverseFlag::RunAction", + "main::commandCategory::Name", + "main::FlagBase::SetStringer", + "main::extFlag::GetDefaultText", + "main::stringSliceArgs::Present", + "main::BoolWithInverseFlag::IsRequired", + "main::exitError::ExitCode", + "main::mutuallyExclusiveGroup::Error", + "main::FlagBase::IsVisible", + "main::Command::HasName" + ], + "8": [ + "main::extFlag::SetCategory", + "main::mapSource::GoString", + "main::extFlag::GetCategory", + "main::Command::HasName", + "main::BoolWithInverseFlag::IsRequired", + "main::BoolWithInverseFlag::IsDefaultVisible", + "main::FlagBase::IsSet", + "main::commandCategory::VisibleCommands", + "main::FlagBase::GetValue", + "main::BoolWithInverseFlag::TakesValue", + "main::BoolWithInverseFlag::RunAction", + "main::extFlag::GetEnvVars", + "main::extFlag::IsBoolFlag", + "main::extFlag::GetDefaultText", + "main::stringSliceArgs::First", + "main::extFlag::IsLocal", + "main::MapBase::Value", + "main::FlagBase::PreParse", + "main::BoolWithInverseFlag::GetDeprecated", + "main::BoolWithInverseFlag::GetUsage" + ], + "9": [ + "main::FlagBase::GetValue", + "main::FlagBase::SetStringer", + "main::FlagBase::IsDefaultVisible", + "main::BoolWithInverseFlag::GetCategory", + "main::FlagBase::IsLocal", + "main::BoolWithInverseFlag::IsRequired", + "main::ValueSourceChain::GoString", + "main::ArgumentsBase::Parse", + "main::extFlag::GetEnvVars", + "main::BoolWithInverseFlag::TypeName", + "main::genericValue::IsBoolFlag", + "main::BoolWithInverseFlag::IsVisible", + "main::FlagBase::Names", + "main::BoolWithInverseFlag::RunAction", + "main::envVarValueSource::IsFromEnv", + "main::BoolWithInverseFlag::IsSet", + "main::mutuallyExclusiveGroupRequiredFlag::Error", + "main::defaultVisibleFlagCategory::Name", + "main::Command::VisibleCategories", + "main::stringSliceArgs::Present" + ] + }, + "samples_blind": { + "7": [ + "main::Command::NArg", + "main::NewValueSourceChain", + "main::exitError::Unwrap", + "main::ValueSourceChain::LookupWithSource", + "main::Command::Uint64", + "main::Command::Timestamp", + "main::Command::Int16", + "main::DefaultShowCommandHelp", + "scripts::VetActionFunc", + "main::Command::Uint", + "main::Command::VisibleFlagCategories", + "main::Command::Int64", + "main::Command::VisibleFlags", + "main::Command::Duration", + "main::Command::Uint16", + "main::Command::Generic", + "main::Exit", + "main::ValueSourceChain::Append", + "main::NewMapSource", + "main::DefaultPrintVersion" + ], + "8": [ + "main::Exit", + "main::Command::NumFlags", + "scripts::LintActionFunc", + "main::Command::Timestamp", + "main::Command::Duration", + "scripts::SetMkdocsRemoteActionFunc", + "main::DefaultShowCommandHelp", + "main::Command::Float32", + "main::Command::VisibleFlagCategories", + "main::Command::Text", + "main::Command::Generic", + "main::DefaultCompleteWithFlags", + "main::DefaultShowRootCommandHelp", + "main::Command::Int16", + "main::Command::Walk", + "main::Command::Lineage", + "scripts::V3Diff", + "main::ShowSubcommandHelpAndExit", + "main::Command::FullName", + "main::Command::NArg" + ], + "9": [ + "main::EnvVars", + "main::Command::Walk", + "main::Command::Generic", + "scripts::V3Diff", + "scripts::SetMkdocsRemoteActionFunc", + "main::Command::Float64", + "main::ShowRootCommandHelpAndExit", + "main::Command::Uint16", + "scripts::EnsureGoimportsActionFunc", + "scripts::LintActionFunc", + "main::Command::ToFishCompletion", + "main::Command::Uint64", + "main::ValueSourceChain::LookupWithSource", + "main::Files", + "main::Command::Duration", + "main::NewSliceBase", + "main::ValueSourceChain::EnvKeys", + "main::Command::Int16", + "main::Command::VisibleFlags", + "main::ShowSubcommandHelpAndExit" + ] + }, + "baseline_failing_tests": [], + "callers": [ + { + "symbol": "main::ValueSourceChain::LookupWithSource", + "truth": [ + "main::BoolWithInverseFlag::PostParse", + "main::ValueSourceChain::Lookup" + ], + "found": [ + "main::BoolWithInverseFlag::PostParse", + "main::ValueSourceChain::Lookup" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Command::VisibleFlagCategories", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Command::VisibleFlags", + "truth": [ + "main::prepareFishFlags" + ], + "found": [ + "main::helpRenderer::flags", + "main::helpRenderer::root", + "main::helpRenderer::usage", + "main::prepareFishFlags" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 0.25, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Exit", + "truth": [ + "main::DefaultShowCommandHelp", + "main::buildShellCompletionSubcommand" + ], + "found": [ + "main::DefaultShowCommandHelp", + "main::buildShellCompletionSubcommand" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::ShowVersion", + "truth": [ + "main::Command::run" + ], + "found": [ + "main::Command::run" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::ValueSourceChain::EnvKeys", + "truth": [ + "main::BoolWithInverseFlag::GetEnvVars", + "main::FlagBase::GetEnvVars" + ], + "found": [ + "main::BoolWithInverseFlag::GetEnvVars", + "main::FlagBase::GetEnvVars" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Command::Walk", + "truth": [ + "main::Command::run", + "main::Command::setupCommandGraph" + ], + "found": [ + "main::Command::run", + "main::Command::setupCommandGraph" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Command::Path", + "truth": [ + "main::Command::FullName" + ], + "found": [ + "main::Command::FullName" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::File", + "truth": [ + "main::Files" + ], + "found": [ + "main::Files" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Command::FullName", + "truth": [ + "main::Command::checkDuplicateFlagNames" + ], + "found": [ + "main::Command::checkDuplicateFlagNames", + "main::DefaultPrintHelpCustom", + "main::helpRenderer::helpName", + "main::helpRenderer::root", + "main::helpRenderer::subcommand", + "main::helpRenderer::usage" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 0.16666666666666666, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Command::Bool", + "truth": [ + "main::Command::checkHelp", + "scripts::EnsureMkdocsActionFunc", + "scripts::GfmrunActionFunc", + "scripts::V3Diff" + ], + "found": [ + "scripts::EnsureMkdocsActionFunc", + "scripts::GfmrunActionFunc", + "scripts::V3Diff" + ], + "maybe": [], + "import_files": [], + "recall": 0.75, + "precision": 1.0, + "recall_with_maybe": 0.75 + }, + { + "symbol": "main::EnvVar", + "truth": [ + "main::EnvVars" + ], + "found": [ + "main::EnvVars" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Command::LocalFlagNames", + "truth": [ + "main::Command::FlagNames" + ], + "found": [ + "main::Command::FlagNames" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Command::VisiblePersistentFlags", + "truth": [ + "main::DefaultCompleteWithFlags", + "main::prepareFishFlags" + ], + "found": [ + "main::DefaultCompleteWithFlags", + "main::helpRenderer::persistentFlags", + "main::prepareFishFlags" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 0.6666666666666666, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::HandleExitCoder", + "truth": [ + "main::Command::handleExitCoder" + ], + "found": [ + "main::Command::handleExitCoder" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::EnvVars", + "truth": [ + "scripts::main" + ], + "found": [ + "scripts::main" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::DefaultCompleteWithFlags", + "truth": [ + "main::Command::setupDefaults", + "main::DefaultRootCommandComplete" + ], + "found": [ + "main::DefaultRootCommandComplete" + ], + "maybe": [], + "import_files": [], + "recall": 0.5, + "precision": 1.0, + "recall_with_maybe": 0.5 + }, + { + "symbol": "main::Command::Lineage", + "truth": [ + "main::Command::VisiblePersistentFlags", + "main::Command::lookupFlag", + "main::Command::useShortOptionHandling", + "main::commandAncestry", + "main::fishFlagHelper", + "main::fishSubcommandHelper", + "main::prepareFishCommands" + ], + "found": [ + "main::Command::VisiblePersistentFlags", + "main::Command::lookupFlag", + "main::Command::useShortOptionHandling", + "main::commandAncestry", + "main::fishFlagHelper", + "main::fishSubcommandHelper", + "main::prepareFishCommands" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Command::Root", + "truth": [ + "main::Command::handleRequiredError", + "main::Command::parseFlags", + "main::Command::run", + "main::DefaultCompleteWithFlags", + "main::DefaultPrintVersion", + "main::DefaultShowCommandHelp", + "main::DefaultShowRootCommandHelp", + "main::DefaultShowSubcommandHelp", + "main::buildShellCompletionSubcommand", + "main::checkShellCompleteFlag", + "main::runCompletion", + "main::shouldRunCompletion" + ], + "found": [ + "main::Command::handleRequiredError", + "main::Command::parseFlags", + "main::Command::run", + "main::DefaultCompleteWithFlags", + "main::DefaultPrintVersion", + "main::DefaultShowCommandHelp", + "main::DefaultShowRootCommandHelp", + "main::DefaultShowSubcommandHelp", + "main::buildShellCompletionSubcommand", + "main::checkShellCompleteFlag", + "main::runCompletion", + "main::shouldRunCompletion" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + } + ], + "callers_common": [ + { + "symbol": "main::extFlag::Names", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::ValueSourceChain::GoString", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::genericValue::IsBoolFlag", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Command::VisibleCategories", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::FlagBase::GetEnvVars", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::BoolWithInverseFlag::IsDefaultVisible", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::FlagBase::IsLocal", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::stringSliceArgs::First", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::BoolWithInverseFlag::TakesValue", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::BoolWithInverseFlag::GetCategory", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::BoolWithInverseFlag::RunAction", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::commandCategory::Name", + "truth": [ + "main::commandCategories::Less" + ], + "found": [ + "main::commandCategories::Less" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::FlagBase::SetStringer", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::extFlag::GetDefaultText", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::stringSliceArgs::Present", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::BoolWithInverseFlag::IsRequired", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::exitError::ExitCode", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::mutuallyExclusiveGroup::Error", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::FlagBase::IsVisible", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Command::HasName", + "truth": [ + "main::Command::Command", + "main::DefaultShowCommandHelp" + ], + "found": [ + "main::Command::Command", + "main::DefaultShowCommandHelp" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::extFlag::SetCategory", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::mapSource::GoString", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::extFlag::GetCategory", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::FlagBase::IsSet", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::commandCategory::VisibleCommands", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::FlagBase::GetValue", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::extFlag::GetEnvVars", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::extFlag::IsBoolFlag", + "truth": [ + "main::extFlag::TakesValue" + ], + "found": [ + "main::extFlag::TakesValue" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::extFlag::IsLocal", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::MapBase::Value", + "truth": [ + "main::MapBase::String" + ], + "found": [ + "main::MapBase::String" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::FlagBase::PreParse", + "truth": [ + "main::FlagBase::Set" + ], + "found": [ + "main::FlagBase::Set" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::BoolWithInverseFlag::GetDeprecated", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::BoolWithInverseFlag::GetUsage", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::FlagBase::IsDefaultVisible", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::ArgumentsBase::Parse", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::BoolWithInverseFlag::TypeName", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::BoolWithInverseFlag::IsVisible", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::FlagBase::Names", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::envVarValueSource::IsFromEnv", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::BoolWithInverseFlag::IsSet", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::mutuallyExclusiveGroupRequiredFlag::Error", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::defaultVisibleFlagCategory::Name", + "skipped": "compiler reported no uses" + } + ], + "callers_blind": [ + { + "symbol": "main::Command::NArg", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::NewValueSourceChain", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::exitError::Unwrap", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::ValueSourceChain::LookupWithSource", + "truth": [ + "main::BoolWithInverseFlag::PostParse", + "main::ValueSourceChain::Lookup" + ], + "found": [ + "main::BoolWithInverseFlag::PostParse", + "main::ValueSourceChain::Lookup" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Command::Uint64", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Command::Timestamp", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Command::Int16", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::DefaultShowCommandHelp", + "truth": [], + "found": [], + "maybe": [], + "import_files": [ + "help.go" + ], + "recall": null, + "precision": null, + "recall_with_maybe": null + }, + { + "symbol": "scripts::VetActionFunc", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Command::Uint", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Command::VisibleFlagCategories", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Command::Int64", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Command::VisibleFlags", + "truth": [ + "main::prepareFishFlags" + ], + "found": [ + "main::helpRenderer::flags", + "main::helpRenderer::root", + "main::helpRenderer::usage", + "main::prepareFishFlags" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 0.25, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Command::Duration", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Command::Uint16", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Command::Generic", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Exit", + "truth": [ + "main::DefaultShowCommandHelp", + "main::buildShellCompletionSubcommand" + ], + "found": [ + "main::DefaultShowCommandHelp", + "main::buildShellCompletionSubcommand" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::ValueSourceChain::Append", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::NewMapSource", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::DefaultPrintVersion", + "truth": [], + "found": [], + "maybe": [], + "import_files": [ + "help.go" + ], + "recall": null, + "precision": null, + "recall_with_maybe": null + }, + { + "symbol": "main::Command::NumFlags", + "skipped": "compiler reported no uses" + }, + { + "symbol": "scripts::LintActionFunc", + "truth": [ + "scripts::main" + ], + "found": [], + "maybe": [], + "import_files": [], + "recall": 0.0, + "precision": null, + "recall_with_maybe": 0.0 + }, + { + "symbol": "scripts::SetMkdocsRemoteActionFunc", + "truth": [ + "scripts::main" + ], + "found": [], + "maybe": [], + "import_files": [], + "recall": 0.0, + "precision": null, + "recall_with_maybe": 0.0 + }, + { + "symbol": "main::Command::Float32", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Command::Text", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::DefaultCompleteWithFlags", + "truth": [ + "main::Command::setupDefaults", + "main::DefaultRootCommandComplete" + ], + "found": [ + "main::DefaultRootCommandComplete" + ], + "maybe": [], + "import_files": [], + "recall": 0.5, + "precision": 1.0, + "recall_with_maybe": 0.5 + }, + { + "symbol": "main::DefaultShowRootCommandHelp", + "truth": [], + "found": [], + "maybe": [], + "import_files": [ + "help.go" + ], + "recall": null, + "precision": null, + "recall_with_maybe": null + }, + { + "symbol": "main::Command::Walk", + "truth": [ + "main::Command::run", + "main::Command::setupCommandGraph" + ], + "found": [ + "main::Command::run", + "main::Command::setupCommandGraph" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Command::Lineage", + "truth": [ + "main::Command::VisiblePersistentFlags", + "main::Command::lookupFlag", + "main::Command::useShortOptionHandling", + "main::commandAncestry", + "main::fishFlagHelper", + "main::fishSubcommandHelper", + "main::prepareFishCommands" + ], + "found": [ + "main::Command::VisiblePersistentFlags", + "main::Command::lookupFlag", + "main::Command::useShortOptionHandling", + "main::commandAncestry", + "main::fishFlagHelper", + "main::fishSubcommandHelper", + "main::prepareFishCommands" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "scripts::V3Diff", + "truth": [ + "scripts::main" + ], + "found": [], + "maybe": [], + "import_files": [], + "recall": 0.0, + "precision": null, + "recall_with_maybe": 0.0 + }, + { + "symbol": "main::ShowSubcommandHelpAndExit", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Command::FullName", + "truth": [ + "main::Command::checkDuplicateFlagNames" + ], + "found": [ + "main::Command::checkDuplicateFlagNames", + "main::DefaultPrintHelpCustom", + "main::helpRenderer::helpName", + "main::helpRenderer::root", + "main::helpRenderer::subcommand", + "main::helpRenderer::usage" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 0.16666666666666666, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::EnvVars", + "truth": [ + "scripts::main" + ], + "found": [ + "scripts::main" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Command::Float64", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::ShowRootCommandHelpAndExit", + "truth": [], + "found": [], + "maybe": [], + "import_files": [ + "help.go" + ], + "recall": null, + "precision": null, + "recall_with_maybe": null + }, + { + "symbol": "scripts::EnsureGoimportsActionFunc", + "truth": [ + "scripts::main" + ], + "found": [], + "maybe": [], + "import_files": [], + "recall": 0.0, + "precision": null, + "recall_with_maybe": 0.0 + }, + { + "symbol": "main::Command::ToFishCompletion", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Files", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::NewSliceBase", + "truth": [], + "found": [], + "maybe": [], + "import_files": [ + "flag_float_slice.go", + "flag_int_slice.go", + "flag_string_slice.go", + "flag_uint_slice.go" + ], + "recall": null, + "precision": null, + "recall_with_maybe": null + }, + { + "symbol": "main::ValueSourceChain::EnvKeys", + "truth": [ + "main::BoolWithInverseFlag::GetEnvVars", + "main::FlagBase::GetEnvVars" + ], + "found": [ + "main::BoolWithInverseFlag::GetEnvVars", + "main::FlagBase::GetEnvVars" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + } + ], + "rename": [ + { + "symbol": "main::ValueSourceChain::LookupWithSource", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "main::Command::VisibleFlagCategories", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "main::Command::VisibleFlags", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "main::Exit", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "errors.go:12:var OsExiter = os.Exit\nerrors.go:123:// Exit wraps a message and exit code into an error, which by default is\nerrors.go:156:// Unwrap returns the error given to [Exit], so that [errors.Is] and\nerrors_test.go:331:\t// The error given to Exit must stay reachable through the standard\nexampl", + "detail": "" + }, + { + "symbol": "main::ShowVersion", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "main::ValueSourceChain::EnvKeys", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "main::Command::Walk", + "ok": false, + "compiled": false, + "tests_ok": null, + "tests_failed": [], + "old_name_left": "autocomplete/bash_autocomplete:41: # Completion output lines use \"token:description\" format. Walk them once, keeping only\ncommand.go:721:// Walk visits cmd and every descendant. If fn returns a non-nil error, the\ncommand_run.go:315:\t// Walk the parent chain to check mutually exclusive flag groups", + "detail": "# github.com/urfave/cli/v3_test\n# [github.com/urfave/cli/v3_test]\n./examples_test.go:445:1: ExampleCommand_Walk_visibleTree refers to unknown field or method: Command.Walk\nFAIL\tgithub.com/urfave/cli/v3 [build failed]\n? \tgithub.com/urfave/cli/v3/examples/example-cli\t[no test files]\n? \tgithub.com/urfave/cli/v3/examples/example-hello-world\t[no test files]\n? \tgithub.com/urfave/cli/v3/scripts\t[no test files]\nFAIL\n" + }, + { + "symbol": "main::Command::Path", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "command.go:711:// Path returns the path of command names from the root to cmd, inclusive.\ncommand.go:712:// Each element is a Command.Name. Path traverses upward via parent pointers\nerrors_test.go:348:\t\t\tmessage: &fs.PathError{Op: \"open\", Path: \"x\", Err: fs.ErrNotExist},\nexamples_test.go:468:\t\t\t// R", + "detail": "" + }, + { + "symbol": "main::File", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "main::Command::FullName", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "main::Command::Bool", + "ok": false, + "compiled": false, + "tests_ok": null, + "tests_failed": [], + "old_name_left": "command.go:216:\treturn helpFlag != nil && slices.ContainsFunc(helpFlag.Names(), cmd.Bool)\ncommand_test.go:4767:\text := flag.Bool(\"v\", false, \"ext package flag usage\")\nflag_ext_test.go:95:\text := flag.Bool(\"ext\", false, \"\")\nflag_ext_test.go:150:\t\t\text := flag.Bool(\"v\", false, \"\")\nflag_ext_test.go:176", + "detail": "# github.com/urfave/cli/v3\n./command.go:216:70: cmd.Bool undefined (type *Command has no field or method Bool)\nFAIL\tgithub.com/urfave/cli/v3 [build failed]\nFAIL\tgithub.com/urfave/cli/v3/examples/example-cli [build failed]\n? \tgithub.com/urfave/cli/v3/examples/example-hello-world\t[no test files]\nFAIL\tgithub.com/urfave/cli/v3/scripts [build failed]\nFAIL\n" + }, + { + "symbol": "main::EnvVar", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "main::Command::LocalFlagNames", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "main::Command::VisiblePersistentFlags", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "main::HandleExitCoder", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "main::EnvVars", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "main::DefaultCompleteWithFlags", + "ok": false, + "compiled": false, + "tests_ok": null, + "tests_failed": [], + "old_name_left": "command_setup.go:25:\t\tcmd.ShellComplete = DefaultCompleteWithFlags\nhelp_test.go:1789:\t\t\tf := DefaultCompleteWithFlags", + "detail": "# github.com/urfave/cli/v3\n./command_setup.go:25:23: undefined: DefaultCompleteWithFlags\nFAIL\tgithub.com/urfave/cli/v3 [build failed]\nFAIL\tgithub.com/urfave/cli/v3/examples/example-cli [build failed]\n? \tgithub.com/urfave/cli/v3/examples/example-hello-world\t[no test files]\nFAIL\tgithub.com/urfave/cli/v3/scripts [build failed]\nFAIL\n" + }, + { + "symbol": "main::Command::Lineage", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "command.go:693:// Lineage returns *this* command and all of its ancestor commands\ncommand.go:713:// similar to Lineage. FullName() is equivalent to strings.Join(cmd.Path(), \" \").\nexamples_test.go:468:\t\t\t// Run has initialized the parent links used by Lineage and Path.\ngodoc-current.txt:731: Linea", + "detail": "" + }, + { + "symbol": "main::Command::Root", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "command.go:406:// Root returns the Command at the root of the graph\ncommand_test.go:1943:\t\t\t\t\t&StringArg{Name: \"root\", UsageText: \"Root path\", Destination: &rootPath},\ngodoc-current.txt:753: Root returns the Command at the root of the graph\ntestdata/godoc-v3.x.txt:753: Root returns the Command", + "detail": "" + } + ], + "mutants": { + "7": [ + "main::ValueSourceChain::LookupWithSource", + "main::Command::VisibleFlagCategories", + "main::Command::VisibleFlags", + "main::Exit", + "main::ShowVersion", + "main::ValueSourceChain::EnvKeys", + "main::Command::Walk", + "main::Command::Path" + ], + "8": [ + "main::Exit", + "main::Command::VisibleFlagCategories", + "main::DefaultCompleteWithFlags", + "main::Command::Walk", + "main::Command::Lineage", + "main::Command::FullName", + "main::ShowVersion", + "main::ValueSourceChain::EnvKeys" + ], + "9": [ + "main::EnvVars", + "main::Command::Walk", + "main::ValueSourceChain::LookupWithSource", + "main::ValueSourceChain::EnvKeys", + "main::Command::VisibleFlags", + "main::ShowVersion", + "main::HandleExitCoder", + "main::DefaultCompleteWithFlags" + ] + }, + "tests": [ + { + "symbol": "main::ValueSourceChain::LookupWithSource", + "level": "name", + "truth": 18, + "predicted": 9, + "recall": 0.16666666666666666, + "precision": 0.3333333333333333, + "top_hits": 3, + "top_n": 9, + "top_precision": 0.3333333333333333, + "top_best": 0.3333333333333333, + "caught": 1.0, + "missed": [ + "TestBoolFlagCountFromCommand", + "TestBoolWithInverseAction", + "TestBoolWithInverseAlias", + "TestBoolWithInverseBasic", + "TestBoolWithInverseDestination", + "TestBoolWithInverseEnvVars", + "TestBoolWithInverseWithPrefix", + "TestCategorizedHelp" + ], + "recall_graph_only": 0.16666666666666666 + }, + { + "symbol": "main::Command::VisibleFlagCategories", + "level": "name", + "truth": 26, + "predicted": 6, + "recall": 0.038461538461538464, + "precision": 0.16666666666666666, + "top_hits": 1, + "top_n": 6, + "top_precision": 0.16666666666666666, + "top_best": 0.16666666666666666, + "caught": 1.0, + "missed": [ + "ExampleCommand_Run_appHelp", + "ExampleCommand_Run_commandHelp", + "ExampleCommand_Run_noAction", + "ExampleCommand_Run_subcommandNoAction", + "TestCategorizedHelp", + "TestCommandListAlignsNonASCIINames", + "TestExtFlagHelp", + "TestHelpFlagWorksWhenAliasYieldedToUserFlag" + ], + "recall_graph_only": 0.038461538461538464 + }, + { + "symbol": "main::Command::VisibleFlags", + "level": "name", + "truth": 45, + "predicted": 14, + "recall": 0.2, + "precision": 0.6428571428571429, + "top_hits": 5, + "top_n": 10, + "top_precision": 0.5, + "top_best": 0.9, + "caught": 1.0, + "missed": [ + "ExampleCommand_Run_appHelp", + "ExampleCommand_Run_commandHelp", + "ExampleCommand_Run_noAction", + "ExampleCommand_Run_subcommandNoAction", + "TestArgumentRequiredUsageInCommandHelp", + "TestCategorizedHelp", + "TestCommandListAlignsNonASCIINames", + "TestCommand_Run_Categories" + ], + "recall_graph_only": 0.2 + }, + { + "symbol": "main::Exit", + "level": "name", + "truth": 32, + "predicted": 32, + "recall": 0.46875, + "precision": 0.46875, + "top_hits": 10, + "top_n": 10, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [ + "TestArgumentsRootCommand", + "TestCommand_Args", + "TestCommand_RunDefaultCommand", + "TestCommand_RunDefaultCommandWithFlags", + "TestCommand_RunDefaultCommandWithSubCommand", + "TestCompletionDisable", + "TestCompletionInvalidShell", + "TestCompletionShellRenderError" + ], + "recall_graph_only": 0.46875 + }, + { + "symbol": "main::ShowVersion", + "level": "name", + "truth": 3, + "predicted": 412, + "recall": 1.0, + "precision": 0.007281553398058253, + "top_hits": 1, + "top_n": 10, + "top_precision": 0.1, + "top_best": 0.3, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "main::ValueSourceChain::EnvKeys", + "level": "name", + "truth": 67, + "predicted": 9, + "recall": 0.029850746268656716, + "precision": 0.2222222222222222, + "top_hits": 2, + "top_n": 9, + "top_precision": 0.2222222222222222, + "top_best": 0.2222222222222222, + "caught": 1.0, + "missed": [ + "ExampleCommand_Run_appHelp", + "ExampleCommand_Run_commandHelp", + "ExampleCommand_Run_noAction", + "ExampleCommand_Run_subcommandNoAction", + "TestBoolFlagHelpOutput", + "TestBoolWithInverseString", + "TestCategorizedHelp", + "TestCommand_ExclusiveFlagsWithAfter" + ], + "recall_graph_only": 0.029850746268656716 + }, + { + "symbol": "main::Command::Walk", + "level": "name", + "truth": 437, + "predicted": 424, + "recall": 0.9588100686498856, + "precision": 0.9882075471698113, + "top_hits": 10, + "top_n": 10, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [ + "ExampleBoolWithInverseFlag", + "ExampleCommand_Run", + "ExampleCommand_Run_appHelp", + "ExampleCommand_Run_commandHelp", + "ExampleCommand_Run_mapValues", + "ExampleCommand_Run_noAction", + "ExampleCommand_Run_shellComplete_bash", + "ExampleCommand_Run_shellComplete_bash_withLongFlag" + ], + "recall_graph_only": 0.9588100686498856 + }, + { + "symbol": "main::Command::Path", + "level": "name", + "truth": 58, + "predicted": 9, + "recall": 0.05172413793103448, + "precision": 0.3333333333333333, + "top_hits": 3, + "top_n": 9, + "top_precision": 0.3333333333333333, + "top_best": 0.3333333333333333, + "caught": 1.0, + "missed": [ + "ExampleCommand_Run_appHelp", + "ExampleCommand_Run_commandHelp", + "ExampleCommand_Run_noAction", + "ExampleCommand_Run_subcommandNoAction", + "ExampleCommand_Walk_visibleTree", + "TestArgumentRequiredUsageInCommandHelp", + "TestCategorizedHelp", + "TestCommandListAlignsNonASCIINames" + ], + "recall_graph_only": 0.017241379310344827 + }, + { + "symbol": "main::DefaultCompleteWithFlags", + "level": "name", + "truth": 13, + "predicted": 69, + "recall": 0.15384615384615385, + "precision": 0.028985507246376812, + "top_hits": 2, + "top_n": 10, + "top_precision": 0.2, + "top_best": 0.2, + "caught": 1.0, + "missed": [ + "ExampleCommand_Run_shellComplete_bash", + "ExampleCommand_Run_shellComplete_bash_withLongFlag", + "ExampleCommand_Run_shellComplete_bash_withMultipleLongFlag", + "ExampleCommand_Run_shellComplete_bash_withShortFlag", + "TestCommand_ParseFlags_InvalidFlagAccessHandler", + "TestCompletionAfterCompleteRootFlag", + "TestCompletionAfterDoubleDashDoesNotLeakToNextRun", + "TestCompletionAfterShortFlag" + ], + "recall_graph_only": 0.07692307692307693 + }, + { + "symbol": "main::Command::Lineage", + "level": "name", + "truth": 461, + "predicted": 142, + "recall": 0.3036876355748373, + "precision": 0.9859154929577465, + "top_hits": 9, + "top_n": 10, + "top_precision": 0.9, + "top_best": 1.0, + "caught": 1.0, + "missed": [ + "ExampleBoolWithInverseFlag", + "ExampleCommand_Run", + "ExampleCommand_Run_appHelp", + "ExampleCommand_Run_commandHelp", + "ExampleCommand_Run_mapValues", + "ExampleCommand_Run_noAction", + "ExampleCommand_Run_shellComplete_bash_withLongFlag", + "ExampleCommand_Run_shellComplete_bash_withMultipleLongFlag" + ], + "recall_graph_only": 0.3036876355748373 + }, + { + "symbol": "main::Command::FullName", + "level": "name", + "truth": 56, + "predicted": 7, + "recall": 0.017857142857142856, + "precision": 0.14285714285714285, + "top_hits": 1, + "top_n": 7, + "top_precision": 0.14285714285714285, + "top_best": 0.14285714285714285, + "caught": 1.0, + "missed": [ + "ExampleCommand_Run_appHelp", + "ExampleCommand_Run_commandHelp", + "ExampleCommand_Run_noAction", + "ExampleCommand_Run_subcommandNoAction", + "TestArgumentRequiredUsageInCommandHelp", + "TestCategorizedHelp", + "TestCommandListAlignsNonASCIINames", + "TestCommand_HelpFlagTakesPrecedenceOverParseErrors" + ], + "recall_graph_only": 0.0 + }, + { + "symbol": "main::EnvVars", + "level": "name", + "truth": 80, + "predicted": 80, + "recall": 1.0, + "precision": 1.0, + "top_hits": 10, + "top_n": 10, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "main::HandleExitCoder", + "level": "name", + "truth": 54, + "predicted": 426, + "recall": 1.0, + "precision": 0.1267605633802817, + "top_hits": 10, + "top_n": 10, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + } + ], + "look": [ + { + "symbol": "main::ValueSourceChain::LookupWithSource", + "look_tokens": 255, + "file_tokens": 1476 + }, + { + "symbol": "main::Command::VisibleFlagCategories", + "look_tokens": 304, + "file_tokens": 6013 + }, + { + "symbol": "main::Command::VisibleFlags", + "look_tokens": 312, + "file_tokens": 6013 + }, + { + "symbol": "main::Exit", + "look_tokens": 435, + "file_tokens": 1356 + }, + { + "symbol": "main::ShowVersion", + "look_tokens": 292, + "file_tokens": 4668 + }, + { + "symbol": "main::ValueSourceChain::EnvKeys", + "look_tokens": 252, + "file_tokens": 1476 + }, + { + "symbol": "main::Command::Walk", + "look_tokens": 319, + "file_tokens": 6013 + }, + { + "symbol": "main::Command::Path", + "look_tokens": 316, + "file_tokens": 6013 + }, + { + "symbol": "main::File", + "look_tokens": 174, + "file_tokens": 1476 + }, + { + "symbol": "main::Command::FullName", + "look_tokens": 304, + "file_tokens": 6013 + }, + { + "symbol": "main::Command::Bool", + "look_tokens": 300, + "file_tokens": 411 + }, + { + "symbol": "main::EnvVar", + "look_tokens": 261, + "file_tokens": 1476 + }, + { + "symbol": "main::Command::LocalFlagNames", + "look_tokens": 267, + "file_tokens": 6013 + }, + { + "symbol": "main::Command::VisiblePersistentFlags", + "look_tokens": 451, + "file_tokens": 6013 + }, + { + "symbol": "main::HandleExitCoder", + "look_tokens": 586, + "file_tokens": 1356 + }, + { + "symbol": "main::EnvVars", + "look_tokens": 284, + "file_tokens": 1476 + }, + { + "symbol": "main::DefaultCompleteWithFlags", + "look_tokens": 716, + "file_tokens": 4668 + }, + { + "symbol": "main::Command::Lineage", + "look_tokens": 342, + "file_tokens": 6013 + }, + { + "symbol": "main::Command::Root", + "look_tokens": 385, + "file_tokens": 6013 + } + ], + "seconds": 9, + "summary": { + "callers_recall": 0.958, + "callers_precision": 0.894, + "callers_checked": 18, + "blind_recall": 0.654, + "blind_checked": 13, + "common_recall": 1.0, + "common_precision": 1.0, + "common_recall_with_maybe": 1.0, + "common_checked": 5, + "rename_ok": 0.842, + "rename_checked": 19, + "tests_recall": 0.415, + "tests_precision": 0.419, + "tests_top10_precision": 0.531, + "tests_top10_best": 0.584, + "tests_caught": 1.0, + "tests_checked": 13, + "look_vs_file": 0.159 + }, + "summary_seeds": { + "7": { + "callers_recall": 0.958, + "callers_precision": 0.894, + "callers_checked": 18, + "blind_recall": 1.0, + "blind_checked": 3, + "common_recall": 1.0, + "common_precision": 1.0, + "common_recall_with_maybe": 1.0, + "common_checked": 2, + "rename_ok": 0.842, + "rename_checked": 19, + "tests_recall": 0.364, + "tests_precision": 0.395, + "tests_top10_precision": 0.457, + "tests_top10_best": 0.532, + "tests_caught": 1.0, + "tests_checked": 8, + "look_vs_file": 0.159 + }, + "8": { + "callers_recall": 0.958, + "callers_precision": 0.894, + "callers_checked": 18, + "blind_recall": 0.562, + "blind_checked": 8, + "common_recall": 1.0, + "common_precision": 1.0, + "common_recall_with_maybe": 1.0, + "common_checked": 4, + "rename_ok": 0.842, + "rename_checked": 19, + "tests_recall": 0.371, + "tests_precision": 0.376, + "tests_top10_precision": 0.466, + "tests_top10_best": 0.504, + "tests_caught": 1.0, + "tests_checked": 8, + "look_vs_file": 0.159 + }, + "9": { + "callers_recall": 0.958, + "callers_precision": 0.894, + "callers_checked": 18, + "blind_recall": 0.556, + "blind_checked": 9, + "common_recall": null, + "common_precision": null, + "common_recall_with_maybe": null, + "common_checked": 0, + "rename_ok": 0.842, + "rename_checked": 19, + "tests_recall": 0.564, + "tests_precision": 0.419, + "tests_top10_precision": 0.544, + "tests_top10_best": 0.619, + "tests_caught": 1.0, + "tests_checked": 8, + "look_vs_file": 0.159 + } + }, + "noise": { + "callers_recall": { + "mean": 0.958, + "functions": 18, + "boot_lo": 0.903, + "boot_hi": 1.0, + "boot_half": 0.049, + "seeds": [ + 0.958, + 0.958, + 0.958 + ], + "seed_sd": 0.0, + "threshold": 0.06 + }, + "callers_precision": { + "mean": 0.894, + "functions": 18, + "boot_lo": 0.792, + "boot_hi": 0.981, + "boot_half": 0.095, + "seeds": [ + 0.894, + 0.894, + 0.894 + ], + "seed_sd": 0.0, + "threshold": 0.1 + }, + "blind_recall": { + "mean": 0.654, + "functions": 13, + "boot_lo": 0.462, + "boot_hi": 0.846, + "boot_half": 0.192, + "seeds": [ + 1.0, + 0.562, + 0.556 + ], + "seed_sd": 0.255, + "threshold": 0.2 + }, + "common_recall": { + "mean": 1.0, + "functions": 5, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.2 + }, + "common_recall_with_maybe": { + "mean": 1.0, + "functions": 5, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.2 + }, + "common_precision": { + "mean": 1.0, + "functions": 5, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.2 + }, + "rename_ok": { + "mean": 0.842, + "functions": 19, + "boot_lo": 0.684, + "boot_hi": 0.947, + "boot_half": 0.132, + "seeds": [ + 0.842, + 0.842, + 0.842 + ], + "seed_sd": 0.0, + "threshold": 0.14 + }, + "tests_recall": { + "mean": 0.415, + "functions": 13, + "boot_lo": 0.236, + "boot_hi": 0.596, + "boot_half": 0.18, + "seeds": [ + 0.364, + 0.371, + 0.564 + ], + "seed_sd": 0.113, + "threshold": 0.19 + }, + "tests_precision": { + "mean": 0.419, + "functions": 13, + "boot_lo": 0.26, + "boot_hi": 0.581, + "boot_half": 0.16, + "seeds": [ + 0.395, + 0.376, + 0.419 + ], + "seed_sd": 0.021, + "threshold": 0.17 + }, + "tests_top10_precision": { + "mean": 0.531, + "functions": 13, + "boot_lo": 0.362, + "boot_hi": 0.697, + "boot_half": 0.168, + "seeds": [ + 0.457, + 0.466, + 0.544 + ], + "seed_sd": 0.048, + "threshold": 0.17 + }, + "tests_top10_best": { + "mean": 0.584, + "functions": 13, + "boot_lo": 0.412, + "boot_hi": 0.755, + "boot_half": 0.171, + "seeds": [ + 0.532, + 0.504, + 0.619 + ], + "seed_sd": 0.06, + "threshold": 0.18 + }, + "tests_caught": { + "mean": 1.0, + "functions": 13, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.08 + }, + "look_vs_file": { + "mean": 0.159, + "functions": 19, + "boot_lo": 0.103, + "boot_hi": 0.229, + "boot_half": 0.063, + "seeds": [ + 0.159, + 0.159, + 0.159 + ], + "seed_sd": 0.0, + "threshold": 0.07 + } + } + }, + { + "repo": "logrus", + "lang": "go", + "commit": "6ef0748d1177", + "index_seconds": 0.0, + "symbols": 311, + "files": 26, + "seeds": [ + 7, + 8, + 9 + ], + "edges": 3476, + "sample": [ + "main::Logger::LogFn", + "main::mutexWrap::Lock", + "main::mutexWrap::Unlock", + "main::Entry::Bytes", + "main::mutexWrap::Disable", + "main::NewEntry" + ], + "sample_common": [ + "main::Entry::Fatalln", + "main::Entry::Logln", + "main::Entry::WriterLevel", + "main::Logger::Panicln", + "main::Logger::Infoln", + "main::Entry::Warningf", + "main::Logger::Errorln", + "main::Entry::WithError", + "main::Entry::Errorf", + "main::Entry::String", + "main::Logger::Info", + "main::Logger::FatalFn", + "main::Entry::Panicf", + "main::Logger::Logf", + "main::Entry::Traceln", + "main::Logger::WithField", + "main::Logger::Println", + "main::Logger::WithContext", + "main::Logger::Debugf", + "hooks::slog::Hook::Fire", + "main::Logger::PrintFn", + "main::Entry::Debug", + "main::Logger::Error", + "main::Entry::Warnln", + "main::Logger::Fatalf", + "main::Logger::DebugFn", + "hooks::syslog::SyslogHook::Fire", + "main::Logger::Warnf", + "main::Logger::Printf", + "main::JSONFormatter::Format", + "main::Logger::IsLevelEnabled", + "main::Logger::WithFields", + "main::Logger::Trace", + "main::Logger::Traceln", + "main::Entry::Errorln", + "main::Logger::SetOutput", + "main::Logger::GetLevel", + "main::Entry::Printf", + "main::Logger::WriterLevel", + "main::Logger::Panic", + "main::Logger::Infof", + "main::Logger::Warnln", + "main::Entry::Info", + "main::Logger::PanicFn", + "main::Logger::Fatal", + "main::Level::String", + "hooks::slog::SlogLevel::Level", + "main::Entry::WithFields" + ], + "samples": { + "7": [ + "main::Logger::LogFn", + "main::mutexWrap::Lock", + "main::mutexWrap::Unlock", + "main::Entry::Bytes", + "main::mutexWrap::Disable", + "main::NewEntry" + ], + "8": [ + "main::mutexWrap::Disable", + "main::mutexWrap::Unlock", + "main::Logger::LogFn", + "main::mutexWrap::Lock", + "main::Entry::Bytes", + "main::NewEntry" + ], + "9": [ + "main::NewEntry", + "main::mutexWrap::Unlock", + "main::Entry::Bytes", + "main::mutexWrap::Disable", + "main::Logger::LogFn", + "main::mutexWrap::Lock" + ] + }, + "samples_common": { + "7": [ + "main::Entry::Fatalln", + "main::Entry::Logln", + "main::Entry::WriterLevel", + "main::Logger::Panicln", + "main::Logger::Infoln", + "main::Entry::Warningf", + "main::Logger::Errorln", + "main::Entry::WithError", + "main::Entry::Errorf", + "main::Entry::String", + "main::Logger::Info", + "main::Logger::FatalFn", + "main::Entry::Panicf", + "main::Logger::Logf", + "main::Entry::Traceln", + "main::Logger::WithField", + "main::Logger::Println", + "main::Logger::WithContext", + "main::Logger::Debugf", + "hooks::slog::Hook::Fire" + ], + "8": [ + "main::Logger::PrintFn", + "main::Entry::Debug", + "main::Entry::WithError", + "main::Logger::Error", + "main::Logger::Infoln", + "main::Entry::String", + "main::Entry::Warnln", + "main::Logger::Fatalf", + "main::Logger::Info", + "main::Logger::DebugFn", + "hooks::syslog::SyslogHook::Fire", + "main::Logger::Warnf", + "main::Logger::Printf", + "main::JSONFormatter::Format", + "main::Entry::Logln", + "main::Logger::IsLevelEnabled", + "main::Logger::WithFields", + "main::Logger::Trace", + "main::Logger::Traceln", + "main::Entry::Errorln" + ], + "9": [ + "main::Logger::SetOutput", + "main::Logger::FatalFn", + "main::Entry::Errorf", + "main::Logger::GetLevel", + "main::Entry::Printf", + "main::Logger::WriterLevel", + "main::Entry::Logln", + "main::Logger::Panic", + "main::Logger::Infof", + "main::Logger::Warnln", + "main::Entry::Info", + "main::Logger::PanicFn", + "main::Logger::Errorln", + "main::Logger::Fatal", + "main::Level::String", + "hooks::slog::SlogLevel::Level", + "hooks::syslog::SyslogHook::Fire", + "main::Entry::Fatalln", + "main::Entry::WithFields", + "main::Logger::Println" + ] + }, + "samples_blind": { + "7": [ + "main::StandardLogger", + "main::Logger::LogFn", + "main::Level::UnmarshalText", + "main::mutexWrap::Lock", + "hooks::slog::Handler::Enabled", + "internal::testutils::LogAndAssertText", + "main::Level::MarshalText", + "main::ParseLevel", + "hooks::slog::NewHandler", + "main::Logger::SetNoLock", + "internal::testutils::LogAndAssertJSON", + "main::mutexWrap::Unlock", + "hooks::slog::Handler::Handle", + "main::RegisterExitHandler", + "hooks::slog::Handler::WithAttrs", + "hooks::slog::NewHook", + "main::Entry::Bytes", + "main::mutexWrap::Disable", + "main::NewEntry", + "main::DeferExitHandler" + ], + "8": [ + "main::mutexWrap::Disable", + "hooks::slog::Handler::WithAttrs", + "main::mutexWrap::Unlock", + "main::Logger::LogFn", + "main::StandardLogger", + "main::Level::UnmarshalText", + "internal::testutils::LogAndAssertText", + "internal::testutils::LogAndAssertJSON", + "main::mutexWrap::Lock", + "main::RegisterExitHandler", + "hooks::slog::Handler::WithGroup", + "main::Logger::SetNoLock", + "main::Entry::Bytes", + "hooks::slog::Handler::Handle", + "main::ParseLevel", + "main::Level::MarshalText", + "main::Logger::ReplaceHooks", + "main::NewEntry", + "main::DeferExitHandler", + "hooks::slog::NewHandler" + ], + "9": [ + "hooks::slog::Handler::Enabled", + "main::NewEntry", + "main::mutexWrap::Unlock", + "main::Level::UnmarshalText", + "main::Entry::Bytes", + "main::ParseLevel", + "hooks::syslog::NewSyslogHook", + "hooks::slog::NewHandler", + "main::mutexWrap::Disable", + "internal::testutils::LogAndAssertJSON", + "main::Logger::ReplaceHooks", + "main::Logger::LogFn", + "main::DeferExitHandler", + "hooks::slog::Handler::WithAttrs", + "main::mutexWrap::Lock", + "main::Level::MarshalText", + "hooks::slog::Handler::WithGroup", + "main::RegisterExitHandler", + "main::StandardLogger", + "main::Entry::HasCaller" + ] + }, + "baseline_failing_tests": [], + "callers": [ + { + "symbol": "main::Logger::LogFn", + "truth": [ + "main::Logger::DebugFn", + "main::Logger::ErrorFn", + "main::Logger::FatalFn", + "main::Logger::InfoFn", + "main::Logger::TraceFn", + "main::Logger::WarnFn" + ], + "found": [ + "main::Logger::DebugFn", + "main::Logger::ErrorFn", + "main::Logger::FatalFn", + "main::Logger::InfoFn", + "main::Logger::TraceFn", + "main::Logger::WarnFn" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::mutexWrap::Lock", + "truth": [ + "main::Entry::Bytes", + "main::Entry::log", + "main::Entry::write", + "main::Logger::AddHook", + "main::Logger::ReplaceHooks", + "main::Logger::SetBufferPool", + "main::Logger::SetFormatter", + "main::Logger::SetOutput", + "main::Logger::SetReportCaller", + "main::Logger::hooksForLevel", + "main::TextFormatter::isTerminal" + ], + "found": [ + "main::Entry::Bytes", + "main::Entry::log", + "main::Entry::write", + "main::Logger::AddHook", + "main::Logger::ReplaceHooks", + "main::Logger::SetBufferPool", + "main::Logger::SetFormatter", + "main::Logger::SetOutput", + "main::Logger::SetReportCaller", + "main::Logger::hooksForLevel", + "main::TextFormatter::isTerminal" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::mutexWrap::Unlock", + "truth": [ + "main::Entry::Bytes", + "main::Entry::log", + "main::Entry::write", + "main::Logger::AddHook", + "main::Logger::ReplaceHooks", + "main::Logger::SetBufferPool", + "main::Logger::SetFormatter", + "main::Logger::SetOutput", + "main::Logger::SetReportCaller", + "main::Logger::hooksForLevel", + "main::TextFormatter::isTerminal" + ], + "found": [ + "main::Entry::Bytes", + "main::Entry::log", + "main::Entry::write", + "main::Logger::AddHook", + "main::Logger::ReplaceHooks", + "main::Logger::SetBufferPool", + "main::Logger::SetFormatter", + "main::Logger::SetOutput", + "main::Logger::SetReportCaller", + "main::Logger::hooksForLevel", + "main::TextFormatter::isTerminal" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Entry::Bytes", + "truth": [ + "hooks::writer::Hook::Fire", + "main::Entry::String" + ], + "found": [ + "hooks::writer::Hook::Fire", + "main::Entry::String", + "main::JSONFormatter::Format", + "main::TextFormatter::Format" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 0.5, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::mutexWrap::Disable", + "truth": [ + "main::Logger::SetNoLock" + ], + "found": [ + "main::Logger::SetNoLock" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::NewEntry", + "truth": [ + "main::Logger::WriterLevel", + "main::Logger::newEntry" + ], + "found": [ + "main::Logger::WriterLevel", + "main::Logger::newEntry" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + } + ], + "callers_common": [ + { + "symbol": "main::Entry::Fatalln", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Entry::Logln", + "truth": [ + "main::Entry::Debugln", + "main::Entry::Errorln", + "main::Entry::Fatalln", + "main::Entry::Infoln", + "main::Entry::Traceln", + "main::Entry::Warnln", + "main::Logger::Logln" + ], + "found": [ + "main::Entry::Debugln", + "main::Entry::Errorln", + "main::Entry::Fatalln", + "main::Entry::Infoln", + "main::Entry::Traceln", + "main::Entry::Warnln", + "main::Logger::Logln" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Entry::WriterLevel", + "truth": [ + "main::Entry::Writer", + "main::Logger::WriterLevel" + ], + "found": [ + "main::Entry::Writer", + "main::Logger::WriterLevel" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Logger::Panicln", + "truth": [ + "main::Panicln" + ], + "found": [ + "main::Panicln" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Logger::Infoln", + "truth": [ + "main::Infoln" + ], + "found": [ + "main::Infoln" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Entry::Warningf", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Logger::Errorln", + "truth": [ + "main::Errorln" + ], + "found": [ + "main::Errorln" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Entry::WithError", + "truth": [ + "main::Logger::WithError" + ], + "found": [ + "main::Logger::WithError" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Entry::Errorf", + "truth": [ + "main::Entry::writerScanner" + ], + "found": [ + "main::Entry::writerScanner" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Entry::String", + "truth": [ + "hooks::syslog::SyslogHook::Fire" + ], + "found": [ + "hooks::syslog::SyslogHook::Fire" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Logger::Info", + "truth": [ + "main::Info" + ], + "found": [ + "main::Info" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Logger::FatalFn", + "truth": [ + "main::FatalFn" + ], + "found": [ + "main::FatalFn" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Entry::Panicf", + "truth": [ + "main::Logger::Panicf" + ], + "found": [ + "main::Logger::Panicf" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Logger::Logf", + "truth": [ + "main::Logger::Debugf", + "main::Logger::Errorf", + "main::Logger::Fatalf", + "main::Logger::Infof", + "main::Logger::Tracef", + "main::Logger::Warnf" + ], + "found": [ + "main::Logger::Debugf", + "main::Logger::Errorf", + "main::Logger::Fatalf", + "main::Logger::Infof", + "main::Logger::Tracef", + "main::Logger::Warnf" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Entry::Traceln", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Logger::WithField", + "truth": [ + "main::WithField" + ], + "found": [ + "main::WithField" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Logger::Println", + "truth": [ + "main::Println" + ], + "found": [ + "main::Println" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Logger::WithContext", + "truth": [ + "main::WithContext" + ], + "found": [ + "main::WithContext" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Logger::Debugf", + "truth": [ + "main::Debugf" + ], + "found": [ + "main::Debugf" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "hooks::slog::Hook::Fire", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Logger::PrintFn", + "truth": [ + "main::PrintFn" + ], + "found": [ + "main::PrintFn" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Entry::Debug", + "truth": [ + "main::Entry::WriterLevel" + ], + "found": [], + "maybe": [], + "import_files": [], + "recall": 0.0, + "precision": null, + "recall_with_maybe": 0.0 + }, + { + "symbol": "main::Logger::Error", + "truth": [ + "main::Error" + ], + "found": [ + "main::Error" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Entry::Warnln", + "truth": [ + "main::Entry::Warningln" + ], + "found": [ + "main::Entry::Warningln" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Logger::Fatalf", + "truth": [ + "main::Fatalf" + ], + "found": [ + "main::Fatalf" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Logger::DebugFn", + "truth": [ + "main::DebugFn" + ], + "found": [ + "main::DebugFn" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "hooks::syslog::SyslogHook::Fire", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Logger::Warnf", + "truth": [ + "main::Logger::Warningf", + "main::Warnf" + ], + "found": [ + "main::Logger::Warningf", + "main::Warnf" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Logger::Printf", + "truth": [ + "main::Printf" + ], + "found": [ + "main::Printf" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::JSONFormatter::Format", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Logger::IsLevelEnabled", + "truth": [ + "hooks::slog::Handler::Enabled", + "hooks::slog::Handler::Handle", + "main::Entry::Log", + "main::Entry::Logf", + "main::Entry::Logln", + "main::Entry::Panic", + "main::Entry::Panicf", + "main::Entry::Panicln", + "main::IsLevelEnabled", + "main::Logger::Log", + "main::Logger::LogFn", + "main::Logger::Logf", + "main::Logger::Logln", + "main::Logger::Panic", + "main::Logger::PanicFn", + "main::Logger::Panicf", + "main::Logger::Panicln" + ], + "found": [ + "hooks::slog::Handler::Enabled", + "hooks::slog::Handler::Handle", + "main::Entry::Log", + "main::Entry::Logf", + "main::Entry::Logln", + "main::Entry::Panic", + "main::Entry::Panicf", + "main::Entry::Panicln", + "main::IsLevelEnabled", + "main::Logger::Log", + "main::Logger::LogFn", + "main::Logger::Logf", + "main::Logger::Logln", + "main::Logger::Panic", + "main::Logger::PanicFn", + "main::Logger::Panicf", + "main::Logger::Panicln" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Logger::WithFields", + "truth": [ + "main::WithFields" + ], + "found": [ + "main::WithFields" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Logger::Trace", + "truth": [ + "main::Trace" + ], + "found": [ + "main::Trace" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Logger::Traceln", + "truth": [ + "main::Traceln" + ], + "found": [ + "main::Traceln" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Entry::Errorln", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Logger::SetOutput", + "truth": [ + "main::SetOutput" + ], + "found": [ + "main::SetOutput" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Logger::GetLevel", + "truth": [ + "main::GetLevel" + ], + "found": [ + "main::GetLevel" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Entry::Printf", + "truth": [ + "main::Logger::Printf" + ], + "found": [ + "main::Logger::Printf" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Logger::WriterLevel", + "truth": [ + "main::Logger::Writer" + ], + "found": [ + "main::Logger::Writer" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Logger::Panic", + "truth": [ + "main::Panic" + ], + "found": [ + "main::Panic" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Logger::Infof", + "truth": [ + "main::Infof" + ], + "found": [ + "main::Infof" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Logger::Warnln", + "truth": [ + "main::Logger::Warningln", + "main::Warnln" + ], + "found": [ + "main::Logger::Warningln", + "main::Warnln" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Entry::Info", + "truth": [ + "main::Entry::Print", + "main::Entry::WriterLevel" + ], + "found": [ + "main::Entry::Print" + ], + "maybe": [], + "import_files": [], + "recall": 0.5, + "precision": 1.0, + "recall_with_maybe": 0.5 + }, + { + "symbol": "main::Logger::PanicFn", + "truth": [ + "main::PanicFn" + ], + "found": [ + "main::PanicFn" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Logger::Fatal", + "truth": [ + "main::Fatal" + ], + "found": [ + "main::Fatal" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Level::String", + "truth": [ + "main::JSONFormatter::Format", + "main::Level::MarshalText", + "main::TextFormatter::printPlain", + "main::formatLevel" + ], + "found": [ + "main", + "main::JSONFormatter::Format", + "main::Level::MarshalText", + "main::TextFormatter::printPlain", + "main::formatLevel" + ], + "maybe": [], + "import_files": [ + "level.go" + ], + "recall": 1.0, + "precision": 0.8, + "recall_with_maybe": 1.0 + }, + { + "symbol": "hooks::slog::SlogLevel::Level", + "truth": [ + "hooks::slog::Handler::toLogrusLevel" + ], + "found": [], + "maybe": [ + "hooks::slog::Handler::toLogrusLevel" + ], + "import_files": [], + "recall": 0.0, + "precision": null, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Entry::WithFields", + "truth": [ + "main::Logger::WithFields" + ], + "found": [ + "main::Logger::WithFields" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + } + ], + "callers_blind": [ + { + "symbol": "main::StandardLogger", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Logger::LogFn", + "truth": [ + "main::Logger::DebugFn", + "main::Logger::ErrorFn", + "main::Logger::FatalFn", + "main::Logger::InfoFn", + "main::Logger::TraceFn", + "main::Logger::WarnFn" + ], + "found": [ + "main::Logger::DebugFn", + "main::Logger::ErrorFn", + "main::Logger::FatalFn", + "main::Logger::InfoFn", + "main::Logger::TraceFn", + "main::Logger::WarnFn" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Level::UnmarshalText", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::mutexWrap::Lock", + "truth": [ + "main::Entry::Bytes", + "main::Entry::log", + "main::Entry::write", + "main::Logger::AddHook", + "main::Logger::ReplaceHooks", + "main::Logger::SetBufferPool", + "main::Logger::SetFormatter", + "main::Logger::SetOutput", + "main::Logger::SetReportCaller", + "main::Logger::hooksForLevel", + "main::TextFormatter::isTerminal" + ], + "found": [ + "main::Entry::Bytes", + "main::Entry::log", + "main::Entry::write", + "main::Logger::AddHook", + "main::Logger::ReplaceHooks", + "main::Logger::SetBufferPool", + "main::Logger::SetFormatter", + "main::Logger::SetOutput", + "main::Logger::SetReportCaller", + "main::Logger::hooksForLevel", + "main::TextFormatter::isTerminal" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "hooks::slog::Handler::Enabled", + "skipped": "compiler reported no uses" + }, + { + "symbol": "internal::testutils::LogAndAssertText", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Level::MarshalText", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::ParseLevel", + "skipped": "compiler reported no uses" + }, + { + "symbol": "hooks::slog::NewHandler", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Logger::SetNoLock", + "skipped": "compiler reported no uses" + }, + { + "symbol": "internal::testutils::LogAndAssertJSON", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::mutexWrap::Unlock", + "truth": [ + "main::Entry::Bytes", + "main::Entry::log", + "main::Entry::write", + "main::Logger::AddHook", + "main::Logger::ReplaceHooks", + "main::Logger::SetBufferPool", + "main::Logger::SetFormatter", + "main::Logger::SetOutput", + "main::Logger::SetReportCaller", + "main::Logger::hooksForLevel", + "main::TextFormatter::isTerminal" + ], + "found": [ + "main::Entry::Bytes", + "main::Entry::log", + "main::Entry::write", + "main::Logger::AddHook", + "main::Logger::ReplaceHooks", + "main::Logger::SetBufferPool", + "main::Logger::SetFormatter", + "main::Logger::SetOutput", + "main::Logger::SetReportCaller", + "main::Logger::hooksForLevel", + "main::TextFormatter::isTerminal" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "hooks::slog::Handler::Handle", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::RegisterExitHandler", + "skipped": "compiler reported no uses" + }, + { + "symbol": "hooks::slog::Handler::WithAttrs", + "skipped": "compiler reported no uses" + }, + { + "symbol": "hooks::slog::NewHook", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Entry::Bytes", + "truth": [ + "hooks::writer::Hook::Fire", + "main::Entry::String" + ], + "found": [ + "hooks::writer::Hook::Fire", + "main::Entry::String", + "main::JSONFormatter::Format", + "main::TextFormatter::Format" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 0.5, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::mutexWrap::Disable", + "truth": [ + "main::Logger::SetNoLock" + ], + "found": [ + "main::Logger::SetNoLock" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::NewEntry", + "truth": [ + "main::Logger::WriterLevel", + "main::Logger::newEntry" + ], + "found": [ + "main::Logger::WriterLevel", + "main::Logger::newEntry" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::DeferExitHandler", + "skipped": "compiler reported no uses" + }, + { + "symbol": "hooks::slog::Handler::WithGroup", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Logger::ReplaceHooks", + "skipped": "compiler reported no uses" + }, + { + "symbol": "hooks::syslog::NewSyslogHook", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Entry::HasCaller", + "skipped": "compiler reported no uses" + } + ], + "rename": [ + { + "symbol": "main::Logger::LogFn", + "ok": false, + "compiled": false, + "tests_ok": null, + "tests_failed": [], + "old_name_left": "logger_test.go:94:\t\t\t\tlogger.LogFn(logrus.PanicLevel, func() []any { return []any{\"boom\", 42} })", + "detail": ".test]\n./logger_test.go:94:12: logger.LogFn undefined (type *logrus.Logger has no field or method LogFn)\nFAIL\tgithub.com/sirupsen/logrus [build failed]\nok \tgithub.com/sirupsen/logrus/hooks/slog\t0.009s [no tests to run]\nok \tgithub.com/sirupsen/logrus/hooks/syslog\t0.004s [no tests to run]\nok \tgithub.com/sirupsen/logrus/hooks/test\t0.003s [no tests to run]\nok \tgithub.com/sirupsen/logrus/hooks/writer\t0.003s [no tests to run]\n? \tgithub.com/sirupsen/logrus/internal/testutils\t[no test files]\nFAIL\n" + }, + { + "symbol": "main::mutexWrap::Lock", + "ok": false, + "compiled": false, + "tests_ok": null, + "tests_failed": [], + "old_name_left": "hooks/test/test.go:48:\tt.mu.Lock()\nhooks/test/test.go:84:\tt.mu.Lock()\nlogger.go:70:\t\tmw.lock.Lock()\nwriter_test.go:51:\tb.mu.Lock()", + "detail": "nx)\n./logrus_test.go:692:9: cond.L.LockGnx undefined (type \"sync\".Locker has no field or method LockGnx)\nFAIL\tgithub.com/sirupsen/logrus [build failed]\nok \tgithub.com/sirupsen/logrus/hooks/slog\t0.004s [no tests to run]\nok \tgithub.com/sirupsen/logrus/hooks/syslog\t0.008s [no tests to run]\nok \tgithub.com/sirupsen/logrus/hooks/test\t0.004s [no tests to run]\nok \tgithub.com/sirupsen/logrus/hooks/writer\t0.008s [no tests to run]\n? \tgithub.com/sirupsen/logrus/internal/testutils\t[no test files]\nFAIL\n" + }, + { + "symbol": "main::mutexWrap::Unlock", + "ok": false, + "compiled": false, + "tests_ok": null, + "tests_failed": [], + "old_name_left": "hooks/test/test.go:49:\tdefer t.mu.Unlock()\nhooks/test/test.go:85:\tdefer t.mu.Unlock()\nlogger.go:76:\t\tmw.lock.Unlock()\nwriter_test.go:52:\tdefer b.mu.Unlock()", + "detail": "./logrus_test.go:694:9: cond.L.UnlockGnx undefined (type \"sync\".Locker has no field or method UnlockGnx)\nFAIL\tgithub.com/sirupsen/logrus [build failed]\nok \tgithub.com/sirupsen/logrus/hooks/slog\t0.003s [no tests to run]\nok \tgithub.com/sirupsen/logrus/hooks/syslog\t0.003s [no tests to run]\nok \tgithub.com/sirupsen/logrus/hooks/test\t0.005s [no tests to run]\nok \tgithub.com/sirupsen/logrus/hooks/writer\t0.005s [no tests to run]\n? \tgithub.com/sirupsen/logrus/internal/testutils\t[no test files]\nFAIL\n" + }, + { + "symbol": "main::Entry::Bytes", + "ok": false, + "compiled": false, + "tests_ok": null, + "tests_failed": [], + "old_name_left": "entry.go:130:// Bytes returns the bytes representation of this entry from the formatter.\nentry_test.go:122:\t\t\t\trequire.NoError(t, json.Unmarshal(buf.Bytes(), &data))\nentry_test.go:439:\trequire.NoError(t, json.Unmarshal(buf.Bytes(), &data))\ninternal/testutils/testutils.go:24:\terr := json.Unmarshal(bu", + "detail": "tes.Buffer has no field or method BytesGnx)\n./text_formatter.go:171:11: b.BytesGnx undefined (type *bytes.Buffer has no field or method BytesGnx)\nFAIL\tgithub.com/sirupsen/logrus [build failed]\nFAIL\tgithub.com/sirupsen/logrus/hooks/slog [build failed]\nFAIL\tgithub.com/sirupsen/logrus/hooks/syslog [build failed]\nFAIL\tgithub.com/sirupsen/logrus/hooks/test [build failed]\nFAIL\tgithub.com/sirupsen/logrus/hooks/writer [build failed]\nFAIL\tgithub.com/sirupsen/logrus/internal/testutils [build failed]\nFAIL\n" + }, + { + "symbol": "main::mutexWrap::Disable", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "text_formatter.go:50:\t// Disable timestamp logging. useful when output is redirected to logging", + "detail": "" + }, + { + "symbol": "main::NewEntry", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + } + ], + "mutants": { + "7": [ + "main::Logger::LogFn", + "main::mutexWrap::Lock", + "main::mutexWrap::Unlock", + "main::Entry::Bytes", + "main::mutexWrap::Disable", + "main::NewEntry" + ], + "8": [ + "main::mutexWrap::Disable", + "main::mutexWrap::Unlock", + "main::Logger::LogFn", + "main::mutexWrap::Lock", + "main::Entry::Bytes", + "main::NewEntry" + ], + "9": [ + "main::NewEntry", + "main::mutexWrap::Unlock", + "main::Entry::Bytes", + "main::mutexWrap::Disable", + "main::Logger::LogFn", + "main::mutexWrap::Lock" + ] + }, + "tests": [ + { + "symbol": "main::Logger::LogFn", + "level": "name", + "truth": 2, + "predicted": 4, + "recall": 1.0, + "precision": 0.5, + "top_hits": 2, + "top_n": 4, + "top_precision": 0.5, + "top_best": 0.5, + "caught": 1.0, + "missed": [], + "recall_graph_only": 0.5 + }, + { + "symbol": "main::mutexWrap::Lock", + "level": "name", + "truth": 113, + "predicted": 85, + "recall": 0.6194690265486725, + "precision": 0.8235294117647058, + "top_hits": 10, + "top_n": 10, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [ + "ExampleDefaultFieldHook", + "ExampleGlobalHook", + "ExampleJSONFormatter_CallerPrettyfier", + "ExampleNewHandler", + "ExampleNewHandler_options", + "ExampleNewHook", + "ExampleNewHook_migration", + "Example_basic" + ], + "recall_graph_only": 0.6194690265486725 + }, + { + "symbol": "main::mutexWrap::Unlock", + "level": "name", + "truth": 113, + "predicted": 85, + "recall": 0.6194690265486725, + "precision": 0.8235294117647058, + "top_hits": 10, + "top_n": 10, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [ + "ExampleDefaultFieldHook", + "ExampleGlobalHook", + "ExampleJSONFormatter_CallerPrettyfier", + "ExampleNewHandler", + "ExampleNewHandler_options", + "ExampleNewHook", + "ExampleNewHook_migration", + "Example_basic" + ], + "recall_graph_only": 0.6194690265486725 + }, + { + "symbol": "main::Entry::Bytes", + "level": "name", + "truth": 4, + "predicted": 20, + "recall": 0.25, + "precision": 0.05, + "top_hits": 1, + "top_n": 10, + "top_precision": 0.1, + "top_best": 0.1, + "caught": 1.0, + "missed": [ + "Example_hook", + "TestDifferentLevelsGoToDifferentWriters", + "TestLocalhostAddAndPrint" + ], + "recall_graph_only": 0.25 + }, + { + "symbol": "main::mutexWrap::Disable", + "skipped": "no test fails when it throws", + "predicted": 4 + }, + { + "symbol": "main::NewEntry", + "level": "name", + "truth": 105, + "predicted": 89, + "recall": 0.8476190476190476, + "precision": 1.0, + "top_hits": 10, + "top_n": 10, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [ + "ExampleDefaultFieldHook", + "ExampleGlobalHook", + "ExampleJSONFormatter_CallerPrettyfier", + "ExampleNewHandler", + "ExampleNewHook", + "ExampleNewHook_migration", + "Example_basic", + "Example_hook" + ], + "recall_graph_only": 0.8476190476190476 + } + ], + "look": [ + { + "symbol": "main::Logger::LogFn", + "look_tokens": 306, + "file_tokens": 3152 + }, + { + "symbol": "main::mutexWrap::Lock", + "look_tokens": 297, + "file_tokens": 3152 + }, + { + "symbol": "main::mutexWrap::Unlock", + "look_tokens": 301, + "file_tokens": 3152 + }, + { + "symbol": "main::Entry::Bytes", + "look_tokens": 388, + "file_tokens": 3899 + }, + { + "symbol": "main::mutexWrap::Disable", + "look_tokens": 147, + "file_tokens": 3152 + }, + { + "symbol": "main::NewEntry", + "look_tokens": 316, + "file_tokens": 3899 + } + ], + "seconds": 2, + "summary": { + "callers_recall": 1.0, + "callers_precision": 0.917, + "callers_checked": 6, + "blind_recall": 1.0, + "blind_checked": 6, + "common_recall": 0.939, + "common_precision": 0.995, + "common_recall_with_maybe": 0.963, + "common_checked": 41, + "rename_ok": 0.333, + "rename_checked": 6, + "tests_recall": 0.667, + "tests_precision": 0.639, + "tests_top10_precision": 0.72, + "tests_top10_best": 0.72, + "tests_caught": 1.0, + "tests_checked": 5, + "look_vs_file": 0.086 + }, + "summary_seeds": { + "7": { + "callers_recall": 1.0, + "callers_precision": 0.917, + "callers_checked": 6, + "blind_recall": 1.0, + "blind_checked": 6, + "common_recall": 1.0, + "common_precision": 1.0, + "common_recall_with_maybe": 1.0, + "common_checked": 16, + "rename_ok": 0.333, + "rename_checked": 6, + "tests_recall": 0.667, + "tests_precision": 0.639, + "tests_top10_precision": 0.72, + "tests_top10_best": 0.72, + "tests_caught": 1.0, + "tests_checked": 5, + "look_vs_file": 0.086 + }, + "8": { + "callers_recall": 1.0, + "callers_precision": 0.917, + "callers_checked": 6, + "blind_recall": 1.0, + "blind_checked": 6, + "common_recall": 0.941, + "common_precision": 1.0, + "common_recall_with_maybe": 0.941, + "common_checked": 17, + "rename_ok": 0.333, + "rename_checked": 6, + "tests_recall": 0.667, + "tests_precision": 0.639, + "tests_top10_precision": 0.72, + "tests_top10_best": 0.72, + "tests_caught": 1.0, + "tests_checked": 5, + "look_vs_file": 0.086 + }, + "9": { + "callers_recall": 1.0, + "callers_precision": 0.917, + "callers_checked": 6, + "blind_recall": 1.0, + "blind_checked": 6, + "common_recall": 0.917, + "common_precision": 0.988, + "common_recall_with_maybe": 0.972, + "common_checked": 18, + "rename_ok": 0.333, + "rename_checked": 6, + "tests_recall": 0.667, + "tests_precision": 0.639, + "tests_top10_precision": 0.72, + "tests_top10_best": 0.72, + "tests_caught": 1.0, + "tests_checked": 5, + "look_vs_file": 0.086 + } + }, + "noise": { + "callers_recall": { + "mean": 1.0, + "functions": 6, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.17 + }, + "callers_precision": { + "mean": 0.917, + "functions": 6, + "boot_lo": 0.75, + "boot_hi": 1.0, + "boot_half": 0.125, + "seeds": [ + 0.917, + 0.917, + 0.917 + ], + "seed_sd": 0.0, + "threshold": 0.17 + }, + "blind_recall": { + "mean": 1.0, + "functions": 6, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.17 + }, + "common_recall": { + "mean": 0.939, + "functions": 41, + "boot_lo": 0.878, + "boot_hi": 0.988, + "boot_half": 0.055, + "seeds": [ + 1.0, + 0.941, + 0.917 + ], + "seed_sd": 0.043, + "threshold": 0.06 + }, + "common_recall_with_maybe": { + "mean": 0.963, + "functions": 41, + "boot_lo": 0.915, + "boot_hi": 1.0, + "boot_half": 0.043, + "seeds": [ + 1.0, + 0.941, + 0.972 + ], + "seed_sd": 0.029, + "threshold": 0.05 + }, + "common_precision": { + "mean": 0.995, + "functions": 39, + "boot_lo": 0.985, + "boot_hi": 1.0, + "boot_half": 0.008, + "seeds": [ + 1.0, + 1.0, + 0.988 + ], + "seed_sd": 0.007, + "threshold": 0.03 + }, + "rename_ok": { + "mean": 0.333, + "functions": 6, + "boot_lo": 0.0, + "boot_hi": 0.667, + "boot_half": 0.333, + "seeds": [ + 0.333, + 0.333, + 0.333 + ], + "seed_sd": 0.0, + "threshold": 0.34 + }, + "tests_recall": { + "mean": 0.667, + "functions": 5, + "boot_lo": 0.472, + "boot_hi": 0.848, + "boot_half": 0.188, + "seeds": [ + 0.667, + 0.667, + 0.667 + ], + "seed_sd": 0.0, + "threshold": 0.2 + }, + "tests_precision": { + "mean": 0.639, + "functions": 5, + "boot_lo": 0.385, + "boot_hi": 0.865, + "boot_half": 0.24, + "seeds": [ + 0.639, + 0.639, + 0.639 + ], + "seed_sd": 0.0, + "threshold": 0.24 + }, + "tests_top10_precision": { + "mean": 0.72, + "functions": 5, + "boot_lo": 0.44, + "boot_hi": 1.0, + "boot_half": 0.28, + "seeds": [ + 0.72, + 0.72, + 0.72 + ], + "seed_sd": 0.0, + "threshold": 0.28 + }, + "tests_top10_best": { + "mean": 0.72, + "functions": 5, + "boot_lo": 0.44, + "boot_hi": 1.0, + "boot_half": 0.28, + "seeds": [ + 0.72, + 0.72, + 0.72 + ], + "seed_sd": 0.0, + "threshold": 0.28 + }, + "tests_caught": { + "mean": 1.0, + "functions": 5, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.2 + }, + "look_vs_file": { + "mean": 0.086, + "functions": 6, + "boot_lo": 0.071, + "boot_hi": 0.096, + "boot_half": 0.013, + "seeds": [ + 0.086, + 0.086, + 0.086 + ], + "seed_sd": 0.0, + "threshold": 0.02 + } + } + }, + { + "repo": "itertools", + "lang": "rust", + "commit": "8b4c6cb2732a", + "index_seconds": 0.1, + "symbols": 1013, + "files": 64, + "seeds": [ + 7, + 8, + 9 + ], + "edges": 8964, + "sample": [ + "itertools::either_or_both::EitherOrBoth::or_default", + "itertools::either_or_both::EitherOrBoth::both", + "itertools::adaptors::checked_binomial", + "itertools::either_or_both::EitherOrBoth::map_any", + "itertools::lazy_buffer::LazyBuffer::get_at", + "itertools::Itertools::strip_prefix_by", + "itertools::Itertools::collect_vec", + "itertools::grouping_map::GroupingMap::fold_with", + "itertools::Itertools::chunk_by", + "itertools::extrema_set::max_set_impl", + "itertools::Itertools::next_tuple", + "itertools::adaptors::PutBack::with_value", + "itertools::Itertools::position_max", + "itertools::extrema_set::min_set_impl", + "itertools::either_or_both::EitherOrBoth::or_else", + "itertools::either_or_both::EitherOrBoth::right_or_insert_with", + "itertools::Itertools::set_from", + "itertools::Itertools::position_min", + "itertools::Itertools::position_minmax", + "itertools::minmax::MinMaxResult::into_option", + "itertools::next_array::ArrayBuilder::take", + "itertools::grouping_map::GroupingMap::max_by", + "itertools::groupbylazy::new_chunks", + "itertools::k_smallest::key_to_cmp", + "itertools::size_hint::mul_scalar", + "itertools::next_array::ArrayBuilder::push", + "itertools::Itertools::fold_ok", + "itertools::Itertools::partition_map", + "itertools::heap::heapify", + "itertools::Itertools::fold1", + "itertools::lazy_buffer::LazyBuffer::get_next", + "itertools::size_hint::add_scalar", + "itertools::Itertools::all_unique_with_hasher", + "itertools::partition", + "itertools::either_or_both::EitherOrBoth::as_ref", + "itertools::grouping_map::GroupingMap::aggregate", + "itertools::Itertools::k_smallest_relaxed", + "itertools::either_or_both::EitherOrBoth::insert_right", + "itertools::grouping_map::GroupingMap::product", + "itertools::Itertools::k_smallest_by", + "itertools::Itertools::k_largest_relaxed_by", + "itertools::minmax::minmax_impl", + "itertools::heap::sift_down", + "itertools::combinations::Combinations::reset", + "itertools::k_smallest::k_smallest_general", + "itertools::grouping_map::new_map_for_grouping", + "itertools::either_or_both::EitherOrBoth::left_or_insert_with" + ], + "sample_common": [ + "itertools::Itertools::next_array", + "itertools::adaptors::PutBack::put_back", + "itertools::Itertools::sorted", + "itertools::Itertools::multi_cartesian_product", + "itertools::Itertools::minmax_by", + "itertools::peek_nth::PeekNth::peek_nth", + "itertools::Itertools::intersperse", + "itertools::Itertools::array_combinations_with_replacement", + "itertools::Itertools::intersperse_with", + "itertools::multipeek_impl::MultiPeek::peek", + "itertools::Itertools::cartesian_product", + "itertools::Itertools::multiunzip", + "itertools::Itertools::tuples", + "itertools::Itertools::all_equal", + "itertools::Itertools::sorted_unstable", + "itertools::Itertools::array_combinations", + "itertools::Itertools::permutations", + "itertools::Itertools::minmax", + "itertools::Itertools::tuple_windows", + "itertools::Itertools::kmerge", + "itertools::either_or_both::EitherOrBoth::reduce", + "itertools::peek_nth::PeekNth::peek", + "itertools::grouping_map::GroupingMap::minmax_by", + "itertools::Itertools::dedup", + "itertools::put_back_n_impl::PutBackN::put_back", + "itertools::grouping_map::GroupingMap::reduce" + ], + "samples": { + "7": [ + "itertools::either_or_both::EitherOrBoth::or_default", + "itertools::either_or_both::EitherOrBoth::both", + "itertools::adaptors::checked_binomial", + "itertools::either_or_both::EitherOrBoth::map_any", + "itertools::lazy_buffer::LazyBuffer::get_at", + "itertools::Itertools::strip_prefix_by", + "itertools::Itertools::collect_vec", + "itertools::grouping_map::GroupingMap::fold_with", + "itertools::Itertools::chunk_by", + "itertools::extrema_set::max_set_impl", + "itertools::Itertools::next_tuple", + "itertools::adaptors::PutBack::with_value", + "itertools::Itertools::position_max", + "itertools::extrema_set::min_set_impl", + "itertools::either_or_both::EitherOrBoth::or_else", + "itertools::either_or_both::EitherOrBoth::right_or_insert_with", + "itertools::Itertools::set_from", + "itertools::Itertools::position_min", + "itertools::Itertools::position_minmax", + "itertools::minmax::MinMaxResult::into_option" + ], + "8": [ + "itertools::next_array::ArrayBuilder::take", + "itertools::grouping_map::GroupingMap::max_by", + "itertools::groupbylazy::new_chunks", + "itertools::k_smallest::key_to_cmp", + "itertools::size_hint::mul_scalar", + "itertools::next_array::ArrayBuilder::push", + "itertools::Itertools::fold_ok", + "itertools::extrema_set::min_set_impl", + "itertools::minmax::MinMaxResult::into_option", + "itertools::Itertools::partition_map", + "itertools::heap::heapify", + "itertools::Itertools::fold1", + "itertools::lazy_buffer::LazyBuffer::get_next", + "itertools::size_hint::add_scalar", + "itertools::Itertools::all_unique_with_hasher", + "itertools::Itertools::next_tuple", + "itertools::partition", + "itertools::either_or_both::EitherOrBoth::as_ref", + "itertools::either_or_both::EitherOrBoth::or_else", + "itertools::extrema_set::max_set_impl" + ], + "9": [ + "itertools::grouping_map::GroupingMap::aggregate", + "itertools::Itertools::k_smallest_relaxed", + "itertools::either_or_both::EitherOrBoth::insert_right", + "itertools::either_or_both::EitherOrBoth::or_default", + "itertools::either_or_both::EitherOrBoth::right_or_insert_with", + "itertools::grouping_map::GroupingMap::product", + "itertools::k_smallest::key_to_cmp", + "itertools::Itertools::k_smallest_by", + "itertools::either_or_both::EitherOrBoth::as_ref", + "itertools::Itertools::k_largest_relaxed_by", + "itertools::minmax::minmax_impl", + "itertools::heap::sift_down", + "itertools::combinations::Combinations::reset", + "itertools::k_smallest::k_smallest_general", + "itertools::extrema_set::min_set_impl", + "itertools::either_or_both::EitherOrBoth::map_any", + "itertools::partition", + "itertools::Itertools::next_tuple", + "itertools::grouping_map::new_map_for_grouping", + "itertools::either_or_both::EitherOrBoth::left_or_insert_with" + ] + }, + "samples_common": { + "7": [ + "itertools::Itertools::next_array", + "itertools::adaptors::PutBack::put_back", + "itertools::Itertools::sorted", + "itertools::Itertools::multi_cartesian_product", + "itertools::Itertools::minmax_by", + "itertools::peek_nth::PeekNth::peek_nth", + "itertools::Itertools::intersperse", + "itertools::Itertools::array_combinations_with_replacement", + "itertools::Itertools::intersperse_with", + "itertools::multipeek_impl::MultiPeek::peek", + "itertools::Itertools::cartesian_product", + "itertools::Itertools::multiunzip", + "itertools::Itertools::tuples", + "itertools::Itertools::all_equal", + "itertools::Itertools::sorted_unstable", + "itertools::Itertools::array_combinations", + "itertools::Itertools::permutations", + "itertools::Itertools::minmax", + "itertools::Itertools::tuple_windows", + "itertools::Itertools::kmerge" + ], + "8": [ + "itertools::Itertools::permutations", + "itertools::Itertools::array_combinations_with_replacement", + "itertools::adaptors::PutBack::put_back", + "itertools::Itertools::sorted", + "itertools::peek_nth::PeekNth::peek_nth", + "itertools::Itertools::kmerge", + "itertools::Itertools::intersperse_with", + "itertools::Itertools::array_combinations", + "itertools::Itertools::minmax", + "itertools::either_or_both::EitherOrBoth::reduce", + "itertools::peek_nth::PeekNth::peek", + "itertools::Itertools::intersperse", + "itertools::grouping_map::GroupingMap::minmax_by", + "itertools::Itertools::multi_cartesian_product", + "itertools::Itertools::tuples", + "itertools::Itertools::sorted_unstable", + "itertools::Itertools::all_equal", + "itertools::Itertools::multiunzip", + "itertools::Itertools::dedup", + "itertools::Itertools::next_array" + ], + "9": [ + "itertools::Itertools::sorted_unstable", + "itertools::put_back_n_impl::PutBackN::put_back", + "itertools::Itertools::intersperse_with", + "itertools::multipeek_impl::MultiPeek::peek", + "itertools::Itertools::multi_cartesian_product", + "itertools::peek_nth::PeekNth::peek_nth", + "itertools::Itertools::minmax", + "itertools::Itertools::all_equal", + "itertools::Itertools::multiunzip", + "itertools::grouping_map::GroupingMap::minmax_by", + "itertools::grouping_map::GroupingMap::reduce", + "itertools::Itertools::tuple_windows", + "itertools::Itertools::kmerge", + "itertools::Itertools::next_array", + "itertools::Itertools::array_combinations_with_replacement", + "itertools::Itertools::intersperse", + "itertools::Itertools::permutations", + "itertools::Itertools::array_combinations", + "itertools::Itertools::sorted", + "itertools::Itertools::cartesian_product" + ] + }, + "samples_blind": { + "7": [ + "itertools::tuple_impl::Tuples::into_buffer", + "itertools::Itertools::k_smallest_relaxed_by_key", + "itertools::Itertools::max_set", + "itertools::Itertools::position_max_by", + "itertools::either_or_both::EitherOrBoth::or_default", + "itertools::Itertools::unique", + "itertools::peek_nth::PeekNth::peek_mut", + "itertools::either_or_both::EitherOrBoth::both", + "itertools::Itertools::position_min_by", + "itertools::adaptors::checked_binomial", + "itertools::either_or_both::EitherOrBoth::map_any", + "itertools::lazy_buffer::LazyBuffer::get_at", + "itertools::Itertools::strip_prefix_by", + "itertools::Itertools::k_largest_relaxed_by_key", + "itertools::Itertools::collect_vec", + "itertools::benches::fold_specialization::specialization::intersperse::internal_specialized", + "itertools::Itertools::tail", + "itertools::grouping_map::GroupingMap::fold_with", + "itertools::Itertools::chunk_by", + "itertools::Itertools::k_smallest_by_key" + ], + "8": [ + "itertools::repeatn::repeat_n", + "itertools::next_array::ArrayBuilder::take", + "itertools::with_position::Position::is_last", + "itertools::Itertools::min_set", + "itertools::grouping_map::GroupingMap::max_by", + "itertools::groupbylazy::new_chunks", + "itertools::k_smallest::key_to_cmp", + "itertools::size_hint::mul_scalar", + "itertools::next_array::ArrayBuilder::push", + "itertools::Itertools::fold_ok", + "itertools::extrema_set::min_set_impl", + "itertools::either_or_both::EitherOrBoth::has_right", + "itertools::minmax::MinMaxResult::into_option", + "itertools::Itertools::partition_map", + "itertools::heap::heapify", + "itertools::Itertools::sorted_by_key", + "itertools::either_or_both::EitherOrBoth::left_and_then", + "itertools::either_or_both::EitherOrBoth::is_right", + "itertools::Itertools::strip_prefix", + "itertools::Itertools::try_len" + ], + "9": [ + "itertools::Itertools::sorted_by", + "itertools::Itertools::dropping", + "itertools::grouping_map::GroupingMap::aggregate", + "itertools::free::enumerate", + "itertools::Itertools::k_smallest_relaxed", + "itertools::either_or_both::EitherOrBoth::insert_right", + "itertools::grouping_map::GroupingMap::min_by_key", + "itertools::either_or_both::EitherOrBoth::or_default", + "itertools::either_or_both::EitherOrBoth::right_or_insert_with", + "itertools::grouping_map::GroupingMap::product", + "itertools::Itertools::unique", + "itertools::either_or_both::EitherOrBoth::has_left", + "itertools::k_smallest::key_to_cmp", + "itertools::Itertools::k_smallest_by", + "itertools::either_or_both::EitherOrBoth::as_ref", + "itertools::Itertools::duplicates", + "itertools::tuple_impl::TupleCollect::buffer_len", + "itertools::Itertools::k_largest_relaxed_by", + "itertools::minmax::minmax_impl", + "itertools::multipeek_impl::MultiPeek::reset_peek" + ] + }, + "baseline_failing_tests": [], + "callers": [ + { + "symbol": "itertools::either_or_both::EitherOrBoth::or_default", + "truth": [ + "itertools::either_or_both::EitherOrBoth::left_and_right" + ], + "found": [ + "itertools::Itertools::counts_with_hasher", + "itertools::either_or_both::EitherOrBoth::left_and_right", + "itertools::group_map::into_group_map_with_hasher" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 0.3333333333333333, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::both", + "truth": [ + "itertools::either_or_both::EitherOrBoth::is_both" + ], + "found": [ + "itertools::either_or_both::EitherOrBoth::is_both" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::adaptors::checked_binomial", + "truth": [ + "itertools::adaptors::impl_tuple_combination", + "itertools::combinations::remaining_for", + "itertools::combinations_with_replacement::remaining_for", + "itertools::powerset::remaining_for" + ], + "found": [ + "itertools::adaptors::impl_tuple_combination", + "itertools::combinations::remaining_for", + "itertools::combinations_with_replacement::remaining_for", + "itertools::powerset::remaining_for" + ], + "maybe": [], + "import_files": [ + "src/combinations.rs", + "src/combinations_with_replacement.rs", + "src/lib.rs", + "src/powerset.rs" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::map_any", + "truth": [ + "itertools::either_or_both::EitherOrBoth::left_and_right" + ], + "found": [ + "itertools::either_or_both::EitherOrBoth::left_and_right" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::lazy_buffer::LazyBuffer::get_at", + "truth": [ + "itertools::combinations::Box::extract_item", + "itertools::combinations::Vec::extract_item", + "itertools::permutations::Permutations::next" + ], + "found": [ + "itertools::combinations::Box::extract_item", + "itertools::combinations::Vec::extract_item", + "itertools::permutations::Permutations::next" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::Itertools::strip_prefix_by", + "truth": [ + "itertools::Itertools::strip_prefix" + ], + "found": [ + "itertools::Itertools::strip_prefix" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::Itertools::collect_vec", + "truth": [ + "itertools::Itertools::k_smallest" + ], + "found": [ + "itertools::Itertools::k_smallest" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::grouping_map::GroupingMap::fold_with", + "truth": [ + "itertools::grouping_map::GroupingMap::fold" + ], + "found": [ + "itertools::grouping_map::GroupingMap::fold" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::Itertools::chunk_by", + "truth": [ + "itertools::Itertools::group_by" + ], + "found": [ + "itertools::Itertools::group_by", + "itertools::examples::iris::main" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 0.5, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::extrema_set::max_set_impl", + "truth": [ + "itertools::Itertools::max_set", + "itertools::Itertools::max_set_by", + "itertools::Itertools::max_set_by_key" + ], + "found": [ + "itertools::Itertools::max_set", + "itertools::Itertools::max_set_by", + "itertools::Itertools::max_set_by_key" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::Itertools::next_tuple", + "truth": [ + "itertools::Itertools::collect_tuple" + ], + "found": [ + "itertools::Itertools::collect_tuple" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::adaptors::PutBack::with_value", + "truth": [ + "itertools::diff::diff_with" + ], + "found": [ + "itertools::diff::diff_with" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::Itertools::position_max", + "truth": [ + "itertools::Itertools::position_max_by_key" + ], + "found": [ + "itertools::Itertools::position_max_by_key" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::extrema_set::min_set_impl", + "truth": [ + "itertools::Itertools::min_set", + "itertools::Itertools::min_set_by", + "itertools::Itertools::min_set_by_key", + "itertools::extrema_set::max_set_impl" + ], + "found": [ + "itertools::Itertools::min_set", + "itertools::Itertools::min_set_by", + "itertools::Itertools::min_set_by_key", + "itertools::extrema_set::max_set_impl" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::or_else", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::right_or_insert_with", + "truth": [ + "itertools::either_or_both::EitherOrBoth::right_or_insert" + ], + "found": [ + "itertools::either_or_both::EitherOrBoth::right_or_insert" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::Itertools::set_from", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::Itertools::position_min", + "truth": [ + "itertools::Itertools::position_min_by_key" + ], + "found": [ + "itertools::Itertools::position_min_by_key" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::Itertools::position_minmax", + "truth": [ + "itertools::Itertools::position_minmax_by_key" + ], + "found": [ + "itertools::Itertools::position_minmax_by_key" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::minmax::MinMaxResult::into_option", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::next_array::ArrayBuilder::take", + "truth": [ + "itertools::next_array::next_array" + ], + "found": [ + "itertools::Itertools::k_smallest", + "itertools::Itertools::tail", + "itertools::adaptors::PutBack::all", + "itertools::adaptors::PutBack::fold", + "itertools::adaptors::PutBack::next", + "itertools::adaptors::PutBack::nth", + "itertools::adaptors::coalesce::CoalesceBy::next", + "itertools::exactly_one_err::ExactlyOneError::next", + "itertools::examples::iris::Iris::from_str", + "itertools::format::Format::clone", + "itertools::format::Format::format", + "itertools::format::FormatWith::clone", + "itertools::format::FormatWith::fmt", + "itertools::groupbylazy::Chunk::next", + "itertools::groupbylazy::Group::next", + "itertools::groupbylazy::GroupInner::group_key", + "itertools::groupbylazy::GroupInner::step_buffering", + "itertools::groupbylazy::GroupInner::step_current", + "itertools::intersperse::IntersperseWith::next", + "itertools::iter_index::Range::index", + "itertools::iter_index::RangeInclusive::index", + "itertools::iter_index::RangeTo::index", + "itertools::iter_index::RangeToInclusive::index", + "itertools::k_smallest::k_smallest_general", + "itertools::k_smallest::k_smallest_relaxed_general", + "itertools::lazy_buffer::LazyBuffer::prefill", + "itertools::next_array::next_array", + "itertools::peek_nth::PeekNth::peek_nth", + "itertools::peek_nth::PeekNth::peek_nth_mut", + "itertools::repeatn::RepeatN::next", + "itertools::tuple_impl::TupleBuffer::next", + "itertools::zip_longest::ZipLongest::rfold" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 0.03125, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::grouping_map::GroupingMap::max_by", + "truth": [ + "itertools::grouping_map::GroupingMap::max", + "itertools::grouping_map::GroupingMap::max_by_key" + ], + "found": [ + "itertools::Itertools::position_max", + "itertools::Itertools::position_max_by", + "itertools::grouping_map::GroupingMap::max", + "itertools::grouping_map::GroupingMap::max_by_key" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 0.5, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::groupbylazy::new_chunks", + "truth": [ + "itertools::Itertools::chunks" + ], + "found": [ + "itertools::Itertools::chunks" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::k_smallest::key_to_cmp", + "truth": [ + "itertools::Itertools::k_largest_by_key", + "itertools::Itertools::k_largest_relaxed_by_key", + "itertools::Itertools::k_smallest_by_key", + "itertools::Itertools::k_smallest_relaxed_by_key" + ], + "found": [ + "itertools::Itertools::k_largest_by_key", + "itertools::Itertools::k_largest_relaxed_by_key", + "itertools::Itertools::k_smallest_by_key", + "itertools::Itertools::k_smallest_relaxed_by_key" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::size_hint::mul_scalar", + "truth": [ + "itertools::adaptors::InterleaveShortest::size_hint" + ], + "found": [ + "itertools::adaptors::InterleaveShortest::size_hint" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::next_array::ArrayBuilder::push", + "truth": [ + "itertools::next_array::next_array" + ], + "found": [ + "itertools::next_array::next_array" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::Itertools::fold_ok", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::Itertools::partition_map", + "truth": [ + "itertools::Itertools::partition_result" + ], + "found": [ + "itertools::Itertools::partition_result" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::heap::heapify", + "truth": [ + "itertools::k_smallest::k_smallest_general", + "itertools::kmerge_impl::kmerge_by" + ], + "found": [ + "itertools::k_smallest::k_smallest_general", + "itertools::kmerge_impl::kmerge_by" + ], + "maybe": [], + "import_files": [ + "src/k_smallest.rs", + "src/kmerge_impl.rs" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::Itertools::fold1", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::lazy_buffer::LazyBuffer::get_next", + "truth": [ + "itertools::combinations::CombinationsGeneric::increment_indices", + "itertools::combinations_with_replacement::CombinationsWithReplacementGeneric::increment_indices", + "itertools::combinations_with_replacement::CombinationsWithReplacementGeneric::next", + "itertools::combinations_with_replacement::CombinationsWithReplacementGeneric::nth", + "itertools::permutations::Permutations::next" + ], + "found": [ + "itertools::combinations::CombinationsGeneric::increment_indices", + "itertools::combinations_with_replacement::CombinationsWithReplacementGeneric::increment_indices", + "itertools::combinations_with_replacement::CombinationsWithReplacementGeneric::next", + "itertools::combinations_with_replacement::CombinationsWithReplacementGeneric::nth", + "itertools::permutations::Permutations::next" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::size_hint::add_scalar", + "truth": [ + "itertools::adaptors::PutBack::size_hint", + "itertools::adaptors::coalesce::CoalesceBy::size_hint", + "itertools::exactly_one_err::ExactlyOneError::size_hint", + "itertools::intersperse::IntersperseWith::size_hint", + "itertools::kmerge_impl::HeadTail::size_hint", + "itertools::lazy_buffer::LazyBuffer::size_hint", + "itertools::multipeek_impl::MultiPeek::size_hint", + "itertools::peek_nth::PeekNth::size_hint", + "itertools::put_back_n_impl::PutBackN::size_hint", + "itertools::tee::Tee::size_hint" + ], + "found": [ + "itertools::adaptors::PutBack::size_hint", + "itertools::adaptors::coalesce::CoalesceBy::size_hint", + "itertools::exactly_one_err::ExactlyOneError::size_hint", + "itertools::intersperse::IntersperseWith::size_hint", + "itertools::kmerge_impl::HeadTail::size_hint", + "itertools::lazy_buffer::LazyBuffer::size_hint", + "itertools::multipeek_impl::MultiPeek::size_hint", + "itertools::peek_nth::PeekNth::size_hint", + "itertools::put_back_n_impl::PutBackN::size_hint", + "itertools::tee::Tee::size_hint" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::Itertools::all_unique_with_hasher", + "truth": [ + "itertools::Itertools::all_unique" + ], + "found": [ + "itertools::Itertools::all_unique" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::partition", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::as_ref", + "truth": [ + "itertools::either_or_both::EitherOrBoth::has_left", + "itertools::either_or_both::EitherOrBoth::has_right", + "itertools::either_or_both::EitherOrBoth::is_both" + ], + "found": [ + "itertools::either_or_both::EitherOrBoth::has_left", + "itertools::either_or_both::EitherOrBoth::has_right", + "itertools::either_or_both::EitherOrBoth::is_both" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::grouping_map::GroupingMap::aggregate", + "truth": [ + "itertools::grouping_map::GroupingMap::fold_with", + "itertools::grouping_map::GroupingMap::minmax_by", + "itertools::grouping_map::GroupingMap::reduce" + ], + "found": [ + "itertools::grouping_map::GroupingMap::fold_with", + "itertools::grouping_map::GroupingMap::minmax_by", + "itertools::grouping_map::GroupingMap::reduce" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::Itertools::k_smallest_relaxed", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::insert_right", + "truth": [ + "itertools::either_or_both::EitherOrBoth::right_or_insert_with" + ], + "found": [ + "itertools::either_or_both::EitherOrBoth::right_or_insert_with" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::grouping_map::GroupingMap::product", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::Itertools::k_smallest_by", + "truth": [ + "itertools::Itertools::k_largest_by", + "itertools::Itertools::k_smallest_by_key" + ], + "found": [ + "itertools::Itertools::k_largest_by", + "itertools::Itertools::k_smallest_by_key" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::Itertools::k_largest_relaxed_by", + "truth": [ + "itertools::Itertools::k_largest_relaxed", + "itertools::Itertools::k_largest_relaxed_by_key" + ], + "found": [ + "itertools::Itertools::k_largest_relaxed", + "itertools::Itertools::k_largest_relaxed_by_key" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::minmax::minmax_impl", + "truth": [ + "itertools::Itertools::minmax", + "itertools::Itertools::minmax_by", + "itertools::Itertools::minmax_by_key", + "itertools::Itertools::position_minmax" + ], + "found": [ + "itertools::Itertools::minmax", + "itertools::Itertools::minmax_by", + "itertools::Itertools::minmax_by_key", + "itertools::Itertools::position_minmax" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::heap::sift_down", + "truth": [ + "itertools::heap::heapify", + "itertools::k_smallest::k_smallest_general", + "itertools::kmerge_impl::KMergeBy::next" + ], + "found": [ + "itertools::heap::heapify", + "itertools::k_smallest::k_smallest_general", + "itertools::kmerge_impl::KMergeBy::next" + ], + "maybe": [], + "import_files": [ + "src/k_smallest.rs", + "src/kmerge_impl.rs" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::combinations::Combinations::reset", + "truth": [ + "itertools::powerset::Powerset::fold", + "itertools::powerset::Powerset::increment_k" + ], + "found": [ + "itertools::powerset::Powerset::fold", + "itertools::powerset::Powerset::increment_k" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::k_smallest::k_smallest_general", + "truth": [ + "itertools::Itertools::k_smallest_by" + ], + "found": [ + "itertools::Itertools::k_smallest_by" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::grouping_map::new_map_for_grouping", + "truth": [ + "itertools::Itertools::into_grouping_map_by", + "itertools::Itertools::into_grouping_map_by_with_hasher" + ], + "found": [ + "itertools::Itertools::into_grouping_map_by", + "itertools::Itertools::into_grouping_map_by_with_hasher" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::left_or_insert_with", + "truth": [ + "itertools::either_or_both::EitherOrBoth::left_or_insert" + ], + "found": [ + "itertools::either_or_both::EitherOrBoth::left_or_insert" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + } + ], + "callers_common": [ + { + "symbol": "itertools::Itertools::next_array", + "truth": [ + "itertools::Itertools::collect_array", + "itertools::array_impl::ArrayWindows::next" + ], + "found": [ + "itertools::Itertools::collect_array" + ], + "maybe": [], + "import_files": [], + "recall": 0.5, + "precision": 1.0, + "recall_with_maybe": 0.5 + }, + { + "symbol": "itertools::adaptors::PutBack::put_back", + "truth": [ + "itertools::adaptors::PutBack::with_value", + "itertools::merge_join::MergeBy::fold", + "itertools::merge_join::MergeBy::next", + "itertools::merge_join::MergeBy::nth", + "itertools::peeking_take_while::PutBack::peeking_next" + ], + "found": [ + "itertools::adaptors::PutBack::with_value", + "itertools::merge_join::MergeBy::fold", + "itertools::merge_join::MergeBy::next", + "itertools::merge_join::MergeBy::nth", + "itertools::peeking_take_while::PutBack::peeking_next" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::Itertools::sorted", + "truth": [ + "itertools::free::sorted" + ], + "found": [ + "itertools::free::sorted" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::Itertools::multi_cartesian_product", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::Itertools::minmax_by", + "truth": [ + "itertools::Itertools::position_minmax_by" + ], + "found": [ + "itertools::Itertools::position_minmax_by" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::peek_nth::PeekNth::peek_nth", + "truth": [ + "itertools::peek_nth::PeekNth::peek" + ], + "found": [ + "itertools::peek_nth::PeekNth::peek" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::Itertools::intersperse", + "truth": [ + "itertools::free::intersperse" + ], + "found": [ + "itertools::free::intersperse" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::Itertools::array_combinations_with_replacement", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::Itertools::intersperse_with", + "truth": [ + "itertools::free::intersperse_with" + ], + "found": [ + "itertools::free::intersperse_with" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::multipeek_impl::MultiPeek::peek", + "truth": [ + "itertools::multipeek_impl::MultiPeek::peeking_next" + ], + "found": [ + "itertools::multipeek_impl::MultiPeek::peeking_next" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::Itertools::cartesian_product", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::Itertools::multiunzip", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::Itertools::tuples", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::Itertools::all_equal", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::Itertools::sorted_unstable", + "truth": [ + "itertools::free::sorted_unstable" + ], + "found": [ + "itertools::free::sorted_unstable" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::Itertools::array_combinations", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::Itertools::permutations", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::Itertools::minmax", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::Itertools::tuple_windows", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::Itertools::kmerge", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::reduce", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::peek_nth::PeekNth::peek", + "truth": [ + "itertools::peek_nth::PeekNth::peeking_next" + ], + "found": [ + "itertools::peek_nth::PeekNth::peeking_next" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::grouping_map::GroupingMap::minmax_by", + "truth": [ + "itertools::grouping_map::GroupingMap::minmax", + "itertools::grouping_map::GroupingMap::minmax_by_key" + ], + "found": [ + "itertools::grouping_map::GroupingMap::minmax", + "itertools::grouping_map::GroupingMap::minmax_by_key" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::Itertools::dedup", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::put_back_n_impl::PutBackN::put_back", + "truth": [ + "itertools::peeking_take_while::PutBackN::peeking_next" + ], + "found": [ + "itertools::peeking_take_while::PutBackN::peeking_next" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::grouping_map::GroupingMap::reduce", + "truth": [ + "itertools::grouping_map::GroupingMap::fold_first", + "itertools::grouping_map::GroupingMap::max_by", + "itertools::grouping_map::GroupingMap::min_by", + "itertools::grouping_map::GroupingMap::product", + "itertools::grouping_map::GroupingMap::sum" + ], + "found": [ + "itertools::grouping_map::GroupingMap::fold_first", + "itertools::grouping_map::GroupingMap::max_by", + "itertools::grouping_map::GroupingMap::min_by", + "itertools::grouping_map::GroupingMap::product", + "itertools::grouping_map::GroupingMap::sum" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + } + ], + "callers_blind": [ + { + "symbol": "itertools::tuple_impl::Tuples::into_buffer", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::Itertools::k_smallest_relaxed_by_key", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::Itertools::max_set", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::Itertools::position_max_by", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::or_default", + "truth": [ + "itertools::either_or_both::EitherOrBoth::left_and_right" + ], + "found": [ + "itertools::Itertools::counts_with_hasher", + "itertools::either_or_both::EitherOrBoth::left_and_right", + "itertools::group_map::into_group_map_with_hasher" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 0.3333333333333333, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::Itertools::unique", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::peek_nth::PeekNth::peek_mut", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::both", + "truth": [ + "itertools::either_or_both::EitherOrBoth::is_both" + ], + "found": [ + "itertools::either_or_both::EitherOrBoth::is_both" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::Itertools::position_min_by", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::adaptors::checked_binomial", + "truth": [ + "itertools::adaptors::impl_tuple_combination", + "itertools::combinations::remaining_for", + "itertools::combinations_with_replacement::remaining_for", + "itertools::powerset::remaining_for" + ], + "found": [ + "itertools::adaptors::impl_tuple_combination", + "itertools::combinations::remaining_for", + "itertools::combinations_with_replacement::remaining_for", + "itertools::powerset::remaining_for" + ], + "maybe": [], + "import_files": [ + "src/combinations.rs", + "src/combinations_with_replacement.rs", + "src/lib.rs", + "src/powerset.rs" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::map_any", + "truth": [ + "itertools::either_or_both::EitherOrBoth::left_and_right" + ], + "found": [ + "itertools::either_or_both::EitherOrBoth::left_and_right" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::lazy_buffer::LazyBuffer::get_at", + "truth": [ + "itertools::combinations::Box::extract_item", + "itertools::combinations::Vec::extract_item", + "itertools::permutations::Permutations::next" + ], + "found": [ + "itertools::combinations::Box::extract_item", + "itertools::combinations::Vec::extract_item", + "itertools::permutations::Permutations::next" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::Itertools::strip_prefix_by", + "truth": [ + "itertools::Itertools::strip_prefix" + ], + "found": [ + "itertools::Itertools::strip_prefix" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::Itertools::k_largest_relaxed_by_key", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::Itertools::collect_vec", + "truth": [ + "itertools::Itertools::k_smallest" + ], + "found": [ + "itertools::Itertools::k_smallest" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::benches::fold_specialization::specialization::intersperse::internal_specialized", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::Itertools::tail", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::grouping_map::GroupingMap::fold_with", + "truth": [ + "itertools::grouping_map::GroupingMap::fold" + ], + "found": [ + "itertools::grouping_map::GroupingMap::fold" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::Itertools::chunk_by", + "truth": [ + "itertools::Itertools::group_by" + ], + "found": [ + "itertools::Itertools::group_by", + "itertools::examples::iris::main" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 0.5, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::Itertools::k_smallest_by_key", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::repeatn::repeat_n", + "truth": [], + "found": [], + "maybe": [], + "import_files": [ + "src/lib.rs" + ], + "recall": null, + "precision": null, + "recall_with_maybe": null + }, + { + "symbol": "itertools::next_array::ArrayBuilder::take", + "truth": [ + "itertools::next_array::next_array" + ], + "found": [ + "itertools::Itertools::k_smallest", + "itertools::Itertools::tail", + "itertools::adaptors::PutBack::all", + "itertools::adaptors::PutBack::fold", + "itertools::adaptors::PutBack::next", + "itertools::adaptors::PutBack::nth", + "itertools::adaptors::coalesce::CoalesceBy::next", + "itertools::exactly_one_err::ExactlyOneError::next", + "itertools::examples::iris::Iris::from_str", + "itertools::format::Format::clone", + "itertools::format::Format::format", + "itertools::format::FormatWith::clone", + "itertools::format::FormatWith::fmt", + "itertools::groupbylazy::Chunk::next", + "itertools::groupbylazy::Group::next", + "itertools::groupbylazy::GroupInner::group_key", + "itertools::groupbylazy::GroupInner::step_buffering", + "itertools::groupbylazy::GroupInner::step_current", + "itertools::intersperse::IntersperseWith::next", + "itertools::iter_index::Range::index", + "itertools::iter_index::RangeInclusive::index", + "itertools::iter_index::RangeTo::index", + "itertools::iter_index::RangeToInclusive::index", + "itertools::k_smallest::k_smallest_general", + "itertools::k_smallest::k_smallest_relaxed_general", + "itertools::lazy_buffer::LazyBuffer::prefill", + "itertools::next_array::next_array", + "itertools::peek_nth::PeekNth::peek_nth", + "itertools::peek_nth::PeekNth::peek_nth_mut", + "itertools::repeatn::RepeatN::next", + "itertools::tuple_impl::TupleBuffer::next", + "itertools::zip_longest::ZipLongest::rfold" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 0.03125, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::with_position::Position::is_last", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::Itertools::min_set", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::grouping_map::GroupingMap::max_by", + "truth": [ + "itertools::grouping_map::GroupingMap::max", + "itertools::grouping_map::GroupingMap::max_by_key" + ], + "found": [ + "itertools::Itertools::position_max", + "itertools::Itertools::position_max_by", + "itertools::grouping_map::GroupingMap::max", + "itertools::grouping_map::GroupingMap::max_by_key" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 0.5, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::groupbylazy::new_chunks", + "truth": [ + "itertools::Itertools::chunks" + ], + "found": [ + "itertools::Itertools::chunks" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::k_smallest::key_to_cmp", + "truth": [ + "itertools::Itertools::k_largest_by_key", + "itertools::Itertools::k_largest_relaxed_by_key", + "itertools::Itertools::k_smallest_by_key", + "itertools::Itertools::k_smallest_relaxed_by_key" + ], + "found": [ + "itertools::Itertools::k_largest_by_key", + "itertools::Itertools::k_largest_relaxed_by_key", + "itertools::Itertools::k_smallest_by_key", + "itertools::Itertools::k_smallest_relaxed_by_key" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::size_hint::mul_scalar", + "truth": [ + "itertools::adaptors::InterleaveShortest::size_hint" + ], + "found": [ + "itertools::adaptors::InterleaveShortest::size_hint" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::next_array::ArrayBuilder::push", + "truth": [ + "itertools::next_array::next_array" + ], + "found": [ + "itertools::next_array::next_array" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::Itertools::fold_ok", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::extrema_set::min_set_impl", + "truth": [ + "itertools::Itertools::min_set", + "itertools::Itertools::min_set_by", + "itertools::Itertools::min_set_by_key", + "itertools::extrema_set::max_set_impl" + ], + "found": [ + "itertools::Itertools::min_set", + "itertools::Itertools::min_set_by", + "itertools::Itertools::min_set_by_key", + "itertools::extrema_set::max_set_impl" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::has_right", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::minmax::MinMaxResult::into_option", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::Itertools::partition_map", + "truth": [ + "itertools::Itertools::partition_result" + ], + "found": [ + "itertools::Itertools::partition_result" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::heap::heapify", + "truth": [ + "itertools::k_smallest::k_smallest_general", + "itertools::kmerge_impl::kmerge_by" + ], + "found": [ + "itertools::k_smallest::k_smallest_general", + "itertools::kmerge_impl::kmerge_by" + ], + "maybe": [], + "import_files": [ + "src/k_smallest.rs", + "src/kmerge_impl.rs" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::Itertools::sorted_by_key", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::left_and_then", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::is_right", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::Itertools::strip_prefix", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::Itertools::try_len", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::Itertools::sorted_by", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::Itertools::dropping", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::grouping_map::GroupingMap::aggregate", + "truth": [ + "itertools::grouping_map::GroupingMap::fold_with", + "itertools::grouping_map::GroupingMap::minmax_by", + "itertools::grouping_map::GroupingMap::reduce" + ], + "found": [ + "itertools::grouping_map::GroupingMap::fold_with", + "itertools::grouping_map::GroupingMap::minmax_by", + "itertools::grouping_map::GroupingMap::reduce" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::free::enumerate", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::Itertools::k_smallest_relaxed", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::insert_right", + "truth": [ + "itertools::either_or_both::EitherOrBoth::right_or_insert_with" + ], + "found": [ + "itertools::either_or_both::EitherOrBoth::right_or_insert_with" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::grouping_map::GroupingMap::min_by_key", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::right_or_insert_with", + "truth": [ + "itertools::either_or_both::EitherOrBoth::right_or_insert" + ], + "found": [ + "itertools::either_or_both::EitherOrBoth::right_or_insert" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::grouping_map::GroupingMap::product", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::has_left", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::Itertools::k_smallest_by", + "truth": [ + "itertools::Itertools::k_largest_by", + "itertools::Itertools::k_smallest_by_key" + ], + "found": [ + "itertools::Itertools::k_largest_by", + "itertools::Itertools::k_smallest_by_key" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::as_ref", + "truth": [ + "itertools::either_or_both::EitherOrBoth::has_left", + "itertools::either_or_both::EitherOrBoth::has_right", + "itertools::either_or_both::EitherOrBoth::is_both" + ], + "found": [ + "itertools::either_or_both::EitherOrBoth::has_left", + "itertools::either_or_both::EitherOrBoth::has_right", + "itertools::either_or_both::EitherOrBoth::is_both" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::Itertools::duplicates", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::tuple_impl::TupleCollect::buffer_len", + "truth": [ + "itertools::tuple_impl::Tuples::size_hint" + ], + "found": [], + "maybe": [], + "import_files": [], + "recall": 0.0, + "precision": null, + "recall_with_maybe": 0.0 + }, + { + "symbol": "itertools::Itertools::k_largest_relaxed_by", + "truth": [ + "itertools::Itertools::k_largest_relaxed", + "itertools::Itertools::k_largest_relaxed_by_key" + ], + "found": [ + "itertools::Itertools::k_largest_relaxed", + "itertools::Itertools::k_largest_relaxed_by_key" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::minmax::minmax_impl", + "truth": [ + "itertools::Itertools::minmax", + "itertools::Itertools::minmax_by", + "itertools::Itertools::minmax_by_key", + "itertools::Itertools::position_minmax" + ], + "found": [ + "itertools::Itertools::minmax", + "itertools::Itertools::minmax_by", + "itertools::Itertools::minmax_by_key", + "itertools::Itertools::position_minmax" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::multipeek_impl::MultiPeek::reset_peek", + "skipped": "compiler reported no uses" + } + ], + "rename": [ + { + "symbol": "itertools::either_or_both::EitherOrBoth::or_default", + "ok": false, + "compiled": false, + "tests_ok": null, + "tests_failed": [], + "old_name_left": "", + "detail": "r_each(|item| *counts.entry(item).or_default_gnx() += 1);\n | ^^^^^^^^^^^^^^\n |\nhelp: there is a method `or_default` with a similar name\n |\n5008 - self.for_each(|item| *counts.entry(item).or_default_gnx() += 1);\n5008 + self.for_each(|item| *counts.entry(item).or_default() += 1);\n |\n\nFor more information about this error, try `rustc --explain E0599`.\nerror: could not compile `itertools` (lib) due to 2 previous errors\n" + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::both", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "src/adaptors/mod.rs:20:/// An iterator adaptor that alternates elements from two iterators until both\nsrc/adaptors/mod.rs:422: // Compute a * b_orig + b for both lower and upper bound\nsrc/diff.rs:22: /// The index of the first non-matching element along with both iterator's remaining eleme", + "detail": "" + }, + { + "symbol": "itertools::adaptors::checked_binomial", + "ok": false, + "compiled": false, + "tests_ok": null, + "tests_failed": [], + "old_name_left": "tests/quick.rs:965: itertools::checked_binomial(n, k).unwrap()\ntests/test_std.rs:1141: it::checked_binomial(n, k).unwrap()", + "detail": " itertools::assert_equal(empty, std::iter::once(Vec::::new()))\n | ++++++++++++++\n\nSome errors have detailed explanations: E0282, E0283, E0425.\nFor more information about an error, try `rustc --explain E0282`.\nerror: could not compile `itertools` (test \"test_std\") due to 15 previous errors\nwarning: build failed, waiting for other jobs to finish...\nerror: could not compile `itertools` (test \"quick\") due to 3 previous errors\n" + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::map_any", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "itertools::lazy_buffer::LazyBuffer::get_at", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "itertools::Itertools::strip_prefix_by", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "itertools::Itertools::collect_vec", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "benches/specializations.rs:279: let v = black_box((0..32).flat_map(|x| [x; 32]).collect_vec());\nbenches/specializations.rs:285: let v = black_box((0..32).flat_map(|x| [x; 32]).collect_vec());\nbenches/specializations.rs:291: let v = black_box((0..32).flat_map(|x| [x; ", + "detail": "" + }, + { + "symbol": "itertools::grouping_map::GroupingMap::fold_with", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "itertools::Itertools::chunk_by", + "ok": false, + "compiled": false, + "tests_ok": null, + "tests_failed": [], + "old_name_left": "tests/laziness.rs:83: chunk_by {\ntests/laziness.rs:85: let _ = Panicking.chunk_by(|x| *x);\ntests/laziness.rs:87: let _ = Panicking.chunk_by(|x| *x).into_iter();\ntests/test_std.rs:911:fn chunk_by() {", + "detail": "s struct\n...\n87 | let _ = Panicking.chunk_by(|x| *x).into_iter();\n | ^^^^^^^^\n |\nhelp: there is a method `chunk_by_gnx` with a similar name\n |\n87 | let _ = Panicking.chunk_by_gnx(|x| *x).into_iter();\n | ++++\n\nFor more information about this error, try `rustc --explain E0599`.\nerror: could not compile `itertools` (test \"laziness\") due to 2 previous errors\nwarning: build failed, waiting for other jobs to finish...\n" + }, + { + "symbol": "itertools::extrema_set::max_set_impl", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "itertools::Itertools::next_tuple", + "ok": false, + "compiled": false, + "tests_ok": null, + "tests_failed": [], + "old_name_left": "tests/tuples.rs:65:fn next_tuple() {\ntests/tuples.rs:70: assert_eq!(iter.next_tuple::<(_, _)>(), None);", + "detail": " --> tests/tuples.rs:70:21\n |\n70 | assert_eq!(iter.next_tuple::<(_, _)>(), None);\n | ^^^^^^^^^^\n |\nhelp: there is a method `next_tuple_gnx` with a similar name\n |\n70 | assert_eq!(iter.next_tuple_gnx::<(_, _)>(), None);\n | ++++\n\nFor more information about this error, try `rustc --explain E0599`.\nerror: could not compile `itertools` (test \"tuples\") due to 1 previous error\nwarning: build failed, waiting for other jobs to finish...\n" + }, + { + "symbol": "itertools::adaptors::PutBack::with_value", + "ok": false, + "compiled": false, + "tests_ok": null, + "tests_failed": [], + "old_name_left": "benches/specializations.rs:545: itertools::put_back(&v).with_value(black_box(&0))\ntests/laziness.rs:302: let _ = itertools::put_back(Panicking).with_value(15);", + "detail": "ith_value(15);\n | ^^^^^^^^^^\n |\nhelp: there is a method `with_value_gnx` with a similar name\n |\n302 | let _ = itertools::put_back(Panicking).with_value_gnx(15);\n | ++++\n\nFor more information about this error, try `rustc --explain E0599`.\nerror: could not compile `itertools` (test \"laziness\") due to 1 previous error\nwarning: build failed, waiting for other jobs to finish...\n" + }, + { + "symbol": "itertools::Itertools::position_max", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "itertools::extrema_set::min_set_impl", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::or_else", + "ok": false, + "compiled": false, + "tests_ok": null, + "tests_failed": [], + "old_name_left": "", + "detail": "m `Option` in the current scope\n --> src/put_back_n_impl.rs:56:24\n |\n56 | self.top.pop().or_else_gnx(|| self.iter.next())\n | ^^^^^^^^^^^\n |\nhelp: there is a method `or_else` with a similar name\n |\n56 - self.top.pop().or_else_gnx(|| self.iter.next())\n56 + self.top.pop().or_else(|| self.iter.next())\n |\n\nFor more information about this error, try `rustc --explain E0599`.\nerror: could not compile `itertools` (lib) due to 3 previous errors\n" + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::right_or_insert_with", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "itertools::Itertools::set_from", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "itertools::Itertools::position_min", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "itertools::Itertools::position_minmax", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "itertools::minmax::MinMaxResult::into_option", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "itertools::next_array::ArrayBuilder::take", + "ok": false, + "compiled": false, + "tests_ok": null, + "tests_failed": [], + "old_name_left": "benches/specializations.rs:304: let v = black_box((0..32).cycle().take(1024).collect_vec());\nbenches/specializations.rs:318: let v = black_box((0..32).cycle().take(1024).collect_vec());\nbenches/tree_reduce.rs:60: // in here are so expensive anyway that it'll stil", + "detail": "ect();\n | ^^^^^^^^\n |\nhelp: there is a method `take` with a similar name\n |\n3940 - let mut data: Vec<_> = iter.by_ref().take_gnx(n).collect();\n3940 + let mut data: Vec<_> = iter.by_ref().take(n).collect();\n |\n\nSome errors have detailed explanations: E0308, E0599.\nFor more information about an error, try `rustc --explain E0308`.\nerror: could not compile `itertools` (lib) due to 34 previous errors\n" + }, + { + "symbol": "itertools::grouping_map::GroupingMap::max_by", + "ok": false, + "compiled": false, + "tests_ok": null, + "tests_failed": [], + "old_name_left": "", + "detail": "urrent scope\n --> src/lib.rs:4653:14\n |\n4652 | / self.enumerate()\n4653 | | .max_by_gnx(|x, y| compare(&x.1, &y.1))\n | |_____________-^^^^^^^^^^\n |\nhelp: there is a method `max_by` with a similar name\n |\n4653 - .max_by_gnx(|x, y| compare(&x.1, &y.1))\n4653 + .max_by(|x, y| compare(&x.1, &y.1))\n |\n\nFor more information about this error, try `rustc --explain E0599`.\nerror: could not compile `itertools` (lib) due to 2 previous errors\n" + }, + { + "symbol": "itertools::groupbylazy::new_chunks", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "itertools::k_smallest::key_to_cmp", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "itertools::size_hint::mul_scalar", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "itertools::next_array::ArrayBuilder::push", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": ".github/workflows/coverage.yml:2: push:\nbenches/bench1.rs:538: chunks.push(fst.iter().cloned());\nbenches/tree_reduce.rs:22: stack.push(x);\nexamples/iris.rs:63: v.push(iris);\nsrc/extrema_set.rs:25: result.push(element);", + "detail": "" + }, + { + "symbol": "itertools::Itertools::fold_ok", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "itertools::Itertools::partition_map", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "itertools::heap::heapify", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "itertools::Itertools::fold1", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "benches/tree_reduce.rs:88: fold1,\nbenches/tree_reduce.rs:106: fold1,\nbenches/tree_reduce.rs:124: fold1,", + "detail": "" + }, + { + "symbol": "itertools::lazy_buffer::LazyBuffer::get_next", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "itertools::size_hint::add_scalar", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "itertools::Itertools::all_unique_with_hasher", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "itertools::partition", + "ok": false, + "compiled": false, + "tests_ok": null, + "tests_failed": [], + "old_name_left": "benches/bench1.rs:594: c.bench_function(\"vec iter mut partition\", move |b| {\nsrc/lib.rs:3961: /// partitions. Unlike [`Iterator::partition_gnx`], each partition may\ntests/test_core.rs:302: let i = it::partition(&mut data, |elt| *elt >= 3);\ntests/test_core.rs:306: let i = it::partition(&m", + "detail": "t_core.rs:306:17\n |\n306 | let i = it::partition(&mut data, |elt| *elt == 1);\n | ^^^^^^^^^ not found in `it`\n\nerror[E0425]: cannot find function `partition` in crate `it`\n --> tests/test_core.rs:311:17\n |\n311 | let i = it::partition(&mut data, |elt| *elt % 3 == 0);\n | ^^^^^^^^^ not found in `it`\n\nFor more information about this error, try `rustc --explain E0425`.\nerror: could not compile `itertools` (test \"test_core\") due to 3 previous errors\n" + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::as_ref", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "src/adaptors/mod.rs:416: .as_ref()\nsrc/adaptors/mod.rs:785: if let Some(z) = item.as_ref() {\nsrc/adaptors/mod.rs:921: .filter(|v| v.as_ref().map(&mut f).unwrap_or(true))\nsrc/adaptors/mod.rs:931: .filter(|v| v.as_ref().map(&mut f).unwrap_or(true))\nsrc/a", + "detail": "" + }, + { + "symbol": "itertools::grouping_map::GroupingMap::aggregate", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "benches/powerset.rs:4:// Keep aggregate generated elements the same, regardless of powerset length.", + "detail": "" + }, + { + "symbol": "itertools::Itertools::k_smallest_relaxed", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::insert_right", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "itertools::grouping_map::GroupingMap::product", + "ok": false, + "compiled": false, + "tests_ok": null, + "tests_failed": [], + "old_name_left": "Cargo.toml:13:keywords = [\"iterator\", \"data-structure\", \"zip\", \"product\"]\nLICENSE-APACHE:139: names, trademarks, service marks, or product names of the Licensor,\nbenches/bench1.rs:608: c.bench_function(\"cartesian product iterator\", move |b| {\nbenches/bench1.rs:624: c.bench_function(\"multi ca", + "detail": "elf.next().map(|first| once(first).chain(self).product_gnx())\n | ^^^^^^^^^^^\n |\nhelp: there is a method `product` with a similar name\n |\n3244 - self.next().map(|first| once(first).chain(self).product_gnx())\n3244 + self.next().map(|first| once(first).chain(self).product())\n |\n\nFor more information about this error, try `rustc --explain E0599`.\nerror: could not compile `itertools` (lib) due to 1 previous error\n" + }, + { + "symbol": "itertools::Itertools::k_smallest_by", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "itertools::Itertools::k_largest_relaxed_by", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "itertools::minmax::minmax_impl", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "itertools::heap::sift_down", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "itertools::combinations::Combinations::reset", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "src/adaptors/multi_product.rs:110: // reset the finished ones encountered.\nsrc/combinations.rs:187: // Increment index, and reset the ones to its right\nsrc/multipeek_impl.rs:49: /// When `.next()` is called, reset the peeking “cursor”.", + "detail": "" + }, + { + "symbol": "itertools::k_smallest::k_smallest_general", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "itertools::grouping_map::new_map_for_grouping", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::left_or_insert_with", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + } + ], + "mutants": { + "7": [ + "itertools::either_or_both::EitherOrBoth::or_default", + "itertools::either_or_both::EitherOrBoth::both", + "itertools::adaptors::checked_binomial", + "itertools::either_or_both::EitherOrBoth::map_any", + "itertools::lazy_buffer::LazyBuffer::get_at", + "itertools::Itertools::strip_prefix_by", + "itertools::Itertools::collect_vec", + "itertools::grouping_map::GroupingMap::fold_with", + "itertools::Itertools::chunk_by", + "itertools::extrema_set::max_set_impl", + "itertools::Itertools::next_tuple" + ], + "8": [ + "itertools::next_array::ArrayBuilder::take", + "itertools::grouping_map::GroupingMap::max_by", + "itertools::groupbylazy::new_chunks", + "itertools::k_smallest::key_to_cmp", + "itertools::size_hint::mul_scalar", + "itertools::next_array::ArrayBuilder::push", + "itertools::Itertools::fold_ok", + "itertools::extrema_set::min_set_impl", + "itertools::minmax::MinMaxResult::into_option" + ], + "9": [ + "itertools::grouping_map::GroupingMap::aggregate", + "itertools::Itertools::k_smallest_relaxed", + "itertools::either_or_both::EitherOrBoth::insert_right", + "itertools::either_or_both::EitherOrBoth::or_default", + "itertools::either_or_both::EitherOrBoth::right_or_insert_with", + "itertools::grouping_map::GroupingMap::product", + "itertools::k_smallest::key_to_cmp", + "itertools::Itertools::k_smallest_by", + "itertools::either_or_both::EitherOrBoth::as_ref", + "itertools::Itertools::k_largest_relaxed_by", + "itertools::minmax::minmax_impl", + "itertools::heap::sift_down" + ] + }, + "tests": [ + { + "symbol": "itertools::either_or_both::EitherOrBoth::or_default", + "skipped": "no test fails when it throws", + "predicted": 22 + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::both", + "skipped": "no test fails when it throws", + "predicted": 0 + }, + { + "symbol": "itertools::adaptors::checked_binomial", + "level": "name", + "truth": 15, + "predicted": 5, + "recall": 0.26666666666666666, + "precision": 0.8, + "top_hits": 4, + "top_n": 5, + "top_precision": 0.8, + "top_best": 0.8, + "caught": 1.0, + "missed": [ + "array_combinations", + "array_combinations_with_replacement", + "binomial_avoids_intermediate_overflow", + "combinations", + "combinations_with_replacement", + "exact_size_combinations_1", + "exact_size_combinations_2", + "exact_size_combinations_3" + ], + "recall_graph_only": 0.26666666666666666 + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::map_any", + "skipped": "no test fails when it throws", + "predicted": 0 + }, + { + "symbol": "itertools::lazy_buffer::LazyBuffer::get_at", + "level": "name", + "truth": 17, + "predicted": 2, + "recall": 0.058823529411764705, + "precision": 0.5, + "top_hits": 1, + "top_n": 2, + "top_precision": 0.5, + "top_best": 0.5, + "caught": 1.0, + "missed": [ + "combinations", + "combinations_inexact_size_hints", + "combinations_no_collect", + "combinations_range_count", + "combinations_with_replacement", + "combinations_with_replacement_no_collect", + "combinations_with_replacement_range_count", + "combinations_zero" + ], + "recall_graph_only": 0.058823529411764705 + }, + { + "symbol": "itertools::Itertools::strip_prefix_by", + "level": "name", + "truth": 4, + "predicted": 4, + "recall": 1.0, + "precision": 1.0, + "top_hits": 4, + "top_n": 4, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "itertools::Itertools::collect_vec", + "level": "name", + "truth": 18, + "predicted": 13, + "recall": 0.6666666666666666, + "precision": 0.9230769230769231, + "top_hits": 10, + "top_n": 10, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [ + "k_smallest_sort_i16", + "k_smallest_sort_i8", + "k_smallest_sort_u16", + "k_smallest_sort_u32", + "k_smallest_sort_u64", + "k_smallest_sort_u8" + ], + "recall_graph_only": 0.6666666666666666 + }, + { + "symbol": "itertools::grouping_map::GroupingMap::fold_with", + "level": "name", + "truth": 2, + "predicted": 1, + "recall": 0.5, + "precision": 1.0, + "top_hits": 1, + "top_n": 1, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [ + "correct_grouping_map_by_fold_modulo_key" + ], + "recall_graph_only": 0.5 + }, + { + "symbol": "itertools::Itertools::chunk_by", + "level": "name", + "truth": 8, + "predicted": 8, + "recall": 1.0, + "precision": 1.0, + "top_hits": 8, + "top_n": 8, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "itertools::extrema_set::max_set_impl", + "level": "name", + "truth": 4, + "predicted": 4, + "recall": 1.0, + "precision": 1.0, + "top_hits": 4, + "top_n": 4, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "itertools::Itertools::next_tuple", + "level": "name", + "truth": 3, + "predicted": 3, + "recall": 1.0, + "precision": 1.0, + "top_hits": 3, + "top_n": 3, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "itertools::next_array::ArrayBuilder::take", + "level": "name", + "truth": 9, + "predicted": 53, + "recall": 0.3333333333333333, + "precision": 0.05660377358490566, + "top_hits": 0, + "top_n": 10, + "top_precision": 0.0, + "top_best": 0.3, + "caught": 0.0, + "missed": [ + "array_windows", + "array_windows_equal_tuple_windows", + "equal_array_windows_0", + "equal_array_windows_1", + "equal_array_windows_2", + "equal_array_windows_3" + ], + "recall_graph_only": 0.3333333333333333 + }, + { + "symbol": "itertools::grouping_map::GroupingMap::max_by", + "level": "name", + "truth": 4, + "predicted": 9, + "recall": 1.0, + "precision": 0.4444444444444444, + "top_hits": 4, + "top_n": 9, + "top_precision": 0.4444444444444444, + "top_best": 0.4444444444444444, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "itertools::groupbylazy::new_chunks", + "level": "name", + "truth": 2, + "predicted": 7, + "recall": 1.0, + "precision": 0.2857142857142857, + "top_hits": 2, + "top_n": 7, + "top_precision": 0.2857142857142857, + "top_best": 0.2857142857142857, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "itertools::k_smallest::key_to_cmp", + "level": "name", + "truth": 2, + "predicted": 2, + "recall": 1.0, + "precision": 1.0, + "top_hits": 2, + "top_n": 2, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "itertools::size_hint::mul_scalar", + "level": "name", + "truth": 3, + "predicted": 2, + "recall": 0.3333333333333333, + "precision": 0.5, + "top_hits": 1, + "top_n": 2, + "top_precision": 0.5, + "top_best": 0.5, + "caught": 1.0, + "missed": [ + "exact_interleave_shortest", + "size_interleave_shortest" + ], + "recall_graph_only": 0.3333333333333333 + }, + { + "symbol": "itertools::next_array::ArrayBuilder::push", + "level": "name", + "truth": 8, + "predicted": 6, + "recall": 0.375, + "precision": 0.5, + "top_hits": 3, + "top_n": 6, + "top_precision": 0.5, + "top_best": 0.5, + "caught": 1.0, + "missed": [ + "array_windows", + "array_windows_equal_tuple_windows", + "equal_array_windows_1", + "equal_array_windows_2", + "equal_array_windows_3" + ], + "recall_graph_only": 0.375 + }, + { + "symbol": "itertools::Itertools::fold_ok", + "skipped": "no test fails when it throws", + "predicted": 0 + }, + { + "symbol": "itertools::extrema_set::min_set_impl", + "level": "name", + "truth": 7, + "predicted": 7, + "recall": 1.0, + "precision": 1.0, + "top_hits": 7, + "top_n": 7, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "itertools::minmax::MinMaxResult::into_option", + "level": "name", + "truth": 1, + "predicted": 1, + "recall": 1.0, + "precision": 1.0, + "top_hits": 1, + "top_n": 1, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "itertools::grouping_map::GroupingMap::aggregate", + "level": "name", + "truth": 16, + "predicted": 18, + "recall": 0.625, + "precision": 0.5555555555555556, + "top_hits": 6, + "top_n": 10, + "top_precision": 0.6, + "top_best": 1.0, + "caught": 1.0, + "missed": [ + "correct_grouping_map_by_fold_modulo_key", + "correct_grouping_map_by_min_max_minmax_order_modulo_key", + "correct_grouping_map_by_minmax_by_key_modulo_key", + "correct_grouping_map_by_minmax_by_modulo_key", + "correct_grouping_map_by_minmax_modulo_key", + "correct_grouping_map_by_reduce_modulo_key" + ], + "recall_graph_only": 0.625 + }, + { + "symbol": "itertools::Itertools::k_smallest_relaxed", + "level": "name", + "truth": 9, + "predicted": 1, + "recall": 0.1111111111111111, + "precision": 1.0, + "top_hits": 1, + "top_n": 1, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [ + "k_smallest_sort_i16", + "k_smallest_sort_i32", + "k_smallest_sort_i64", + "k_smallest_sort_i8", + "k_smallest_sort_u16", + "k_smallest_sort_u32", + "k_smallest_sort_u64", + "k_smallest_sort_u8" + ], + "recall_graph_only": 0.1111111111111111 + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::insert_right", + "skipped": "no test fails when it throws", + "predicted": 0 + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::right_or_insert_with", + "skipped": "no test fails when it throws", + "predicted": 0 + }, + { + "symbol": "itertools::grouping_map::GroupingMap::product", + "level": "name", + "truth": 1, + "predicted": 9, + "recall": 1.0, + "precision": 0.1111111111111111, + "top_hits": 1, + "top_n": 9, + "top_precision": 0.1111111111111111, + "top_best": 0.1111111111111111, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "itertools::Itertools::k_smallest_by", + "level": "name", + "truth": 9, + "predicted": 1, + "recall": 0.1111111111111111, + "precision": 1.0, + "top_hits": 1, + "top_n": 1, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [ + "k_smallest_by_sort_i16", + "k_smallest_by_sort_i32", + "k_smallest_by_sort_i64", + "k_smallest_by_sort_i8", + "k_smallest_by_sort_u16", + "k_smallest_by_sort_u32", + "k_smallest_by_sort_u64", + "k_smallest_by_sort_u8" + ], + "recall_graph_only": 0.1111111111111111 + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::as_ref", + "skipped": "no test fails when it throws", + "predicted": 0 + }, + { + "symbol": "itertools::Itertools::k_largest_relaxed_by", + "level": "name", + "truth": 1, + "predicted": 1, + "recall": 1.0, + "precision": 1.0, + "top_hits": 1, + "top_n": 1, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "itertools::minmax::minmax_impl", + "level": "name", + "truth": 5, + "predicted": 1, + "recall": 0.2, + "precision": 1.0, + "top_hits": 1, + "top_n": 1, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [ + "correct_grouping_map_by_minmax_by_key_modulo_key", + "correct_grouping_map_by_minmax_by_modulo_key", + "correct_grouping_map_by_minmax_modulo_key", + "minmax_f64" + ], + "recall_graph_only": 0.2 + }, + { + "symbol": "itertools::heap::sift_down", + "level": "name", + "truth": 19, + "predicted": 6, + "recall": 0.2631578947368421, + "precision": 0.8333333333333334, + "top_hits": 5, + "top_n": 6, + "top_precision": 0.8333333333333334, + "top_best": 0.8333333333333334, + "caught": 1.0, + "missed": [ + "equal_kmerge", + "equal_kmerge_2", + "k_smallest_by_sort_i16", + "k_smallest_by_sort_i32", + "k_smallest_by_sort_i64", + "k_smallest_by_sort_i8", + "k_smallest_by_sort_u16", + "k_smallest_by_sort_u32" + ], + "recall_graph_only": 0.2631578947368421 + } + ], + "look": [ + { + "symbol": "itertools::either_or_both::EitherOrBoth::or_default", + "look_tokens": 434, + "file_tokens": 4456 + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::both", + "look_tokens": 126, + "file_tokens": 4456 + }, + { + "symbol": "itertools::adaptors::checked_binomial", + "look_tokens": 374, + "file_tokens": 8216 + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::map_any", + "look_tokens": 196, + "file_tokens": 4456 + }, + { + "symbol": "itertools::lazy_buffer::LazyBuffer::get_at", + "look_tokens": 168, + "file_tokens": 416 + }, + { + "symbol": "itertools::Itertools::strip_prefix_by", + "look_tokens": 514, + "file_tokens": 46216 + }, + { + "symbol": "itertools::Itertools::collect_vec", + "look_tokens": 344, + "file_tokens": 46216 + }, + { + "symbol": "itertools::grouping_map::GroupingMap::fold_with", + "look_tokens": 552, + "file_tokens": 5640 + }, + { + "symbol": "itertools::Itertools::chunk_by", + "look_tokens": 648, + "file_tokens": 46216 + }, + { + "symbol": "itertools::extrema_set::max_set_impl", + "look_tokens": 258, + "file_tokens": 373 + }, + { + "symbol": "itertools::Itertools::next_tuple", + "look_tokens": 297, + "file_tokens": 46216 + }, + { + "symbol": "itertools::adaptors::PutBack::with_value", + "look_tokens": 140, + "file_tokens": 8216 + }, + { + "symbol": "itertools::Itertools::position_max", + "look_tokens": 268, + "file_tokens": 46216 + }, + { + "symbol": "itertools::extrema_set::min_set_impl", + "look_tokens": 473, + "file_tokens": 373 + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::or_else", + "look_tokens": 429, + "file_tokens": 4456 + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::right_or_insert_with", + "look_tokens": 190, + "file_tokens": 4456 + }, + { + "symbol": "itertools::Itertools::set_from", + "look_tokens": 283, + "file_tokens": 46216 + }, + { + "symbol": "itertools::Itertools::position_min", + "look_tokens": 268, + "file_tokens": 46216 + }, + { + "symbol": "itertools::Itertools::position_minmax", + "look_tokens": 602, + "file_tokens": 46216 + }, + { + "symbol": "itertools::minmax::MinMaxResult::into_option", + "look_tokens": 338, + "file_tokens": 961 + }, + { + "symbol": "itertools::next_array::ArrayBuilder::take", + "look_tokens": 516, + "file_tokens": 2322 + }, + { + "symbol": "itertools::grouping_map::GroupingMap::max_by", + "look_tokens": 516, + "file_tokens": 5640 + }, + { + "symbol": "itertools::groupbylazy::new_chunks", + "look_tokens": 313, + "file_tokens": 4544 + }, + { + "symbol": "itertools::k_smallest::key_to_cmp", + "look_tokens": 178, + "file_tokens": 877 + }, + { + "symbol": "itertools::size_hint::mul_scalar", + "look_tokens": 185, + "file_tokens": 605 + }, + { + "symbol": "itertools::next_array::ArrayBuilder::push", + "look_tokens": 698, + "file_tokens": 2322 + }, + { + "symbol": "itertools::Itertools::fold_ok", + "look_tokens": 518, + "file_tokens": 46216 + }, + { + "symbol": "itertools::Itertools::partition_map", + "look_tokens": 374, + "file_tokens": 46216 + }, + { + "symbol": "itertools::heap::heapify", + "look_tokens": 249, + "file_tokens": 382 + }, + { + "symbol": "itertools::Itertools::fold1", + "look_tokens": 159, + "file_tokens": 46216 + }, + { + "symbol": "itertools::lazy_buffer::LazyBuffer::get_next", + "look_tokens": 325, + "file_tokens": 416 + }, + { + "symbol": "itertools::size_hint::add_scalar", + "look_tokens": 349, + "file_tokens": 605 + }, + { + "symbol": "itertools::Itertools::all_unique_with_hasher", + "look_tokens": 366, + "file_tokens": 46216 + }, + { + "symbol": "itertools::partition", + "look_tokens": 358, + "file_tokens": 46216 + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::as_ref", + "look_tokens": 161, + "file_tokens": 4456 + }, + { + "symbol": "itertools::grouping_map::GroupingMap::aggregate", + "look_tokens": 944, + "file_tokens": 5640 + }, + { + "symbol": "itertools::Itertools::k_smallest_relaxed", + "look_tokens": 491, + "file_tokens": 46216 + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::insert_right", + "look_tokens": 505, + "file_tokens": 4456 + }, + { + "symbol": "itertools::grouping_map::GroupingMap::product", + "look_tokens": 425, + "file_tokens": 5640 + }, + { + "symbol": "itertools::Itertools::k_smallest_by", + "look_tokens": 417, + "file_tokens": 46216 + }, + { + "symbol": "itertools::Itertools::k_largest_relaxed_by", + "look_tokens": 401, + "file_tokens": 46216 + }, + { + "symbol": "itertools::minmax::minmax_impl", + "look_tokens": 712, + "file_tokens": 961 + }, + { + "symbol": "itertools::heap::sift_down", + "look_tokens": 439, + "file_tokens": 382 + }, + { + "symbol": "itertools::combinations::Combinations::reset", + "look_tokens": 296, + "file_tokens": 2492 + }, + { + "symbol": "itertools::k_smallest::k_smallest_general", + "look_tokens": 702, + "file_tokens": 877 + }, + { + "symbol": "itertools::grouping_map::new_map_for_grouping", + "look_tokens": 372, + "file_tokens": 5640 + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::left_or_insert_with", + "look_tokens": 187, + "file_tokens": 4456 + } + ], + "seconds": 69, + "summary": { + "callers_recall": 1.0, + "callers_precision": 0.932, + "callers_checked": 39, + "blind_recall": 0.962, + "blind_checked": 26, + "common_recall": 0.962, + "common_precision": 1.0, + "common_recall_with_maybe": 0.962, + "common_checked": 13, + "rename_ok": 0.787, + "rename_checked": 47, + "tests_recall": 0.645, + "tests_precision": 0.761, + "tests_top10_precision": 0.764, + "tests_top10_best": 0.795, + "tests_caught": 0.957, + "tests_checked": 23, + "look_vs_file": 0.209 + }, + "summary_seeds": { + "7": { + "callers_recall": 1.0, + "callers_precision": 0.931, + "callers_checked": 17, + "blind_recall": 1.0, + "blind_checked": 9, + "common_recall": 0.944, + "common_precision": 1.0, + "common_recall_with_maybe": 0.944, + "common_checked": 9, + "rename_ok": 0.7, + "rename_checked": 20, + "tests_recall": 0.687, + "tests_precision": 0.903, + "tests_top10_precision": 0.912, + "tests_top10_best": 0.912, + "tests_caught": 1.0, + "tests_checked": 8, + "look_vs_file": 0.163 + }, + "8": { + "callers_recall": 1.0, + "callers_precision": 0.902, + "callers_checked": 15, + "blind_recall": 1.0, + "blind_checked": 9, + "common_recall": 0.944, + "common_precision": 1.0, + "common_recall_with_maybe": 0.944, + "common_checked": 9, + "rename_ok": 0.75, + "rename_checked": 20, + "tests_recall": 0.755, + "tests_precision": 0.598, + "tests_top10_precision": 0.591, + "tests_top10_best": 0.629, + "tests_caught": 0.875, + "tests_checked": 8, + "look_vs_file": 0.285 + }, + "9": { + "callers_recall": 1.0, + "callers_precision": 0.961, + "callers_checked": 17, + "blind_recall": 0.9, + "blind_checked": 10, + "common_recall": 0.95, + "common_precision": 1.0, + "common_recall_with_maybe": 0.95, + "common_checked": 10, + "rename_ok": 0.8, + "rename_checked": 20, + "tests_recall": 0.539, + "tests_precision": 0.812, + "tests_top10_precision": 0.818, + "tests_top10_best": 0.868, + "tests_caught": 1.0, + "tests_checked": 8, + "look_vs_file": 0.25 + } + }, + "noise": { + "callers_recall": { + "mean": 1.0, + "functions": 39, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.03 + }, + "callers_precision": { + "mean": 0.932, + "functions": 39, + "boot_lo": 0.875, + "boot_hi": 0.983, + "boot_half": 0.054, + "seeds": [ + 0.931, + 0.902, + 0.961 + ], + "seed_sd": 0.029, + "threshold": 0.06 + }, + "blind_recall": { + "mean": 0.962, + "functions": 26, + "boot_lo": 0.885, + "boot_hi": 1.0, + "boot_half": 0.058, + "seeds": [ + 1.0, + 1.0, + 0.9 + ], + "seed_sd": 0.058, + "threshold": 0.06 + }, + "common_recall": { + "mean": 0.962, + "functions": 13, + "boot_lo": 0.885, + "boot_hi": 1.0, + "boot_half": 0.058, + "seeds": [ + 0.944, + 0.944, + 0.95 + ], + "seed_sd": 0.003, + "threshold": 0.08 + }, + "common_recall_with_maybe": { + "mean": 0.962, + "functions": 13, + "boot_lo": 0.885, + "boot_hi": 1.0, + "boot_half": 0.058, + "seeds": [ + 0.944, + 0.944, + 0.95 + ], + "seed_sd": 0.003, + "threshold": 0.08 + }, + "common_precision": { + "mean": 1.0, + "functions": 13, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.08 + }, + "rename_ok": { + "mean": 0.787, + "functions": 47, + "boot_lo": 0.681, + "boot_hi": 0.872, + "boot_half": 0.096, + "seeds": [ + 0.7, + 0.75, + 0.8 + ], + "seed_sd": 0.05, + "threshold": 0.1 + }, + "tests_recall": { + "mean": 0.645, + "functions": 23, + "boot_lo": 0.517, + "boot_hi": 0.77, + "boot_half": 0.126, + "seeds": [ + 0.687, + 0.755, + 0.539 + ], + "seed_sd": 0.111, + "threshold": 0.13 + }, + "tests_precision": { + "mean": 0.761, + "functions": 23, + "boot_lo": 0.653, + "boot_hi": 0.866, + "boot_half": 0.106, + "seeds": [ + 0.903, + 0.598, + 0.812 + ], + "seed_sd": 0.156, + "threshold": 0.11 + }, + "tests_top10_precision": { + "mean": 0.764, + "functions": 23, + "boot_lo": 0.653, + "boot_hi": 0.871, + "boot_half": 0.109, + "seeds": [ + 0.912, + 0.591, + 0.818 + ], + "seed_sd": 0.165, + "threshold": 0.11 + }, + "tests_top10_best": { + "mean": 0.795, + "functions": 23, + "boot_lo": 0.694, + "boot_hi": 0.893, + "boot_half": 0.099, + "seeds": [ + 0.912, + 0.629, + 0.868 + ], + "seed_sd": 0.153, + "threshold": 0.1 + }, + "tests_caught": { + "mean": 0.957, + "functions": 23, + "boot_lo": 0.87, + "boot_hi": 1.0, + "boot_half": 0.065, + "seeds": [ + 1.0, + 0.875, + 1.0 + ], + "seed_sd": 0.072, + "threshold": 0.07 + }, + "look_vs_file": { + "mean": 0.209, + "functions": 47, + "boot_lo": 0.136, + "boot_hi": 0.289, + "boot_half": 0.077, + "seeds": [ + 0.163, + 0.285, + 0.25 + ], + "seed_sd": 0.063, + "threshold": 0.08 + } + } + } +] \ No newline at end of file diff --git a/eval/results/heldout-lsp-refined.md b/eval/results/heldout-lsp-refined.md new file mode 100644 index 0000000..b36419d --- /dev/null +++ b/eval/results/heldout-lsp-refined.md @@ -0,0 +1,47 @@ +| repo | lang | symbols | index s | callers recall | callers precision | callers recall, picked blind | shared names: recall (+maybe) | shared names: precision | rename ok | tests recall | tests precision | top-10 fail (best possible) | caught by top-10 | look / file | +|---|---|---:|---:|---:|---:|---:|---:|---:|---:|---:|---:|---:|---:|---:| +| pflag | go | 756 | 0.1 | 98% ±10 (10) | 100% ±10 | 98% ±13 (8) | 89% ±7 (89% ±7) (34) | 97% ±5 | 82% ±19 (11) | 100% ±15 (7) | 64% ±23 | 64% ±22 (80% ±20) | 100% ±15 | 10% ±6 | +| mux | go | 128 | 0.0 | 100% ±20 (5) | 100% ±20 | 100% ±34 (3) | 100% ±10 (100% ±10) (10) | 100% ±10 | 100% ±20 (5) | 90% ±25 (4) | 93% ±25 | 95% ±25 (100% ±25) | 100% ±25 | 5% ±1 | +| byteorder | rust | 198 | 0.0 | — | — | 0% ±25 (4) | 73% ±20 (73% ±20) (5) | 100% ±20 | — | — | — | — | — | — | +| either | rust | 150 | 0.0 | 100% ±50 (2) | 100% ±50 | 100% ±100 (1) | — | — | 100% ±50 (2) | — | — | — | — | 2% ±1 | +| strsim | rust | 48 | 0.0 | 100% ±20 (5) | 100% ±20 | 100% ±20 (5) | — | — | 100% ±8 (13) | 100% ±10 (11) | 75% ±17 | 90% ±14 (90% ±14) | 100% ±10 | 5% ±1 | +| urfave-cli | go | 703 | 0.1 | 96% ±6 (18) | 89% ±10 | 65% ±20 (13) | 100% ±20 (100% ±20) (5) | 100% ±20 | 84% ±14 (19) | 42% ±19 (13) | 42% ±17 | 53% ±17 (58% ±18) | 100% ±8 | 16% ±7 | +| logrus | go | 311 | 0.0 | 100% ±17 (6) | 92% ±17 | 100% ±17 (6) | 94% ±6 (96% ±5) (41) | 100% ±3 | 33% ±34 (6) | 67% ±20 (5) | 64% ±24 | 72% ±28 (72% ±28) | 100% ±20 | 9% ±2 | +| itertools | rust | 1013 | 0.1 | 100% ±3 (39) | 93% ±6 | 96% ±6 (26) | 96% ±8 (96% ±8) (13) | 100% ±8 | 79% ±10 (47) | 64% ±13 (23) | 76% ±11 | 76% ±11 (80% ±10) | 96% ±7 | 21% ±8 | + +`77% ±6 (20)`: the mean over 20 functions; a change smaller than ±6 points is noise. The ± is half the 90% interval +the number stays in when the functions are drawn again (bootstrap), and never less than what one function weighs. + +| per language | all | go | rust | +|---|---:|---:|---:| +| callers recall | 99% ±2 (85) | 98% ±3 (39) | 100% ±3 (46) | +| callers precision | 94% ±4 (85) | 94% ±6 (39) | 94% ±5 (46) | +| callers recall, picked blind | 85% ±7 (66) | 84% ±11 (30) | 86% ±10 (36) | +| shared names: recall | 93% ±4 (108) | 93% ±4 (90) | 90% ±8 (18) | +| shared names: recall with maybe | 94% ±4 (108) | 94% ±4 (90) | 90% ±8 (18) | +| shared names: precision | 99% ±2 (106) | 99% ±2 (88) | 100% ±6 (18) | +| rename ok (tests pass) | 82% ±6 (103) | 78% ±11 (41) | 84% ±9 (62) | +| tests recall | 72% ±8 (63) | 67% ±12 (29) | 76% ±10 (34) | +| tests precision | 68% ±8 (63) | 58% ±12 (29) | 76% ±9 (34) | +| top-10 that fail | 73% ±7 (63) | 65% ±12 (29) | 81% ±9 (34) | +| … best possible order | 78% ±7 (63) | 72% ±11 (29) | 83% ±8 (34) | +| caught by the top 10 | 98% ±3 (63) | 100% ±4 (29) | 97% ±5 (34) | +| look / file | 15% ±4 (103) | 12% ±4 (41) | 17% ±6 (62) | + +| all repos | mean | functions | 90% interval | on each seed | 2 × SD of the seeds | threshold | +|---|---:|---:|---:|---:|---:|---:| +| callers recall | 98.9% | 85 | 98–100% | 98 / 98 / 98 | 0.0 | ±2 | +| callers precision | 94.1% | 85 | 90–97% | 94 / 94 / 95 | 1.4 | ±4 | +| callers recall, picked blind | 85.3% | 66 | 78–92% | 88 / 80 / 76 | 11.8 | ±7 | +| shared names: recall | 92.7% | 108 | 89–96% | 94 / 94 / 91 | 3.4 | ±4 | +| shared names: recall with maybe | 93.6% | 108 | 90–96% | 94 / 94 / 93 | 1.4 | ±4 | +| shared names: precision | 98.9% | 106 | 97–100% | 98 / 98 / 100 | 1.6 | ±2 | +| rename ok (tests pass) | 81.6% | 103 | 76–87% | 80 / 82 / 83 | 2.6 | ±6 | +| tests recall | 71.7% | 63 | 64–79% | 76 / 77 / 77 | 1.6 | ±8 | +| tests precision | 67.6% | 63 | 60–75% | 68 / 65 / 68 | 3.4 | ±8 | +| top-10 that fail | 73.3% | 63 | 66–80% | 75 / 70 / 74 | 5.0 | ±7 | +| … best possible order | 77.6% | 63 | 71–84% | 80 / 75 / 80 | 5.4 | ±7 | +| caught by the top 10 | 98.4% | 63 | 95–100% | 100 / 98 / 100 | 2.8 | ±3 | +| look / file | 14.9% | 103 | 11–19% | 12 / 15 / 14 | 3.4 | ±4 | + +Sample `n20-m8-seeds7,8,9`: 20 functions and 8 mutants per repo and seed, seeds 7, 8, 9. Run time: 1 min 29 s; of the compilers' and test suites' answers 731 came from the cache, 1 were asked now. diff --git a/eval/results/heldout-lsp-refined.noise.json b/eval/results/heldout-lsp-refined.noise.json new file mode 100644 index 0000000..c52a1fc --- /dev/null +++ b/eval/results/heldout-lsp-refined.noise.json @@ -0,0 +1,562 @@ +{ + "config": "n20-m8-seeds7,8,9", + "seconds": 89, + "truth": { + "cached": 731, + "asked": 1 + }, + "scopes": { + "all": { + "callers_recall": { + "mean": 0.989, + "functions": 85, + "boot_lo": 0.976, + "boot_hi": 0.998, + "boot_half": 0.011, + "seeds": [ + 0.985, + 0.984, + 0.985 + ], + "seed_sd": 0.0, + "threshold": 0.02 + }, + "callers_precision": { + "mean": 0.941, + "functions": 85, + "boot_lo": 0.902, + "boot_hi": 0.974, + "boot_half": 0.036, + "seeds": [ + 0.943, + 0.936, + 0.951 + ], + "seed_sd": 0.007, + "threshold": 0.04 + }, + "blind_recall": { + "mean": 0.853, + "functions": 66, + "boot_lo": 0.78, + "boot_hi": 0.918, + "boot_half": 0.069, + "seeds": [ + 0.875, + 0.803, + 0.758 + ], + "seed_sd": 0.059, + "threshold": 0.07 + }, + "common_recall": { + "mean": 0.927, + "functions": 108, + "boot_lo": 0.892, + "boot_hi": 0.959, + "boot_half": 0.033, + "seeds": [ + 0.94, + 0.937, + 0.91 + ], + "seed_sd": 0.017, + "threshold": 0.04 + }, + "common_recall_with_maybe": { + "mean": 0.936, + "functions": 108, + "boot_lo": 0.903, + "boot_hi": 0.964, + "boot_half": 0.03, + "seeds": [ + 0.94, + 0.937, + 0.927 + ], + "seed_sd": 0.007, + "threshold": 0.04 + }, + "common_precision": { + "mean": 0.989, + "functions": 106, + "boot_lo": 0.97, + "boot_hi": 1.0, + "boot_half": 0.015, + "seeds": [ + 0.982, + 0.983, + 0.997 + ], + "seed_sd": 0.008, + "threshold": 0.02 + }, + "rename_ok": { + "mean": 0.816, + "functions": 103, + "boot_lo": 0.757, + "boot_hi": 0.874, + "boot_half": 0.058, + "seeds": [ + 0.803, + 0.816, + 0.829 + ], + "seed_sd": 0.013, + "threshold": 0.06 + }, + "tests_recall": { + "mean": 0.717, + "functions": 63, + "boot_lo": 0.637, + "boot_hi": 0.79, + "boot_half": 0.076, + "seeds": [ + 0.758, + 0.774, + 0.769 + ], + "seed_sd": 0.008, + "threshold": 0.08 + }, + "tests_precision": { + "mean": 0.676, + "functions": 63, + "boot_lo": 0.603, + "boot_hi": 0.748, + "boot_half": 0.072, + "seeds": [ + 0.684, + 0.651, + 0.678 + ], + "seed_sd": 0.017, + "threshold": 0.08 + }, + "tests_top10_precision": { + "mean": 0.733, + "functions": 63, + "boot_lo": 0.662, + "boot_hi": 0.799, + "boot_half": 0.068, + "seeds": [ + 0.748, + 0.702, + 0.74 + ], + "seed_sd": 0.025, + "threshold": 0.07 + }, + "tests_top10_best": { + "mean": 0.776, + "functions": 63, + "boot_lo": 0.708, + "boot_hi": 0.839, + "boot_half": 0.066, + "seeds": [ + 0.796, + 0.749, + 0.798 + ], + "seed_sd": 0.027, + "threshold": 0.07 + }, + "tests_caught": { + "mean": 0.984, + "functions": 63, + "boot_lo": 0.952, + "boot_hi": 1.0, + "boot_half": 0.024, + "seeds": [ + 1.0, + 0.975, + 1.0 + ], + "seed_sd": 0.014, + "threshold": 0.03 + }, + "look_vs_file": { + "mean": 0.149, + "functions": 103, + "boot_lo": 0.113, + "boot_hi": 0.19, + "boot_half": 0.038, + "seeds": [ + 0.116, + 0.148, + 0.139 + ], + "seed_sd": 0.017, + "threshold": 0.04 + } + }, + "go": { + "callers_recall": { + "mean": 0.976, + "functions": 39, + "boot_lo": 0.95, + "boot_hi": 0.995, + "boot_half": 0.022, + "seeds": [ + 0.976, + 0.976, + 0.976 + ], + "seed_sd": 0.0, + "threshold": 0.03 + }, + "callers_precision": { + "mean": 0.938, + "functions": 39, + "boot_lo": 0.882, + "boot_hi": 0.983, + "boot_half": 0.05, + "seeds": [ + 0.938, + 0.938, + 0.938 + ], + "seed_sd": 0.0, + "threshold": 0.06 + }, + "blind_recall": { + "mean": 0.843, + "functions": 30, + "boot_lo": 0.737, + "boot_hi": 0.943, + "boot_half": 0.103, + "seeds": [ + 1.0, + 0.816, + 0.779 + ], + "seed_sd": 0.118, + "threshold": 0.11 + }, + "common_recall": { + "mean": 0.932, + "functions": 90, + "boot_lo": 0.892, + "boot_hi": 0.966, + "boot_half": 0.037, + "seeds": [ + 0.964, + 0.945, + 0.922 + ], + "seed_sd": 0.021, + "threshold": 0.04 + }, + "common_recall_with_maybe": { + "mean": 0.943, + "functions": 90, + "boot_lo": 0.909, + "boot_hi": 0.974, + "boot_half": 0.032, + "seeds": [ + 0.964, + 0.945, + 0.944 + ], + "seed_sd": 0.011, + "threshold": 0.04 + }, + "common_precision": { + "mean": 0.986, + "functions": 88, + "boot_lo": 0.964, + "boot_hi": 1.0, + "boot_half": 0.018, + "seeds": [ + 0.977, + 0.978, + 0.995 + ], + "seed_sd": 0.01, + "threshold": 0.02 + }, + "rename_ok": { + "mean": 0.78, + "functions": 41, + "boot_lo": 0.659, + "boot_hi": 0.878, + "boot_half": 0.11, + "seeds": [ + 0.78, + 0.78, + 0.78 + ], + "seed_sd": 0.0, + "threshold": 0.11 + }, + "tests_recall": { + "mean": 0.666, + "functions": 29, + "boot_lo": 0.547, + "boot_hi": 0.785, + "boot_half": 0.119, + "seeds": [ + 0.702, + 0.704, + 0.768 + ], + "seed_sd": 0.038, + "threshold": 0.12 + }, + "tests_precision": { + "mean": 0.58, + "functions": 29, + "boot_lo": 0.469, + "boot_hi": 0.694, + "boot_half": 0.112, + "seeds": [ + 0.606, + 0.6, + 0.614 + ], + "seed_sd": 0.007, + "threshold": 0.12 + }, + "tests_top10_precision": { + "mean": 0.647, + "functions": 29, + "boot_lo": 0.534, + "boot_hi": 0.758, + "boot_half": 0.112, + "seeds": [ + 0.647, + 0.65, + 0.676 + ], + "seed_sd": 0.016, + "threshold": 0.12 + }, + "tests_top10_best": { + "mean": 0.716, + "functions": 29, + "boot_lo": 0.606, + "boot_hi": 0.824, + "boot_half": 0.109, + "seeds": [ + 0.726, + 0.717, + 0.755 + ], + "seed_sd": 0.02, + "threshold": 0.11 + }, + "tests_caught": { + "mean": 1.0, + "functions": 29, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.04 + }, + "look_vs_file": { + "mean": 0.119, + "functions": 41, + "boot_lo": 0.089, + "boot_hi": 0.156, + "boot_half": 0.034, + "seeds": [ + 0.119, + 0.119, + 0.119 + ], + "seed_sd": 0.0, + "threshold": 0.04 + } + }, + "rust": { + "callers_recall": { + "mean": 1.0, + "functions": 46, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.03 + }, + "callers_precision": { + "mean": 0.943, + "functions": 46, + "boot_lo": 0.895, + "boot_hi": 0.989, + "boot_half": 0.047, + "seeds": [ + 0.951, + 0.933, + 0.972 + ], + "seed_sd": 0.02, + "threshold": 0.05 + }, + "blind_recall": { + "mean": 0.861, + "functions": 36, + "boot_lo": 0.75, + "boot_hi": 0.944, + "boot_half": 0.097, + "seeds": [ + 0.789, + 0.789, + 0.737 + ], + "seed_sd": 0.03, + "threshold": 0.1 + }, + "common_recall": { + "mean": 0.898, + "functions": 18, + "boot_lo": 0.815, + "boot_hi": 0.972, + "boot_half": 0.079, + "seeds": [ + 0.859, + 0.91, + 0.869 + ], + "seed_sd": 0.027, + "threshold": 0.08 + }, + "common_recall_with_maybe": { + "mean": 0.898, + "functions": 18, + "boot_lo": 0.815, + "boot_hi": 0.972, + "boot_half": 0.079, + "seeds": [ + 0.859, + 0.91, + 0.869 + ], + "seed_sd": 0.027, + "threshold": 0.08 + }, + "common_precision": { + "mean": 1.0, + "functions": 18, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.06 + }, + "rename_ok": { + "mean": 0.839, + "functions": 62, + "boot_lo": 0.758, + "boot_hi": 0.919, + "boot_half": 0.081, + "seeds": [ + 0.829, + 0.857, + 0.886 + ], + "seed_sd": 0.029, + "threshold": 0.09 + }, + "tests_recall": { + "mean": 0.76, + "functions": 34, + "boot_lo": 0.663, + "boot_hi": 0.852, + "boot_half": 0.095, + "seeds": [ + 0.843, + 0.878, + 0.769 + ], + "seed_sd": 0.055, + "threshold": 0.1 + }, + "tests_precision": { + "mean": 0.758, + "functions": 34, + "boot_lo": 0.667, + "boot_hi": 0.845, + "boot_half": 0.089, + "seeds": [ + 0.8, + 0.728, + 0.774 + ], + "seed_sd": 0.036, + "threshold": 0.09 + }, + "tests_top10_precision": { + "mean": 0.807, + "functions": 34, + "boot_lo": 0.718, + "boot_hi": 0.89, + "boot_half": 0.086, + "seeds": [ + 0.9, + 0.78, + 0.837 + ], + "seed_sd": 0.06, + "threshold": 0.09 + }, + "tests_top10_best": { + "mean": 0.827, + "functions": 34, + "boot_lo": 0.745, + "boot_hi": 0.904, + "boot_half": 0.08, + "seeds": [ + 0.9, + 0.799, + 0.862 + ], + "seed_sd": 0.051, + "threshold": 0.08 + }, + "tests_caught": { + "mean": 0.971, + "functions": 34, + "boot_lo": 0.912, + "boot_hi": 1.0, + "boot_half": 0.044, + "seeds": [ + 1.0, + 0.938, + 1.0 + ], + "seed_sd": 0.036, + "threshold": 0.05 + }, + "look_vs_file": { + "mean": 0.169, + "functions": 62, + "boot_lo": 0.115, + "boot_hi": 0.229, + "boot_half": 0.057, + "seeds": [ + 0.112, + 0.182, + 0.162 + ], + "seed_sd": 0.036, + "threshold": 0.06 + } + } + } +} \ No newline at end of file diff --git a/eval/results/heldout.baselines.json b/eval/results/heldout.baselines.json new file mode 100644 index 0000000..01328bd --- /dev/null +++ b/eval/results/heldout.baselines.json @@ -0,0 +1,5329 @@ +{ + "callers": [ + { + "symbol": "main::FlagSet::Output", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::NewFlagSet", + "lang": "go", + "grep_recall": null, + "grep_precision": null, + "recall": null, + "precision": 0.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::FlagUsagesWrapped", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::GetNormalizeFunc", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::FlagUsages", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::AddGoFlag", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::PFlagFromGoFlag", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::VarPF", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 0.8, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::AddFlag", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::UnquoteUsage", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::ParseIPv4Mask", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::Router::NewRoute", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "mux" + }, + { + "symbol": "main::Route::Handler", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.125, + "recall": 1.0, + "precision": 1.0, + "repo": "mux" + }, + { + "symbol": "main::Route::GetMethods", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "mux" + }, + { + "symbol": "main::Route::HandlerFunc", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.3333333333333333, + "recall": 1.0, + "precision": 1.0, + "repo": "mux" + }, + { + "symbol": "main::Route::GetHandlerWithMiddlewares", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "mux" + }, + { + "symbol": "either::Either::as_pin_mut", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "either" + }, + { + "symbol": "either::Either::is_left", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "either" + }, + { + "symbol": "strsim::jaro", + "lang": "rust", + "grep_recall": null, + "grep_precision": null, + "recall": null, + "precision": null, + "repo": "strsim" + }, + { + "symbol": "strsim::damerau_levenshtein", + "lang": "rust", + "grep_recall": null, + "grep_precision": null, + "recall": null, + "precision": null, + "repo": "strsim" + }, + { + "symbol": "strsim::sorensen_dice", + "lang": "rust", + "grep_recall": null, + "grep_precision": null, + "recall": null, + "precision": null, + "repo": "strsim" + }, + { + "symbol": "strsim::levenshtein", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "strsim" + }, + { + "symbol": "strsim::osa_distance", + "lang": "rust", + "grep_recall": null, + "grep_precision": null, + "recall": null, + "precision": null, + "repo": "strsim" + }, + { + "symbol": "strsim::generic_jaro_winkler", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "strsim" + }, + { + "symbol": "strsim::normalized_damerau_levenshtein", + "lang": "rust", + "grep_recall": null, + "grep_precision": null, + "recall": null, + "precision": null, + "repo": "strsim" + }, + { + "symbol": "strsim::normalized_levenshtein", + "lang": "rust", + "grep_recall": null, + "grep_precision": null, + "recall": null, + "precision": null, + "repo": "strsim" + }, + { + "symbol": "strsim::hamming", + "lang": "rust", + "grep_recall": null, + "grep_precision": null, + "recall": null, + "precision": null, + "repo": "strsim" + }, + { + "symbol": "strsim::generic_hamming", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "strsim" + }, + { + "symbol": "strsim::generic_levenshtein", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "strsim" + }, + { + "symbol": "strsim::generic_jaro", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "strsim" + }, + { + "symbol": "strsim::jaro_winkler", + "lang": "rust", + "grep_recall": null, + "grep_precision": null, + "recall": null, + "precision": null, + "repo": "strsim" + }, + { + "symbol": "src::encoding::encodeHost", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::query::stringifyQuery", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::parse::parsePath", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::utils::isNonEmptyURL", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::query::encodeQueryItem", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::utils::withProtocol", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::encoding::encode", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::encoding::encodeHash", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::encoding::decodeQueryKey", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::parse::parseURL", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::utils::withLeadingSlash", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::query::parseQuery", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::utils::isEmptyURL", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::utils::hasLeadingSlash", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::punycode::toASCII", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::utils::withoutTrailingSlash", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::utils::withTrailingSlash", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::parse::parseHost", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::encoding::decodePath", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::utils::joinURL", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::encoding::decode", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::encoding::decodeQueryValue", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::encoding::encodePath", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::utils::hasTrailingSlash", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::encoding::encodeQueryKey", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::utils::withoutLeadingSlash", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::parse::parseAuth", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::parse::stringifyParsedURL", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::utils::normalizeAliases", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pathe" + }, + { + "symbol": "src::_path::normalize", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 0.6666666666666666, + "recall": 1.0, + "precision": 1.0, + "repo": "pathe" + }, + { + "symbol": "src::_path::isAbsolute", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pathe" + }, + { + "symbol": "src::_path::join", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 0.25, + "recall": 1.0, + "precision": 1.0, + "repo": "pathe" + }, + { + "symbol": "src::_path::normalizeString", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pathe" + }, + { + "symbol": "src::_path::extname", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pathe" + }, + { + "symbol": "src::_internal::normalizeWindowsPath", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pathe" + }, + { + "symbol": "src::_glob::matchGlob", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pathe" + }, + { + "symbol": "src::_path::basename", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pathe" + }, + { + "symbol": "src::_path::resolve", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 0.6666666666666666, + "recall": 1.0, + "precision": 1.0, + "repo": "pathe" + }, + { + "symbol": "src::_path::dirname", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pathe" + }, + { + "symbol": "main::ValueSourceChain::LookupWithSource", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "urfave-cli" + }, + { + "symbol": "main::Command::VisibleFlags", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.25, + "recall": 1.0, + "precision": 0.25, + "repo": "urfave-cli" + }, + { + "symbol": "main::Exit", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.6666666666666666, + "recall": 1.0, + "precision": 1.0, + "repo": "urfave-cli" + }, + { + "symbol": "main::ShowVersion", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "urfave-cli" + }, + { + "symbol": "main::ValueSourceChain::EnvKeys", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "urfave-cli" + }, + { + "symbol": "main::Command::Walk", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.5, + "recall": 1.0, + "precision": 1.0, + "repo": "urfave-cli" + }, + { + "symbol": "main::Command::Path", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.16666666666666666, + "recall": 1.0, + "precision": 1.0, + "repo": "urfave-cli" + }, + { + "symbol": "main::File", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "urfave-cli" + }, + { + "symbol": "main::Command::FullName", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.16666666666666666, + "recall": 1.0, + "precision": 0.16666666666666666, + "repo": "urfave-cli" + }, + { + "symbol": "main::Command::Bool", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.6666666666666666, + "recall": 0.75, + "precision": 1.0, + "repo": "urfave-cli" + }, + { + "symbol": "main::EnvVar", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "urfave-cli" + }, + { + "symbol": "main::Command::LocalFlagNames", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "urfave-cli" + }, + { + "symbol": "main::Command::VisiblePersistentFlags", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.6666666666666666, + "recall": 1.0, + "precision": 0.6666666666666666, + "repo": "urfave-cli" + }, + { + "symbol": "main::HandleExitCoder", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.5, + "recall": 1.0, + "precision": 1.0, + "repo": "urfave-cli" + }, + { + "symbol": "main::EnvVars", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "urfave-cli" + }, + { + "symbol": "main::DefaultCompleteWithFlags", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.6666666666666666, + "recall": 0.5, + "precision": 1.0, + "repo": "urfave-cli" + }, + { + "symbol": "main::Command::Lineage", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "urfave-cli" + }, + { + "symbol": "main::Command::Root", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "urfave-cli" + }, + { + "symbol": "main::Logger::LogFn", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "logrus" + }, + { + "symbol": "main::mutexWrap::Lock", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "logrus" + }, + { + "symbol": "main::mutexWrap::Unlock", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "logrus" + }, + { + "symbol": "main::Entry::Bytes", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.4, + "recall": 1.0, + "precision": 0.5, + "repo": "logrus" + }, + { + "symbol": "main::mutexWrap::Disable", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.5, + "recall": 1.0, + "precision": 1.0, + "repo": "logrus" + }, + { + "symbol": "main::NewEntry", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "logrus" + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::or_default", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 0.3333333333333333, + "recall": 1.0, + "precision": 0.3333333333333333, + "repo": "itertools" + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::both", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 0.25, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::adaptors::checked_binomial", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::map_any", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::lazy_buffer::LazyBuffer::get_at", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::Itertools::strip_prefix_by", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 0.5, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::Itertools::collect_vec", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 0.5, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::grouping_map::GroupingMap::fold_with", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::Itertools::chunk_by", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 0.3333333333333333, + "recall": 1.0, + "precision": 0.5, + "repo": "itertools" + }, + { + "symbol": "itertools::extrema_set::max_set_impl", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::Itertools::next_tuple", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 0.5, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::adaptors::PutBack::with_value", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::Itertools::position_max", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 0.5, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::extrema_set::min_set_impl", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::right_or_insert_with", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::Itertools::position_min", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 0.5, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::Itertools::position_minmax", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 0.5, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::next_array::ArrayBuilder::take", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 0.030303030303030304, + "recall": 1.0, + "precision": 0.03125, + "repo": "itertools" + }, + { + "symbol": "itertools::grouping_map::GroupingMap::max_by", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 0.5, + "recall": 1.0, + "precision": 0.5, + "repo": "itertools" + }, + { + "symbol": "itertools::groupbylazy::new_chunks", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::k_smallest::key_to_cmp", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::size_hint::mul_scalar", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::next_array::ArrayBuilder::push", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 0.07692307692307693, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::Itertools::partition_map", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 0.5, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::heap::heapify", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::lazy_buffer::LazyBuffer::get_next", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::size_hint::add_scalar", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::Itertools::all_unique_with_hasher", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 0.5, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::as_ref", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 0.23076923076923078, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::grouping_map::GroupingMap::aggregate", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::insert_right", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::Itertools::k_smallest_by", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 0.6666666666666666, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::Itertools::k_largest_relaxed_by", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 0.6666666666666666, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::minmax::minmax_impl", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::heap::sift_down", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::combinations::Combinations::reset", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 0.5, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::k_smallest::k_smallest_general", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 0.5, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::grouping_map::new_map_for_grouping", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::left_or_insert_with", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + } + ], + "callers_common": [ + { + "symbol": "main::FlagSet::StringToIntVarP", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.6666666666666666, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::BoolVarP", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.5, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::StringArrayVarP", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.6666666666666666, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::IPNetSliceVarP", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.6666666666666666, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::StringSliceVarP", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.6666666666666666, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::Uint16VarP", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.6666666666666666, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::Lookup", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 0.9, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::Float32VarP", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.6666666666666666, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::StringToInt64VarP", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.6666666666666666, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::Uint64VarP", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.6666666666666666, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::Uint32VarP", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.6666666666666666, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::DurationSliceVarP", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.6666666666666666, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::Float64SliceVarP", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.6666666666666666, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::Parse", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.3333333333333333, + "recall": 0.0, + "precision": 0.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::BoolP", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.6666666666666666, + "recall": 0.5, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::IntVarP", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.6666666666666666, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::IPNetVarP", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.6666666666666666, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::IPVarP", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.6666666666666666, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::BytesBase64VarP", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.6666666666666666, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::StringToStringVarP", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.6666666666666666, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::Int64VarP", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.6666666666666666, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::DurationVarP", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.6666666666666666, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::Int16VarP", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.6666666666666666, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::StringVarP", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.6666666666666666, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::UintSliceVarP", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.6666666666666666, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::TimeVarP", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.75, + "recall": 0.6666666666666666, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::Int8VarP", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.6666666666666666, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::VarP", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 0.5, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::Float32SliceVarP", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.6666666666666666, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::TimeP", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 0.3333333333333333, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::BoolSliceVarP", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.6666666666666666, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::UintVarP", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.6666666666666666, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::IPSliceVarP", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.6666666666666666, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::PrintDefaults", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 0.5, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::Route::Path", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.3, + "recall": 1.0, + "precision": 1.0, + "repo": "mux" + }, + { + "symbol": "main::Route::Schemes", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "mux" + }, + { + "symbol": "main::Route::Host", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.25, + "recall": 1.0, + "precision": 1.0, + "repo": "mux" + }, + { + "symbol": "main::Route::Headers", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "mux" + }, + { + "symbol": "main::Route::BuildVarsFunc", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.3333333333333333, + "recall": 1.0, + "precision": 1.0, + "repo": "mux" + }, + { + "symbol": "main::Route::Queries", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "mux" + }, + { + "symbol": "main::Route::PathPrefix", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "mux" + }, + { + "symbol": "main::Route::Name", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.5, + "recall": 1.0, + "precision": 1.0, + "repo": "mux" + }, + { + "symbol": "main::Route::MatcherFunc", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.3333333333333333, + "recall": 1.0, + "precision": 1.0, + "repo": "mux" + }, + { + "symbol": "main::Route::Methods", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.5, + "recall": 1.0, + "precision": 1.0, + "repo": "mux" + }, + { + "symbol": "byteorder::io::ReadBytesExt::read_f64_into", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 0.8, + "recall": 0.3333333333333333, + "precision": 1.0, + "repo": "byteorder" + }, + { + "symbol": "byteorder::ByteOrder::read_f32_into", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 0.4, + "recall": 1.0, + "precision": 1.0, + "repo": "byteorder" + }, + { + "symbol": "byteorder::ByteOrder::read_int", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 0.8, + "recall": 0.6666666666666666, + "precision": 1.0, + "repo": "byteorder" + }, + { + "symbol": "byteorder::ByteOrder::write_int", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 0.8, + "recall": 0.6666666666666666, + "precision": 1.0, + "repo": "byteorder" + }, + { + "symbol": "byteorder::ByteOrder::read_f64_into", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 0.4, + "recall": 1.0, + "precision": 1.0, + "repo": "byteorder" + }, + { + "symbol": "main::commandCategory::Name", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.012048192771084338, + "recall": 0.0, + "precision": null, + "repo": "urfave-cli" + }, + { + "symbol": "main::Command::HasName", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.3333333333333333, + "recall": 0.0, + "precision": null, + "repo": "urfave-cli" + }, + { + "symbol": "main::extFlag::IsBoolFlag", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.14285714285714285, + "recall": 1.0, + "precision": 1.0, + "repo": "urfave-cli" + }, + { + "symbol": "main::MapBase::Value", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.016129032258064516, + "recall": 1.0, + "precision": 1.0, + "repo": "urfave-cli" + }, + { + "symbol": "main::FlagBase::PreParse", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.2, + "recall": 1.0, + "precision": 1.0, + "repo": "urfave-cli" + }, + { + "symbol": "main::Entry::Logln", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.5384615384615384, + "recall": 1.0, + "precision": 1.0, + "repo": "logrus" + }, + { + "symbol": "main::Entry::WriterLevel", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.6666666666666666, + "recall": 1.0, + "precision": 1.0, + "repo": "logrus" + }, + { + "symbol": "main::Logger::Panicln", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.3333333333333333, + "recall": 0.0, + "precision": null, + "repo": "logrus" + }, + { + "symbol": "main::Logger::Infoln", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.25, + "recall": 0.0, + "precision": null, + "repo": "logrus" + }, + { + "symbol": "main::Logger::Errorln", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.3333333333333333, + "recall": 0.0, + "precision": null, + "repo": "logrus" + }, + { + "symbol": "main::Entry::WithError", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.3333333333333333, + "recall": 1.0, + "precision": 1.0, + "repo": "logrus" + }, + { + "symbol": "main::Entry::Errorf", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.14285714285714285, + "recall": 1.0, + "precision": 1.0, + "repo": "logrus" + }, + { + "symbol": "main::Entry::String", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.125, + "recall": 1.0, + "precision": 1.0, + "repo": "logrus" + }, + { + "symbol": "main::Logger::Info", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.125, + "recall": 0.0, + "precision": null, + "repo": "logrus" + }, + { + "symbol": "main::Logger::FatalFn", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "logrus" + }, + { + "symbol": "main::Entry::Panicf", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.3333333333333333, + "recall": 1.0, + "precision": 1.0, + "repo": "logrus" + }, + { + "symbol": "main::Logger::Logf", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.46153846153846156, + "recall": 1.0, + "precision": 1.0, + "repo": "logrus" + }, + { + "symbol": "main::Logger::WithField", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.25, + "recall": 0.0, + "precision": null, + "repo": "logrus" + }, + { + "symbol": "main::Logger::Println", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.3333333333333333, + "recall": 0.0, + "precision": null, + "repo": "logrus" + }, + { + "symbol": "main::Logger::WithContext", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.5, + "recall": 0.0, + "precision": null, + "repo": "logrus" + }, + { + "symbol": "main::Logger::Debugf", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.3333333333333333, + "recall": 0.0, + "precision": null, + "repo": "logrus" + }, + { + "symbol": "main::Logger::PrintFn", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "logrus" + }, + { + "symbol": "main::Entry::Debug", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.16666666666666666, + "recall": 0.0, + "precision": null, + "repo": "logrus" + }, + { + "symbol": "main::Logger::Error", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.1, + "recall": 0.0, + "precision": null, + "repo": "logrus" + }, + { + "symbol": "main::Entry::Warnln", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.2, + "recall": 1.0, + "precision": 1.0, + "repo": "logrus" + }, + { + "symbol": "main::Logger::Fatalf", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.3333333333333333, + "recall": 0.0, + "precision": null, + "repo": "logrus" + }, + { + "symbol": "main::Logger::DebugFn", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "logrus" + }, + { + "symbol": "main::Logger::Warnf", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.4, + "recall": 0.5, + "precision": 1.0, + "repo": "logrus" + }, + { + "symbol": "main::Logger::Printf", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.3333333333333333, + "recall": 0.0, + "precision": null, + "repo": "logrus" + }, + { + "symbol": "main::Logger::IsLevelEnabled", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "logrus" + }, + { + "symbol": "main::Logger::WithFields", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.3333333333333333, + "recall": 0.0, + "precision": null, + "repo": "logrus" + }, + { + "symbol": "main::Logger::Trace", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.2, + "recall": 0.0, + "precision": null, + "repo": "logrus" + }, + { + "symbol": "main::Logger::Traceln", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.3333333333333333, + "recall": 0.0, + "precision": null, + "repo": "logrus" + }, + { + "symbol": "main::Logger::SetOutput", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "logrus" + }, + { + "symbol": "main::Logger::GetLevel", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "logrus" + }, + { + "symbol": "main::Entry::Printf", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.3333333333333333, + "recall": 1.0, + "precision": 1.0, + "repo": "logrus" + }, + { + "symbol": "main::Logger::WriterLevel", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.3333333333333333, + "recall": 1.0, + "precision": 1.0, + "repo": "logrus" + }, + { + "symbol": "main::Logger::Panic", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.14285714285714285, + "recall": 0.0, + "precision": null, + "repo": "logrus" + }, + { + "symbol": "main::Logger::Infof", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.25, + "recall": 0.0, + "precision": null, + "repo": "logrus" + }, + { + "symbol": "main::Logger::Warnln", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.4, + "recall": 0.5, + "precision": 1.0, + "repo": "logrus" + }, + { + "symbol": "main::Entry::Info", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.25, + "recall": 0.5, + "precision": 1.0, + "repo": "logrus" + }, + { + "symbol": "main::Logger::PanicFn", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "logrus" + }, + { + "symbol": "main::Logger::Fatal", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.16666666666666666, + "recall": 0.0, + "precision": null, + "repo": "logrus" + }, + { + "symbol": "main::Level::String", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.5, + "recall": 0.5, + "precision": 1.0, + "repo": "logrus" + }, + { + "symbol": "hooks::slog::SlogLevel::Level", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.017543859649122806, + "recall": 0.0, + "precision": null, + "repo": "logrus" + }, + { + "symbol": "main::Entry::WithFields", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.3333333333333333, + "recall": 1.0, + "precision": 1.0, + "repo": "logrus" + }, + { + "symbol": "itertools::Itertools::next_array", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 0.5, + "recall": 0.5, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::adaptors::PutBack::put_back", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 0.4166666666666667, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::Itertools::sorted", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 0.25, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::Itertools::minmax_by", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 0.2, + "recall": 0.0, + "precision": null, + "repo": "itertools" + }, + { + "symbol": "itertools::peek_nth::PeekNth::peek_nth", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 0.5, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::Itertools::intersperse", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 0.25, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::Itertools::intersperse_with", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 0.25, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::multipeek_impl::MultiPeek::peek", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 0.08333333333333333, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::Itertools::sorted_unstable", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 0.5, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::peek_nth::PeekNth::peek", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 0.08333333333333333, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::grouping_map::GroupingMap::minmax_by", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 0.4, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::put_back_n_impl::PutBackN::put_back", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 0.08333333333333333, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::grouping_map::GroupingMap::reduce", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 0.5555555555555556, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + } + ], + "callers_blind": [ + { + "symbol": "main::FlagSet::Output", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::NewFlagSet", + "lang": "go", + "grep_recall": null, + "grep_precision": null, + "recall": null, + "precision": 0.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::FlagUsagesWrapped", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::GetNormalizeFunc", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::AddFlag", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::UnquoteUsage", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::PFlagFromGoFlag", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::AddGoFlag", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::VarPF", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 0.8, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::Router::NewRoute", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "mux" + }, + { + "symbol": "main::Route::GetMethods", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "mux" + }, + { + "symbol": "main::Route::GetHandlerWithMiddlewares", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "mux" + }, + { + "symbol": "byteorder::ByteOrder::from_slice_i64", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 0.5, + "recall": 0.0, + "precision": null, + "repo": "byteorder" + }, + { + "symbol": "byteorder::ByteOrder::write_i32_into", + "lang": "rust", + "grep_recall": null, + "grep_precision": 1.0, + "recall": null, + "precision": null, + "repo": "byteorder" + }, + { + "symbol": "byteorder::ByteOrder::write_i128_into", + "lang": "rust", + "grep_recall": null, + "grep_precision": 1.0, + "recall": null, + "precision": null, + "repo": "byteorder" + }, + { + "symbol": "byteorder::ByteOrder::from_slice_i32", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 0.5, + "recall": 0.0, + "precision": null, + "repo": "byteorder" + }, + { + "symbol": "byteorder::ByteOrder::write_f64_into", + "lang": "rust", + "grep_recall": null, + "grep_precision": 1.0, + "recall": null, + "precision": null, + "repo": "byteorder" + }, + { + "symbol": "byteorder::ByteOrder::from_slice_i16", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 0.5, + "recall": 0.0, + "precision": null, + "repo": "byteorder" + }, + { + "symbol": "byteorder::ByteOrder::write_i64_into", + "lang": "rust", + "grep_recall": null, + "grep_precision": 1.0, + "recall": null, + "precision": null, + "repo": "byteorder" + }, + { + "symbol": "byteorder::ByteOrder::from_slice_i128", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 0.5, + "recall": 0.0, + "precision": null, + "repo": "byteorder" + }, + { + "symbol": "byteorder::ByteOrder::write_i16_into", + "lang": "rust", + "grep_recall": null, + "grep_precision": 1.0, + "recall": null, + "precision": null, + "repo": "byteorder" + }, + { + "symbol": "byteorder::ByteOrder::write_f32_into", + "lang": "rust", + "grep_recall": null, + "grep_precision": 1.0, + "recall": null, + "precision": null, + "repo": "byteorder" + }, + { + "symbol": "either::Either::as_pin_mut", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "either" + }, + { + "symbol": "either::Either::right", + "lang": "rust", + "grep_recall": null, + "grep_precision": 0.5, + "recall": null, + "precision": null, + "repo": "either" + }, + { + "symbol": "strsim::jaro", + "lang": "rust", + "grep_recall": null, + "grep_precision": null, + "recall": null, + "precision": null, + "repo": "strsim" + }, + { + "symbol": "strsim::damerau_levenshtein", + "lang": "rust", + "grep_recall": null, + "grep_precision": null, + "recall": null, + "precision": null, + "repo": "strsim" + }, + { + "symbol": "strsim::sorensen_dice", + "lang": "rust", + "grep_recall": null, + "grep_precision": null, + "recall": null, + "precision": null, + "repo": "strsim" + }, + { + "symbol": "strsim::levenshtein", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "strsim" + }, + { + "symbol": "strsim::osa_distance", + "lang": "rust", + "grep_recall": null, + "grep_precision": null, + "recall": null, + "precision": null, + "repo": "strsim" + }, + { + "symbol": "strsim::generic_jaro_winkler", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "strsim" + }, + { + "symbol": "strsim::normalized_damerau_levenshtein", + "lang": "rust", + "grep_recall": null, + "grep_precision": null, + "recall": null, + "precision": null, + "repo": "strsim" + }, + { + "symbol": "strsim::normalized_levenshtein", + "lang": "rust", + "grep_recall": null, + "grep_precision": null, + "recall": null, + "precision": null, + "repo": "strsim" + }, + { + "symbol": "strsim::hamming", + "lang": "rust", + "grep_recall": null, + "grep_precision": null, + "recall": null, + "precision": null, + "repo": "strsim" + }, + { + "symbol": "strsim::generic_hamming", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "strsim" + }, + { + "symbol": "strsim::generic_levenshtein", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "strsim" + }, + { + "symbol": "strsim::generic_jaro", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "strsim" + }, + { + "symbol": "strsim::jaro_winkler", + "lang": "rust", + "grep_recall": null, + "grep_precision": null, + "recall": null, + "precision": null, + "repo": "strsim" + }, + { + "symbol": "src::encoding::encodeHost", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::query::stringifyQuery", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::parse::parsePath", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::url::$URL::href", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 0.5, + "recall": 0.0, + "precision": null, + "repo": "ufo" + }, + { + "symbol": "src::utils::isNonEmptyURL", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::query::encodeQueryItem", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::utils::withProtocol", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::encoding::encode", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::encoding::encodeHash", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::encoding::decodeQueryKey", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::parse::parseURL", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::utils::withLeadingSlash", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::encoding::decode", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::utils::withoutTrailingSlash", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::encoding::decodeQueryValue", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::encoding::encodePath", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::query::parseQuery", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::encoding::decodePath", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::utils::withTrailingSlash", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::url::$URL::encodedAuth", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 0.0, + "precision": null, + "repo": "ufo" + }, + { + "symbol": "src::utils::hasTrailingSlash", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::url::$URL::isAbsolute", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 0.0, + "precision": null, + "repo": "ufo" + }, + { + "symbol": "src::url::$URL::search", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 0.07692307692307693, + "recall": 0.0, + "precision": null, + "repo": "ufo" + }, + { + "symbol": "src::utils::joinURL", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::parse::parseHost", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::utils::withoutLeadingSlash", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::utils::normalizeAliases", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pathe" + }, + { + "symbol": "src::_path::normalize", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 0.6666666666666666, + "recall": 1.0, + "precision": 1.0, + "repo": "pathe" + }, + { + "symbol": "src::_path::isAbsolute", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pathe" + }, + { + "symbol": "src::_path::join", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 0.25, + "recall": 1.0, + "precision": 1.0, + "repo": "pathe" + }, + { + "symbol": "src::_path::normalizeString", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pathe" + }, + { + "symbol": "src::_path::extname", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pathe" + }, + { + "symbol": "src::_internal::normalizeWindowsPath", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pathe" + }, + { + "symbol": "src::_glob::matchGlob", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pathe" + }, + { + "symbol": "src::_path::basename", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pathe" + }, + { + "symbol": "src::_path::resolve", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 0.6666666666666666, + "recall": 1.0, + "precision": 1.0, + "repo": "pathe" + }, + { + "symbol": "src::_path::dirname", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pathe" + }, + { + "symbol": "main::ValueSourceChain::LookupWithSource", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "urfave-cli" + }, + { + "symbol": "main::DefaultShowCommandHelp", + "lang": "go", + "grep_recall": null, + "grep_precision": null, + "recall": null, + "precision": null, + "repo": "urfave-cli" + }, + { + "symbol": "main::Command::VisibleFlags", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.25, + "recall": 1.0, + "precision": 0.25, + "repo": "urfave-cli" + }, + { + "symbol": "main::Exit", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.6666666666666666, + "recall": 1.0, + "precision": 1.0, + "repo": "urfave-cli" + }, + { + "symbol": "main::DefaultPrintVersion", + "lang": "go", + "grep_recall": null, + "grep_precision": null, + "recall": null, + "precision": null, + "repo": "urfave-cli" + }, + { + "symbol": "scripts::LintActionFunc", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 0.0, + "precision": null, + "repo": "urfave-cli" + }, + { + "symbol": "scripts::SetMkdocsRemoteActionFunc", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 0.0, + "precision": null, + "repo": "urfave-cli" + }, + { + "symbol": "main::DefaultCompleteWithFlags", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.6666666666666666, + "recall": 0.5, + "precision": 1.0, + "repo": "urfave-cli" + }, + { + "symbol": "main::DefaultShowRootCommandHelp", + "lang": "go", + "grep_recall": null, + "grep_precision": null, + "recall": null, + "precision": null, + "repo": "urfave-cli" + }, + { + "symbol": "main::Command::Walk", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.5, + "recall": 1.0, + "precision": 1.0, + "repo": "urfave-cli" + }, + { + "symbol": "main::Command::Lineage", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "urfave-cli" + }, + { + "symbol": "scripts::V3Diff", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 0.0, + "precision": null, + "repo": "urfave-cli" + }, + { + "symbol": "main::Command::FullName", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.16666666666666666, + "recall": 1.0, + "precision": 0.16666666666666666, + "repo": "urfave-cli" + }, + { + "symbol": "main::EnvVars", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "urfave-cli" + }, + { + "symbol": "main::ShowRootCommandHelpAndExit", + "lang": "go", + "grep_recall": null, + "grep_precision": null, + "recall": null, + "precision": null, + "repo": "urfave-cli" + }, + { + "symbol": "scripts::EnsureGoimportsActionFunc", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 0.0, + "precision": null, + "repo": "urfave-cli" + }, + { + "symbol": "main::NewSliceBase", + "lang": "go", + "grep_recall": null, + "grep_precision": null, + "recall": null, + "precision": null, + "repo": "urfave-cli" + }, + { + "symbol": "main::ValueSourceChain::EnvKeys", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "urfave-cli" + }, + { + "symbol": "main::Logger::LogFn", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "logrus" + }, + { + "symbol": "main::mutexWrap::Lock", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "logrus" + }, + { + "symbol": "main::mutexWrap::Unlock", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "logrus" + }, + { + "symbol": "main::Entry::Bytes", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.4, + "recall": 1.0, + "precision": 0.5, + "repo": "logrus" + }, + { + "symbol": "main::mutexWrap::Disable", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.5, + "recall": 1.0, + "precision": 1.0, + "repo": "logrus" + }, + { + "symbol": "main::NewEntry", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "logrus" + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::or_default", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 0.3333333333333333, + "recall": 1.0, + "precision": 0.3333333333333333, + "repo": "itertools" + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::both", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 0.25, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::adaptors::checked_binomial", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::map_any", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::lazy_buffer::LazyBuffer::get_at", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::Itertools::strip_prefix_by", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 0.5, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::Itertools::collect_vec", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 0.5, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::grouping_map::GroupingMap::fold_with", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::Itertools::chunk_by", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 0.3333333333333333, + "recall": 1.0, + "precision": 0.5, + "repo": "itertools" + }, + { + "symbol": "itertools::repeatn::repeat_n", + "lang": "rust", + "grep_recall": null, + "grep_precision": 1.0, + "recall": null, + "precision": null, + "repo": "itertools" + }, + { + "symbol": "itertools::next_array::ArrayBuilder::take", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 0.030303030303030304, + "recall": 1.0, + "precision": 0.03125, + "repo": "itertools" + }, + { + "symbol": "itertools::grouping_map::GroupingMap::max_by", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 0.5, + "recall": 1.0, + "precision": 0.5, + "repo": "itertools" + }, + { + "symbol": "itertools::groupbylazy::new_chunks", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::k_smallest::key_to_cmp", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::size_hint::mul_scalar", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::next_array::ArrayBuilder::push", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 0.07692307692307693, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::extrema_set::min_set_impl", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::Itertools::partition_map", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 0.5, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::heap::heapify", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::grouping_map::GroupingMap::aggregate", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::insert_right", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::right_or_insert_with", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::Itertools::k_smallest_by", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 0.6666666666666666, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::as_ref", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 0.23076923076923078, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::tuple_impl::TupleCollect::buffer_len", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 0.5, + "recall": 0.0, + "precision": null, + "repo": "itertools" + }, + { + "symbol": "itertools::Itertools::k_largest_relaxed_by", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 0.6666666666666666, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::minmax::minmax_impl", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + } + ], + "tests": [ + { + "symbol": "main::FlagSet::Output", + "lang": "go", + "tests_in_project": 194, + "failing": 12, + "grep_recall": 0.08333333333333333, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.48021748388099006, + "random_precision": 0.061855670103092786, + "recall": 1.0, + "precision": 0.07100591715976332, + "caught": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::FlagUsagesWrapped", + "lang": "go", + "tests_in_project": 194, + "failing": 13, + "grep_recall": 0.3076923076923077, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.5087769627886279, + "random_precision": 0.06701030927835051, + "recall": 1.0, + "precision": 1.0, + "caught": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::FlagUsages", + "lang": "go", + "tests_in_project": 194, + "failing": 9, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.3853485533357117, + "random_precision": 0.04639175257731959, + "recall": 1.0, + "precision": 0.9, + "caught": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::AddGoFlag", + "lang": "go", + "tests_in_project": 194, + "failing": 1, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.05154639175257736, + "random_precision": 0.005154639175257732, + "recall": 1.0, + "precision": 0.3333333333333333, + "caught": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::PFlagFromGoFlag", + "lang": "go", + "tests_in_project": 194, + "failing": 1, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.05154639175257736, + "random_precision": 0.005154639175257732, + "recall": 1.0, + "precision": 0.3333333333333333, + "caught": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::UnquoteUsage", + "lang": "go", + "tests_in_project": 194, + "failing": 11, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.45017225173538256, + "random_precision": 0.05670103092783505, + "recall": 1.0, + "precision": 0.8461538461538461, + "caught": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::ParseIPv4Mask", + "lang": "go", + "tests_in_project": 194, + "failing": 4, + "grep_recall": 0.25, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.1921602095359496, + "random_precision": 0.020618556701030927, + "recall": 1.0, + "precision": 1.0, + "caught": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::Route::Handler", + "lang": "go", + "tests_in_project": 72, + "failing": 36, + "grep_recall": 0.3055555555555556, + "grep_precision": 0.9166666666666666, + "grep_caught": 1.0, + "random_caught": 0.9995259582252664, + "random_precision": 0.5, + "recall": 0.9722222222222222, + "precision": 1.0, + "caught": 1.0, + "repo": "mux" + }, + { + "symbol": "main::Route::GetMethods", + "lang": "go", + "tests_in_project": 72, + "failing": 4, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.45776591918661724, + "random_precision": 0.05555555555555555, + "recall": 0.75, + "precision": 1.0, + "caught": 1.0, + "repo": "mux" + }, + { + "symbol": "main::Route::HandlerFunc", + "lang": "go", + "tests_in_project": 72, + "failing": 33, + "grep_recall": 0.24242424242424243, + "grep_precision": 0.8, + "grep_caught": 1.0, + "random_caught": 0.99881437663402, + "random_precision": 0.4583333333333333, + "recall": 0.9696969696969697, + "precision": 1.0, + "caught": 1.0, + "repo": "mux" + }, + { + "symbol": "main::Route::GetHandlerWithMiddlewares", + "lang": "go", + "tests_in_project": 72, + "failing": 40, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.9998796889138059, + "random_precision": 0.5555555555555556, + "recall": 0.05, + "precision": 1.0, + "caught": 1.0, + "repo": "mux" + }, + { + "symbol": "itsdangerous::encoding::base64_encode", + "lang": "python", + "tests_in_project": 59, + "failing": 59, + "grep_recall": 0.01694915254237288, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 1.0, + "random_precision": 1.0, + "recall": 0.01694915254237288, + "precision": 0.25, + "caught": 1.0, + "repo": "itsdangerous" + }, + { + "symbol": "itsdangerous::timed::TimestampSigner::timestamp_to_datetime", + "lang": "python", + "tests_in_project": 36, + "failing": 31, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 1.0, + "random_precision": 0.8611111111111112, + "recall": 0.16129032258064516, + "precision": 0.3125, + "caught": 1.0, + "repo": "itsdangerous" + }, + { + "symbol": "itsdangerous::serializer::is_text_serializer", + "lang": "python", + "tests_in_project": 41, + "failing": 41, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 1.0, + "random_precision": 1.0, + "recall": 0.3170731707317073, + "precision": 1.0, + "caught": 1.0, + "repo": "itsdangerous" + }, + { + "symbol": "itsdangerous::timed::TimestampSigner::get_timestamp", + "lang": "python", + "tests_in_project": 36, + "failing": 35, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 1.0, + "random_precision": 0.9722222222222222, + "recall": 0.14285714285714285, + "precision": 0.5555555555555556, + "caught": 1.0, + "repo": "itsdangerous" + }, + { + "symbol": "itsdangerous::signer::Signer::derive_key", + "lang": "python", + "tests_in_project": 61, + "failing": 61, + "grep_recall": 0.01639344262295082, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 1.0, + "random_precision": 1.0, + "recall": 0.14754098360655737, + "precision": 0.8181818181818182, + "caught": 1.0, + "repo": "itsdangerous" + }, + { + "symbol": "itsdangerous::serializer::Serializer::make_signer", + "lang": "python", + "tests_in_project": 41, + "failing": 41, + "grep_recall": 0.04878048780487805, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 1.0, + "random_precision": 1.0, + "recall": 0.3170731707317073, + "precision": 1.0, + "caught": 1.0, + "repo": "itsdangerous" + }, + { + "symbol": "itsdangerous::encoding::want_bytes", + "lang": "python", + "tests_in_project": 69, + "failing": 69, + "grep_recall": 0.028985507246376812, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 1.0, + "random_precision": 1.0, + "recall": 0.057971014492753624, + "precision": 0.8, + "caught": 1.0, + "repo": "itsdangerous" + }, + { + "symbol": "itsdangerous::encoding::base64_decode", + "lang": "python", + "tests_in_project": 53, + "failing": 53, + "grep_recall": 0.03773584905660377, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 1.0, + "random_precision": 1.0, + "recall": 0.2830188679245283, + "precision": 0.8823529411764706, + "caught": 1.0, + "repo": "itsdangerous" + }, + { + "symbol": "strsim::jaro", + "lang": "rust", + "tests_in_project": 97, + "failing": 14, + "grep_recall": 1.0, + "grep_precision": 0.9333333333333333, + "grep_caught": 1.0, + "random_caught": 0.8065965742163365, + "random_precision": 0.14432989690721648, + "recall": 1.0, + "precision": 0.45161290322580644, + "caught": 1.0, + "repo": "strsim" + }, + { + "symbol": "strsim::damerau_levenshtein", + "lang": "rust", + "tests_in_project": 97, + "failing": 17, + "grep_recall": 1.0, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.8690815351373979, + "random_precision": 0.17525773195876287, + "recall": 1.0, + "precision": 0.7391304347826086, + "caught": 1.0, + "repo": "strsim" + }, + { + "symbol": "strsim::sorensen_dice", + "lang": "rust", + "tests_in_project": 97, + "failing": 1, + "grep_recall": 1.0, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.1030927835051546, + "random_precision": 0.010309278350515464, + "recall": 1.0, + "precision": 0.010416666666666666, + "caught": 1.0, + "repo": "strsim" + }, + { + "symbol": "strsim::levenshtein", + "lang": "rust", + "tests_in_project": 97, + "failing": 14, + "grep_recall": 0.6428571428571429, + "grep_precision": 0.8181818181818182, + "grep_caught": 1.0, + "random_caught": 0.8065965742163365, + "random_precision": 0.14432989690721648, + "recall": 1.0, + "precision": 0.3684210526315789, + "caught": 1.0, + "repo": "strsim" + }, + { + "symbol": "strsim::osa_distance", + "lang": "rust", + "tests_in_project": 97, + "failing": 17, + "grep_recall": 1.0, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.8690815351373979, + "random_precision": 0.17525773195876287, + "recall": 1.0, + "precision": 1.0, + "caught": 1.0, + "repo": "strsim" + }, + { + "symbol": "strsim::generic_jaro_winkler", + "lang": "rust", + "tests_in_project": 97, + "failing": 16, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.8506423147342146, + "random_precision": 0.16494845360824742, + "recall": 1.0, + "precision": 1.0, + "caught": 1.0, + "repo": "strsim" + }, + { + "symbol": "strsim::normalized_damerau_levenshtein", + "lang": "rust", + "tests_in_project": 97, + "failing": 6, + "grep_recall": 1.0, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.4889743982398018, + "random_precision": 0.061855670103092786, + "recall": 1.0, + "precision": 1.0, + "caught": 1.0, + "repo": "strsim" + }, + { + "symbol": "strsim::normalized_levenshtein", + "lang": "rust", + "tests_in_project": 97, + "failing": 6, + "grep_recall": 1.0, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.4889743982398018, + "random_precision": 0.061855670103092786, + "recall": 1.0, + "precision": 1.0, + "caught": 1.0, + "repo": "strsim" + }, + { + "symbol": "strsim::hamming", + "lang": "rust", + "tests_in_project": 97, + "failing": 6, + "grep_recall": 0.6666666666666666, + "grep_precision": 0.6666666666666666, + "grep_caught": 1.0, + "random_caught": 0.4889743982398018, + "random_precision": 0.061855670103092786, + "recall": 1.0, + "precision": 0.75, + "caught": 1.0, + "repo": "strsim" + }, + { + "symbol": "strsim::generic_hamming", + "lang": "rust", + "tests_in_project": 97, + "failing": 8, + "grep_recall": 0.25, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.5956720513545685, + "random_precision": 0.08247422680412371, + "recall": 1.0, + "precision": 1.0, + "caught": 1.0, + "repo": "strsim" + }, + { + "symbol": "strsim::generic_levenshtein", + "lang": "rust", + "tests_in_project": 97, + "failing": 14, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.8065965742163365, + "random_precision": 0.14432989690721648, + "recall": 1.0, + "precision": 0.9333333333333333, + "caught": 1.0, + "repo": "strsim" + }, + { + "symbol": "src::encoding::encodeHost", + "lang": "typescript", + "tests_in_project": 14, + "failing": 2, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.9340659340659341, + "random_precision": 0.14285714285714285, + "recall": 0.5, + "precision": 0.5, + "caught": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::query::stringifyQuery", + "lang": "typescript", + "tests_in_project": 14, + "failing": 4, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.999000999000999, + "random_precision": 0.2857142857142857, + "recall": 0.75, + "precision": 1.0, + "caught": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::parse::parsePath", + "lang": "typescript", + "tests_in_project": 14, + "failing": 6, + "grep_recall": 0.16666666666666666, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 1.0, + "random_precision": 0.42857142857142855, + "recall": 0.8333333333333334, + "precision": 0.8333333333333334, + "caught": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::utils::isNonEmptyURL", + "lang": "typescript", + "tests_in_project": 14, + "failing": 3, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.989010989010989, + "random_precision": 0.21428571428571427, + "recall": 1.0, + "precision": 1.0, + "caught": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::query::encodeQueryItem", + "lang": "typescript", + "tests_in_project": 14, + "failing": 4, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.999000999000999, + "random_precision": 0.2857142857142857, + "recall": 0.75, + "precision": 1.0, + "caught": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::utils::withProtocol", + "lang": "typescript", + "tests_in_project": 14, + "failing": 1, + "grep_recall": 1.0, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.7142857142857143, + "random_precision": 0.07142857142857142, + "recall": 1.0, + "precision": 1.0, + "caught": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::encoding::encode", + "lang": "typescript", + "tests_in_project": 14, + "failing": 6, + "grep_recall": 0.16666666666666666, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 1.0, + "random_precision": 0.42857142857142855, + "recall": 0.5, + "precision": 1.0, + "caught": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::encoding::encodeHash", + "lang": "typescript", + "tests_in_project": 14, + "failing": 4, + "grep_recall": 0.25, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.999000999000999, + "random_precision": 0.2857142857142857, + "recall": 0.75, + "precision": 1.0, + "caught": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::encoding::decode", + "lang": "typescript", + "tests_in_project": 14, + "failing": 8, + "grep_recall": 0.125, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 1.0, + "random_precision": 0.5714285714285714, + "recall": 0.875, + "precision": 0.875, + "caught": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::utils::withoutTrailingSlash", + "lang": "typescript", + "tests_in_project": 14, + "failing": 4, + "grep_recall": 0.5, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.999000999000999, + "random_precision": 0.2857142857142857, + "recall": 1.0, + "precision": 1.0, + "caught": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::encoding::decodeQueryValue", + "lang": "typescript", + "tests_in_project": 14, + "failing": 4, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.999000999000999, + "random_precision": 0.2857142857142857, + "recall": 0.75, + "precision": 0.6, + "caught": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::encoding::encodePath", + "lang": "typescript", + "tests_in_project": 14, + "failing": 3, + "grep_recall": 0.3333333333333333, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.989010989010989, + "random_precision": 0.21428571428571427, + "recall": 0.6666666666666666, + "precision": 1.0, + "caught": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::query::parseQuery", + "lang": "typescript", + "tests_in_project": 14, + "failing": 4, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.999000999000999, + "random_precision": 0.2857142857142857, + "recall": 0.75, + "precision": 0.75, + "caught": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::utils::hasTrailingSlash", + "lang": "typescript", + "tests_in_project": 14, + "failing": 4, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.999000999000999, + "random_precision": 0.2857142857142857, + "recall": 1.0, + "precision": 0.5714285714285714, + "caught": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::utils::joinURL", + "lang": "typescript", + "tests_in_project": 14, + "failing": 2, + "grep_recall": 0.5, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.9340659340659341, + "random_precision": 0.14285714285714285, + "recall": 1.0, + "precision": 1.0, + "caught": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::parse::parseHost", + "lang": "typescript", + "tests_in_project": 14, + "failing": 2, + "grep_recall": 0.5, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.9340659340659341, + "random_precision": 0.14285714285714285, + "recall": 0.5, + "precision": 1.0, + "caught": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::utils::withoutLeadingSlash", + "lang": "typescript", + "tests_in_project": 14, + "failing": 2, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.9340659340659341, + "random_precision": 0.14285714285714285, + "recall": 0.5, + "precision": 1.0, + "caught": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::utils::normalizeAliases", + "lang": "typescript", + "tests_in_project": 4, + "failing": 1, + "grep_recall": 1.0, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 1.0, + "random_precision": 0.25, + "recall": 1.0, + "precision": 1.0, + "caught": 1.0, + "repo": "pathe" + }, + { + "symbol": "src::_path::normalize", + "lang": "typescript", + "tests_in_project": 4, + "failing": 3, + "grep_recall": 0.3333333333333333, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 1.0, + "random_precision": 0.75, + "recall": 0.6666666666666666, + "precision": 1.0, + "caught": 1.0, + "repo": "pathe" + }, + { + "symbol": "src::_path::isAbsolute", + "lang": "typescript", + "tests_in_project": 4, + "failing": 3, + "grep_recall": 0.3333333333333333, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 1.0, + "random_precision": 0.75, + "recall": 1.0, + "precision": 1.0, + "caught": 1.0, + "repo": "pathe" + }, + { + "symbol": "src::_path::join", + "lang": "typescript", + "tests_in_project": 4, + "failing": 2, + "grep_recall": 0.5, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 1.0, + "random_precision": 0.5, + "recall": 0.5, + "precision": 1.0, + "caught": 1.0, + "repo": "pathe" + }, + { + "symbol": "src::_path::normalizeString", + "lang": "typescript", + "tests_in_project": 4, + "failing": 3, + "grep_recall": 0.3333333333333333, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 1.0, + "random_precision": 0.75, + "recall": 1.0, + "precision": 1.0, + "caught": 1.0, + "repo": "pathe" + }, + { + "symbol": "src::_path::extname", + "lang": "typescript", + "tests_in_project": 4, + "failing": 1, + "grep_recall": 1.0, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 1.0, + "random_precision": 0.25, + "recall": 1.0, + "precision": 1.0, + "caught": 1.0, + "repo": "pathe" + }, + { + "symbol": "src::_internal::normalizeWindowsPath", + "lang": "typescript", + "tests_in_project": 4, + "failing": 3, + "grep_recall": 0.3333333333333333, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 1.0, + "random_precision": 0.75, + "recall": 1.0, + "precision": 1.0, + "caught": 1.0, + "repo": "pathe" + }, + { + "symbol": "src::_glob::matchGlob", + "lang": "typescript", + "tests_in_project": 4, + "failing": 3, + "grep_recall": 0.3333333333333333, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 1.0, + "random_precision": 0.75, + "recall": 0.6666666666666666, + "precision": 1.0, + "caught": 1.0, + "repo": "pathe" + }, + { + "symbol": "src::_path::resolve", + "lang": "typescript", + "tests_in_project": 4, + "failing": 1, + "grep_recall": 1.0, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 1.0, + "random_precision": 0.25, + "recall": 1.0, + "precision": 1.0, + "caught": 1.0, + "repo": "pathe" + }, + { + "symbol": "src::_path::dirname", + "lang": "typescript", + "tests_in_project": 4, + "failing": 1, + "grep_recall": 1.0, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 1.0, + "random_precision": 0.25, + "recall": 1.0, + "precision": 1.0, + "caught": 1.0, + "repo": "pathe" + }, + { + "symbol": "src::_path::basename", + "lang": "typescript", + "tests_in_project": 4, + "failing": 1, + "grep_recall": 1.0, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 1.0, + "random_precision": 0.25, + "recall": 1.0, + "precision": 1.0, + "caught": 1.0, + "repo": "pathe" + }, + { + "symbol": "main::ValueSourceChain::LookupWithSource", + "lang": "go", + "tests_in_project": 646, + "failing": 18, + "grep_recall": 0.1111111111111111, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.2476924485795753, + "random_precision": 0.02786377708978328, + "recall": 0.16666666666666666, + "precision": 0.3333333333333333, + "caught": 1.0, + "repo": "urfave-cli" + }, + { + "symbol": "main::Command::VisibleFlagCategories", + "lang": "go", + "tests_in_project": 646, + "failing": 26, + "grep_recall": 0.038461538461538464, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.3388344601515808, + "random_precision": 0.04024767801857585, + "recall": 0.038461538461538464, + "precision": 0.16666666666666666, + "caught": 1.0, + "repo": "urfave-cli" + }, + { + "symbol": "main::Command::VisibleFlags", + "lang": "go", + "tests_in_project": 646, + "failing": 45, + "grep_recall": 0.044444444444444446, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.5167954036600311, + "random_precision": 0.0696594427244582, + "recall": 0.2, + "precision": 0.6428571428571429, + "caught": 1.0, + "repo": "urfave-cli" + }, + { + "symbol": "main::Exit", + "lang": "go", + "tests_in_project": 646, + "failing": 32, + "grep_recall": 0.40625, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.40053228154294174, + "random_precision": 0.04953560371517028, + "recall": 0.46875, + "precision": 0.46875, + "caught": 1.0, + "repo": "urfave-cli" + }, + { + "symbol": "main::ShowVersion", + "lang": "go", + "tests_in_project": 646, + "failing": 3, + "grep_recall": 0.3333333333333333, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.045794316875278684, + "random_precision": 0.0046439628482972135, + "recall": 1.0, + "precision": 0.007518796992481203, + "caught": 1.0, + "repo": "urfave-cli" + }, + { + "symbol": "main::ValueSourceChain::EnvKeys", + "lang": "go", + "tests_in_project": 646, + "failing": 67, + "grep_recall": 0.029850746268656716, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.6681643995363452, + "random_precision": 0.10371517027863777, + "recall": 0.029850746268656716, + "precision": 0.2222222222222222, + "caught": 1.0, + "repo": "urfave-cli" + }, + { + "symbol": "main::Command::Walk", + "lang": "go", + "tests_in_project": 646, + "failing": 437, + "grep_recall": 0.009153318077803204, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.9999891711683475, + "random_precision": 0.6764705882352942, + "recall": 0.9290617848970252, + "precision": 0.9878345498783455, + "caught": 1.0, + "repo": "urfave-cli" + }, + { + "symbol": "main::Command::Path", + "lang": "go", + "tests_in_project": 646, + "failing": 58, + "grep_recall": 0.017241379310344827, + "grep_precision": 0.3333333333333333, + "grep_caught": 1.0, + "random_caught": 0.6123561377886477, + "random_precision": 0.08978328173374613, + "recall": 0.05172413793103448, + "precision": 0.3333333333333333, + "caught": 1.0, + "repo": "urfave-cli" + }, + { + "symbol": "main::DefaultCompleteWithFlags", + "lang": "go", + "tests_in_project": 646, + "failing": 13, + "grep_recall": 0.15384615384615385, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.18513738455250794, + "random_precision": 0.020123839009287926, + "recall": 0.15384615384615385, + "precision": 0.028985507246376812, + "caught": 1.0, + "repo": "urfave-cli" + }, + { + "symbol": "main::Command::Lineage", + "lang": "go", + "tests_in_project": 646, + "failing": 461, + "grep_recall": 0.0021691973969631237, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.9999968933022502, + "random_precision": 0.7136222910216719, + "recall": 0.27765726681127983, + "precision": 0.9846153846153847, + "caught": 1.0, + "repo": "urfave-cli" + }, + { + "symbol": "main::Command::FullName", + "lang": "go", + "tests_in_project": 646, + "failing": 56, + "grep_recall": 0.03571428571428571, + "grep_precision": 0.6666666666666666, + "grep_caught": 1.0, + "random_caught": 0.5988621328179768, + "random_precision": 0.08668730650154799, + "recall": 0.017857142857142856, + "precision": 0.14285714285714285, + "caught": 1.0, + "repo": "urfave-cli" + }, + { + "symbol": "main::EnvVars", + "lang": "go", + "tests_in_project": 646, + "failing": 80, + "grep_recall": 0.85, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.73605240453924, + "random_precision": 0.1238390092879257, + "recall": 1.0, + "precision": 1.0, + "caught": 1.0, + "repo": "urfave-cli" + }, + { + "symbol": "main::HandleExitCoder", + "lang": "go", + "tests_in_project": 646, + "failing": 54, + "grep_recall": 0.16666666666666666, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.5849468333815118, + "random_precision": 0.08359133126934984, + "recall": 0.9814814814814815, + "precision": 0.12832929782082325, + "caught": 1.0, + "repo": "urfave-cli" + }, + { + "symbol": "main::Logger::LogFn", + "lang": "go", + "tests_in_project": 137, + "failing": 2, + "grep_recall": 0.5, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.14115500214684418, + "random_precision": 0.014598540145985401, + "recall": 1.0, + "precision": 0.5, + "caught": 1.0, + "repo": "logrus" + }, + { + "symbol": "main::mutexWrap::Lock", + "lang": "go", + "tests_in_project": 137, + "failing": 113, + "grep_recall": 0.008849557522123894, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.9999999957228018, + "random_precision": 0.8248175182481752, + "recall": 0.6017699115044248, + "precision": 0.8395061728395061, + "caught": 1.0, + "repo": "logrus" + }, + { + "symbol": "main::mutexWrap::Unlock", + "lang": "go", + "tests_in_project": 137, + "failing": 113, + "grep_recall": 0.008849557522123894, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.9999999957228018, + "random_precision": 0.8248175182481752, + "recall": 0.6017699115044248, + "precision": 0.8395061728395061, + "caught": 1.0, + "repo": "logrus" + }, + { + "symbol": "main::Entry::Bytes", + "lang": "go", + "tests_in_project": 137, + "failing": 4, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.2641184374392529, + "random_precision": 0.029197080291970802, + "recall": 0.25, + "precision": 0.05555555555555555, + "caught": 1.0, + "repo": "logrus" + }, + { + "symbol": "main::NewEntry", + "lang": "go", + "tests_in_project": 137, + "failing": 105, + "grep_recall": 0.09523809523809523, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.9999998593087098, + "random_precision": 0.7664233576642335, + "recall": 0.49523809523809526, + "precision": 1.0, + "caught": 1.0, + "repo": "logrus" + }, + { + "symbol": "marshmallow::utils::is_generator", + "lang": "python", + "tests_in_project": 647, + "failing": 173, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.9565903014466047, + "random_precision": 0.26738794435857804, + "recall": 0.005780346820809248, + "precision": 0.07692307692307693, + "caught": 0.0, + "repo": "marshmallow" + }, + { + "symbol": "marshmallow::utils::timedelta_to_microseconds", + "lang": "python", + "tests_in_project": 647, + "failing": 36, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.4382133339683756, + "random_precision": 0.05564142194744977, + "recall": 0.0, + "precision": 0.0, + "caught": 0.0, + "repo": "marshmallow" + }, + { + "symbol": "marshmallow::orderedset::OrderedSet::discard", + "lang": "python", + "tests_in_project": 647, + "failing": 4, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.06054247271955571, + "random_precision": 0.0061823802163833074, + "recall": 0.0, + "precision": 0.0, + "caught": 0.0, + "repo": "marshmallow" + }, + { + "symbol": "marshmallow::error_store::merge_errors", + "lang": "python", + "tests_in_project": 647, + "failing": 106, + "grep_recall": 0.0660377358490566, + "grep_precision": 0.25, + "grep_caught": 1.0, + "random_caught": 0.8352038355405944, + "random_precision": 0.16383307573415765, + "recall": 0.08490566037735849, + "precision": 0.3, + "caught": 1.0, + "repo": "marshmallow" + }, + { + "symbol": "marshmallow::utils::from_timestamp", + "lang": "python", + "tests_in_project": 647, + "failing": 8, + "grep_recall": 0.375, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.11776589403065596, + "random_precision": 0.012364760432766615, + "recall": 0.5, + "precision": 0.8, + "caught": 1.0, + "repo": "marshmallow" + }, + { + "symbol": "marshmallow::fields::Field::make_error", + "lang": "python", + "tests_in_project": 647, + "failing": 86, + "grep_recall": 0.023255813953488372, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.762367456397425, + "random_precision": 0.13292117465224113, + "recall": 0.5930232558139535, + "precision": 0.4811320754716981, + "caught": 1.0, + "repo": "marshmallow" + }, + { + "symbol": "marshmallow::schema::Schema::from_dict", + "lang": "python", + "tests_in_project": 647, + "failing": 5, + "grep_recall": 0.8, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.07515300969125771, + "random_precision": 0.0077279752704791345, + "recall": 0.8, + "precision": 0.8, + "caught": 1.0, + "repo": "marshmallow" + }, + { + "symbol": "marshmallow::utils::is_aware", + "lang": "python", + "tests_in_project": 647, + "failing": 7, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.10376217806288868, + "random_precision": 0.010819165378670788, + "recall": 0.0, + "precision": 0.0, + "caught": 0.0, + "repo": "marshmallow" + }, + { + "symbol": "marshmallow::utils::timestamp", + "lang": "python", + "tests_in_project": 647, + "failing": 1, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.015455950540958274, + "random_precision": 0.0015455950540958269, + "recall": 1.0, + "precision": 0.1, + "caught": 1.0, + "repo": "marshmallow" + }, + { + "symbol": "marshmallow::exceptions::ValidationError::normalized_messages", + "lang": "python", + "tests_in_project": 647, + "failing": 3, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.04572453064888615, + "random_precision": 0.00463678516228748, + "recall": 1.0, + "precision": 0.01694915254237288, + "caught": 0.0, + "repo": "marshmallow" + }, + { + "symbol": "marshmallow::error_store::ErrorStore::store_error", + "lang": "python", + "tests_in_project": 647, + "failing": 99, + "grep_recall": 0.020202020202020204, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.8123939179800322, + "random_precision": 0.15301391035548687, + "recall": 1.0, + "precision": 0.553072625698324, + "caught": 1.0, + "repo": "marshmallow" + }, + { + "symbol": "marshmallow::utils::set_value", + "lang": "python", + "tests_in_project": 647, + "failing": 136, + "grep_recall": 0.007352941176470588, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.9073091762552673, + "random_precision": 0.21020092735703247, + "recall": 0.9779411764705882, + "precision": 0.7471910112359551, + "caught": 1.0, + "repo": "marshmallow" + }, + { + "symbol": "marshmallow::utils::pluck", + "lang": "python", + "tests_in_project": 647, + "failing": 5, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.07515300969125771, + "random_precision": 0.0077279752704791345, + "recall": 1.0, + "precision": 1.0, + "caught": 1.0, + "repo": "marshmallow" + }, + { + "symbol": "boltons::iterutils::remap", + "lang": "python", + "tests_in_project": 468, + "failing": 21, + "grep_recall": 0.9047619047619048, + "grep_precision": 0.9047619047619048, + "grep_caught": 1.0, + "random_caught": 0.37103386557214113, + "random_precision": 0.04487179487179487, + "recall": 1.0, + "precision": 0.9130434782608695, + "caught": 1.0, + "repo": "boltons" + }, + { + "symbol": "boltons::mathutils::Bits::as_bin", + "lang": "python", + "tests_in_project": 468, + "failing": 4, + "grep_recall": 1.0, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.08302749409065446, + "random_precision": 0.008547008547008548, + "recall": 1.0, + "precision": 0.25, + "caught": 1.0, + "repo": "boltons" + }, + { + "symbol": "boltons::iterutils::chunked_iter", + "lang": "python", + "tests_in_project": 468, + "failing": 2, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.042323248961364635, + "random_precision": 0.004273504273504274, + "recall": 1.0, + "precision": 0.034482758620689655, + "caught": 1.0, + "repo": "boltons" + }, + { + "symbol": "boltons::timeutils::decimal_relative_time", + "lang": "python", + "tests_in_project": 468, + "failing": 1, + "grep_recall": 1.0, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.021367521367521403, + "random_precision": 0.002136752136752137, + "recall": 1.0, + "precision": 0.058823529411764705, + "caught": 1.0, + "repo": "boltons" + }, + { + "symbol": "boltons::strutils::format_int_list", + "lang": "python", + "tests_in_project": 468, + "failing": 1, + "grep_recall": 1.0, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.021367521367521403, + "random_precision": 0.002136752136752137, + "recall": 1.0, + "precision": 0.03125, + "caught": 1.0, + "repo": "boltons" + }, + { + "symbol": "boltons::mathutils::Bits::as_hex", + "lang": "python", + "tests_in_project": 468, + "failing": 2, + "grep_recall": 1.0, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.042323248961364635, + "random_precision": 0.004273504273504274, + "recall": 1.0, + "precision": 0.125, + "caught": 1.0, + "repo": "boltons" + }, + { + "symbol": "boltons::cacheutils::ThresholdCounter::get_common_count", + "lang": "python", + "tests_in_project": 468, + "failing": 2, + "grep_recall": 0.5, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.042323248961364635, + "random_precision": 0.004273504273504274, + "recall": 1.0, + "precision": 0.07142857142857142, + "caught": 1.0, + "repo": "boltons" + }, + { + "symbol": "boltons::iterutils::is_iterable", + "lang": "python", + "tests_in_project": 468, + "failing": 7, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.1411687141069763, + "random_precision": 0.014957264957264958, + "recall": 1.0, + "precision": 0.6363636363636364, + "caught": 1.0, + "repo": "boltons" + }, + { + "symbol": "boltons::strutils::args2sh", + "lang": "python", + "tests_in_project": 468, + "failing": 1, + "grep_recall": 1.0, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.021367521367521403, + "random_precision": 0.002136752136752137, + "recall": 1.0, + "precision": 0.03125, + "caught": 1.0, + "repo": "boltons" + }, + { + "symbol": "boltons::strutils::asciify", + "lang": "python", + "tests_in_project": 468, + "failing": 1, + "grep_recall": 1.0, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.021367521367521403, + "random_precision": 0.002136752136752137, + "recall": 1.0, + "precision": 0.03125, + "caught": 1.0, + "repo": "boltons" + }, + { + "symbol": "boltons::iterutils::windowed", + "lang": "python", + "tests_in_project": 468, + "failing": 2, + "grep_recall": 0.5, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.042323248961364635, + "random_precision": 0.004273504273504274, + "recall": 1.0, + "precision": 0.034482758620689655, + "caught": 1.0, + "repo": "boltons" + }, + { + "symbol": "boltons::urlutils::parse_qsl", + "lang": "python", + "tests_in_project": 468, + "failing": 29, + "grep_recall": 0.034482758620689655, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.47593045872557194, + "random_precision": 0.06196581196581197, + "recall": 1.0, + "precision": 0.7631578947368421, + "caught": 1.0, + "repo": "boltons" + }, + { + "symbol": "boltons::formatutils::infer_positional_format_args", + "lang": "python", + "tests_in_project": 468, + "failing": 3, + "grep_recall": 0.6666666666666666, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.06287425220253706, + "random_precision": 0.00641025641025641, + "recall": 1.0, + "precision": 0.6, + "caught": 1.0, + "repo": "boltons" + }, + { + "symbol": "boltons::namedutils::namedtuple", + "lang": "python", + "tests_in_project": 468, + "failing": 8, + "grep_recall": 0.125, + "grep_precision": 0.5, + "grep_caught": 1.0, + "random_caught": 0.15979846000487274, + "random_precision": 0.017094017094017096, + "recall": 1.0, + "precision": 0.8888888888888888, + "caught": 1.0, + "repo": "boltons" + }, + { + "symbol": "boltons::tbutils::Callpoint::tb_frame_str", + "lang": "python", + "tests_in_project": 468, + "failing": 2, + "grep_recall": 0.5, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.042323248961364635, + "random_precision": 0.004273504273504274, + "recall": 1.0, + "precision": 1.0, + "caught": 1.0, + "repo": "boltons" + }, + { + "symbol": "boltons::tbutils::print_exception", + "lang": "python", + "tests_in_project": 468, + "failing": 1, + "grep_recall": 1.0, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.021367521367521403, + "random_precision": 0.002136752136752137, + "recall": 1.0, + "precision": 0.5, + "caught": 1.0, + "repo": "boltons" + }, + { + "symbol": "boltons::urlutils::quote_path_part", + "lang": "python", + "tests_in_project": 468, + "failing": 26, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.43859925819647305, + "random_precision": 0.05555555555555555, + "recall": 1.0, + "precision": 0.6842105263157895, + "caught": 1.0, + "repo": "boltons" + }, + { + "symbol": "boltons::mathutils::ceil", + "lang": "python", + "tests_in_project": 468, + "failing": 4, + "grep_recall": 1.0, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.08302749409065446, + "random_precision": 0.008547008547008548, + "recall": 1.0, + "precision": 0.5714285714285714, + "caught": 1.0, + "repo": "boltons" + }, + { + "symbol": "boltons::strutils::parse_int_list", + "lang": "python", + "tests_in_project": 468, + "failing": 1, + "grep_recall": 1.0, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.021367521367521403, + "random_precision": 0.002136752136752137, + "recall": 1.0, + "precision": 0.03125, + "caught": 1.0, + "repo": "boltons" + }, + { + "symbol": "boltons::mathutils::floor", + "lang": "python", + "tests_in_project": 468, + "failing": 4, + "grep_recall": 1.0, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.08302749409065446, + "random_precision": 0.008547008547008548, + "recall": 1.0, + "precision": 0.5714285714285714, + "caught": 1.0, + "repo": "boltons" + }, + { + "symbol": "boltons::tableutils::Table::to_html", + "lang": "python", + "tests_in_project": 468, + "failing": 2, + "grep_recall": 1.0, + "grep_precision": 0.5, + "grep_caught": 1.0, + "random_caught": 0.042323248961364635, + "random_precision": 0.004273504273504274, + "recall": 1.0, + "precision": 0.2, + "caught": 1.0, + "repo": "boltons" + }, + { + "symbol": "boltons::urlutils::parse_url", + "lang": "python", + "tests_in_project": 468, + "failing": 75, + "grep_recall": 0.013333333333333334, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.8288497494101232, + "random_precision": 0.16025641025641027, + "recall": 0.49333333333333335, + "precision": 0.9736842105263158, + "caught": 1.0, + "repo": "boltons" + }, + { + "symbol": "boltons::setutils::_ComplementSet::complemented", + "lang": "python", + "tests_in_project": 468, + "failing": 2, + "grep_recall": 0.5, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.042323248961364635, + "random_precision": 0.004273504273504274, + "recall": 1.0, + "precision": 0.10526315789473684, + "caught": 1.0, + "repo": "boltons" + }, + { + "symbol": "itertools::adaptors::checked_binomial", + "lang": "rust", + "tests_in_project": 370, + "failing": 15, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.3423502109791211, + "random_precision": 0.04054054054054054, + "recall": 0.0, + "precision": 0.0, + "caught": 0.0, + "repo": "itertools" + }, + { + "symbol": "itertools::lazy_buffer::LazyBuffer::get_at", + "lang": "rust", + "tests_in_project": 370, + "failing": 17, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.37892991994113234, + "random_precision": 0.04594594594594595, + "recall": 0.0, + "precision": 0.0, + "caught": 0.0, + "repo": "itertools" + }, + { + "symbol": "itertools::Itertools::strip_prefix_by", + "lang": "rust", + "tests_in_project": 370, + "failing": 4, + "grep_recall": 0.25, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.10420998146270555, + "random_precision": 0.010810810810810811, + "recall": 1.0, + "precision": 1.0, + "caught": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::Itertools::collect_vec", + "lang": "rust", + "tests_in_project": 370, + "failing": 18, + "grep_recall": 0.6666666666666666, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.3965239732005903, + "random_precision": 0.04864864864864865, + "recall": 0.6666666666666666, + "precision": 0.9230769230769231, + "caught": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::grouping_map::GroupingMap::fold_with", + "lang": "rust", + "tests_in_project": 370, + "failing": 2, + "grep_recall": 0.5, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.05339485827290702, + "random_precision": 0.005405405405405406, + "recall": 0.5, + "precision": 1.0, + "caught": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::Itertools::chunk_by", + "lang": "rust", + "tests_in_project": 370, + "failing": 8, + "grep_recall": 1.0, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.19854234961368167, + "random_precision": 0.021621621621621623, + "recall": 1.0, + "precision": 1.0, + "caught": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::extrema_set::max_set_impl", + "lang": "rust", + "tests_in_project": 370, + "failing": 4, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.10420998146270555, + "random_precision": 0.010810810810810811, + "recall": 1.0, + "precision": 1.0, + "caught": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::Itertools::next_tuple", + "lang": "rust", + "tests_in_project": 370, + "failing": 3, + "grep_recall": 0.3333333333333333, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.07911782408070844, + "random_precision": 0.008108108108108109, + "recall": 1.0, + "precision": 1.0, + "caught": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::next_array::ArrayBuilder::take", + "lang": "rust", + "tests_in_project": 370, + "failing": 9, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.22068206371275123, + "random_precision": 0.024324324324324326, + "recall": 0.3333333333333333, + "precision": 0.06818181818181818, + "caught": 0.0, + "repo": "itertools" + }, + { + "symbol": "itertools::grouping_map::GroupingMap::max_by", + "lang": "rust", + "tests_in_project": 370, + "failing": 4, + "grep_recall": 0.5, + "grep_precision": 0.6666666666666666, + "grep_caught": 1.0, + "random_caught": 0.10420998146270555, + "random_precision": 0.010810810810810811, + "recall": 1.0, + "precision": 0.4444444444444444, + "caught": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::groupbylazy::new_chunks", + "lang": "rust", + "tests_in_project": 370, + "failing": 2, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.05339485827290702, + "random_precision": 0.005405405405405406, + "recall": 1.0, + "precision": 0.2857142857142857, + "caught": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::k_smallest::key_to_cmp", + "lang": "rust", + "tests_in_project": 370, + "failing": 2, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.05339485827290702, + "random_precision": 0.005405405405405406, + "recall": 1.0, + "precision": 1.0, + "caught": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::size_hint::mul_scalar", + "lang": "rust", + "tests_in_project": 370, + "failing": 3, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.07911782408070844, + "random_precision": 0.008108108108108109, + "recall": 0.0, + "precision": 0.0, + "caught": 0.0, + "repo": "itertools" + }, + { + "symbol": "itertools::next_array::ArrayBuilder::push", + "lang": "rust", + "tests_in_project": 370, + "failing": 8, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.19854234961368167, + "random_precision": 0.021621621621621623, + "recall": 0.375, + "precision": 0.6, + "caught": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::extrema_set::min_set_impl", + "lang": "rust", + "tests_in_project": 370, + "failing": 7, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.1758381668831911, + "random_precision": 0.01891891891891892, + "recall": 1.0, + "precision": 1.0, + "caught": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::minmax::MinMaxResult::into_option", + "lang": "rust", + "tests_in_project": 370, + "failing": 1, + "grep_recall": 1.0, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.027027027027026973, + "random_precision": 0.002702702702702703, + "recall": 1.0, + "precision": 1.0, + "caught": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::grouping_map::GroupingMap::aggregate", + "lang": "rust", + "tests_in_project": 370, + "failing": 16, + "grep_recall": 0.0625, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.3608755571487233, + "random_precision": 0.043243243243243246, + "recall": 0.625, + "precision": 0.5555555555555556, + "caught": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::Itertools::k_smallest_relaxed", + "lang": "rust", + "tests_in_project": 370, + "failing": 9, + "grep_recall": 0.1111111111111111, + "grep_precision": 0.5, + "grep_caught": 1.0, + "random_caught": 0.22068206371275123, + "random_precision": 0.024324324324324326, + "recall": 0.1111111111111111, + "precision": 1.0, + "caught": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::grouping_map::GroupingMap::product", + "lang": "rust", + "tests_in_project": 370, + "failing": 1, + "grep_recall": 1.0, + "grep_precision": 0.3333333333333333, + "grep_caught": 1.0, + "random_caught": 0.027027027027026973, + "random_precision": 0.002702702702702703, + "recall": 1.0, + "precision": 0.1111111111111111, + "caught": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::Itertools::k_smallest_by", + "lang": "rust", + "tests_in_project": 370, + "failing": 9, + "grep_recall": 0.1111111111111111, + "grep_precision": 0.5, + "grep_caught": 1.0, + "random_caught": 0.22068206371275123, + "random_precision": 0.024324324324324326, + "recall": 0.1111111111111111, + "precision": 1.0, + "caught": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::Itertools::k_largest_relaxed_by", + "lang": "rust", + "tests_in_project": 370, + "failing": 1, + "grep_recall": 1.0, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.027027027027026973, + "random_precision": 0.002702702702702703, + "recall": 1.0, + "precision": 1.0, + "caught": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::minmax::minmax_impl", + "lang": "rust", + "tests_in_project": 370, + "failing": 5, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.1286851185812109, + "random_precision": 0.013513513513513514, + "recall": 0.0, + "precision": 0.0, + "caught": 0.0, + "repo": "itertools" + }, + { + "symbol": "itertools::heap::sift_down", + "lang": "rust", + "tests_in_project": 370, + "failing": 19, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.4136681785073917, + "random_precision": 0.051351351351351354, + "recall": 0.2631578947368421, + "precision": 1.0, + "caught": 1.0, + "repo": "itertools" + } + ] +} \ No newline at end of file diff --git a/eval/results/heldout.baselines.md b/eval/results/heldout.baselines.md new file mode 100644 index 0000000..88e1610 --- /dev/null +++ b/eval/results/heldout.baselines.md @@ -0,0 +1,41 @@ +# Baselines on the functions of the run `heldout` + +The search for the name: `git grep -w ` in the files of the language; every hit is put into the function around it (callers) or counted for the test whose body has it (tests). The truth is the run's own: the compiler's uses, the tests that fail when the function throws. ± is half of a 90% bootstrap interval over the functions. + +## Callers — names that occur once + +| | functions | search: recall | search: precision | gitnext: recall | gitnext: precision | +|---|---|---|---|---|---| +| all | 124 | 100% ±0 | 84% ±4 | 99% ±1 | 95% ±3 | +| go | 39 | 100% ±0 | 81% ±8 | 98% ±2 | 91% ±6 | +| rust | 46 | 100% ±0 | 76% ±7 | 100% ±0 | 94% ±5 | +| typescript | 39 | 100% ±0 | 96% ±4 | 100% ±0 | 100% ±0 | + +## Callers — methods that share a name + +| | functions | search: recall | search: precision | gitnext: recall | gitnext: precision | +|---|---|---|---|---|---| +| all | 108 | 100% ±0 | 51% ±5 | 73% ±7 | 99% ±2 | +| go | 90 | 100% ±0 | 53% ±5 | 70% ±7 | 99% ±2 | +| rust | 18 | 100% ±0 | 40% ±9 | 84% ±11 | 100% ±0 | + +## Callers — whether or not gitnext sees a caller + +| | functions | search: recall | search: precision | gitnext: recall | gitnext: precision | +|---|---|---|---|---|---| +| all | 103 | 100% ±0 | 85% ±4 | 87% ±6 | 94% ±4 | +| go | 30 | 100% ±0 | 87% ±7 | 84% ±11 | 89% ±9 | +| rust | 36 | 100% ±0 | 76% ±8 | 86% ±10 | 91% ±7 | +| typescript | 37 | 100% ±0 | 92% ±6 | 89% ±8 | 100% ±0 | + +## The tests of a function + +"Caught": at least one of the first 10 tests named fails when the function throws. "Ten at random": the chance of that for ten tests drawn from all tests of the project; their precision is the share of the project's tests that fail. + +| | functions | ten at random: caught | ten at random: precision | search: caught | search: recall | search: precision | gitnext: caught | gitnext: recall | gitnext: precision | +|---|---|---|---|---|---|---|---|---|---| +| all | 135 | 52% ±5 | 20% ±4 | 70% ±7 | 33% ±5 | 65% ±6 | 93% ±4 | 72% ±5 | 64% ±5 | +| go | 29 | 55% ±10 | 22% ±9 | 76% ±12 | 14% ±6 | 71% ±13 | 100% ±0 | 62% ±12 | 59% ±12 | +| rust | 34 | 33% ±8 | 5% ±2 | 62% ±15 | 41% ±12 | 54% ±13 | 85% ±10 | 73% ±11 | 68% ±11 | +| typescript | 28 | 98% ±2 | 36% ±7 | 71% ±14 | 38% ±12 | 71% ±14 | 100% ±0 | 82% ±6 | 93% ±5 | +| python | 44 | 37% ±10 | 21% ±9 | 70% ±11 | 37% ±11 | 66% ±11 | 89% ±8 | 70% ±10 | 45% ±9 | diff --git a/eval/results/heldout.codebase-memory.json b/eval/results/heldout.codebase-memory.json new file mode 100644 index 0000000..c1443a7 --- /dev/null +++ b/eval/results/heldout.codebase-memory.json @@ -0,0 +1,3302 @@ +{ + "callers": [ + { + "symbol": "main::FlagSet::Output", + "lang": "go", + "other_recall": 0.375, + "other_precision": 0.875, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::NewFlagSet", + "lang": "go", + "other_recall": null, + "other_precision": null, + "recall": null, + "precision": 0.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::FlagUsagesWrapped", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::GetNormalizeFunc", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::FlagUsages", + "lang": "go", + "other_recall": 0.0, + "other_precision": 0.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::AddGoFlag", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::PFlagFromGoFlag", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::VarPF", + "lang": "go", + "other_recall": 0.2, + "other_precision": 0.25, + "recall": 0.8, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::AddFlag", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::UnquoteUsage", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::ParseIPv4Mask", + "lang": "go", + "other_recall": 0.5, + "other_precision": 0.5, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::Router::NewRoute", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "mux" + }, + { + "symbol": "main::Route::Handler", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "mux" + }, + { + "symbol": "main::Route::GetMethods", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "mux" + }, + { + "symbol": "main::Route::HandlerFunc", + "lang": "go", + "other_recall": 1.0, + "other_precision": 0.3333333333333333, + "recall": 1.0, + "precision": 1.0, + "repo": "mux" + }, + { + "symbol": "main::Route::GetHandlerWithMiddlewares", + "lang": "go", + "other_recall": 0.0, + "other_precision": 0.0, + "recall": 1.0, + "precision": 1.0, + "repo": "mux" + }, + { + "symbol": "either::Either::as_pin_mut", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "either" + }, + { + "symbol": "either::Either::is_left", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "either" + }, + { + "symbol": "strsim::jaro", + "lang": "rust", + "other_recall": null, + "other_precision": null, + "recall": null, + "precision": null, + "repo": "strsim" + }, + { + "symbol": "strsim::damerau_levenshtein", + "lang": "rust", + "other_recall": null, + "other_precision": null, + "recall": null, + "precision": null, + "repo": "strsim" + }, + { + "symbol": "strsim::sorensen_dice", + "lang": "rust", + "other_recall": null, + "other_precision": null, + "recall": null, + "precision": null, + "repo": "strsim" + }, + { + "symbol": "strsim::levenshtein", + "lang": "rust", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "strsim" + }, + { + "symbol": "strsim::osa_distance", + "lang": "rust", + "other_recall": null, + "other_precision": null, + "recall": null, + "precision": null, + "repo": "strsim" + }, + { + "symbol": "strsim::generic_jaro_winkler", + "lang": "rust", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "strsim" + }, + { + "symbol": "strsim::normalized_damerau_levenshtein", + "lang": "rust", + "other_recall": null, + "other_precision": null, + "recall": null, + "precision": null, + "repo": "strsim" + }, + { + "symbol": "strsim::normalized_levenshtein", + "lang": "rust", + "other_recall": null, + "other_precision": null, + "recall": null, + "precision": null, + "repo": "strsim" + }, + { + "symbol": "strsim::hamming", + "lang": "rust", + "other_recall": null, + "other_precision": null, + "recall": null, + "precision": null, + "repo": "strsim" + }, + { + "symbol": "strsim::generic_hamming", + "lang": "rust", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "strsim" + }, + { + "symbol": "strsim::generic_levenshtein", + "lang": "rust", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "strsim" + }, + { + "symbol": "strsim::generic_jaro", + "lang": "rust", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "strsim" + }, + { + "symbol": "strsim::jaro_winkler", + "lang": "rust", + "other_recall": null, + "other_precision": null, + "recall": null, + "precision": null, + "repo": "strsim" + }, + { + "symbol": "src::encoding::encodeHost", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::query::stringifyQuery", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::parse::parsePath", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::utils::isNonEmptyURL", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::query::encodeQueryItem", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::utils::withProtocol", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::encoding::encode", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::encoding::encodeHash", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::encoding::decodeQueryKey", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::parse::parseURL", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::utils::withLeadingSlash", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::query::parseQuery", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::utils::isEmptyURL", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::utils::hasLeadingSlash", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::punycode::toASCII", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::utils::withoutTrailingSlash", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::utils::withTrailingSlash", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::parse::parseHost", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::encoding::decodePath", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::utils::joinURL", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::encoding::decode", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::encoding::decodeQueryValue", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::encoding::encodePath", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::utils::hasTrailingSlash", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::encoding::encodeQueryKey", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::utils::withoutLeadingSlash", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::parse::parseAuth", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::parse::stringifyParsedURL", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::utils::normalizeAliases", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pathe" + }, + { + "symbol": "src::_path::normalize", + "lang": "typescript", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "pathe" + }, + { + "symbol": "src::_path::isAbsolute", + "lang": "typescript", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "pathe" + }, + { + "symbol": "src::_path::join", + "lang": "typescript", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "pathe" + }, + { + "symbol": "src::_path::normalizeString", + "lang": "typescript", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "pathe" + }, + { + "symbol": "src::_path::extname", + "lang": "typescript", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "pathe" + }, + { + "symbol": "src::_internal::normalizeWindowsPath", + "lang": "typescript", + "other_recall": 0.2222222222222222, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pathe" + }, + { + "symbol": "src::_glob::matchGlob", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pathe" + }, + { + "symbol": "src::_path::basename", + "lang": "typescript", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "pathe" + }, + { + "symbol": "src::_path::resolve", + "lang": "typescript", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "pathe" + }, + { + "symbol": "src::_path::dirname", + "lang": "typescript", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "pathe" + }, + { + "symbol": "main::ValueSourceChain::LookupWithSource", + "lang": "go", + "other_recall": 0.0, + "other_precision": 0.0, + "recall": 1.0, + "precision": 1.0, + "repo": "urfave-cli" + }, + { + "symbol": "main::Command::VisibleFlags", + "lang": "go", + "other_recall": 1.0, + "other_precision": 0.25, + "recall": 1.0, + "precision": 0.25, + "repo": "urfave-cli" + }, + { + "symbol": "main::Exit", + "lang": "go", + "other_recall": 1.0, + "other_precision": 0.6666666666666666, + "recall": 1.0, + "precision": 1.0, + "repo": "urfave-cli" + }, + { + "symbol": "main::ShowVersion", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "urfave-cli" + }, + { + "symbol": "main::ValueSourceChain::EnvKeys", + "lang": "go", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "urfave-cli" + }, + { + "symbol": "main::Command::Walk", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "urfave-cli" + }, + { + "symbol": "main::Command::Path", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "urfave-cli" + }, + { + "symbol": "main::File", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "urfave-cli" + }, + { + "symbol": "main::Command::FullName", + "lang": "go", + "other_recall": 1.0, + "other_precision": 0.2, + "recall": 1.0, + "precision": 0.16666666666666666, + "repo": "urfave-cli" + }, + { + "symbol": "main::Command::Bool", + "lang": "go", + "other_recall": 0.75, + "other_precision": 1.0, + "recall": 0.75, + "precision": 1.0, + "repo": "urfave-cli" + }, + { + "symbol": "main::EnvVar", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "urfave-cli" + }, + { + "symbol": "main::Command::LocalFlagNames", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "urfave-cli" + }, + { + "symbol": "main::Command::VisiblePersistentFlags", + "lang": "go", + "other_recall": 1.0, + "other_precision": 0.6666666666666666, + "recall": 1.0, + "precision": 0.6666666666666666, + "repo": "urfave-cli" + }, + { + "symbol": "main::HandleExitCoder", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "urfave-cli" + }, + { + "symbol": "main::EnvVars", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "urfave-cli" + }, + { + "symbol": "main::DefaultCompleteWithFlags", + "lang": "go", + "other_recall": 0.5, + "other_precision": 1.0, + "recall": 0.5, + "precision": 1.0, + "repo": "urfave-cli" + }, + { + "symbol": "main::Command::Lineage", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "urfave-cli" + }, + { + "symbol": "main::Command::Root", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "urfave-cli" + }, + { + "symbol": "main::Logger::LogFn", + "lang": "go", + "other_recall": 0.0, + "other_precision": 0.0, + "recall": 1.0, + "precision": 1.0, + "repo": "logrus" + }, + { + "symbol": "main::mutexWrap::Lock", + "lang": "go", + "other_recall": 0.45454545454545453, + "other_precision": 0.45454545454545453, + "recall": 1.0, + "precision": 1.0, + "repo": "logrus" + }, + { + "symbol": "main::mutexWrap::Unlock", + "lang": "go", + "other_recall": 0.45454545454545453, + "other_precision": 0.45454545454545453, + "recall": 1.0, + "precision": 1.0, + "repo": "logrus" + }, + { + "symbol": "main::Entry::Bytes", + "lang": "go", + "other_recall": 1.0, + "other_precision": 0.6666666666666666, + "recall": 1.0, + "precision": 0.5, + "repo": "logrus" + }, + { + "symbol": "main::mutexWrap::Disable", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "logrus" + }, + { + "symbol": "main::NewEntry", + "lang": "go", + "other_recall": 0.5, + "other_precision": 0.5, + "recall": 1.0, + "precision": 1.0, + "repo": "logrus" + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::or_default", + "lang": "rust", + "other_recall": 0.0, + "other_precision": 0.0, + "recall": 1.0, + "precision": 0.3333333333333333, + "repo": "itertools" + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::both", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::adaptors::checked_binomial", + "lang": "rust", + "other_recall": 0.75, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::map_any", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::lazy_buffer::LazyBuffer::get_at", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::Itertools::strip_prefix_by", + "lang": "rust", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::Itertools::collect_vec", + "lang": "rust", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::grouping_map::GroupingMap::fold_with", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::Itertools::chunk_by", + "lang": "rust", + "other_recall": 1.0, + "other_precision": 0.5, + "recall": 1.0, + "precision": 0.5, + "repo": "itertools" + }, + { + "symbol": "itertools::extrema_set::max_set_impl", + "lang": "rust", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::Itertools::next_tuple", + "lang": "rust", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::adaptors::PutBack::with_value", + "lang": "rust", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::Itertools::position_max", + "lang": "rust", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::extrema_set::min_set_impl", + "lang": "rust", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::right_or_insert_with", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::Itertools::position_min", + "lang": "rust", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::Itertools::position_minmax", + "lang": "rust", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::next_array::ArrayBuilder::take", + "lang": "rust", + "other_recall": 1.0, + "other_precision": 0.16666666666666666, + "recall": 1.0, + "precision": 0.03125, + "repo": "itertools" + }, + { + "symbol": "itertools::grouping_map::GroupingMap::max_by", + "lang": "rust", + "other_recall": 0.0, + "other_precision": 0.0, + "recall": 1.0, + "precision": 0.5, + "repo": "itertools" + }, + { + "symbol": "itertools::groupbylazy::new_chunks", + "lang": "rust", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::k_smallest::key_to_cmp", + "lang": "rust", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::size_hint::mul_scalar", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::next_array::ArrayBuilder::push", + "lang": "rust", + "other_recall": 1.0, + "other_precision": 0.25, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::Itertools::partition_map", + "lang": "rust", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::heap::heapify", + "lang": "rust", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::lazy_buffer::LazyBuffer::get_next", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::size_hint::add_scalar", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::Itertools::all_unique_with_hasher", + "lang": "rust", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::as_ref", + "lang": "rust", + "other_recall": 0.0, + "other_precision": 0.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::grouping_map::GroupingMap::aggregate", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::insert_right", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::Itertools::k_smallest_by", + "lang": "rust", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::Itertools::k_largest_relaxed_by", + "lang": "rust", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::minmax::minmax_impl", + "lang": "rust", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::heap::sift_down", + "lang": "rust", + "other_recall": 0.6666666666666666, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::combinations::Combinations::reset", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::k_smallest::k_smallest_general", + "lang": "rust", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::grouping_map::new_map_for_grouping", + "lang": "rust", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::left_or_insert_with", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + } + ], + "callers_common": [ + { + "symbol": "main::FlagSet::StringToIntVarP", + "lang": "go", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::BoolVarP", + "lang": "go", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::StringArrayVarP", + "lang": "go", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::IPNetSliceVarP", + "lang": "go", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::StringSliceVarP", + "lang": "go", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::Uint16VarP", + "lang": "go", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::Lookup", + "lang": "go", + "other_recall": 0.0, + "other_precision": null, + "recall": 0.9, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::Float32VarP", + "lang": "go", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::StringToInt64VarP", + "lang": "go", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::Uint64VarP", + "lang": "go", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::Uint32VarP", + "lang": "go", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::DurationSliceVarP", + "lang": "go", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::Float64SliceVarP", + "lang": "go", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::Parse", + "lang": "go", + "other_recall": 0.0, + "other_precision": null, + "recall": 0.0, + "precision": 0.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::BoolP", + "lang": "go", + "other_recall": 0.0, + "other_precision": null, + "recall": 0.5, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::IntVarP", + "lang": "go", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::IPNetVarP", + "lang": "go", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::IPVarP", + "lang": "go", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::BytesBase64VarP", + "lang": "go", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::StringToStringVarP", + "lang": "go", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::Int64VarP", + "lang": "go", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::DurationVarP", + "lang": "go", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::Int16VarP", + "lang": "go", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::StringVarP", + "lang": "go", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::UintSliceVarP", + "lang": "go", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::TimeVarP", + "lang": "go", + "other_recall": 0.0, + "other_precision": null, + "recall": 0.6666666666666666, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::Int8VarP", + "lang": "go", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::VarP", + "lang": "go", + "other_recall": 0.0, + "other_precision": null, + "recall": 0.5, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::Float32SliceVarP", + "lang": "go", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::TimeP", + "lang": "go", + "other_recall": 0.0, + "other_precision": null, + "recall": 0.3333333333333333, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::BoolSliceVarP", + "lang": "go", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::UintVarP", + "lang": "go", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::IPSliceVarP", + "lang": "go", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::PrintDefaults", + "lang": "go", + "other_recall": 0.0, + "other_precision": null, + "recall": 0.5, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::Route::Path", + "lang": "go", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "mux" + }, + { + "symbol": "main::Route::Schemes", + "lang": "go", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "mux" + }, + { + "symbol": "main::Route::Host", + "lang": "go", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "mux" + }, + { + "symbol": "main::Route::Headers", + "lang": "go", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "mux" + }, + { + "symbol": "main::Route::BuildVarsFunc", + "lang": "go", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "mux" + }, + { + "symbol": "main::Route::Queries", + "lang": "go", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "mux" + }, + { + "symbol": "main::Route::PathPrefix", + "lang": "go", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "mux" + }, + { + "symbol": "main::Route::Name", + "lang": "go", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "mux" + }, + { + "symbol": "main::Route::MatcherFunc", + "lang": "go", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "mux" + }, + { + "symbol": "main::Route::Methods", + "lang": "go", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "mux" + }, + { + "symbol": "byteorder::io::ReadBytesExt::read_f64_into", + "lang": "rust", + "other_recall": 0.3333333333333333, + "other_precision": 1.0, + "recall": 0.3333333333333333, + "precision": 1.0, + "repo": "byteorder" + }, + { + "symbol": "byteorder::ByteOrder::read_f32_into", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "byteorder" + }, + { + "symbol": "byteorder::ByteOrder::read_int", + "lang": "rust", + "other_recall": 0.3333333333333333, + "other_precision": 1.0, + "recall": 0.6666666666666666, + "precision": 1.0, + "repo": "byteorder" + }, + { + "symbol": "byteorder::ByteOrder::write_int", + "lang": "rust", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 0.6666666666666666, + "precision": 1.0, + "repo": "byteorder" + }, + { + "symbol": "byteorder::ByteOrder::read_f64_into", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "byteorder" + }, + { + "symbol": "main::commandCategory::Name", + "lang": "go", + "other_recall": 0.0, + "other_precision": null, + "recall": 0.0, + "precision": null, + "repo": "urfave-cli" + }, + { + "symbol": "main::Command::HasName", + "lang": "go", + "other_recall": 0.0, + "other_precision": null, + "recall": 0.0, + "precision": null, + "repo": "urfave-cli" + }, + { + "symbol": "main::extFlag::IsBoolFlag", + "lang": "go", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "urfave-cli" + }, + { + "symbol": "main::MapBase::Value", + "lang": "go", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "urfave-cli" + }, + { + "symbol": "main::FlagBase::PreParse", + "lang": "go", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "urfave-cli" + }, + { + "symbol": "main::Entry::Logln", + "lang": "go", + "other_recall": 0.8571428571428571, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "logrus" + }, + { + "symbol": "main::Entry::WriterLevel", + "lang": "go", + "other_recall": 0.5, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "logrus" + }, + { + "symbol": "main::Logger::Panicln", + "lang": "go", + "other_recall": 0.0, + "other_precision": null, + "recall": 0.0, + "precision": null, + "repo": "logrus" + }, + { + "symbol": "main::Logger::Infoln", + "lang": "go", + "other_recall": 0.0, + "other_precision": null, + "recall": 0.0, + "precision": null, + "repo": "logrus" + }, + { + "symbol": "main::Logger::Errorln", + "lang": "go", + "other_recall": 0.0, + "other_precision": null, + "recall": 0.0, + "precision": null, + "repo": "logrus" + }, + { + "symbol": "main::Entry::WithError", + "lang": "go", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "logrus" + }, + { + "symbol": "main::Entry::Errorf", + "lang": "go", + "other_recall": 1.0, + "other_precision": 0.3333333333333333, + "recall": 1.0, + "precision": 1.0, + "repo": "logrus" + }, + { + "symbol": "main::Entry::String", + "lang": "go", + "other_recall": 1.0, + "other_precision": 0.16666666666666666, + "recall": 1.0, + "precision": 1.0, + "repo": "logrus" + }, + { + "symbol": "main::Logger::Info", + "lang": "go", + "other_recall": 0.0, + "other_precision": null, + "recall": 0.0, + "precision": null, + "repo": "logrus" + }, + { + "symbol": "main::Logger::FatalFn", + "lang": "go", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "logrus" + }, + { + "symbol": "main::Entry::Panicf", + "lang": "go", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "logrus" + }, + { + "symbol": "main::Logger::Logf", + "lang": "go", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "logrus" + }, + { + "symbol": "main::Logger::WithField", + "lang": "go", + "other_recall": 0.0, + "other_precision": null, + "recall": 0.0, + "precision": null, + "repo": "logrus" + }, + { + "symbol": "main::Logger::Println", + "lang": "go", + "other_recall": 0.0, + "other_precision": null, + "recall": 0.0, + "precision": null, + "repo": "logrus" + }, + { + "symbol": "main::Logger::WithContext", + "lang": "go", + "other_recall": 0.0, + "other_precision": null, + "recall": 0.0, + "precision": null, + "repo": "logrus" + }, + { + "symbol": "main::Logger::Debugf", + "lang": "go", + "other_recall": 0.0, + "other_precision": null, + "recall": 0.0, + "precision": null, + "repo": "logrus" + }, + { + "symbol": "main::Logger::PrintFn", + "lang": "go", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "logrus" + }, + { + "symbol": "main::Entry::Debug", + "lang": "go", + "other_recall": 0.0, + "other_precision": 0.0, + "recall": 0.0, + "precision": null, + "repo": "logrus" + }, + { + "symbol": "main::Logger::Error", + "lang": "go", + "other_recall": 0.0, + "other_precision": null, + "recall": 0.0, + "precision": null, + "repo": "logrus" + }, + { + "symbol": "main::Entry::Warnln", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "logrus" + }, + { + "symbol": "main::Logger::Fatalf", + "lang": "go", + "other_recall": 0.0, + "other_precision": null, + "recall": 0.0, + "precision": null, + "repo": "logrus" + }, + { + "symbol": "main::Logger::DebugFn", + "lang": "go", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "logrus" + }, + { + "symbol": "main::Logger::Warnf", + "lang": "go", + "other_recall": 0.0, + "other_precision": null, + "recall": 0.5, + "precision": 1.0, + "repo": "logrus" + }, + { + "symbol": "main::Logger::Printf", + "lang": "go", + "other_recall": 0.0, + "other_precision": null, + "recall": 0.0, + "precision": null, + "repo": "logrus" + }, + { + "symbol": "main::Logger::IsLevelEnabled", + "lang": "go", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "logrus" + }, + { + "symbol": "main::Logger::WithFields", + "lang": "go", + "other_recall": 0.0, + "other_precision": null, + "recall": 0.0, + "precision": null, + "repo": "logrus" + }, + { + "symbol": "main::Logger::Trace", + "lang": "go", + "other_recall": 0.0, + "other_precision": null, + "recall": 0.0, + "precision": null, + "repo": "logrus" + }, + { + "symbol": "main::Logger::Traceln", + "lang": "go", + "other_recall": 0.0, + "other_precision": null, + "recall": 0.0, + "precision": null, + "repo": "logrus" + }, + { + "symbol": "main::Logger::SetOutput", + "lang": "go", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "logrus" + }, + { + "symbol": "main::Logger::GetLevel", + "lang": "go", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "logrus" + }, + { + "symbol": "main::Entry::Printf", + "lang": "go", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "logrus" + }, + { + "symbol": "main::Logger::WriterLevel", + "lang": "go", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "logrus" + }, + { + "symbol": "main::Logger::Panic", + "lang": "go", + "other_recall": 0.0, + "other_precision": null, + "recall": 0.0, + "precision": null, + "repo": "logrus" + }, + { + "symbol": "main::Logger::Infof", + "lang": "go", + "other_recall": 0.0, + "other_precision": null, + "recall": 0.0, + "precision": null, + "repo": "logrus" + }, + { + "symbol": "main::Logger::Warnln", + "lang": "go", + "other_recall": 0.0, + "other_precision": null, + "recall": 0.5, + "precision": 1.0, + "repo": "logrus" + }, + { + "symbol": "main::Entry::Info", + "lang": "go", + "other_recall": 0.5, + "other_precision": 0.5, + "recall": 0.5, + "precision": 1.0, + "repo": "logrus" + }, + { + "symbol": "main::Logger::PanicFn", + "lang": "go", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "logrus" + }, + { + "symbol": "main::Logger::Fatal", + "lang": "go", + "other_recall": 0.0, + "other_precision": null, + "recall": 0.0, + "precision": null, + "repo": "logrus" + }, + { + "symbol": "main::Level::String", + "lang": "go", + "other_recall": 0.0, + "other_precision": null, + "recall": 0.5, + "precision": 1.0, + "repo": "logrus" + }, + { + "symbol": "hooks::slog::SlogLevel::Level", + "lang": "go", + "other_recall": 1.0, + "other_precision": 0.5, + "recall": 0.0, + "precision": null, + "repo": "logrus" + }, + { + "symbol": "main::Entry::WithFields", + "lang": "go", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "logrus" + }, + { + "symbol": "itertools::Itertools::next_array", + "lang": "rust", + "other_recall": 0.5, + "other_precision": 1.0, + "recall": 0.5, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::adaptors::PutBack::put_back", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::Itertools::sorted", + "lang": "rust", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::Itertools::minmax_by", + "lang": "rust", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 0.0, + "precision": null, + "repo": "itertools" + }, + { + "symbol": "itertools::peek_nth::PeekNth::peek_nth", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::Itertools::intersperse", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::Itertools::intersperse_with", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::multipeek_impl::MultiPeek::peek", + "lang": "rust", + "other_recall": 0.0, + "other_precision": 0.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::Itertools::sorted_unstable", + "lang": "rust", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::peek_nth::PeekNth::peek", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::grouping_map::GroupingMap::minmax_by", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::put_back_n_impl::PutBackN::put_back", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::grouping_map::GroupingMap::reduce", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + } + ], + "callers_blind": [ + { + "symbol": "main::FlagSet::Output", + "lang": "go", + "other_recall": 0.375, + "other_precision": 0.875, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::NewFlagSet", + "lang": "go", + "other_recall": null, + "other_precision": null, + "recall": null, + "precision": 0.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::FlagUsagesWrapped", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::GetNormalizeFunc", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::AddFlag", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::UnquoteUsage", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::PFlagFromGoFlag", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::AddGoFlag", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::VarPF", + "lang": "go", + "other_recall": 0.2, + "other_precision": 0.25, + "recall": 0.8, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::Router::NewRoute", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "mux" + }, + { + "symbol": "main::Route::GetMethods", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "mux" + }, + { + "symbol": "main::Route::GetHandlerWithMiddlewares", + "lang": "go", + "other_recall": 0.0, + "other_precision": 0.0, + "recall": 1.0, + "precision": 1.0, + "repo": "mux" + }, + { + "symbol": "byteorder::ByteOrder::from_slice_i64", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 0.0, + "precision": null, + "repo": "byteorder" + }, + { + "symbol": "byteorder::ByteOrder::write_i32_into", + "lang": "rust", + "other_recall": null, + "other_precision": null, + "recall": null, + "precision": null, + "repo": "byteorder" + }, + { + "symbol": "byteorder::ByteOrder::write_i128_into", + "lang": "rust", + "other_recall": null, + "other_precision": null, + "recall": null, + "precision": null, + "repo": "byteorder" + }, + { + "symbol": "byteorder::ByteOrder::from_slice_i32", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 0.0, + "precision": null, + "repo": "byteorder" + }, + { + "symbol": "byteorder::ByteOrder::write_f64_into", + "lang": "rust", + "other_recall": null, + "other_precision": null, + "recall": null, + "precision": null, + "repo": "byteorder" + }, + { + "symbol": "byteorder::ByteOrder::from_slice_i16", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 0.0, + "precision": null, + "repo": "byteorder" + }, + { + "symbol": "byteorder::ByteOrder::write_i64_into", + "lang": "rust", + "other_recall": null, + "other_precision": null, + "recall": null, + "precision": null, + "repo": "byteorder" + }, + { + "symbol": "byteorder::ByteOrder::from_slice_i128", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 0.0, + "precision": null, + "repo": "byteorder" + }, + { + "symbol": "byteorder::ByteOrder::write_i16_into", + "lang": "rust", + "other_recall": null, + "other_precision": null, + "recall": null, + "precision": null, + "repo": "byteorder" + }, + { + "symbol": "byteorder::ByteOrder::write_f32_into", + "lang": "rust", + "other_recall": null, + "other_precision": null, + "recall": null, + "precision": null, + "repo": "byteorder" + }, + { + "symbol": "either::Either::as_pin_mut", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "either" + }, + { + "symbol": "either::Either::right", + "lang": "rust", + "other_recall": null, + "other_precision": null, + "recall": null, + "precision": null, + "repo": "either" + }, + { + "symbol": "strsim::jaro", + "lang": "rust", + "other_recall": null, + "other_precision": null, + "recall": null, + "precision": null, + "repo": "strsim" + }, + { + "symbol": "strsim::damerau_levenshtein", + "lang": "rust", + "other_recall": null, + "other_precision": null, + "recall": null, + "precision": null, + "repo": "strsim" + }, + { + "symbol": "strsim::sorensen_dice", + "lang": "rust", + "other_recall": null, + "other_precision": null, + "recall": null, + "precision": null, + "repo": "strsim" + }, + { + "symbol": "strsim::levenshtein", + "lang": "rust", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "strsim" + }, + { + "symbol": "strsim::osa_distance", + "lang": "rust", + "other_recall": null, + "other_precision": null, + "recall": null, + "precision": null, + "repo": "strsim" + }, + { + "symbol": "strsim::generic_jaro_winkler", + "lang": "rust", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "strsim" + }, + { + "symbol": "strsim::normalized_damerau_levenshtein", + "lang": "rust", + "other_recall": null, + "other_precision": null, + "recall": null, + "precision": null, + "repo": "strsim" + }, + { + "symbol": "strsim::normalized_levenshtein", + "lang": "rust", + "other_recall": null, + "other_precision": null, + "recall": null, + "precision": null, + "repo": "strsim" + }, + { + "symbol": "strsim::hamming", + "lang": "rust", + "other_recall": null, + "other_precision": null, + "recall": null, + "precision": null, + "repo": "strsim" + }, + { + "symbol": "strsim::generic_hamming", + "lang": "rust", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "strsim" + }, + { + "symbol": "strsim::generic_levenshtein", + "lang": "rust", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "strsim" + }, + { + "symbol": "strsim::generic_jaro", + "lang": "rust", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "strsim" + }, + { + "symbol": "strsim::jaro_winkler", + "lang": "rust", + "other_recall": null, + "other_precision": null, + "recall": null, + "precision": null, + "repo": "strsim" + }, + { + "symbol": "src::encoding::encodeHost", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::query::stringifyQuery", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::parse::parsePath", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::url::$URL::href", + "lang": "typescript", + "other_recall": 0.0, + "other_precision": null, + "recall": 0.0, + "precision": null, + "repo": "ufo" + }, + { + "symbol": "src::utils::isNonEmptyURL", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::query::encodeQueryItem", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::utils::withProtocol", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::encoding::encode", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::encoding::encodeHash", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::encoding::decodeQueryKey", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::parse::parseURL", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::utils::withLeadingSlash", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::encoding::decode", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::utils::withoutTrailingSlash", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::encoding::decodeQueryValue", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::encoding::encodePath", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::query::parseQuery", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::encoding::decodePath", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::utils::withTrailingSlash", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::url::$URL::encodedAuth", + "lang": "typescript", + "other_recall": 0.0, + "other_precision": null, + "recall": 0.0, + "precision": null, + "repo": "ufo" + }, + { + "symbol": "src::utils::hasTrailingSlash", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::url::$URL::isAbsolute", + "lang": "typescript", + "other_recall": 0.0, + "other_precision": null, + "recall": 0.0, + "precision": null, + "repo": "ufo" + }, + { + "symbol": "src::url::$URL::search", + "lang": "typescript", + "other_recall": 0.0, + "other_precision": null, + "recall": 0.0, + "precision": null, + "repo": "ufo" + }, + { + "symbol": "src::utils::joinURL", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::parse::parseHost", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::utils::withoutLeadingSlash", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::utils::normalizeAliases", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pathe" + }, + { + "symbol": "src::_path::normalize", + "lang": "typescript", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "pathe" + }, + { + "symbol": "src::_path::isAbsolute", + "lang": "typescript", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "pathe" + }, + { + "symbol": "src::_path::join", + "lang": "typescript", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "pathe" + }, + { + "symbol": "src::_path::normalizeString", + "lang": "typescript", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "pathe" + }, + { + "symbol": "src::_path::extname", + "lang": "typescript", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "pathe" + }, + { + "symbol": "src::_internal::normalizeWindowsPath", + "lang": "typescript", + "other_recall": 0.2222222222222222, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pathe" + }, + { + "symbol": "src::_glob::matchGlob", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pathe" + }, + { + "symbol": "src::_path::basename", + "lang": "typescript", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "pathe" + }, + { + "symbol": "src::_path::resolve", + "lang": "typescript", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "pathe" + }, + { + "symbol": "src::_path::dirname", + "lang": "typescript", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "pathe" + }, + { + "symbol": "main::ValueSourceChain::LookupWithSource", + "lang": "go", + "other_recall": 0.0, + "other_precision": 0.0, + "recall": 1.0, + "precision": 1.0, + "repo": "urfave-cli" + }, + { + "symbol": "main::DefaultShowCommandHelp", + "lang": "go", + "other_recall": null, + "other_precision": 1.0, + "recall": null, + "precision": null, + "repo": "urfave-cli" + }, + { + "symbol": "main::Command::VisibleFlags", + "lang": "go", + "other_recall": 1.0, + "other_precision": 0.25, + "recall": 1.0, + "precision": 0.25, + "repo": "urfave-cli" + }, + { + "symbol": "main::Exit", + "lang": "go", + "other_recall": 1.0, + "other_precision": 0.6666666666666666, + "recall": 1.0, + "precision": 1.0, + "repo": "urfave-cli" + }, + { + "symbol": "main::DefaultPrintVersion", + "lang": "go", + "other_recall": null, + "other_precision": 1.0, + "recall": null, + "precision": null, + "repo": "urfave-cli" + }, + { + "symbol": "scripts::LintActionFunc", + "lang": "go", + "other_recall": 0.0, + "other_precision": null, + "recall": 0.0, + "precision": null, + "repo": "urfave-cli" + }, + { + "symbol": "scripts::SetMkdocsRemoteActionFunc", + "lang": "go", + "other_recall": 0.0, + "other_precision": null, + "recall": 0.0, + "precision": null, + "repo": "urfave-cli" + }, + { + "symbol": "main::DefaultCompleteWithFlags", + "lang": "go", + "other_recall": 0.5, + "other_precision": 1.0, + "recall": 0.5, + "precision": 1.0, + "repo": "urfave-cli" + }, + { + "symbol": "main::DefaultShowRootCommandHelp", + "lang": "go", + "other_recall": null, + "other_precision": 1.0, + "recall": null, + "precision": null, + "repo": "urfave-cli" + }, + { + "symbol": "main::Command::Walk", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "urfave-cli" + }, + { + "symbol": "main::Command::Lineage", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "urfave-cli" + }, + { + "symbol": "scripts::V3Diff", + "lang": "go", + "other_recall": 0.0, + "other_precision": null, + "recall": 0.0, + "precision": null, + "repo": "urfave-cli" + }, + { + "symbol": "main::Command::FullName", + "lang": "go", + "other_recall": 1.0, + "other_precision": 0.2, + "recall": 1.0, + "precision": 0.16666666666666666, + "repo": "urfave-cli" + }, + { + "symbol": "main::EnvVars", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "urfave-cli" + }, + { + "symbol": "main::ShowRootCommandHelpAndExit", + "lang": "go", + "other_recall": null, + "other_precision": null, + "recall": null, + "precision": null, + "repo": "urfave-cli" + }, + { + "symbol": "scripts::EnsureGoimportsActionFunc", + "lang": "go", + "other_recall": 0.0, + "other_precision": null, + "recall": 0.0, + "precision": null, + "repo": "urfave-cli" + }, + { + "symbol": "main::NewSliceBase", + "lang": "go", + "other_recall": null, + "other_precision": null, + "recall": null, + "precision": null, + "repo": "urfave-cli" + }, + { + "symbol": "main::ValueSourceChain::EnvKeys", + "lang": "go", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "urfave-cli" + }, + { + "symbol": "main::Logger::LogFn", + "lang": "go", + "other_recall": 0.0, + "other_precision": 0.0, + "recall": 1.0, + "precision": 1.0, + "repo": "logrus" + }, + { + "symbol": "main::mutexWrap::Lock", + "lang": "go", + "other_recall": 0.45454545454545453, + "other_precision": 0.45454545454545453, + "recall": 1.0, + "precision": 1.0, + "repo": "logrus" + }, + { + "symbol": "main::mutexWrap::Unlock", + "lang": "go", + "other_recall": 0.45454545454545453, + "other_precision": 0.45454545454545453, + "recall": 1.0, + "precision": 1.0, + "repo": "logrus" + }, + { + "symbol": "main::Entry::Bytes", + "lang": "go", + "other_recall": 1.0, + "other_precision": 0.6666666666666666, + "recall": 1.0, + "precision": 0.5, + "repo": "logrus" + }, + { + "symbol": "main::mutexWrap::Disable", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "logrus" + }, + { + "symbol": "main::NewEntry", + "lang": "go", + "other_recall": 0.5, + "other_precision": 0.5, + "recall": 1.0, + "precision": 1.0, + "repo": "logrus" + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::or_default", + "lang": "rust", + "other_recall": 0.0, + "other_precision": 0.0, + "recall": 1.0, + "precision": 0.3333333333333333, + "repo": "itertools" + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::both", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::adaptors::checked_binomial", + "lang": "rust", + "other_recall": 0.75, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::map_any", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::lazy_buffer::LazyBuffer::get_at", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::Itertools::strip_prefix_by", + "lang": "rust", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::Itertools::collect_vec", + "lang": "rust", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::grouping_map::GroupingMap::fold_with", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::Itertools::chunk_by", + "lang": "rust", + "other_recall": 1.0, + "other_precision": 0.5, + "recall": 1.0, + "precision": 0.5, + "repo": "itertools" + }, + { + "symbol": "itertools::repeatn::repeat_n", + "lang": "rust", + "other_recall": null, + "other_precision": null, + "recall": null, + "precision": null, + "repo": "itertools" + }, + { + "symbol": "itertools::next_array::ArrayBuilder::take", + "lang": "rust", + "other_recall": 1.0, + "other_precision": 0.16666666666666666, + "recall": 1.0, + "precision": 0.03125, + "repo": "itertools" + }, + { + "symbol": "itertools::grouping_map::GroupingMap::max_by", + "lang": "rust", + "other_recall": 0.0, + "other_precision": 0.0, + "recall": 1.0, + "precision": 0.5, + "repo": "itertools" + }, + { + "symbol": "itertools::groupbylazy::new_chunks", + "lang": "rust", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::k_smallest::key_to_cmp", + "lang": "rust", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::size_hint::mul_scalar", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::next_array::ArrayBuilder::push", + "lang": "rust", + "other_recall": 1.0, + "other_precision": 0.25, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::extrema_set::min_set_impl", + "lang": "rust", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::Itertools::partition_map", + "lang": "rust", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::heap::heapify", + "lang": "rust", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::grouping_map::GroupingMap::aggregate", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::insert_right", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::right_or_insert_with", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::Itertools::k_smallest_by", + "lang": "rust", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::as_ref", + "lang": "rust", + "other_recall": 0.0, + "other_precision": 0.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::tuple_impl::TupleCollect::buffer_len", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 0.0, + "precision": null, + "repo": "itertools" + }, + { + "symbol": "itertools::Itertools::k_largest_relaxed_by", + "lang": "rust", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::minmax::minmax_impl", + "lang": "rust", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + } + ] +} \ No newline at end of file diff --git a/eval/results/heldout.codebase-memory.md b/eval/results/heldout.codebase-memory.md new file mode 100644 index 0000000..16d6455 --- /dev/null +++ b/eval/results/heldout.codebase-memory.md @@ -0,0 +1,29 @@ +# Codebase-Memory on the functions of the run `heldout` + +`codebase-memory-mcp 0.12.1`. Its `CALLS` edges into each sampled function against the compiler's uses, next to gitnext on the same functions. ± is half of a 90% bootstrap interval over the functions; precision is over the functions for which the tool names a caller. + +## Callers — names that occur once + +| | functions | Codebase-Memory: recall | Codebase-Memory: precision | gitnext: recall | gitnext: precision | +|---|---|---|---|---|---| +| all | 124 | 71% ±6 | 85% ±5 | 99% ±1 | 95% ±3 | +| go | 39 | 76% ±9 | 73% ±10 | 98% ±2 | 91% ±6 | +| rust | 46 | 62% ±12 | 84% ±10 | 100% ±0 | 94% ±5 | +| typescript | 39 | 77% ±11 | 100% ±0 | 100% ±0 | 100% ±0 | + +## Callers — methods that share a name + +| | functions | Codebase-Memory: recall | Codebase-Memory: precision | gitnext: recall | gitnext: precision | +|---|---|---|---|---|---| +| all | 108 | 10% ±5 | 72% ±16 | 73% ±7 | 99% ±2 | +| go | 90 | 7% ±4 | 56% ±21 | 70% ±7 | 99% ±2 | +| rust | 18 | 29% ±16 | 88% ±19 | 84% ±11 | 100% ±0 | + +## Callers — whether or not gitnext sees a caller + +| | functions | Codebase-Memory: recall | Codebase-Memory: precision | gitnext: recall | gitnext: precision | +|---|---|---|---|---|---| +| all | 103 | 60% ±8 | 83% ±6 | 87% ±6 | 94% ±4 | +| go | 30 | 62% ±13 | 73% ±12 | 84% ±11 | 89% ±9 | +| rust | 36 | 52% ±14 | 77% ±14 | 86% ±10 | 91% ±7 | +| typescript | 37 | 65% ±13 | 100% ±0 | 89% ±8 | 100% ±0 | diff --git a/eval/results/heldout.json b/eval/results/heldout.json new file mode 100644 index 0000000..bb19ed9 --- /dev/null +++ b/eval/results/heldout.json @@ -0,0 +1,19160 @@ +[ + { + "repo": "pflag", + "lang": "go", + "commit": "046b0d889369", + "index_seconds": 0.1, + "symbols": 756, + "files": 44, + "seeds": [ + 7, + 8, + 9 + ], + "edges": 4738, + "sample": [ + "main::FlagSet::Output", + "main::NewFlagSet", + "main::FlagSet::FlagUsagesWrapped", + "main::FlagSet::GetNormalizeFunc", + "main::FlagSet::FlagUsages", + "main::FlagSet::AddGoFlag", + "main::PFlagFromGoFlag", + "main::FlagSet::VarPF", + "main::FlagSet::AddFlag", + "main::UnquoteUsage", + "main::ParseIPv4Mask" + ], + "sample_common": [ + "main::FlagSet::StringToIntVarP", + "main::FlagSet::BoolVarP", + "main::FlagSet::StringArrayVarP", + "main::FlagSet::IPNetSliceVarP", + "main::InvalidValueError::Error", + "main::FlagSet::StringSliceVarP", + "main::FlagSet::Uint16VarP", + "main::FlagSet::IntVar", + "main::FlagSet::Lookup", + "main::FlagSet::Float32VarP", + "main::FlagSet::Int64Var", + "main::FlagSet::StringToInt64VarP", + "main::FlagSet::Uint64VarP", + "main::FlagSet::Uint64Var", + "main::FlagSet::Uint32VarP", + "main::FlagSet::DurationSliceVarP", + "main::FlagSet::Float64SliceVarP", + "main::FlagSet::Parse", + "main::FlagSet::BoolP", + "main::FlagSet::IntVarP", + "main::FlagSet::IPNetVarP", + "main::FlagSet::IPVarP", + "main::unknownFlagError::Error", + "main::FlagSet::UintVar", + "main::FlagSet::BytesBase64VarP", + "main::FlagSet::StringToStringVarP", + "main::FlagSet::Int64VarP", + "main::FlagSet::DurationVarP", + "main::FlagSet::StringVar", + "main::FlagSet::Int16VarP", + "main::FlagSet::StringVarP", + "main::InvalidSyntaxError::Error", + "main::FlagSet::Float64Var", + "main::FlagSet::UintSliceVarP", + "main::FlagSet::TimeVarP", + "main::FlagSet::Int8VarP", + "main::FlagSet::VarP", + "main::FlagSet::Float32SliceVarP", + "main::FlagSet::TimeP", + "main::FlagSet::BoolSliceVarP", + "main::FlagSet::UintVarP", + "main::FlagSet::IPSliceVarP", + "main::FlagSet::PrintDefaults" + ], + "samples": { + "7": [ + "main::FlagSet::Output", + "main::NewFlagSet", + "main::FlagSet::FlagUsagesWrapped", + "main::FlagSet::GetNormalizeFunc", + "main::FlagSet::FlagUsages", + "main::FlagSet::AddGoFlag", + "main::PFlagFromGoFlag", + "main::FlagSet::VarPF", + "main::FlagSet::AddFlag", + "main::UnquoteUsage", + "main::ParseIPv4Mask" + ], + "8": [ + "main::FlagSet::AddFlag", + "main::UnquoteUsage", + "main::FlagSet::GetNormalizeFunc", + "main::PFlagFromGoFlag", + "main::FlagSet::VarPF", + "main::FlagSet::Output", + "main::FlagSet::AddGoFlag", + "main::ParseIPv4Mask", + "main::FlagSet::FlagUsages", + "main::FlagSet::FlagUsagesWrapped", + "main::NewFlagSet" + ], + "9": [ + "main::FlagSet::AddGoFlag", + "main::FlagSet::GetNormalizeFunc", + "main::FlagSet::VarPF", + "main::FlagSet::Output", + "main::ParseIPv4Mask", + "main::FlagSet::FlagUsages", + "main::FlagSet::AddFlag", + "main::FlagSet::FlagUsagesWrapped", + "main::PFlagFromGoFlag", + "main::NewFlagSet", + "main::UnquoteUsage" + ] + }, + "samples_common": { + "7": [ + "main::FlagSet::StringToIntVarP", + "main::FlagSet::BoolVarP", + "main::FlagSet::StringArrayVarP", + "main::FlagSet::IPNetSliceVarP", + "main::InvalidValueError::Error", + "main::FlagSet::StringSliceVarP", + "main::FlagSet::Uint16VarP", + "main::FlagSet::IntVar", + "main::FlagSet::Lookup", + "main::FlagSet::Float32VarP", + "main::FlagSet::Int64Var", + "main::FlagSet::StringToInt64VarP", + "main::FlagSet::Uint64VarP", + "main::FlagSet::Uint64Var", + "main::FlagSet::Uint32VarP", + "main::FlagSet::DurationSliceVarP", + "main::FlagSet::Float64SliceVarP", + "main::FlagSet::Parse", + "main::FlagSet::BoolP", + "main::FlagSet::IntVarP" + ], + "8": [ + "main::FlagSet::IPNetVarP", + "main::FlagSet::IPNetSliceVarP", + "main::FlagSet::IPVarP", + "main::unknownFlagError::Error", + "main::FlagSet::Float32VarP", + "main::FlagSet::UintVar", + "main::FlagSet::BytesBase64VarP", + "main::FlagSet::StringToStringVarP", + "main::FlagSet::Int64VarP", + "main::FlagSet::DurationVarP", + "main::FlagSet::Lookup", + "main::FlagSet::StringVar", + "main::FlagSet::Int16VarP", + "main::FlagSet::Uint16VarP", + "main::FlagSet::Parse", + "main::FlagSet::StringToInt64VarP", + "main::FlagSet::StringVarP", + "main::FlagSet::IntVarP", + "main::FlagSet::Uint64Var", + "main::FlagSet::BoolP" + ], + "9": [ + "main::InvalidSyntaxError::Error", + "main::FlagSet::Float64Var", + "main::FlagSet::StringToStringVarP", + "main::FlagSet::IPNetVarP", + "main::FlagSet::StringSliceVarP", + "main::FlagSet::UintSliceVarP", + "main::FlagSet::TimeVarP", + "main::FlagSet::StringVarP", + "main::FlagSet::Int8VarP", + "main::FlagSet::VarP", + "main::FlagSet::DurationVarP", + "main::FlagSet::Float32SliceVarP", + "main::FlagSet::TimeP", + "main::FlagSet::IntVarP", + "main::FlagSet::UintVar", + "main::FlagSet::BoolSliceVarP", + "main::FlagSet::DurationSliceVarP", + "main::FlagSet::UintVarP", + "main::FlagSet::IPSliceVarP", + "main::FlagSet::PrintDefaults" + ] + }, + "samples_blind": { + "7": [ + "main::FlagSet::SetNormalizeFunc", + "main::FlagSet::Init", + "main::FlagSet::GetBoolSlice", + "main::FlagSet::GetIPSlice", + "main::FlagSet::Output", + "main::NewFlagSet", + "main::FlagSet::FlagUsagesWrapped", + "main::FlagSet::Changed", + "main::FlagSet::GetUint8", + "main::FlagSet::GetStringSlice", + "main::FlagSet::GetInt32Slice", + "main::FlagSet::HasAvailableFlags", + "main::FlagSet::GetTime", + "main::FlagSet::GetBool", + "main::ParseSkippedFlags", + "main::FlagSet::GetFloat64", + "main::FlagSet::GetStringToString", + "main::FlagSet::GetNormalizeFunc", + "main::FlagSet::GetText", + "main::FlagSet::MarkHidden" + ], + "8": [ + "main::FlagSet::MarkDeprecated", + "main::FlagSet::GetInt32Slice", + "main::FlagSet::GetBool", + "main::FlagSet::MarkHidden", + "main::FlagSet::AddFlag", + "main::FlagSet::GetStringArray", + "main::FlagSet::GetStringToString", + "main::ParseSkippedFlags", + "main::UnquoteUsage", + "main::FlagSet::GetIPNetSlice", + "main::InvalidSyntaxError::GetSpecifiedFlag", + "main::FlagSet::GetIPSlice", + "main::FlagSet::AddFlagSet", + "main::FlagSet::GetNormalizeFunc", + "main::FlagSet::Changed", + "main::PFlagFromGoFlag", + "main::FlagSet::GetInt64", + "main::FlagSet::GetInt32", + "main::FlagSet::GetStringSlice", + "main::FlagSet::CopyToGoFlagSet" + ], + "9": [ + "main::FlagSet::GetInt16", + "main::InvalidSyntaxError::GetSpecifiedFlag", + "main::FlagSet::GetString", + "main::FlagSet::GetUint", + "main::FlagSet::Changed", + "main::FlagSet::AddGoFlag", + "main::FlagSet::GetFloat32", + "main::FlagSet::GetNormalizeFunc", + "main::FlagSet::HasAvailableFlags", + "main::FlagSet::MarkShorthandDeprecated", + "main::FlagSet::GetInt", + "main::FlagSet::GetFloat64", + "main::FlagSet::GetIPv4Mask", + "main::FlagSet::GetIPNet", + "main::FlagSet::GetUint32", + "main::FlagSet::Init", + "main::FlagSet::MarkHidden", + "main::FlagSet::GetIPSlice", + "main::FlagSet::GetText", + "main::FlagSet::VarPF" + ] + }, + "baseline_failing_tests": [], + "callers": [ + { + "symbol": "main::FlagSet::Output", + "truth": [ + "main::FlagSet::AddFlag", + "main::FlagSet::Parse", + "main::FlagSet::ParseAll", + "main::FlagSet::PrintDefaults", + "main::FlagSet::Set", + "main::FlagSet::ShorthandLookup", + "main::FlagSet::parseSingleShortArg", + "main::defaultUsage" + ], + "found": [ + "main::FlagSet::AddFlag", + "main::FlagSet::Parse", + "main::FlagSet::ParseAll", + "main::FlagSet::PrintDefaults", + "main::FlagSet::Set", + "main::FlagSet::ShorthandLookup", + "main::FlagSet::parseSingleShortArg", + "main::defaultUsage" + ], + "maybe": [], + "import_files": [ + "flag.go" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::NewFlagSet", + "truth": [], + "found": [ + "main" + ], + "maybe": [], + "import_files": [ + "bool_func_go1.21_test.go", + "flag.go", + "func_go1.21_test.go" + ], + "recall": null, + "precision": 0.0, + "recall_with_maybe": null + }, + { + "symbol": "main::FlagSet::FlagUsagesWrapped", + "truth": [ + "main::FlagSet::FlagUsages" + ], + "found": [ + "main::FlagSet::FlagUsages" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::FlagSet::GetNormalizeFunc", + "truth": [ + "main::FlagSet::normalizeFlagName" + ], + "found": [ + "main::FlagSet::normalizeFlagName" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::FlagSet::FlagUsages", + "truth": [ + "main::FlagSet::PrintDefaults" + ], + "found": [ + "main::FlagSet::PrintDefaults" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::FlagSet::AddGoFlag", + "truth": [ + "main::FlagSet::AddGoFlagSet" + ], + "found": [ + "main::FlagSet::AddGoFlagSet" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::PFlagFromGoFlag", + "truth": [ + "main::FlagSet::AddGoFlag" + ], + "found": [ + "main::FlagSet::AddGoFlag" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::FlagSet::VarPF", + "truth": [ + "main::BoolVarP", + "main::FlagSet::BoolFuncP", + "main::FlagSet::BoolVarP", + "main::FlagSet::CountVarP", + "main::FlagSet::VarP" + ], + "found": [ + "main::FlagSet::BoolFuncP", + "main::FlagSet::BoolVarP", + "main::FlagSet::CountVarP", + "main::FlagSet::VarP" + ], + "maybe": [], + "import_files": [], + "recall": 0.8, + "precision": 1.0, + "recall_with_maybe": 0.8 + }, + { + "symbol": "main::FlagSet::AddFlag", + "truth": [ + "main::FlagSet::AddFlagSet", + "main::FlagSet::AddGoFlag", + "main::FlagSet::VarPF" + ], + "found": [ + "main::FlagSet::AddFlagSet", + "main::FlagSet::AddGoFlag", + "main::FlagSet::VarPF" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::UnquoteUsage", + "truth": [ + "main::FlagSet::FlagUsagesWrapped" + ], + "found": [ + "main::FlagSet::FlagUsagesWrapped" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::ParseIPv4Mask", + "truth": [ + "main::ipMaskValue::Set", + "main::parseIPv4Mask" + ], + "found": [ + "main::ipMaskValue::Set", + "main::parseIPv4Mask" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + } + ], + "callers_common": [ + { + "symbol": "main::FlagSet::StringToIntVarP", + "truth": [ + "main::FlagSet::StringToInt", + "main::FlagSet::StringToIntP" + ], + "found": [ + "main::FlagSet::StringToInt", + "main::FlagSet::StringToIntP" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::FlagSet::BoolVarP", + "truth": [ + "main::FlagSet::BoolP", + "main::FlagSet::BoolVar" + ], + "found": [ + "main::FlagSet::BoolP", + "main::FlagSet::BoolVar" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::FlagSet::StringArrayVarP", + "truth": [ + "main::FlagSet::StringArray", + "main::FlagSet::StringArrayP" + ], + "found": [ + "main::FlagSet::StringArray", + "main::FlagSet::StringArrayP" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::FlagSet::IPNetSliceVarP", + "truth": [ + "main::FlagSet::IPNetSlice", + "main::FlagSet::IPNetSliceP" + ], + "found": [ + "main::FlagSet::IPNetSlice", + "main::FlagSet::IPNetSliceP" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::InvalidValueError::Error", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::FlagSet::StringSliceVarP", + "truth": [ + "main::FlagSet::StringSlice", + "main::FlagSet::StringSliceP" + ], + "found": [ + "main::FlagSet::StringSlice", + "main::FlagSet::StringSliceP" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::FlagSet::Uint16VarP", + "truth": [ + "main::FlagSet::Uint16", + "main::FlagSet::Uint16P" + ], + "found": [ + "main::FlagSet::Uint16", + "main::FlagSet::Uint16P" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::FlagSet::IntVar", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::FlagSet::Lookup", + "truth": [ + "main::FlagSet::AddFlagSet", + "main::FlagSet::AddGoFlag", + "main::FlagSet::Changed", + "main::FlagSet::GetText", + "main::FlagSet::GetTime", + "main::FlagSet::MarkDeprecated", + "main::FlagSet::MarkHidden", + "main::FlagSet::MarkShorthandDeprecated", + "main::FlagSet::getFlagType", + "main::Lookup" + ], + "found": [ + "main::FlagSet::AddFlagSet", + "main::FlagSet::AddGoFlag", + "main::FlagSet::Changed", + "main::FlagSet::GetText", + "main::FlagSet::GetTime", + "main::FlagSet::MarkDeprecated", + "main::FlagSet::MarkHidden", + "main::FlagSet::MarkShorthandDeprecated", + "main::FlagSet::getFlagType" + ], + "maybe": [], + "import_files": [], + "recall": 0.9, + "precision": 1.0, + "recall_with_maybe": 0.9 + }, + { + "symbol": "main::FlagSet::Float32VarP", + "truth": [ + "main::FlagSet::Float32", + "main::FlagSet::Float32P" + ], + "found": [ + "main::FlagSet::Float32", + "main::FlagSet::Float32P" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::FlagSet::Int64Var", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::FlagSet::StringToInt64VarP", + "truth": [ + "main::FlagSet::StringToInt64", + "main::FlagSet::StringToInt64P" + ], + "found": [ + "main::FlagSet::StringToInt64", + "main::FlagSet::StringToInt64P" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::FlagSet::Uint64VarP", + "truth": [ + "main::FlagSet::Uint64", + "main::FlagSet::Uint64P" + ], + "found": [ + "main::FlagSet::Uint64", + "main::FlagSet::Uint64P" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::FlagSet::Uint64Var", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::FlagSet::Uint32VarP", + "truth": [ + "main::FlagSet::Uint32", + "main::FlagSet::Uint32P" + ], + "found": [ + "main::FlagSet::Uint32", + "main::FlagSet::Uint32P" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::FlagSet::DurationSliceVarP", + "truth": [ + "main::FlagSet::DurationSlice", + "main::FlagSet::DurationSliceP" + ], + "found": [ + "main::FlagSet::DurationSlice", + "main::FlagSet::DurationSliceP" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::FlagSet::Float64SliceVarP", + "truth": [ + "main::FlagSet::Float64Slice", + "main::FlagSet::Float64SliceP" + ], + "found": [ + "main::FlagSet::Float64Slice", + "main::FlagSet::Float64SliceP" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::FlagSet::Parse", + "truth": [ + "main::Parse" + ], + "found": [ + "main::ParseSkippedFlags" + ], + "maybe": [], + "import_files": [], + "recall": 0.0, + "precision": 0.0, + "recall_with_maybe": 0.0 + }, + { + "symbol": "main::FlagSet::BoolP", + "truth": [ + "main::BoolP", + "main::FlagSet::Bool" + ], + "found": [ + "main::FlagSet::Bool" + ], + "maybe": [], + "import_files": [], + "recall": 0.5, + "precision": 1.0, + "recall_with_maybe": 0.5 + }, + { + "symbol": "main::FlagSet::IntVarP", + "truth": [ + "main::FlagSet::Int", + "main::FlagSet::IntP" + ], + "found": [ + "main::FlagSet::Int", + "main::FlagSet::IntP" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::FlagSet::IPNetVarP", + "truth": [ + "main::FlagSet::IPNet", + "main::FlagSet::IPNetP" + ], + "found": [ + "main::FlagSet::IPNet", + "main::FlagSet::IPNetP" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::FlagSet::IPVarP", + "truth": [ + "main::FlagSet::IP", + "main::FlagSet::IPP" + ], + "found": [ + "main::FlagSet::IP", + "main::FlagSet::IPP" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::unknownFlagError::Error", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::FlagSet::UintVar", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::FlagSet::BytesBase64VarP", + "truth": [ + "main::FlagSet::BytesBase64", + "main::FlagSet::BytesBase64P" + ], + "found": [ + "main::FlagSet::BytesBase64", + "main::FlagSet::BytesBase64P" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::FlagSet::StringToStringVarP", + "truth": [ + "main::FlagSet::StringToString", + "main::FlagSet::StringToStringP" + ], + "found": [ + "main::FlagSet::StringToString", + "main::FlagSet::StringToStringP" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::FlagSet::Int64VarP", + "truth": [ + "main::FlagSet::Int64", + "main::FlagSet::Int64P" + ], + "found": [ + "main::FlagSet::Int64", + "main::FlagSet::Int64P" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::FlagSet::DurationVarP", + "truth": [ + "main::FlagSet::Duration", + "main::FlagSet::DurationP" + ], + "found": [ + "main::FlagSet::Duration", + "main::FlagSet::DurationP" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::FlagSet::StringVar", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::FlagSet::Int16VarP", + "truth": [ + "main::FlagSet::Int16", + "main::FlagSet::Int16P" + ], + "found": [ + "main::FlagSet::Int16", + "main::FlagSet::Int16P" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::FlagSet::StringVarP", + "truth": [ + "main::FlagSet::String", + "main::FlagSet::StringP" + ], + "found": [ + "main::FlagSet::String", + "main::FlagSet::StringP" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::InvalidSyntaxError::Error", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::FlagSet::Float64Var", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::FlagSet::UintSliceVarP", + "truth": [ + "main::FlagSet::UintSlice", + "main::FlagSet::UintSliceP" + ], + "found": [ + "main::FlagSet::UintSlice", + "main::FlagSet::UintSliceP" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::FlagSet::TimeVarP", + "truth": [ + "main::FlagSet::TimeP", + "main::FlagSet::TimeVar", + "main::TimeVar" + ], + "found": [ + "main::FlagSet::TimeP", + "main::FlagSet::TimeVar" + ], + "maybe": [], + "import_files": [], + "recall": 0.6666666666666666, + "precision": 1.0, + "recall_with_maybe": 0.6666666666666666 + }, + { + "symbol": "main::FlagSet::Int8VarP", + "truth": [ + "main::FlagSet::Int8", + "main::FlagSet::Int8P" + ], + "found": [ + "main::FlagSet::Int8", + "main::FlagSet::Int8P" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::FlagSet::VarP", + "truth": [ + "main::BoolSliceVar", + "main::BoolSliceVarP", + "main::BytesBase64Var", + "main::BytesBase64VarP", + "main::BytesHexVar", + "main::BytesHexVarP", + "main::DurationSliceVar", + "main::DurationSliceVarP", + "main::DurationVar", + "main::DurationVarP", + "main::FlagSet::BoolSliceVar", + "main::FlagSet::BoolSliceVarP", + "main::FlagSet::BytesBase64Var", + "main::FlagSet::BytesBase64VarP", + "main::FlagSet::BytesHexVar", + "main::FlagSet::BytesHexVarP", + "main::FlagSet::DurationSliceVar", + "main::FlagSet::DurationSliceVarP", + "main::FlagSet::DurationVar", + "main::FlagSet::DurationVarP", + "main::FlagSet::Float32SliceVar", + "main::FlagSet::Float32SliceVarP", + "main::FlagSet::Float32Var", + "main::FlagSet::Float32VarP", + "main::FlagSet::Float64SliceVar", + "main::FlagSet::Float64SliceVarP", + "main::FlagSet::Float64Var", + "main::FlagSet::Float64VarP", + "main::FlagSet::FuncP", + "main::FlagSet::IPMaskVar", + "main::FlagSet::IPMaskVarP", + "main::FlagSet::IPNetSliceVar", + "main::FlagSet::IPNetSliceVarP", + "main::FlagSet::IPNetVar", + "main::FlagSet::IPNetVarP", + "main::FlagSet::IPSliceVar", + "main::FlagSet::IPSliceVarP", + "main::FlagSet::IPVar", + "main::FlagSet::IPVarP", + "main::FlagSet::Int16Var", + "main::FlagSet::Int16VarP", + "main::FlagSet::Int32SliceVar", + "main::FlagSet::Int32SliceVarP", + "main::FlagSet::Int32Var", + "main::FlagSet::Int32VarP", + "main::FlagSet::Int64SliceVar", + "main::FlagSet::Int64SliceVarP", + "main::FlagSet::Int64Var", + "main::FlagSet::Int64VarP", + "main::FlagSet::Int8Var", + "main::FlagSet::Int8VarP", + "main::FlagSet::IntSliceVar", + "main::FlagSet::IntSliceVarP", + "main::FlagSet::IntVar", + "main::FlagSet::IntVarP", + "main::FlagSet::StringArrayVar", + "main::FlagSet::StringArrayVarP", + "main::FlagSet::StringSliceVar", + "main::FlagSet::StringSliceVarP", + "main::FlagSet::StringToInt64Var", + "main::FlagSet::StringToInt64VarP", + "main::FlagSet::StringToIntVar", + "main::FlagSet::StringToIntVarP", + "main::FlagSet::StringToStringVar", + "main::FlagSet::StringToStringVarP", + "main::FlagSet::StringVar", + "main::FlagSet::StringVarP", + "main::FlagSet::TextVar", + "main::FlagSet::TextVarP", + "main::FlagSet::TimeVarP", + "main::FlagSet::Uint16Var", + "main::FlagSet::Uint16VarP", + "main::FlagSet::Uint32Var", + "main::FlagSet::Uint32VarP", + "main::FlagSet::Uint64Var", + "main::FlagSet::Uint64VarP", + "main::FlagSet::Uint8Var", + "main::FlagSet::Uint8VarP", + "main::FlagSet::UintSliceVar", + "main::FlagSet::UintSliceVarP", + "main::FlagSet::UintVar", + "main::FlagSet::UintVarP", + "main::FlagSet::Var", + "main::Float32SliceVar", + "main::Float32SliceVarP", + "main::Float32Var", + "main::Float32VarP", + "main::Float64SliceVar", + "main::Float64SliceVarP", + "main::Float64Var", + "main::Float64VarP", + "main::IPMaskVar", + "main::IPMaskVarP", + "main::IPNetSliceVar", + "main::IPNetSliceVarP", + "main::IPNetVar", + "main::IPNetVarP", + "main::IPSliceVar", + "main::IPSliceVarP", + "main::IPVar", + "main::IPVarP", + "main::Int16Var", + "main::Int16VarP", + "main::Int32SliceVar", + "main::Int32SliceVarP", + "main::Int32Var", + "main::Int32VarP", + "main::Int64SliceVar", + "main::Int64SliceVarP", + "main::Int64Var", + "main::Int64VarP", + "main::Int8Var", + "main::Int8VarP", + "main::IntSliceVar", + "main::IntSliceVarP", + "main::IntVar", + "main::IntVarP", + "main::StringArrayVar", + "main::StringArrayVarP", + "main::StringSliceVar", + "main::StringSliceVarP", + "main::StringToInt64Var", + "main::StringToInt64VarP", + "main::StringToIntVar", + "main::StringToIntVarP", + "main::StringToStringVar", + "main::StringToStringVarP", + "main::StringVar", + "main::StringVarP", + "main::TextVar", + "main::TextVarP", + "main::TimeVarP", + "main::Uint16Var", + "main::Uint16VarP", + "main::Uint32Var", + "main::Uint32VarP", + "main::Uint64Var", + "main::Uint64VarP", + "main::Uint8Var", + "main::Uint8VarP", + "main::UintSliceVar", + "main::UintSliceVarP", + "main::UintVar", + "main::UintVarP", + "main::Var", + "main::VarP" + ], + "found": [ + "main::FlagSet::BoolSliceVar", + "main::FlagSet::BoolSliceVarP", + "main::FlagSet::BytesBase64Var", + "main::FlagSet::BytesBase64VarP", + "main::FlagSet::BytesHexVar", + "main::FlagSet::BytesHexVarP", + "main::FlagSet::DurationSliceVar", + "main::FlagSet::DurationSliceVarP", + "main::FlagSet::DurationVar", + "main::FlagSet::DurationVarP", + "main::FlagSet::Float32SliceVar", + "main::FlagSet::Float32SliceVarP", + "main::FlagSet::Float32Var", + "main::FlagSet::Float32VarP", + "main::FlagSet::Float64SliceVar", + "main::FlagSet::Float64SliceVarP", + "main::FlagSet::Float64Var", + "main::FlagSet::Float64VarP", + "main::FlagSet::FuncP", + "main::FlagSet::IPMaskVar", + "main::FlagSet::IPMaskVarP", + "main::FlagSet::IPNetSliceVar", + "main::FlagSet::IPNetSliceVarP", + "main::FlagSet::IPNetVar", + "main::FlagSet::IPNetVarP", + "main::FlagSet::IPSliceVar", + "main::FlagSet::IPSliceVarP", + "main::FlagSet::IPVar", + "main::FlagSet::IPVarP", + "main::FlagSet::Int16Var", + "main::FlagSet::Int16VarP", + "main::FlagSet::Int32SliceVar", + "main::FlagSet::Int32SliceVarP", + "main::FlagSet::Int32Var", + "main::FlagSet::Int32VarP", + "main::FlagSet::Int64SliceVar", + "main::FlagSet::Int64SliceVarP", + "main::FlagSet::Int64Var", + "main::FlagSet::Int64VarP", + "main::FlagSet::Int8Var", + "main::FlagSet::Int8VarP", + "main::FlagSet::IntSliceVar", + "main::FlagSet::IntSliceVarP", + "main::FlagSet::IntVar", + "main::FlagSet::IntVarP", + "main::FlagSet::StringArrayVar", + "main::FlagSet::StringArrayVarP", + "main::FlagSet::StringSliceVar", + "main::FlagSet::StringSliceVarP", + "main::FlagSet::StringToInt64Var", + "main::FlagSet::StringToInt64VarP", + "main::FlagSet::StringToIntVar", + "main::FlagSet::StringToIntVarP", + "main::FlagSet::StringToStringVar", + "main::FlagSet::StringToStringVarP", + "main::FlagSet::StringVar", + "main::FlagSet::StringVarP", + "main::FlagSet::TextVar", + "main::FlagSet::TextVarP", + "main::FlagSet::TimeVarP", + "main::FlagSet::Uint16Var", + "main::FlagSet::Uint16VarP", + "main::FlagSet::Uint32Var", + "main::FlagSet::Uint32VarP", + "main::FlagSet::Uint64Var", + "main::FlagSet::Uint64VarP", + "main::FlagSet::Uint8Var", + "main::FlagSet::Uint8VarP", + "main::FlagSet::UintSliceVar", + "main::FlagSet::UintSliceVarP", + "main::FlagSet::UintVar", + "main::FlagSet::UintVarP", + "main::FlagSet::Var" + ], + "maybe": [], + "import_files": [], + "recall": 0.5, + "precision": 1.0, + "recall_with_maybe": 0.5 + }, + { + "symbol": "main::FlagSet::Float32SliceVarP", + "truth": [ + "main::FlagSet::Float32Slice", + "main::FlagSet::Float32SliceP" + ], + "found": [ + "main::FlagSet::Float32Slice", + "main::FlagSet::Float32SliceP" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::FlagSet::TimeP", + "truth": [ + "main::FlagSet::Time", + "main::Time", + "main::TimeP" + ], + "found": [ + "main::FlagSet::Time" + ], + "maybe": [], + "import_files": [], + "recall": 0.3333333333333333, + "precision": 1.0, + "recall_with_maybe": 0.3333333333333333 + }, + { + "symbol": "main::FlagSet::BoolSliceVarP", + "truth": [ + "main::FlagSet::BoolSlice", + "main::FlagSet::BoolSliceP" + ], + "found": [ + "main::FlagSet::BoolSlice", + "main::FlagSet::BoolSliceP" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::FlagSet::UintVarP", + "truth": [ + "main::FlagSet::Uint", + "main::FlagSet::UintP" + ], + "found": [ + "main::FlagSet::Uint", + "main::FlagSet::UintP" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::FlagSet::IPSliceVarP", + "truth": [ + "main::FlagSet::IPSlice", + "main::FlagSet::IPSliceP" + ], + "found": [ + "main::FlagSet::IPSlice", + "main::FlagSet::IPSliceP" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::FlagSet::PrintDefaults", + "truth": [ + "main::PrintDefaults", + "main::defaultUsage" + ], + "found": [ + "main::defaultUsage" + ], + "maybe": [], + "import_files": [], + "recall": 0.5, + "precision": 1.0, + "recall_with_maybe": 0.5 + } + ], + "callers_blind": [ + { + "symbol": "main::FlagSet::SetNormalizeFunc", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::FlagSet::Init", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::FlagSet::GetBoolSlice", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::FlagSet::GetIPSlice", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::FlagSet::Output", + "truth": [ + "main::FlagSet::AddFlag", + "main::FlagSet::Parse", + "main::FlagSet::ParseAll", + "main::FlagSet::PrintDefaults", + "main::FlagSet::Set", + "main::FlagSet::ShorthandLookup", + "main::FlagSet::parseSingleShortArg", + "main::defaultUsage" + ], + "found": [ + "main::FlagSet::AddFlag", + "main::FlagSet::Parse", + "main::FlagSet::ParseAll", + "main::FlagSet::PrintDefaults", + "main::FlagSet::Set", + "main::FlagSet::ShorthandLookup", + "main::FlagSet::parseSingleShortArg", + "main::defaultUsage" + ], + "maybe": [], + "import_files": [ + "flag.go" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::NewFlagSet", + "truth": [], + "found": [ + "main" + ], + "maybe": [], + "import_files": [ + "bool_func_go1.21_test.go", + "flag.go", + "func_go1.21_test.go" + ], + "recall": null, + "precision": 0.0, + "recall_with_maybe": null + }, + { + "symbol": "main::FlagSet::FlagUsagesWrapped", + "truth": [ + "main::FlagSet::FlagUsages" + ], + "found": [ + "main::FlagSet::FlagUsages" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::FlagSet::Changed", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::FlagSet::GetUint8", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::FlagSet::GetStringSlice", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::FlagSet::GetInt32Slice", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::FlagSet::HasAvailableFlags", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::FlagSet::GetTime", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::FlagSet::GetBool", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::ParseSkippedFlags", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::FlagSet::GetFloat64", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::FlagSet::GetStringToString", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::FlagSet::GetNormalizeFunc", + "truth": [ + "main::FlagSet::normalizeFlagName" + ], + "found": [ + "main::FlagSet::normalizeFlagName" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::FlagSet::GetText", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::FlagSet::MarkHidden", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::FlagSet::MarkDeprecated", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::FlagSet::AddFlag", + "truth": [ + "main::FlagSet::AddFlagSet", + "main::FlagSet::AddGoFlag", + "main::FlagSet::VarPF" + ], + "found": [ + "main::FlagSet::AddFlagSet", + "main::FlagSet::AddGoFlag", + "main::FlagSet::VarPF" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::FlagSet::GetStringArray", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::UnquoteUsage", + "truth": [ + "main::FlagSet::FlagUsagesWrapped" + ], + "found": [ + "main::FlagSet::FlagUsagesWrapped" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::FlagSet::GetIPNetSlice", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::InvalidSyntaxError::GetSpecifiedFlag", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::FlagSet::AddFlagSet", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::PFlagFromGoFlag", + "truth": [ + "main::FlagSet::AddGoFlag" + ], + "found": [ + "main::FlagSet::AddGoFlag" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::FlagSet::GetInt64", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::FlagSet::GetInt32", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::FlagSet::CopyToGoFlagSet", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::FlagSet::GetInt16", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::FlagSet::GetString", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::FlagSet::GetUint", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::FlagSet::AddGoFlag", + "truth": [ + "main::FlagSet::AddGoFlagSet" + ], + "found": [ + "main::FlagSet::AddGoFlagSet" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::FlagSet::GetFloat32", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::FlagSet::MarkShorthandDeprecated", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::FlagSet::GetInt", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::FlagSet::GetIPv4Mask", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::FlagSet::GetIPNet", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::FlagSet::GetUint32", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::FlagSet::VarPF", + "truth": [ + "main::BoolVarP", + "main::FlagSet::BoolFuncP", + "main::FlagSet::BoolVarP", + "main::FlagSet::CountVarP", + "main::FlagSet::VarP" + ], + "found": [ + "main::FlagSet::BoolFuncP", + "main::FlagSet::BoolVarP", + "main::FlagSet::CountVarP", + "main::FlagSet::VarP" + ], + "maybe": [], + "import_files": [], + "recall": 0.8, + "precision": 1.0, + "recall_with_maybe": 0.8 + } + ], + "rename": [ + { + "symbol": "main::FlagSet::Output", + "ok": false, + "compiled": false, + "tests_ok": null, + "tests_failed": [], + "old_name_left": "example_test.go:58:\t// Output: map[a:2 b:2 d:4]\nexample_test.go:70:\t// Output:\nflag.go:300:// Output returns the destination for usage and error messages. os.Stderr is returned if\nflag.go:876:\t_, _ = fmt.Fprintf(CommandLine.Output(), \"Usage of %s:\\n\", os.Args[0])", + "detail": "# github.com/spf13/pflag [github.com/spf13/pflag.test]\n./flag.go:876:33: CommandLine.Output undefined (type *FlagSet has no field or method Output, but does have field output)\nFAIL\tgithub.com/spf13/pflag [build failed]\nFAIL\n" + }, + { + "symbol": "main::NewFlagSet", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "bool_func_go1.21_test.go:48:\t\tstdFSet := flag.NewFlagSet(\"std test\", flag.ContinueOnError)\nbool_func_go1.21_test.go:75:\t\tstdFSet := flag.NewFlagSet(\"std test\", flag.ContinueOnError)\nfunc_go1.21_test.go:40:\t\tstdFSet := flag.NewFlagSet(\"std test\", flag.ContinueOnError)\nfunc_go1.21_test.go:67:\t\tstdFSet", + "detail": "" + }, + { + "symbol": "main::FlagSet::FlagUsagesWrapped", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "main::FlagSet::GetNormalizeFunc", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "main::FlagSet::FlagUsages", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "main::FlagSet::AddGoFlag", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "main::PFlagFromGoFlag", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "golangflag.go:74:func PFlagFromGoFlagGnx(goflag *goflag.Flag) *Flag { //nolint:revive // ignore \"func name will be used as pflag.PFlagFromGoFlag by other packages, and that stutters\"", + "detail": "" + }, + { + "symbol": "main::FlagSet::VarPF", + "ok": false, + "compiled": false, + "tests_ok": null, + "tests_failed": [], + "old_name_left": "bool.go:80:\tflag := CommandLine.VarPF(newBoolValue(value, p), name, shorthand, usage)", + "detail": "# github.com/spf13/pflag [github.com/spf13/pflag.test]\n./bool.go:80:22: CommandLine.VarPF undefined (type *FlagSet has no field or method VarPF)\nFAIL\tgithub.com/spf13/pflag [build failed]\nFAIL\n" + }, + { + "symbol": "main::FlagSet::AddFlag", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "main::UnquoteUsage", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "main::ParseIPv4Mask", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + } + ], + "mutants": { + "7": [ + "main::FlagSet::Output", + "main::NewFlagSet", + "main::FlagSet::FlagUsagesWrapped", + "main::FlagSet::GetNormalizeFunc", + "main::FlagSet::FlagUsages", + "main::FlagSet::AddGoFlag", + "main::PFlagFromGoFlag", + "main::FlagSet::VarPF", + "main::FlagSet::AddFlag", + "main::UnquoteUsage", + "main::ParseIPv4Mask" + ], + "8": [ + "main::FlagSet::AddFlag", + "main::UnquoteUsage", + "main::FlagSet::GetNormalizeFunc", + "main::PFlagFromGoFlag", + "main::FlagSet::VarPF", + "main::FlagSet::Output", + "main::FlagSet::AddGoFlag", + "main::ParseIPv4Mask", + "main::FlagSet::FlagUsages", + "main::FlagSet::FlagUsagesWrapped", + "main::NewFlagSet" + ], + "9": [ + "main::FlagSet::AddGoFlag", + "main::FlagSet::GetNormalizeFunc", + "main::FlagSet::VarPF", + "main::FlagSet::Output", + "main::ParseIPv4Mask", + "main::FlagSet::FlagUsages", + "main::FlagSet::AddFlag", + "main::FlagSet::FlagUsagesWrapped", + "main::PFlagFromGoFlag", + "main::NewFlagSet", + "main::UnquoteUsage" + ] + }, + "tests": [ + { + "symbol": "main::FlagSet::Output", + "level": "name", + "truth": 12, + "predicted": 169, + "recall": 1.0, + "precision": 0.07100591715976332, + "top_hits": 1, + "top_n": 10, + "top_precision": 0.1, + "top_best": 1.0, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "main::NewFlagSet", + "skipped": "mutant does not compile" + }, + { + "symbol": "main::FlagSet::FlagUsagesWrapped", + "level": "name", + "truth": 13, + "predicted": 13, + "recall": 1.0, + "precision": 1.0, + "top_hits": 10, + "top_n": 10, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "main::FlagSet::GetNormalizeFunc", + "skipped": "mutant does not compile" + }, + { + "symbol": "main::FlagSet::FlagUsages", + "level": "name", + "truth": 9, + "predicted": 10, + "recall": 1.0, + "precision": 0.9, + "top_hits": 9, + "top_n": 10, + "top_precision": 0.9, + "top_best": 0.9, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "main::FlagSet::AddGoFlag", + "level": "name", + "truth": 1, + "predicted": 3, + "recall": 1.0, + "precision": 0.3333333333333333, + "top_hits": 1, + "top_n": 3, + "top_precision": 0.3333333333333333, + "top_best": 0.3333333333333333, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "main::PFlagFromGoFlag", + "level": "name", + "truth": 1, + "predicted": 3, + "recall": 1.0, + "precision": 0.3333333333333333, + "top_hits": 1, + "top_n": 3, + "top_precision": 0.3333333333333333, + "top_best": 0.3333333333333333, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "main::FlagSet::VarPF", + "skipped": "mutant does not compile" + }, + { + "symbol": "main::FlagSet::AddFlag", + "skipped": "mutant does not compile" + }, + { + "symbol": "main::UnquoteUsage", + "level": "name", + "truth": 11, + "predicted": 13, + "recall": 1.0, + "precision": 0.8461538461538461, + "top_hits": 8, + "top_n": 10, + "top_precision": 0.8, + "top_best": 1.0, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "main::ParseIPv4Mask", + "level": "name", + "truth": 4, + "predicted": 4, + "recall": 1.0, + "precision": 1.0, + "top_hits": 4, + "top_n": 4, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [], + "recall_graph_only": 0.75 + } + ], + "look": [ + { + "symbol": "main::FlagSet::Output", + "look_tokens": 274, + "file_tokens": 10645 + }, + { + "symbol": "main::NewFlagSet", + "look_tokens": 306, + "file_tokens": 10645 + }, + { + "symbol": "main::FlagSet::FlagUsagesWrapped", + "look_tokens": 772, + "file_tokens": 10645 + }, + { + "symbol": "main::FlagSet::GetNormalizeFunc", + "look_tokens": 323, + "file_tokens": 10645 + }, + { + "symbol": "main::FlagSet::FlagUsages", + "look_tokens": 264, + "file_tokens": 10645 + }, + { + "symbol": "main::FlagSet::AddGoFlag", + "look_tokens": 183, + "file_tokens": 1209 + }, + { + "symbol": "main::PFlagFromGoFlag", + "look_tokens": 373, + "file_tokens": 1209 + }, + { + "symbol": "main::FlagSet::VarPF", + "look_tokens": 320, + "file_tokens": 10645 + }, + { + "symbol": "main::FlagSet::AddFlag", + "look_tokens": 549, + "file_tokens": 10645 + }, + { + "symbol": "main::UnquoteUsage", + "look_tokens": 500, + "file_tokens": 10645 + }, + { + "symbol": "main::ParseIPv4Mask", + "look_tokens": 340, + "file_tokens": 1026 + } + ], + "seconds": 392, + "summary": { + "callers_recall": 0.98, + "callers_precision": 1.0, + "callers_checked": 10, + "blind_recall": 0.975, + "blind_checked": 8, + "common_recall": 0.894, + "common_precision": 0.971, + "common_recall_with_maybe": 0.894, + "common_checked": 34, + "rename_ok": 0.818, + "rename_checked": 11, + "tests_recall": 1.0, + "tests_precision": 0.641, + "tests_top10_precision": 0.638, + "tests_top10_best": 0.795, + "tests_caught": 1.0, + "tests_checked": 7, + "look_vs_file": 0.1 + }, + "summary_seeds": { + "7": { + "callers_recall": 0.98, + "callers_precision": 1.0, + "callers_checked": 10, + "blind_recall": 1.0, + "blind_checked": 3, + "common_recall": 0.9, + "common_precision": 0.938, + "common_recall_with_maybe": 0.9, + "common_checked": 16, + "rename_ok": 0.818, + "rename_checked": 11, + "tests_recall": 1.0, + "tests_precision": 0.641, + "tests_top10_precision": 0.638, + "tests_top10_best": 0.795, + "tests_caught": 1.0, + "tests_checked": 7, + "look_vs_file": 0.1 + }, + "8": { + "callers_recall": 0.98, + "callers_precision": 1.0, + "callers_checked": 10, + "blind_recall": 1.0, + "blind_checked": 4, + "common_recall": 0.9, + "common_precision": 0.938, + "common_recall_with_maybe": 0.9, + "common_checked": 16, + "rename_ok": 0.818, + "rename_checked": 11, + "tests_recall": 1.0, + "tests_precision": 0.641, + "tests_top10_precision": 0.638, + "tests_top10_best": 0.795, + "tests_caught": 1.0, + "tests_checked": 7, + "look_vs_file": 0.1 + }, + "9": { + "callers_recall": 0.98, + "callers_precision": 1.0, + "callers_checked": 10, + "blind_recall": 0.933, + "blind_checked": 3, + "common_recall": 0.882, + "common_precision": 1.0, + "common_recall_with_maybe": 0.882, + "common_checked": 17, + "rename_ok": 0.818, + "rename_checked": 11, + "tests_recall": 1.0, + "tests_precision": 0.641, + "tests_top10_precision": 0.638, + "tests_top10_best": 0.795, + "tests_caught": 1.0, + "tests_checked": 7, + "look_vs_file": 0.1 + } + }, + "noise": { + "callers_recall": { + "mean": 0.98, + "functions": 10, + "boot_lo": 0.94, + "boot_hi": 1.0, + "boot_half": 0.03, + "seeds": [ + 0.98, + 0.98, + 0.98 + ], + "seed_sd": 0.0, + "threshold": 0.1 + }, + "callers_precision": { + "mean": 1.0, + "functions": 10, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.1 + }, + "blind_recall": { + "mean": 0.975, + "functions": 8, + "boot_lo": 0.925, + "boot_hi": 1.0, + "boot_half": 0.037, + "seeds": [ + 1.0, + 1.0, + 0.933 + ], + "seed_sd": 0.038, + "threshold": 0.13 + }, + "common_recall": { + "mean": 0.894, + "functions": 34, + "boot_lo": 0.824, + "boot_hi": 0.956, + "boot_half": 0.066, + "seeds": [ + 0.9, + 0.9, + 0.882 + ], + "seed_sd": 0.01, + "threshold": 0.07 + }, + "common_recall_with_maybe": { + "mean": 0.894, + "functions": 34, + "boot_lo": 0.824, + "boot_hi": 0.956, + "boot_half": 0.066, + "seeds": [ + 0.9, + 0.9, + 0.882 + ], + "seed_sd": 0.01, + "threshold": 0.07 + }, + "common_precision": { + "mean": 0.971, + "functions": 34, + "boot_lo": 0.912, + "boot_hi": 1.0, + "boot_half": 0.044, + "seeds": [ + 0.938, + 0.938, + 1.0 + ], + "seed_sd": 0.036, + "threshold": 0.05 + }, + "rename_ok": { + "mean": 0.818, + "functions": 11, + "boot_lo": 0.636, + "boot_hi": 1.0, + "boot_half": 0.182, + "seeds": [ + 0.818, + 0.818, + 0.818 + ], + "seed_sd": 0.0, + "threshold": 0.19 + }, + "tests_recall": { + "mean": 1.0, + "functions": 7, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.15 + }, + "tests_precision": { + "mean": 0.641, + "functions": 7, + "boot_lo": 0.405, + "boot_hi": 0.854, + "boot_half": 0.225, + "seeds": [ + 0.641, + 0.641, + 0.641 + ], + "seed_sd": 0.0, + "threshold": 0.23 + }, + "tests_top10_precision": { + "mean": 0.638, + "functions": 7, + "boot_lo": 0.41, + "boot_hi": 0.848, + "boot_half": 0.219, + "seeds": [ + 0.638, + 0.638, + 0.638 + ], + "seed_sd": 0.0, + "threshold": 0.22 + }, + "tests_top10_best": { + "mean": 0.795, + "functions": 7, + "boot_lo": 0.605, + "boot_hi": 0.986, + "boot_half": 0.19, + "seeds": [ + 0.795, + 0.795, + 0.795 + ], + "seed_sd": 0.0, + "threshold": 0.2 + }, + "tests_caught": { + "mean": 1.0, + "functions": 7, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.15 + }, + "look_vs_file": { + "mean": 0.1, + "functions": 11, + "boot_lo": 0.049, + "boot_hi": 0.159, + "boot_half": 0.055, + "seeds": [ + 0.1, + 0.1, + 0.1 + ], + "seed_sd": 0.0, + "threshold": 0.06 + } + } + }, + { + "repo": "mux", + "lang": "go", + "commit": "db9d1d0073d2", + "index_seconds": 0.1, + "symbols": 128, + "files": 5, + "seeds": [ + 7, + 8, + 9 + ], + "edges": 2589, + "sample": [ + "main::Router::NewRoute", + "main::Route::Handler", + "main::Route::GetMethods", + "main::Route::HandlerFunc", + "main::Route::GetHandlerWithMiddlewares" + ], + "sample_common": [ + "main::Route::Path", + "main::Route::Schemes", + "main::Route::Host", + "main::Route::Headers", + "main::Route::BuildVarsFunc", + "main::Route::Queries", + "main::Route::PathPrefix", + "main::Route::Name", + "main::Route::MatcherFunc", + "main::MiddlewareFunc::Middleware", + "main::Route::Methods" + ], + "samples": { + "7": [ + "main::Router::NewRoute", + "main::Route::Handler", + "main::Route::GetMethods", + "main::Route::HandlerFunc", + "main::Route::GetHandlerWithMiddlewares" + ], + "8": [ + "main::Route::GetMethods", + "main::Route::Handler", + "main::Route::GetHandlerWithMiddlewares", + "main::Router::NewRoute", + "main::Route::HandlerFunc" + ], + "9": [ + "main::Route::GetHandlerWithMiddlewares", + "main::Route::Handler", + "main::Route::GetMethods", + "main::Router::NewRoute", + "main::Route::HandlerFunc" + ] + }, + "samples_common": { + "7": [ + "main::Route::Path", + "main::Route::Schemes", + "main::Route::Host", + "main::Route::Headers", + "main::Route::BuildVarsFunc", + "main::Route::Queries", + "main::Route::PathPrefix", + "main::Route::Name", + "main::Route::MatcherFunc", + "main::MiddlewareFunc::Middleware", + "main::Route::Methods" + ], + "8": [ + "main::Route::MatcherFunc", + "main::Route::Host", + "main::Route::Methods", + "main::Route::Schemes", + "main::Route::Name", + "main::Route::BuildVarsFunc", + "main::MiddlewareFunc::Middleware", + "main::Route::Path", + "main::Route::Headers", + "main::Route::Queries", + "main::Route::PathPrefix" + ], + "9": [ + "main::Route::Name", + "main::Route::Path", + "main::Route::Host", + "main::Route::Queries", + "main::Route::MatcherFunc", + "main::Route::BuildVarsFunc", + "main::Route::Methods", + "main::Route::Schemes", + "main::MiddlewareFunc::Middleware", + "main::Route::PathPrefix", + "main::Route::Headers" + ] + }, + "samples_blind": { + "7": [ + "main::Router::OmitRouteFromContext", + "main::Route::GetVarNames", + "main::Route::Subrouter", + "main::Router::NewRoute", + "main::Route::GetQueriesRegexp", + "main::Route::GetError", + "main::Route::MetadataContains", + "main::Router::Walk", + "main::Route::HeadersRegexp", + "main::Route::URLPath", + "main::Vars", + "main::CORSMethodMiddleware", + "main::Route::GetHostTemplate", + "main::CurrentRouter", + "main::Router::HandleFunc", + "main::Route::GetMetadataValueOr", + "main::Route::GetQueriesTemplates", + "main::Route::GetName", + "main::Route::GetPathTemplate", + "main::Route::Metadata" + ], + "8": [ + "main::NewRouter", + "main::Router::Handle", + "main::Router::HandleFunc", + "main::Route::GetMetadata", + "main::Router::Walk", + "main::Route::GetPathTemplate", + "main::CurrentRoute", + "main::Route::GetMethods", + "main::Route::Metadata", + "main::Route::GetQueriesTemplates", + "main::Route::URLPath", + "main::Route::GetHostTemplate", + "main::Route::HeadersRegexp", + "main::Router::GetRoute", + "main::Route::URLHost", + "main::Route::GetPathRegexp", + "main::Route::MetadataContains", + "main::Route::GetName", + "main::Route::GetMetadataValueOr", + "main::Route::Subrouter" + ], + "9": [ + "main::Route::GetHandlerWithMiddlewares", + "main::Route::GetMetadata", + "main::Router::StrictSlash", + "main::Route::GetQueriesRegexp", + "main::Route::GetHandler", + "main::Route::GetError", + "main::Router::UseEncodedPath", + "main::Router::OmitRouterFromContext", + "main::Route::GetMetadataValue", + "main::Router::Handle", + "main::Route::GetQueriesTemplates", + "main::Route::GetName", + "main::Route::GetPathTemplate", + "main::Route::GetPathRegexp", + "main::Router::GetRoute", + "main::Route::URLPath", + "main::Route::GetHostTemplate", + "main::CurrentRoute", + "main::Route::GetVarNames", + "main::Router::OmitRouteFromContext" + ] + }, + "baseline_failing_tests": [], + "callers": [ + { + "symbol": "main::Router::NewRoute", + "truth": [ + "main::Router::BuildVarsFunc", + "main::Router::Handle", + "main::Router::HandleFunc", + "main::Router::Headers", + "main::Router::Host", + "main::Router::MatcherFunc", + "main::Router::Methods", + "main::Router::Name", + "main::Router::Path", + "main::Router::PathPrefix", + "main::Router::Queries", + "main::Router::Schemes" + ], + "found": [ + "main::Router::BuildVarsFunc", + "main::Router::Handle", + "main::Router::HandleFunc", + "main::Router::Headers", + "main::Router::Host", + "main::Router::MatcherFunc", + "main::Router::Methods", + "main::Router::Name", + "main::Router::Path", + "main::Router::PathPrefix", + "main::Router::Queries", + "main::Router::Schemes" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Route::Handler", + "truth": [ + "main::Route::HandlerFunc", + "main::Router::Handle" + ], + "found": [ + "main::Route::HandlerFunc", + "main::Router::Handle" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Route::GetMethods", + "truth": [ + "main::getAllMethodsForRoute" + ], + "found": [ + "main::getAllMethodsForRoute" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Route::HandlerFunc", + "truth": [ + "main::Router::HandleFunc" + ], + "found": [ + "main::Router::HandleFunc" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Route::GetHandlerWithMiddlewares", + "truth": [ + "main::Route::Match" + ], + "found": [ + "main::Route::Match" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + } + ], + "callers_common": [ + { + "symbol": "main::Route::Path", + "truth": [ + "main::Router::Handle", + "main::Router::HandleFunc", + "main::Router::Path" + ], + "found": [ + "main::Router::Handle", + "main::Router::HandleFunc", + "main::Router::Path" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Route::Schemes", + "truth": [ + "main::Router::Schemes" + ], + "found": [ + "main::Router::Schemes" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Route::Host", + "truth": [ + "main::Router::Host" + ], + "found": [ + "main::Router::Host" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Route::Headers", + "truth": [ + "main::Router::Headers" + ], + "found": [ + "main::Router::Headers" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Route::BuildVarsFunc", + "truth": [ + "main::Router::BuildVarsFunc" + ], + "found": [ + "main::Router::BuildVarsFunc" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Route::Queries", + "truth": [ + "main::Router::Queries" + ], + "found": [ + "main::Router::Queries" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Route::PathPrefix", + "truth": [ + "main::Router::PathPrefix" + ], + "found": [ + "main::Router::PathPrefix" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Route::Name", + "truth": [ + "main::Router::Name" + ], + "found": [ + "main::Router::Name" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Route::MatcherFunc", + "truth": [ + "main::Router::MatcherFunc" + ], + "found": [ + "main::Router::MatcherFunc" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::MiddlewareFunc::Middleware", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Route::Methods", + "truth": [ + "main::Router::Methods" + ], + "found": [ + "main::Router::Methods" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + } + ], + "callers_blind": [ + { + "symbol": "main::Router::OmitRouteFromContext", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Route::GetVarNames", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Route::Subrouter", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Router::NewRoute", + "truth": [ + "main::Router::BuildVarsFunc", + "main::Router::Handle", + "main::Router::HandleFunc", + "main::Router::Headers", + "main::Router::Host", + "main::Router::MatcherFunc", + "main::Router::Methods", + "main::Router::Name", + "main::Router::Path", + "main::Router::PathPrefix", + "main::Router::Queries", + "main::Router::Schemes" + ], + "found": [ + "main::Router::BuildVarsFunc", + "main::Router::Handle", + "main::Router::HandleFunc", + "main::Router::Headers", + "main::Router::Host", + "main::Router::MatcherFunc", + "main::Router::Methods", + "main::Router::Name", + "main::Router::Path", + "main::Router::PathPrefix", + "main::Router::Queries", + "main::Router::Schemes" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Route::GetQueriesRegexp", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Route::GetError", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Route::MetadataContains", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Router::Walk", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Route::HeadersRegexp", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Route::URLPath", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Vars", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::CORSMethodMiddleware", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Route::GetHostTemplate", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::CurrentRouter", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Router::HandleFunc", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Route::GetMetadataValueOr", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Route::GetQueriesTemplates", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Route::GetName", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Route::GetPathTemplate", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Route::Metadata", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::NewRouter", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Router::Handle", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Route::GetMetadata", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::CurrentRoute", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Route::GetMethods", + "truth": [ + "main::getAllMethodsForRoute" + ], + "found": [ + "main::getAllMethodsForRoute" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Router::GetRoute", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Route::URLHost", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Route::GetPathRegexp", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Route::GetHandlerWithMiddlewares", + "truth": [ + "main::Route::Match" + ], + "found": [ + "main::Route::Match" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Router::StrictSlash", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Route::GetHandler", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Router::UseEncodedPath", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Router::OmitRouterFromContext", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Route::GetMetadataValue", + "skipped": "compiler reported no uses" + } + ], + "rename": [ + { + "symbol": "main::Router::NewRoute", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "main::Route::Handler", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "doc.go:163:\t\t\tHandler: r,\nexample_authentication_middleware_test.go:24:func (amw *authenticationMiddleware) Middleware(next http.Handler) http.Handler {\nmiddleware.go:11:type MiddlewareFunc func(http.Handler) http.Handler\nmiddleware.go:15:\tMiddleware(handler http.Handler) http.Handler\nmiddlewar", + "detail": "" + }, + { + "symbol": "main::Route::GetMethods", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "main::Route::HandlerFunc", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "example_authentication_middleware_test.go:25:\treturn http.HandlerFunc(func(w http.ResponseWriter, r *http.Request) {\nmiddleware.go:57:\t\treturn http.HandlerFunc(func(w http.ResponseWriter, req *http.Request) {\nmiddleware_test.go:15:\treturn http.HandlerFunc(func(w http.ResponseWriter, r *http.Request)", + "detail": "" + }, + { + "symbol": "main::Route::GetHandlerWithMiddlewares", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + } + ], + "mutants": { + "7": [ + "main::Router::NewRoute", + "main::Route::Handler", + "main::Route::GetMethods", + "main::Route::HandlerFunc", + "main::Route::GetHandlerWithMiddlewares" + ], + "8": [ + "main::Route::GetMethods", + "main::Route::Handler", + "main::Route::GetHandlerWithMiddlewares", + "main::Router::NewRoute", + "main::Route::HandlerFunc" + ], + "9": [ + "main::Route::GetHandlerWithMiddlewares", + "main::Route::Handler", + "main::Route::GetMethods", + "main::Router::NewRoute", + "main::Route::HandlerFunc" + ] + }, + "tests": [ + { + "symbol": "main::Router::NewRoute", + "skipped": "mutant does not compile" + }, + { + "symbol": "main::Route::Handler", + "level": "name", + "truth": 36, + "predicted": 35, + "recall": 0.9722222222222222, + "precision": 1.0, + "top_hits": 10, + "top_n": 10, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [ + "ExampleCORSMethodMiddleware" + ], + "recall_graph_only": 0.9722222222222222 + }, + { + "symbol": "main::Route::GetMethods", + "level": "name", + "truth": 4, + "predicted": 3, + "recall": 0.75, + "precision": 1.0, + "top_hits": 3, + "top_n": 3, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [ + "ExampleCORSMethodMiddleware" + ], + "recall_graph_only": 0.75 + }, + { + "symbol": "main::Route::HandlerFunc", + "level": "name", + "truth": 33, + "predicted": 32, + "recall": 0.9696969696969697, + "precision": 1.0, + "top_hits": 10, + "top_n": 10, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [ + "ExampleCORSMethodMiddleware" + ], + "recall_graph_only": 0.9696969696969697 + }, + { + "symbol": "main::Route::GetHandlerWithMiddlewares", + "level": "name", + "truth": 40, + "predicted": 2, + "recall": 0.05, + "precision": 1.0, + "top_hits": 2, + "top_n": 2, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [ + "ExampleCORSMethodMiddleware", + "ExampleRoute_HeadersRegexp", + "ExampleRoute_HeadersRegexp_exactMatch", + "TestBuildVarsFunc", + "TestCORSMethodMiddleware", + "TestCORSMethodMiddlewareSubrouter", + "TestContextMiddleware", + "TestHeaders" + ], + "recall_graph_only": 0.025 + } + ], + "look": [ + { + "symbol": "main::Router::NewRoute", + "look_tokens": 324, + "file_tokens": 4980 + }, + { + "symbol": "main::Route::Handler", + "look_tokens": 225, + "file_tokens": 6100 + }, + { + "symbol": "main::Route::GetMethods", + "look_tokens": 251, + "file_tokens": 6100 + }, + { + "symbol": "main::Route::HandlerFunc", + "look_tokens": 246, + "file_tokens": 6100 + }, + { + "symbol": "main::Route::GetHandlerWithMiddlewares", + "look_tokens": 220, + "file_tokens": 6100 + } + ], + "seconds": 197, + "summary": { + "callers_recall": 1.0, + "callers_precision": 1.0, + "callers_checked": 5, + "blind_recall": 1.0, + "blind_checked": 3, + "common_recall": 1.0, + "common_precision": 1.0, + "common_recall_with_maybe": 1.0, + "common_checked": 10, + "rename_ok": 1.0, + "rename_checked": 5, + "tests_recall": 0.685, + "tests_precision": 1.0, + "tests_top10_precision": 1.0, + "tests_top10_best": 1.0, + "tests_caught": 1.0, + "tests_checked": 4, + "look_vs_file": 0.044 + }, + "summary_seeds": { + "7": { + "callers_recall": 1.0, + "callers_precision": 1.0, + "callers_checked": 5, + "blind_recall": 1.0, + "blind_checked": 1, + "common_recall": 1.0, + "common_precision": 1.0, + "common_recall_with_maybe": 1.0, + "common_checked": 10, + "rename_ok": 1.0, + "rename_checked": 5, + "tests_recall": 0.685, + "tests_precision": 1.0, + "tests_top10_precision": 1.0, + "tests_top10_best": 1.0, + "tests_caught": 1.0, + "tests_checked": 4, + "look_vs_file": 0.044 + }, + "8": { + "callers_recall": 1.0, + "callers_precision": 1.0, + "callers_checked": 5, + "blind_recall": 1.0, + "blind_checked": 1, + "common_recall": 1.0, + "common_precision": 1.0, + "common_recall_with_maybe": 1.0, + "common_checked": 10, + "rename_ok": 1.0, + "rename_checked": 5, + "tests_recall": 0.685, + "tests_precision": 1.0, + "tests_top10_precision": 1.0, + "tests_top10_best": 1.0, + "tests_caught": 1.0, + "tests_checked": 4, + "look_vs_file": 0.044 + }, + "9": { + "callers_recall": 1.0, + "callers_precision": 1.0, + "callers_checked": 5, + "blind_recall": 1.0, + "blind_checked": 1, + "common_recall": 1.0, + "common_precision": 1.0, + "common_recall_with_maybe": 1.0, + "common_checked": 10, + "rename_ok": 1.0, + "rename_checked": 5, + "tests_recall": 0.685, + "tests_precision": 1.0, + "tests_top10_precision": 1.0, + "tests_top10_best": 1.0, + "tests_caught": 1.0, + "tests_checked": 4, + "look_vs_file": 0.044 + } + }, + "noise": { + "callers_recall": { + "mean": 1.0, + "functions": 5, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.2 + }, + "callers_precision": { + "mean": 1.0, + "functions": 5, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.2 + }, + "blind_recall": { + "mean": 1.0, + "functions": 3, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.34 + }, + "common_recall": { + "mean": 1.0, + "functions": 10, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.1 + }, + "common_recall_with_maybe": { + "mean": 1.0, + "functions": 10, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.1 + }, + "common_precision": { + "mean": 1.0, + "functions": 10, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.1 + }, + "rename_ok": { + "mean": 1.0, + "functions": 5, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.2 + }, + "tests_recall": { + "mean": 0.685, + "functions": 4, + "boot_lo": 0.4, + "boot_hi": 0.97, + "boot_half": 0.285, + "seeds": [ + 0.685, + 0.685, + 0.685 + ], + "seed_sd": 0.0, + "threshold": 0.29 + }, + "tests_precision": { + "mean": 1.0, + "functions": 4, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.25 + }, + "tests_top10_precision": { + "mean": 1.0, + "functions": 4, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.25 + }, + "tests_top10_best": { + "mean": 1.0, + "functions": 4, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.25 + }, + "tests_caught": { + "mean": 1.0, + "functions": 4, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.25 + }, + "look_vs_file": { + "mean": 0.044, + "functions": 5, + "boot_lo": 0.038, + "boot_hi": 0.054, + "boot_half": 0.008, + "seeds": [ + 0.044, + 0.044, + 0.044 + ], + "seed_sd": 0.0, + "threshold": 0.01 + } + } + }, + { + "repo": "itsdangerous", + "lang": "python", + "commit": "672971d66a2e", + "index_seconds": 0.1, + "symbols": 79, + "files": 9, + "seeds": [ + 7, + 8, + 9 + ], + "edges": 611, + "sample": [ + "itsdangerous::encoding::base64_encode", + "itsdangerous::timed::TimestampSigner::timestamp_to_datetime", + "itsdangerous::serializer::is_text_serializer", + "itsdangerous::timed::TimestampSigner::get_timestamp", + "itsdangerous::signer::Signer::derive_key", + "itsdangerous::serializer::Serializer::make_signer", + "itsdangerous::encoding::want_bytes", + "itsdangerous::encoding::base64_decode" + ], + "sample_common": [], + "samples": { + "7": [ + "itsdangerous::encoding::base64_encode", + "itsdangerous::timed::TimestampSigner::timestamp_to_datetime", + "itsdangerous::serializer::is_text_serializer", + "itsdangerous::timed::TimestampSigner::get_timestamp", + "itsdangerous::signer::Signer::derive_key", + "itsdangerous::serializer::Serializer::make_signer", + "itsdangerous::encoding::want_bytes", + "itsdangerous::encoding::base64_decode" + ], + "8": [ + "itsdangerous::signer::Signer::derive_key", + "itsdangerous::timed::TimestampSigner::timestamp_to_datetime", + "itsdangerous::serializer::Serializer::make_signer", + "itsdangerous::encoding::want_bytes", + "itsdangerous::timed::TimestampSigner::get_timestamp", + "itsdangerous::encoding::base64_encode", + "itsdangerous::encoding::base64_decode", + "itsdangerous::serializer::is_text_serializer" + ], + "9": [ + "itsdangerous::timed::TimestampSigner::timestamp_to_datetime", + "itsdangerous::signer::Signer::derive_key", + "itsdangerous::serializer::is_text_serializer", + "itsdangerous::encoding::base64_decode", + "itsdangerous::encoding::want_bytes", + "itsdangerous::encoding::base64_encode", + "itsdangerous::serializer::Serializer::make_signer", + "itsdangerous::timed::TimestampSigner::get_timestamp" + ] + }, + "samples_common": { + "7": [], + "8": [], + "9": [] + }, + "samples_blind": { + "7": [], + "8": [], + "9": [] + }, + "baseline_failing_tests": [], + "callers": [], + "callers_common": [], + "callers_blind": [], + "rename": [ + { + "symbol": "itsdangerous::encoding::base64_encode", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "itsdangerous::timed::TimestampSigner::timestamp_to_datetime", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "itsdangerous::serializer::is_text_serializer", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "src/itsdangerous/serializer.py:220: self.is_text_serializer: bool = is_text_serializer_gnx(serializer)\nsrc/itsdangerous/serializer.py:254: is_text = self.is_text_serializer\nsrc/itsdangerous/serializer.py:317: if self.is_text_serializer:", + "detail": "" + }, + { + "symbol": "itsdangerous::timed::TimestampSigner::get_timestamp", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "itsdangerous::signer::Signer::derive_key", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "itsdangerous::serializer::Serializer::make_signer", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "itsdangerous::encoding::want_bytes", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "itsdangerous::encoding::base64_decode", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + } + ], + "mutants": { + "7": [ + "itsdangerous::encoding::base64_encode", + "itsdangerous::timed::TimestampSigner::timestamp_to_datetime", + "itsdangerous::serializer::is_text_serializer", + "itsdangerous::timed::TimestampSigner::get_timestamp", + "itsdangerous::signer::Signer::derive_key", + "itsdangerous::serializer::Serializer::make_signer", + "itsdangerous::encoding::want_bytes", + "itsdangerous::encoding::base64_decode" + ], + "8": [ + "itsdangerous::signer::Signer::derive_key", + "itsdangerous::timed::TimestampSigner::timestamp_to_datetime", + "itsdangerous::serializer::Serializer::make_signer", + "itsdangerous::encoding::want_bytes", + "itsdangerous::timed::TimestampSigner::get_timestamp", + "itsdangerous::encoding::base64_encode", + "itsdangerous::encoding::base64_decode", + "itsdangerous::serializer::is_text_serializer" + ], + "9": [ + "itsdangerous::timed::TimestampSigner::timestamp_to_datetime", + "itsdangerous::signer::Signer::derive_key", + "itsdangerous::serializer::is_text_serializer", + "itsdangerous::encoding::base64_decode", + "itsdangerous::encoding::want_bytes", + "itsdangerous::encoding::base64_encode", + "itsdangerous::serializer::Serializer::make_signer", + "itsdangerous::timed::TimestampSigner::get_timestamp" + ] + }, + "tests": [ + { + "symbol": "itsdangerous::encoding::base64_encode", + "level": "id", + "truth": 59, + "predicted": 4, + "recall": 0.01694915254237288, + "precision": 0.25, + "top_hits": 1, + "top_n": 4, + "top_precision": 0.25, + "top_best": 0.25, + "caught": 1.0, + "missed": [ + "tests/test_itsdangerous/test_serializer.py::test_alt_salt", + "tests/test_itsdangerous/test_serializer.py::test_bad_payload_exception", + "tests/test_itsdangerous/test_serializer.py::test_bad_signature_exception", + "tests/test_itsdangerous/test_serializer.py::test_changed_value", + "tests/test_itsdangerous/test_serializer.py::test_digests", + "tests/test_itsdangerous/test_serializer.py::test_fallback_signers", + "tests/test_itsdangerous/test_serializer.py::test_file", + "tests/test_itsdangerous/test_serializer.py::test_loads_unsafe" + ], + "recall_graph_only": 0.01694915254237288 + }, + { + "symbol": "itsdangerous::timed::TimestampSigner::timestamp_to_datetime", + "level": "id", + "truth": 31, + "predicted": 16, + "recall": 0.16129032258064516, + "precision": 0.3125, + "top_hits": 5, + "top_n": 10, + "top_precision": 0.5, + "top_best": 0.5, + "caught": 1.0, + "missed": [ + "tests/test_itsdangerous/test_timed.py::test_alt_salt", + "tests/test_itsdangerous/test_timed.py::test_bad_payload_exception", + "tests/test_itsdangerous/test_timed.py::test_bad_signature_exception", + "tests/test_itsdangerous/test_timed.py::test_broken_signature", + "tests/test_itsdangerous/test_timed.py::test_changed_value", + "tests/test_itsdangerous/test_timed.py::test_fallback_signers", + "tests/test_itsdangerous/test_timed.py::test_file", + "tests/test_itsdangerous/test_timed.py::test_loads_unsafe" + ], + "recall_graph_only": 0.16129032258064516 + }, + { + "symbol": "itsdangerous::serializer::is_text_serializer", + "level": "id", + "truth": 41, + "predicted": 13, + "recall": 0.3170731707317073, + "precision": 1.0, + "top_hits": 10, + "top_n": 10, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [ + "tests/test_itsdangerous/test_timed.py::test_alt_salt", + "tests/test_itsdangerous/test_timed.py::test_bad_payload_exception", + "tests/test_itsdangerous/test_timed.py::test_bad_signature_exception", + "tests/test_itsdangerous/test_timed.py::test_changed_value", + "tests/test_itsdangerous/test_timed.py::test_fallback_signers", + "tests/test_itsdangerous/test_timed.py::test_file", + "tests/test_itsdangerous/test_timed.py::test_iter_unsigners", + "tests/test_itsdangerous/test_timed.py::test_loads_unsafe" + ], + "recall_graph_only": 0.024390243902439025 + }, + { + "symbol": "itsdangerous::timed::TimestampSigner::get_timestamp", + "level": "id", + "truth": 35, + "predicted": 9, + "recall": 0.14285714285714285, + "precision": 0.5555555555555556, + "top_hits": 5, + "top_n": 9, + "top_precision": 0.5555555555555556, + "top_best": 0.5555555555555556, + "caught": 1.0, + "missed": [ + "tests/test_itsdangerous/test_timed.py::test_algorithm", + "tests/test_itsdangerous/test_timed.py::test_alt_salt", + "tests/test_itsdangerous/test_timed.py::test_bad_payload_exception", + "tests/test_itsdangerous/test_timed.py::test_bad_signature_exception", + "tests/test_itsdangerous/test_timed.py::test_broken_signature", + "tests/test_itsdangerous/test_timed.py::test_changed_value", + "tests/test_itsdangerous/test_timed.py::test_digest_method", + "tests/test_itsdangerous/test_timed.py::test_fallback_signers" + ], + "recall_graph_only": 0.0 + }, + { + "symbol": "itsdangerous::signer::Signer::derive_key", + "level": "id", + "truth": 61, + "predicted": 11, + "recall": 0.14754098360655737, + "precision": 0.8181818181818182, + "top_hits": 9, + "top_n": 10, + "top_precision": 0.9, + "top_best": 0.9, + "caught": 1.0, + "missed": [ + "tests/test_itsdangerous/test_serializer.py::test_alt_salt", + "tests/test_itsdangerous/test_serializer.py::test_bad_payload_exception", + "tests/test_itsdangerous/test_serializer.py::test_bad_signature_exception", + "tests/test_itsdangerous/test_serializer.py::test_changed_value", + "tests/test_itsdangerous/test_serializer.py::test_digests", + "tests/test_itsdangerous/test_serializer.py::test_fallback_signers", + "tests/test_itsdangerous/test_serializer.py::test_file", + "tests/test_itsdangerous/test_serializer.py::test_loads_unsafe" + ], + "recall_graph_only": 0.01639344262295082 + }, + { + "symbol": "itsdangerous::serializer::Serializer::make_signer", + "level": "id", + "truth": 41, + "predicted": 13, + "recall": 0.3170731707317073, + "precision": 1.0, + "top_hits": 10, + "top_n": 10, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [ + "tests/test_itsdangerous/test_timed.py::test_alt_salt", + "tests/test_itsdangerous/test_timed.py::test_bad_payload_exception", + "tests/test_itsdangerous/test_timed.py::test_bad_signature_exception", + "tests/test_itsdangerous/test_timed.py::test_changed_value", + "tests/test_itsdangerous/test_timed.py::test_fallback_signers", + "tests/test_itsdangerous/test_timed.py::test_file", + "tests/test_itsdangerous/test_timed.py::test_iter_unsigners", + "tests/test_itsdangerous/test_timed.py::test_loads_unsafe" + ], + "recall_graph_only": 0.04878048780487805 + }, + { + "symbol": "itsdangerous::encoding::want_bytes", + "level": "id", + "truth": 69, + "predicted": 5, + "recall": 0.057971014492753624, + "precision": 0.8, + "top_hits": 4, + "top_n": 5, + "top_precision": 0.8, + "top_best": 0.8, + "caught": 1.0, + "missed": [ + "tests/test_itsdangerous/test_serializer.py::test_alt_salt", + "tests/test_itsdangerous/test_serializer.py::test_bad_payload_exception", + "tests/test_itsdangerous/test_serializer.py::test_bad_signature_exception", + "tests/test_itsdangerous/test_serializer.py::test_changed_value", + "tests/test_itsdangerous/test_serializer.py::test_digests", + "tests/test_itsdangerous/test_serializer.py::test_fallback_signers", + "tests/test_itsdangerous/test_serializer.py::test_file", + "tests/test_itsdangerous/test_serializer.py::test_iter_unsigners" + ], + "recall_graph_only": 0.057971014492753624 + }, + { + "symbol": "itsdangerous::encoding::base64_decode", + "level": "id", + "truth": 53, + "predicted": 17, + "recall": 0.2830188679245283, + "precision": 0.8823529411764706, + "top_hits": 8, + "top_n": 10, + "top_precision": 0.8, + "top_best": 1.0, + "caught": 1.0, + "missed": [ + "tests/test_itsdangerous/test_serializer.py::test_alt_salt", + "tests/test_itsdangerous/test_serializer.py::test_bad_payload_exception", + "tests/test_itsdangerous/test_serializer.py::test_changed_value", + "tests/test_itsdangerous/test_serializer.py::test_fallback_signers", + "tests/test_itsdangerous/test_serializer.py::test_loads_unsafe", + "tests/test_itsdangerous/test_serializer.py::test_serializer", + "tests/test_itsdangerous/test_serializer.py::test_serializer_kwargs", + "tests/test_itsdangerous/test_serializer.py::test_signer_cls" + ], + "recall_graph_only": 0.2830188679245283 + } + ], + "look": [ + { + "symbol": "itsdangerous::encoding::base64_encode", + "look_tokens": 257, + "file_tokens": 353 + }, + { + "symbol": "itsdangerous::timed::TimestampSigner::timestamp_to_datetime", + "look_tokens": 496, + "file_tokens": 2022 + }, + { + "symbol": "itsdangerous::serializer::is_text_serializer", + "look_tokens": 423, + "file_tokens": 3891 + }, + { + "symbol": "itsdangerous::timed::TimestampSigner::get_timestamp", + "look_tokens": 394, + "file_tokens": 2022 + }, + { + "symbol": "itsdangerous::signer::Signer::derive_key", + "look_tokens": 696, + "file_tokens": 2412 + }, + { + "symbol": "itsdangerous::serializer::Serializer::make_signer", + "look_tokens": 447, + "file_tokens": 3891 + }, + { + "symbol": "itsdangerous::encoding::want_bytes", + "look_tokens": 322, + "file_tokens": 353 + }, + { + "symbol": "itsdangerous::encoding::base64_decode", + "look_tokens": 483, + "file_tokens": 353 + } + ], + "seconds": 45, + "summary": { + "callers_recall": null, + "callers_precision": null, + "callers_checked": 0, + "blind_recall": null, + "blind_checked": 0, + "common_recall": null, + "common_precision": null, + "common_recall_with_maybe": null, + "common_checked": 0, + "rename_ok": 1.0, + "rename_checked": 8, + "tests_recall": 0.18, + "tests_precision": 0.702, + "tests_top10_precision": 0.726, + "tests_top10_best": 0.751, + "tests_caught": 1.0, + "tests_checked": 8, + "look_vs_file": 0.495 + }, + "summary_seeds": { + "7": { + "callers_recall": null, + "callers_precision": null, + "callers_checked": 0, + "blind_recall": null, + "blind_checked": 0, + "common_recall": null, + "common_precision": null, + "common_recall_with_maybe": null, + "common_checked": 0, + "rename_ok": 1.0, + "rename_checked": 8, + "tests_recall": 0.18, + "tests_precision": 0.702, + "tests_top10_precision": 0.726, + "tests_top10_best": 0.751, + "tests_caught": 1.0, + "tests_checked": 8, + "look_vs_file": 0.495 + }, + "8": { + "callers_recall": null, + "callers_precision": null, + "callers_checked": 0, + "blind_recall": null, + "blind_checked": 0, + "common_recall": null, + "common_precision": null, + "common_recall_with_maybe": null, + "common_checked": 0, + "rename_ok": 1.0, + "rename_checked": 8, + "tests_recall": 0.18, + "tests_precision": 0.702, + "tests_top10_precision": 0.726, + "tests_top10_best": 0.751, + "tests_caught": 1.0, + "tests_checked": 8, + "look_vs_file": 0.495 + }, + "9": { + "callers_recall": null, + "callers_precision": null, + "callers_checked": 0, + "blind_recall": null, + "blind_checked": 0, + "common_recall": null, + "common_precision": null, + "common_recall_with_maybe": null, + "common_checked": 0, + "rename_ok": 1.0, + "rename_checked": 8, + "tests_recall": 0.18, + "tests_precision": 0.702, + "tests_top10_precision": 0.726, + "tests_top10_best": 0.751, + "tests_caught": 1.0, + "tests_checked": 8, + "look_vs_file": 0.495 + } + }, + "noise": { + "callers_recall": null, + "callers_precision": null, + "blind_recall": null, + "common_recall": null, + "common_recall_with_maybe": null, + "common_precision": null, + "rename_ok": { + "mean": 1.0, + "functions": 8, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.13 + }, + "tests_recall": { + "mean": 0.18, + "functions": 8, + "boot_lo": 0.117, + "boot_hi": 0.243, + "boot_half": 0.063, + "seeds": [ + 0.18, + 0.18, + 0.18 + ], + "seed_sd": 0.0, + "threshold": 0.13 + }, + "tests_precision": { + "mean": 0.702, + "functions": 8, + "boot_lo": 0.535, + "boot_hi": 0.856, + "boot_half": 0.161, + "seeds": [ + 0.702, + 0.702, + 0.702 + ], + "seed_sd": 0.0, + "threshold": 0.17 + }, + "tests_top10_precision": { + "mean": 0.726, + "functions": 8, + "boot_lo": 0.571, + "boot_hi": 0.863, + "boot_half": 0.146, + "seeds": [ + 0.726, + 0.726, + 0.726 + ], + "seed_sd": 0.0, + "threshold": 0.15 + }, + "tests_top10_best": { + "mean": 0.751, + "functions": 8, + "boot_lo": 0.588, + "boot_hi": 0.894, + "boot_half": 0.153, + "seeds": [ + 0.751, + 0.751, + 0.751 + ], + "seed_sd": 0.0, + "threshold": 0.16 + }, + "tests_caught": { + "mean": 1.0, + "functions": 8, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.13 + }, + "look_vs_file": { + "mean": 0.495, + "functions": 8, + "boot_lo": 0.266, + "boot_hi": 0.756, + "boot_half": 0.245, + "seeds": [ + 0.495, + 0.495, + 0.495 + ], + "seed_sd": 0.0, + "threshold": 0.25 + } + } + }, + { + "repo": "more-itertools", + "lang": "python", + "commit": "ceafee8ce96f", + "index_seconds": 0.1, + "symbols": 596, + "files": 7, + "seeds": [ + 7, + 8, + 9 + ], + "edges": 6891, + "sample": [ + "more_itertools::more::dl_split", + "more_itertools::more::dl_mul" + ], + "sample_common": [], + "samples": { + "7": [ + "more_itertools::more::dl_split", + "more_itertools::more::dl_mul" + ], + "8": [ + "more_itertools::more::dl_mul", + "more_itertools::more::dl_split" + ], + "9": [ + "more_itertools::more::dl_split", + "more_itertools::more::dl_mul" + ] + }, + "samples_common": { + "7": [], + "8": [], + "9": [] + }, + "samples_blind": { + "7": [], + "8": [], + "9": [] + }, + "baseline_failing_tests": [], + "callers": [], + "callers_common": [], + "callers_blind": [], + "rename": [ + { + "symbol": "more_itertools::more::dl_split", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "more_itertools::more::dl_mul", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + } + ], + "mutants": { + "7": [ + "more_itertools::more::dl_split", + "more_itertools::more::dl_mul" + ], + "8": [ + "more_itertools::more::dl_mul", + "more_itertools::more::dl_split" + ], + "9": [ + "more_itertools::more::dl_split", + "more_itertools::more::dl_mul" + ] + }, + "tests": [ + { + "symbol": "more_itertools::more::dl_split", + "skipped": "no test fails when it throws", + "predicted": 426 + }, + { + "symbol": "more_itertools::more::dl_mul", + "skipped": "no test fails when it throws", + "predicted": 426 + } + ], + "look": [ + { + "symbol": "more_itertools::more::dl_split", + "look_tokens": 322, + "file_tokens": 44028 + }, + { + "symbol": "more_itertools::more::dl_mul", + "look_tokens": 325, + "file_tokens": 44028 + } + ], + "seconds": 65, + "summary": { + "callers_recall": null, + "callers_precision": null, + "callers_checked": 0, + "blind_recall": null, + "blind_checked": 0, + "common_recall": null, + "common_precision": null, + "common_recall_with_maybe": null, + "common_checked": 0, + "rename_ok": 1.0, + "rename_checked": 2, + "tests_recall": null, + "tests_precision": null, + "tests_top10_precision": null, + "tests_top10_best": null, + "tests_caught": null, + "tests_checked": 0, + "look_vs_file": 0.007 + }, + "summary_seeds": { + "7": { + "callers_recall": null, + "callers_precision": null, + "callers_checked": 0, + "blind_recall": null, + "blind_checked": 0, + "common_recall": null, + "common_precision": null, + "common_recall_with_maybe": null, + "common_checked": 0, + "rename_ok": 1.0, + "rename_checked": 2, + "tests_recall": null, + "tests_precision": null, + "tests_top10_precision": null, + "tests_top10_best": null, + "tests_caught": null, + "tests_checked": 0, + "look_vs_file": 0.007 + }, + "8": { + "callers_recall": null, + "callers_precision": null, + "callers_checked": 0, + "blind_recall": null, + "blind_checked": 0, + "common_recall": null, + "common_precision": null, + "common_recall_with_maybe": null, + "common_checked": 0, + "rename_ok": 1.0, + "rename_checked": 2, + "tests_recall": null, + "tests_precision": null, + "tests_top10_precision": null, + "tests_top10_best": null, + "tests_caught": null, + "tests_checked": 0, + "look_vs_file": 0.007 + }, + "9": { + "callers_recall": null, + "callers_precision": null, + "callers_checked": 0, + "blind_recall": null, + "blind_checked": 0, + "common_recall": null, + "common_precision": null, + "common_recall_with_maybe": null, + "common_checked": 0, + "rename_ok": 1.0, + "rename_checked": 2, + "tests_recall": null, + "tests_precision": null, + "tests_top10_precision": null, + "tests_top10_best": null, + "tests_caught": null, + "tests_checked": 0, + "look_vs_file": 0.007 + } + }, + "noise": { + "callers_recall": null, + "callers_precision": null, + "blind_recall": null, + "common_recall": null, + "common_recall_with_maybe": null, + "common_precision": null, + "rename_ok": { + "mean": 1.0, + "functions": 2, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.5 + }, + "tests_recall": null, + "tests_precision": null, + "tests_top10_precision": null, + "tests_top10_best": null, + "tests_caught": null, + "look_vs_file": { + "mean": 0.007, + "functions": 2, + "boot_lo": 0.007, + "boot_hi": 0.007, + "boot_half": 0.0, + "seeds": [ + 0.007, + 0.007, + 0.007 + ], + "seed_sd": 0.0, + "threshold": 0.01 + } + } + }, + { + "repo": "byteorder", + "lang": "rust", + "commit": "5a82625fae46", + "index_seconds": 0.4, + "symbols": 198, + "files": 3, + "seeds": [ + 7, + 8, + 9 + ], + "edges": 738, + "sample": [], + "sample_common": [ + "byteorder::io::ReadBytesExt::read_f64_into", + "byteorder::ByteOrder::read_f32_into", + "byteorder::ByteOrder::read_int", + "byteorder::ByteOrder::write_int", + "byteorder::ByteOrder::read_f64_into" + ], + "samples": { + "7": [], + "8": [], + "9": [] + }, + "samples_common": { + "7": [ + "byteorder::io::ReadBytesExt::read_f64_into", + "byteorder::ByteOrder::read_f32_into", + "byteorder::ByteOrder::read_int", + "byteorder::ByteOrder::write_int" + ], + "8": [ + "byteorder::ByteOrder::read_f64_into", + "byteorder::ByteOrder::write_int", + "byteorder::ByteOrder::read_f32_into", + "byteorder::ByteOrder::read_int" + ], + "9": [ + "byteorder::ByteOrder::write_int", + "byteorder::io::ReadBytesExt::read_f64_into", + "byteorder::ByteOrder::read_int", + "byteorder::ByteOrder::read_f32_into" + ] + }, + "samples_blind": { + "7": [ + "byteorder::io::WriteBytesExt::write_u8", + "byteorder::ByteOrder::from_slice_i64", + "byteorder::ByteOrder::write_i32_into", + "byteorder::ByteOrder::write_i128_into", + "byteorder::ByteOrder::from_slice_i32", + "byteorder::ByteOrder::write_f64_into", + "byteorder::io::WriteBytesExt::write_i8", + "byteorder::ByteOrder::write_i8_into", + "byteorder::ByteOrder::from_slice_i16", + "byteorder::ByteOrder::write_i64_into", + "byteorder::io::ReadBytesExt::read_i8", + "byteorder::io::ReadBytesExt::read_u8", + "byteorder::ByteOrder::from_slice_i128", + "byteorder::ByteOrder::write_i16_into", + "byteorder::io::ReadBytesExt::read_i8_into", + "byteorder::ByteOrder::write_f32_into" + ], + "8": [ + "byteorder::ByteOrder::from_slice_i64", + "byteorder::ByteOrder::write_f32_into", + "byteorder::ByteOrder::write_i64_into", + "byteorder::ByteOrder::from_slice_i128", + "byteorder::ByteOrder::write_i128_into", + "byteorder::io::WriteBytesExt::write_i8", + "byteorder::ByteOrder::from_slice_i32", + "byteorder::ByteOrder::write_f64_into", + "byteorder::ByteOrder::from_slice_i16", + "byteorder::io::ReadBytesExt::read_i8", + "byteorder::io::ReadBytesExt::read_u8", + "byteorder::io::WriteBytesExt::write_u8", + "byteorder::io::ReadBytesExt::read_i8_into", + "byteorder::ByteOrder::write_i16_into", + "byteorder::ByteOrder::write_i8_into", + "byteorder::ByteOrder::write_i32_into" + ], + "9": [ + "byteorder::io::WriteBytesExt::write_u8", + "byteorder::io::ReadBytesExt::read_i8", + "byteorder::ByteOrder::write_i16_into", + "byteorder::ByteOrder::write_i64_into", + "byteorder::ByteOrder::write_f32_into", + "byteorder::ByteOrder::from_slice_i128", + "byteorder::ByteOrder::from_slice_i16", + "byteorder::ByteOrder::write_i32_into", + "byteorder::ByteOrder::from_slice_i32", + "byteorder::io::ReadBytesExt::read_u8", + "byteorder::ByteOrder::write_f64_into", + "byteorder::io::ReadBytesExt::read_i8_into", + "byteorder::io::WriteBytesExt::write_i8", + "byteorder::ByteOrder::write_i8_into", + "byteorder::ByteOrder::write_i128_into", + "byteorder::ByteOrder::from_slice_i64" + ] + }, + "baseline_failing_tests": [], + "callers": [], + "callers_common": [ + { + "symbol": "byteorder::io::ReadBytesExt::read_f64_into", + "truth": [ + "byteorder::ByteOrder::read_f64_into", + "byteorder::ByteOrder::read_f64_into_unchecked", + "byteorder::io::ReadBytesExt::read_f64_into_unchecked" + ], + "found": [ + "byteorder::io::ReadBytesExt::read_f64_into_unchecked" + ], + "maybe": [], + "import_files": [ + "src/lib.rs" + ], + "recall": 0.3333333333333333, + "precision": 1.0, + "recall_with_maybe": 0.3333333333333333 + }, + { + "symbol": "byteorder::ByteOrder::read_f32_into", + "truth": [ + "byteorder::ByteOrder::read_f32_into_unchecked" + ], + "found": [ + "byteorder::ByteOrder::read_f32_into_unchecked" + ], + "maybe": [], + "import_files": [ + "src/lib.rs" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "byteorder::ByteOrder::read_int", + "truth": [ + "byteorder::ByteOrder::read_i24", + "byteorder::ByteOrder::read_i48", + "byteorder::io::ReadBytesExt::read_int" + ], + "found": [ + "byteorder::ByteOrder::read_i24", + "byteorder::ByteOrder::read_i48" + ], + "maybe": [], + "import_files": [ + "src/lib.rs" + ], + "recall": 0.6666666666666666, + "precision": 1.0, + "recall_with_maybe": 0.6666666666666666 + }, + { + "symbol": "byteorder::ByteOrder::write_int", + "truth": [ + "byteorder::ByteOrder::write_i24", + "byteorder::ByteOrder::write_i48", + "byteorder::io::WriteBytesExt::write_int" + ], + "found": [ + "byteorder::ByteOrder::write_i24", + "byteorder::ByteOrder::write_i48" + ], + "maybe": [], + "import_files": [ + "src/lib.rs" + ], + "recall": 0.6666666666666666, + "precision": 1.0, + "recall_with_maybe": 0.6666666666666666 + }, + { + "symbol": "byteorder::ByteOrder::read_f64_into", + "truth": [ + "byteorder::ByteOrder::read_f64_into_unchecked" + ], + "found": [ + "byteorder::ByteOrder::read_f64_into_unchecked" + ], + "maybe": [], + "import_files": [ + "src/lib.rs" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + } + ], + "callers_blind": [ + { + "symbol": "byteorder::io::WriteBytesExt::write_u8", + "skipped": "compiler reported no uses" + }, + { + "symbol": "byteorder::ByteOrder::from_slice_i64", + "truth": [ + "byteorder::io::ReadBytesExt::read_i64_into" + ], + "found": [], + "maybe": [], + "import_files": [], + "recall": 0.0, + "precision": null, + "recall_with_maybe": 0.0 + }, + { + "symbol": "byteorder::ByteOrder::write_i32_into", + "truth": [], + "found": [], + "maybe": [], + "import_files": [ + "src/lib.rs" + ], + "recall": null, + "precision": null, + "recall_with_maybe": null + }, + { + "symbol": "byteorder::ByteOrder::write_i128_into", + "truth": [], + "found": [], + "maybe": [], + "import_files": [ + "src/lib.rs" + ], + "recall": null, + "precision": null, + "recall_with_maybe": null + }, + { + "symbol": "byteorder::ByteOrder::from_slice_i32", + "truth": [ + "byteorder::io::ReadBytesExt::read_i32_into" + ], + "found": [], + "maybe": [], + "import_files": [], + "recall": 0.0, + "precision": null, + "recall_with_maybe": 0.0 + }, + { + "symbol": "byteorder::ByteOrder::write_f64_into", + "truth": [], + "found": [], + "maybe": [], + "import_files": [ + "src/lib.rs" + ], + "recall": null, + "precision": null, + "recall_with_maybe": null + }, + { + "symbol": "byteorder::io::WriteBytesExt::write_i8", + "skipped": "compiler reported no uses" + }, + { + "symbol": "byteorder::ByteOrder::write_i8_into", + "skipped": "compiler reported no uses" + }, + { + "symbol": "byteorder::ByteOrder::from_slice_i16", + "truth": [ + "byteorder::io::ReadBytesExt::read_i16_into" + ], + "found": [], + "maybe": [], + "import_files": [], + "recall": 0.0, + "precision": null, + "recall_with_maybe": 0.0 + }, + { + "symbol": "byteorder::ByteOrder::write_i64_into", + "truth": [], + "found": [], + "maybe": [], + "import_files": [ + "src/lib.rs" + ], + "recall": null, + "precision": null, + "recall_with_maybe": null + }, + { + "symbol": "byteorder::io::ReadBytesExt::read_i8", + "skipped": "compiler reported no uses" + }, + { + "symbol": "byteorder::io::ReadBytesExt::read_u8", + "skipped": "compiler reported no uses" + }, + { + "symbol": "byteorder::ByteOrder::from_slice_i128", + "truth": [ + "byteorder::io::ReadBytesExt::read_i128_into" + ], + "found": [], + "maybe": [], + "import_files": [], + "recall": 0.0, + "precision": null, + "recall_with_maybe": 0.0 + }, + { + "symbol": "byteorder::ByteOrder::write_i16_into", + "truth": [], + "found": [], + "maybe": [], + "import_files": [ + "src/lib.rs" + ], + "recall": null, + "precision": null, + "recall_with_maybe": null + }, + { + "symbol": "byteorder::io::ReadBytesExt::read_i8_into", + "skipped": "compiler reported no uses" + }, + { + "symbol": "byteorder::ByteOrder::write_f32_into", + "truth": [], + "found": [], + "maybe": [], + "import_files": [ + "src/lib.rs" + ], + "recall": null, + "precision": null, + "recall_with_maybe": null + } + ], + "rename": [], + "mutants": { + "7": [], + "8": [], + "9": [] + }, + "tests": [], + "look": [], + "seconds": 2, + "summary": { + "callers_recall": null, + "callers_precision": null, + "callers_checked": 0, + "blind_recall": 0.0, + "blind_checked": 4, + "common_recall": 0.733, + "common_precision": 1.0, + "common_recall_with_maybe": 0.733, + "common_checked": 5, + "rename_ok": null, + "rename_checked": 0, + "tests_recall": null, + "tests_precision": null, + "tests_top10_precision": null, + "tests_top10_best": null, + "tests_caught": null, + "tests_checked": 0, + "look_vs_file": null + }, + "summary_seeds": { + "7": { + "callers_recall": null, + "callers_precision": null, + "callers_checked": 0, + "blind_recall": 0.0, + "blind_checked": 4, + "common_recall": 0.667, + "common_precision": 1.0, + "common_recall_with_maybe": 0.667, + "common_checked": 4, + "rename_ok": null, + "rename_checked": 0, + "tests_recall": null, + "tests_precision": null, + "tests_top10_precision": null, + "tests_top10_best": null, + "tests_caught": null, + "tests_checked": 0, + "look_vs_file": null + }, + "8": { + "callers_recall": null, + "callers_precision": null, + "callers_checked": 0, + "blind_recall": 0.0, + "blind_checked": 4, + "common_recall": 0.833, + "common_precision": 1.0, + "common_recall_with_maybe": 0.833, + "common_checked": 4, + "rename_ok": null, + "rename_checked": 0, + "tests_recall": null, + "tests_precision": null, + "tests_top10_precision": null, + "tests_top10_best": null, + "tests_caught": null, + "tests_checked": 0, + "look_vs_file": null + }, + "9": { + "callers_recall": null, + "callers_precision": null, + "callers_checked": 0, + "blind_recall": 0.0, + "blind_checked": 4, + "common_recall": 0.667, + "common_precision": 1.0, + "common_recall_with_maybe": 0.667, + "common_checked": 4, + "rename_ok": null, + "rename_checked": 0, + "tests_recall": null, + "tests_precision": null, + "tests_top10_precision": null, + "tests_top10_best": null, + "tests_caught": null, + "tests_checked": 0, + "look_vs_file": null + } + }, + "noise": { + "callers_recall": null, + "callers_precision": null, + "blind_recall": { + "mean": 0.0, + "functions": 4, + "boot_lo": 0.0, + "boot_hi": 0.0, + "boot_half": 0.0, + "seeds": [ + 0.0, + 0.0, + 0.0 + ], + "seed_sd": 0.0, + "threshold": 0.25 + }, + "common_recall": { + "mean": 0.733, + "functions": 5, + "boot_lo": 0.533, + "boot_hi": 0.933, + "boot_half": 0.2, + "seeds": [ + 0.667, + 0.833, + 0.667 + ], + "seed_sd": 0.096, + "threshold": 0.2 + }, + "common_recall_with_maybe": { + "mean": 0.733, + "functions": 5, + "boot_lo": 0.533, + "boot_hi": 0.933, + "boot_half": 0.2, + "seeds": [ + 0.667, + 0.833, + 0.667 + ], + "seed_sd": 0.096, + "threshold": 0.2 + }, + "common_precision": { + "mean": 1.0, + "functions": 5, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.2 + }, + "rename_ok": null, + "tests_recall": null, + "tests_precision": null, + "tests_top10_precision": null, + "tests_top10_best": null, + "tests_caught": null, + "look_vs_file": null + } + }, + { + "repo": "either", + "lang": "rust", + "commit": "1e4326df5972", + "index_seconds": 0.3, + "symbols": 150, + "files": 5, + "seeds": [ + 7, + 8, + 9 + ], + "edges": 512, + "sample": [ + "either::Either::as_pin_mut", + "either::Either::is_left" + ], + "sample_common": [], + "samples": { + "7": [ + "either::Either::as_pin_mut", + "either::Either::is_left" + ], + "8": [ + "either::Either::as_pin_mut", + "either::Either::is_left" + ], + "9": [ + "either::Either::is_left", + "either::Either::as_pin_mut" + ] + }, + "samples_common": { + "7": [], + "8": [], + "9": [] + }, + "samples_blind": { + "7": [ + "either::Either::inspect_left", + "either::Either::right_or_default", + "either::Either::map_left_or", + "either::Either::map_right_or", + "either::Either::as_pin_mut", + "either::Either::factor_second", + "either::Either::flip", + "either::Either::map_either", + "either::Either::left_or_else", + "either::Either::unwrap_right", + "either::Either::inspect_right", + "either::Either::factor_none", + "either::Either::factor_iter_mut", + "either::Either::right", + "either::into_either::IntoEither::into_either_with", + "either::Either::right_and_then", + "either::Either::left_and", + "either::Either::map_left", + "either::Either::factor_first", + "either::Either::iter" + ], + "8": [ + "either::Either::either_into", + "either::Either::is_left_or", + "either::Either::as_pin_mut", + "either::Either::right_and", + "either::Either::factor_second", + "either::Either::expect_right", + "either::Either::unwrap_right", + "either::Either::right_and_then", + "either::Either::map_either_with", + "either::Either::flip", + "either::Either::as_pin_ref", + "either::Either::factor_iter_mut", + "either::Either::into_inner", + "either::Either::left_and", + "either::Either::unwrap_left", + "either::Either::left_and_then", + "either::Either::is_right_and", + "either::Either::factor_iter", + "either::Either::right_or_default", + "either::Either::expect_left" + ], + "9": [ + "either::Either::factor_err", + "either::Either::unwrap_right", + "either::Either::factor_into_iter", + "either::Either::map_left_or", + "either::Either::either_into", + "either::Either::iter_mut", + "either::Either::left_and", + "either::Either::right_and", + "either::Either::left_or_else", + "either::Either::right_and_then", + "either::Either::right_or_default", + "either::Either::map_right_or", + "either::Either::factor_none", + "either::Either::factor_ok", + "either::Either::factor_second", + "either::Either::is_right", + "either::Either::as_pin_ref", + "either::Either::expect_right", + "either::Either::map_left", + "either::Either::right_or_else" + ] + }, + "baseline_failing_tests": [], + "callers": [ + { + "symbol": "either::Either::as_pin_mut", + "truth": [ + "either::Either::poll" + ], + "found": [ + "either::Either::poll" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "either::Either::is_left", + "truth": [ + "either::Either::is_right" + ], + "found": [ + "either::Either::is_right" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + } + ], + "callers_common": [], + "callers_blind": [ + { + "symbol": "either::Either::inspect_left", + "skipped": "compiler reported no uses" + }, + { + "symbol": "either::Either::right_or_default", + "skipped": "compiler reported no uses" + }, + { + "symbol": "either::Either::map_left_or", + "skipped": "compiler reported no uses" + }, + { + "symbol": "either::Either::map_right_or", + "skipped": "compiler reported no uses" + }, + { + "symbol": "either::Either::as_pin_mut", + "truth": [ + "either::Either::poll" + ], + "found": [ + "either::Either::poll" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "either::Either::factor_second", + "skipped": "compiler reported no uses" + }, + { + "symbol": "either::Either::flip", + "skipped": "compiler reported no uses" + }, + { + "symbol": "either::Either::map_either", + "skipped": "compiler reported no uses" + }, + { + "symbol": "either::Either::left_or_else", + "skipped": "compiler reported no uses" + }, + { + "symbol": "either::Either::unwrap_right", + "skipped": "compiler reported no uses" + }, + { + "symbol": "either::Either::inspect_right", + "skipped": "compiler reported no uses" + }, + { + "symbol": "either::Either::factor_none", + "skipped": "compiler reported no uses" + }, + { + "symbol": "either::Either::factor_iter_mut", + "skipped": "compiler reported no uses" + }, + { + "symbol": "either::Either::right", + "truth": [], + "found": [], + "maybe": [], + "import_files": [ + "src/lib.rs" + ], + "recall": null, + "precision": null, + "recall_with_maybe": null + }, + { + "symbol": "either::into_either::IntoEither::into_either_with", + "skipped": "compiler reported no uses" + }, + { + "symbol": "either::Either::right_and_then", + "skipped": "compiler reported no uses" + }, + { + "symbol": "either::Either::left_and", + "skipped": "compiler reported no uses" + }, + { + "symbol": "either::Either::map_left", + "skipped": "compiler reported no uses" + }, + { + "symbol": "either::Either::factor_first", + "skipped": "compiler reported no uses" + }, + { + "symbol": "either::Either::iter", + "skipped": "compiler reported no uses" + }, + { + "symbol": "either::Either::either_into", + "skipped": "compiler reported no uses" + }, + { + "symbol": "either::Either::is_left_or", + "skipped": "compiler reported no uses" + }, + { + "symbol": "either::Either::right_and", + "skipped": "compiler reported no uses" + }, + { + "symbol": "either::Either::expect_right", + "skipped": "compiler reported no uses" + }, + { + "symbol": "either::Either::map_either_with", + "skipped": "compiler reported no uses" + }, + { + "symbol": "either::Either::as_pin_ref", + "skipped": "compiler reported no uses" + }, + { + "symbol": "either::Either::into_inner", + "skipped": "compiler reported no uses" + }, + { + "symbol": "either::Either::unwrap_left", + "skipped": "compiler reported no uses" + }, + { + "symbol": "either::Either::left_and_then", + "skipped": "compiler reported no uses" + }, + { + "symbol": "either::Either::is_right_and", + "skipped": "compiler reported no uses" + }, + { + "symbol": "either::Either::factor_iter", + "skipped": "compiler reported no uses" + }, + { + "symbol": "either::Either::expect_left", + "skipped": "compiler reported no uses" + }, + { + "symbol": "either::Either::factor_err", + "skipped": "compiler reported no uses" + }, + { + "symbol": "either::Either::factor_into_iter", + "skipped": "compiler reported no uses" + }, + { + "symbol": "either::Either::iter_mut", + "skipped": "compiler reported no uses" + }, + { + "symbol": "either::Either::factor_ok", + "skipped": "compiler reported no uses" + }, + { + "symbol": "either::Either::is_right", + "skipped": "compiler reported no uses" + }, + { + "symbol": "either::Either::right_or_else", + "skipped": "compiler reported no uses" + } + ], + "rename": [ + { + "symbol": "either::Either::as_pin_mut", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "either::Either::is_left", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + } + ], + "mutants": { + "7": [ + "either::Either::as_pin_mut", + "either::Either::is_left" + ], + "8": [ + "either::Either::as_pin_mut", + "either::Either::is_left" + ], + "9": [ + "either::Either::is_left", + "either::Either::as_pin_mut" + ] + }, + "tests": [ + { + "symbol": "either::Either::as_pin_mut", + "skipped": "no test fails when it throws", + "predicted": 8 + }, + { + "symbol": "either::Either::is_left", + "skipped": "no test fails when it throws", + "predicted": 8 + } + ], + "look": [ + { + "symbol": "either::Either::as_pin_mut", + "look_tokens": 306, + "file_tokens": 13434 + }, + { + "symbol": "either::Either::is_left", + "look_tokens": 213, + "file_tokens": 13434 + } + ], + "seconds": 2, + "summary": { + "callers_recall": 1.0, + "callers_precision": 1.0, + "callers_checked": 2, + "blind_recall": 1.0, + "blind_checked": 1, + "common_recall": null, + "common_precision": null, + "common_recall_with_maybe": null, + "common_checked": 0, + "rename_ok": 1.0, + "rename_checked": 2, + "tests_recall": null, + "tests_precision": null, + "tests_top10_precision": null, + "tests_top10_best": null, + "tests_caught": null, + "tests_checked": 0, + "look_vs_file": 0.019 + }, + "summary_seeds": { + "7": { + "callers_recall": 1.0, + "callers_precision": 1.0, + "callers_checked": 2, + "blind_recall": 1.0, + "blind_checked": 1, + "common_recall": null, + "common_precision": null, + "common_recall_with_maybe": null, + "common_checked": 0, + "rename_ok": 1.0, + "rename_checked": 2, + "tests_recall": null, + "tests_precision": null, + "tests_top10_precision": null, + "tests_top10_best": null, + "tests_caught": null, + "tests_checked": 0, + "look_vs_file": 0.019 + }, + "8": { + "callers_recall": 1.0, + "callers_precision": 1.0, + "callers_checked": 2, + "blind_recall": 1.0, + "blind_checked": 1, + "common_recall": null, + "common_precision": null, + "common_recall_with_maybe": null, + "common_checked": 0, + "rename_ok": 1.0, + "rename_checked": 2, + "tests_recall": null, + "tests_precision": null, + "tests_top10_precision": null, + "tests_top10_best": null, + "tests_caught": null, + "tests_checked": 0, + "look_vs_file": 0.019 + }, + "9": { + "callers_recall": 1.0, + "callers_precision": 1.0, + "callers_checked": 2, + "blind_recall": null, + "blind_checked": 0, + "common_recall": null, + "common_precision": null, + "common_recall_with_maybe": null, + "common_checked": 0, + "rename_ok": 1.0, + "rename_checked": 2, + "tests_recall": null, + "tests_precision": null, + "tests_top10_precision": null, + "tests_top10_best": null, + "tests_caught": null, + "tests_checked": 0, + "look_vs_file": 0.019 + } + }, + "noise": { + "callers_recall": { + "mean": 1.0, + "functions": 2, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.5 + }, + "callers_precision": { + "mean": 1.0, + "functions": 2, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.5 + }, + "blind_recall": { + "mean": 1.0, + "functions": 1, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 1.0 + }, + "common_recall": null, + "common_recall_with_maybe": null, + "common_precision": null, + "rename_ok": { + "mean": 1.0, + "functions": 2, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.5 + }, + "tests_recall": null, + "tests_precision": null, + "tests_top10_precision": null, + "tests_top10_best": null, + "tests_caught": null, + "look_vs_file": { + "mean": 0.019, + "functions": 2, + "boot_lo": 0.016, + "boot_hi": 0.023, + "boot_half": 0.003, + "seeds": [ + 0.019, + 0.019, + 0.019 + ], + "seed_sd": 0.0, + "threshold": 0.01 + } + } + }, + { + "repo": "strsim", + "lang": "rust", + "commit": "dacc84c0dc61", + "index_seconds": 0.4, + "symbols": 48, + "files": 2, + "seeds": [ + 7, + 8, + 9 + ], + "edges": 430, + "sample": [ + "strsim::jaro", + "strsim::damerau_levenshtein", + "strsim::sorensen_dice", + "strsim::levenshtein", + "strsim::osa_distance", + "strsim::generic_jaro_winkler", + "strsim::normalized_damerau_levenshtein", + "strsim::normalized_levenshtein", + "strsim::hamming", + "strsim::generic_hamming", + "strsim::generic_levenshtein", + "strsim::generic_jaro", + "strsim::jaro_winkler" + ], + "sample_common": [], + "samples": { + "7": [ + "strsim::jaro", + "strsim::damerau_levenshtein", + "strsim::sorensen_dice", + "strsim::levenshtein", + "strsim::osa_distance", + "strsim::generic_jaro_winkler", + "strsim::normalized_damerau_levenshtein", + "strsim::normalized_levenshtein", + "strsim::hamming", + "strsim::generic_hamming", + "strsim::generic_levenshtein", + "strsim::generic_jaro", + "strsim::jaro_winkler" + ], + "8": [ + "strsim::normalized_levenshtein", + "strsim::osa_distance", + "strsim::normalized_damerau_levenshtein", + "strsim::generic_jaro_winkler", + "strsim::damerau_levenshtein", + "strsim::levenshtein", + "strsim::hamming", + "strsim::generic_hamming", + "strsim::sorensen_dice", + "strsim::generic_jaro", + "strsim::generic_levenshtein", + "strsim::jaro_winkler", + "strsim::jaro" + ], + "9": [ + "strsim::generic_levenshtein", + "strsim::damerau_levenshtein", + "strsim::hamming", + "strsim::sorensen_dice", + "strsim::jaro", + "strsim::normalized_levenshtein", + "strsim::generic_hamming", + "strsim::normalized_damerau_levenshtein", + "strsim::generic_jaro", + "strsim::generic_jaro_winkler", + "strsim::jaro_winkler", + "strsim::osa_distance", + "strsim::levenshtein" + ] + }, + "samples_common": { + "7": [], + "8": [], + "9": [] + }, + "samples_blind": { + "7": [ + "strsim::jaro", + "strsim::damerau_levenshtein", + "strsim::sorensen_dice", + "strsim::levenshtein", + "strsim::osa_distance", + "strsim::generic_jaro_winkler", + "strsim::normalized_damerau_levenshtein", + "strsim::normalized_levenshtein", + "strsim::hamming", + "strsim::generic_hamming", + "strsim::generic_damerau_levenshtein", + "strsim::generic_levenshtein", + "strsim::generic_jaro", + "strsim::jaro_winkler" + ], + "8": [ + "strsim::generic_damerau_levenshtein", + "strsim::normalized_levenshtein", + "strsim::osa_distance", + "strsim::normalized_damerau_levenshtein", + "strsim::generic_jaro_winkler", + "strsim::damerau_levenshtein", + "strsim::levenshtein", + "strsim::hamming", + "strsim::generic_hamming", + "strsim::sorensen_dice", + "strsim::generic_jaro", + "strsim::generic_levenshtein", + "strsim::jaro_winkler", + "strsim::jaro" + ], + "9": [ + "strsim::generic_levenshtein", + "strsim::damerau_levenshtein", + "strsim::hamming", + "strsim::sorensen_dice", + "strsim::jaro", + "strsim::generic_damerau_levenshtein", + "strsim::normalized_levenshtein", + "strsim::generic_hamming", + "strsim::normalized_damerau_levenshtein", + "strsim::generic_jaro", + "strsim::generic_jaro_winkler", + "strsim::jaro_winkler", + "strsim::osa_distance", + "strsim::levenshtein" + ] + }, + "baseline_failing_tests": [], + "callers": [ + { + "symbol": "strsim::jaro", + "truth": [], + "found": [], + "maybe": [], + "import_files": [ + "src/lib.rs" + ], + "recall": null, + "precision": null, + "recall_with_maybe": null + }, + { + "symbol": "strsim::damerau_levenshtein", + "truth": [], + "found": [], + "maybe": [], + "import_files": [ + "src/lib.rs" + ], + "recall": null, + "precision": null, + "recall_with_maybe": null + }, + { + "symbol": "strsim::sorensen_dice", + "truth": [], + "found": [], + "maybe": [], + "import_files": [ + "src/lib.rs" + ], + "recall": null, + "precision": null, + "recall_with_maybe": null + }, + { + "symbol": "strsim::levenshtein", + "truth": [ + "strsim::normalized_levenshtein" + ], + "found": [ + "strsim::normalized_levenshtein" + ], + "maybe": [], + "import_files": [ + "src/lib.rs" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "strsim::osa_distance", + "truth": [], + "found": [], + "maybe": [], + "import_files": [ + "src/lib.rs" + ], + "recall": null, + "precision": null, + "recall_with_maybe": null + }, + { + "symbol": "strsim::generic_jaro_winkler", + "truth": [ + "strsim::jaro_winkler" + ], + "found": [ + "strsim::jaro_winkler" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "strsim::normalized_damerau_levenshtein", + "truth": [], + "found": [], + "maybe": [], + "import_files": [ + "src/lib.rs" + ], + "recall": null, + "precision": null, + "recall_with_maybe": null + }, + { + "symbol": "strsim::normalized_levenshtein", + "truth": [], + "found": [], + "maybe": [], + "import_files": [ + "src/lib.rs" + ], + "recall": null, + "precision": null, + "recall_with_maybe": null + }, + { + "symbol": "strsim::hamming", + "truth": [], + "found": [], + "maybe": [], + "import_files": [ + "src/lib.rs" + ], + "recall": null, + "precision": null, + "recall_with_maybe": null + }, + { + "symbol": "strsim::generic_hamming", + "truth": [ + "strsim::hamming" + ], + "found": [ + "strsim::hamming" + ], + "maybe": [], + "import_files": [ + "src/lib.rs" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "strsim::generic_levenshtein", + "truth": [ + "strsim::levenshtein" + ], + "found": [ + "strsim::levenshtein" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "strsim::generic_jaro", + "truth": [ + "strsim::generic_jaro_winkler", + "strsim::jaro" + ], + "found": [ + "strsim::generic_jaro_winkler", + "strsim::jaro" + ], + "maybe": [], + "import_files": [ + "src/lib.rs" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "strsim::jaro_winkler", + "truth": [], + "found": [], + "maybe": [], + "import_files": [ + "src/lib.rs" + ], + "recall": null, + "precision": null, + "recall_with_maybe": null + } + ], + "callers_common": [], + "callers_blind": [ + { + "symbol": "strsim::jaro", + "truth": [], + "found": [], + "maybe": [], + "import_files": [ + "src/lib.rs" + ], + "recall": null, + "precision": null, + "recall_with_maybe": null + }, + { + "symbol": "strsim::damerau_levenshtein", + "truth": [], + "found": [], + "maybe": [], + "import_files": [ + "src/lib.rs" + ], + "recall": null, + "precision": null, + "recall_with_maybe": null + }, + { + "symbol": "strsim::sorensen_dice", + "truth": [], + "found": [], + "maybe": [], + "import_files": [ + "src/lib.rs" + ], + "recall": null, + "precision": null, + "recall_with_maybe": null + }, + { + "symbol": "strsim::levenshtein", + "truth": [ + "strsim::normalized_levenshtein" + ], + "found": [ + "strsim::normalized_levenshtein" + ], + "maybe": [], + "import_files": [ + "src/lib.rs" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "strsim::osa_distance", + "truth": [], + "found": [], + "maybe": [], + "import_files": [ + "src/lib.rs" + ], + "recall": null, + "precision": null, + "recall_with_maybe": null + }, + { + "symbol": "strsim::generic_jaro_winkler", + "truth": [ + "strsim::jaro_winkler" + ], + "found": [ + "strsim::jaro_winkler" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "strsim::normalized_damerau_levenshtein", + "truth": [], + "found": [], + "maybe": [], + "import_files": [ + "src/lib.rs" + ], + "recall": null, + "precision": null, + "recall_with_maybe": null + }, + { + "symbol": "strsim::normalized_levenshtein", + "truth": [], + "found": [], + "maybe": [], + "import_files": [ + "src/lib.rs" + ], + "recall": null, + "precision": null, + "recall_with_maybe": null + }, + { + "symbol": "strsim::hamming", + "truth": [], + "found": [], + "maybe": [], + "import_files": [ + "src/lib.rs" + ], + "recall": null, + "precision": null, + "recall_with_maybe": null + }, + { + "symbol": "strsim::generic_hamming", + "truth": [ + "strsim::hamming" + ], + "found": [ + "strsim::hamming" + ], + "maybe": [], + "import_files": [ + "src/lib.rs" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "strsim::generic_damerau_levenshtein", + "skipped": "compiler reported no uses" + }, + { + "symbol": "strsim::generic_levenshtein", + "truth": [ + "strsim::levenshtein" + ], + "found": [ + "strsim::levenshtein" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "strsim::generic_jaro", + "truth": [ + "strsim::generic_jaro_winkler", + "strsim::jaro" + ], + "found": [ + "strsim::generic_jaro_winkler", + "strsim::jaro" + ], + "maybe": [], + "import_files": [ + "src/lib.rs" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "strsim::jaro_winkler", + "truth": [], + "found": [], + "maybe": [], + "import_files": [ + "src/lib.rs" + ], + "recall": null, + "precision": null, + "recall_with_maybe": null + } + ], + "rename": [ + { + "symbol": "strsim::jaro", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "src/lib.rs:831: assert_eq!(0.0, jaro_gnx(\"\", \"jaro\"));\nsrc/lib.rs:841: assert_eq!(1.0, jaro_gnx(\"jaro\", \"jaro\"));\nsrc/lib.rs:907: assert_eq!(0.0, jaro_winkler(\"\", \"jaro-winkler\"));", + "detail": "" + }, + { + "symbol": "strsim::damerau_levenshtein", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "strsim::sorensen_dice", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "strsim::levenshtein", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "src/lib.rs:683:/// assert!((normalized_damerau_levenshtein(\"levenshtein\", \"löwenbräu\") - 0.27272).abs() < 0.00001);\nsrc/lib.rs:992: assert_eq!(0, levenshtein_gnx(\"levenshtein\", \"levenshtein\"));\nsrc/lib.rs:1223: normalized_damerau_levenshtein(\"levenshtein\", \"löwenbräu\")\ntests/lib.rs", + "detail": "" + }, + { + "symbol": "strsim::osa_distance", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "strsim::generic_jaro_winkler", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "strsim::normalized_damerau_levenshtein", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "strsim::normalized_levenshtein", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "strsim::hamming", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "src/lib.rs:78:/// use strsim::{hamming, StrSimError::DifferentLengthArgs};\nsrc/lib.rs:80:/// assert_eq!(Ok(3), hamming_gnx(\"hamming\", \"hammers\"));\nsrc/lib.rs:82:/// assert_eq!(Err(DifferentLengthArgs), hamming_gnx(\"hamming\", \"ham\"));\nsrc/lib.rs:793: assert_hamming_dist(0, \"hamming\", \"hamming\"", + "detail": "" + }, + { + "symbol": "strsim::generic_hamming", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "strsim::generic_levenshtein", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "strsim::generic_jaro", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "strsim::jaro_winkler", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + } + ], + "mutants": { + "7": [ + "strsim::jaro", + "strsim::damerau_levenshtein", + "strsim::sorensen_dice", + "strsim::levenshtein", + "strsim::osa_distance", + "strsim::generic_jaro_winkler", + "strsim::normalized_damerau_levenshtein", + "strsim::normalized_levenshtein" + ], + "8": [ + "strsim::normalized_levenshtein", + "strsim::osa_distance", + "strsim::normalized_damerau_levenshtein", + "strsim::generic_jaro_winkler", + "strsim::damerau_levenshtein", + "strsim::levenshtein", + "strsim::hamming", + "strsim::generic_hamming" + ], + "9": [ + "strsim::generic_levenshtein", + "strsim::damerau_levenshtein", + "strsim::hamming", + "strsim::sorensen_dice", + "strsim::jaro", + "strsim::normalized_levenshtein", + "strsim::generic_hamming", + "strsim::normalized_damerau_levenshtein" + ] + }, + "tests": [ + { + "symbol": "strsim::jaro", + "level": "name", + "truth": 14, + "predicted": 31, + "recall": 1.0, + "precision": 0.45161290322580644, + "top_hits": 10, + "top_n": 10, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "strsim::damerau_levenshtein", + "level": "name", + "truth": 17, + "predicted": 23, + "recall": 1.0, + "precision": 0.7391304347826086, + "top_hits": 10, + "top_n": 10, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "strsim::sorensen_dice", + "level": "name", + "truth": 1, + "predicted": 96, + "recall": 1.0, + "precision": 0.010416666666666666, + "top_hits": 1, + "top_n": 10, + "top_precision": 0.1, + "top_best": 0.1, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "strsim::levenshtein", + "level": "name", + "truth": 14, + "predicted": 38, + "recall": 1.0, + "precision": 0.3684210526315789, + "top_hits": 10, + "top_n": 10, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "strsim::osa_distance", + "level": "name", + "truth": 17, + "predicted": 17, + "recall": 1.0, + "precision": 1.0, + "top_hits": 10, + "top_n": 10, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "strsim::generic_jaro_winkler", + "level": "name", + "truth": 16, + "predicted": 16, + "recall": 1.0, + "precision": 1.0, + "top_hits": 10, + "top_n": 10, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "strsim::normalized_damerau_levenshtein", + "level": "name", + "truth": 6, + "predicted": 6, + "recall": 1.0, + "precision": 1.0, + "top_hits": 6, + "top_n": 6, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "strsim::normalized_levenshtein", + "level": "name", + "truth": 6, + "predicted": 6, + "recall": 1.0, + "precision": 1.0, + "top_hits": 6, + "top_n": 6, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "strsim::hamming", + "level": "name", + "truth": 6, + "predicted": 8, + "recall": 1.0, + "precision": 0.75, + "top_hits": 6, + "top_n": 8, + "top_precision": 0.75, + "top_best": 0.75, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "strsim::generic_hamming", + "level": "name", + "truth": 8, + "predicted": 8, + "recall": 1.0, + "precision": 1.0, + "top_hits": 8, + "top_n": 8, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "strsim::generic_levenshtein", + "level": "name", + "truth": 14, + "predicted": 15, + "recall": 1.0, + "precision": 0.9333333333333333, + "top_hits": 10, + "top_n": 10, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + } + ], + "look": [ + { + "symbol": "strsim::jaro", + "look_tokens": 289, + "file_tokens": 9272 + }, + { + "symbol": "strsim::damerau_levenshtein", + "look_tokens": 373, + "file_tokens": 9272 + }, + { + "symbol": "strsim::sorensen_dice", + "look_tokens": 563, + "file_tokens": 9272 + }, + { + "symbol": "strsim::levenshtein", + "look_tokens": 335, + "file_tokens": 9272 + }, + { + "symbol": "strsim::osa_distance", + "look_tokens": 676, + "file_tokens": 9272 + }, + { + "symbol": "strsim::generic_jaro_winkler", + "look_tokens": 400, + "file_tokens": 9272 + }, + { + "symbol": "strsim::normalized_damerau_levenshtein", + "look_tokens": 516, + "file_tokens": 9272 + }, + { + "symbol": "strsim::normalized_levenshtein", + "look_tokens": 426, + "file_tokens": 9272 + }, + { + "symbol": "strsim::hamming", + "look_tokens": 286, + "file_tokens": 9272 + }, + { + "symbol": "strsim::generic_hamming", + "look_tokens": 358, + "file_tokens": 9272 + }, + { + "symbol": "strsim::generic_levenshtein", + "look_tokens": 511, + "file_tokens": 9272 + }, + { + "symbol": "strsim::generic_jaro", + "look_tokens": 756, + "file_tokens": 9272 + }, + { + "symbol": "strsim::jaro_winkler", + "look_tokens": 329, + "file_tokens": 9272 + } + ], + "seconds": 5, + "summary": { + "callers_recall": 1.0, + "callers_precision": 1.0, + "callers_checked": 5, + "blind_recall": 1.0, + "blind_checked": 5, + "common_recall": null, + "common_precision": null, + "common_recall_with_maybe": null, + "common_checked": 0, + "rename_ok": 1.0, + "rename_checked": 13, + "tests_recall": 1.0, + "tests_precision": 0.75, + "tests_top10_precision": 0.895, + "tests_top10_best": 0.895, + "tests_caught": 1.0, + "tests_checked": 11, + "look_vs_file": 0.048 + }, + "summary_seeds": { + "7": { + "callers_recall": 1.0, + "callers_precision": 1.0, + "callers_checked": 5, + "blind_recall": 1.0, + "blind_checked": 5, + "common_recall": null, + "common_precision": null, + "common_recall_with_maybe": null, + "common_checked": 0, + "rename_ok": 1.0, + "rename_checked": 13, + "tests_recall": 1.0, + "tests_precision": 0.696, + "tests_top10_precision": 0.887, + "tests_top10_best": 0.887, + "tests_caught": 1.0, + "tests_checked": 8, + "look_vs_file": 0.048 + }, + "8": { + "callers_recall": 1.0, + "callers_precision": 1.0, + "callers_checked": 5, + "blind_recall": 1.0, + "blind_checked": 5, + "common_recall": null, + "common_precision": null, + "common_recall_with_maybe": null, + "common_checked": 0, + "rename_ok": 1.0, + "rename_checked": 13, + "tests_recall": 1.0, + "tests_precision": 0.857, + "tests_top10_precision": 0.969, + "tests_top10_best": 0.969, + "tests_caught": 1.0, + "tests_checked": 8, + "look_vs_file": 0.048 + }, + "9": { + "callers_recall": 1.0, + "callers_precision": 1.0, + "callers_checked": 5, + "blind_recall": 1.0, + "blind_checked": 5, + "common_recall": null, + "common_precision": null, + "common_recall_with_maybe": null, + "common_checked": 0, + "rename_ok": 1.0, + "rename_checked": 13, + "tests_recall": 1.0, + "tests_precision": 0.736, + "tests_top10_precision": 0.856, + "tests_top10_best": 0.856, + "tests_caught": 1.0, + "tests_checked": 8, + "look_vs_file": 0.048 + } + }, + "noise": { + "callers_recall": { + "mean": 1.0, + "functions": 5, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.2 + }, + "callers_precision": { + "mean": 1.0, + "functions": 5, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.2 + }, + "blind_recall": { + "mean": 1.0, + "functions": 5, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.2 + }, + "common_recall": null, + "common_recall_with_maybe": null, + "common_precision": null, + "rename_ok": { + "mean": 1.0, + "functions": 13, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.08 + }, + "tests_recall": { + "mean": 1.0, + "functions": 11, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.1 + }, + "tests_precision": { + "mean": 0.75, + "functions": 11, + "boot_lo": 0.583, + "boot_hi": 0.903, + "boot_half": 0.16, + "seeds": [ + 0.696, + 0.857, + 0.736 + ], + "seed_sd": 0.084, + "threshold": 0.17 + }, + "tests_top10_precision": { + "mean": 0.895, + "functions": 11, + "boot_lo": 0.732, + "boot_hi": 1.0, + "boot_half": 0.134, + "seeds": [ + 0.887, + 0.969, + 0.856 + ], + "seed_sd": 0.058, + "threshold": 0.14 + }, + "tests_top10_best": { + "mean": 0.895, + "functions": 11, + "boot_lo": 0.732, + "boot_hi": 1.0, + "boot_half": 0.134, + "seeds": [ + 0.887, + 0.969, + 0.856 + ], + "seed_sd": 0.058, + "threshold": 0.14 + }, + "tests_caught": { + "mean": 1.0, + "functions": 11, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.1 + }, + "look_vs_file": { + "mean": 0.048, + "functions": 13, + "boot_lo": 0.042, + "boot_hi": 0.056, + "boot_half": 0.007, + "seeds": [ + 0.048, + 0.048, + 0.048 + ], + "seed_sd": 0.0, + "threshold": 0.01 + } + } + }, + { + "repo": "ufo", + "lang": "typescript", + "commit": "f06c800d0c59", + "index_seconds": 0.1, + "symbols": 83, + "files": 8, + "seeds": [ + 7, + 8, + 9 + ], + "edges": 662, + "sample": [ + "src::encoding::encodeHost", + "src::query::stringifyQuery", + "src::parse::parsePath", + "src::utils::isNonEmptyURL", + "src::query::encodeQueryItem", + "src::utils::withProtocol", + "src::encoding::encode", + "src::encoding::encodeHash", + "src::encoding::decodeQueryKey", + "src::parse::parseURL", + "src::utils::withLeadingSlash", + "src::query::parseQuery", + "src::utils::isEmptyURL", + "src::utils::hasLeadingSlash", + "src::punycode::toASCII", + "src::utils::withoutTrailingSlash", + "src::utils::withTrailingSlash", + "src::parse::parseHost", + "src::encoding::decodePath", + "src::utils::joinURL", + "src::encoding::decode", + "src::encoding::decodeQueryValue", + "src::encoding::encodePath", + "src::utils::hasTrailingSlash", + "src::encoding::encodeQueryKey", + "src::utils::withoutLeadingSlash", + "src::parse::parseAuth", + "src::parse::stringifyParsedURL" + ], + "sample_common": [], + "samples": { + "7": [ + "src::encoding::encodeHost", + "src::query::stringifyQuery", + "src::parse::parsePath", + "src::utils::isNonEmptyURL", + "src::query::encodeQueryItem", + "src::utils::withProtocol", + "src::encoding::encode", + "src::encoding::encodeHash", + "src::encoding::decodeQueryKey", + "src::parse::parseURL", + "src::utils::withLeadingSlash", + "src::query::parseQuery", + "src::utils::isEmptyURL", + "src::utils::hasLeadingSlash", + "src::punycode::toASCII", + "src::utils::withoutTrailingSlash", + "src::utils::withTrailingSlash", + "src::parse::parseHost", + "src::encoding::decodePath", + "src::utils::joinURL" + ], + "8": [ + "src::encoding::decode", + "src::utils::withoutTrailingSlash", + "src::query::stringifyQuery", + "src::encoding::decodeQueryValue", + "src::encoding::encode", + "src::encoding::encodePath", + "src::utils::isNonEmptyURL", + "src::query::parseQuery", + "src::parse::parseURL", + "src::encoding::decodePath", + "src::encoding::encodeHost", + "src::utils::withTrailingSlash", + "src::query::encodeQueryItem", + "src::utils::hasTrailingSlash", + "src::utils::withProtocol", + "src::encoding::encodeQueryKey", + "src::utils::hasLeadingSlash", + "src::punycode::toASCII", + "src::parse::parseHost", + "src::utils::withLeadingSlash" + ], + "9": [ + "src::query::encodeQueryItem", + "src::utils::isNonEmptyURL", + "src::query::parseQuery", + "src::utils::hasTrailingSlash", + "src::query::stringifyQuery", + "src::utils::joinURL", + "src::parse::parseHost", + "src::utils::withoutLeadingSlash", + "src::encoding::encodeHash", + "src::parse::parsePath", + "src::utils::withLeadingSlash", + "src::parse::parseAuth", + "src::utils::isEmptyURL", + "src::encoding::decodeQueryValue", + "src::encoding::decode", + "src::encoding::encodePath", + "src::encoding::decodePath", + "src::encoding::encodeQueryKey", + "src::parse::stringifyParsedURL", + "src::utils::hasLeadingSlash" + ] + }, + "samples_common": { + "7": [], + "8": [], + "9": [] + }, + "samples_blind": { + "7": [ + "src::encoding::encodeHost", + "src::query::stringifyQuery", + "src::parse::parsePath", + "src::url::$URL::href", + "src::utils::isNonEmptyURL", + "src::utils::withoutProtocol", + "src::query::encodeQueryItem", + "src::utils::withProtocol", + "src::utils::cleanDoubleSlashes", + "src::utils::withoutBase", + "src::encoding::encode", + "src::url::$URL::hostname", + "src::encoding::encodeHash", + "src::parse::parseFilename", + "src::encoding::decodeQueryKey", + "src::url::$URL::port", + "src::parse::parseURL", + "src::utils::withHttps", + "src::utils::withHttp", + "src::utils::withLeadingSlash" + ], + "8": [ + "src::utils::getQuery", + "src::encoding::decode", + "src::utils::withoutTrailingSlash", + "src::query::stringifyQuery", + "src::encoding::decodeQueryValue", + "src::encoding::encode", + "src::encoding::encodePath", + "src::utils::isNonEmptyURL", + "src::url::$URL::port", + "src::query::parseQuery", + "src::utils::cleanDoubleSlashes", + "src::parse::parseFilename", + "src::utils::withHttp", + "src::url::createURL", + "src::parse::parseURL", + "src::encoding::decodePath", + "src::encoding::encodeHost", + "src::utils::isRelative", + "src::url::$URL::searchParams", + "src::utils::withTrailingSlash" + ], + "9": [ + "src::utils::isEqual", + "src::url::$URL::encodedAuth", + "src::utils::resolveURL", + "src::url::$URL::toJSON", + "src::query::encodeQueryItem", + "src::utils::isNonEmptyURL", + "src::query::parseQuery", + "src::utils::hasTrailingSlash", + "src::query::stringifyQuery", + "src::url::$URL::isAbsolute", + "src::url::$URL::search", + "src::url::createURL", + "src::utils::joinURL", + "src::parse::parseFilename", + "src::parse::parseHost", + "src::utils::normalizeURL", + "src::utils::withoutLeadingSlash", + "src::encoding::encodeHash", + "src::utils::filterQuery", + "src::url::$URL::port" + ] + }, + "baseline_failing_tests": [], + "callers": [ + { + "symbol": "src::encoding::encodeHost", + "truth": [ + "src::url::$URL::href", + "src::url::$URL::origin", + "src::utils::normalizeURL" + ], + "found": [ + "src::url::$URL::href", + "src::url::$URL::origin", + "src::utils::normalizeURL" + ], + "maybe": [], + "import_files": [ + "src/url.ts", + "src/utils.ts" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "src::query::stringifyQuery", + "truth": [ + "src::url::$URL::search", + "src::utils::filterQuery", + "src::utils::normalizeURL", + "src::utils::resolveURL", + "src::utils::withQuery" + ], + "found": [ + "src::url::$URL::search", + "src::utils::filterQuery", + "src::utils::normalizeURL", + "src::utils::resolveURL", + "src::utils::withQuery" + ], + "maybe": [], + "import_files": [ + "src/url.ts", + "src/utils.ts" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "src::parse::parsePath", + "truth": [ + "src::parse::parseURL" + ], + "found": [ + "src::parse::parseURL" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "src::utils::isNonEmptyURL", + "truth": [ + "src::utils::joinURL", + "src::utils::resolveURL" + ], + "found": [ + "src::utils::joinURL", + "src::utils::resolveURL" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "src::query::encodeQueryItem", + "truth": [ + "src::query::stringifyQuery" + ], + "found": [ + "src::query::stringifyQuery" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "src::utils::withProtocol", + "truth": [ + "src::utils::withHttp", + "src::utils::withHttps", + "src::utils::withoutProtocol" + ], + "found": [ + "src::utils::withHttp", + "src::utils::withHttps", + "src::utils::withoutProtocol" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "src::encoding::encode", + "truth": [ + "src::encoding::encodeHash", + "src::encoding::encodePath", + "src::encoding::encodeQueryValue" + ], + "found": [ + "src::encoding::encodeHash", + "src::encoding::encodePath", + "src::encoding::encodeQueryValue" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "src::encoding::encodeHash", + "truth": [ + "src::url::$URL::fullpath", + "src::utils::normalizeURL", + "src::utils::withFragment" + ], + "found": [ + "src::url::$URL::fullpath", + "src::utils::normalizeURL", + "src::utils::withFragment" + ], + "maybe": [], + "import_files": [ + "src/url.ts", + "src/utils.ts" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "src::encoding::decodeQueryKey", + "truth": [ + "src::query::parseQuery" + ], + "found": [ + "src::query::parseQuery" + ], + "maybe": [], + "import_files": [ + "src/query.ts" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "src::parse::parseURL", + "truth": [ + "src::parse::parseFilename", + "src::url::$URL::constructor", + "src::utils::filterQuery", + "src::utils::getQuery", + "src::utils::normalizeURL", + "src::utils::resolveURL", + "src::utils::withFragment", + "src::utils::withQuery", + "src::utils::withoutFragment", + "src::utils::withoutHost" + ], + "found": [ + "src::parse::parseFilename", + "src::url::$URL::constructor", + "src::utils::filterQuery", + "src::utils::getQuery", + "src::utils::normalizeURL", + "src::utils::resolveURL", + "src::utils::withFragment", + "src::utils::withQuery", + "src::utils::withoutFragment", + "src::utils::withoutHost" + ], + "maybe": [], + "import_files": [ + "src/url.ts", + "src/utils.ts" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "src::utils::withLeadingSlash", + "truth": [ + "src::utils::isEqual" + ], + "found": [ + "src::utils::isEqual" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "src::query::parseQuery", + "truth": [ + "src::url::$URL::constructor", + "src::utils::filterQuery", + "src::utils::getQuery", + "src::utils::normalizeURL", + "src::utils::resolveURL", + "src::utils::withQuery" + ], + "found": [ + "src::url::$URL::constructor", + "src::utils::filterQuery", + "src::utils::getQuery", + "src::utils::normalizeURL", + "src::utils::resolveURL", + "src::utils::withQuery" + ], + "maybe": [], + "import_files": [ + "src/url.ts", + "src/utils.ts" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "src::utils::isEmptyURL", + "truth": [ + "src::utils::withBase", + "src::utils::withoutBase" + ], + "found": [ + "src::utils::withBase", + "src::utils::withoutBase" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "src::utils::hasLeadingSlash", + "truth": [ + "src::utils::withLeadingSlash", + "src::utils::withoutLeadingSlash" + ], + "found": [ + "src::utils::withLeadingSlash", + "src::utils::withoutLeadingSlash" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "src::punycode::toASCII", + "truth": [ + "src::encoding::encodeHost" + ], + "found": [ + "src::encoding::encodeHost" + ], + "maybe": [], + "import_files": [ + "src/encoding.ts" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "src::utils::withoutTrailingSlash", + "truth": [ + "src::utils::isSamePath", + "src::utils::withBase", + "src::utils::withoutBase" + ], + "found": [ + "src::utils::isSamePath", + "src::utils::withBase", + "src::utils::withoutBase" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "src::utils::withTrailingSlash", + "truth": [ + "src::url::$URL::append", + "src::utils::isEqual", + "src::utils::joinURL", + "src::utils::resolveURL" + ], + "found": [ + "src::url::$URL::append", + "src::utils::isEqual", + "src::utils::joinURL", + "src::utils::resolveURL" + ], + "maybe": [], + "import_files": [ + "src/url.ts" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "src::parse::parseHost", + "truth": [ + "src::url::$URL::hostname", + "src::url::$URL::port" + ], + "found": [ + "src::url::$URL::hostname", + "src::url::$URL::port" + ], + "maybe": [], + "import_files": [ + "src/url.ts" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "src::encoding::decodePath", + "truth": [ + "src::url::$URL::constructor", + "src::utils::normalizeURL" + ], + "found": [ + "src::url::$URL::constructor", + "src::utils::normalizeURL" + ], + "maybe": [], + "import_files": [ + "src/url.ts", + "src/utils.ts" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "src::utils::joinURL", + "truth": [ + "src::utils::withBase" + ], + "found": [ + "src::utils::withBase" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "src::encoding::decode", + "truth": [ + "src::encoding::decodePath", + "src::encoding::decodeQueryKey", + "src::encoding::decodeQueryValue", + "src::parse::parseAuth", + "src::parse::parseHost", + "src::url::$URL::constructor", + "src::utils::isEqual", + "src::utils::isSamePath", + "src::utils::normalizeURL" + ], + "found": [ + "src::encoding::decodePath", + "src::encoding::decodeQueryKey", + "src::encoding::decodeQueryValue", + "src::parse::parseAuth", + "src::parse::parseHost", + "src::url::$URL::constructor", + "src::utils::isEqual", + "src::utils::isSamePath", + "src::utils::normalizeURL" + ], + "maybe": [], + "import_files": [ + "src/parse.ts", + "src/url.ts", + "src/utils.ts" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "src::encoding::decodeQueryValue", + "truth": [ + "src::query::parseQuery" + ], + "found": [ + "src::query::parseQuery" + ], + "maybe": [], + "import_files": [ + "src/query.ts" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "src::encoding::encodePath", + "truth": [ + "src::encoding::encodeParam", + "src::url::$URL::fullpath", + "src::utils::normalizeURL" + ], + "found": [ + "src::encoding::encodeParam", + "src::url::$URL::fullpath", + "src::utils::normalizeURL" + ], + "maybe": [], + "import_files": [ + "src/url.ts", + "src/utils.ts" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "src::utils::hasTrailingSlash", + "truth": [ + "src::utils::withTrailingSlash", + "src::utils::withoutTrailingSlash" + ], + "found": [ + "src::utils::withTrailingSlash", + "src::utils::withoutTrailingSlash" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "src::encoding::encodeQueryKey", + "truth": [ + "src::query::encodeQueryItem" + ], + "found": [ + "src::query::encodeQueryItem" + ], + "maybe": [], + "import_files": [ + "src/query.ts" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "src::utils::withoutLeadingSlash", + "truth": [ + "src::url::$URL::append", + "src::utils::resolveURL" + ], + "found": [ + "src::url::$URL::append", + "src::utils::resolveURL" + ], + "maybe": [], + "import_files": [ + "src/url.ts" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "src::parse::parseAuth", + "truth": [ + "src::url::$URL::encodedAuth", + "src::url::$URL::password", + "src::url::$URL::username" + ], + "found": [ + "src::url::$URL::encodedAuth", + "src::url::$URL::password", + "src::url::$URL::username" + ], + "maybe": [], + "import_files": [ + "src/url.ts" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "src::parse::stringifyParsedURL", + "truth": [ + "src::utils::filterQuery", + "src::utils::normalizeURL", + "src::utils::resolveURL", + "src::utils::withFragment", + "src::utils::withQuery", + "src::utils::withoutFragment" + ], + "found": [ + "src::utils::filterQuery", + "src::utils::normalizeURL", + "src::utils::resolveURL", + "src::utils::withFragment", + "src::utils::withQuery", + "src::utils::withoutFragment" + ], + "maybe": [], + "import_files": [ + "src/utils.ts" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + } + ], + "callers_common": [], + "callers_blind": [ + { + "symbol": "src::encoding::encodeHost", + "truth": [ + "src::url::$URL::href", + "src::url::$URL::origin", + "src::utils::normalizeURL" + ], + "found": [ + "src::url::$URL::href", + "src::url::$URL::origin", + "src::utils::normalizeURL" + ], + "maybe": [], + "import_files": [ + "src/url.ts", + "src/utils.ts" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "src::query::stringifyQuery", + "truth": [ + "src::url::$URL::search", + "src::utils::filterQuery", + "src::utils::normalizeURL", + "src::utils::resolveURL", + "src::utils::withQuery" + ], + "found": [ + "src::url::$URL::search", + "src::utils::filterQuery", + "src::utils::normalizeURL", + "src::utils::resolveURL", + "src::utils::withQuery" + ], + "maybe": [], + "import_files": [ + "src/url.ts", + "src/utils.ts" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "src::parse::parsePath", + "truth": [ + "src::parse::parseURL" + ], + "found": [ + "src::parse::parseURL" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "src::url::$URL::href", + "truth": [ + "src::url::$URL::toJSON", + "src::url::$URL::toString" + ], + "found": [], + "maybe": [], + "import_files": [], + "recall": 0.0, + "precision": null, + "recall_with_maybe": 0.0 + }, + { + "symbol": "src::utils::isNonEmptyURL", + "truth": [ + "src::utils::joinURL", + "src::utils::resolveURL" + ], + "found": [ + "src::utils::joinURL", + "src::utils::resolveURL" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "src::utils::withoutProtocol", + "skipped": "compiler reported no uses" + }, + { + "symbol": "src::query::encodeQueryItem", + "truth": [ + "src::query::stringifyQuery" + ], + "found": [ + "src::query::stringifyQuery" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "src::utils::withProtocol", + "truth": [ + "src::utils::withHttp", + "src::utils::withHttps", + "src::utils::withoutProtocol" + ], + "found": [ + "src::utils::withHttp", + "src::utils::withHttps", + "src::utils::withoutProtocol" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "src::utils::cleanDoubleSlashes", + "skipped": "compiler reported no uses" + }, + { + "symbol": "src::utils::withoutBase", + "skipped": "compiler reported no uses" + }, + { + "symbol": "src::encoding::encode", + "truth": [ + "src::encoding::encodeHash", + "src::encoding::encodePath", + "src::encoding::encodeQueryValue" + ], + "found": [ + "src::encoding::encodeHash", + "src::encoding::encodePath", + "src::encoding::encodeQueryValue" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "src::url::$URL::hostname", + "skipped": "compiler reported no uses" + }, + { + "symbol": "src::encoding::encodeHash", + "truth": [ + "src::url::$URL::fullpath", + "src::utils::normalizeURL", + "src::utils::withFragment" + ], + "found": [ + "src::url::$URL::fullpath", + "src::utils::normalizeURL", + "src::utils::withFragment" + ], + "maybe": [], + "import_files": [ + "src/url.ts", + "src/utils.ts" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "src::parse::parseFilename", + "skipped": "compiler reported no uses" + }, + { + "symbol": "src::encoding::decodeQueryKey", + "truth": [ + "src::query::parseQuery" + ], + "found": [ + "src::query::parseQuery" + ], + "maybe": [], + "import_files": [ + "src/query.ts" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "src::url::$URL::port", + "skipped": "compiler reported no uses" + }, + { + "symbol": "src::parse::parseURL", + "truth": [ + "src::parse::parseFilename", + "src::url::$URL::constructor", + "src::utils::filterQuery", + "src::utils::getQuery", + "src::utils::normalizeURL", + "src::utils::resolveURL", + "src::utils::withFragment", + "src::utils::withQuery", + "src::utils::withoutFragment", + "src::utils::withoutHost" + ], + "found": [ + "src::parse::parseFilename", + "src::url::$URL::constructor", + "src::utils::filterQuery", + "src::utils::getQuery", + "src::utils::normalizeURL", + "src::utils::resolveURL", + "src::utils::withFragment", + "src::utils::withQuery", + "src::utils::withoutFragment", + "src::utils::withoutHost" + ], + "maybe": [], + "import_files": [ + "src/url.ts", + "src/utils.ts" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "src::utils::withHttps", + "skipped": "compiler reported no uses" + }, + { + "symbol": "src::utils::withHttp", + "skipped": "compiler reported no uses" + }, + { + "symbol": "src::utils::withLeadingSlash", + "truth": [ + "src::utils::isEqual" + ], + "found": [ + "src::utils::isEqual" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "src::utils::getQuery", + "skipped": "compiler reported no uses" + }, + { + "symbol": "src::encoding::decode", + "truth": [ + "src::encoding::decodePath", + "src::encoding::decodeQueryKey", + "src::encoding::decodeQueryValue", + "src::parse::parseAuth", + "src::parse::parseHost", + "src::url::$URL::constructor", + "src::utils::isEqual", + "src::utils::isSamePath", + "src::utils::normalizeURL" + ], + "found": [ + "src::encoding::decodePath", + "src::encoding::decodeQueryKey", + "src::encoding::decodeQueryValue", + "src::parse::parseAuth", + "src::parse::parseHost", + "src::url::$URL::constructor", + "src::utils::isEqual", + "src::utils::isSamePath", + "src::utils::normalizeURL" + ], + "maybe": [], + "import_files": [ + "src/parse.ts", + "src/url.ts", + "src/utils.ts" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "src::utils::withoutTrailingSlash", + "truth": [ + "src::utils::isSamePath", + "src::utils::withBase", + "src::utils::withoutBase" + ], + "found": [ + "src::utils::isSamePath", + "src::utils::withBase", + "src::utils::withoutBase" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "src::encoding::decodeQueryValue", + "truth": [ + "src::query::parseQuery" + ], + "found": [ + "src::query::parseQuery" + ], + "maybe": [], + "import_files": [ + "src/query.ts" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "src::encoding::encodePath", + "truth": [ + "src::encoding::encodeParam", + "src::url::$URL::fullpath", + "src::utils::normalizeURL" + ], + "found": [ + "src::encoding::encodeParam", + "src::url::$URL::fullpath", + "src::utils::normalizeURL" + ], + "maybe": [], + "import_files": [ + "src/url.ts", + "src/utils.ts" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "src::query::parseQuery", + "truth": [ + "src::url::$URL::constructor", + "src::utils::filterQuery", + "src::utils::getQuery", + "src::utils::normalizeURL", + "src::utils::resolveURL", + "src::utils::withQuery" + ], + "found": [ + "src::url::$URL::constructor", + "src::utils::filterQuery", + "src::utils::getQuery", + "src::utils::normalizeURL", + "src::utils::resolveURL", + "src::utils::withQuery" + ], + "maybe": [], + "import_files": [ + "src/url.ts", + "src/utils.ts" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "src::url::createURL", + "skipped": "compiler reported no uses" + }, + { + "symbol": "src::encoding::decodePath", + "truth": [ + "src::url::$URL::constructor", + "src::utils::normalizeURL" + ], + "found": [ + "src::url::$URL::constructor", + "src::utils::normalizeURL" + ], + "maybe": [], + "import_files": [ + "src/url.ts", + "src/utils.ts" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "src::utils::isRelative", + "skipped": "compiler reported no uses" + }, + { + "symbol": "src::url::$URL::searchParams", + "skipped": "compiler reported no uses" + }, + { + "symbol": "src::utils::withTrailingSlash", + "truth": [ + "src::url::$URL::append", + "src::utils::isEqual", + "src::utils::joinURL", + "src::utils::resolveURL" + ], + "found": [ + "src::url::$URL::append", + "src::utils::isEqual", + "src::utils::joinURL", + "src::utils::resolveURL" + ], + "maybe": [], + "import_files": [ + "src/url.ts" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "src::utils::isEqual", + "skipped": "compiler reported no uses" + }, + { + "symbol": "src::url::$URL::encodedAuth", + "truth": [ + "src::url::$URL::href" + ], + "found": [], + "maybe": [], + "import_files": [], + "recall": 0.0, + "precision": null, + "recall_with_maybe": 0.0 + }, + { + "symbol": "src::utils::resolveURL", + "skipped": "compiler reported no uses" + }, + { + "symbol": "src::url::$URL::toJSON", + "skipped": "compiler reported no uses" + }, + { + "symbol": "src::utils::hasTrailingSlash", + "truth": [ + "src::utils::withTrailingSlash", + "src::utils::withoutTrailingSlash" + ], + "found": [ + "src::utils::withTrailingSlash", + "src::utils::withoutTrailingSlash" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "src::url::$URL::isAbsolute", + "truth": [ + "src::url::$URL::href" + ], + "found": [], + "maybe": [], + "import_files": [], + "recall": 0.0, + "precision": null, + "recall_with_maybe": 0.0 + }, + { + "symbol": "src::url::$URL::search", + "truth": [ + "src::url::$URL::fullpath" + ], + "found": [], + "maybe": [], + "import_files": [], + "recall": 0.0, + "precision": null, + "recall_with_maybe": 0.0 + }, + { + "symbol": "src::utils::joinURL", + "truth": [ + "src::utils::withBase" + ], + "found": [ + "src::utils::withBase" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "src::parse::parseHost", + "truth": [ + "src::url::$URL::hostname", + "src::url::$URL::port" + ], + "found": [ + "src::url::$URL::hostname", + "src::url::$URL::port" + ], + "maybe": [], + "import_files": [ + "src/url.ts" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "src::utils::normalizeURL", + "skipped": "compiler reported no uses" + }, + { + "symbol": "src::utils::withoutLeadingSlash", + "truth": [ + "src::url::$URL::append", + "src::utils::resolveURL" + ], + "found": [ + "src::url::$URL::append", + "src::utils::resolveURL" + ], + "maybe": [], + "import_files": [ + "src/url.ts" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "src::utils::filterQuery", + "skipped": "compiler reported no uses" + } + ], + "rename": [ + { + "symbol": "src::encoding::encodeHost", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "src::query::stringifyQuery", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "src::parse::parsePath", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "src::utils::isNonEmptyURL", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "src::query::encodeQueryItem", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "src::utils::withProtocol", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "src::encoding::encode", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "pnpm-lock.yaml:1596: micromark-util-encode@2.0.1:\npnpm-lock.yaml:3820: micromark-util-encode@2.0.1: {}\npnpm-lock.yaml:3835: micromark-util-encode: 2.0.1\npnpm-lock.yaml:3861: micromark-util-encode: 2.0.1\nsrc/encoding.ts:28: * @param text - string to encode", + "detail": "" + }, + { + "symbol": "src::encoding::encodeHash", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "src::encoding::decodeQueryKey", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "src::parse::parseURL", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "src::utils::withLeadingSlash", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "src::query::parseQuery", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "src::utils::isEmptyURL", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "src::utils::hasLeadingSlash", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "src::punycode::toASCII", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "src::utils::withoutTrailingSlash", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "src::utils::withTrailingSlash", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "src::parse::parseHost", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "src::encoding::decodePath", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "src::utils::joinURL", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "src::encoding::decode", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "pnpm-lock.yaml:1023: decode-named-character-reference@1.3.0:\npnpm-lock.yaml:1590: micromark-util-decode-numeric-character-reference@2.0.2:\npnpm-lock.yaml:1593: micromark-util-decode-string@2.0.1:\npnpm-lock.yaml:3109: decode-named-character-reference@1.3.0:\npnpm-lock.yaml:3563: decode-named-", + "detail": "" + }, + { + "symbol": "src::encoding::decodeQueryValue", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "src::encoding::encodePath", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "src::utils::hasTrailingSlash", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "src::encoding::encodeQueryKey", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "src::utils::withoutLeadingSlash", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "src::parse::parseAuth", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "src::parse::stringifyParsedURL", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + } + ], + "mutants": { + "7": [ + "src::encoding::encodeHost", + "src::query::stringifyQuery", + "src::parse::parsePath", + "src::utils::isNonEmptyURL", + "src::query::encodeQueryItem", + "src::utils::withProtocol", + "src::encoding::encode", + "src::encoding::encodeHash" + ], + "8": [ + "src::encoding::decode", + "src::utils::withoutTrailingSlash", + "src::query::stringifyQuery", + "src::encoding::decodeQueryValue", + "src::encoding::encode", + "src::encoding::encodePath", + "src::utils::isNonEmptyURL", + "src::query::parseQuery" + ], + "9": [ + "src::query::encodeQueryItem", + "src::utils::isNonEmptyURL", + "src::query::parseQuery", + "src::utils::hasTrailingSlash", + "src::query::stringifyQuery", + "src::utils::joinURL", + "src::parse::parseHost", + "src::utils::withoutLeadingSlash" + ] + }, + "tests": [ + { + "symbol": "src::encoding::encodeHost", + "level": "file", + "truth": 2, + "predicted": 2, + "recall": 0.5, + "precision": 0.5, + "top_hits": 1, + "top_n": 2, + "top_precision": 0.5, + "top_best": 0.5, + "caught": 1.0, + "missed": [ + "test/url.test.ts" + ] + }, + { + "symbol": "src::query::stringifyQuery", + "level": "file", + "truth": 4, + "predicted": 3, + "recall": 0.75, + "precision": 1.0, + "top_hits": 3, + "top_n": 3, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [ + "test/url.test.ts" + ] + }, + { + "symbol": "src::parse::parsePath", + "level": "file", + "truth": 6, + "predicted": 6, + "recall": 0.8333333333333334, + "precision": 0.8333333333333334, + "top_hits": 5, + "top_n": 6, + "top_precision": 0.8333333333333334, + "top_best": 0.8333333333333334, + "caught": 1.0, + "missed": [ + "test/url.test.ts" + ] + }, + { + "symbol": "src::utils::isNonEmptyURL", + "level": "file", + "truth": 3, + "predicted": 3, + "recall": 1.0, + "precision": 1.0, + "top_hits": 3, + "top_n": 3, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [] + }, + { + "symbol": "src::query::encodeQueryItem", + "level": "file", + "truth": 4, + "predicted": 3, + "recall": 0.75, + "precision": 1.0, + "top_hits": 3, + "top_n": 3, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [ + "test/url.test.ts" + ] + }, + { + "symbol": "src::utils::withProtocol", + "level": "file", + "truth": 1, + "predicted": 1, + "recall": 1.0, + "precision": 1.0, + "top_hits": 1, + "top_n": 1, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [] + }, + { + "symbol": "src::encoding::encode", + "level": "file", + "truth": 6, + "predicted": 3, + "recall": 0.5, + "precision": 1.0, + "top_hits": 3, + "top_n": 3, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [ + "test/query.test.ts", + "test/resolve.test.ts", + "test/url.test.ts" + ] + }, + { + "symbol": "src::encoding::encodeHash", + "level": "file", + "truth": 4, + "predicted": 3, + "recall": 0.75, + "precision": 1.0, + "top_hits": 3, + "top_n": 3, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [ + "test/url.test.ts" + ] + }, + { + "symbol": "src::encoding::decode", + "level": "file", + "truth": 8, + "predicted": 8, + "recall": 0.875, + "precision": 0.875, + "top_hits": 7, + "top_n": 8, + "top_precision": 0.875, + "top_best": 0.875, + "caught": 1.0, + "missed": [ + "test/url.test.ts" + ] + }, + { + "symbol": "src::utils::withoutTrailingSlash", + "level": "file", + "truth": 4, + "predicted": 4, + "recall": 1.0, + "precision": 1.0, + "top_hits": 4, + "top_n": 4, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [] + }, + { + "symbol": "src::encoding::decodeQueryValue", + "level": "file", + "truth": 4, + "predicted": 5, + "recall": 0.75, + "precision": 0.6, + "top_hits": 3, + "top_n": 5, + "top_precision": 0.6, + "top_best": 0.6, + "caught": 1.0, + "missed": [ + "test/url.test.ts" + ] + }, + { + "symbol": "src::encoding::encodePath", + "level": "file", + "truth": 3, + "predicted": 2, + "recall": 0.6666666666666666, + "precision": 1.0, + "top_hits": 2, + "top_n": 2, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [ + "test/url.test.ts" + ] + }, + { + "symbol": "src::query::parseQuery", + "level": "file", + "truth": 4, + "predicted": 4, + "recall": 0.75, + "precision": 0.75, + "top_hits": 3, + "top_n": 4, + "top_precision": 0.75, + "top_best": 0.75, + "caught": 1.0, + "missed": [ + "test/url.test.ts" + ] + }, + { + "symbol": "src::utils::hasTrailingSlash", + "level": "file", + "truth": 4, + "predicted": 7, + "recall": 1.0, + "precision": 0.5714285714285714, + "top_hits": 4, + "top_n": 7, + "top_precision": 0.5714285714285714, + "top_best": 0.5714285714285714, + "caught": 1.0, + "missed": [] + }, + { + "symbol": "src::utils::joinURL", + "level": "file", + "truth": 2, + "predicted": 2, + "recall": 1.0, + "precision": 1.0, + "top_hits": 2, + "top_n": 2, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [] + }, + { + "symbol": "src::parse::parseHost", + "level": "file", + "truth": 2, + "predicted": 1, + "recall": 0.5, + "precision": 1.0, + "top_hits": 1, + "top_n": 1, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [ + "test/url.test.ts" + ] + }, + { + "symbol": "src::utils::withoutLeadingSlash", + "level": "file", + "truth": 2, + "predicted": 1, + "recall": 0.5, + "precision": 1.0, + "top_hits": 1, + "top_n": 1, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [ + "test/url.test.ts" + ] + } + ], + "look": [ + { + "symbol": "src::encoding::encodeHost", + "look_tokens": 148, + "file_tokens": 1119 + }, + { + "symbol": "src::query::stringifyQuery", + "look_tokens": 262, + "file_tokens": 838 + }, + { + "symbol": "src::parse::parsePath", + "look_tokens": 288, + "file_tokens": 1497 + }, + { + "symbol": "src::utils::isNonEmptyURL", + "look_tokens": 149, + "file_tokens": 4519 + }, + { + "symbol": "src::query::encodeQueryItem", + "look_tokens": 349, + "file_tokens": 838 + }, + { + "symbol": "src::utils::withProtocol", + "look_tokens": 216, + "file_tokens": 4519 + }, + { + "symbol": "src::encoding::encode", + "look_tokens": 198, + "file_tokens": 1119 + }, + { + "symbol": "src::encoding::encodeHash", + "look_tokens": 214, + "file_tokens": 1119 + }, + { + "symbol": "src::encoding::decodeQueryKey", + "look_tokens": 200, + "file_tokens": 1119 + }, + { + "symbol": "src::parse::parseURL", + "look_tokens": 700, + "file_tokens": 1497 + }, + { + "symbol": "src::utils::withLeadingSlash", + "look_tokens": 165, + "file_tokens": 4519 + }, + { + "symbol": "src::query::parseQuery", + "look_tokens": 512, + "file_tokens": 838 + }, + { + "symbol": "src::utils::isEmptyURL", + "look_tokens": 128, + "file_tokens": 4519 + }, + { + "symbol": "src::utils::hasLeadingSlash", + "look_tokens": 156, + "file_tokens": 4519 + }, + { + "symbol": "src::punycode::toASCII", + "look_tokens": 687, + "file_tokens": 751 + }, + { + "symbol": "src::utils::withoutTrailingSlash", + "look_tokens": 413, + "file_tokens": 4519 + }, + { + "symbol": "src::utils::withTrailingSlash", + "look_tokens": 402, + "file_tokens": 4519 + }, + { + "symbol": "src::parse::parseHost", + "look_tokens": 234, + "file_tokens": 1497 + }, + { + "symbol": "src::encoding::decodePath", + "look_tokens": 180, + "file_tokens": 1119 + }, + { + "symbol": "src::utils::joinURL", + "look_tokens": 235, + "file_tokens": 4519 + }, + { + "symbol": "src::encoding::decode", + "look_tokens": 284, + "file_tokens": 1119 + }, + { + "symbol": "src::encoding::decodeQueryValue", + "look_tokens": 204, + "file_tokens": 1119 + }, + { + "symbol": "src::encoding::encodePath", + "look_tokens": 219, + "file_tokens": 1119 + }, + { + "symbol": "src::utils::hasTrailingSlash", + "look_tokens": 287, + "file_tokens": 4519 + }, + { + "symbol": "src::encoding::encodeQueryKey", + "look_tokens": 208, + "file_tokens": 1119 + }, + { + "symbol": "src::utils::withoutLeadingSlash", + "look_tokens": 177, + "file_tokens": 4519 + }, + { + "symbol": "src::parse::parseAuth", + "look_tokens": 208, + "file_tokens": 1497 + }, + { + "symbol": "src::parse::stringifyParsedURL", + "look_tokens": 383, + "file_tokens": 1497 + } + ], + "seconds": 599, + "summary": { + "callers_recall": 1.0, + "callers_precision": 1.0, + "callers_checked": 28, + "blind_recall": 0.846, + "blind_checked": 26, + "common_recall": null, + "common_precision": null, + "common_recall_with_maybe": null, + "common_checked": 0, + "rename_ok": 1.0, + "rename_checked": 28, + "tests_recall": 0.772, + "tests_precision": 0.89, + "tests_top10_precision": 0.89, + "tests_top10_best": 0.89, + "tests_caught": 1.0, + "tests_checked": 17, + "look_vs_file": 0.201 + }, + "summary_seeds": { + "7": { + "callers_recall": 1.0, + "callers_precision": 1.0, + "callers_checked": 20, + "blind_recall": 0.917, + "blind_checked": 12, + "common_recall": null, + "common_precision": null, + "common_recall_with_maybe": null, + "common_checked": 0, + "rename_ok": 1.0, + "rename_checked": 20, + "tests_recall": 0.76, + "tests_precision": 0.917, + "tests_top10_precision": 0.917, + "tests_top10_best": 0.917, + "tests_caught": 1.0, + "tests_checked": 8, + "look_vs_file": 0.216 + }, + "8": { + "callers_recall": 1.0, + "callers_precision": 1.0, + "callers_checked": 20, + "blind_recall": 1.0, + "blind_checked": 12, + "common_recall": null, + "common_precision": null, + "common_recall_with_maybe": null, + "common_checked": 0, + "rename_ok": 1.0, + "rename_checked": 20, + "tests_recall": 0.786, + "tests_precision": 0.903, + "tests_top10_precision": 0.903, + "tests_top10_best": 0.903, + "tests_caught": 1.0, + "tests_checked": 8, + "look_vs_file": 0.228 + }, + "9": { + "callers_recall": 1.0, + "callers_precision": 1.0, + "callers_checked": 20, + "blind_recall": 0.75, + "blind_checked": 12, + "common_recall": null, + "common_precision": null, + "common_recall_with_maybe": null, + "common_checked": 0, + "rename_ok": 1.0, + "rename_checked": 20, + "tests_recall": 0.781, + "tests_precision": 0.915, + "tests_top10_precision": 0.915, + "tests_top10_best": 0.915, + "tests_caught": 1.0, + "tests_checked": 8, + "look_vs_file": 0.177 + } + }, + "noise": { + "callers_recall": { + "mean": 1.0, + "functions": 28, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.04 + }, + "callers_precision": { + "mean": 1.0, + "functions": 28, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.04 + }, + "blind_recall": { + "mean": 0.846, + "functions": 26, + "boot_lo": 0.731, + "boot_hi": 0.962, + "boot_half": 0.115, + "seeds": [ + 0.917, + 1.0, + 0.75 + ], + "seed_sd": 0.127, + "threshold": 0.12 + }, + "common_recall": null, + "common_recall_with_maybe": null, + "common_precision": null, + "rename_ok": { + "mean": 1.0, + "functions": 28, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.04 + }, + "tests_recall": { + "mean": 0.772, + "functions": 17, + "boot_lo": 0.699, + "boot_hi": 0.843, + "boot_half": 0.072, + "seeds": [ + 0.76, + 0.786, + 0.781 + ], + "seed_sd": 0.014, + "threshold": 0.08 + }, + "tests_precision": { + "mean": 0.89, + "functions": 17, + "boot_lo": 0.818, + "boot_hi": 0.953, + "boot_half": 0.068, + "seeds": [ + 0.917, + 0.903, + 0.915 + ], + "seed_sd": 0.007, + "threshold": 0.07 + }, + "tests_top10_precision": { + "mean": 0.89, + "functions": 17, + "boot_lo": 0.818, + "boot_hi": 0.953, + "boot_half": 0.068, + "seeds": [ + 0.917, + 0.903, + 0.915 + ], + "seed_sd": 0.007, + "threshold": 0.07 + }, + "tests_top10_best": { + "mean": 0.89, + "functions": 17, + "boot_lo": 0.818, + "boot_hi": 0.953, + "boot_half": 0.068, + "seeds": [ + 0.917, + 0.903, + 0.915 + ], + "seed_sd": 0.007, + "threshold": 0.07 + }, + "tests_caught": { + "mean": 1.0, + "functions": 17, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.06 + }, + "look_vs_file": { + "mean": 0.201, + "functions": 28, + "boot_lo": 0.145, + "boot_hi": 0.265, + "boot_half": 0.06, + "seeds": [ + 0.216, + 0.228, + 0.177 + ], + "seed_sd": 0.027, + "threshold": 0.07 + } + } + }, + { + "repo": "pathe", + "lang": "typescript", + "commit": "bc7477a01f0b", + "index_seconds": 0.1, + "symbols": 57, + "files": 8, + "seeds": [ + 7, + 8, + 9 + ], + "edges": 5290, + "sample": [ + "src::utils::normalizeAliases", + "src::_path::normalize", + "src::_path::isAbsolute", + "src::_path::join", + "src::_path::normalizeString", + "src::_path::extname", + "src::_internal::normalizeWindowsPath", + "src::_glob::matchGlob", + "src::_path::basename", + "src::_path::resolve", + "src::_path::dirname" + ], + "sample_common": [], + "samples": { + "7": [ + "src::utils::normalizeAliases", + "src::_path::normalize", + "src::_path::isAbsolute", + "src::_path::join", + "src::_path::normalizeString", + "src::_path::extname", + "src::_internal::normalizeWindowsPath", + "src::_glob::matchGlob", + "src::_path::basename", + "src::_path::resolve", + "src::_path::dirname" + ], + "8": [ + "src::_path::resolve", + "src::_path::dirname", + "src::_path::isAbsolute", + "src::_path::normalizeString", + "src::_path::extname", + "src::utils::normalizeAliases", + "src::_internal::normalizeWindowsPath", + "src::_glob::matchGlob", + "src::_path::join", + "src::_path::normalize", + "src::_path::basename" + ], + "9": [ + "src::_path::join", + "src::_path::isAbsolute", + "src::_path::basename", + "src::_path::resolve", + "src::_internal::normalizeWindowsPath", + "src::_path::normalizeString", + "src::_glob::matchGlob", + "src::_path::dirname", + "src::_path::normalize", + "src::_path::extname", + "src::utils::normalizeAliases" + ] + }, + "samples_common": { + "7": [], + "8": [], + "9": [] + }, + "samples_blind": { + "7": [ + "src::utils::normalizeAliases", + "src::_path::normalize", + "src::_path::relative", + "src::utils::reverseResolveAlias", + "src::_path::toNamespacedPath", + "src::_path::isAbsolute", + "src::_path::format", + "src::_path::join", + "src::_path::matchesGlob", + "src::_path::normalizeString", + "src::utils::resolveAlias", + "src::_path::extname", + "src::_internal::normalizeWindowsPath", + "src::_glob::matchGlob", + "src::utils::filename", + "src::_path::basename", + "src::_path::resolve", + "src::_path::dirname" + ], + "8": [ + "src::_path::resolve", + "src::_path::relative", + "src::_path::dirname", + "src::_path::isAbsolute", + "src::utils::resolveAlias", + "src::_path::normalizeString", + "src::utils::filename", + "src::_path::extname", + "src::_path::matchesGlob", + "src::utils::normalizeAliases", + "src::_internal::normalizeWindowsPath", + "src::_glob::matchGlob", + "src::utils::reverseResolveAlias", + "src::_path::join", + "src::_path::normalize", + "src::_path::basename", + "src::_path::format", + "src::_path::toNamespacedPath" + ], + "9": [ + "src::_path::join", + "src::_path::relative", + "src::_path::isAbsolute", + "src::utils::reverseResolveAlias", + "src::_path::basename", + "src::_path::resolve", + "src::_path::matchesGlob", + "src::_internal::normalizeWindowsPath", + "src::_path::toNamespacedPath", + "src::utils::resolveAlias", + "src::_path::normalizeString", + "src::_glob::matchGlob", + "src::_path::dirname", + "src::utils::filename", + "src::_path::normalize", + "src::_path::extname", + "src::_path::format", + "src::utils::normalizeAliases" + ] + }, + "baseline_failing_tests": [], + "callers": [ + { + "symbol": "src::utils::normalizeAliases", + "truth": [ + "src::utils::resolveAlias", + "src::utils::reverseResolveAlias" + ], + "found": [ + "src::utils::resolveAlias", + "src::utils::reverseResolveAlias" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "src::_path::normalize", + "truth": [ + "src::_path::join", + "src::_path::matchesGlob" + ], + "found": [ + "src::_path::join", + "src::_path::matchesGlob" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "src::_path::isAbsolute", + "truth": [ + "src::_path::dirname", + "src::_path::normalize", + "src::_path::resolve" + ], + "found": [ + "src::_path::dirname", + "src::_path::normalize", + "src::_path::resolve" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "src::_path::join", + "truth": [ + "src::utils::resolveAlias", + "src::utils::reverseResolveAlias" + ], + "found": [ + "src::utils::resolveAlias", + "src::utils::reverseResolveAlias" + ], + "maybe": [], + "import_files": [ + "src/utils.ts" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "src::_path::normalizeString", + "truth": [ + "src::_path::normalize", + "src::_path::resolve" + ], + "found": [ + "src::_path::normalize", + "src::_path::resolve" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "src::_path::extname", + "truth": [ + "src::_path::parse" + ], + "found": [ + "src::_path::parse" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "src::_internal::normalizeWindowsPath", + "truth": [ + "src::_path::basename", + "src::_path::dirname", + "src::_path::format", + "src::_path::normalize", + "src::_path::parse", + "src::_path::resolve", + "src::_path::toNamespacedPath", + "src::utils::resolveAlias", + "src::utils::reverseResolveAlias" + ], + "found": [ + "src::_path::basename", + "src::_path::dirname", + "src::_path::format", + "src::_path::normalize", + "src::_path::parse", + "src::_path::resolve", + "src::_path::toNamespacedPath", + "src::utils::resolveAlias", + "src::utils::reverseResolveAlias" + ], + "maybe": [], + "import_files": [ + "src/_path.ts", + "src/utils.ts" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "src::_glob::matchGlob", + "truth": [ + "src::_path::matchesGlob" + ], + "found": [ + "src::_path::matchesGlob" + ], + "maybe": [], + "import_files": [ + "src/_path.ts" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "src::_path::basename", + "truth": [ + "src::_path::extname", + "src::_path::parse" + ], + "found": [ + "src::_path::extname", + "src::_path::parse" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "src::_path::resolve", + "truth": [ + "src::_path::format", + "src::_path::relative" + ], + "found": [ + "src::_path::format", + "src::_path::relative" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "src::_path::dirname", + "truth": [ + "src::_path::parse" + ], + "found": [ + "src::_path::parse" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + } + ], + "callers_common": [], + "callers_blind": [ + { + "symbol": "src::utils::normalizeAliases", + "truth": [ + "src::utils::resolveAlias", + "src::utils::reverseResolveAlias" + ], + "found": [ + "src::utils::resolveAlias", + "src::utils::reverseResolveAlias" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "src::_path::normalize", + "truth": [ + "src::_path::join", + "src::_path::matchesGlob" + ], + "found": [ + "src::_path::join", + "src::_path::matchesGlob" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "src::_path::relative", + "skipped": "compiler reported no uses" + }, + { + "symbol": "src::utils::reverseResolveAlias", + "skipped": "compiler reported no uses" + }, + { + "symbol": "src::_path::toNamespacedPath", + "skipped": "compiler reported no uses" + }, + { + "symbol": "src::_path::isAbsolute", + "truth": [ + "src::_path::dirname", + "src::_path::normalize", + "src::_path::resolve" + ], + "found": [ + "src::_path::dirname", + "src::_path::normalize", + "src::_path::resolve" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "src::_path::format", + "skipped": "compiler reported no uses" + }, + { + "symbol": "src::_path::join", + "truth": [ + "src::utils::resolveAlias", + "src::utils::reverseResolveAlias" + ], + "found": [ + "src::utils::resolveAlias", + "src::utils::reverseResolveAlias" + ], + "maybe": [], + "import_files": [ + "src/utils.ts" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "src::_path::matchesGlob", + "skipped": "compiler reported no uses" + }, + { + "symbol": "src::_path::normalizeString", + "truth": [ + "src::_path::normalize", + "src::_path::resolve" + ], + "found": [ + "src::_path::normalize", + "src::_path::resolve" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "src::utils::resolveAlias", + "skipped": "compiler reported no uses" + }, + { + "symbol": "src::_path::extname", + "truth": [ + "src::_path::parse" + ], + "found": [ + "src::_path::parse" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "src::_internal::normalizeWindowsPath", + "truth": [ + "src::_path::basename", + "src::_path::dirname", + "src::_path::format", + "src::_path::normalize", + "src::_path::parse", + "src::_path::resolve", + "src::_path::toNamespacedPath", + "src::utils::resolveAlias", + "src::utils::reverseResolveAlias" + ], + "found": [ + "src::_path::basename", + "src::_path::dirname", + "src::_path::format", + "src::_path::normalize", + "src::_path::parse", + "src::_path::resolve", + "src::_path::toNamespacedPath", + "src::utils::resolveAlias", + "src::utils::reverseResolveAlias" + ], + "maybe": [], + "import_files": [ + "src/_path.ts", + "src/utils.ts" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "src::_glob::matchGlob", + "truth": [ + "src::_path::matchesGlob" + ], + "found": [ + "src::_path::matchesGlob" + ], + "maybe": [], + "import_files": [ + "src/_path.ts" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "src::utils::filename", + "skipped": "compiler reported no uses" + }, + { + "symbol": "src::_path::basename", + "truth": [ + "src::_path::extname", + "src::_path::parse" + ], + "found": [ + "src::_path::extname", + "src::_path::parse" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "src::_path::resolve", + "truth": [ + "src::_path::format", + "src::_path::relative" + ], + "found": [ + "src::_path::format", + "src::_path::relative" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "src::_path::dirname", + "truth": [ + "src::_path::parse" + ], + "found": [ + "src::_path::parse" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + } + ], + "rename": [ + { + "symbol": "src::utils::normalizeAliases", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "src::_path::normalize", + "ok": false, + "compiled": false, + "tests_ok": null, + "tests_failed": [], + "old_name_left": "src/_internal.ts:1:// Util to normalize windows paths to posix\nsrc/_path.ts:28:export const normalize_gnx: typeof path.normalize = function (path: string) {\ntest/index.spec.ts:205:runTest(\"normalize_gnx\", normalize, {", + "detail": "test/index.spec.ts(13,3): error TS6133: 'normalize_gnx' is declared but its value is never read.\ntest/index.spec.ts(205,26): error TS2304: Cannot find name 'normalize'.\n" + }, + { + "symbol": "src::_path::isAbsolute", + "ok": false, + "compiled": false, + "tests_ok": null, + "tests_failed": [], + "old_name_left": "src/_path.ts:216:export const isAbsoluteGnx: typeof path.isAbsolute = function (p) {\ntest/index.spec.ts:37:runTest(\"isAbsoluteGnx\", isAbsolute, {", + "detail": "test/index.spec.ts(11,3): error TS6133: 'isAbsoluteGnx' is declared but its value is never read.\ntest/index.spec.ts(37,26): error TS2552: Cannot find name 'isAbsolute'. Did you mean 'isAbsoluteGnx'?\n" + }, + { + "symbol": "src::_path::join", + "ok": false, + "compiled": false, + "tests_ok": null, + "tests_failed": [], + "old_name_left": "src/_glob.ts:309:const normalizeGlob = (glob: string): string => parse(glob, NormalizeGrammar).join(\"\");\nsrc/_glob.ts:366: (_) => regex(_.join(\"\")),\nsrc/_glob.ts:372: makeRangePaddedInt(+$1, +$2, Math.min($1.length, $2.length)).join(\"|\"),\nsrc/_glob.ts:376: (_: string, $1: string, $2: string) => m", + "detail": "src/_glob.ts(238,54): error TS2339: Property 'join_gnx' does not exist on type 'string[]'.\ntest/index.spec.ts(12,3): error TS6133: 'join_gnx' is declared but its value is never read.\ntest/index.spec.ts(179,21): error TS2304: Cannot find name 'join'.\ntest/index.spec.ts(478,50): error TS2339: Property 'join_gnx' does not exist on type 'string[]'.\ntest/index.spec.ts(483,50): error TS2339: Property 'join_gnx' does not exist on type 'string[]'.\n" + }, + { + "symbol": "src::_path::normalizeString", + "ok": false, + "compiled": false, + "tests_ok": null, + "tests_failed": [], + "old_name_left": "test/index.spec.ts:56:runTest(\"normalizeStringGnx\", normalizeString, {", + "detail": "test/index.spec.ts(17,3): error TS6133: 'normalizeStringGnx' is declared but its value is never read.\ntest/index.spec.ts(56,31): error TS2552: Cannot find name 'normalizeString'. Did you mean 'normalizeStringGnx'?\n" + }, + { + "symbol": "src::_path::extname", + "ok": false, + "compiled": false, + "tests_ok": null, + "tests_failed": [], + "old_name_left": "src/_path.ts:224:export const extname_gnx: typeof path.extname = function (p) {\ntest/index.spec.ts:132:runTest(\"extname_gnx\", extname, {", + "detail": "test/index.spec.ts(6,3): error TS6133: 'extname_gnx' is declared but its value is never read.\ntest/index.spec.ts(132,24): error TS2304: Cannot find name 'extname'.\n" + }, + { + "symbol": "src::_internal::normalizeWindowsPath", + "ok": false, + "compiled": false, + "tests_ok": null, + "tests_failed": [], + "old_name_left": "test/index.spec.ts:25:runTest(\"normalizeWindowsPathGnx\", normalizeWindowsPath, {", + "detail": "test/index.spec.ts(25,36): error TS2552: Cannot find name 'normalizeWindowsPath'. Did you mean 'normalizeWindowsPathGnx'?\n" + }, + { + "symbol": "src::_glob::matchGlob", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "src::_path::basename", + "ok": false, + "compiled": false, + "tests_ok": null, + "tests_failed": [], + "old_name_left": "src/_path.ts:269:export const basename_gnx: typeof path.basename = function (p, extension) {\ntest/index.spec.ts:79:runTest(\"basename_gnx\", basename, [", + "detail": "test/index.spec.ts(4,3): error TS6133: 'basename_gnx' is declared but its value is never read.\ntest/index.spec.ts(79,25): error TS2304: Cannot find name 'basename'.\n" + }, + { + "symbol": "src::_path::resolve", + "ok": false, + "compiled": false, + "tests_ok": null, + "tests_failed": [], + "old_name_left": "pnpm-lock.yaml:251: '@jridgewell/resolve-uri@3.1.2':\npnpm-lock.yaml:1076: resolve-pkg-maps@1.0.0:\npnpm-lock.yaml:1399: '@jridgewell/resolve-uri@3.1.2': {}\npnpm-lock.yaml:1405: '@jridgewell/resolve-uri': 3.1.2\npnpm-lock.yaml:1842: resolve-pkg-maps: 1.0.0", + "detail": "test/index.spec.ts(366,24): error TS2304: Cannot find name 'resolve'.\n" + }, + { + "symbol": "src::_path::dirname", + "ok": false, + "compiled": false, + "tests_ok": null, + "tests_failed": [], + "old_name_left": "src/_path.ts:255:export const dirname_gnx: typeof path.dirname = function (p) {\ntest/index.spec.ts:109:runTest(\"dirname_gnx\", dirname, {", + "detail": "test/index.spec.ts(5,3): error TS6133: 'dirname_gnx' is declared but its value is never read.\ntest/index.spec.ts(109,24): error TS2552: Cannot find name 'dirname'. Did you mean '__dirname'?\n" + } + ], + "mutants": { + "7": [ + "src::utils::normalizeAliases", + "src::_path::normalize", + "src::_path::isAbsolute", + "src::_path::join", + "src::_path::normalizeString", + "src::_path::extname", + "src::_internal::normalizeWindowsPath", + "src::_glob::matchGlob" + ], + "8": [ + "src::_path::resolve", + "src::_path::dirname", + "src::_path::isAbsolute", + "src::_path::normalizeString", + "src::_path::extname", + "src::utils::normalizeAliases", + "src::_internal::normalizeWindowsPath", + "src::_glob::matchGlob" + ], + "9": [ + "src::_path::join", + "src::_path::isAbsolute", + "src::_path::basename", + "src::_path::resolve", + "src::_internal::normalizeWindowsPath", + "src::_path::normalizeString", + "src::_glob::matchGlob", + "src::_path::dirname" + ] + }, + "tests": [ + { + "symbol": "src::utils::normalizeAliases", + "level": "file", + "truth": 1, + "predicted": 1, + "recall": 1.0, + "precision": 1.0, + "top_hits": 1, + "top_n": 1, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [] + }, + { + "symbol": "src::_path::normalize", + "level": "file", + "truth": 3, + "predicted": 2, + "recall": 0.6666666666666666, + "precision": 1.0, + "top_hits": 2, + "top_n": 2, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [ + "test/index.spec.ts" + ] + }, + { + "symbol": "src::_path::isAbsolute", + "level": "file", + "truth": 3, + "predicted": 3, + "recall": 1.0, + "precision": 1.0, + "top_hits": 3, + "top_n": 3, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [] + }, + { + "symbol": "src::_path::join", + "level": "file", + "truth": 2, + "predicted": 1, + "recall": 0.5, + "precision": 1.0, + "top_hits": 1, + "top_n": 1, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [ + "test/index.spec.ts" + ] + }, + { + "symbol": "src::_path::normalizeString", + "level": "file", + "truth": 3, + "predicted": 3, + "recall": 1.0, + "precision": 1.0, + "top_hits": 3, + "top_n": 3, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [] + }, + { + "symbol": "src::_path::extname", + "level": "file", + "truth": 1, + "predicted": 1, + "recall": 1.0, + "precision": 1.0, + "top_hits": 1, + "top_n": 1, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [] + }, + { + "symbol": "src::_internal::normalizeWindowsPath", + "level": "file", + "truth": 3, + "predicted": 3, + "recall": 1.0, + "precision": 1.0, + "top_hits": 3, + "top_n": 3, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [] + }, + { + "symbol": "src::_glob::matchGlob", + "level": "file", + "truth": 3, + "predicted": 2, + "recall": 0.6666666666666666, + "precision": 1.0, + "top_hits": 2, + "top_n": 2, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [ + "test/index.spec.ts" + ] + }, + { + "symbol": "src::_path::resolve", + "level": "file", + "truth": 1, + "predicted": 1, + "recall": 1.0, + "precision": 1.0, + "top_hits": 1, + "top_n": 1, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [] + }, + { + "symbol": "src::_path::dirname", + "level": "file", + "truth": 1, + "predicted": 1, + "recall": 1.0, + "precision": 1.0, + "top_hits": 1, + "top_n": 1, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [] + }, + { + "symbol": "src::_path::basename", + "level": "file", + "truth": 1, + "predicted": 1, + "recall": 1.0, + "precision": 1.0, + "top_hits": 1, + "top_n": 1, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [] + } + ], + "look": [ + { + "symbol": "src::utils::normalizeAliases", + "look_tokens": 428, + "file_tokens": 1034 + }, + { + "symbol": "src::_path::normalize", + "look_tokens": 319, + "file_tokens": 2338 + }, + { + "symbol": "src::_path::isAbsolute", + "look_tokens": 140, + "file_tokens": 2338 + }, + { + "symbol": "src::_path::join", + "look_tokens": 225, + "file_tokens": 2338 + }, + { + "symbol": "src::_path::normalizeString", + "look_tokens": 659, + "file_tokens": 2338 + }, + { + "symbol": "src::_path::extname", + "look_tokens": 194, + "file_tokens": 2338 + }, + { + "symbol": "src::_internal::normalizeWindowsPath", + "look_tokens": 295, + "file_tokens": 130 + }, + { + "symbol": "src::_glob::matchGlob", + "look_tokens": 174, + "file_tokens": 3688 + }, + { + "symbol": "src::_path::basename", + "look_tokens": 209, + "file_tokens": 2338 + }, + { + "symbol": "src::_path::resolve", + "look_tokens": 484, + "file_tokens": 2338 + }, + { + "symbol": "src::_path::dirname", + "look_tokens": 173, + "file_tokens": 2338 + } + ], + "seconds": 271, + "summary": { + "callers_recall": 1.0, + "callers_precision": 1.0, + "callers_checked": 11, + "blind_recall": 1.0, + "blind_checked": 11, + "common_recall": null, + "common_precision": null, + "common_recall_with_maybe": null, + "common_checked": 0, + "rename_ok": 0.182, + "rename_checked": 11, + "tests_recall": 0.894, + "tests_precision": 1.0, + "tests_top10_precision": 1.0, + "tests_top10_best": 1.0, + "tests_caught": 1.0, + "tests_checked": 11, + "look_vs_file": 0.342 + }, + "summary_seeds": { + "7": { + "callers_recall": 1.0, + "callers_precision": 1.0, + "callers_checked": 11, + "blind_recall": 1.0, + "blind_checked": 11, + "common_recall": null, + "common_precision": null, + "common_recall_with_maybe": null, + "common_checked": 0, + "rename_ok": 0.182, + "rename_checked": 11, + "tests_recall": 0.854, + "tests_precision": 1.0, + "tests_top10_precision": 1.0, + "tests_top10_best": 1.0, + "tests_caught": 1.0, + "tests_checked": 8, + "look_vs_file": 0.342 + }, + "8": { + "callers_recall": 1.0, + "callers_precision": 1.0, + "callers_checked": 11, + "blind_recall": 1.0, + "blind_checked": 11, + "common_recall": null, + "common_precision": null, + "common_recall_with_maybe": null, + "common_checked": 0, + "rename_ok": 0.182, + "rename_checked": 11, + "tests_recall": 0.958, + "tests_precision": 1.0, + "tests_top10_precision": 1.0, + "tests_top10_best": 1.0, + "tests_caught": 1.0, + "tests_checked": 8, + "look_vs_file": 0.342 + }, + "9": { + "callers_recall": 1.0, + "callers_precision": 1.0, + "callers_checked": 11, + "blind_recall": 1.0, + "blind_checked": 11, + "common_recall": null, + "common_precision": null, + "common_recall_with_maybe": null, + "common_checked": 0, + "rename_ok": 0.182, + "rename_checked": 11, + "tests_recall": 0.896, + "tests_precision": 1.0, + "tests_top10_precision": 1.0, + "tests_top10_best": 1.0, + "tests_caught": 1.0, + "tests_checked": 8, + "look_vs_file": 0.342 + } + }, + "noise": { + "callers_recall": { + "mean": 1.0, + "functions": 11, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.1 + }, + "callers_precision": { + "mean": 1.0, + "functions": 11, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.1 + }, + "blind_recall": { + "mean": 1.0, + "functions": 11, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.1 + }, + "common_recall": null, + "common_recall_with_maybe": null, + "common_precision": null, + "rename_ok": { + "mean": 0.182, + "functions": 11, + "boot_lo": 0.0, + "boot_hi": 0.364, + "boot_half": 0.182, + "seeds": [ + 0.182, + 0.182, + 0.182 + ], + "seed_sd": 0.0, + "threshold": 0.19 + }, + "tests_recall": { + "mean": 0.894, + "functions": 11, + "boot_lo": 0.803, + "boot_hi": 0.97, + "boot_half": 0.083, + "seeds": [ + 0.854, + 0.958, + 0.896 + ], + "seed_sd": 0.052, + "threshold": 0.1 + }, + "tests_precision": { + "mean": 1.0, + "functions": 11, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.1 + }, + "tests_top10_precision": { + "mean": 1.0, + "functions": 11, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.1 + }, + "tests_top10_best": { + "mean": 1.0, + "functions": 11, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.1 + }, + "tests_caught": { + "mean": 1.0, + "functions": 11, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.1 + }, + "look_vs_file": { + "mean": 0.342, + "functions": 11, + "boot_lo": 0.115, + "boot_hi": 0.723, + "boot_half": 0.304, + "seeds": [ + 0.342, + 0.342, + 0.342 + ], + "seed_sd": 0.0, + "threshold": 0.31 + } + } + }, + { + "repo": "urfave-cli", + "lang": "go", + "commit": "d5c06cb04479", + "index_seconds": 0.9, + "symbols": 703, + "files": 45, + "seeds": [ + 7, + 8, + 9 + ], + "edges": 8526, + "sample": [ + "main::ValueSourceChain::LookupWithSource", + "main::Command::VisibleFlagCategories", + "main::Command::VisibleFlags", + "main::Exit", + "main::ShowVersion", + "main::ValueSourceChain::EnvKeys", + "main::Command::Walk", + "main::Command::Path", + "main::File", + "main::Command::FullName", + "main::Command::Bool", + "main::EnvVar", + "main::Command::LocalFlagNames", + "main::Command::VisiblePersistentFlags", + "main::HandleExitCoder", + "main::EnvVars", + "main::DefaultCompleteWithFlags", + "main::Command::Lineage", + "main::Command::Root" + ], + "sample_common": [ + "main::extFlag::Names", + "main::ValueSourceChain::GoString", + "main::genericValue::IsBoolFlag", + "main::Command::VisibleCategories", + "main::FlagBase::GetEnvVars", + "main::BoolWithInverseFlag::IsDefaultVisible", + "main::FlagBase::IsLocal", + "main::stringSliceArgs::First", + "main::BoolWithInverseFlag::TakesValue", + "main::BoolWithInverseFlag::GetCategory", + "main::BoolWithInverseFlag::RunAction", + "main::commandCategory::Name", + "main::FlagBase::SetStringer", + "main::extFlag::GetDefaultText", + "main::stringSliceArgs::Present", + "main::BoolWithInverseFlag::IsRequired", + "main::exitError::ExitCode", + "main::mutuallyExclusiveGroup::Error", + "main::FlagBase::IsVisible", + "main::Command::HasName", + "main::extFlag::SetCategory", + "main::mapSource::GoString", + "main::extFlag::GetCategory", + "main::FlagBase::IsSet", + "main::commandCategory::VisibleCommands", + "main::FlagBase::GetValue", + "main::extFlag::GetEnvVars", + "main::extFlag::IsBoolFlag", + "main::extFlag::IsLocal", + "main::MapBase::Value", + "main::FlagBase::PreParse", + "main::BoolWithInverseFlag::GetDeprecated", + "main::BoolWithInverseFlag::GetUsage", + "main::FlagBase::IsDefaultVisible", + "main::ArgumentsBase::Parse", + "main::BoolWithInverseFlag::TypeName", + "main::BoolWithInverseFlag::IsVisible", + "main::FlagBase::Names", + "main::envVarValueSource::IsFromEnv", + "main::BoolWithInverseFlag::IsSet", + "main::mutuallyExclusiveGroupRequiredFlag::Error", + "main::defaultVisibleFlagCategory::Name" + ], + "samples": { + "7": [ + "main::ValueSourceChain::LookupWithSource", + "main::Command::VisibleFlagCategories", + "main::Command::VisibleFlags", + "main::Exit", + "main::ShowVersion", + "main::ValueSourceChain::EnvKeys", + "main::Command::Walk", + "main::Command::Path", + "main::File", + "main::Command::FullName", + "main::Command::Bool", + "main::EnvVar", + "main::Command::LocalFlagNames", + "main::Command::VisiblePersistentFlags", + "main::HandleExitCoder", + "main::EnvVars", + "main::DefaultCompleteWithFlags", + "main::Command::Lineage", + "main::Command::Root" + ], + "8": [ + "main::Exit", + "main::Command::VisibleFlagCategories", + "main::DefaultCompleteWithFlags", + "main::Command::Walk", + "main::Command::Lineage", + "main::Command::FullName", + "main::ShowVersion", + "main::ValueSourceChain::EnvKeys", + "main::ValueSourceChain::LookupWithSource", + "main::Command::Root", + "main::EnvVar", + "main::Command::VisibleFlags", + "main::HandleExitCoder", + "main::Command::Bool", + "main::EnvVars", + "main::Command::LocalFlagNames", + "main::Command::VisiblePersistentFlags", + "main::Command::Path", + "main::File" + ], + "9": [ + "main::EnvVars", + "main::Command::Walk", + "main::ValueSourceChain::LookupWithSource", + "main::ValueSourceChain::EnvKeys", + "main::Command::VisibleFlags", + "main::ShowVersion", + "main::HandleExitCoder", + "main::DefaultCompleteWithFlags", + "main::Command::Lineage", + "main::File", + "main::Command::FullName", + "main::Command::Root", + "main::Command::Bool", + "main::Command::VisiblePersistentFlags", + "main::Command::LocalFlagNames", + "main::Command::VisibleFlagCategories", + "main::Exit", + "main::Command::Path", + "main::EnvVar" + ] + }, + "samples_common": { + "7": [ + "main::extFlag::Names", + "main::ValueSourceChain::GoString", + "main::genericValue::IsBoolFlag", + "main::Command::VisibleCategories", + "main::FlagBase::GetEnvVars", + "main::BoolWithInverseFlag::IsDefaultVisible", + "main::FlagBase::IsLocal", + "main::stringSliceArgs::First", + "main::BoolWithInverseFlag::TakesValue", + "main::BoolWithInverseFlag::GetCategory", + "main::BoolWithInverseFlag::RunAction", + "main::commandCategory::Name", + "main::FlagBase::SetStringer", + "main::extFlag::GetDefaultText", + "main::stringSliceArgs::Present", + "main::BoolWithInverseFlag::IsRequired", + "main::exitError::ExitCode", + "main::mutuallyExclusiveGroup::Error", + "main::FlagBase::IsVisible", + "main::Command::HasName" + ], + "8": [ + "main::extFlag::SetCategory", + "main::mapSource::GoString", + "main::extFlag::GetCategory", + "main::Command::HasName", + "main::BoolWithInverseFlag::IsRequired", + "main::BoolWithInverseFlag::IsDefaultVisible", + "main::FlagBase::IsSet", + "main::commandCategory::VisibleCommands", + "main::FlagBase::GetValue", + "main::BoolWithInverseFlag::TakesValue", + "main::BoolWithInverseFlag::RunAction", + "main::extFlag::GetEnvVars", + "main::extFlag::IsBoolFlag", + "main::extFlag::GetDefaultText", + "main::stringSliceArgs::First", + "main::extFlag::IsLocal", + "main::MapBase::Value", + "main::FlagBase::PreParse", + "main::BoolWithInverseFlag::GetDeprecated", + "main::BoolWithInverseFlag::GetUsage" + ], + "9": [ + "main::FlagBase::GetValue", + "main::FlagBase::SetStringer", + "main::FlagBase::IsDefaultVisible", + "main::BoolWithInverseFlag::GetCategory", + "main::FlagBase::IsLocal", + "main::BoolWithInverseFlag::IsRequired", + "main::ValueSourceChain::GoString", + "main::ArgumentsBase::Parse", + "main::extFlag::GetEnvVars", + "main::BoolWithInverseFlag::TypeName", + "main::genericValue::IsBoolFlag", + "main::BoolWithInverseFlag::IsVisible", + "main::FlagBase::Names", + "main::BoolWithInverseFlag::RunAction", + "main::envVarValueSource::IsFromEnv", + "main::BoolWithInverseFlag::IsSet", + "main::mutuallyExclusiveGroupRequiredFlag::Error", + "main::defaultVisibleFlagCategory::Name", + "main::Command::VisibleCategories", + "main::stringSliceArgs::Present" + ] + }, + "samples_blind": { + "7": [ + "main::Command::NArg", + "main::NewValueSourceChain", + "main::exitError::Unwrap", + "main::ValueSourceChain::LookupWithSource", + "main::Command::Uint64", + "main::Command::Timestamp", + "main::Command::Int16", + "main::DefaultShowCommandHelp", + "scripts::VetActionFunc", + "main::Command::Uint", + "main::Command::VisibleFlagCategories", + "main::Command::Int64", + "main::Command::VisibleFlags", + "main::Command::Duration", + "main::Command::Uint16", + "main::Command::Generic", + "main::Exit", + "main::ValueSourceChain::Append", + "main::NewMapSource", + "main::DefaultPrintVersion" + ], + "8": [ + "main::Exit", + "main::Command::NumFlags", + "scripts::LintActionFunc", + "main::Command::Timestamp", + "main::Command::Duration", + "scripts::SetMkdocsRemoteActionFunc", + "main::DefaultShowCommandHelp", + "main::Command::Float32", + "main::Command::VisibleFlagCategories", + "main::Command::Text", + "main::Command::Generic", + "main::DefaultCompleteWithFlags", + "main::DefaultShowRootCommandHelp", + "main::Command::Int16", + "main::Command::Walk", + "main::Command::Lineage", + "scripts::V3Diff", + "main::ShowSubcommandHelpAndExit", + "main::Command::FullName", + "main::Command::NArg" + ], + "9": [ + "main::EnvVars", + "main::Command::Walk", + "main::Command::Generic", + "scripts::V3Diff", + "scripts::SetMkdocsRemoteActionFunc", + "main::Command::Float64", + "main::ShowRootCommandHelpAndExit", + "main::Command::Uint16", + "scripts::EnsureGoimportsActionFunc", + "scripts::LintActionFunc", + "main::Command::ToFishCompletion", + "main::Command::Uint64", + "main::ValueSourceChain::LookupWithSource", + "main::Files", + "main::Command::Duration", + "main::NewSliceBase", + "main::ValueSourceChain::EnvKeys", + "main::Command::Int16", + "main::Command::VisibleFlags", + "main::ShowSubcommandHelpAndExit" + ] + }, + "baseline_failing_tests": [], + "callers": [ + { + "symbol": "main::ValueSourceChain::LookupWithSource", + "truth": [ + "main::BoolWithInverseFlag::PostParse", + "main::ValueSourceChain::Lookup" + ], + "found": [ + "main::BoolWithInverseFlag::PostParse", + "main::ValueSourceChain::Lookup" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Command::VisibleFlagCategories", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Command::VisibleFlags", + "truth": [ + "main::prepareFishFlags" + ], + "found": [ + "main::helpRenderer::flags", + "main::helpRenderer::root", + "main::helpRenderer::usage", + "main::prepareFishFlags" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 0.25, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Exit", + "truth": [ + "main::DefaultShowCommandHelp", + "main::buildShellCompletionSubcommand" + ], + "found": [ + "main::DefaultShowCommandHelp", + "main::buildShellCompletionSubcommand" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::ShowVersion", + "truth": [ + "main::Command::run" + ], + "found": [ + "main::Command::run" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::ValueSourceChain::EnvKeys", + "truth": [ + "main::BoolWithInverseFlag::GetEnvVars", + "main::FlagBase::GetEnvVars" + ], + "found": [ + "main::BoolWithInverseFlag::GetEnvVars", + "main::FlagBase::GetEnvVars" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Command::Walk", + "truth": [ + "main::Command::run", + "main::Command::setupCommandGraph" + ], + "found": [ + "main::Command::run", + "main::Command::setupCommandGraph" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Command::Path", + "truth": [ + "main::Command::FullName" + ], + "found": [ + "main::Command::FullName" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::File", + "truth": [ + "main::Files" + ], + "found": [ + "main::Files" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Command::FullName", + "truth": [ + "main::Command::checkDuplicateFlagNames" + ], + "found": [ + "main::Command::checkDuplicateFlagNames", + "main::DefaultPrintHelpCustom", + "main::helpRenderer::helpName", + "main::helpRenderer::root", + "main::helpRenderer::subcommand", + "main::helpRenderer::usage" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 0.16666666666666666, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Command::Bool", + "truth": [ + "main::Command::checkHelp", + "scripts::EnsureMkdocsActionFunc", + "scripts::GfmrunActionFunc", + "scripts::V3Diff" + ], + "found": [ + "scripts::EnsureMkdocsActionFunc", + "scripts::GfmrunActionFunc", + "scripts::V3Diff" + ], + "maybe": [], + "import_files": [], + "recall": 0.75, + "precision": 1.0, + "recall_with_maybe": 0.75 + }, + { + "symbol": "main::EnvVar", + "truth": [ + "main::EnvVars" + ], + "found": [ + "main::EnvVars" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Command::LocalFlagNames", + "truth": [ + "main::Command::FlagNames" + ], + "found": [ + "main::Command::FlagNames" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Command::VisiblePersistentFlags", + "truth": [ + "main::DefaultCompleteWithFlags", + "main::prepareFishFlags" + ], + "found": [ + "main::DefaultCompleteWithFlags", + "main::helpRenderer::persistentFlags", + "main::prepareFishFlags" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 0.6666666666666666, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::HandleExitCoder", + "truth": [ + "main::Command::handleExitCoder" + ], + "found": [ + "main::Command::handleExitCoder" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::EnvVars", + "truth": [ + "scripts::main" + ], + "found": [ + "scripts::main" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::DefaultCompleteWithFlags", + "truth": [ + "main::Command::setupDefaults", + "main::DefaultRootCommandComplete" + ], + "found": [ + "main::DefaultRootCommandComplete" + ], + "maybe": [], + "import_files": [], + "recall": 0.5, + "precision": 1.0, + "recall_with_maybe": 0.5 + }, + { + "symbol": "main::Command::Lineage", + "truth": [ + "main::Command::VisiblePersistentFlags", + "main::Command::lookupFlag", + "main::Command::useShortOptionHandling", + "main::commandAncestry", + "main::fishFlagHelper", + "main::fishSubcommandHelper", + "main::prepareFishCommands" + ], + "found": [ + "main::Command::VisiblePersistentFlags", + "main::Command::lookupFlag", + "main::Command::useShortOptionHandling", + "main::commandAncestry", + "main::fishFlagHelper", + "main::fishSubcommandHelper", + "main::prepareFishCommands" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Command::Root", + "truth": [ + "main::Command::handleRequiredError", + "main::Command::parseFlags", + "main::Command::run", + "main::DefaultCompleteWithFlags", + "main::DefaultPrintVersion", + "main::DefaultShowCommandHelp", + "main::DefaultShowRootCommandHelp", + "main::DefaultShowSubcommandHelp", + "main::buildShellCompletionSubcommand", + "main::checkShellCompleteFlag", + "main::runCompletion", + "main::shouldRunCompletion" + ], + "found": [ + "main::Command::handleRequiredError", + "main::Command::parseFlags", + "main::Command::run", + "main::DefaultCompleteWithFlags", + "main::DefaultPrintVersion", + "main::DefaultShowCommandHelp", + "main::DefaultShowRootCommandHelp", + "main::DefaultShowSubcommandHelp", + "main::buildShellCompletionSubcommand", + "main::checkShellCompleteFlag", + "main::runCompletion", + "main::shouldRunCompletion" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + } + ], + "callers_common": [ + { + "symbol": "main::extFlag::Names", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::ValueSourceChain::GoString", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::genericValue::IsBoolFlag", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Command::VisibleCategories", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::FlagBase::GetEnvVars", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::BoolWithInverseFlag::IsDefaultVisible", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::FlagBase::IsLocal", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::stringSliceArgs::First", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::BoolWithInverseFlag::TakesValue", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::BoolWithInverseFlag::GetCategory", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::BoolWithInverseFlag::RunAction", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::commandCategory::Name", + "truth": [ + "main::commandCategories::Less" + ], + "found": [], + "maybe": [ + "main::FlagBase::TypeName", + "main::commandCategories::Less", + "main::tracef" + ], + "import_files": [], + "recall": 0.0, + "precision": null, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::FlagBase::SetStringer", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::extFlag::GetDefaultText", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::stringSliceArgs::Present", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::BoolWithInverseFlag::IsRequired", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::exitError::ExitCode", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::mutuallyExclusiveGroup::Error", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::FlagBase::IsVisible", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Command::HasName", + "truth": [ + "main::Command::Command", + "main::DefaultShowCommandHelp" + ], + "found": [], + "maybe": [ + "main::Command::Command", + "main::Command::getArgValue", + "main::DefaultShowCommandHelp" + ], + "import_files": [], + "recall": 0.0, + "precision": null, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::extFlag::SetCategory", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::mapSource::GoString", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::extFlag::GetCategory", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::FlagBase::IsSet", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::commandCategory::VisibleCommands", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::FlagBase::GetValue", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::extFlag::GetEnvVars", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::extFlag::IsBoolFlag", + "truth": [ + "main::extFlag::TakesValue" + ], + "found": [ + "main::extFlag::TakesValue" + ], + "maybe": [ + "main::Command::parseFlags", + "main::FlagBase::IsBoolFlag", + "main::genericValue::IsBoolFlag" + ], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::extFlag::IsLocal", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::MapBase::Value", + "truth": [ + "main::MapBase::String" + ], + "found": [ + "main::MapBase::String" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::FlagBase::PreParse", + "truth": [ + "main::FlagBase::Set" + ], + "found": [ + "main::FlagBase::Set" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::BoolWithInverseFlag::GetDeprecated", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::BoolWithInverseFlag::GetUsage", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::FlagBase::IsDefaultVisible", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::ArgumentsBase::Parse", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::BoolWithInverseFlag::TypeName", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::BoolWithInverseFlag::IsVisible", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::FlagBase::Names", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::envVarValueSource::IsFromEnv", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::BoolWithInverseFlag::IsSet", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::mutuallyExclusiveGroupRequiredFlag::Error", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::defaultVisibleFlagCategory::Name", + "skipped": "compiler reported no uses" + } + ], + "callers_blind": [ + { + "symbol": "main::Command::NArg", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::NewValueSourceChain", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::exitError::Unwrap", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::ValueSourceChain::LookupWithSource", + "truth": [ + "main::BoolWithInverseFlag::PostParse", + "main::ValueSourceChain::Lookup" + ], + "found": [ + "main::BoolWithInverseFlag::PostParse", + "main::ValueSourceChain::Lookup" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Command::Uint64", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Command::Timestamp", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Command::Int16", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::DefaultShowCommandHelp", + "truth": [], + "found": [], + "maybe": [], + "import_files": [ + "help.go" + ], + "recall": null, + "precision": null, + "recall_with_maybe": null + }, + { + "symbol": "scripts::VetActionFunc", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Command::Uint", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Command::VisibleFlagCategories", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Command::Int64", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Command::VisibleFlags", + "truth": [ + "main::prepareFishFlags" + ], + "found": [ + "main::helpRenderer::flags", + "main::helpRenderer::root", + "main::helpRenderer::usage", + "main::prepareFishFlags" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 0.25, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Command::Duration", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Command::Uint16", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Command::Generic", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Exit", + "truth": [ + "main::DefaultShowCommandHelp", + "main::buildShellCompletionSubcommand" + ], + "found": [ + "main::DefaultShowCommandHelp", + "main::buildShellCompletionSubcommand" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::ValueSourceChain::Append", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::NewMapSource", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::DefaultPrintVersion", + "truth": [], + "found": [], + "maybe": [], + "import_files": [ + "help.go" + ], + "recall": null, + "precision": null, + "recall_with_maybe": null + }, + { + "symbol": "main::Command::NumFlags", + "skipped": "compiler reported no uses" + }, + { + "symbol": "scripts::LintActionFunc", + "truth": [ + "scripts::main" + ], + "found": [], + "maybe": [], + "import_files": [], + "recall": 0.0, + "precision": null, + "recall_with_maybe": 0.0 + }, + { + "symbol": "scripts::SetMkdocsRemoteActionFunc", + "truth": [ + "scripts::main" + ], + "found": [], + "maybe": [], + "import_files": [], + "recall": 0.0, + "precision": null, + "recall_with_maybe": 0.0 + }, + { + "symbol": "main::Command::Float32", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Command::Text", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::DefaultCompleteWithFlags", + "truth": [ + "main::Command::setupDefaults", + "main::DefaultRootCommandComplete" + ], + "found": [ + "main::DefaultRootCommandComplete" + ], + "maybe": [], + "import_files": [], + "recall": 0.5, + "precision": 1.0, + "recall_with_maybe": 0.5 + }, + { + "symbol": "main::DefaultShowRootCommandHelp", + "truth": [], + "found": [], + "maybe": [], + "import_files": [ + "help.go" + ], + "recall": null, + "precision": null, + "recall_with_maybe": null + }, + { + "symbol": "main::Command::Walk", + "truth": [ + "main::Command::run", + "main::Command::setupCommandGraph" + ], + "found": [ + "main::Command::run", + "main::Command::setupCommandGraph" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Command::Lineage", + "truth": [ + "main::Command::VisiblePersistentFlags", + "main::Command::lookupFlag", + "main::Command::useShortOptionHandling", + "main::commandAncestry", + "main::fishFlagHelper", + "main::fishSubcommandHelper", + "main::prepareFishCommands" + ], + "found": [ + "main::Command::VisiblePersistentFlags", + "main::Command::lookupFlag", + "main::Command::useShortOptionHandling", + "main::commandAncestry", + "main::fishFlagHelper", + "main::fishSubcommandHelper", + "main::prepareFishCommands" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "scripts::V3Diff", + "truth": [ + "scripts::main" + ], + "found": [], + "maybe": [], + "import_files": [], + "recall": 0.0, + "precision": null, + "recall_with_maybe": 0.0 + }, + { + "symbol": "main::ShowSubcommandHelpAndExit", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Command::FullName", + "truth": [ + "main::Command::checkDuplicateFlagNames" + ], + "found": [ + "main::Command::checkDuplicateFlagNames", + "main::DefaultPrintHelpCustom", + "main::helpRenderer::helpName", + "main::helpRenderer::root", + "main::helpRenderer::subcommand", + "main::helpRenderer::usage" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 0.16666666666666666, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::EnvVars", + "truth": [ + "scripts::main" + ], + "found": [ + "scripts::main" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Command::Float64", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::ShowRootCommandHelpAndExit", + "truth": [], + "found": [], + "maybe": [], + "import_files": [ + "help.go" + ], + "recall": null, + "precision": null, + "recall_with_maybe": null + }, + { + "symbol": "scripts::EnsureGoimportsActionFunc", + "truth": [ + "scripts::main" + ], + "found": [], + "maybe": [], + "import_files": [], + "recall": 0.0, + "precision": null, + "recall_with_maybe": 0.0 + }, + { + "symbol": "main::Command::ToFishCompletion", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Files", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::NewSliceBase", + "truth": [], + "found": [], + "maybe": [], + "import_files": [ + "flag_float_slice.go", + "flag_int_slice.go", + "flag_string_slice.go", + "flag_uint_slice.go" + ], + "recall": null, + "precision": null, + "recall_with_maybe": null + }, + { + "symbol": "main::ValueSourceChain::EnvKeys", + "truth": [ + "main::BoolWithInverseFlag::GetEnvVars", + "main::FlagBase::GetEnvVars" + ], + "found": [ + "main::BoolWithInverseFlag::GetEnvVars", + "main::FlagBase::GetEnvVars" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + } + ], + "rename": [ + { + "symbol": "main::ValueSourceChain::LookupWithSource", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "main::Command::VisibleFlagCategories", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "main::Command::VisibleFlags", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "main::Exit", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "errors.go:12:var OsExiter = os.Exit\nerrors.go:123:// Exit wraps a message and exit code into an error, which by default is\nerrors.go:156:// Unwrap returns the error given to [Exit], so that [errors.Is] and\nerrors_test.go:331:\t// The error given to Exit must stay reachable through the standard\nexampl", + "detail": "" + }, + { + "symbol": "main::ShowVersion", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "main::ValueSourceChain::EnvKeys", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "main::Command::Walk", + "ok": false, + "compiled": false, + "tests_ok": null, + "tests_failed": [], + "old_name_left": "autocomplete/bash_autocomplete:41: # Completion output lines use \"token:description\" format. Walk them once, keeping only\ncommand.go:721:// Walk visits cmd and every descendant. If fn returns a non-nil error, the\ncommand_run.go:315:\t// Walk the parent chain to check mutually exclusive flag groups", + "detail": "# github.com/urfave/cli/v3_test\n# [github.com/urfave/cli/v3_test]\n./examples_test.go:445:1: ExampleCommand_Walk_visibleTree refers to unknown field or method: Command.Walk\nFAIL\tgithub.com/urfave/cli/v3 [build failed]\n? \tgithub.com/urfave/cli/v3/examples/example-cli\t[no test files]\n? \tgithub.com/urfave/cli/v3/examples/example-hello-world\t[no test files]\n? \tgithub.com/urfave/cli/v3/scripts\t[no test files]\nFAIL\n" + }, + { + "symbol": "main::Command::Path", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "command.go:711:// Path returns the path of command names from the root to cmd, inclusive.\ncommand.go:712:// Each element is a Command.Name. Path traverses upward via parent pointers\nerrors_test.go:348:\t\t\tmessage: &fs.PathError{Op: \"open\", Path: \"x\", Err: fs.ErrNotExist},\nexamples_test.go:468:\t\t\t// R", + "detail": "" + }, + { + "symbol": "main::File", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "main::Command::FullName", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "main::Command::Bool", + "ok": false, + "compiled": false, + "tests_ok": null, + "tests_failed": [], + "old_name_left": "command.go:216:\treturn helpFlag != nil && slices.ContainsFunc(helpFlag.Names(), cmd.Bool)\ncommand_test.go:4767:\text := flag.Bool(\"v\", false, \"ext package flag usage\")\nflag_ext_test.go:95:\text := flag.Bool(\"ext\", false, \"\")\nflag_ext_test.go:150:\t\t\text := flag.Bool(\"v\", false, \"\")\nflag_ext_test.go:176", + "detail": "# github.com/urfave/cli/v3\n./command.go:216:70: cmd.Bool undefined (type *Command has no field or method Bool)\nFAIL\tgithub.com/urfave/cli/v3 [build failed]\nFAIL\tgithub.com/urfave/cli/v3/examples/example-cli [build failed]\n? \tgithub.com/urfave/cli/v3/examples/example-hello-world\t[no test files]\nFAIL\tgithub.com/urfave/cli/v3/scripts [build failed]\nFAIL\n" + }, + { + "symbol": "main::EnvVar", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "main::Command::LocalFlagNames", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "main::Command::VisiblePersistentFlags", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "main::HandleExitCoder", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "main::EnvVars", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "main::DefaultCompleteWithFlags", + "ok": false, + "compiled": false, + "tests_ok": null, + "tests_failed": [], + "old_name_left": "command_setup.go:25:\t\tcmd.ShellComplete = DefaultCompleteWithFlags\nhelp_test.go:1789:\t\t\tf := DefaultCompleteWithFlags", + "detail": "# github.com/urfave/cli/v3\n./command_setup.go:25:23: undefined: DefaultCompleteWithFlags\nFAIL\tgithub.com/urfave/cli/v3 [build failed]\nFAIL\tgithub.com/urfave/cli/v3/examples/example-cli [build failed]\n? \tgithub.com/urfave/cli/v3/examples/example-hello-world\t[no test files]\nFAIL\tgithub.com/urfave/cli/v3/scripts [build failed]\nFAIL\n" + }, + { + "symbol": "main::Command::Lineage", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "command.go:693:// Lineage returns *this* command and all of its ancestor commands\ncommand.go:713:// similar to Lineage. FullName() is equivalent to strings.Join(cmd.Path(), \" \").\nexamples_test.go:468:\t\t\t// Run has initialized the parent links used by Lineage and Path.\ngodoc-current.txt:731: Linea", + "detail": "" + }, + { + "symbol": "main::Command::Root", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "command.go:406:// Root returns the Command at the root of the graph\ncommand_test.go:1943:\t\t\t\t\t&StringArg{Name: \"root\", UsageText: \"Root path\", Destination: &rootPath},\ngodoc-current.txt:753: Root returns the Command at the root of the graph\ntestdata/godoc-v3.x.txt:753: Root returns the Command", + "detail": "" + } + ], + "mutants": { + "7": [ + "main::ValueSourceChain::LookupWithSource", + "main::Command::VisibleFlagCategories", + "main::Command::VisibleFlags", + "main::Exit", + "main::ShowVersion", + "main::ValueSourceChain::EnvKeys", + "main::Command::Walk", + "main::Command::Path" + ], + "8": [ + "main::Exit", + "main::Command::VisibleFlagCategories", + "main::DefaultCompleteWithFlags", + "main::Command::Walk", + "main::Command::Lineage", + "main::Command::FullName", + "main::ShowVersion", + "main::ValueSourceChain::EnvKeys" + ], + "9": [ + "main::EnvVars", + "main::Command::Walk", + "main::ValueSourceChain::LookupWithSource", + "main::ValueSourceChain::EnvKeys", + "main::Command::VisibleFlags", + "main::ShowVersion", + "main::HandleExitCoder", + "main::DefaultCompleteWithFlags" + ] + }, + "tests": [ + { + "symbol": "main::ValueSourceChain::LookupWithSource", + "level": "name", + "truth": 18, + "predicted": 9, + "recall": 0.16666666666666666, + "precision": 0.3333333333333333, + "top_hits": 3, + "top_n": 9, + "top_precision": 0.3333333333333333, + "top_best": 0.3333333333333333, + "caught": 1.0, + "missed": [ + "TestBoolFlagCountFromCommand", + "TestBoolWithInverseAction", + "TestBoolWithInverseAlias", + "TestBoolWithInverseBasic", + "TestBoolWithInverseDestination", + "TestBoolWithInverseEnvVars", + "TestBoolWithInverseWithPrefix", + "TestCategorizedHelp" + ], + "recall_graph_only": 0.16666666666666666 + }, + { + "symbol": "main::Command::VisibleFlagCategories", + "level": "name", + "truth": 26, + "predicted": 6, + "recall": 0.038461538461538464, + "precision": 0.16666666666666666, + "top_hits": 1, + "top_n": 6, + "top_precision": 0.16666666666666666, + "top_best": 0.16666666666666666, + "caught": 1.0, + "missed": [ + "ExampleCommand_Run_appHelp", + "ExampleCommand_Run_commandHelp", + "ExampleCommand_Run_noAction", + "ExampleCommand_Run_subcommandNoAction", + "TestCategorizedHelp", + "TestCommandListAlignsNonASCIINames", + "TestExtFlagHelp", + "TestHelpFlagWorksWhenAliasYieldedToUserFlag" + ], + "recall_graph_only": 0.038461538461538464 + }, + { + "symbol": "main::Command::VisibleFlags", + "level": "name", + "truth": 45, + "predicted": 14, + "recall": 0.2, + "precision": 0.6428571428571429, + "top_hits": 5, + "top_n": 10, + "top_precision": 0.5, + "top_best": 0.9, + "caught": 1.0, + "missed": [ + "ExampleCommand_Run_appHelp", + "ExampleCommand_Run_commandHelp", + "ExampleCommand_Run_noAction", + "ExampleCommand_Run_subcommandNoAction", + "TestArgumentRequiredUsageInCommandHelp", + "TestCategorizedHelp", + "TestCommandListAlignsNonASCIINames", + "TestCommand_Run_Categories" + ], + "recall_graph_only": 0.2 + }, + { + "symbol": "main::Exit", + "level": "name", + "truth": 32, + "predicted": 32, + "recall": 0.46875, + "precision": 0.46875, + "top_hits": 10, + "top_n": 10, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [ + "TestArgumentsRootCommand", + "TestCommand_Args", + "TestCommand_RunDefaultCommand", + "TestCommand_RunDefaultCommandWithFlags", + "TestCommand_RunDefaultCommandWithSubCommand", + "TestCompletionDisable", + "TestCompletionInvalidShell", + "TestCompletionShellRenderError" + ], + "recall_graph_only": 0.46875 + }, + { + "symbol": "main::ShowVersion", + "level": "name", + "truth": 3, + "predicted": 399, + "recall": 1.0, + "precision": 0.007518796992481203, + "top_hits": 1, + "top_n": 10, + "top_precision": 0.1, + "top_best": 0.3, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "main::ValueSourceChain::EnvKeys", + "level": "name", + "truth": 67, + "predicted": 9, + "recall": 0.029850746268656716, + "precision": 0.2222222222222222, + "top_hits": 2, + "top_n": 9, + "top_precision": 0.2222222222222222, + "top_best": 0.2222222222222222, + "caught": 1.0, + "missed": [ + "ExampleCommand_Run_appHelp", + "ExampleCommand_Run_commandHelp", + "ExampleCommand_Run_noAction", + "ExampleCommand_Run_subcommandNoAction", + "TestBoolFlagHelpOutput", + "TestBoolWithInverseString", + "TestCategorizedHelp", + "TestCommand_ExclusiveFlagsWithAfter" + ], + "recall_graph_only": 0.029850746268656716 + }, + { + "symbol": "main::Command::Walk", + "level": "name", + "truth": 437, + "predicted": 411, + "recall": 0.9290617848970252, + "precision": 0.9878345498783455, + "top_hits": 10, + "top_n": 10, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [ + "ExampleBoolWithInverseFlag", + "ExampleCommand_Run", + "ExampleCommand_Run_appHelp", + "ExampleCommand_Run_commandHelp", + "ExampleCommand_Run_mapValues", + "ExampleCommand_Run_noAction", + "ExampleCommand_Run_shellComplete_bash", + "ExampleCommand_Run_shellComplete_bash_withLongFlag" + ], + "recall_graph_only": 0.9290617848970252 + }, + { + "symbol": "main::Command::Path", + "level": "name", + "truth": 58, + "predicted": 9, + "recall": 0.05172413793103448, + "precision": 0.3333333333333333, + "top_hits": 3, + "top_n": 9, + "top_precision": 0.3333333333333333, + "top_best": 0.3333333333333333, + "caught": 1.0, + "missed": [ + "ExampleCommand_Run_appHelp", + "ExampleCommand_Run_commandHelp", + "ExampleCommand_Run_noAction", + "ExampleCommand_Run_subcommandNoAction", + "ExampleCommand_Walk_visibleTree", + "TestArgumentRequiredUsageInCommandHelp", + "TestCategorizedHelp", + "TestCommandListAlignsNonASCIINames" + ], + "recall_graph_only": 0.017241379310344827 + }, + { + "symbol": "main::DefaultCompleteWithFlags", + "level": "name", + "truth": 13, + "predicted": 69, + "recall": 0.15384615384615385, + "precision": 0.028985507246376812, + "top_hits": 2, + "top_n": 10, + "top_precision": 0.2, + "top_best": 0.2, + "caught": 1.0, + "missed": [ + "ExampleCommand_Run_shellComplete_bash", + "ExampleCommand_Run_shellComplete_bash_withLongFlag", + "ExampleCommand_Run_shellComplete_bash_withMultipleLongFlag", + "ExampleCommand_Run_shellComplete_bash_withShortFlag", + "TestCommand_ParseFlags_InvalidFlagAccessHandler", + "TestCompletionAfterCompleteRootFlag", + "TestCompletionAfterDoubleDashDoesNotLeakToNextRun", + "TestCompletionAfterShortFlag" + ], + "recall_graph_only": 0.07692307692307693 + }, + { + "symbol": "main::Command::Lineage", + "level": "name", + "truth": 461, + "predicted": 130, + "recall": 0.27765726681127983, + "precision": 0.9846153846153847, + "top_hits": 9, + "top_n": 10, + "top_precision": 0.9, + "top_best": 1.0, + "caught": 1.0, + "missed": [ + "ExampleBoolWithInverseFlag", + "ExampleCommand_Run", + "ExampleCommand_Run_appHelp", + "ExampleCommand_Run_commandHelp", + "ExampleCommand_Run_mapValues", + "ExampleCommand_Run_noAction", + "ExampleCommand_Run_shellComplete_bash_withLongFlag", + "ExampleCommand_Run_shellComplete_bash_withMultipleLongFlag" + ], + "recall_graph_only": 0.27765726681127983 + }, + { + "symbol": "main::Command::FullName", + "level": "name", + "truth": 56, + "predicted": 7, + "recall": 0.017857142857142856, + "precision": 0.14285714285714285, + "top_hits": 1, + "top_n": 7, + "top_precision": 0.14285714285714285, + "top_best": 0.14285714285714285, + "caught": 1.0, + "missed": [ + "ExampleCommand_Run_appHelp", + "ExampleCommand_Run_commandHelp", + "ExampleCommand_Run_noAction", + "ExampleCommand_Run_subcommandNoAction", + "TestArgumentRequiredUsageInCommandHelp", + "TestCategorizedHelp", + "TestCommandListAlignsNonASCIINames", + "TestCommand_HelpFlagTakesPrecedenceOverParseErrors" + ], + "recall_graph_only": 0.0 + }, + { + "symbol": "main::EnvVars", + "level": "name", + "truth": 80, + "predicted": 80, + "recall": 1.0, + "precision": 1.0, + "top_hits": 10, + "top_n": 10, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "main::HandleExitCoder", + "level": "name", + "truth": 54, + "predicted": 413, + "recall": 0.9814814814814815, + "precision": 0.12832929782082325, + "top_hits": 10, + "top_n": 10, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [ + "TestBoolWithInverseAction" + ], + "recall_graph_only": 0.9814814814814815 + } + ], + "look": [ + { + "symbol": "main::ValueSourceChain::LookupWithSource", + "look_tokens": 252, + "file_tokens": 1476 + }, + { + "symbol": "main::Command::VisibleFlagCategories", + "look_tokens": 295, + "file_tokens": 6013 + }, + { + "symbol": "main::Command::VisibleFlags", + "look_tokens": 312, + "file_tokens": 6013 + }, + { + "symbol": "main::Exit", + "look_tokens": 435, + "file_tokens": 1356 + }, + { + "symbol": "main::ShowVersion", + "look_tokens": 293, + "file_tokens": 4668 + }, + { + "symbol": "main::ValueSourceChain::EnvKeys", + "look_tokens": 242, + "file_tokens": 1476 + }, + { + "symbol": "main::Command::Walk", + "look_tokens": 319, + "file_tokens": 6013 + }, + { + "symbol": "main::Command::Path", + "look_tokens": 316, + "file_tokens": 6013 + }, + { + "symbol": "main::File", + "look_tokens": 174, + "file_tokens": 1476 + }, + { + "symbol": "main::Command::FullName", + "look_tokens": 304, + "file_tokens": 6013 + }, + { + "symbol": "main::Command::Bool", + "look_tokens": 300, + "file_tokens": 411 + }, + { + "symbol": "main::EnvVar", + "look_tokens": 261, + "file_tokens": 1476 + }, + { + "symbol": "main::Command::LocalFlagNames", + "look_tokens": 267, + "file_tokens": 6013 + }, + { + "symbol": "main::Command::VisiblePersistentFlags", + "look_tokens": 446, + "file_tokens": 6013 + }, + { + "symbol": "main::HandleExitCoder", + "look_tokens": 581, + "file_tokens": 1356 + }, + { + "symbol": "main::EnvVars", + "look_tokens": 284, + "file_tokens": 1476 + }, + { + "symbol": "main::DefaultCompleteWithFlags", + "look_tokens": 716, + "file_tokens": 4668 + }, + { + "symbol": "main::Command::Lineage", + "look_tokens": 343, + "file_tokens": 6013 + }, + { + "symbol": "main::Command::Root", + "look_tokens": 385, + "file_tokens": 6013 + } + ], + "seconds": 1771, + "summary": { + "callers_recall": 0.958, + "callers_precision": 0.894, + "callers_checked": 18, + "blind_recall": 0.654, + "blind_checked": 13, + "common_recall": 0.6, + "common_precision": 1.0, + "common_recall_with_maybe": 1.0, + "common_checked": 5, + "rename_ok": 0.842, + "rename_checked": 19, + "tests_recall": 0.409, + "tests_precision": 0.419, + "tests_top10_precision": 0.531, + "tests_top10_best": 0.584, + "tests_caught": 1.0, + "tests_checked": 13, + "look_vs_file": 0.159 + }, + "summary_seeds": { + "7": { + "callers_recall": 0.958, + "callers_precision": 0.894, + "callers_checked": 18, + "blind_recall": 1.0, + "blind_checked": 3, + "common_recall": 0.0, + "common_precision": null, + "common_recall_with_maybe": 1.0, + "common_checked": 2, + "rename_ok": 0.842, + "rename_checked": 19, + "tests_recall": 0.361, + "tests_precision": 0.395, + "tests_top10_precision": 0.457, + "tests_top10_best": 0.532, + "tests_caught": 1.0, + "tests_checked": 8, + "look_vs_file": 0.159 + }, + "8": { + "callers_recall": 0.958, + "callers_precision": 0.894, + "callers_checked": 18, + "blind_recall": 0.562, + "blind_checked": 8, + "common_recall": 0.75, + "common_precision": 1.0, + "common_recall_with_maybe": 1.0, + "common_checked": 4, + "rename_ok": 0.842, + "rename_checked": 19, + "tests_recall": 0.364, + "tests_precision": 0.376, + "tests_top10_precision": 0.466, + "tests_top10_best": 0.504, + "tests_caught": 1.0, + "tests_checked": 8, + "look_vs_file": 0.159 + }, + "9": { + "callers_recall": 0.958, + "callers_precision": 0.894, + "callers_checked": 18, + "blind_recall": 0.556, + "blind_checked": 9, + "common_recall": null, + "common_precision": null, + "common_recall_with_maybe": null, + "common_checked": 0, + "rename_ok": 0.842, + "rename_checked": 19, + "tests_recall": 0.558, + "tests_precision": 0.419, + "tests_top10_precision": 0.544, + "tests_top10_best": 0.619, + "tests_caught": 1.0, + "tests_checked": 8, + "look_vs_file": 0.159 + } + }, + "noise": { + "callers_recall": { + "mean": 0.958, + "functions": 18, + "boot_lo": 0.903, + "boot_hi": 1.0, + "boot_half": 0.049, + "seeds": [ + 0.958, + 0.958, + 0.958 + ], + "seed_sd": 0.0, + "threshold": 0.06 + }, + "callers_precision": { + "mean": 0.894, + "functions": 18, + "boot_lo": 0.792, + "boot_hi": 0.981, + "boot_half": 0.095, + "seeds": [ + 0.894, + 0.894, + 0.894 + ], + "seed_sd": 0.0, + "threshold": 0.1 + }, + "blind_recall": { + "mean": 0.654, + "functions": 13, + "boot_lo": 0.462, + "boot_hi": 0.846, + "boot_half": 0.192, + "seeds": [ + 1.0, + 0.562, + 0.556 + ], + "seed_sd": 0.255, + "threshold": 0.2 + }, + "common_recall": { + "mean": 0.6, + "functions": 5, + "boot_lo": 0.2, + "boot_hi": 1.0, + "boot_half": 0.4, + "seeds": [ + 0.0, + 0.75 + ], + "seed_sd": 0.53, + "threshold": 0.4 + }, + "common_recall_with_maybe": { + "mean": 1.0, + "functions": 5, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.2 + }, + "common_precision": { + "mean": 1.0, + "functions": 3, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0 + ], + "seed_sd": null, + "threshold": 0.34 + }, + "rename_ok": { + "mean": 0.842, + "functions": 19, + "boot_lo": 0.684, + "boot_hi": 0.947, + "boot_half": 0.132, + "seeds": [ + 0.842, + 0.842, + 0.842 + ], + "seed_sd": 0.0, + "threshold": 0.14 + }, + "tests_recall": { + "mean": 0.409, + "functions": 13, + "boot_lo": 0.233, + "boot_hi": 0.589, + "boot_half": 0.178, + "seeds": [ + 0.361, + 0.364, + 0.558 + ], + "seed_sd": 0.113, + "threshold": 0.18 + }, + "tests_precision": { + "mean": 0.419, + "functions": 13, + "boot_lo": 0.26, + "boot_hi": 0.581, + "boot_half": 0.16, + "seeds": [ + 0.395, + 0.376, + 0.419 + ], + "seed_sd": 0.021, + "threshold": 0.17 + }, + "tests_top10_precision": { + "mean": 0.531, + "functions": 13, + "boot_lo": 0.362, + "boot_hi": 0.697, + "boot_half": 0.168, + "seeds": [ + 0.457, + 0.466, + 0.544 + ], + "seed_sd": 0.048, + "threshold": 0.17 + }, + "tests_top10_best": { + "mean": 0.584, + "functions": 13, + "boot_lo": 0.412, + "boot_hi": 0.755, + "boot_half": 0.171, + "seeds": [ + 0.532, + 0.504, + 0.619 + ], + "seed_sd": 0.06, + "threshold": 0.18 + }, + "tests_caught": { + "mean": 1.0, + "functions": 13, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.08 + }, + "look_vs_file": { + "mean": 0.159, + "functions": 19, + "boot_lo": 0.103, + "boot_hi": 0.229, + "boot_half": 0.063, + "seeds": [ + 0.159, + 0.159, + 0.159 + ], + "seed_sd": 0.0, + "threshold": 0.07 + } + } + }, + { + "repo": "logrus", + "lang": "go", + "commit": "6ef0748d1177", + "index_seconds": 0.4, + "symbols": 311, + "files": 26, + "seeds": [ + 7, + 8, + 9 + ], + "edges": 3476, + "sample": [ + "main::Logger::LogFn", + "main::mutexWrap::Lock", + "main::mutexWrap::Unlock", + "main::Entry::Bytes", + "main::mutexWrap::Disable", + "main::NewEntry" + ], + "sample_common": [ + "main::Entry::Fatalln", + "main::Entry::Logln", + "main::Entry::WriterLevel", + "main::Logger::Panicln", + "main::Logger::Infoln", + "main::Entry::Warningf", + "main::Logger::Errorln", + "main::Entry::WithError", + "main::Entry::Errorf", + "main::Entry::String", + "main::Logger::Info", + "main::Logger::FatalFn", + "main::Entry::Panicf", + "main::Logger::Logf", + "main::Entry::Traceln", + "main::Logger::WithField", + "main::Logger::Println", + "main::Logger::WithContext", + "main::Logger::Debugf", + "hooks::slog::Hook::Fire", + "main::Logger::PrintFn", + "main::Entry::Debug", + "main::Logger::Error", + "main::Entry::Warnln", + "main::Logger::Fatalf", + "main::Logger::DebugFn", + "hooks::syslog::SyslogHook::Fire", + "main::Logger::Warnf", + "main::Logger::Printf", + "main::JSONFormatter::Format", + "main::Logger::IsLevelEnabled", + "main::Logger::WithFields", + "main::Logger::Trace", + "main::Logger::Traceln", + "main::Entry::Errorln", + "main::Logger::SetOutput", + "main::Logger::GetLevel", + "main::Entry::Printf", + "main::Logger::WriterLevel", + "main::Logger::Panic", + "main::Logger::Infof", + "main::Logger::Warnln", + "main::Entry::Info", + "main::Logger::PanicFn", + "main::Logger::Fatal", + "main::Level::String", + "hooks::slog::SlogLevel::Level", + "main::Entry::WithFields" + ], + "samples": { + "7": [ + "main::Logger::LogFn", + "main::mutexWrap::Lock", + "main::mutexWrap::Unlock", + "main::Entry::Bytes", + "main::mutexWrap::Disable", + "main::NewEntry" + ], + "8": [ + "main::mutexWrap::Disable", + "main::mutexWrap::Unlock", + "main::Logger::LogFn", + "main::mutexWrap::Lock", + "main::Entry::Bytes", + "main::NewEntry" + ], + "9": [ + "main::NewEntry", + "main::mutexWrap::Unlock", + "main::Entry::Bytes", + "main::mutexWrap::Disable", + "main::Logger::LogFn", + "main::mutexWrap::Lock" + ] + }, + "samples_common": { + "7": [ + "main::Entry::Fatalln", + "main::Entry::Logln", + "main::Entry::WriterLevel", + "main::Logger::Panicln", + "main::Logger::Infoln", + "main::Entry::Warningf", + "main::Logger::Errorln", + "main::Entry::WithError", + "main::Entry::Errorf", + "main::Entry::String", + "main::Logger::Info", + "main::Logger::FatalFn", + "main::Entry::Panicf", + "main::Logger::Logf", + "main::Entry::Traceln", + "main::Logger::WithField", + "main::Logger::Println", + "main::Logger::WithContext", + "main::Logger::Debugf", + "hooks::slog::Hook::Fire" + ], + "8": [ + "main::Logger::PrintFn", + "main::Entry::Debug", + "main::Entry::WithError", + "main::Logger::Error", + "main::Logger::Infoln", + "main::Entry::String", + "main::Entry::Warnln", + "main::Logger::Fatalf", + "main::Logger::Info", + "main::Logger::DebugFn", + "hooks::syslog::SyslogHook::Fire", + "main::Logger::Warnf", + "main::Logger::Printf", + "main::JSONFormatter::Format", + "main::Entry::Logln", + "main::Logger::IsLevelEnabled", + "main::Logger::WithFields", + "main::Logger::Trace", + "main::Logger::Traceln", + "main::Entry::Errorln" + ], + "9": [ + "main::Logger::SetOutput", + "main::Logger::FatalFn", + "main::Entry::Errorf", + "main::Logger::GetLevel", + "main::Entry::Printf", + "main::Logger::WriterLevel", + "main::Entry::Logln", + "main::Logger::Panic", + "main::Logger::Infof", + "main::Logger::Warnln", + "main::Entry::Info", + "main::Logger::PanicFn", + "main::Logger::Errorln", + "main::Logger::Fatal", + "main::Level::String", + "hooks::slog::SlogLevel::Level", + "hooks::syslog::SyslogHook::Fire", + "main::Entry::Fatalln", + "main::Entry::WithFields", + "main::Logger::Println" + ] + }, + "samples_blind": { + "7": [ + "main::StandardLogger", + "main::Logger::LogFn", + "main::Level::UnmarshalText", + "main::mutexWrap::Lock", + "hooks::slog::Handler::Enabled", + "internal::testutils::LogAndAssertText", + "main::Level::MarshalText", + "main::ParseLevel", + "hooks::slog::NewHandler", + "main::Logger::SetNoLock", + "internal::testutils::LogAndAssertJSON", + "main::mutexWrap::Unlock", + "hooks::slog::Handler::Handle", + "main::RegisterExitHandler", + "hooks::slog::Handler::WithAttrs", + "hooks::slog::NewHook", + "main::Entry::Bytes", + "main::mutexWrap::Disable", + "main::NewEntry", + "main::DeferExitHandler" + ], + "8": [ + "main::mutexWrap::Disable", + "hooks::slog::Handler::WithAttrs", + "main::mutexWrap::Unlock", + "main::Logger::LogFn", + "main::StandardLogger", + "main::Level::UnmarshalText", + "internal::testutils::LogAndAssertText", + "internal::testutils::LogAndAssertJSON", + "main::mutexWrap::Lock", + "main::RegisterExitHandler", + "hooks::slog::Handler::WithGroup", + "main::Logger::SetNoLock", + "main::Entry::Bytes", + "hooks::slog::Handler::Handle", + "main::ParseLevel", + "main::Level::MarshalText", + "main::Logger::ReplaceHooks", + "main::NewEntry", + "main::DeferExitHandler", + "hooks::slog::NewHandler" + ], + "9": [ + "hooks::slog::Handler::Enabled", + "main::NewEntry", + "main::mutexWrap::Unlock", + "main::Level::UnmarshalText", + "main::Entry::Bytes", + "main::ParseLevel", + "hooks::syslog::NewSyslogHook", + "hooks::slog::NewHandler", + "main::mutexWrap::Disable", + "internal::testutils::LogAndAssertJSON", + "main::Logger::ReplaceHooks", + "main::Logger::LogFn", + "main::DeferExitHandler", + "hooks::slog::Handler::WithAttrs", + "main::mutexWrap::Lock", + "main::Level::MarshalText", + "hooks::slog::Handler::WithGroup", + "main::RegisterExitHandler", + "main::StandardLogger", + "main::Entry::HasCaller" + ] + }, + "baseline_failing_tests": [], + "callers": [ + { + "symbol": "main::Logger::LogFn", + "truth": [ + "main::Logger::DebugFn", + "main::Logger::ErrorFn", + "main::Logger::FatalFn", + "main::Logger::InfoFn", + "main::Logger::TraceFn", + "main::Logger::WarnFn" + ], + "found": [ + "main::Logger::DebugFn", + "main::Logger::ErrorFn", + "main::Logger::FatalFn", + "main::Logger::InfoFn", + "main::Logger::TraceFn", + "main::Logger::WarnFn" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::mutexWrap::Lock", + "truth": [ + "main::Entry::Bytes", + "main::Entry::log", + "main::Entry::write", + "main::Logger::AddHook", + "main::Logger::ReplaceHooks", + "main::Logger::SetBufferPool", + "main::Logger::SetFormatter", + "main::Logger::SetOutput", + "main::Logger::SetReportCaller", + "main::Logger::hooksForLevel", + "main::TextFormatter::isTerminal" + ], + "found": [ + "main::Entry::Bytes", + "main::Entry::log", + "main::Entry::write", + "main::Logger::AddHook", + "main::Logger::ReplaceHooks", + "main::Logger::SetBufferPool", + "main::Logger::SetFormatter", + "main::Logger::SetOutput", + "main::Logger::SetReportCaller", + "main::Logger::hooksForLevel", + "main::TextFormatter::isTerminal" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::mutexWrap::Unlock", + "truth": [ + "main::Entry::Bytes", + "main::Entry::log", + "main::Entry::write", + "main::Logger::AddHook", + "main::Logger::ReplaceHooks", + "main::Logger::SetBufferPool", + "main::Logger::SetFormatter", + "main::Logger::SetOutput", + "main::Logger::SetReportCaller", + "main::Logger::hooksForLevel", + "main::TextFormatter::isTerminal" + ], + "found": [ + "main::Entry::Bytes", + "main::Entry::log", + "main::Entry::write", + "main::Logger::AddHook", + "main::Logger::ReplaceHooks", + "main::Logger::SetBufferPool", + "main::Logger::SetFormatter", + "main::Logger::SetOutput", + "main::Logger::SetReportCaller", + "main::Logger::hooksForLevel", + "main::TextFormatter::isTerminal" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Entry::Bytes", + "truth": [ + "hooks::writer::Hook::Fire", + "main::Entry::String" + ], + "found": [ + "hooks::writer::Hook::Fire", + "main::Entry::String", + "main::JSONFormatter::Format", + "main::TextFormatter::Format" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 0.5, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::mutexWrap::Disable", + "truth": [ + "main::Logger::SetNoLock" + ], + "found": [ + "main::Logger::SetNoLock" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::NewEntry", + "truth": [ + "main::Logger::WriterLevel", + "main::Logger::newEntry" + ], + "found": [ + "main::Logger::WriterLevel", + "main::Logger::newEntry" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + } + ], + "callers_common": [ + { + "symbol": "main::Entry::Fatalln", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Entry::Logln", + "truth": [ + "main::Entry::Debugln", + "main::Entry::Errorln", + "main::Entry::Fatalln", + "main::Entry::Infoln", + "main::Entry::Traceln", + "main::Entry::Warnln", + "main::Logger::Logln" + ], + "found": [ + "main::Entry::Debugln", + "main::Entry::Errorln", + "main::Entry::Fatalln", + "main::Entry::Infoln", + "main::Entry::Traceln", + "main::Entry::Warnln", + "main::Logger::Logln" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Entry::WriterLevel", + "truth": [ + "main::Entry::Writer", + "main::Logger::WriterLevel" + ], + "found": [ + "main::Entry::Writer", + "main::Logger::WriterLevel" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Logger::Panicln", + "truth": [ + "main::Panicln" + ], + "found": [], + "maybe": [ + "main::Panicln" + ], + "import_files": [], + "recall": 0.0, + "precision": null, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Logger::Infoln", + "truth": [ + "main::Infoln" + ], + "found": [], + "maybe": [ + "main::Infoln" + ], + "import_files": [], + "recall": 0.0, + "precision": null, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Entry::Warningf", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Logger::Errorln", + "truth": [ + "main::Errorln" + ], + "found": [], + "maybe": [ + "main::Errorln" + ], + "import_files": [], + "recall": 0.0, + "precision": null, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Entry::WithError", + "truth": [ + "main::Logger::WithError" + ], + "found": [ + "main::Logger::WithError" + ], + "maybe": [ + "main::WithError" + ], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Entry::Errorf", + "truth": [ + "main::Entry::writerScanner" + ], + "found": [ + "main::Entry::writerScanner" + ], + "maybe": [ + "main::Errorf" + ], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Entry::String", + "truth": [ + "hooks::syslog::SyslogHook::Fire" + ], + "found": [ + "hooks::syslog::SyslogHook::Fire" + ], + "maybe": [ + "main", + "main::JSONFormatter::Format", + "main::TextFormatter::printPlain" + ], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Logger::Info", + "truth": [ + "main::Info" + ], + "found": [], + "maybe": [ + "main::Info" + ], + "import_files": [], + "recall": 0.0, + "precision": null, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Logger::FatalFn", + "truth": [ + "main::FatalFn" + ], + "found": [ + "main::FatalFn" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Entry::Panicf", + "truth": [ + "main::Logger::Panicf" + ], + "found": [ + "main::Logger::Panicf" + ], + "maybe": [ + "main::Panicf" + ], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Logger::Logf", + "truth": [ + "main::Logger::Debugf", + "main::Logger::Errorf", + "main::Logger::Fatalf", + "main::Logger::Infof", + "main::Logger::Tracef", + "main::Logger::Warnf" + ], + "found": [ + "main::Logger::Debugf", + "main::Logger::Errorf", + "main::Logger::Fatalf", + "main::Logger::Infof", + "main::Logger::Tracef", + "main::Logger::Warnf" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Entry::Traceln", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Logger::WithField", + "truth": [ + "main::WithField" + ], + "found": [], + "maybe": [ + "main::WithField" + ], + "import_files": [], + "recall": 0.0, + "precision": null, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Logger::Println", + "truth": [ + "main::Println" + ], + "found": [], + "maybe": [ + "main::Println" + ], + "import_files": [], + "recall": 0.0, + "precision": null, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Logger::WithContext", + "truth": [ + "main::WithContext" + ], + "found": [], + "maybe": [ + "main::WithContext" + ], + "import_files": [], + "recall": 0.0, + "precision": null, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Logger::Debugf", + "truth": [ + "main::Debugf" + ], + "found": [], + "maybe": [ + "main::Debugf" + ], + "import_files": [], + "recall": 0.0, + "precision": null, + "recall_with_maybe": 1.0 + }, + { + "symbol": "hooks::slog::Hook::Fire", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Logger::PrintFn", + "truth": [ + "main::PrintFn" + ], + "found": [ + "main::PrintFn" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Entry::Debug", + "truth": [ + "main::Entry::WriterLevel" + ], + "found": [], + "maybe": [ + "main::Debug" + ], + "import_files": [], + "recall": 0.0, + "precision": null, + "recall_with_maybe": 0.0 + }, + { + "symbol": "main::Logger::Error", + "truth": [ + "main::Error" + ], + "found": [], + "maybe": [ + "main::Error", + "main::JSONFormatter::Format", + "main::TextFormatter::appendError" + ], + "import_files": [], + "recall": 0.0, + "precision": null, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Entry::Warnln", + "truth": [ + "main::Entry::Warningln" + ], + "found": [ + "main::Entry::Warningln" + ], + "maybe": [ + "main::Warnln" + ], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Logger::Fatalf", + "truth": [ + "main::Fatalf" + ], + "found": [], + "maybe": [ + "main::Fatalf" + ], + "import_files": [], + "recall": 0.0, + "precision": null, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Logger::DebugFn", + "truth": [ + "main::DebugFn" + ], + "found": [ + "main::DebugFn" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "hooks::syslog::SyslogHook::Fire", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Logger::Warnf", + "truth": [ + "main::Logger::Warningf", + "main::Warnf" + ], + "found": [ + "main::Logger::Warningf" + ], + "maybe": [ + "main::Warnf" + ], + "import_files": [], + "recall": 0.5, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Logger::Printf", + "truth": [ + "main::Printf" + ], + "found": [], + "maybe": [ + "main::Printf" + ], + "import_files": [], + "recall": 0.0, + "precision": null, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::JSONFormatter::Format", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Logger::IsLevelEnabled", + "truth": [ + "hooks::slog::Handler::Enabled", + "hooks::slog::Handler::Handle", + "main::Entry::Log", + "main::Entry::Logf", + "main::Entry::Logln", + "main::Entry::Panic", + "main::Entry::Panicf", + "main::Entry::Panicln", + "main::IsLevelEnabled", + "main::Logger::Log", + "main::Logger::LogFn", + "main::Logger::Logf", + "main::Logger::Logln", + "main::Logger::Panic", + "main::Logger::PanicFn", + "main::Logger::Panicf", + "main::Logger::Panicln" + ], + "found": [ + "hooks::slog::Handler::Enabled", + "hooks::slog::Handler::Handle", + "main::Entry::Log", + "main::Entry::Logf", + "main::Entry::Logln", + "main::Entry::Panic", + "main::Entry::Panicf", + "main::Entry::Panicln", + "main::IsLevelEnabled", + "main::Logger::Log", + "main::Logger::LogFn", + "main::Logger::Logf", + "main::Logger::Logln", + "main::Logger::Panic", + "main::Logger::PanicFn", + "main::Logger::Panicf", + "main::Logger::Panicln" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Logger::WithFields", + "truth": [ + "main::WithFields" + ], + "found": [], + "maybe": [ + "main::WithFields" + ], + "import_files": [], + "recall": 0.0, + "precision": null, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Logger::Trace", + "truth": [ + "main::Trace" + ], + "found": [], + "maybe": [ + "main::Trace" + ], + "import_files": [], + "recall": 0.0, + "precision": null, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Logger::Traceln", + "truth": [ + "main::Traceln" + ], + "found": [], + "maybe": [ + "main::Traceln" + ], + "import_files": [], + "recall": 0.0, + "precision": null, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Entry::Errorln", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Logger::SetOutput", + "truth": [ + "main::SetOutput" + ], + "found": [ + "main::SetOutput" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Logger::GetLevel", + "truth": [ + "main::GetLevel" + ], + "found": [ + "main::GetLevel" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Entry::Printf", + "truth": [ + "main::Logger::Printf" + ], + "found": [ + "main::Logger::Printf" + ], + "maybe": [ + "main::Printf" + ], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Logger::WriterLevel", + "truth": [ + "main::Logger::Writer" + ], + "found": [ + "main::Logger::Writer" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Logger::Panic", + "truth": [ + "main::Panic" + ], + "found": [], + "maybe": [ + "main::Panic" + ], + "import_files": [], + "recall": 0.0, + "precision": null, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Logger::Infof", + "truth": [ + "main::Infof" + ], + "found": [], + "maybe": [ + "main::Infof" + ], + "import_files": [], + "recall": 0.0, + "precision": null, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Logger::Warnln", + "truth": [ + "main::Logger::Warningln", + "main::Warnln" + ], + "found": [ + "main::Logger::Warningln" + ], + "maybe": [ + "main::Warnln" + ], + "import_files": [], + "recall": 0.5, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Entry::Info", + "truth": [ + "main::Entry::Print", + "main::Entry::WriterLevel" + ], + "found": [ + "main::Entry::Print" + ], + "maybe": [ + "main::Info" + ], + "import_files": [], + "recall": 0.5, + "precision": 1.0, + "recall_with_maybe": 0.5 + }, + { + "symbol": "main::Logger::PanicFn", + "truth": [ + "main::PanicFn" + ], + "found": [ + "main::PanicFn" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Logger::Fatal", + "truth": [ + "main::Fatal" + ], + "found": [], + "maybe": [ + "main::Fatal" + ], + "import_files": [], + "recall": 0.0, + "precision": null, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Level::String", + "truth": [ + "main::JSONFormatter::Format", + "main::Level::MarshalText", + "main::TextFormatter::printPlain", + "main::formatLevel" + ], + "found": [ + "main::Level::MarshalText", + "main::formatLevel" + ], + "maybe": [ + "main", + "main::JSONFormatter::Format", + "main::TextFormatter::printPlain" + ], + "import_files": [ + "level.go" + ], + "recall": 0.5, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "hooks::slog::SlogLevel::Level", + "truth": [ + "hooks::slog::Handler::toLogrusLevel" + ], + "found": [], + "maybe": [ + "hooks::slog::Handler::toLogrusLevel", + "hooks::slog::Hook::toSlogLevel" + ], + "import_files": [], + "recall": 0.0, + "precision": null, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Entry::WithFields", + "truth": [ + "main::Logger::WithFields" + ], + "found": [ + "main::Logger::WithFields" + ], + "maybe": [ + "main::WithFields" + ], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + } + ], + "callers_blind": [ + { + "symbol": "main::StandardLogger", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Logger::LogFn", + "truth": [ + "main::Logger::DebugFn", + "main::Logger::ErrorFn", + "main::Logger::FatalFn", + "main::Logger::InfoFn", + "main::Logger::TraceFn", + "main::Logger::WarnFn" + ], + "found": [ + "main::Logger::DebugFn", + "main::Logger::ErrorFn", + "main::Logger::FatalFn", + "main::Logger::InfoFn", + "main::Logger::TraceFn", + "main::Logger::WarnFn" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Level::UnmarshalText", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::mutexWrap::Lock", + "truth": [ + "main::Entry::Bytes", + "main::Entry::log", + "main::Entry::write", + "main::Logger::AddHook", + "main::Logger::ReplaceHooks", + "main::Logger::SetBufferPool", + "main::Logger::SetFormatter", + "main::Logger::SetOutput", + "main::Logger::SetReportCaller", + "main::Logger::hooksForLevel", + "main::TextFormatter::isTerminal" + ], + "found": [ + "main::Entry::Bytes", + "main::Entry::log", + "main::Entry::write", + "main::Logger::AddHook", + "main::Logger::ReplaceHooks", + "main::Logger::SetBufferPool", + "main::Logger::SetFormatter", + "main::Logger::SetOutput", + "main::Logger::SetReportCaller", + "main::Logger::hooksForLevel", + "main::TextFormatter::isTerminal" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "hooks::slog::Handler::Enabled", + "skipped": "compiler reported no uses" + }, + { + "symbol": "internal::testutils::LogAndAssertText", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Level::MarshalText", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::ParseLevel", + "skipped": "compiler reported no uses" + }, + { + "symbol": "hooks::slog::NewHandler", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Logger::SetNoLock", + "skipped": "compiler reported no uses" + }, + { + "symbol": "internal::testutils::LogAndAssertJSON", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::mutexWrap::Unlock", + "truth": [ + "main::Entry::Bytes", + "main::Entry::log", + "main::Entry::write", + "main::Logger::AddHook", + "main::Logger::ReplaceHooks", + "main::Logger::SetBufferPool", + "main::Logger::SetFormatter", + "main::Logger::SetOutput", + "main::Logger::SetReportCaller", + "main::Logger::hooksForLevel", + "main::TextFormatter::isTerminal" + ], + "found": [ + "main::Entry::Bytes", + "main::Entry::log", + "main::Entry::write", + "main::Logger::AddHook", + "main::Logger::ReplaceHooks", + "main::Logger::SetBufferPool", + "main::Logger::SetFormatter", + "main::Logger::SetOutput", + "main::Logger::SetReportCaller", + "main::Logger::hooksForLevel", + "main::TextFormatter::isTerminal" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "hooks::slog::Handler::Handle", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::RegisterExitHandler", + "skipped": "compiler reported no uses" + }, + { + "symbol": "hooks::slog::Handler::WithAttrs", + "skipped": "compiler reported no uses" + }, + { + "symbol": "hooks::slog::NewHook", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Entry::Bytes", + "truth": [ + "hooks::writer::Hook::Fire", + "main::Entry::String" + ], + "found": [ + "hooks::writer::Hook::Fire", + "main::Entry::String", + "main::JSONFormatter::Format", + "main::TextFormatter::Format" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 0.5, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::mutexWrap::Disable", + "truth": [ + "main::Logger::SetNoLock" + ], + "found": [ + "main::Logger::SetNoLock" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::NewEntry", + "truth": [ + "main::Logger::WriterLevel", + "main::Logger::newEntry" + ], + "found": [ + "main::Logger::WriterLevel", + "main::Logger::newEntry" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::DeferExitHandler", + "skipped": "compiler reported no uses" + }, + { + "symbol": "hooks::slog::Handler::WithGroup", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Logger::ReplaceHooks", + "skipped": "compiler reported no uses" + }, + { + "symbol": "hooks::syslog::NewSyslogHook", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Entry::HasCaller", + "skipped": "compiler reported no uses" + } + ], + "rename": [ + { + "symbol": "main::Logger::LogFn", + "ok": false, + "compiled": false, + "tests_ok": null, + "tests_failed": [], + "old_name_left": "logger_test.go:94:\t\t\t\tlogger.LogFn(logrus.PanicLevel, func() []any { return []any{\"boom\", 42} })", + "detail": ".test]\n./logger_test.go:94:12: logger.LogFn undefined (type *logrus.Logger has no field or method LogFn)\nFAIL\tgithub.com/sirupsen/logrus [build failed]\nok \tgithub.com/sirupsen/logrus/hooks/slog\t0.009s [no tests to run]\nok \tgithub.com/sirupsen/logrus/hooks/syslog\t0.004s [no tests to run]\nok \tgithub.com/sirupsen/logrus/hooks/test\t0.003s [no tests to run]\nok \tgithub.com/sirupsen/logrus/hooks/writer\t0.003s [no tests to run]\n? \tgithub.com/sirupsen/logrus/internal/testutils\t[no test files]\nFAIL\n" + }, + { + "symbol": "main::mutexWrap::Lock", + "ok": false, + "compiled": false, + "tests_ok": null, + "tests_failed": [], + "old_name_left": "hooks/test/test.go:48:\tt.mu.Lock()\nhooks/test/test.go:84:\tt.mu.Lock()\nlogger.go:70:\t\tmw.lock.Lock()\nwriter_test.go:51:\tb.mu.Lock()", + "detail": "nx)\n./logrus_test.go:692:9: cond.L.LockGnx undefined (type \"sync\".Locker has no field or method LockGnx)\nFAIL\tgithub.com/sirupsen/logrus [build failed]\nok \tgithub.com/sirupsen/logrus/hooks/slog\t0.004s [no tests to run]\nok \tgithub.com/sirupsen/logrus/hooks/syslog\t0.008s [no tests to run]\nok \tgithub.com/sirupsen/logrus/hooks/test\t0.004s [no tests to run]\nok \tgithub.com/sirupsen/logrus/hooks/writer\t0.008s [no tests to run]\n? \tgithub.com/sirupsen/logrus/internal/testutils\t[no test files]\nFAIL\n" + }, + { + "symbol": "main::mutexWrap::Unlock", + "ok": false, + "compiled": false, + "tests_ok": null, + "tests_failed": [], + "old_name_left": "hooks/test/test.go:49:\tdefer t.mu.Unlock()\nhooks/test/test.go:85:\tdefer t.mu.Unlock()\nlogger.go:76:\t\tmw.lock.Unlock()\nwriter_test.go:52:\tdefer b.mu.Unlock()", + "detail": "./logrus_test.go:694:9: cond.L.UnlockGnx undefined (type \"sync\".Locker has no field or method UnlockGnx)\nFAIL\tgithub.com/sirupsen/logrus [build failed]\nok \tgithub.com/sirupsen/logrus/hooks/slog\t0.003s [no tests to run]\nok \tgithub.com/sirupsen/logrus/hooks/syslog\t0.003s [no tests to run]\nok \tgithub.com/sirupsen/logrus/hooks/test\t0.005s [no tests to run]\nok \tgithub.com/sirupsen/logrus/hooks/writer\t0.005s [no tests to run]\n? \tgithub.com/sirupsen/logrus/internal/testutils\t[no test files]\nFAIL\n" + }, + { + "symbol": "main::Entry::Bytes", + "ok": false, + "compiled": false, + "tests_ok": null, + "tests_failed": [], + "old_name_left": "entry.go:130:// Bytes returns the bytes representation of this entry from the formatter.\nentry_test.go:122:\t\t\t\trequire.NoError(t, json.Unmarshal(buf.Bytes(), &data))\nentry_test.go:439:\trequire.NoError(t, json.Unmarshal(buf.Bytes(), &data))\ninternal/testutils/testutils.go:24:\terr := json.Unmarshal(bu", + "detail": "tes.Buffer has no field or method BytesGnx)\n./text_formatter.go:171:11: b.BytesGnx undefined (type *bytes.Buffer has no field or method BytesGnx)\nFAIL\tgithub.com/sirupsen/logrus [build failed]\nFAIL\tgithub.com/sirupsen/logrus/hooks/slog [build failed]\nFAIL\tgithub.com/sirupsen/logrus/hooks/syslog [build failed]\nFAIL\tgithub.com/sirupsen/logrus/hooks/test [build failed]\nFAIL\tgithub.com/sirupsen/logrus/hooks/writer [build failed]\nFAIL\tgithub.com/sirupsen/logrus/internal/testutils [build failed]\nFAIL\n" + }, + { + "symbol": "main::mutexWrap::Disable", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "text_formatter.go:50:\t// Disable timestamp logging. useful when output is redirected to logging", + "detail": "" + }, + { + "symbol": "main::NewEntry", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + } + ], + "mutants": { + "7": [ + "main::Logger::LogFn", + "main::mutexWrap::Lock", + "main::mutexWrap::Unlock", + "main::Entry::Bytes", + "main::mutexWrap::Disable", + "main::NewEntry" + ], + "8": [ + "main::mutexWrap::Disable", + "main::mutexWrap::Unlock", + "main::Logger::LogFn", + "main::mutexWrap::Lock", + "main::Entry::Bytes", + "main::NewEntry" + ], + "9": [ + "main::NewEntry", + "main::mutexWrap::Unlock", + "main::Entry::Bytes", + "main::mutexWrap::Disable", + "main::Logger::LogFn", + "main::mutexWrap::Lock" + ] + }, + "tests": [ + { + "symbol": "main::Logger::LogFn", + "level": "name", + "truth": 2, + "predicted": 4, + "recall": 1.0, + "precision": 0.5, + "top_hits": 2, + "top_n": 4, + "top_precision": 0.5, + "top_best": 0.5, + "caught": 1.0, + "missed": [], + "recall_graph_only": 0.5 + }, + { + "symbol": "main::mutexWrap::Lock", + "level": "name", + "truth": 113, + "predicted": 81, + "recall": 0.6017699115044248, + "precision": 0.8395061728395061, + "top_hits": 10, + "top_n": 10, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [ + "ExampleDefaultFieldHook", + "ExampleGlobalHook", + "ExampleJSONFormatter_CallerPrettyfier", + "ExampleNewHandler", + "ExampleNewHandler_options", + "ExampleNewHook", + "ExampleNewHook_migration", + "Example_basic" + ], + "recall_graph_only": 0.6017699115044248 + }, + { + "symbol": "main::mutexWrap::Unlock", + "level": "name", + "truth": 113, + "predicted": 81, + "recall": 0.6017699115044248, + "precision": 0.8395061728395061, + "top_hits": 10, + "top_n": 10, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [ + "ExampleDefaultFieldHook", + "ExampleGlobalHook", + "ExampleJSONFormatter_CallerPrettyfier", + "ExampleNewHandler", + "ExampleNewHandler_options", + "ExampleNewHook", + "ExampleNewHook_migration", + "Example_basic" + ], + "recall_graph_only": 0.6017699115044248 + }, + { + "symbol": "main::Entry::Bytes", + "level": "name", + "truth": 4, + "predicted": 18, + "recall": 0.25, + "precision": 0.05555555555555555, + "top_hits": 1, + "top_n": 10, + "top_precision": 0.1, + "top_best": 0.1, + "caught": 1.0, + "missed": [ + "Example_hook", + "TestDifferentLevelsGoToDifferentWriters", + "TestLocalhostAddAndPrint" + ], + "recall_graph_only": 0.25 + }, + { + "symbol": "main::mutexWrap::Disable", + "skipped": "no test fails when it throws", + "predicted": 4 + }, + { + "symbol": "main::NewEntry", + "level": "name", + "truth": 105, + "predicted": 52, + "recall": 0.49523809523809526, + "precision": 1.0, + "top_hits": 10, + "top_n": 10, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [ + "ExampleDefaultFieldHook", + "ExampleGlobalHook", + "ExampleJSONFormatter_CallerPrettyfier", + "ExampleNewHandler", + "ExampleNewHook", + "ExampleNewHook_migration", + "Example_basic", + "Example_hook" + ], + "recall_graph_only": 0.49523809523809526 + } + ], + "look": [ + { + "symbol": "main::Logger::LogFn", + "look_tokens": 306, + "file_tokens": 3152 + }, + { + "symbol": "main::mutexWrap::Lock", + "look_tokens": 301, + "file_tokens": 3152 + }, + { + "symbol": "main::mutexWrap::Unlock", + "look_tokens": 305, + "file_tokens": 3152 + }, + { + "symbol": "main::Entry::Bytes", + "look_tokens": 387, + "file_tokens": 3899 + }, + { + "symbol": "main::mutexWrap::Disable", + "look_tokens": 147, + "file_tokens": 3152 + }, + { + "symbol": "main::NewEntry", + "look_tokens": 320, + "file_tokens": 3899 + } + ], + "seconds": 322, + "summary": { + "callers_recall": 1.0, + "callers_precision": 0.917, + "callers_checked": 6, + "blind_recall": 1.0, + "blind_checked": 6, + "common_recall": 0.488, + "common_precision": 1.0, + "common_recall_with_maybe": 0.963, + "common_checked": 41, + "rename_ok": 0.333, + "rename_checked": 6, + "tests_recall": 0.59, + "tests_precision": 0.647, + "tests_top10_precision": 0.72, + "tests_top10_best": 0.72, + "tests_caught": 1.0, + "tests_checked": 5, + "look_vs_file": 0.086 + }, + "summary_seeds": { + "7": { + "callers_recall": 1.0, + "callers_precision": 0.917, + "callers_checked": 6, + "blind_recall": 1.0, + "blind_checked": 6, + "common_recall": 0.5, + "common_precision": 1.0, + "common_recall_with_maybe": 1.0, + "common_checked": 16, + "rename_ok": 0.333, + "rename_checked": 6, + "tests_recall": 0.59, + "tests_precision": 0.647, + "tests_top10_precision": 0.72, + "tests_top10_best": 0.72, + "tests_caught": 1.0, + "tests_checked": 5, + "look_vs_file": 0.086 + }, + "8": { + "callers_recall": 1.0, + "callers_precision": 0.917, + "callers_checked": 6, + "blind_recall": 1.0, + "blind_checked": 6, + "common_recall": 0.441, + "common_precision": 1.0, + "common_recall_with_maybe": 0.941, + "common_checked": 17, + "rename_ok": 0.333, + "rename_checked": 6, + "tests_recall": 0.59, + "tests_precision": 0.647, + "tests_top10_precision": 0.72, + "tests_top10_best": 0.72, + "tests_caught": 1.0, + "tests_checked": 5, + "look_vs_file": 0.086 + }, + "9": { + "callers_recall": 1.0, + "callers_precision": 0.917, + "callers_checked": 6, + "blind_recall": 1.0, + "blind_checked": 6, + "common_recall": 0.583, + "common_precision": 1.0, + "common_recall_with_maybe": 0.972, + "common_checked": 18, + "rename_ok": 0.333, + "rename_checked": 6, + "tests_recall": 0.59, + "tests_precision": 0.647, + "tests_top10_precision": 0.72, + "tests_top10_best": 0.72, + "tests_caught": 1.0, + "tests_checked": 5, + "look_vs_file": 0.086 + } + }, + "noise": { + "callers_recall": { + "mean": 1.0, + "functions": 6, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.17 + }, + "callers_precision": { + "mean": 0.917, + "functions": 6, + "boot_lo": 0.75, + "boot_hi": 1.0, + "boot_half": 0.125, + "seeds": [ + 0.917, + 0.917, + 0.917 + ], + "seed_sd": 0.0, + "threshold": 0.17 + }, + "blind_recall": { + "mean": 1.0, + "functions": 6, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.17 + }, + "common_recall": { + "mean": 0.488, + "functions": 41, + "boot_lo": 0.366, + "boot_hi": 0.61, + "boot_half": 0.122, + "seeds": [ + 0.5, + 0.441, + 0.583 + ], + "seed_sd": 0.071, + "threshold": 0.13 + }, + "common_recall_with_maybe": { + "mean": 0.963, + "functions": 41, + "boot_lo": 0.915, + "boot_hi": 1.0, + "boot_half": 0.043, + "seeds": [ + 1.0, + 0.941, + 0.972 + ], + "seed_sd": 0.029, + "threshold": 0.05 + }, + "common_precision": { + "mean": 1.0, + "functions": 22, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.05 + }, + "rename_ok": { + "mean": 0.333, + "functions": 6, + "boot_lo": 0.0, + "boot_hi": 0.667, + "boot_half": 0.333, + "seeds": [ + 0.333, + 0.333, + 0.333 + ], + "seed_sd": 0.0, + "threshold": 0.34 + }, + "tests_recall": { + "mean": 0.59, + "functions": 5, + "boot_lo": 0.418, + "boot_hi": 0.77, + "boot_half": 0.176, + "seeds": [ + 0.59, + 0.59, + 0.59 + ], + "seed_sd": 0.0, + "threshold": 0.2 + }, + "tests_precision": { + "mean": 0.647, + "functions": 5, + "boot_lo": 0.39, + "boot_hi": 0.872, + "boot_half": 0.241, + "seeds": [ + 0.647, + 0.647, + 0.647 + ], + "seed_sd": 0.0, + "threshold": 0.25 + }, + "tests_top10_precision": { + "mean": 0.72, + "functions": 5, + "boot_lo": 0.44, + "boot_hi": 1.0, + "boot_half": 0.28, + "seeds": [ + 0.72, + 0.72, + 0.72 + ], + "seed_sd": 0.0, + "threshold": 0.28 + }, + "tests_top10_best": { + "mean": 0.72, + "functions": 5, + "boot_lo": 0.44, + "boot_hi": 1.0, + "boot_half": 0.28, + "seeds": [ + 0.72, + 0.72, + 0.72 + ], + "seed_sd": 0.0, + "threshold": 0.28 + }, + "tests_caught": { + "mean": 1.0, + "functions": 5, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.2 + }, + "look_vs_file": { + "mean": 0.086, + "functions": 6, + "boot_lo": 0.072, + "boot_hi": 0.097, + "boot_half": 0.013, + "seeds": [ + 0.086, + 0.086, + 0.086 + ], + "seed_sd": 0.0, + "threshold": 0.02 + } + } + }, + { + "repo": "marshmallow", + "lang": "python", + "commit": "777ff66039fd", + "index_seconds": 0.2, + "symbols": 352, + "files": 19, + "seeds": [ + 7, + 8, + 9 + ], + "edges": 6346, + "sample": [ + "marshmallow::utils::is_generator", + "marshmallow::utils::timedelta_to_microseconds", + "marshmallow::decorators::set_hook", + "marshmallow::orderedset::OrderedSet::discard", + "marshmallow::utils::callable_or_raise", + "marshmallow::utils::ensure_text_type", + "marshmallow::schema::SchemaMeta::resolve_hooks", + "performance::benchmark::run_timeit", + "marshmallow::error_store::merge_errors", + "marshmallow::utils::from_timestamp", + "marshmallow::fields::Field::make_error", + "marshmallow::schema::Schema::from_dict", + "marshmallow::utils::is_aware", + "marshmallow::error_store::copy_containers", + "marshmallow::schema::Schema::dump", + "marshmallow::error_store::ErrorStore::store_error", + "marshmallow::utils::timestamp", + "marshmallow::schema::Schema::load", + "marshmallow::utils::is_sequence_but_not_string", + "marshmallow::utils::is_iterable_but_not_string", + "marshmallow::class_registry::register", + "marshmallow::exceptions::ValidationError::normalized_messages", + "marshmallow::utils::is_collection", + "examples::inflection_example::camelcase", + "marshmallow::utils::pluck", + "marshmallow::utils::set_value" + ], + "sample_common": [], + "samples": { + "7": [ + "marshmallow::utils::is_generator", + "marshmallow::utils::timedelta_to_microseconds", + "marshmallow::decorators::set_hook", + "marshmallow::orderedset::OrderedSet::discard", + "marshmallow::utils::callable_or_raise", + "marshmallow::utils::ensure_text_type", + "marshmallow::schema::SchemaMeta::resolve_hooks", + "performance::benchmark::run_timeit", + "marshmallow::error_store::merge_errors", + "marshmallow::utils::from_timestamp", + "marshmallow::fields::Field::make_error", + "marshmallow::schema::Schema::from_dict", + "marshmallow::utils::is_aware", + "marshmallow::error_store::copy_containers", + "marshmallow::schema::Schema::dump", + "marshmallow::error_store::ErrorStore::store_error", + "marshmallow::utils::timestamp", + "marshmallow::schema::Schema::load", + "marshmallow::utils::is_sequence_but_not_string", + "marshmallow::utils::is_iterable_but_not_string" + ], + "8": [ + "marshmallow::class_registry::register", + "marshmallow::utils::is_generator", + "marshmallow::utils::timedelta_to_microseconds", + "marshmallow::utils::timestamp", + "marshmallow::exceptions::ValidationError::normalized_messages", + "marshmallow::error_store::merge_errors", + "marshmallow::utils::is_sequence_but_not_string", + "marshmallow::schema::SchemaMeta::resolve_hooks", + "marshmallow::error_store::ErrorStore::store_error", + "marshmallow::utils::is_aware", + "marshmallow::utils::callable_or_raise", + "marshmallow::fields::Field::make_error", + "marshmallow::utils::is_collection", + "marshmallow::decorators::set_hook", + "marshmallow::schema::Schema::from_dict", + "marshmallow::utils::ensure_text_type", + "examples::inflection_example::camelcase", + "marshmallow::error_store::copy_containers", + "marshmallow::schema::Schema::load", + "marshmallow::utils::pluck" + ], + "9": [ + "marshmallow::class_registry::register", + "marshmallow::utils::is_generator", + "marshmallow::utils::timestamp", + "marshmallow::schema::Schema::from_dict", + "marshmallow::utils::set_value", + "marshmallow::utils::timedelta_to_microseconds", + "marshmallow::utils::pluck", + "marshmallow::schema::SchemaMeta::resolve_hooks", + "marshmallow::utils::is_aware", + "examples::inflection_example::camelcase", + "marshmallow::error_store::merge_errors", + "marshmallow::exceptions::ValidationError::normalized_messages", + "marshmallow::utils::is_sequence_but_not_string", + "marshmallow::utils::from_timestamp", + "marshmallow::error_store::copy_containers", + "marshmallow::decorators::set_hook", + "marshmallow::schema::Schema::load", + "marshmallow::utils::callable_or_raise", + "marshmallow::fields::Field::make_error", + "marshmallow::utils::is_collection" + ] + }, + "samples_common": { + "7": [], + "8": [], + "9": [] + }, + "samples_blind": { + "7": [], + "8": [], + "9": [] + }, + "baseline_failing_tests": [], + "callers": [], + "callers_common": [], + "callers_blind": [], + "rename": [ + { + "symbol": "marshmallow::utils::is_generator", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "marshmallow::utils::timedelta_to_microseconds", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "marshmallow::decorators::set_hook", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "marshmallow::orderedset::OrderedSet::discard", + "ok": false, + "compiled": true, + "tests_ok": false, + "tests_failed": [], + "old_name_left": "", + "detail": "the test suite did not run" + }, + { + "symbol": "marshmallow::utils::callable_or_raise", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "marshmallow::utils::ensure_text_type", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "marshmallow::schema::SchemaMeta::resolve_hooks", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "performance::benchmark::run_timeit", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "marshmallow::error_store::merge_errors", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "marshmallow::utils::from_timestamp", + "ok": false, + "compiled": true, + "tests_ok": false, + "tests_failed": [], + "old_name_left": "src/marshmallow/fields.py:1330: \"timestamp\": utils.from_timestamp,", + "detail": "the test suite did not run" + }, + { + "symbol": "marshmallow::fields::Field::make_error", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "marshmallow::schema::Schema::from_dict", + "ok": false, + "compiled": true, + "tests_ok": false, + "tests_failed": [ + "tests/test_schema.py::test_meta_options_are_applied" + ], + "old_name_left": "tests/test_schema.py:2526: OSchema = OrderedSchema.from_dict({\"foo\": fields.Int(), \"bar\": fields.Int()})", + "detail": "" + }, + { + "symbol": "marshmallow::utils::is_aware", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "marshmallow::error_store::copy_containers", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "marshmallow::schema::Schema::dump", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "CHANGELOG.rst:1998:- Errors raised by pre/post-load/dump methods will be added to a schema's errors dictionary (:issue:`472`). Thanks :user:`dbertouille` for the suggestion and for the PR.\ndocs/extending/pre_and_post_processing.rst:36:Your method will then receive the input data (which may be a sing", + "detail": "" + }, + { + "symbol": "marshmallow::error_store::ErrorStore::store_error", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "marshmallow::utils::timestamp", + "ok": false, + "compiled": true, + "tests_ok": false, + "tests_failed": [], + "old_name_left": "CHANGELOG.rst:464:- Allow timestamp 0 in ``fields.DateTime`` (:issue:`2133`).\nBinary file docs/_static/marshmallow-logo-200.png matches\nBinary file docs/_static/marshmallow-logo-with-title-for-dark-theme.png matches\nsrc/marshmallow/fields.py:1306: ``\"timestamp_gnx\"``, ``\"timestamp_ms\"`` (for ", + "detail": "the test suite did not run" + }, + { + "symbol": "marshmallow::schema::Schema::load", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "CHANGELOG.rst:906:- Don't load fields for which ``load_only`` and ``dump_only`` are both ``True`` (:pr:`1448`).\nCHANGELOG.rst:1998:- Errors raised by pre/post-load/dump methods will be added to a schema's errors dictionary (:issue:`472`). Thanks :user:`dbertouille` for the suggestion and for the PR.", + "detail": "" + }, + { + "symbol": "marshmallow::utils::is_sequence_but_not_string", + "ok": false, + "compiled": true, + "tests_ok": false, + "tests_failed": [], + "old_name_left": "src/marshmallow/schema.py:38: is_sequence_but_not_string,", + "detail": "the test suite did not run" + }, + { + "symbol": "marshmallow::utils::is_iterable_but_not_string", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "marshmallow::class_registry::register", + "ok": false, + "compiled": true, + "tests_ok": false, + "tests_failed": [ + "tests/test_registry.py::test_register_class_meta_option" + ], + "old_name_left": "docs/extending/pre_and_post_processing.rst:214: You may register multiple processor methods on a Schema. Keep in mind, however, that **the invocation order of decorated methods of the same type is not guaranteed**. If you need to guarantee order of processing steps, you should put them in the sam", + "detail": "" + }, + { + "symbol": "marshmallow::exceptions::ValidationError::normalized_messages", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "marshmallow::utils::is_collection", + "ok": false, + "compiled": true, + "tests_ok": false, + "tests_failed": [], + "old_name_left": "src/marshmallow/schema.py:37: is_collection,", + "detail": "the test suite did not run" + }, + { + "symbol": "examples::inflection_example::camelcase", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "marshmallow::utils::pluck", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "src/marshmallow/fields.py:680: :param str field_name: The key to pluck a value from.", + "detail": "" + }, + { + "symbol": "marshmallow::utils::set_value", + "ok": false, + "compiled": true, + "tests_ok": false, + "tests_failed": [], + "old_name_left": "src/marshmallow/schema.py:39: set_value,", + "detail": "the test suite did not run" + } + ], + "mutants": { + "7": [ + "marshmallow::utils::is_generator", + "marshmallow::utils::timedelta_to_microseconds", + "marshmallow::decorators::set_hook", + "marshmallow::orderedset::OrderedSet::discard", + "marshmallow::utils::callable_or_raise", + "marshmallow::utils::ensure_text_type", + "marshmallow::schema::SchemaMeta::resolve_hooks", + "performance::benchmark::run_timeit", + "marshmallow::error_store::merge_errors", + "marshmallow::utils::from_timestamp", + "marshmallow::fields::Field::make_error", + "marshmallow::schema::Schema::from_dict", + "marshmallow::utils::is_aware" + ], + "8": [ + "marshmallow::class_registry::register", + "marshmallow::utils::is_generator", + "marshmallow::utils::timedelta_to_microseconds", + "marshmallow::utils::timestamp", + "marshmallow::exceptions::ValidationError::normalized_messages", + "marshmallow::error_store::merge_errors", + "marshmallow::utils::is_sequence_but_not_string", + "marshmallow::schema::SchemaMeta::resolve_hooks", + "marshmallow::error_store::ErrorStore::store_error", + "marshmallow::utils::is_aware", + "marshmallow::utils::callable_or_raise", + "marshmallow::fields::Field::make_error" + ], + "9": [ + "marshmallow::class_registry::register", + "marshmallow::utils::is_generator", + "marshmallow::utils::timestamp", + "marshmallow::schema::Schema::from_dict", + "marshmallow::utils::set_value", + "marshmallow::utils::timedelta_to_microseconds", + "marshmallow::utils::pluck", + "marshmallow::schema::SchemaMeta::resolve_hooks", + "marshmallow::utils::is_aware", + "examples::inflection_example::camelcase", + "marshmallow::error_store::merge_errors" + ] + }, + "tests": [ + { + "symbol": "marshmallow::utils::is_generator", + "level": "id", + "truth": 173, + "predicted": 13, + "recall": 0.005780346820809248, + "precision": 0.07692307692307693, + "top_hits": 0, + "top_n": 10, + "top_precision": 0.0, + "top_best": 0.1, + "caught": 0.0, + "missed": [ + "tests/test_context.py::test_context_load_dump", + "tests/test_context.py::test_decorated_processors_with_context", + "tests/test_context.py::test_nested_dict_fields_inherit_context", + "tests/test_context.py::test_nested_list_fields_inherit_context", + "tests/test_context.py::test_validates_schema_with_context", + "tests/test_decorators.py::test_allow_arbitrary_field_names_in_error", + "tests/test_decorators.py::test_allow_reporting_field_errors_in_schema_validator", + "tests/test_decorators.py::test_data_key_is_used_in_errors_dict" + ], + "recall_graph_only": 0.0 + }, + { + "symbol": "marshmallow::utils::timedelta_to_microseconds", + "level": "id", + "truth": 36, + "predicted": 13, + "recall": 0.0, + "precision": 0.0, + "top_hits": 0, + "top_n": 10, + "top_precision": 0.0, + "top_best": 0.0, + "caught": 0.0, + "missed": [ + "tests/test_options.py::test_declared_field_order_is_maintained_on_load", + "tests/test_schema.py::test_as_string", + "tests/test_schema.py::test_can_serialize_time", + "tests/test_schema.py::test_can_serialize_uuid", + "tests/test_schema.py::test_class_variable", + "tests/test_schema.py::test_custom_field", + "tests/test_schema.py::test_datetime_formatted_field", + "tests/test_schema.py::test_datetime_iso_field" + ], + "recall_graph_only": 0.0 + }, + { + "symbol": "marshmallow::decorators::set_hook", + "skipped": "the test suite did not run" + }, + { + "symbol": "marshmallow::orderedset::OrderedSet::discard", + "level": "id", + "truth": 4, + "predicted": 0, + "recall": 0.0, + "precision": 0.0, + "top_hits": 0, + "top_n": 0, + "top_precision": 0.0, + "top_best": 0.0, + "caught": 0.0, + "missed": [ + "tests/test_fields.py::test_dict_nested_only_and_exclude_merged_with_nested", + "tests/test_fields.py::test_list_nested_class_only_and_exclude_merged_with_nested", + "tests/test_schema.py::test_nested_only_empty_inheritance", + "tests/test_schema.py::test_nested_only_inheritance" + ], + "recall_graph_only": 0.0 + }, + { + "symbol": "marshmallow::utils::callable_or_raise", + "skipped": "the test suite did not run" + }, + { + "symbol": "marshmallow::utils::ensure_text_type", + "skipped": "the test suite did not run" + }, + { + "symbol": "marshmallow::schema::SchemaMeta::resolve_hooks", + "skipped": "the test suite did not run" + }, + { + "symbol": "performance::benchmark::run_timeit", + "skipped": "no test fails when it throws", + "predicted": 0 + }, + { + "symbol": "marshmallow::error_store::merge_errors", + "level": "id", + "truth": 106, + "predicted": 30, + "recall": 0.08490566037735849, + "precision": 0.3, + "top_hits": 4, + "top_n": 10, + "top_precision": 0.4, + "top_best": 0.9, + "caught": 1.0, + "missed": [ + "tests/test_context.py::test_validates_schema_with_context", + "tests/test_decorators.py::test_allow_arbitrary_field_names_in_error", + "tests/test_decorators.py::test_allow_reporting_field_errors_in_schema_validator", + "tests/test_decorators.py::test_data_key_is_used_in_errors_dict", + "tests/test_decorators.py::test_decorated_processor_returning_none", + "tests/test_decorators.py::test_decorated_validators", + "tests/test_decorators.py::test_multiple_validators", + "tests/test_decorators.py::test_multiple_validators_merge_dict_errors" + ], + "recall_graph_only": 0.08490566037735849 + }, + { + "symbol": "marshmallow::utils::from_timestamp", + "level": "id", + "truth": 8, + "predicted": 5, + "recall": 0.5, + "precision": 0.8, + "top_hits": 4, + "top_n": 5, + "top_precision": 0.8, + "top_best": 0.8, + "caught": 1.0, + "missed": [ + "tests/test_deserialization.py::test_boolean_timestamp_field_deserialization", + "tests/test_deserialization.py::test_invalid_timestamp_field_deserialization", + "tests/test_deserialization.py::test_oversized_timestamp_field_deserialization", + "tests/test_deserialization.py::test_timestamp_field_deserialization" + ], + "recall_graph_only": 0.5 + }, + { + "symbol": "marshmallow::fields::Field::make_error", + "level": "id", + "truth": 86, + "predicted": 106, + "recall": 0.5930232558139535, + "precision": 0.4811320754716981, + "top_hits": 5, + "top_n": 10, + "top_precision": 0.5, + "top_best": 1.0, + "caught": 1.0, + "missed": [ + "tests/test_decorators.py::test_skip_on_field_errors", + "tests/test_deserialization.py::test_deeply_nested_partial_load", + "tests/test_deserialization.py::test_deserialize_with_attribute_param_error_returns_data_key_not_attribute_name", + "tests/test_deserialization.py::test_nested_data_is_stored_when_validation_fails", + "tests/test_deserialization.py::test_nested_many_non_not_allowed", + "tests/test_deserialization.py::test_nested_many_required_missing", + "tests/test_deserialization.py::test_nested_partial_default", + "tests/test_deserialization.py::test_nested_partial_load" + ], + "recall_graph_only": 0.5930232558139535 + }, + { + "symbol": "marshmallow::schema::Schema::from_dict", + "level": "id", + "truth": 5, + "predicted": 5, + "recall": 0.8, + "precision": 0.8, + "top_hits": 4, + "top_n": 5, + "top_precision": 0.8, + "top_best": 0.8, + "caught": 1.0, + "missed": [ + "tests/test_schema.py::test_meta_options_are_applied" + ], + "recall_graph_only": 0.6 + }, + { + "symbol": "marshmallow::utils::is_aware", + "level": "id", + "truth": 7, + "predicted": 13, + "recall": 0.0, + "precision": 0.0, + "top_hits": 0, + "top_n": 10, + "top_precision": 0.0, + "top_best": 0.0, + "caught": 0.0, + "missed": [ + "tests/test_deserialization.py::test_aware_datetime_default_timezone", + "tests/test_deserialization.py::test_custom_date_format_datetime_field_deserialization", + "tests/test_deserialization.py::test_iso_datetime_field_deserialization", + "tests/test_deserialization.py::test_naive_datetime_with_timezone", + "tests/test_deserialization.py::test_rfc_datetime_field_deserialization", + "tests/test_deserialization.py::test_timestamp_field_deserialization", + "tests/test_serialization.py::test_datetime_field_timestamp" + ], + "recall_graph_only": 0.0 + }, + { + "symbol": "marshmallow::class_registry::register", + "skipped": "the test suite did not run" + }, + { + "symbol": "marshmallow::utils::timestamp", + "level": "id", + "truth": 1, + "predicted": 10, + "recall": 1.0, + "precision": 0.1, + "top_hits": 1, + "top_n": 10, + "top_precision": 0.1, + "top_best": 0.1, + "caught": 1.0, + "missed": [], + "recall_graph_only": 0.0 + }, + { + "symbol": "marshmallow::exceptions::ValidationError::normalized_messages", + "level": "id", + "truth": 3, + "predicted": 177, + "recall": 1.0, + "precision": 0.01694915254237288, + "top_hits": 0, + "top_n": 10, + "top_precision": 0.0, + "top_best": 0.3, + "caught": 0.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "marshmallow::utils::is_sequence_but_not_string", + "skipped": "the test suite did not run" + }, + { + "symbol": "marshmallow::error_store::ErrorStore::store_error", + "level": "id", + "truth": 99, + "predicted": 179, + "recall": 1.0, + "precision": 0.553072625698324, + "top_hits": 6, + "top_n": 10, + "top_precision": 0.6, + "top_best": 1.0, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "marshmallow::utils::set_value", + "level": "id", + "truth": 136, + "predicted": 178, + "recall": 0.9779411764705882, + "precision": 0.7471910112359551, + "top_hits": 9, + "top_n": 10, + "top_precision": 0.9, + "top_best": 1.0, + "caught": 1.0, + "missed": [ + "tests/test_schema.py::test_loads_deserializes_from_json", + "tests/test_schema.py::test_loads_many", + "tests/test_schema.py::test_loads_returns_a_user" + ], + "recall_graph_only": 0.9779411764705882 + }, + { + "symbol": "marshmallow::utils::pluck", + "level": "id", + "truth": 5, + "predicted": 5, + "recall": 1.0, + "precision": 1.0, + "top_hits": 5, + "top_n": 5, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [], + "recall_graph_only": 0.0 + }, + { + "symbol": "examples::inflection_example::camelcase", + "skipped": "no test fails when it throws", + "predicted": 0 + } + ], + "look": [ + { + "symbol": "marshmallow::utils::is_generator", + "look_tokens": 333, + "file_tokens": 1300 + }, + { + "symbol": "marshmallow::utils::timedelta_to_microseconds", + "look_tokens": 361, + "file_tokens": 1300 + }, + { + "symbol": "marshmallow::decorators::set_hook", + "look_tokens": 699, + "file_tokens": 2541 + }, + { + "symbol": "marshmallow::orderedset::OrderedSet::discard", + "look_tokens": 110, + "file_tokens": 739 + }, + { + "symbol": "marshmallow::utils::callable_or_raise", + "look_tokens": 342, + "file_tokens": 1300 + }, + { + "symbol": "marshmallow::utils::ensure_text_type", + "look_tokens": 346, + "file_tokens": 1300 + }, + { + "symbol": "marshmallow::schema::SchemaMeta::resolve_hooks", + "look_tokens": 731, + "file_tokens": 12527 + }, + { + "symbol": "performance::benchmark::run_timeit", + "look_tokens": 232, + "file_tokens": 961 + }, + { + "symbol": "marshmallow::error_store::merge_errors", + "look_tokens": 667, + "file_tokens": 611 + }, + { + "symbol": "marshmallow::utils::from_timestamp", + "look_tokens": 376, + "file_tokens": 1300 + }, + { + "symbol": "marshmallow::fields::Field::make_error", + "look_tokens": 708, + "file_tokens": 18811 + }, + { + "symbol": "marshmallow::schema::Schema::from_dict", + "look_tokens": 444, + "file_tokens": 12527 + }, + { + "symbol": "marshmallow::utils::is_aware", + "look_tokens": 328, + "file_tokens": 1300 + }, + { + "symbol": "marshmallow::error_store::copy_containers", + "look_tokens": 396, + "file_tokens": 611 + }, + { + "symbol": "marshmallow::schema::Schema::dump", + "look_tokens": 765, + "file_tokens": 12527 + }, + { + "symbol": "marshmallow::error_store::ErrorStore::store_error", + "look_tokens": 584, + "file_tokens": 611 + }, + { + "symbol": "marshmallow::utils::timestamp", + "look_tokens": 410, + "file_tokens": 1300 + }, + { + "symbol": "marshmallow::schema::Schema::load", + "look_tokens": 743, + "file_tokens": 12527 + }, + { + "symbol": "marshmallow::utils::is_sequence_but_not_string", + "look_tokens": 580, + "file_tokens": 1300 + }, + { + "symbol": "marshmallow::utils::is_iterable_but_not_string", + "look_tokens": 361, + "file_tokens": 1300 + }, + { + "symbol": "marshmallow::class_registry::register", + "look_tokens": 473, + "file_tokens": 758 + }, + { + "symbol": "marshmallow::exceptions::ValidationError::normalized_messages", + "look_tokens": 423, + "file_tokens": 569 + }, + { + "symbol": "marshmallow::utils::is_collection", + "look_tokens": 505, + "file_tokens": 1300 + }, + { + "symbol": "examples::inflection_example::camelcase", + "look_tokens": 105, + "file_tokens": 231 + }, + { + "symbol": "marshmallow::utils::pluck", + "look_tokens": 258, + "file_tokens": 1300 + }, + { + "symbol": "marshmallow::utils::set_value", + "look_tokens": 570, + "file_tokens": 1300 + } + ], + "seconds": 91, + "summary": { + "callers_recall": null, + "callers_precision": null, + "callers_checked": 0, + "blind_recall": null, + "blind_checked": 0, + "common_recall": null, + "common_precision": null, + "common_recall_with_maybe": null, + "common_checked": 0, + "rename_ok": 0.692, + "rename_checked": 26, + "tests_recall": 0.536, + "tests_precision": 0.375, + "tests_top10_precision": 0.392, + "tests_top10_best": 0.538, + "tests_caught": 0.615, + "tests_checked": 13, + "look_vs_file": 0.35 + }, + "summary_seeds": { + "7": { + "callers_recall": null, + "callers_precision": null, + "callers_checked": 0, + "blind_recall": null, + "blind_checked": 0, + "common_recall": null, + "common_precision": null, + "common_recall_with_maybe": null, + "common_checked": 0, + "rename_ok": 0.75, + "rename_checked": 20, + "tests_recall": 0.248, + "tests_precision": 0.307, + "tests_top10_precision": 0.312, + "tests_top10_best": 0.45, + "tests_caught": 0.5, + "tests_checked": 8, + "look_vs_file": 0.313 + }, + "8": { + "callers_recall": null, + "callers_precision": null, + "callers_checked": 0, + "blind_recall": null, + "blind_checked": 0, + "common_recall": null, + "common_precision": null, + "common_recall_with_maybe": null, + "common_checked": 0, + "rename_ok": 0.75, + "rename_checked": 20, + "tests_recall": 0.46, + "tests_precision": 0.191, + "tests_top10_precision": 0.2, + "tests_top10_best": 0.425, + "tests_caught": 0.5, + "tests_checked": 8, + "look_vs_file": 0.382 + }, + "9": { + "callers_recall": null, + "callers_precision": null, + "callers_checked": 0, + "blind_recall": null, + "blind_checked": 0, + "common_recall": null, + "common_precision": null, + "common_recall_with_maybe": null, + "common_checked": 0, + "rename_ok": 0.65, + "rename_checked": 20, + "tests_recall": 0.484, + "tests_precision": 0.378, + "tests_top10_precision": 0.4, + "tests_top10_best": 0.487, + "tests_caught": 0.625, + "tests_checked": 8, + "look_vs_file": 0.358 + } + }, + "noise": { + "callers_recall": null, + "callers_precision": null, + "blind_recall": null, + "common_recall": null, + "common_recall_with_maybe": null, + "common_precision": null, + "rename_ok": { + "mean": 0.692, + "functions": 26, + "boot_lo": 0.538, + "boot_hi": 0.846, + "boot_half": 0.154, + "seeds": [ + 0.75, + 0.75, + 0.65 + ], + "seed_sd": 0.058, + "threshold": 0.16 + }, + "tests_recall": { + "mean": 0.536, + "functions": 13, + "boot_lo": 0.323, + "boot_hi": 0.728, + "boot_half": 0.202, + "seeds": [ + 0.248, + 0.46, + 0.484 + ], + "seed_sd": 0.13, + "threshold": 0.21 + }, + "tests_precision": { + "mean": 0.375, + "functions": 13, + "boot_lo": 0.214, + "boot_hi": 0.535, + "boot_half": 0.16, + "seeds": [ + 0.307, + 0.191, + 0.378 + ], + "seed_sd": 0.094, + "threshold": 0.17 + }, + "tests_top10_precision": { + "mean": 0.392, + "functions": 13, + "boot_lo": 0.215, + "boot_hi": 0.562, + "boot_half": 0.173, + "seeds": [ + 0.312, + 0.2, + 0.4 + ], + "seed_sd": 0.1, + "threshold": 0.18 + }, + "tests_top10_best": { + "mean": 0.538, + "functions": 13, + "boot_lo": 0.331, + "boot_hi": 0.731, + "boot_half": 0.2, + "seeds": [ + 0.45, + 0.425, + 0.487 + ], + "seed_sd": 0.031, + "threshold": 0.2 + }, + "tests_caught": { + "mean": 0.615, + "functions": 13, + "boot_lo": 0.385, + "boot_hi": 0.846, + "boot_half": 0.231, + "seeds": [ + 0.5, + 0.5, + 0.625 + ], + "seed_sd": 0.072, + "threshold": 0.24 + }, + "look_vs_file": { + "mean": 0.35, + "functions": 26, + "boot_lo": 0.269, + "boot_hi": 0.437, + "boot_half": 0.084, + "seeds": [ + 0.313, + 0.382, + 0.358 + ], + "seed_sd": 0.035, + "threshold": 0.09 + } + } + }, + { + "repo": "boltons", + "lang": "python", + "commit": "d31d821d56c8", + "index_seconds": 0.2, + "symbols": 1171, + "files": 34, + "seeds": [ + 7, + 8, + 9 + ], + "edges": 7719, + "sample": [ + "boltons::iterutils::remap", + "boltons::mathutils::Bits::as_bin", + "boltons::iterutils::chunked_iter", + "boltons::timeutils::decimal_relative_time", + "boltons::strutils::format_int_list", + "boltons::iterutils::default_visit", + "boltons::mathutils::Bits::as_hex", + "boltons::cacheutils::ThresholdCounter::get_common_count", + "boltons::iterutils::is_iterable", + "boltons::funcutils::inspect_formatargspec", + "boltons::formatutils::BaseFormatField::set_fspec", + "docs::conf::get_mod_stats", + "boltons::iterutils::windowed_iter", + "boltons::urlutils::URL::normalize", + "boltons::tbutils::ExceptionInfo::from_exc_info", + "boltons::strutils::split_punct_ws", + "boltons::tableutils::Table::to_html", + "boltons::tableutils::Table::from_data", + "boltons::ioutils::SpooledIOBase::getvalue", + "boltons::cacheutils::ThresholdCounter::most_common", + "boltons::strutils::args2sh", + "boltons::iterutils::unique_iter", + "boltons::setutils::IndexedSet::iter_intersection", + "boltons::strutils::asciify", + "boltons::iterutils::windowed", + "boltons::urlutils::parse_qsl", + "boltons::formatutils::infer_positional_format_args", + "boltons::namedutils::namedtuple", + "boltons::typeutils::issubclass", + "boltons::tbutils::Callpoint::tb_frame_str", + "boltons::tbutils::print_exception", + "boltons::iterutils::split", + "boltons::timeutils::LocalTZInfo::is_dst", + "boltons::funcutils::FunctionBuilder::from_func", + "boltons::funcutils::format_invocation", + "boltons::statsutils::Stats::get_quantile", + "boltons::urlutils::quote_path_part", + "boltons::ecoutils::dumps", + "boltons::mathutils::ceil", + "boltons::strutils::parse_int_list", + "boltons::mathutils::floor", + "boltons::urlutils::parse_url", + "boltons::setutils::_ComplementSet::complemented", + "boltons::mathutils::Bits::from_hex", + "boltons::strutils::cardinalize", + "boltons::funcutils::FunctionBuilder::remove_arg", + "boltons::setutils::IndexedSet::intersection_update", + "boltons::iterutils::is_scalar" + ], + "sample_common": [], + "samples": { + "7": [ + "boltons::iterutils::remap", + "boltons::mathutils::Bits::as_bin", + "boltons::iterutils::chunked_iter", + "boltons::timeutils::decimal_relative_time", + "boltons::strutils::format_int_list", + "boltons::iterutils::default_visit", + "boltons::mathutils::Bits::as_hex", + "boltons::cacheutils::ThresholdCounter::get_common_count", + "boltons::iterutils::is_iterable", + "boltons::funcutils::inspect_formatargspec", + "boltons::formatutils::BaseFormatField::set_fspec", + "docs::conf::get_mod_stats", + "boltons::iterutils::windowed_iter", + "boltons::urlutils::URL::normalize", + "boltons::tbutils::ExceptionInfo::from_exc_info", + "boltons::strutils::split_punct_ws", + "boltons::tableutils::Table::to_html", + "boltons::tableutils::Table::from_data", + "boltons::ioutils::SpooledIOBase::getvalue", + "boltons::cacheutils::ThresholdCounter::most_common" + ], + "8": [ + "boltons::strutils::args2sh", + "boltons::iterutils::unique_iter", + "boltons::setutils::IndexedSet::iter_intersection", + "boltons::strutils::asciify", + "boltons::iterutils::windowed", + "boltons::urlutils::parse_qsl", + "boltons::formatutils::infer_positional_format_args", + "boltons::namedutils::namedtuple", + "boltons::typeutils::issubclass", + "boltons::tbutils::Callpoint::tb_frame_str", + "docs::conf::get_mod_stats", + "boltons::tbutils::print_exception", + "boltons::iterutils::split", + "boltons::timeutils::LocalTZInfo::is_dst", + "boltons::urlutils::URL::normalize", + "boltons::strutils::split_punct_ws", + "boltons::funcutils::FunctionBuilder::from_func", + "boltons::funcutils::format_invocation", + "boltons::statsutils::Stats::get_quantile", + "boltons::mathutils::Bits::as_bin" + ], + "9": [ + "boltons::urlutils::quote_path_part", + "boltons::ecoutils::dumps", + "boltons::mathutils::ceil", + "boltons::strutils::parse_int_list", + "boltons::timeutils::LocalTZInfo::is_dst", + "boltons::mathutils::floor", + "boltons::tableutils::Table::to_html", + "boltons::mathutils::Bits::as_hex", + "boltons::urlutils::parse_url", + "boltons::setutils::_ComplementSet::complemented", + "boltons::ioutils::SpooledIOBase::getvalue", + "boltons::mathutils::Bits::from_hex", + "boltons::timeutils::decimal_relative_time", + "docs::conf::get_mod_stats", + "boltons::strutils::cardinalize", + "boltons::statsutils::Stats::get_quantile", + "boltons::funcutils::FunctionBuilder::remove_arg", + "boltons::setutils::IndexedSet::intersection_update", + "boltons::mathutils::Bits::as_bin", + "boltons::iterutils::is_scalar" + ] + }, + "samples_common": { + "7": [], + "8": [], + "9": [] + }, + "samples_blind": { + "7": [], + "8": [], + "9": [] + }, + "baseline_failing_tests": [], + "callers": [], + "callers_common": [], + "callers_blind": [], + "rename": [ + { + "symbol": "boltons::iterutils::remap", + "ok": false, + "compiled": true, + "tests_ok": false, + "tests_failed": [ + "tests/test_iterutils.py::test_add_length", + "tests/test_iterutils.py::test_backoff_basic", + "tests/test_iterutils.py::test_backoff_constant_factor", + "tests/test_iterutils.py::test_backoff_jitter", + "tests/test_iterutils.py::test_backoff_repeat", + "tests/test_iterutils.py::test_backoff_validation", + "tests/test_iterutils.py::test_backoff_zero_start", + "tests/test_iterutils.py::test_backoff_zero_start_fractional_stop" + ], + "old_name_left": "boltons/iterutils.py:1161: \"\"\"The remap (\"recursive map\") function is used to traverse and\nboltons/iterutils.py:1170: remap goes where list comprehensions cannot.\nboltons/iterutils.py:1182: See `this remap cookbook`_ for more delicious recipes.\nboltons/iterutils.py:1184: .. _this remap c", + "detail": "" + }, + { + "symbol": "boltons::mathutils::Bits::as_bin", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "boltons::iterutils::chunked_iter", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "boltons::timeutils::decimal_relative_time", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "boltons::strutils::format_int_list", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "boltons::iterutils::default_visit", + "ok": false, + "compiled": true, + "tests_ok": false, + "tests_failed": [ + "tests/test_iterutils.py::test_add_length", + "tests/test_iterutils.py::test_backoff_basic", + "tests/test_iterutils.py::test_backoff_constant_factor", + "tests/test_iterutils.py::test_backoff_jitter", + "tests/test_iterutils.py::test_backoff_repeat", + "tests/test_iterutils.py::test_backoff_validation", + "tests/test_iterutils.py::test_backoff_zero_start", + "tests/test_iterutils.py::test_backoff_zero_start_fractional_stop" + ], + "old_name_left": "boltons/iterutils.py:1155: visit=default_visit,", + "detail": "" + }, + { + "symbol": "boltons::mathutils::Bits::as_hex", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "boltons::cacheutils::ThresholdCounter::get_common_count", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "boltons::iterutils::is_iterable", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "boltons/iterutils.py:62: \"\"\"Similar in nature to :func:`callable`, ``is_iterable`` returns", + "detail": "" + }, + { + "symbol": "boltons::funcutils::inspect_formatargspec", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "boltons::formatutils::BaseFormatField::set_fspec", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "docs::conf::get_mod_stats", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "boltons::iterutils::windowed_iter", + "ok": false, + "compiled": true, + "tests_ok": false, + "tests_failed": [ + "tests/test_iterutils.py::test_add_length", + "tests/test_iterutils.py::test_backoff_basic", + "tests/test_iterutils.py::test_backoff_constant_factor", + "tests/test_iterutils.py::test_backoff_jitter", + "tests/test_iterutils.py::test_backoff_repeat", + "tests/test_iterutils.py::test_backoff_validation", + "tests/test_iterutils.py::test_backoff_zero_start", + "tests/test_iterutils.py::test_backoff_zero_start_fractional_stop" + ], + "old_name_left": "tests/test_iterutils.py:11: windowed_iter,", + "detail": "" + }, + { + "symbol": "boltons::urlutils::URL::normalize", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "TODO.rst:79:* normalize unicode on input?\nboltons/setutils.py:598: '''normalize args and raise type-error if there is a problem'''\nboltons/setutils.py:609: '''normalize args and return NotImplemented (for overloaded operators)'''\nboltons/strutils.py:440: transd = unicodedata.normalize('", + "detail": "" + }, + { + "symbol": "boltons::tbutils::ExceptionInfo::from_exc_info", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "boltons::strutils::split_punct_ws", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "boltons::tableutils::Table::to_html", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "boltons::tableutils::Table::from_data", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "boltons::ioutils::SpooledIOBase::getvalue", + "ok": false, + "compiled": true, + "tests_ok": false, + "tests_failed": [ + "tests/test_ioutils.py::test_auto_rollover", + "tests/test_ioutils.py::test_buffer_write_rollover_uses_byte_count", + "tests/test_ioutils.py::test_flush_after_rollover", + "tests/test_ioutils.py::test_getvalue_rollover", + "tests/test_ioutils.py::test_len_rollover", + "tests/test_ioutils.py::test_no_mixed_bytes_and_text", + "tests/test_ioutils.py::test_read_seek_text", + "tests/test_ioutils.py::test_rollover_after_readline_keeps_position" + ], + "old_name_left": "tests/test_ioutils.py:29: \"\"\"Make sure getvalue function works with in-memory flo\"\"\"\ntests/test_ioutils.py:34: \"\"\"Make sure getvalue function works with on-disk flo\"\"\"", + "detail": "" + }, + { + "symbol": "boltons::cacheutils::ThresholdCounter::most_common", + "ok": false, + "compiled": true, + "tests_ok": false, + "tests_failed": [ + "tests/test_statsutils.py::test_mode", + "tests/test_statsutils.py::test_sorted_measures_keep_data_order" + ], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "boltons::strutils::args2sh", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "boltons::iterutils::unique_iter", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "boltons::setutils::IndexedSet::iter_intersection", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "boltons/setutils.py:319: \"iter_intersection(*others) -> iterate over elements also in others\"", + "detail": "" + }, + { + "symbol": "boltons::strutils::asciify", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "boltons/tbutils.py:617:# TODO: use asciify, improved if necessary", + "detail": "" + }, + { + "symbol": "boltons::iterutils::windowed", + "ok": false, + "compiled": true, + "tests_ok": false, + "tests_failed": [ + "tests/test_iterutils.py::test_add_length", + "tests/test_iterutils.py::test_backoff_basic", + "tests/test_iterutils.py::test_backoff_constant_factor", + "tests/test_iterutils.py::test_backoff_jitter", + "tests/test_iterutils.py::test_backoff_repeat", + "tests/test_iterutils.py::test_backoff_validation", + "tests/test_iterutils.py::test_backoff_zero_start", + "tests/test_iterutils.py::test_backoff_zero_start_fractional_stop" + ], + "old_name_left": "docs/iterutils.rst:25:.. autofunction:: windowed\ntests/test_iterutils.py:10: windowed,", + "detail": "" + }, + { + "symbol": "boltons::urlutils::parse_qsl", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "boltons::formatutils::infer_positional_format_args", + "ok": false, + "compiled": true, + "tests_ok": false, + "tests_failed": [ + "tests/test_formatutils.py::test_deferredvalue", + "tests/test_formatutils.py::test_get_fstr_args", + "tests/test_formatutils.py::test_pos_infer", + "tests/test_formatutils.py::test_split_fstr", + "tests/test_formatutils.py::test_tokenize_format_str" + ], + "old_name_left": "tests/test_formatutils.py:7: infer_positional_format_args,", + "detail": "" + }, + { + "symbol": "boltons::namedutils::namedtuple", + "ok": false, + "compiled": true, + "tests_ok": false, + "tests_failed": [ + "tests/test_excutils.py::test_cause_str_outside_handler" + ], + "old_name_left": "boltons/excutils.py:35:from collections import namedtuple\nboltons/iterutils.py:1118: new_parent = value # namedtuple, rebuilt in default_exit\nboltons/namedutils.py:70:### namedtuple\ntests/test_debugutils_trace.py:1:from collections import namedtuple\ntests/test_debugutils_trace.py:76: ", + "detail": "" + }, + { + "symbol": "boltons::typeutils::issubclass", + "ok": false, + "compiled": true, + "tests_ok": false, + "tests_failed": [ + "tests/test_cacheutils.py::test_cache_copy", + "tests/test_cacheutils.py::test_cache_eq_non_mapping", + "tests/test_cacheutils.py::test_cache_falsey_on_miss", + "tests/test_cacheutils.py::test_cache_ior", + "tests/test_cacheutils.py::test_cache_sizes_on_repeat_insertions", + "tests/test_cacheutils.py::test_cache_update_optional_source", + "tests/test_cacheutils.py::test_cached_dec", + "tests/test_cacheutils.py::test_cachedmethod" + ], + "old_name_left": "boltons/typeutils.py:109: \"\"\"Just like the built-in :func:`issubclass`, this function checks", + "detail": "" + }, + { + "symbol": "boltons::tbutils::Callpoint::tb_frame_str", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "boltons::tbutils::print_exception", + "ok": false, + "compiled": true, + "tests_ok": false, + "tests_failed": [ + "tests/test_tbutils.py::test_contextual", + "tests/test_tbutils.py::test_exception_info" + ], + "old_name_left": "tests/test_tbutils.py:7: print_exception,", + "detail": "" + }, + { + "symbol": "boltons::iterutils::split", + "ok": false, + "compiled": true, + "tests_ok": false, + "tests_failed": [ + "tests/test_iterutils.py::test_add_length", + "tests/test_iterutils.py::test_backoff_basic", + "tests/test_iterutils.py::test_backoff_constant_factor", + "tests/test_iterutils.py::test_backoff_jitter", + "tests/test_iterutils.py::test_backoff_repeat", + "tests/test_iterutils.py::test_backoff_validation", + "tests/test_iterutils.py::test_backoff_zero_start", + "tests/test_iterutils.py::test_backoff_zero_start_fractional_stop" + ], + "old_name_left": "boltons/ecoutils.py:269: ret['version'] = ' '.join(sys.version.split())\nboltons/formatutils.py:179: fname_list = re.split('[.[]', fname)\nboltons/formatutils.py:233: path_list = re.split('[.[]', fname) # TODO\nboltons/iterutils.py:110: \"\"\"Splits an iterable based on a separato", + "detail": "" + }, + { + "symbol": "boltons::timeutils::LocalTZInfo::is_dst", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "boltons::funcutils::FunctionBuilder::from_func", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "boltons::funcutils::format_invocation", + "ok": false, + "compiled": true, + "tests_ok": false, + "tests_failed": [ + "tests/test_funcutils.py::test_copy_function", + "tests/test_funcutils.py::test_format_invocation", + "tests/test_funcutils.py::test_noop", + "tests/test_funcutils.py::test_once_caches_result", + "tests/test_funcutils.py::test_once_executes_only_once", + "tests/test_funcutils.py::test_once_thread_safety", + "tests/test_funcutils.py::test_partials", + "tests/test_funcutils.py::test_total_ordering" + ], + "old_name_left": "tests/test_funcutils.py:5: format_invocation,", + "detail": "" + }, + { + "symbol": "boltons::statsutils::Stats::get_quantile", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "boltons::urlutils::quote_path_part", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "boltons::ecoutils::dumps", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "boltons/ecoutils.py:359: return json.dumps(val, sort_keys=True, indent=indent)\nboltons/ecoutils.py:360: return json.dumps(val, sort_keys=True)\ntests/test_dictutils.py:94: pickled = pickle.dumps(empty)\ntests/test_dictutils.py:100: roundtripped = pickle.loads(pickle.dumps(nonempty))\nte", + "detail": "" + }, + { + "symbol": "boltons::mathutils::ceil", + "ok": false, + "compiled": true, + "tests_ok": false, + "tests_failed": [ + "tests/test_statsutils.py::test_clear_cache_resets_is_sorted", + "tests/test_statsutils.py::test_histogram_zero_interquartile_range", + "tests/test_statsutils.py::test_sorted_measures_keep_data_order", + "tests/test_statsutils.py::test_stats_basic", + "tests/test_statsutils_histogram.py::test_check_sum", + "tests/test_statsutils_histogram.py::test_norm_regression" + ], + "old_name_left": "boltons/cacheutils.py:693: self._thresh_count = math.ceil(1 / threshold)\nboltons/iterutils.py:569: count = int(math.ceil((stop - start) / step))\nboltons/iterutils.py:597: count = int(math.ceil((stop - start) / step))\nboltons/iterutils.py:698: count = 1 + math.ceil(math.log(st", + "detail": "" + }, + { + "symbol": "boltons::strutils::parse_int_list", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "boltons::mathutils::floor", + "ok": false, + "compiled": true, + "tests_ok": false, + "tests_failed": [ + "tests/test_statsutils.py::test_clear_cache_resets_is_sorted", + "tests/test_statsutils.py::test_histogram_zero_interquartile_range", + "tests/test_statsutils.py::test_sorted_measures_keep_data_order", + "tests/test_statsutils.py::test_stats_basic", + "tests/test_statsutils_histogram.py::test_check_sum", + "tests/test_statsutils_histogram.py::test_norm_regression" + ], + "old_name_left": "boltons/mathutils.py:35:from math import ceil as _ceil, floor as _floor\nboltons/mathutils.py:98: \"\"\"Return the floor of *x*. If *options* is set, return the largest\nboltons/mathutils.py:120: raise ValueError(\"no floor options less than or equal to: %r\" % x)\nboltons/statsutils.py:130:from m", + "detail": "" + }, + { + "symbol": "boltons::urlutils::parse_url", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "boltons::setutils::_ComplementSet::complemented", + "ok": false, + "compiled": true, + "tests_ok": false, + "tests_failed": [ + "tests/test_setutils.py::test_bulk_difference_update", + "tests/test_setutils.py::test_bulk_intersection_update", + "tests/test_setutils.py::test_complement_set", + "tests/test_setutils.py::test_complement_set_identities", + "tests/test_setutils.py::test_cull_trims_multiple_tail_intervals", + "tests/test_setutils.py::test_indexed_set_basic", + "tests/test_setutils.py::test_indexed_set_mutate", + "tests/test_setutils.py::test_indexed_set_rsub" + ], + "old_name_left": "boltons/setutils.py:647: __invert__ = complemented\nboltons/setutils.py:992: raise NotImplementedError('complemented sets have undefined length')\nboltons/setutils.py:997: raise NotImplementedError('complemented sets have undefined contents')\ntests/test_setutils.py:133: # double-co", + "detail": "" + }, + { + "symbol": "boltons::mathutils::Bits::from_hex", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "boltons::strutils::cardinalize", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "boltons/timeutils.py:229: # all time units cardinalize normally\nboltons/timeutils.py:235:def decimal_relative_time(d, other=None, ndigits=0, cardinalize=True):\nboltons/timeutils.py:247: cardinalize (bool): Whether to pluralize the time unit if\nboltons/timeutils.py:252: *cardinali", + "detail": "" + }, + { + "symbol": "boltons::funcutils::FunctionBuilder::remove_arg", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "boltons::setutils::IndexedSet::intersection_update", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "boltons/setutils.py:382: \"intersection_update(*others) -> discard items missing from any other\"", + "detail": "" + }, + { + "symbol": "boltons::iterutils::is_scalar", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + } + ], + "mutants": { + "7": [ + "boltons::iterutils::remap", + "boltons::mathutils::Bits::as_bin", + "boltons::iterutils::chunked_iter", + "boltons::timeutils::decimal_relative_time", + "boltons::strutils::format_int_list", + "boltons::iterutils::default_visit", + "boltons::mathutils::Bits::as_hex", + "boltons::cacheutils::ThresholdCounter::get_common_count", + "boltons::iterutils::is_iterable" + ], + "8": [ + "boltons::strutils::args2sh", + "boltons::iterutils::unique_iter", + "boltons::setutils::IndexedSet::iter_intersection", + "boltons::strutils::asciify", + "boltons::iterutils::windowed", + "boltons::urlutils::parse_qsl", + "boltons::formatutils::infer_positional_format_args", + "boltons::namedutils::namedtuple", + "boltons::typeutils::issubclass", + "boltons::tbutils::Callpoint::tb_frame_str", + "docs::conf::get_mod_stats", + "boltons::tbutils::print_exception" + ], + "9": [ + "boltons::urlutils::quote_path_part", + "boltons::ecoutils::dumps", + "boltons::mathutils::ceil", + "boltons::strutils::parse_int_list", + "boltons::timeutils::LocalTZInfo::is_dst", + "boltons::mathutils::floor", + "boltons::tableutils::Table::to_html", + "boltons::mathutils::Bits::as_hex", + "boltons::urlutils::parse_url", + "boltons::setutils::_ComplementSet::complemented" + ] + }, + "tests": [ + { + "symbol": "boltons::iterutils::remap", + "level": "id", + "truth": 21, + "predicted": 23, + "recall": 1.0, + "precision": 0.9130434782608695, + "top_hits": 8, + "top_n": 10, + "top_precision": 0.8, + "top_best": 1.0, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "boltons::mathutils::Bits::as_bin", + "level": "id", + "truth": 4, + "predicted": 16, + "recall": 1.0, + "precision": 0.25, + "top_hits": 4, + "top_n": 10, + "top_precision": 0.4, + "top_best": 0.4, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "boltons::iterutils::chunked_iter", + "level": "id", + "truth": 2, + "predicted": 58, + "recall": 1.0, + "precision": 0.034482758620689655, + "top_hits": 2, + "top_n": 10, + "top_precision": 0.2, + "top_best": 0.2, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "boltons::timeutils::decimal_relative_time", + "level": "id", + "truth": 1, + "predicted": 17, + "recall": 1.0, + "precision": 0.058823529411764705, + "top_hits": 1, + "top_n": 10, + "top_precision": 0.1, + "top_best": 0.1, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "boltons::strutils::format_int_list", + "level": "id", + "truth": 1, + "predicted": 32, + "recall": 1.0, + "precision": 0.03125, + "top_hits": 1, + "top_n": 10, + "top_precision": 0.1, + "top_best": 0.1, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "boltons::iterutils::default_visit", + "skipped": "no test fails when it throws", + "predicted": 58 + }, + { + "symbol": "boltons::mathutils::Bits::as_hex", + "level": "id", + "truth": 2, + "predicted": 16, + "recall": 1.0, + "precision": 0.125, + "top_hits": 2, + "top_n": 10, + "top_precision": 0.2, + "top_best": 0.2, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "boltons::cacheutils::ThresholdCounter::get_common_count", + "level": "id", + "truth": 2, + "predicted": 28, + "recall": 1.0, + "precision": 0.07142857142857142, + "top_hits": 2, + "top_n": 10, + "top_precision": 0.2, + "top_best": 0.2, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "boltons::iterutils::is_iterable", + "level": "id", + "truth": 7, + "predicted": 11, + "recall": 1.0, + "precision": 0.6363636363636364, + "top_hits": 7, + "top_n": 10, + "top_precision": 0.7, + "top_best": 0.7, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "boltons::strutils::args2sh", + "level": "id", + "truth": 1, + "predicted": 32, + "recall": 1.0, + "precision": 0.03125, + "top_hits": 1, + "top_n": 10, + "top_precision": 0.1, + "top_best": 0.1, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "boltons::iterutils::unique_iter", + "skipped": "no test fails when it throws", + "predicted": 58 + }, + { + "symbol": "boltons::setutils::IndexedSet::iter_intersection", + "skipped": "no test fails when it throws", + "predicted": 19 + }, + { + "symbol": "boltons::strutils::asciify", + "level": "id", + "truth": 1, + "predicted": 32, + "recall": 1.0, + "precision": 0.03125, + "top_hits": 1, + "top_n": 10, + "top_precision": 0.1, + "top_best": 0.1, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "boltons::iterutils::windowed", + "level": "id", + "truth": 2, + "predicted": 58, + "recall": 1.0, + "precision": 0.034482758620689655, + "top_hits": 2, + "top_n": 10, + "top_precision": 0.2, + "top_best": 0.2, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "boltons::urlutils::parse_qsl", + "level": "id", + "truth": 29, + "predicted": 38, + "recall": 1.0, + "precision": 0.7631578947368421, + "top_hits": 6, + "top_n": 10, + "top_precision": 0.6, + "top_best": 1.0, + "caught": 1.0, + "missed": [], + "recall_graph_only": 0.034482758620689655 + }, + { + "symbol": "boltons::formatutils::infer_positional_format_args", + "level": "id", + "truth": 3, + "predicted": 5, + "recall": 1.0, + "precision": 0.6, + "top_hits": 3, + "top_n": 5, + "top_precision": 0.6, + "top_best": 0.6, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "boltons::namedutils::namedtuple", + "level": "id", + "truth": 8, + "predicted": 9, + "recall": 1.0, + "precision": 0.8888888888888888, + "top_hits": 8, + "top_n": 9, + "top_precision": 0.8888888888888888, + "top_best": 0.8888888888888888, + "caught": 1.0, + "missed": [], + "recall_graph_only": 0.125 + }, + { + "symbol": "boltons::typeutils::issubclass", + "skipped": "no test fails when it throws", + "predicted": 5 + }, + { + "symbol": "boltons::tbutils::Callpoint::tb_frame_str", + "level": "id", + "truth": 2, + "predicted": 2, + "recall": 1.0, + "precision": 1.0, + "top_hits": 2, + "top_n": 2, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [], + "recall_graph_only": 0.5 + }, + { + "symbol": "docs::conf::get_mod_stats", + "skipped": "no test fails when it throws", + "predicted": 0 + }, + { + "symbol": "boltons::tbutils::print_exception", + "level": "id", + "truth": 1, + "predicted": 2, + "recall": 1.0, + "precision": 0.5, + "top_hits": 1, + "top_n": 2, + "top_precision": 0.5, + "top_best": 0.5, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "boltons::urlutils::quote_path_part", + "level": "id", + "truth": 26, + "predicted": 38, + "recall": 1.0, + "precision": 0.6842105263157895, + "top_hits": 4, + "top_n": 10, + "top_precision": 0.4, + "top_best": 1.0, + "caught": 1.0, + "missed": [], + "recall_graph_only": 0.0 + }, + { + "symbol": "boltons::ecoutils::dumps", + "skipped": "no test fails when it throws", + "predicted": 4 + }, + { + "symbol": "boltons::mathutils::ceil", + "level": "id", + "truth": 4, + "predicted": 7, + "recall": 1.0, + "precision": 0.5714285714285714, + "top_hits": 4, + "top_n": 7, + "top_precision": 0.5714285714285714, + "top_best": 0.5714285714285714, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "boltons::strutils::parse_int_list", + "level": "id", + "truth": 1, + "predicted": 32, + "recall": 1.0, + "precision": 0.03125, + "top_hits": 1, + "top_n": 10, + "top_precision": 0.1, + "top_best": 0.1, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "boltons::timeutils::LocalTZInfo::is_dst", + "skipped": "no test fails when it throws", + "predicted": 17 + }, + { + "symbol": "boltons::mathutils::floor", + "level": "id", + "truth": 4, + "predicted": 7, + "recall": 1.0, + "precision": 0.5714285714285714, + "top_hits": 4, + "top_n": 7, + "top_precision": 0.5714285714285714, + "top_best": 0.5714285714285714, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "boltons::tableutils::Table::to_html", + "level": "id", + "truth": 2, + "predicted": 10, + "recall": 1.0, + "precision": 0.2, + "top_hits": 2, + "top_n": 10, + "top_precision": 0.2, + "top_best": 0.2, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "boltons::urlutils::parse_url", + "level": "id", + "truth": 75, + "predicted": 38, + "recall": 0.49333333333333335, + "precision": 0.9736842105263158, + "top_hits": 9, + "top_n": 10, + "top_precision": 0.9, + "top_best": 1.0, + "caught": 1.0, + "missed": [ + "tests/test_dictutils.py::test_addlist", + "tests/test_dictutils.py::test_addlist_iterator", + "tests/test_dictutils.py::test_clear", + "tests/test_dictutils.py::test_copy", + "tests/test_dictutils.py::test_dict_init", + "tests/test_dictutils.py::test_eq", + "tests/test_dictutils.py::test_eq_none_items", + "tests/test_dictutils.py::test_eq_with_dict" + ], + "recall_graph_only": 0.013333333333333334 + }, + { + "symbol": "boltons::setutils::_ComplementSet::complemented", + "level": "id", + "truth": 2, + "predicted": 19, + "recall": 1.0, + "precision": 0.10526315789473684, + "top_hits": 2, + "top_n": 10, + "top_precision": 0.2, + "top_best": 0.2, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + } + ], + "look": [ + { + "symbol": "boltons::iterutils::remap", + "look_tokens": 2639, + "file_tokens": 15381 + }, + { + "symbol": "boltons::mathutils::Bits::as_bin", + "look_tokens": 291, + "file_tokens": 2064 + }, + { + "symbol": "boltons::iterutils::chunked_iter", + "look_tokens": 675, + "file_tokens": 15381 + }, + { + "symbol": "boltons::timeutils::decimal_relative_time", + "look_tokens": 824, + "file_tokens": 6128 + }, + { + "symbol": "boltons::strutils::format_int_list", + "look_tokens": 1028, + "file_tokens": 11995 + }, + { + "symbol": "boltons::iterutils::default_visit", + "look_tokens": 312, + "file_tokens": 15381 + }, + { + "symbol": "boltons::mathutils::Bits::as_hex", + "look_tokens": 311, + "file_tokens": 2064 + }, + { + "symbol": "boltons::cacheutils::ThresholdCounter::get_common_count", + "look_tokens": 333, + "file_tokens": 7605 + }, + { + "symbol": "boltons::iterutils::is_iterable", + "look_tokens": 435, + "file_tokens": 15381 + }, + { + "symbol": "boltons::funcutils::inspect_formatargspec", + "look_tokens": 834, + "file_tokens": 10115 + }, + { + "symbol": "boltons::formatutils::BaseFormatField::set_fspec", + "look_tokens": 278, + "file_tokens": 3182 + }, + { + "symbol": "docs::conf::get_mod_stats", + "look_tokens": 281, + "file_tokens": 2435 + }, + { + "symbol": "boltons::iterutils::windowed_iter", + "look_tokens": 612, + "file_tokens": 15381 + }, + { + "symbol": "boltons::urlutils::URL::normalize", + "look_tokens": 353, + "file_tokens": 14494 + }, + { + "symbol": "boltons::tbutils::ExceptionInfo::from_exc_info", + "look_tokens": 277, + "file_tokens": 8251 + }, + { + "symbol": "boltons::strutils::split_punct_ws", + "look_tokens": 352, + "file_tokens": 11995 + }, + { + "symbol": "boltons::tableutils::Table::to_html", + "look_tokens": 1107, + "file_tokens": 5583 + }, + { + "symbol": "boltons::tableutils::Table::from_data", + "look_tokens": 1138, + "file_tokens": 5583 + }, + { + "symbol": "boltons::ioutils::SpooledIOBase::getvalue", + "look_tokens": 436, + "file_tokens": 4658 + }, + { + "symbol": "boltons::cacheutils::ThresholdCounter::most_common", + "look_tokens": 351, + "file_tokens": 7605 + }, + { + "symbol": "boltons::strutils::args2sh", + "look_tokens": 560, + "file_tokens": 11995 + }, + { + "symbol": "boltons::iterutils::unique_iter", + "look_tokens": 572, + "file_tokens": 15381 + }, + { + "symbol": "boltons::setutils::IndexedSet::iter_intersection", + "look_tokens": 395, + "file_tokens": 8871 + }, + { + "symbol": "boltons::strutils::asciify", + "look_tokens": 491, + "file_tokens": 11995 + }, + { + "symbol": "boltons::iterutils::windowed", + "look_tokens": 356, + "file_tokens": 15381 + }, + { + "symbol": "boltons::urlutils::parse_qsl", + "look_tokens": 399, + "file_tokens": 14494 + }, + { + "symbol": "boltons::formatutils::infer_positional_format_args", + "look_tokens": 383, + "file_tokens": 3182 + }, + { + "symbol": "boltons::namedutils::namedtuple", + "look_tokens": 1397, + "file_tokens": 3862 + }, + { + "symbol": "boltons::typeutils::issubclass", + "look_tokens": 374, + "file_tokens": 1456 + }, + { + "symbol": "boltons::tbutils::Callpoint::tb_frame_str", + "look_tokens": 263, + "file_tokens": 8251 + }, + { + "symbol": "boltons::tbutils::print_exception", + "look_tokens": 337, + "file_tokens": 8251 + }, + { + "symbol": "boltons::iterutils::split", + "look_tokens": 288, + "file_tokens": 15381 + }, + { + "symbol": "boltons::timeutils::LocalTZInfo::is_dst", + "look_tokens": 367, + "file_tokens": 6128 + }, + { + "symbol": "boltons::funcutils::FunctionBuilder::from_func", + "look_tokens": 771, + "file_tokens": 10115 + }, + { + "symbol": "boltons::funcutils::format_invocation", + "look_tokens": 467, + "file_tokens": 10115 + }, + { + "symbol": "boltons::statsutils::Stats::get_quantile", + "look_tokens": 457, + "file_tokens": 7863 + }, + { + "symbol": "boltons::urlutils::quote_path_part", + "look_tokens": 342, + "file_tokens": 14494 + }, + { + "symbol": "boltons::ecoutils::dumps", + "look_tokens": 190, + "file_tokens": 3531 + }, + { + "symbol": "boltons::mathutils::ceil", + "look_tokens": 399, + "file_tokens": 2064 + }, + { + "symbol": "boltons::strutils::parse_int_list", + "look_tokens": 555, + "file_tokens": 11995 + }, + { + "symbol": "boltons::mathutils::floor", + "look_tokens": 403, + "file_tokens": 2064 + }, + { + "symbol": "boltons::urlutils::parse_url", + "look_tokens": 801, + "file_tokens": 14494 + }, + { + "symbol": "boltons::setutils::_ComplementSet::complemented", + "look_tokens": 400, + "file_tokens": 8871 + }, + { + "symbol": "boltons::mathutils::Bits::from_hex", + "look_tokens": 311, + "file_tokens": 2064 + }, + { + "symbol": "boltons::strutils::cardinalize", + "look_tokens": 369, + "file_tokens": 11995 + }, + { + "symbol": "boltons::funcutils::FunctionBuilder::remove_arg", + "look_tokens": 634, + "file_tokens": 10115 + }, + { + "symbol": "boltons::setutils::IndexedSet::intersection_update", + "look_tokens": 402, + "file_tokens": 8871 + }, + { + "symbol": "boltons::iterutils::is_scalar", + "look_tokens": 401, + "file_tokens": 15381 + } + ], + "seconds": 262, + "summary": { + "callers_recall": null, + "callers_precision": null, + "callers_checked": 0, + "blind_recall": null, + "blind_checked": 0, + "common_recall": null, + "common_precision": null, + "common_recall_with_maybe": null, + "common_checked": 0, + "rename_ok": 0.688, + "rename_checked": 48, + "tests_recall": 0.978, + "tests_precision": 0.396, + "tests_top10_precision": 0.419, + "tests_top10_best": 0.475, + "tests_caught": 1.0, + "tests_checked": 23, + "look_vs_file": 0.083 + }, + "summary_seeds": { + "7": { + "callers_recall": null, + "callers_precision": null, + "callers_checked": 0, + "blind_recall": null, + "blind_checked": 0, + "common_recall": null, + "common_precision": null, + "common_recall_with_maybe": null, + "common_checked": 0, + "rename_ok": 0.75, + "rename_checked": 20, + "tests_recall": 1.0, + "tests_precision": 0.265, + "tests_top10_precision": 0.338, + "tests_top10_best": 0.362, + "tests_caught": 1.0, + "tests_checked": 8, + "look_vs_file": 0.089 + }, + "8": { + "callers_recall": null, + "callers_precision": null, + "callers_checked": 0, + "blind_recall": null, + "blind_checked": 0, + "common_recall": null, + "common_precision": null, + "common_recall_with_maybe": null, + "common_checked": 0, + "rename_ok": 0.65, + "rename_checked": 20, + "tests_recall": 1.0, + "tests_precision": 0.481, + "tests_top10_precision": 0.499, + "tests_top10_best": 0.549, + "tests_caught": 1.0, + "tests_checked": 8, + "look_vs_file": 0.08 + }, + "9": { + "callers_recall": null, + "callers_precision": null, + "callers_checked": 0, + "blind_recall": null, + "blind_checked": 0, + "common_recall": null, + "common_precision": null, + "common_recall_with_maybe": null, + "common_checked": 0, + "rename_ok": 0.8, + "rename_checked": 20, + "tests_recall": 0.937, + "tests_precision": 0.408, + "tests_top10_precision": 0.393, + "tests_top10_best": 0.48, + "tests_caught": 1.0, + "tests_checked": 8, + "look_vs_file": 0.094 + } + }, + "noise": { + "callers_recall": null, + "callers_precision": null, + "blind_recall": null, + "common_recall": null, + "common_recall_with_maybe": null, + "common_precision": null, + "rename_ok": { + "mean": 0.688, + "functions": 48, + "boot_lo": 0.583, + "boot_hi": 0.792, + "boot_half": 0.104, + "seeds": [ + 0.75, + 0.65, + 0.8 + ], + "seed_sd": 0.076, + "threshold": 0.11 + }, + "tests_recall": { + "mean": 0.978, + "functions": 23, + "boot_lo": 0.934, + "boot_hi": 1.0, + "boot_half": 0.033, + "seeds": [ + 1.0, + 1.0, + 0.937 + ], + "seed_sd": 0.037, + "threshold": 0.05 + }, + "tests_precision": { + "mean": 0.396, + "functions": 23, + "boot_lo": 0.271, + "boot_hi": 0.516, + "boot_half": 0.123, + "seeds": [ + 0.265, + 0.481, + 0.408 + ], + "seed_sd": 0.11, + "threshold": 0.13 + }, + "tests_top10_precision": { + "mean": 0.419, + "functions": 23, + "boot_lo": 0.315, + "boot_hi": 0.52, + "boot_half": 0.103, + "seeds": [ + 0.338, + 0.499, + 0.393 + ], + "seed_sd": 0.082, + "threshold": 0.11 + }, + "tests_top10_best": { + "mean": 0.475, + "functions": 23, + "boot_lo": 0.354, + "boot_hi": 0.594, + "boot_half": 0.12, + "seeds": [ + 0.362, + 0.549, + 0.48 + ], + "seed_sd": 0.094, + "threshold": 0.13 + }, + "tests_caught": { + "mean": 1.0, + "functions": 23, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.05 + }, + "look_vs_file": { + "mean": 0.083, + "functions": 48, + "boot_lo": 0.068, + "boot_hi": 0.101, + "boot_half": 0.017, + "seeds": [ + 0.089, + 0.08, + 0.094 + ], + "seed_sd": 0.007, + "threshold": 0.02 + } + } + }, + { + "repo": "itertools", + "lang": "rust", + "commit": "8b4c6cb2732a", + "index_seconds": 0.4, + "symbols": 1013, + "files": 64, + "seeds": [ + 7, + 8, + 9 + ], + "edges": 8964, + "sample": [ + "itertools::either_or_both::EitherOrBoth::or_default", + "itertools::either_or_both::EitherOrBoth::both", + "itertools::adaptors::checked_binomial", + "itertools::either_or_both::EitherOrBoth::map_any", + "itertools::lazy_buffer::LazyBuffer::get_at", + "itertools::Itertools::strip_prefix_by", + "itertools::Itertools::collect_vec", + "itertools::grouping_map::GroupingMap::fold_with", + "itertools::Itertools::chunk_by", + "itertools::extrema_set::max_set_impl", + "itertools::Itertools::next_tuple", + "itertools::adaptors::PutBack::with_value", + "itertools::Itertools::position_max", + "itertools::extrema_set::min_set_impl", + "itertools::either_or_both::EitherOrBoth::or_else", + "itertools::either_or_both::EitherOrBoth::right_or_insert_with", + "itertools::Itertools::set_from", + "itertools::Itertools::position_min", + "itertools::Itertools::position_minmax", + "itertools::minmax::MinMaxResult::into_option", + "itertools::next_array::ArrayBuilder::take", + "itertools::grouping_map::GroupingMap::max_by", + "itertools::groupbylazy::new_chunks", + "itertools::k_smallest::key_to_cmp", + "itertools::size_hint::mul_scalar", + "itertools::next_array::ArrayBuilder::push", + "itertools::Itertools::fold_ok", + "itertools::Itertools::partition_map", + "itertools::heap::heapify", + "itertools::Itertools::fold1", + "itertools::lazy_buffer::LazyBuffer::get_next", + "itertools::size_hint::add_scalar", + "itertools::Itertools::all_unique_with_hasher", + "itertools::partition", + "itertools::either_or_both::EitherOrBoth::as_ref", + "itertools::grouping_map::GroupingMap::aggregate", + "itertools::Itertools::k_smallest_relaxed", + "itertools::either_or_both::EitherOrBoth::insert_right", + "itertools::grouping_map::GroupingMap::product", + "itertools::Itertools::k_smallest_by", + "itertools::Itertools::k_largest_relaxed_by", + "itertools::minmax::minmax_impl", + "itertools::heap::sift_down", + "itertools::combinations::Combinations::reset", + "itertools::k_smallest::k_smallest_general", + "itertools::grouping_map::new_map_for_grouping", + "itertools::either_or_both::EitherOrBoth::left_or_insert_with" + ], + "sample_common": [ + "itertools::Itertools::next_array", + "itertools::adaptors::PutBack::put_back", + "itertools::Itertools::sorted", + "itertools::Itertools::multi_cartesian_product", + "itertools::Itertools::minmax_by", + "itertools::peek_nth::PeekNth::peek_nth", + "itertools::Itertools::intersperse", + "itertools::Itertools::array_combinations_with_replacement", + "itertools::Itertools::intersperse_with", + "itertools::multipeek_impl::MultiPeek::peek", + "itertools::Itertools::cartesian_product", + "itertools::Itertools::multiunzip", + "itertools::Itertools::tuples", + "itertools::Itertools::all_equal", + "itertools::Itertools::sorted_unstable", + "itertools::Itertools::array_combinations", + "itertools::Itertools::permutations", + "itertools::Itertools::minmax", + "itertools::Itertools::tuple_windows", + "itertools::Itertools::kmerge", + "itertools::either_or_both::EitherOrBoth::reduce", + "itertools::peek_nth::PeekNth::peek", + "itertools::grouping_map::GroupingMap::minmax_by", + "itertools::Itertools::dedup", + "itertools::put_back_n_impl::PutBackN::put_back", + "itertools::grouping_map::GroupingMap::reduce" + ], + "samples": { + "7": [ + "itertools::either_or_both::EitherOrBoth::or_default", + "itertools::either_or_both::EitherOrBoth::both", + "itertools::adaptors::checked_binomial", + "itertools::either_or_both::EitherOrBoth::map_any", + "itertools::lazy_buffer::LazyBuffer::get_at", + "itertools::Itertools::strip_prefix_by", + "itertools::Itertools::collect_vec", + "itertools::grouping_map::GroupingMap::fold_with", + "itertools::Itertools::chunk_by", + "itertools::extrema_set::max_set_impl", + "itertools::Itertools::next_tuple", + "itertools::adaptors::PutBack::with_value", + "itertools::Itertools::position_max", + "itertools::extrema_set::min_set_impl", + "itertools::either_or_both::EitherOrBoth::or_else", + "itertools::either_or_both::EitherOrBoth::right_or_insert_with", + "itertools::Itertools::set_from", + "itertools::Itertools::position_min", + "itertools::Itertools::position_minmax", + "itertools::minmax::MinMaxResult::into_option" + ], + "8": [ + "itertools::next_array::ArrayBuilder::take", + "itertools::grouping_map::GroupingMap::max_by", + "itertools::groupbylazy::new_chunks", + "itertools::k_smallest::key_to_cmp", + "itertools::size_hint::mul_scalar", + "itertools::next_array::ArrayBuilder::push", + "itertools::Itertools::fold_ok", + "itertools::extrema_set::min_set_impl", + "itertools::minmax::MinMaxResult::into_option", + "itertools::Itertools::partition_map", + "itertools::heap::heapify", + "itertools::Itertools::fold1", + "itertools::lazy_buffer::LazyBuffer::get_next", + "itertools::size_hint::add_scalar", + "itertools::Itertools::all_unique_with_hasher", + "itertools::Itertools::next_tuple", + "itertools::partition", + "itertools::either_or_both::EitherOrBoth::as_ref", + "itertools::either_or_both::EitherOrBoth::or_else", + "itertools::extrema_set::max_set_impl" + ], + "9": [ + "itertools::grouping_map::GroupingMap::aggregate", + "itertools::Itertools::k_smallest_relaxed", + "itertools::either_or_both::EitherOrBoth::insert_right", + "itertools::either_or_both::EitherOrBoth::or_default", + "itertools::either_or_both::EitherOrBoth::right_or_insert_with", + "itertools::grouping_map::GroupingMap::product", + "itertools::k_smallest::key_to_cmp", + "itertools::Itertools::k_smallest_by", + "itertools::either_or_both::EitherOrBoth::as_ref", + "itertools::Itertools::k_largest_relaxed_by", + "itertools::minmax::minmax_impl", + "itertools::heap::sift_down", + "itertools::combinations::Combinations::reset", + "itertools::k_smallest::k_smallest_general", + "itertools::extrema_set::min_set_impl", + "itertools::either_or_both::EitherOrBoth::map_any", + "itertools::partition", + "itertools::Itertools::next_tuple", + "itertools::grouping_map::new_map_for_grouping", + "itertools::either_or_both::EitherOrBoth::left_or_insert_with" + ] + }, + "samples_common": { + "7": [ + "itertools::Itertools::next_array", + "itertools::adaptors::PutBack::put_back", + "itertools::Itertools::sorted", + "itertools::Itertools::multi_cartesian_product", + "itertools::Itertools::minmax_by", + "itertools::peek_nth::PeekNth::peek_nth", + "itertools::Itertools::intersperse", + "itertools::Itertools::array_combinations_with_replacement", + "itertools::Itertools::intersperse_with", + "itertools::multipeek_impl::MultiPeek::peek", + "itertools::Itertools::cartesian_product", + "itertools::Itertools::multiunzip", + "itertools::Itertools::tuples", + "itertools::Itertools::all_equal", + "itertools::Itertools::sorted_unstable", + "itertools::Itertools::array_combinations", + "itertools::Itertools::permutations", + "itertools::Itertools::minmax", + "itertools::Itertools::tuple_windows", + "itertools::Itertools::kmerge" + ], + "8": [ + "itertools::Itertools::permutations", + "itertools::Itertools::array_combinations_with_replacement", + "itertools::adaptors::PutBack::put_back", + "itertools::Itertools::sorted", + "itertools::peek_nth::PeekNth::peek_nth", + "itertools::Itertools::kmerge", + "itertools::Itertools::intersperse_with", + "itertools::Itertools::array_combinations", + "itertools::Itertools::minmax", + "itertools::either_or_both::EitherOrBoth::reduce", + "itertools::peek_nth::PeekNth::peek", + "itertools::Itertools::intersperse", + "itertools::grouping_map::GroupingMap::minmax_by", + "itertools::Itertools::multi_cartesian_product", + "itertools::Itertools::tuples", + "itertools::Itertools::sorted_unstable", + "itertools::Itertools::all_equal", + "itertools::Itertools::multiunzip", + "itertools::Itertools::dedup", + "itertools::Itertools::next_array" + ], + "9": [ + "itertools::Itertools::sorted_unstable", + "itertools::put_back_n_impl::PutBackN::put_back", + "itertools::Itertools::intersperse_with", + "itertools::multipeek_impl::MultiPeek::peek", + "itertools::Itertools::multi_cartesian_product", + "itertools::peek_nth::PeekNth::peek_nth", + "itertools::Itertools::minmax", + "itertools::Itertools::all_equal", + "itertools::Itertools::multiunzip", + "itertools::grouping_map::GroupingMap::minmax_by", + "itertools::grouping_map::GroupingMap::reduce", + "itertools::Itertools::tuple_windows", + "itertools::Itertools::kmerge", + "itertools::Itertools::next_array", + "itertools::Itertools::array_combinations_with_replacement", + "itertools::Itertools::intersperse", + "itertools::Itertools::permutations", + "itertools::Itertools::array_combinations", + "itertools::Itertools::sorted", + "itertools::Itertools::cartesian_product" + ] + }, + "samples_blind": { + "7": [ + "itertools::tuple_impl::Tuples::into_buffer", + "itertools::Itertools::k_smallest_relaxed_by_key", + "itertools::Itertools::max_set", + "itertools::Itertools::position_max_by", + "itertools::either_or_both::EitherOrBoth::or_default", + "itertools::Itertools::unique", + "itertools::peek_nth::PeekNth::peek_mut", + "itertools::either_or_both::EitherOrBoth::both", + "itertools::Itertools::position_min_by", + "itertools::adaptors::checked_binomial", + "itertools::either_or_both::EitherOrBoth::map_any", + "itertools::lazy_buffer::LazyBuffer::get_at", + "itertools::Itertools::strip_prefix_by", + "itertools::Itertools::k_largest_relaxed_by_key", + "itertools::Itertools::collect_vec", + "itertools::benches::fold_specialization::specialization::intersperse::internal_specialized", + "itertools::Itertools::tail", + "itertools::grouping_map::GroupingMap::fold_with", + "itertools::Itertools::chunk_by", + "itertools::Itertools::k_smallest_by_key" + ], + "8": [ + "itertools::repeatn::repeat_n", + "itertools::next_array::ArrayBuilder::take", + "itertools::with_position::Position::is_last", + "itertools::Itertools::min_set", + "itertools::grouping_map::GroupingMap::max_by", + "itertools::groupbylazy::new_chunks", + "itertools::k_smallest::key_to_cmp", + "itertools::size_hint::mul_scalar", + "itertools::next_array::ArrayBuilder::push", + "itertools::Itertools::fold_ok", + "itertools::extrema_set::min_set_impl", + "itertools::either_or_both::EitherOrBoth::has_right", + "itertools::minmax::MinMaxResult::into_option", + "itertools::Itertools::partition_map", + "itertools::heap::heapify", + "itertools::Itertools::sorted_by_key", + "itertools::either_or_both::EitherOrBoth::left_and_then", + "itertools::either_or_both::EitherOrBoth::is_right", + "itertools::Itertools::strip_prefix", + "itertools::Itertools::try_len" + ], + "9": [ + "itertools::Itertools::sorted_by", + "itertools::Itertools::dropping", + "itertools::grouping_map::GroupingMap::aggregate", + "itertools::free::enumerate", + "itertools::Itertools::k_smallest_relaxed", + "itertools::either_or_both::EitherOrBoth::insert_right", + "itertools::grouping_map::GroupingMap::min_by_key", + "itertools::either_or_both::EitherOrBoth::or_default", + "itertools::either_or_both::EitherOrBoth::right_or_insert_with", + "itertools::grouping_map::GroupingMap::product", + "itertools::Itertools::unique", + "itertools::either_or_both::EitherOrBoth::has_left", + "itertools::k_smallest::key_to_cmp", + "itertools::Itertools::k_smallest_by", + "itertools::either_or_both::EitherOrBoth::as_ref", + "itertools::Itertools::duplicates", + "itertools::tuple_impl::TupleCollect::buffer_len", + "itertools::Itertools::k_largest_relaxed_by", + "itertools::minmax::minmax_impl", + "itertools::multipeek_impl::MultiPeek::reset_peek" + ] + }, + "baseline_failing_tests": [], + "callers": [ + { + "symbol": "itertools::either_or_both::EitherOrBoth::or_default", + "truth": [ + "itertools::either_or_both::EitherOrBoth::left_and_right" + ], + "found": [ + "itertools::Itertools::counts_with_hasher", + "itertools::either_or_both::EitherOrBoth::left_and_right", + "itertools::group_map::into_group_map_with_hasher" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 0.3333333333333333, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::both", + "truth": [ + "itertools::either_or_both::EitherOrBoth::is_both" + ], + "found": [ + "itertools::either_or_both::EitherOrBoth::is_both" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::adaptors::checked_binomial", + "truth": [ + "itertools::adaptors::impl_tuple_combination", + "itertools::combinations::remaining_for", + "itertools::combinations_with_replacement::remaining_for", + "itertools::powerset::remaining_for" + ], + "found": [ + "itertools::adaptors::impl_tuple_combination", + "itertools::combinations::remaining_for", + "itertools::combinations_with_replacement::remaining_for", + "itertools::powerset::remaining_for" + ], + "maybe": [], + "import_files": [ + "src/combinations.rs", + "src/combinations_with_replacement.rs", + "src/lib.rs", + "src/powerset.rs" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::map_any", + "truth": [ + "itertools::either_or_both::EitherOrBoth::left_and_right" + ], + "found": [ + "itertools::either_or_both::EitherOrBoth::left_and_right" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::lazy_buffer::LazyBuffer::get_at", + "truth": [ + "itertools::combinations::Box::extract_item", + "itertools::combinations::Vec::extract_item", + "itertools::permutations::Permutations::next" + ], + "found": [ + "itertools::combinations::Box::extract_item", + "itertools::combinations::Vec::extract_item", + "itertools::permutations::Permutations::next" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::Itertools::strip_prefix_by", + "truth": [ + "itertools::Itertools::strip_prefix" + ], + "found": [ + "itertools::Itertools::strip_prefix" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::Itertools::collect_vec", + "truth": [ + "itertools::Itertools::k_smallest" + ], + "found": [ + "itertools::Itertools::k_smallest" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::grouping_map::GroupingMap::fold_with", + "truth": [ + "itertools::grouping_map::GroupingMap::fold" + ], + "found": [ + "itertools::grouping_map::GroupingMap::fold" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::Itertools::chunk_by", + "truth": [ + "itertools::Itertools::group_by" + ], + "found": [ + "itertools::Itertools::group_by", + "itertools::examples::iris::main" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 0.5, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::extrema_set::max_set_impl", + "truth": [ + "itertools::Itertools::max_set", + "itertools::Itertools::max_set_by", + "itertools::Itertools::max_set_by_key" + ], + "found": [ + "itertools::Itertools::max_set", + "itertools::Itertools::max_set_by", + "itertools::Itertools::max_set_by_key" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::Itertools::next_tuple", + "truth": [ + "itertools::Itertools::collect_tuple" + ], + "found": [ + "itertools::Itertools::collect_tuple" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::adaptors::PutBack::with_value", + "truth": [ + "itertools::diff::diff_with" + ], + "found": [ + "itertools::diff::diff_with" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::Itertools::position_max", + "truth": [ + "itertools::Itertools::position_max_by_key" + ], + "found": [ + "itertools::Itertools::position_max_by_key" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::extrema_set::min_set_impl", + "truth": [ + "itertools::Itertools::min_set", + "itertools::Itertools::min_set_by", + "itertools::Itertools::min_set_by_key", + "itertools::extrema_set::max_set_impl" + ], + "found": [ + "itertools::Itertools::min_set", + "itertools::Itertools::min_set_by", + "itertools::Itertools::min_set_by_key", + "itertools::extrema_set::max_set_impl" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::or_else", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::right_or_insert_with", + "truth": [ + "itertools::either_or_both::EitherOrBoth::right_or_insert" + ], + "found": [ + "itertools::either_or_both::EitherOrBoth::right_or_insert" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::Itertools::set_from", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::Itertools::position_min", + "truth": [ + "itertools::Itertools::position_min_by_key" + ], + "found": [ + "itertools::Itertools::position_min_by_key" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::Itertools::position_minmax", + "truth": [ + "itertools::Itertools::position_minmax_by_key" + ], + "found": [ + "itertools::Itertools::position_minmax_by_key" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::minmax::MinMaxResult::into_option", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::next_array::ArrayBuilder::take", + "truth": [ + "itertools::next_array::next_array" + ], + "found": [ + "itertools::Itertools::k_smallest", + "itertools::Itertools::tail", + "itertools::adaptors::PutBack::all", + "itertools::adaptors::PutBack::fold", + "itertools::adaptors::PutBack::next", + "itertools::adaptors::PutBack::nth", + "itertools::adaptors::coalesce::CoalesceBy::next", + "itertools::exactly_one_err::ExactlyOneError::next", + "itertools::examples::iris::Iris::from_str", + "itertools::format::Format::clone", + "itertools::format::Format::format", + "itertools::format::FormatWith::clone", + "itertools::format::FormatWith::fmt", + "itertools::groupbylazy::Chunk::next", + "itertools::groupbylazy::Group::next", + "itertools::groupbylazy::GroupInner::group_key", + "itertools::groupbylazy::GroupInner::step_buffering", + "itertools::groupbylazy::GroupInner::step_current", + "itertools::intersperse::IntersperseWith::next", + "itertools::iter_index::Range::index", + "itertools::iter_index::RangeInclusive::index", + "itertools::iter_index::RangeTo::index", + "itertools::iter_index::RangeToInclusive::index", + "itertools::k_smallest::k_smallest_general", + "itertools::k_smallest::k_smallest_relaxed_general", + "itertools::lazy_buffer::LazyBuffer::prefill", + "itertools::next_array::next_array", + "itertools::peek_nth::PeekNth::peek_nth", + "itertools::peek_nth::PeekNth::peek_nth_mut", + "itertools::repeatn::RepeatN::next", + "itertools::tuple_impl::TupleBuffer::next", + "itertools::zip_longest::ZipLongest::rfold" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 0.03125, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::grouping_map::GroupingMap::max_by", + "truth": [ + "itertools::grouping_map::GroupingMap::max", + "itertools::grouping_map::GroupingMap::max_by_key" + ], + "found": [ + "itertools::Itertools::position_max", + "itertools::Itertools::position_max_by", + "itertools::grouping_map::GroupingMap::max", + "itertools::grouping_map::GroupingMap::max_by_key" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 0.5, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::groupbylazy::new_chunks", + "truth": [ + "itertools::Itertools::chunks" + ], + "found": [ + "itertools::Itertools::chunks" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::k_smallest::key_to_cmp", + "truth": [ + "itertools::Itertools::k_largest_by_key", + "itertools::Itertools::k_largest_relaxed_by_key", + "itertools::Itertools::k_smallest_by_key", + "itertools::Itertools::k_smallest_relaxed_by_key" + ], + "found": [ + "itertools::Itertools::k_largest_by_key", + "itertools::Itertools::k_largest_relaxed_by_key", + "itertools::Itertools::k_smallest_by_key", + "itertools::Itertools::k_smallest_relaxed_by_key" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::size_hint::mul_scalar", + "truth": [ + "itertools::adaptors::InterleaveShortest::size_hint" + ], + "found": [ + "itertools::adaptors::InterleaveShortest::size_hint" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::next_array::ArrayBuilder::push", + "truth": [ + "itertools::next_array::next_array" + ], + "found": [ + "itertools::next_array::next_array" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::Itertools::fold_ok", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::Itertools::partition_map", + "truth": [ + "itertools::Itertools::partition_result" + ], + "found": [ + "itertools::Itertools::partition_result" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::heap::heapify", + "truth": [ + "itertools::k_smallest::k_smallest_general", + "itertools::kmerge_impl::kmerge_by" + ], + "found": [ + "itertools::k_smallest::k_smallest_general", + "itertools::kmerge_impl::kmerge_by" + ], + "maybe": [], + "import_files": [ + "src/k_smallest.rs", + "src/kmerge_impl.rs" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::Itertools::fold1", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::lazy_buffer::LazyBuffer::get_next", + "truth": [ + "itertools::combinations::CombinationsGeneric::increment_indices", + "itertools::combinations_with_replacement::CombinationsWithReplacementGeneric::increment_indices", + "itertools::combinations_with_replacement::CombinationsWithReplacementGeneric::next", + "itertools::combinations_with_replacement::CombinationsWithReplacementGeneric::nth", + "itertools::permutations::Permutations::next" + ], + "found": [ + "itertools::combinations::CombinationsGeneric::increment_indices", + "itertools::combinations_with_replacement::CombinationsWithReplacementGeneric::increment_indices", + "itertools::combinations_with_replacement::CombinationsWithReplacementGeneric::next", + "itertools::combinations_with_replacement::CombinationsWithReplacementGeneric::nth", + "itertools::permutations::Permutations::next" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::size_hint::add_scalar", + "truth": [ + "itertools::adaptors::PutBack::size_hint", + "itertools::adaptors::coalesce::CoalesceBy::size_hint", + "itertools::exactly_one_err::ExactlyOneError::size_hint", + "itertools::intersperse::IntersperseWith::size_hint", + "itertools::kmerge_impl::HeadTail::size_hint", + "itertools::lazy_buffer::LazyBuffer::size_hint", + "itertools::multipeek_impl::MultiPeek::size_hint", + "itertools::peek_nth::PeekNth::size_hint", + "itertools::put_back_n_impl::PutBackN::size_hint", + "itertools::tee::Tee::size_hint" + ], + "found": [ + "itertools::adaptors::PutBack::size_hint", + "itertools::adaptors::coalesce::CoalesceBy::size_hint", + "itertools::exactly_one_err::ExactlyOneError::size_hint", + "itertools::intersperse::IntersperseWith::size_hint", + "itertools::kmerge_impl::HeadTail::size_hint", + "itertools::lazy_buffer::LazyBuffer::size_hint", + "itertools::multipeek_impl::MultiPeek::size_hint", + "itertools::peek_nth::PeekNth::size_hint", + "itertools::put_back_n_impl::PutBackN::size_hint", + "itertools::tee::Tee::size_hint" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::Itertools::all_unique_with_hasher", + "truth": [ + "itertools::Itertools::all_unique" + ], + "found": [ + "itertools::Itertools::all_unique" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::partition", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::as_ref", + "truth": [ + "itertools::either_or_both::EitherOrBoth::has_left", + "itertools::either_or_both::EitherOrBoth::has_right", + "itertools::either_or_both::EitherOrBoth::is_both" + ], + "found": [ + "itertools::either_or_both::EitherOrBoth::has_left", + "itertools::either_or_both::EitherOrBoth::has_right", + "itertools::either_or_both::EitherOrBoth::is_both" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::grouping_map::GroupingMap::aggregate", + "truth": [ + "itertools::grouping_map::GroupingMap::fold_with", + "itertools::grouping_map::GroupingMap::minmax_by", + "itertools::grouping_map::GroupingMap::reduce" + ], + "found": [ + "itertools::grouping_map::GroupingMap::fold_with", + "itertools::grouping_map::GroupingMap::minmax_by", + "itertools::grouping_map::GroupingMap::reduce" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::Itertools::k_smallest_relaxed", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::insert_right", + "truth": [ + "itertools::either_or_both::EitherOrBoth::right_or_insert_with" + ], + "found": [ + "itertools::either_or_both::EitherOrBoth::right_or_insert_with" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::grouping_map::GroupingMap::product", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::Itertools::k_smallest_by", + "truth": [ + "itertools::Itertools::k_largest_by", + "itertools::Itertools::k_smallest_by_key" + ], + "found": [ + "itertools::Itertools::k_largest_by", + "itertools::Itertools::k_smallest_by_key" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::Itertools::k_largest_relaxed_by", + "truth": [ + "itertools::Itertools::k_largest_relaxed", + "itertools::Itertools::k_largest_relaxed_by_key" + ], + "found": [ + "itertools::Itertools::k_largest_relaxed", + "itertools::Itertools::k_largest_relaxed_by_key" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::minmax::minmax_impl", + "truth": [ + "itertools::Itertools::minmax", + "itertools::Itertools::minmax_by", + "itertools::Itertools::minmax_by_key", + "itertools::Itertools::position_minmax" + ], + "found": [ + "itertools::Itertools::minmax", + "itertools::Itertools::minmax_by", + "itertools::Itertools::minmax_by_key", + "itertools::Itertools::position_minmax" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::heap::sift_down", + "truth": [ + "itertools::heap::heapify", + "itertools::k_smallest::k_smallest_general", + "itertools::kmerge_impl::KMergeBy::next" + ], + "found": [ + "itertools::heap::heapify", + "itertools::k_smallest::k_smallest_general", + "itertools::kmerge_impl::KMergeBy::next" + ], + "maybe": [], + "import_files": [ + "src/k_smallest.rs", + "src/kmerge_impl.rs" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::combinations::Combinations::reset", + "truth": [ + "itertools::powerset::Powerset::fold", + "itertools::powerset::Powerset::increment_k" + ], + "found": [ + "itertools::powerset::Powerset::fold", + "itertools::powerset::Powerset::increment_k" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::k_smallest::k_smallest_general", + "truth": [ + "itertools::Itertools::k_smallest_by" + ], + "found": [ + "itertools::Itertools::k_smallest_by" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::grouping_map::new_map_for_grouping", + "truth": [ + "itertools::Itertools::into_grouping_map_by", + "itertools::Itertools::into_grouping_map_by_with_hasher" + ], + "found": [ + "itertools::Itertools::into_grouping_map_by", + "itertools::Itertools::into_grouping_map_by_with_hasher" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::left_or_insert_with", + "truth": [ + "itertools::either_or_both::EitherOrBoth::left_or_insert" + ], + "found": [ + "itertools::either_or_both::EitherOrBoth::left_or_insert" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + } + ], + "callers_common": [ + { + "symbol": "itertools::Itertools::next_array", + "truth": [ + "itertools::Itertools::collect_array", + "itertools::array_impl::ArrayWindows::next" + ], + "found": [ + "itertools::Itertools::collect_array" + ], + "maybe": [], + "import_files": [], + "recall": 0.5, + "precision": 1.0, + "recall_with_maybe": 0.5 + }, + { + "symbol": "itertools::adaptors::PutBack::put_back", + "truth": [ + "itertools::adaptors::PutBack::with_value", + "itertools::merge_join::MergeBy::fold", + "itertools::merge_join::MergeBy::next", + "itertools::merge_join::MergeBy::nth", + "itertools::peeking_take_while::PutBack::peeking_next" + ], + "found": [ + "itertools::adaptors::PutBack::with_value", + "itertools::merge_join::MergeBy::fold", + "itertools::merge_join::MergeBy::next", + "itertools::merge_join::MergeBy::nth", + "itertools::peeking_take_while::PutBack::peeking_next" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::Itertools::sorted", + "truth": [ + "itertools::free::sorted" + ], + "found": [ + "itertools::free::sorted" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::Itertools::multi_cartesian_product", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::Itertools::minmax_by", + "truth": [ + "itertools::Itertools::position_minmax_by" + ], + "found": [], + "maybe": [ + "itertools::Itertools::position_minmax_by" + ], + "import_files": [], + "recall": 0.0, + "precision": null, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::peek_nth::PeekNth::peek_nth", + "truth": [ + "itertools::peek_nth::PeekNth::peek" + ], + "found": [ + "itertools::peek_nth::PeekNth::peek" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::Itertools::intersperse", + "truth": [ + "itertools::free::intersperse" + ], + "found": [ + "itertools::free::intersperse" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::Itertools::array_combinations_with_replacement", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::Itertools::intersperse_with", + "truth": [ + "itertools::free::intersperse_with" + ], + "found": [ + "itertools::free::intersperse_with" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::multipeek_impl::MultiPeek::peek", + "truth": [ + "itertools::multipeek_impl::MultiPeek::peeking_next" + ], + "found": [ + "itertools::multipeek_impl::MultiPeek::peeking_next" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::Itertools::cartesian_product", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::Itertools::multiunzip", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::Itertools::tuples", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::Itertools::all_equal", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::Itertools::sorted_unstable", + "truth": [ + "itertools::free::sorted_unstable" + ], + "found": [ + "itertools::free::sorted_unstable" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::Itertools::array_combinations", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::Itertools::permutations", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::Itertools::minmax", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::Itertools::tuple_windows", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::Itertools::kmerge", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::reduce", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::peek_nth::PeekNth::peek", + "truth": [ + "itertools::peek_nth::PeekNth::peeking_next" + ], + "found": [ + "itertools::peek_nth::PeekNth::peeking_next" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::grouping_map::GroupingMap::minmax_by", + "truth": [ + "itertools::grouping_map::GroupingMap::minmax", + "itertools::grouping_map::GroupingMap::minmax_by_key" + ], + "found": [ + "itertools::grouping_map::GroupingMap::minmax", + "itertools::grouping_map::GroupingMap::minmax_by_key" + ], + "maybe": [ + "itertools::Itertools::position_minmax_by" + ], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::Itertools::dedup", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::put_back_n_impl::PutBackN::put_back", + "truth": [ + "itertools::peeking_take_while::PutBackN::peeking_next" + ], + "found": [ + "itertools::peeking_take_while::PutBackN::peeking_next" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::grouping_map::GroupingMap::reduce", + "truth": [ + "itertools::grouping_map::GroupingMap::fold_first", + "itertools::grouping_map::GroupingMap::max_by", + "itertools::grouping_map::GroupingMap::min_by", + "itertools::grouping_map::GroupingMap::product", + "itertools::grouping_map::GroupingMap::sum" + ], + "found": [ + "itertools::grouping_map::GroupingMap::fold_first", + "itertools::grouping_map::GroupingMap::max_by", + "itertools::grouping_map::GroupingMap::min_by", + "itertools::grouping_map::GroupingMap::product", + "itertools::grouping_map::GroupingMap::sum" + ], + "maybe": [ + "itertools::concat_impl::concat", + "itertools::kmerge_impl::KMergeBy::size_hint" + ], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + } + ], + "callers_blind": [ + { + "symbol": "itertools::tuple_impl::Tuples::into_buffer", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::Itertools::k_smallest_relaxed_by_key", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::Itertools::max_set", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::Itertools::position_max_by", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::or_default", + "truth": [ + "itertools::either_or_both::EitherOrBoth::left_and_right" + ], + "found": [ + "itertools::Itertools::counts_with_hasher", + "itertools::either_or_both::EitherOrBoth::left_and_right", + "itertools::group_map::into_group_map_with_hasher" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 0.3333333333333333, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::Itertools::unique", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::peek_nth::PeekNth::peek_mut", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::both", + "truth": [ + "itertools::either_or_both::EitherOrBoth::is_both" + ], + "found": [ + "itertools::either_or_both::EitherOrBoth::is_both" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::Itertools::position_min_by", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::adaptors::checked_binomial", + "truth": [ + "itertools::adaptors::impl_tuple_combination", + "itertools::combinations::remaining_for", + "itertools::combinations_with_replacement::remaining_for", + "itertools::powerset::remaining_for" + ], + "found": [ + "itertools::adaptors::impl_tuple_combination", + "itertools::combinations::remaining_for", + "itertools::combinations_with_replacement::remaining_for", + "itertools::powerset::remaining_for" + ], + "maybe": [], + "import_files": [ + "src/combinations.rs", + "src/combinations_with_replacement.rs", + "src/lib.rs", + "src/powerset.rs" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::map_any", + "truth": [ + "itertools::either_or_both::EitherOrBoth::left_and_right" + ], + "found": [ + "itertools::either_or_both::EitherOrBoth::left_and_right" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::lazy_buffer::LazyBuffer::get_at", + "truth": [ + "itertools::combinations::Box::extract_item", + "itertools::combinations::Vec::extract_item", + "itertools::permutations::Permutations::next" + ], + "found": [ + "itertools::combinations::Box::extract_item", + "itertools::combinations::Vec::extract_item", + "itertools::permutations::Permutations::next" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::Itertools::strip_prefix_by", + "truth": [ + "itertools::Itertools::strip_prefix" + ], + "found": [ + "itertools::Itertools::strip_prefix" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::Itertools::k_largest_relaxed_by_key", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::Itertools::collect_vec", + "truth": [ + "itertools::Itertools::k_smallest" + ], + "found": [ + "itertools::Itertools::k_smallest" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::benches::fold_specialization::specialization::intersperse::internal_specialized", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::Itertools::tail", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::grouping_map::GroupingMap::fold_with", + "truth": [ + "itertools::grouping_map::GroupingMap::fold" + ], + "found": [ + "itertools::grouping_map::GroupingMap::fold" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::Itertools::chunk_by", + "truth": [ + "itertools::Itertools::group_by" + ], + "found": [ + "itertools::Itertools::group_by", + "itertools::examples::iris::main" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 0.5, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::Itertools::k_smallest_by_key", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::repeatn::repeat_n", + "truth": [], + "found": [], + "maybe": [], + "import_files": [ + "src/lib.rs" + ], + "recall": null, + "precision": null, + "recall_with_maybe": null + }, + { + "symbol": "itertools::next_array::ArrayBuilder::take", + "truth": [ + "itertools::next_array::next_array" + ], + "found": [ + "itertools::Itertools::k_smallest", + "itertools::Itertools::tail", + "itertools::adaptors::PutBack::all", + "itertools::adaptors::PutBack::fold", + "itertools::adaptors::PutBack::next", + "itertools::adaptors::PutBack::nth", + "itertools::adaptors::coalesce::CoalesceBy::next", + "itertools::exactly_one_err::ExactlyOneError::next", + "itertools::examples::iris::Iris::from_str", + "itertools::format::Format::clone", + "itertools::format::Format::format", + "itertools::format::FormatWith::clone", + "itertools::format::FormatWith::fmt", + "itertools::groupbylazy::Chunk::next", + "itertools::groupbylazy::Group::next", + "itertools::groupbylazy::GroupInner::group_key", + "itertools::groupbylazy::GroupInner::step_buffering", + "itertools::groupbylazy::GroupInner::step_current", + "itertools::intersperse::IntersperseWith::next", + "itertools::iter_index::Range::index", + "itertools::iter_index::RangeInclusive::index", + "itertools::iter_index::RangeTo::index", + "itertools::iter_index::RangeToInclusive::index", + "itertools::k_smallest::k_smallest_general", + "itertools::k_smallest::k_smallest_relaxed_general", + "itertools::lazy_buffer::LazyBuffer::prefill", + "itertools::next_array::next_array", + "itertools::peek_nth::PeekNth::peek_nth", + "itertools::peek_nth::PeekNth::peek_nth_mut", + "itertools::repeatn::RepeatN::next", + "itertools::tuple_impl::TupleBuffer::next", + "itertools::zip_longest::ZipLongest::rfold" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 0.03125, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::with_position::Position::is_last", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::Itertools::min_set", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::grouping_map::GroupingMap::max_by", + "truth": [ + "itertools::grouping_map::GroupingMap::max", + "itertools::grouping_map::GroupingMap::max_by_key" + ], + "found": [ + "itertools::Itertools::position_max", + "itertools::Itertools::position_max_by", + "itertools::grouping_map::GroupingMap::max", + "itertools::grouping_map::GroupingMap::max_by_key" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 0.5, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::groupbylazy::new_chunks", + "truth": [ + "itertools::Itertools::chunks" + ], + "found": [ + "itertools::Itertools::chunks" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::k_smallest::key_to_cmp", + "truth": [ + "itertools::Itertools::k_largest_by_key", + "itertools::Itertools::k_largest_relaxed_by_key", + "itertools::Itertools::k_smallest_by_key", + "itertools::Itertools::k_smallest_relaxed_by_key" + ], + "found": [ + "itertools::Itertools::k_largest_by_key", + "itertools::Itertools::k_largest_relaxed_by_key", + "itertools::Itertools::k_smallest_by_key", + "itertools::Itertools::k_smallest_relaxed_by_key" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::size_hint::mul_scalar", + "truth": [ + "itertools::adaptors::InterleaveShortest::size_hint" + ], + "found": [ + "itertools::adaptors::InterleaveShortest::size_hint" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::next_array::ArrayBuilder::push", + "truth": [ + "itertools::next_array::next_array" + ], + "found": [ + "itertools::next_array::next_array" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::Itertools::fold_ok", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::extrema_set::min_set_impl", + "truth": [ + "itertools::Itertools::min_set", + "itertools::Itertools::min_set_by", + "itertools::Itertools::min_set_by_key", + "itertools::extrema_set::max_set_impl" + ], + "found": [ + "itertools::Itertools::min_set", + "itertools::Itertools::min_set_by", + "itertools::Itertools::min_set_by_key", + "itertools::extrema_set::max_set_impl" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::has_right", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::minmax::MinMaxResult::into_option", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::Itertools::partition_map", + "truth": [ + "itertools::Itertools::partition_result" + ], + "found": [ + "itertools::Itertools::partition_result" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::heap::heapify", + "truth": [ + "itertools::k_smallest::k_smallest_general", + "itertools::kmerge_impl::kmerge_by" + ], + "found": [ + "itertools::k_smallest::k_smallest_general", + "itertools::kmerge_impl::kmerge_by" + ], + "maybe": [], + "import_files": [ + "src/k_smallest.rs", + "src/kmerge_impl.rs" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::Itertools::sorted_by_key", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::left_and_then", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::is_right", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::Itertools::strip_prefix", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::Itertools::try_len", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::Itertools::sorted_by", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::Itertools::dropping", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::grouping_map::GroupingMap::aggregate", + "truth": [ + "itertools::grouping_map::GroupingMap::fold_with", + "itertools::grouping_map::GroupingMap::minmax_by", + "itertools::grouping_map::GroupingMap::reduce" + ], + "found": [ + "itertools::grouping_map::GroupingMap::fold_with", + "itertools::grouping_map::GroupingMap::minmax_by", + "itertools::grouping_map::GroupingMap::reduce" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::free::enumerate", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::Itertools::k_smallest_relaxed", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::insert_right", + "truth": [ + "itertools::either_or_both::EitherOrBoth::right_or_insert_with" + ], + "found": [ + "itertools::either_or_both::EitherOrBoth::right_or_insert_with" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::grouping_map::GroupingMap::min_by_key", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::right_or_insert_with", + "truth": [ + "itertools::either_or_both::EitherOrBoth::right_or_insert" + ], + "found": [ + "itertools::either_or_both::EitherOrBoth::right_or_insert" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::grouping_map::GroupingMap::product", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::has_left", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::Itertools::k_smallest_by", + "truth": [ + "itertools::Itertools::k_largest_by", + "itertools::Itertools::k_smallest_by_key" + ], + "found": [ + "itertools::Itertools::k_largest_by", + "itertools::Itertools::k_smallest_by_key" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::as_ref", + "truth": [ + "itertools::either_or_both::EitherOrBoth::has_left", + "itertools::either_or_both::EitherOrBoth::has_right", + "itertools::either_or_both::EitherOrBoth::is_both" + ], + "found": [ + "itertools::either_or_both::EitherOrBoth::has_left", + "itertools::either_or_both::EitherOrBoth::has_right", + "itertools::either_or_both::EitherOrBoth::is_both" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::Itertools::duplicates", + "skipped": "compiler reported no uses" + }, + { + "symbol": "itertools::tuple_impl::TupleCollect::buffer_len", + "truth": [ + "itertools::tuple_impl::Tuples::size_hint" + ], + "found": [], + "maybe": [], + "import_files": [], + "recall": 0.0, + "precision": null, + "recall_with_maybe": 0.0 + }, + { + "symbol": "itertools::Itertools::k_largest_relaxed_by", + "truth": [ + "itertools::Itertools::k_largest_relaxed", + "itertools::Itertools::k_largest_relaxed_by_key" + ], + "found": [ + "itertools::Itertools::k_largest_relaxed", + "itertools::Itertools::k_largest_relaxed_by_key" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::minmax::minmax_impl", + "truth": [ + "itertools::Itertools::minmax", + "itertools::Itertools::minmax_by", + "itertools::Itertools::minmax_by_key", + "itertools::Itertools::position_minmax" + ], + "found": [ + "itertools::Itertools::minmax", + "itertools::Itertools::minmax_by", + "itertools::Itertools::minmax_by_key", + "itertools::Itertools::position_minmax" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "itertools::multipeek_impl::MultiPeek::reset_peek", + "skipped": "compiler reported no uses" + } + ], + "rename": [ + { + "symbol": "itertools::either_or_both::EitherOrBoth::or_default", + "ok": false, + "compiled": false, + "tests_ok": null, + "tests_failed": [], + "old_name_left": "", + "detail": "r_each(|item| *counts.entry(item).or_default_gnx() += 1);\n | ^^^^^^^^^^^^^^\n |\nhelp: there is a method `or_default` with a similar name\n |\n5008 - self.for_each(|item| *counts.entry(item).or_default_gnx() += 1);\n5008 + self.for_each(|item| *counts.entry(item).or_default() += 1);\n |\n\nFor more information about this error, try `rustc --explain E0599`.\nerror: could not compile `itertools` (lib) due to 2 previous errors\n" + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::both", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "src/adaptors/mod.rs:20:/// An iterator adaptor that alternates elements from two iterators until both\nsrc/adaptors/mod.rs:422: // Compute a * b_orig + b for both lower and upper bound\nsrc/diff.rs:22: /// The index of the first non-matching element along with both iterator's remaining eleme", + "detail": "" + }, + { + "symbol": "itertools::adaptors::checked_binomial", + "ok": false, + "compiled": false, + "tests_ok": null, + "tests_failed": [], + "old_name_left": "tests/quick.rs:965: itertools::checked_binomial(n, k).unwrap()\ntests/test_std.rs:1141: it::checked_binomial(n, k).unwrap()", + "detail": " itertools::assert_equal(empty, std::iter::once(Vec::::new()))\n | ++++++++++++++\n\nSome errors have detailed explanations: E0282, E0283, E0425.\nFor more information about an error, try `rustc --explain E0282`.\nerror: could not compile `itertools` (test \"test_std\") due to 15 previous errors\nwarning: build failed, waiting for other jobs to finish...\nerror: could not compile `itertools` (test \"quick\") due to 3 previous errors\n" + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::map_any", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "itertools::lazy_buffer::LazyBuffer::get_at", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "itertools::Itertools::strip_prefix_by", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "itertools::Itertools::collect_vec", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "benches/specializations.rs:279: let v = black_box((0..32).flat_map(|x| [x; 32]).collect_vec());\nbenches/specializations.rs:285: let v = black_box((0..32).flat_map(|x| [x; 32]).collect_vec());\nbenches/specializations.rs:291: let v = black_box((0..32).flat_map(|x| [x; ", + "detail": "" + }, + { + "symbol": "itertools::grouping_map::GroupingMap::fold_with", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "itertools::Itertools::chunk_by", + "ok": false, + "compiled": false, + "tests_ok": null, + "tests_failed": [], + "old_name_left": "tests/laziness.rs:83: chunk_by {\ntests/laziness.rs:85: let _ = Panicking.chunk_by(|x| *x);\ntests/laziness.rs:87: let _ = Panicking.chunk_by(|x| *x).into_iter();\ntests/test_std.rs:911:fn chunk_by() {", + "detail": "s struct\n...\n87 | let _ = Panicking.chunk_by(|x| *x).into_iter();\n | ^^^^^^^^\n |\nhelp: there is a method `chunk_by_gnx` with a similar name\n |\n87 | let _ = Panicking.chunk_by_gnx(|x| *x).into_iter();\n | ++++\n\nFor more information about this error, try `rustc --explain E0599`.\nerror: could not compile `itertools` (test \"laziness\") due to 2 previous errors\nwarning: build failed, waiting for other jobs to finish...\n" + }, + { + "symbol": "itertools::extrema_set::max_set_impl", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "itertools::Itertools::next_tuple", + "ok": false, + "compiled": false, + "tests_ok": null, + "tests_failed": [], + "old_name_left": "tests/tuples.rs:65:fn next_tuple() {\ntests/tuples.rs:70: assert_eq!(iter.next_tuple::<(_, _)>(), None);", + "detail": " --> tests/tuples.rs:70:21\n |\n70 | assert_eq!(iter.next_tuple::<(_, _)>(), None);\n | ^^^^^^^^^^\n |\nhelp: there is a method `next_tuple_gnx` with a similar name\n |\n70 | assert_eq!(iter.next_tuple_gnx::<(_, _)>(), None);\n | ++++\n\nFor more information about this error, try `rustc --explain E0599`.\nerror: could not compile `itertools` (test \"tuples\") due to 1 previous error\nwarning: build failed, waiting for other jobs to finish...\n" + }, + { + "symbol": "itertools::adaptors::PutBack::with_value", + "ok": false, + "compiled": false, + "tests_ok": null, + "tests_failed": [], + "old_name_left": "benches/specializations.rs:545: itertools::put_back(&v).with_value(black_box(&0))\ntests/laziness.rs:302: let _ = itertools::put_back(Panicking).with_value(15);", + "detail": "ith_value(15);\n | ^^^^^^^^^^\n |\nhelp: there is a method `with_value_gnx` with a similar name\n |\n302 | let _ = itertools::put_back(Panicking).with_value_gnx(15);\n | ++++\n\nFor more information about this error, try `rustc --explain E0599`.\nerror: could not compile `itertools` (test \"laziness\") due to 1 previous error\nwarning: build failed, waiting for other jobs to finish...\n" + }, + { + "symbol": "itertools::Itertools::position_max", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "itertools::extrema_set::min_set_impl", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::or_else", + "ok": false, + "compiled": false, + "tests_ok": null, + "tests_failed": [], + "old_name_left": "", + "detail": "m `Option` in the current scope\n --> src/put_back_n_impl.rs:56:24\n |\n56 | self.top.pop().or_else_gnx(|| self.iter.next())\n | ^^^^^^^^^^^\n |\nhelp: there is a method `or_else` with a similar name\n |\n56 - self.top.pop().or_else_gnx(|| self.iter.next())\n56 + self.top.pop().or_else(|| self.iter.next())\n |\n\nFor more information about this error, try `rustc --explain E0599`.\nerror: could not compile `itertools` (lib) due to 3 previous errors\n" + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::right_or_insert_with", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "itertools::Itertools::set_from", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "itertools::Itertools::position_min", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "itertools::Itertools::position_minmax", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "itertools::minmax::MinMaxResult::into_option", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "itertools::next_array::ArrayBuilder::take", + "ok": false, + "compiled": false, + "tests_ok": null, + "tests_failed": [], + "old_name_left": "benches/specializations.rs:304: let v = black_box((0..32).cycle().take(1024).collect_vec());\nbenches/specializations.rs:318: let v = black_box((0..32).cycle().take(1024).collect_vec());\nbenches/tree_reduce.rs:60: // in here are so expensive anyway that it'll stil", + "detail": "ect();\n | ^^^^^^^^\n |\nhelp: there is a method `take` with a similar name\n |\n3940 - let mut data: Vec<_> = iter.by_ref().take_gnx(n).collect();\n3940 + let mut data: Vec<_> = iter.by_ref().take(n).collect();\n |\n\nSome errors have detailed explanations: E0308, E0599.\nFor more information about an error, try `rustc --explain E0308`.\nerror: could not compile `itertools` (lib) due to 34 previous errors\n" + }, + { + "symbol": "itertools::grouping_map::GroupingMap::max_by", + "ok": false, + "compiled": false, + "tests_ok": null, + "tests_failed": [], + "old_name_left": "", + "detail": "urrent scope\n --> src/lib.rs:4653:14\n |\n4652 | / self.enumerate()\n4653 | | .max_by_gnx(|x, y| compare(&x.1, &y.1))\n | |_____________-^^^^^^^^^^\n |\nhelp: there is a method `max_by` with a similar name\n |\n4653 - .max_by_gnx(|x, y| compare(&x.1, &y.1))\n4653 + .max_by(|x, y| compare(&x.1, &y.1))\n |\n\nFor more information about this error, try `rustc --explain E0599`.\nerror: could not compile `itertools` (lib) due to 2 previous errors\n" + }, + { + "symbol": "itertools::groupbylazy::new_chunks", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "itertools::k_smallest::key_to_cmp", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "itertools::size_hint::mul_scalar", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "itertools::next_array::ArrayBuilder::push", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": ".github/workflows/coverage.yml:2: push:\nbenches/bench1.rs:538: chunks.push(fst.iter().cloned());\nbenches/tree_reduce.rs:22: stack.push(x);\nexamples/iris.rs:63: v.push(iris);\nsrc/extrema_set.rs:25: result.push(element);", + "detail": "" + }, + { + "symbol": "itertools::Itertools::fold_ok", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "itertools::Itertools::partition_map", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "itertools::heap::heapify", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "itertools::Itertools::fold1", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "benches/tree_reduce.rs:88: fold1,\nbenches/tree_reduce.rs:106: fold1,\nbenches/tree_reduce.rs:124: fold1,", + "detail": "" + }, + { + "symbol": "itertools::lazy_buffer::LazyBuffer::get_next", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "itertools::size_hint::add_scalar", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "itertools::Itertools::all_unique_with_hasher", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "itertools::partition", + "ok": false, + "compiled": false, + "tests_ok": null, + "tests_failed": [], + "old_name_left": "benches/bench1.rs:594: c.bench_function(\"vec iter mut partition\", move |b| {\nsrc/lib.rs:3961: /// partitions. Unlike [`Iterator::partition_gnx`], each partition may\ntests/test_core.rs:302: let i = it::partition(&mut data, |elt| *elt >= 3);\ntests/test_core.rs:306: let i = it::partition(&m", + "detail": "t_core.rs:306:17\n |\n306 | let i = it::partition(&mut data, |elt| *elt == 1);\n | ^^^^^^^^^ not found in `it`\n\nerror[E0425]: cannot find function `partition` in crate `it`\n --> tests/test_core.rs:311:17\n |\n311 | let i = it::partition(&mut data, |elt| *elt % 3 == 0);\n | ^^^^^^^^^ not found in `it`\n\nFor more information about this error, try `rustc --explain E0425`.\nerror: could not compile `itertools` (test \"test_core\") due to 3 previous errors\n" + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::as_ref", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "src/adaptors/mod.rs:416: .as_ref()\nsrc/adaptors/mod.rs:785: if let Some(z) = item.as_ref() {\nsrc/adaptors/mod.rs:921: .filter(|v| v.as_ref().map(&mut f).unwrap_or(true))\nsrc/adaptors/mod.rs:931: .filter(|v| v.as_ref().map(&mut f).unwrap_or(true))\nsrc/a", + "detail": "" + }, + { + "symbol": "itertools::grouping_map::GroupingMap::aggregate", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "benches/powerset.rs:4:// Keep aggregate generated elements the same, regardless of powerset length.", + "detail": "" + }, + { + "symbol": "itertools::Itertools::k_smallest_relaxed", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::insert_right", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "itertools::grouping_map::GroupingMap::product", + "ok": false, + "compiled": false, + "tests_ok": null, + "tests_failed": [], + "old_name_left": "Cargo.toml:13:keywords = [\"iterator\", \"data-structure\", \"zip\", \"product\"]\nLICENSE-APACHE:139: names, trademarks, service marks, or product names of the Licensor,\nbenches/bench1.rs:608: c.bench_function(\"cartesian product iterator\", move |b| {\nbenches/bench1.rs:624: c.bench_function(\"multi ca", + "detail": "elf.next().map(|first| once(first).chain(self).product_gnx())\n | ^^^^^^^^^^^\n |\nhelp: there is a method `product` with a similar name\n |\n3244 - self.next().map(|first| once(first).chain(self).product_gnx())\n3244 + self.next().map(|first| once(first).chain(self).product())\n |\n\nFor more information about this error, try `rustc --explain E0599`.\nerror: could not compile `itertools` (lib) due to 1 previous error\n" + }, + { + "symbol": "itertools::Itertools::k_smallest_by", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "itertools::Itertools::k_largest_relaxed_by", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "itertools::minmax::minmax_impl", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "itertools::heap::sift_down", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "itertools::combinations::Combinations::reset", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "src/adaptors/multi_product.rs:110: // reset the finished ones encountered.\nsrc/combinations.rs:187: // Increment index, and reset the ones to its right\nsrc/multipeek_impl.rs:49: /// When `.next()` is called, reset the peeking “cursor”.", + "detail": "" + }, + { + "symbol": "itertools::k_smallest::k_smallest_general", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "itertools::grouping_map::new_map_for_grouping", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::left_or_insert_with", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + } + ], + "mutants": { + "7": [ + "itertools::either_or_both::EitherOrBoth::or_default", + "itertools::either_or_both::EitherOrBoth::both", + "itertools::adaptors::checked_binomial", + "itertools::either_or_both::EitherOrBoth::map_any", + "itertools::lazy_buffer::LazyBuffer::get_at", + "itertools::Itertools::strip_prefix_by", + "itertools::Itertools::collect_vec", + "itertools::grouping_map::GroupingMap::fold_with", + "itertools::Itertools::chunk_by", + "itertools::extrema_set::max_set_impl", + "itertools::Itertools::next_tuple" + ], + "8": [ + "itertools::next_array::ArrayBuilder::take", + "itertools::grouping_map::GroupingMap::max_by", + "itertools::groupbylazy::new_chunks", + "itertools::k_smallest::key_to_cmp", + "itertools::size_hint::mul_scalar", + "itertools::next_array::ArrayBuilder::push", + "itertools::Itertools::fold_ok", + "itertools::extrema_set::min_set_impl", + "itertools::minmax::MinMaxResult::into_option" + ], + "9": [ + "itertools::grouping_map::GroupingMap::aggregate", + "itertools::Itertools::k_smallest_relaxed", + "itertools::either_or_both::EitherOrBoth::insert_right", + "itertools::either_or_both::EitherOrBoth::or_default", + "itertools::either_or_both::EitherOrBoth::right_or_insert_with", + "itertools::grouping_map::GroupingMap::product", + "itertools::k_smallest::key_to_cmp", + "itertools::Itertools::k_smallest_by", + "itertools::either_or_both::EitherOrBoth::as_ref", + "itertools::Itertools::k_largest_relaxed_by", + "itertools::minmax::minmax_impl", + "itertools::heap::sift_down" + ] + }, + "tests": [ + { + "symbol": "itertools::either_or_both::EitherOrBoth::or_default", + "skipped": "no test fails when it throws", + "predicted": 22 + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::both", + "skipped": "no test fails when it throws", + "predicted": 0 + }, + { + "symbol": "itertools::adaptors::checked_binomial", + "level": "name", + "truth": 15, + "predicted": 1, + "recall": 0.0, + "precision": 0.0, + "top_hits": 0, + "top_n": 1, + "top_precision": 0.0, + "top_best": 0.0, + "caught": 0.0, + "missed": [ + "array_combinations", + "array_combinations_with_replacement", + "binomial_avoids_intermediate_overflow", + "combinations", + "combinations_inexact_size_hints", + "combinations_range_count", + "combinations_with_replacement", + "combinations_with_replacement_range_count" + ], + "recall_graph_only": 0.0 + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::map_any", + "skipped": "no test fails when it throws", + "predicted": 0 + }, + { + "symbol": "itertools::lazy_buffer::LazyBuffer::get_at", + "level": "name", + "truth": 17, + "predicted": 0, + "recall": 0.0, + "precision": 0.0, + "top_hits": 0, + "top_n": 0, + "top_precision": 0.0, + "top_best": 0.0, + "caught": 0.0, + "missed": [ + "combinations", + "combinations_inexact_size_hints", + "combinations_no_collect", + "combinations_range_count", + "combinations_with_replacement", + "combinations_with_replacement_no_collect", + "combinations_with_replacement_range_count", + "combinations_zero" + ], + "recall_graph_only": 0.0 + }, + { + "symbol": "itertools::Itertools::strip_prefix_by", + "level": "name", + "truth": 4, + "predicted": 4, + "recall": 1.0, + "precision": 1.0, + "top_hits": 4, + "top_n": 4, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "itertools::Itertools::collect_vec", + "level": "name", + "truth": 18, + "predicted": 13, + "recall": 0.6666666666666666, + "precision": 0.9230769230769231, + "top_hits": 10, + "top_n": 10, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [ + "k_smallest_sort_i16", + "k_smallest_sort_i8", + "k_smallest_sort_u16", + "k_smallest_sort_u32", + "k_smallest_sort_u64", + "k_smallest_sort_u8" + ], + "recall_graph_only": 0.6666666666666666 + }, + { + "symbol": "itertools::grouping_map::GroupingMap::fold_with", + "level": "name", + "truth": 2, + "predicted": 1, + "recall": 0.5, + "precision": 1.0, + "top_hits": 1, + "top_n": 1, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [ + "correct_grouping_map_by_fold_modulo_key" + ], + "recall_graph_only": 0.5 + }, + { + "symbol": "itertools::Itertools::chunk_by", + "level": "name", + "truth": 8, + "predicted": 8, + "recall": 1.0, + "precision": 1.0, + "top_hits": 8, + "top_n": 8, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "itertools::extrema_set::max_set_impl", + "level": "name", + "truth": 4, + "predicted": 4, + "recall": 1.0, + "precision": 1.0, + "top_hits": 4, + "top_n": 4, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "itertools::Itertools::next_tuple", + "level": "name", + "truth": 3, + "predicted": 3, + "recall": 1.0, + "precision": 1.0, + "top_hits": 3, + "top_n": 3, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "itertools::next_array::ArrayBuilder::take", + "level": "name", + "truth": 9, + "predicted": 44, + "recall": 0.3333333333333333, + "precision": 0.06818181818181818, + "top_hits": 0, + "top_n": 10, + "top_precision": 0.0, + "top_best": 0.3, + "caught": 0.0, + "missed": [ + "array_windows", + "array_windows_equal_tuple_windows", + "equal_array_windows_0", + "equal_array_windows_1", + "equal_array_windows_2", + "equal_array_windows_3" + ], + "recall_graph_only": 0.3333333333333333 + }, + { + "symbol": "itertools::grouping_map::GroupingMap::max_by", + "level": "name", + "truth": 4, + "predicted": 9, + "recall": 1.0, + "precision": 0.4444444444444444, + "top_hits": 4, + "top_n": 9, + "top_precision": 0.4444444444444444, + "top_best": 0.4444444444444444, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "itertools::groupbylazy::new_chunks", + "level": "name", + "truth": 2, + "predicted": 7, + "recall": 1.0, + "precision": 0.2857142857142857, + "top_hits": 2, + "top_n": 7, + "top_precision": 0.2857142857142857, + "top_best": 0.2857142857142857, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "itertools::k_smallest::key_to_cmp", + "level": "name", + "truth": 2, + "predicted": 2, + "recall": 1.0, + "precision": 1.0, + "top_hits": 2, + "top_n": 2, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "itertools::size_hint::mul_scalar", + "level": "name", + "truth": 3, + "predicted": 1, + "recall": 0.0, + "precision": 0.0, + "top_hits": 0, + "top_n": 1, + "top_precision": 0.0, + "top_best": 0.0, + "caught": 0.0, + "missed": [ + "exact_interleave_shortest", + "interleave_shortest", + "size_interleave_shortest" + ], + "recall_graph_only": 0.0 + }, + { + "symbol": "itertools::next_array::ArrayBuilder::push", + "level": "name", + "truth": 8, + "predicted": 5, + "recall": 0.375, + "precision": 0.6, + "top_hits": 3, + "top_n": 5, + "top_precision": 0.6, + "top_best": 0.6, + "caught": 1.0, + "missed": [ + "array_windows", + "array_windows_equal_tuple_windows", + "equal_array_windows_1", + "equal_array_windows_2", + "equal_array_windows_3" + ], + "recall_graph_only": 0.375 + }, + { + "symbol": "itertools::Itertools::fold_ok", + "skipped": "no test fails when it throws", + "predicted": 0 + }, + { + "symbol": "itertools::extrema_set::min_set_impl", + "level": "name", + "truth": 7, + "predicted": 7, + "recall": 1.0, + "precision": 1.0, + "top_hits": 7, + "top_n": 7, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "itertools::minmax::MinMaxResult::into_option", + "level": "name", + "truth": 1, + "predicted": 1, + "recall": 1.0, + "precision": 1.0, + "top_hits": 1, + "top_n": 1, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "itertools::grouping_map::GroupingMap::aggregate", + "level": "name", + "truth": 16, + "predicted": 18, + "recall": 0.625, + "precision": 0.5555555555555556, + "top_hits": 6, + "top_n": 10, + "top_precision": 0.6, + "top_best": 1.0, + "caught": 1.0, + "missed": [ + "correct_grouping_map_by_fold_modulo_key", + "correct_grouping_map_by_min_max_minmax_order_modulo_key", + "correct_grouping_map_by_minmax_by_key_modulo_key", + "correct_grouping_map_by_minmax_by_modulo_key", + "correct_grouping_map_by_minmax_modulo_key", + "correct_grouping_map_by_reduce_modulo_key" + ], + "recall_graph_only": 0.625 + }, + { + "symbol": "itertools::Itertools::k_smallest_relaxed", + "level": "name", + "truth": 9, + "predicted": 1, + "recall": 0.1111111111111111, + "precision": 1.0, + "top_hits": 1, + "top_n": 1, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [ + "k_smallest_sort_i16", + "k_smallest_sort_i32", + "k_smallest_sort_i64", + "k_smallest_sort_i8", + "k_smallest_sort_u16", + "k_smallest_sort_u32", + "k_smallest_sort_u64", + "k_smallest_sort_u8" + ], + "recall_graph_only": 0.1111111111111111 + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::insert_right", + "skipped": "no test fails when it throws", + "predicted": 0 + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::right_or_insert_with", + "skipped": "no test fails when it throws", + "predicted": 0 + }, + { + "symbol": "itertools::grouping_map::GroupingMap::product", + "level": "name", + "truth": 1, + "predicted": 9, + "recall": 1.0, + "precision": 0.1111111111111111, + "top_hits": 1, + "top_n": 9, + "top_precision": 0.1111111111111111, + "top_best": 0.1111111111111111, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "itertools::Itertools::k_smallest_by", + "level": "name", + "truth": 9, + "predicted": 1, + "recall": 0.1111111111111111, + "precision": 1.0, + "top_hits": 1, + "top_n": 1, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [ + "k_smallest_by_sort_i16", + "k_smallest_by_sort_i32", + "k_smallest_by_sort_i64", + "k_smallest_by_sort_i8", + "k_smallest_by_sort_u16", + "k_smallest_by_sort_u32", + "k_smallest_by_sort_u64", + "k_smallest_by_sort_u8" + ], + "recall_graph_only": 0.1111111111111111 + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::as_ref", + "skipped": "no test fails when it throws", + "predicted": 0 + }, + { + "symbol": "itertools::Itertools::k_largest_relaxed_by", + "level": "name", + "truth": 1, + "predicted": 1, + "recall": 1.0, + "precision": 1.0, + "top_hits": 1, + "top_n": 1, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "itertools::minmax::minmax_impl", + "level": "name", + "truth": 5, + "predicted": 0, + "recall": 0.0, + "precision": 0.0, + "top_hits": 0, + "top_n": 0, + "top_precision": 0.0, + "top_best": 0.0, + "caught": 0.0, + "missed": [ + "correct_grouping_map_by_minmax_by_key_modulo_key", + "correct_grouping_map_by_minmax_by_modulo_key", + "correct_grouping_map_by_minmax_modulo_key", + "minmax", + "minmax_f64" + ], + "recall_graph_only": 0.0 + }, + { + "symbol": "itertools::heap::sift_down", + "level": "name", + "truth": 19, + "predicted": 5, + "recall": 0.2631578947368421, + "precision": 1.0, + "top_hits": 5, + "top_n": 5, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [ + "equal_kmerge", + "equal_kmerge_2", + "k_smallest_by_sort_i16", + "k_smallest_by_sort_i32", + "k_smallest_by_sort_i64", + "k_smallest_by_sort_i8", + "k_smallest_by_sort_u16", + "k_smallest_by_sort_u32" + ], + "recall_graph_only": 0.2631578947368421 + } + ], + "look": [ + { + "symbol": "itertools::either_or_both::EitherOrBoth::or_default", + "look_tokens": 434, + "file_tokens": 4456 + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::both", + "look_tokens": 126, + "file_tokens": 4456 + }, + { + "symbol": "itertools::adaptors::checked_binomial", + "look_tokens": 304, + "file_tokens": 8216 + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::map_any", + "look_tokens": 196, + "file_tokens": 4456 + }, + { + "symbol": "itertools::lazy_buffer::LazyBuffer::get_at", + "look_tokens": 122, + "file_tokens": 416 + }, + { + "symbol": "itertools::Itertools::strip_prefix_by", + "look_tokens": 514, + "file_tokens": 46216 + }, + { + "symbol": "itertools::Itertools::collect_vec", + "look_tokens": 344, + "file_tokens": 46216 + }, + { + "symbol": "itertools::grouping_map::GroupingMap::fold_with", + "look_tokens": 552, + "file_tokens": 5640 + }, + { + "symbol": "itertools::Itertools::chunk_by", + "look_tokens": 648, + "file_tokens": 46216 + }, + { + "symbol": "itertools::extrema_set::max_set_impl", + "look_tokens": 258, + "file_tokens": 373 + }, + { + "symbol": "itertools::Itertools::next_tuple", + "look_tokens": 297, + "file_tokens": 46216 + }, + { + "symbol": "itertools::adaptors::PutBack::with_value", + "look_tokens": 140, + "file_tokens": 8216 + }, + { + "symbol": "itertools::Itertools::position_max", + "look_tokens": 268, + "file_tokens": 46216 + }, + { + "symbol": "itertools::extrema_set::min_set_impl", + "look_tokens": 473, + "file_tokens": 373 + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::or_else", + "look_tokens": 393, + "file_tokens": 4456 + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::right_or_insert_with", + "look_tokens": 190, + "file_tokens": 4456 + }, + { + "symbol": "itertools::Itertools::set_from", + "look_tokens": 283, + "file_tokens": 46216 + }, + { + "symbol": "itertools::Itertools::position_min", + "look_tokens": 268, + "file_tokens": 46216 + }, + { + "symbol": "itertools::Itertools::position_minmax", + "look_tokens": 602, + "file_tokens": 46216 + }, + { + "symbol": "itertools::minmax::MinMaxResult::into_option", + "look_tokens": 338, + "file_tokens": 961 + }, + { + "symbol": "itertools::next_array::ArrayBuilder::take", + "look_tokens": 516, + "file_tokens": 2322 + }, + { + "symbol": "itertools::grouping_map::GroupingMap::max_by", + "look_tokens": 516, + "file_tokens": 5640 + }, + { + "symbol": "itertools::groupbylazy::new_chunks", + "look_tokens": 313, + "file_tokens": 4544 + }, + { + "symbol": "itertools::k_smallest::key_to_cmp", + "look_tokens": 178, + "file_tokens": 877 + }, + { + "symbol": "itertools::size_hint::mul_scalar", + "look_tokens": 160, + "file_tokens": 605 + }, + { + "symbol": "itertools::next_array::ArrayBuilder::push", + "look_tokens": 687, + "file_tokens": 2322 + }, + { + "symbol": "itertools::Itertools::fold_ok", + "look_tokens": 518, + "file_tokens": 46216 + }, + { + "symbol": "itertools::Itertools::partition_map", + "look_tokens": 374, + "file_tokens": 46216 + }, + { + "symbol": "itertools::heap::heapify", + "look_tokens": 249, + "file_tokens": 382 + }, + { + "symbol": "itertools::Itertools::fold1", + "look_tokens": 159, + "file_tokens": 46216 + }, + { + "symbol": "itertools::lazy_buffer::LazyBuffer::get_next", + "look_tokens": 206, + "file_tokens": 416 + }, + { + "symbol": "itertools::size_hint::add_scalar", + "look_tokens": 247, + "file_tokens": 605 + }, + { + "symbol": "itertools::Itertools::all_unique_with_hasher", + "look_tokens": 366, + "file_tokens": 46216 + }, + { + "symbol": "itertools::partition", + "look_tokens": 358, + "file_tokens": 46216 + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::as_ref", + "look_tokens": 161, + "file_tokens": 4456 + }, + { + "symbol": "itertools::grouping_map::GroupingMap::aggregate", + "look_tokens": 944, + "file_tokens": 5640 + }, + { + "symbol": "itertools::Itertools::k_smallest_relaxed", + "look_tokens": 491, + "file_tokens": 46216 + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::insert_right", + "look_tokens": 505, + "file_tokens": 4456 + }, + { + "symbol": "itertools::grouping_map::GroupingMap::product", + "look_tokens": 425, + "file_tokens": 5640 + }, + { + "symbol": "itertools::Itertools::k_smallest_by", + "look_tokens": 417, + "file_tokens": 46216 + }, + { + "symbol": "itertools::Itertools::k_largest_relaxed_by", + "look_tokens": 401, + "file_tokens": 46216 + }, + { + "symbol": "itertools::minmax::minmax_impl", + "look_tokens": 691, + "file_tokens": 961 + }, + { + "symbol": "itertools::heap::sift_down", + "look_tokens": 436, + "file_tokens": 382 + }, + { + "symbol": "itertools::combinations::Combinations::reset", + "look_tokens": 289, + "file_tokens": 2492 + }, + { + "symbol": "itertools::k_smallest::k_smallest_general", + "look_tokens": 702, + "file_tokens": 877 + }, + { + "symbol": "itertools::grouping_map::new_map_for_grouping", + "look_tokens": 372, + "file_tokens": 5640 + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::left_or_insert_with", + "look_tokens": 187, + "file_tokens": 4456 + } + ], + "seconds": 2734, + "summary": { + "callers_recall": 1.0, + "callers_precision": 0.932, + "callers_checked": 39, + "blind_recall": 0.962, + "blind_checked": 26, + "common_recall": 0.885, + "common_precision": 1.0, + "common_recall_with_maybe": 0.962, + "common_checked": 13, + "rename_ok": 0.787, + "rename_checked": 47, + "tests_recall": 0.608, + "tests_precision": 0.652, + "tests_top10_precision": 0.654, + "tests_top10_best": 0.684, + "tests_caught": 0.783, + "tests_checked": 23, + "look_vs_file": 0.195 + }, + "summary_seeds": { + "7": { + "callers_recall": 1.0, + "callers_precision": 0.931, + "callers_checked": 17, + "blind_recall": 1.0, + "blind_checked": 9, + "common_recall": 0.833, + "common_precision": 1.0, + "common_recall_with_maybe": 0.944, + "common_checked": 9, + "rename_ok": 0.7, + "rename_checked": 20, + "tests_recall": 0.646, + "tests_precision": 0.74, + "tests_top10_precision": 0.75, + "tests_top10_best": 0.75, + "tests_caught": 0.75, + "tests_checked": 8, + "look_vs_file": 0.156 + }, + "8": { + "callers_recall": 1.0, + "callers_precision": 0.902, + "callers_checked": 15, + "blind_recall": 1.0, + "blind_checked": 9, + "common_recall": 0.944, + "common_precision": 1.0, + "common_recall_with_maybe": 0.944, + "common_checked": 9, + "rename_ok": 0.75, + "rename_checked": 20, + "tests_recall": 0.714, + "tests_precision": 0.55, + "tests_top10_precision": 0.541, + "tests_top10_best": 0.579, + "tests_caught": 0.75, + "tests_checked": 8, + "look_vs_file": 0.259 + }, + "9": { + "callers_recall": 1.0, + "callers_precision": 0.961, + "callers_checked": 17, + "blind_recall": 0.9, + "blind_checked": 10, + "common_recall": 0.95, + "common_precision": 1.0, + "common_recall_with_maybe": 0.95, + "common_checked": 10, + "rename_ok": 0.8, + "rename_checked": 20, + "tests_recall": 0.514, + "tests_precision": 0.708, + "tests_top10_precision": 0.714, + "tests_top10_best": 0.764, + "tests_caught": 0.875, + "tests_checked": 8, + "look_vs_file": 0.249 + } + }, + "noise": { + "callers_recall": { + "mean": 1.0, + "functions": 39, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.03 + }, + "callers_precision": { + "mean": 0.932, + "functions": 39, + "boot_lo": 0.875, + "boot_hi": 0.983, + "boot_half": 0.054, + "seeds": [ + 0.931, + 0.902, + 0.961 + ], + "seed_sd": 0.029, + "threshold": 0.06 + }, + "blind_recall": { + "mean": 0.962, + "functions": 26, + "boot_lo": 0.885, + "boot_hi": 1.0, + "boot_half": 0.058, + "seeds": [ + 1.0, + 1.0, + 0.9 + ], + "seed_sd": 0.058, + "threshold": 0.06 + }, + "common_recall": { + "mean": 0.885, + "functions": 13, + "boot_lo": 0.731, + "boot_hi": 1.0, + "boot_half": 0.135, + "seeds": [ + 0.833, + 0.944, + 0.95 + ], + "seed_sd": 0.066, + "threshold": 0.14 + }, + "common_recall_with_maybe": { + "mean": 0.962, + "functions": 13, + "boot_lo": 0.885, + "boot_hi": 1.0, + "boot_half": 0.058, + "seeds": [ + 0.944, + 0.944, + 0.95 + ], + "seed_sd": 0.003, + "threshold": 0.08 + }, + "common_precision": { + "mean": 1.0, + "functions": 12, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.09 + }, + "rename_ok": { + "mean": 0.787, + "functions": 47, + "boot_lo": 0.681, + "boot_hi": 0.872, + "boot_half": 0.096, + "seeds": [ + 0.7, + 0.75, + 0.8 + ], + "seed_sd": 0.05, + "threshold": 0.1 + }, + "tests_recall": { + "mean": 0.608, + "functions": 23, + "boot_lo": 0.464, + "boot_hi": 0.749, + "boot_half": 0.143, + "seeds": [ + 0.646, + 0.714, + 0.514 + ], + "seed_sd": 0.102, + "threshold": 0.15 + }, + "tests_precision": { + "mean": 0.652, + "functions": 23, + "boot_lo": 0.504, + "boot_hi": 0.795, + "boot_half": 0.146, + "seeds": [ + 0.74, + 0.55, + 0.708 + ], + "seed_sd": 0.102, + "threshold": 0.15 + }, + "tests_top10_precision": { + "mean": 0.654, + "functions": 23, + "boot_lo": 0.504, + "boot_hi": 0.801, + "boot_half": 0.148, + "seeds": [ + 0.75, + 0.541, + 0.714 + ], + "seed_sd": 0.112, + "threshold": 0.15 + }, + "tests_top10_best": { + "mean": 0.684, + "functions": 23, + "boot_lo": 0.535, + "boot_hi": 0.827, + "boot_half": 0.146, + "seeds": [ + 0.75, + 0.579, + 0.764 + ], + "seed_sd": 0.103, + "threshold": 0.15 + }, + "tests_caught": { + "mean": 0.783, + "functions": 23, + "boot_lo": 0.609, + "boot_hi": 0.913, + "boot_half": 0.152, + "seeds": [ + 0.75, + 0.75, + 0.875 + ], + "seed_sd": 0.072, + "threshold": 0.16 + }, + "look_vs_file": { + "mean": 0.195, + "functions": 47, + "boot_lo": 0.125, + "boot_hi": 0.27, + "boot_half": 0.072, + "seeds": [ + 0.156, + 0.259, + 0.249 + ], + "seed_sd": 0.057, + "threshold": 0.08 + } + } + } +] \ No newline at end of file diff --git a/eval/results/heldout.lsp-rename.json b/eval/results/heldout.lsp-rename.json new file mode 100644 index 0000000..3c51418 --- /dev/null +++ b/eval/results/heldout.lsp-rename.json @@ -0,0 +1,330 @@ +[ + { + "repo": "pflag", + "symbol": "main::FlagSet::Output", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": false + }, + { + "repo": "pflag", + "symbol": "main::NewFlagSet", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "pflag", + "symbol": "main::FlagSet::FlagUsagesWrapped", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "pflag", + "symbol": "main::FlagSet::GetNormalizeFunc", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "pflag", + "symbol": "main::FlagSet::FlagUsages", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "pflag", + "symbol": "main::FlagSet::AddGoFlag", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "pflag", + "symbol": "main::PFlagFromGoFlag", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "pflag", + "symbol": "main::FlagSet::VarPF", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": false + }, + { + "repo": "pflag", + "symbol": "main::FlagSet::AddFlag", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "pflag", + "symbol": "main::UnquoteUsage", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "pflag", + "symbol": "main::ParseIPv4Mask", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "mux", + "symbol": "main::Router::NewRoute", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "mux", + "symbol": "main::Route::Handler", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "mux", + "symbol": "main::Route::GetMethods", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "mux", + "symbol": "main::Route::HandlerFunc", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "mux", + "symbol": "main::Route::GetHandlerWithMiddlewares", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "urfave-cli", + "symbol": "main::ValueSourceChain::LookupWithSource", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "urfave-cli", + "symbol": "main::Command::VisibleFlagCategories", + "server_ok": false, + "server_stage": "tests", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "urfave-cli", + "symbol": "main::Command::VisibleFlags", + "server_ok": false, + "server_stage": "tests", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "urfave-cli", + "symbol": "main::Exit", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "urfave-cli", + "symbol": "main::ShowVersion", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "urfave-cli", + "symbol": "main::ValueSourceChain::EnvKeys", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "urfave-cli", + "symbol": "main::Command::Walk", + "server_ok": false, + "server_stage": "build", + "server_detail": "# github.com/urfave/cli/v3_test\n# [github.com/urfave/cli/v3_test]\n./examples_test.go:445:1: ExampleCommand_Walk_visibleTree refers to unknown field or method: Command.Walk\nFAIL\tgithub.com/urfave/cli/v3 [build failed]\n? \tgithub.com/urfave/cli/v3/examples/example-cli\t[no test files]\n? \tgithub.com/", + "gitnext_ok": false + }, + { + "repo": "urfave-cli", + "symbol": "main::Command::Path", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "urfave-cli", + "symbol": "main::File", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "urfave-cli", + "symbol": "main::Command::FullName", + "server_ok": false, + "server_stage": "tests", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "urfave-cli", + "symbol": "main::Command::Bool", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": false + }, + { + "repo": "urfave-cli", + "symbol": "main::EnvVar", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "urfave-cli", + "symbol": "main::Command::LocalFlagNames", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "urfave-cli", + "symbol": "main::Command::VisiblePersistentFlags", + "server_ok": false, + "server_stage": "tests", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "urfave-cli", + "symbol": "main::HandleExitCoder", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "urfave-cli", + "symbol": "main::EnvVars", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "urfave-cli", + "symbol": "main::DefaultCompleteWithFlags", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": false + }, + { + "repo": "urfave-cli", + "symbol": "main::Command::Lineage", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "urfave-cli", + "symbol": "main::Command::Root", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "logrus", + "symbol": "main::Logger::LogFn", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": false + }, + { + "repo": "logrus", + "symbol": "main::mutexWrap::Lock", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": false + }, + { + "repo": "logrus", + "symbol": "main::mutexWrap::Unlock", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": false + }, + { + "repo": "logrus", + "symbol": "main::Entry::Bytes", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": false + }, + { + "repo": "logrus", + "symbol": "main::mutexWrap::Disable", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "logrus", + "symbol": "main::NewEntry", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + } +] \ No newline at end of file diff --git a/eval/results/heldout.lsp-rename.md b/eval/results/heldout.lsp-rename.md new file mode 100644 index 0000000..fa878c5 --- /dev/null +++ b/eval/results/heldout.lsp-rename.md @@ -0,0 +1,21 @@ +# The rename of a language server on the functions of the run `heldout` + +`gopls rename` at the name in the definition, then the same check as for the tool: the project builds and the tests that passed before still pass. ± is half of a 90% bootstrap interval over the functions. + +| | renames | gopls: builds and tests pass | gitnext: builds and tests pass | both | only gopls | only gitnext | neither | +|---|---|---|---|---|---|---|---| +| all | 41 | 88% ±9 | 78% ±10 | 28 | 8 | 4 | 1 | +| pflag | 11 | 100% ±0 | 82% ±18 | 9 | 2 | 0 | 0 | +| mux | 5 | 100% ±0 | 100% ±0 | 5 | 0 | 0 | 0 | +| urfave-cli | 19 | 74% ±16 | 84% ±13 | 12 | 2 | 4 | 1 | +| logrus | 6 | 100% ±0 | 33% ±33 | 2 | 4 | 0 | 0 | + +## Where the server's rename did not pass + +- `urfave-cli` `main::Command::VisibleFlagCategories` — tests: +- `urfave-cli` `main::Command::VisibleFlags` — tests: +- `urfave-cli` `main::Command::Walk` — build: # github.com/urfave/cli/v3_test +# [github.com/urfave/cli/v3_test] +./examples_test.go:445:1: ExampleCommand_Walk_visibleTree refers to unknown field or method: C +- `urfave-cli` `main::Command::FullName` — tests: +- `urfave-cli` `main::Command::VisiblePersistentFlags` — tests: diff --git a/eval/results/heldout.lsp.json b/eval/results/heldout.lsp.json new file mode 100644 index 0000000..07be066 --- /dev/null +++ b/eval/results/heldout.lsp.json @@ -0,0 +1,2229 @@ +{ + "rows": { + "callers": [ + { + "symbol": "main::FlagSet::Output", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::NewFlagSet", + "lang": "go", + "server_recall": null, + "server_precision": null, + "recall": null, + "precision": 0.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::FlagUsagesWrapped", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::GetNormalizeFunc", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::FlagUsages", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::AddGoFlag", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::PFlagFromGoFlag", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::VarPF", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 0.8, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::AddFlag", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::UnquoteUsage", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::ParseIPv4Mask", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::Router::NewRoute", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "mux" + }, + { + "symbol": "main::Route::Handler", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "mux" + }, + { + "symbol": "main::Route::GetMethods", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "mux" + }, + { + "symbol": "main::Route::HandlerFunc", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "mux" + }, + { + "symbol": "main::Route::GetHandlerWithMiddlewares", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "mux" + }, + { + "symbol": "either::Either::as_pin_mut", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "either" + }, + { + "symbol": "either::Either::is_left", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "either" + }, + { + "symbol": "strsim::jaro", + "lang": "rust", + "server_recall": null, + "server_precision": null, + "recall": null, + "precision": null, + "repo": "strsim" + }, + { + "symbol": "strsim::damerau_levenshtein", + "lang": "rust", + "server_recall": null, + "server_precision": null, + "recall": null, + "precision": null, + "repo": "strsim" + }, + { + "symbol": "strsim::sorensen_dice", + "lang": "rust", + "server_recall": null, + "server_precision": null, + "recall": null, + "precision": null, + "repo": "strsim" + }, + { + "symbol": "strsim::levenshtein", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "strsim" + }, + { + "symbol": "strsim::osa_distance", + "lang": "rust", + "server_recall": null, + "server_precision": null, + "recall": null, + "precision": null, + "repo": "strsim" + }, + { + "symbol": "strsim::generic_jaro_winkler", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "strsim" + }, + { + "symbol": "strsim::normalized_damerau_levenshtein", + "lang": "rust", + "server_recall": null, + "server_precision": null, + "recall": null, + "precision": null, + "repo": "strsim" + }, + { + "symbol": "strsim::normalized_levenshtein", + "lang": "rust", + "server_recall": null, + "server_precision": null, + "recall": null, + "precision": null, + "repo": "strsim" + }, + { + "symbol": "strsim::hamming", + "lang": "rust", + "server_recall": null, + "server_precision": null, + "recall": null, + "precision": null, + "repo": "strsim" + }, + { + "symbol": "strsim::generic_hamming", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "strsim" + }, + { + "symbol": "strsim::generic_levenshtein", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "strsim" + }, + { + "symbol": "strsim::generic_jaro", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "strsim" + }, + { + "symbol": "strsim::jaro_winkler", + "lang": "rust", + "server_recall": null, + "server_precision": null, + "recall": null, + "precision": null, + "repo": "strsim" + }, + { + "symbol": "src::encoding::encodeHost", + "lang": "typescript", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::query::stringifyQuery", + "lang": "typescript", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::parse::parsePath", + "lang": "typescript", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::utils::isNonEmptyURL", + "lang": "typescript", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::query::encodeQueryItem", + "lang": "typescript", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::utils::withProtocol", + "lang": "typescript", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::encoding::encode", + "lang": "typescript", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::encoding::encodeHash", + "lang": "typescript", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::encoding::decodeQueryKey", + "lang": "typescript", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::parse::parseURL", + "lang": "typescript", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::utils::withLeadingSlash", + "lang": "typescript", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::query::parseQuery", + "lang": "typescript", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::utils::isEmptyURL", + "lang": "typescript", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::utils::hasLeadingSlash", + "lang": "typescript", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::punycode::toASCII", + "lang": "typescript", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::utils::withoutTrailingSlash", + "lang": "typescript", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::utils::withTrailingSlash", + "lang": "typescript", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::parse::parseHost", + "lang": "typescript", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::encoding::decodePath", + "lang": "typescript", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::utils::joinURL", + "lang": "typescript", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::encoding::decode", + "lang": "typescript", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::encoding::decodeQueryValue", + "lang": "typescript", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::encoding::encodePath", + "lang": "typescript", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::utils::hasTrailingSlash", + "lang": "typescript", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::encoding::encodeQueryKey", + "lang": "typescript", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::utils::withoutLeadingSlash", + "lang": "typescript", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::parse::parseAuth", + "lang": "typescript", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::parse::stringifyParsedURL", + "lang": "typescript", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "ufo" + }, + { + "symbol": "src::utils::normalizeAliases", + "lang": "typescript", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pathe" + }, + { + "symbol": "src::_path::normalize", + "lang": "typescript", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pathe" + }, + { + "symbol": "src::_path::isAbsolute", + "lang": "typescript", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pathe" + }, + { + "symbol": "src::_path::join", + "lang": "typescript", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pathe" + }, + { + "symbol": "src::_path::normalizeString", + "lang": "typescript", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pathe" + }, + { + "symbol": "src::_path::extname", + "lang": "typescript", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pathe" + }, + { + "symbol": "src::_internal::normalizeWindowsPath", + "lang": "typescript", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pathe" + }, + { + "symbol": "src::_glob::matchGlob", + "lang": "typescript", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pathe" + }, + { + "symbol": "src::_path::basename", + "lang": "typescript", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pathe" + }, + { + "symbol": "src::_path::resolve", + "lang": "typescript", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pathe" + }, + { + "symbol": "src::_path::dirname", + "lang": "typescript", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pathe" + }, + { + "symbol": "main::ValueSourceChain::LookupWithSource", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "urfave-cli" + }, + { + "symbol": "main::Command::VisibleFlags", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 0.25, + "repo": "urfave-cli" + }, + { + "symbol": "main::Exit", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "urfave-cli" + }, + { + "symbol": "main::ShowVersion", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "urfave-cli" + }, + { + "symbol": "main::ValueSourceChain::EnvKeys", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "urfave-cli" + }, + { + "symbol": "main::Command::Walk", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "urfave-cli" + }, + { + "symbol": "main::Command::Path", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "urfave-cli" + }, + { + "symbol": "main::File", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "urfave-cli" + }, + { + "symbol": "main::Command::FullName", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 0.16666666666666666, + "repo": "urfave-cli" + }, + { + "symbol": "main::Command::Bool", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 0.75, + "precision": 1.0, + "repo": "urfave-cli" + }, + { + "symbol": "main::EnvVar", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "urfave-cli" + }, + { + "symbol": "main::Command::LocalFlagNames", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "urfave-cli" + }, + { + "symbol": "main::Command::VisiblePersistentFlags", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 0.6666666666666666, + "repo": "urfave-cli" + }, + { + "symbol": "main::HandleExitCoder", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "urfave-cli" + }, + { + "symbol": "main::EnvVars", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "urfave-cli" + }, + { + "symbol": "main::DefaultCompleteWithFlags", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 0.5, + "precision": 1.0, + "repo": "urfave-cli" + }, + { + "symbol": "main::Command::Lineage", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "urfave-cli" + }, + { + "symbol": "main::Command::Root", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "urfave-cli" + }, + { + "symbol": "main::Logger::LogFn", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "logrus" + }, + { + "symbol": "main::mutexWrap::Lock", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "logrus" + }, + { + "symbol": "main::mutexWrap::Unlock", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "logrus" + }, + { + "symbol": "main::Entry::Bytes", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 0.5, + "repo": "logrus" + }, + { + "symbol": "main::mutexWrap::Disable", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "logrus" + }, + { + "symbol": "main::NewEntry", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "logrus" + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::or_default", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 0.3333333333333333, + "repo": "itertools" + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::both", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::adaptors::checked_binomial", + "lang": "rust", + "server_recall": 0.75, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::map_any", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::lazy_buffer::LazyBuffer::get_at", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::Itertools::strip_prefix_by", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::Itertools::collect_vec", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::grouping_map::GroupingMap::fold_with", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::Itertools::chunk_by", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 0.5, + "recall": 1.0, + "precision": 0.5, + "repo": "itertools" + }, + { + "symbol": "itertools::extrema_set::max_set_impl", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::Itertools::next_tuple", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::adaptors::PutBack::with_value", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::Itertools::position_max", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::extrema_set::min_set_impl", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::right_or_insert_with", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::Itertools::position_min", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::Itertools::position_minmax", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::next_array::ArrayBuilder::take", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 0.03125, + "repo": "itertools" + }, + { + "symbol": "itertools::grouping_map::GroupingMap::max_by", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 0.5, + "repo": "itertools" + }, + { + "symbol": "itertools::groupbylazy::new_chunks", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::k_smallest::key_to_cmp", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::size_hint::mul_scalar", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::next_array::ArrayBuilder::push", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::Itertools::partition_map", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::heap::heapify", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::lazy_buffer::LazyBuffer::get_next", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::size_hint::add_scalar", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::Itertools::all_unique_with_hasher", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::as_ref", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::grouping_map::GroupingMap::aggregate", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::insert_right", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::Itertools::k_smallest_by", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::Itertools::k_largest_relaxed_by", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::minmax::minmax_impl", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::heap::sift_down", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::combinations::Combinations::reset", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::k_smallest::k_smallest_general", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::grouping_map::new_map_for_grouping", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::either_or_both::EitherOrBoth::left_or_insert_with", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + } + ], + "callers_common": [ + { + "symbol": "main::FlagSet::StringToIntVarP", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::BoolVarP", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::StringArrayVarP", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::IPNetSliceVarP", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::StringSliceVarP", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::Uint16VarP", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::Lookup", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 0.9, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::Float32VarP", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::StringToInt64VarP", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::Uint64VarP", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::Uint32VarP", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::DurationSliceVarP", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::Float64SliceVarP", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::Parse", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 0.0, + "precision": 0.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::BoolP", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 0.5, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::IntVarP", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::IPNetVarP", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::IPVarP", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::BytesBase64VarP", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::StringToStringVarP", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::Int64VarP", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::DurationVarP", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::Int16VarP", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::StringVarP", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::UintSliceVarP", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::TimeVarP", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 0.6666666666666666, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::Int8VarP", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::VarP", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 0.5, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::Float32SliceVarP", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::TimeP", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 0.3333333333333333, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::BoolSliceVarP", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::UintVarP", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::IPSliceVarP", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::FlagSet::PrintDefaults", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 0.5, + "precision": 1.0, + "repo": "pflag" + }, + { + "symbol": "main::Route::Path", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "mux" + }, + { + "symbol": "main::Route::Schemes", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "mux" + }, + { + "symbol": "main::Route::Host", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "mux" + }, + { + "symbol": "main::Route::Headers", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "mux" + }, + { + "symbol": "main::Route::BuildVarsFunc", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "mux" + }, + { + "symbol": "main::Route::Queries", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "mux" + }, + { + "symbol": "main::Route::PathPrefix", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "mux" + }, + { + "symbol": "main::Route::Name", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "mux" + }, + { + "symbol": "main::Route::MatcherFunc", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "mux" + }, + { + "symbol": "main::Route::Methods", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "mux" + }, + { + "symbol": "byteorder::io::ReadBytesExt::read_f64_into", + "lang": "rust", + "server_recall": 0.3333333333333333, + "server_precision": 1.0, + "recall": 0.3333333333333333, + "precision": 1.0, + "repo": "byteorder" + }, + { + "symbol": "byteorder::ByteOrder::read_f32_into", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "byteorder" + }, + { + "symbol": "byteorder::ByteOrder::read_int", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 0.6666666666666666, + "precision": 1.0, + "repo": "byteorder" + }, + { + "symbol": "byteorder::ByteOrder::write_int", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 0.6666666666666666, + "precision": 1.0, + "repo": "byteorder" + }, + { + "symbol": "byteorder::ByteOrder::read_f64_into", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "byteorder" + }, + { + "symbol": "main::commandCategory::Name", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 0.0, + "precision": null, + "repo": "urfave-cli" + }, + { + "symbol": "main::Command::HasName", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 0.0, + "precision": null, + "repo": "urfave-cli" + }, + { + "symbol": "main::extFlag::IsBoolFlag", + "lang": "go", + "server_recall": 1.0, + "server_precision": 0.25, + "recall": 1.0, + "precision": 1.0, + "repo": "urfave-cli" + }, + { + "symbol": "main::MapBase::Value", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "urfave-cli" + }, + { + "symbol": "main::FlagBase::PreParse", + "lang": "go", + "server_recall": 1.0, + "server_precision": 0.5, + "recall": 1.0, + "precision": 1.0, + "repo": "urfave-cli" + }, + { + "symbol": "main::Entry::Logln", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "logrus" + }, + { + "symbol": "main::Entry::WriterLevel", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "logrus" + }, + { + "symbol": "main::Logger::Panicln", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 0.0, + "precision": null, + "repo": "logrus" + }, + { + "symbol": "main::Logger::Infoln", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 0.0, + "precision": null, + "repo": "logrus" + }, + { + "symbol": "main::Logger::Errorln", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 0.0, + "precision": null, + "repo": "logrus" + }, + { + "symbol": "main::Entry::WithError", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "logrus" + }, + { + "symbol": "main::Entry::Errorf", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "logrus" + }, + { + "symbol": "main::Entry::String", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "logrus" + }, + { + "symbol": "main::Logger::Info", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 0.0, + "precision": null, + "repo": "logrus" + }, + { + "symbol": "main::Logger::FatalFn", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "logrus" + }, + { + "symbol": "main::Entry::Panicf", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "logrus" + }, + { + "symbol": "main::Logger::Logf", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "logrus" + }, + { + "symbol": "main::Logger::WithField", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 0.0, + "precision": null, + "repo": "logrus" + }, + { + "symbol": "main::Logger::Println", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 0.0, + "precision": null, + "repo": "logrus" + }, + { + "symbol": "main::Logger::WithContext", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 0.0, + "precision": null, + "repo": "logrus" + }, + { + "symbol": "main::Logger::Debugf", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 0.0, + "precision": null, + "repo": "logrus" + }, + { + "symbol": "main::Logger::PrintFn", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "logrus" + }, + { + "symbol": "main::Entry::Debug", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 0.0, + "precision": null, + "repo": "logrus" + }, + { + "symbol": "main::Logger::Error", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 0.0, + "precision": null, + "repo": "logrus" + }, + { + "symbol": "main::Entry::Warnln", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "logrus" + }, + { + "symbol": "main::Logger::Fatalf", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 0.0, + "precision": null, + "repo": "logrus" + }, + { + "symbol": "main::Logger::DebugFn", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "logrus" + }, + { + "symbol": "main::Logger::Warnf", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 0.5, + "precision": 1.0, + "repo": "logrus" + }, + { + "symbol": "main::Logger::Printf", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 0.0, + "precision": null, + "repo": "logrus" + }, + { + "symbol": "main::Logger::IsLevelEnabled", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "logrus" + }, + { + "symbol": "main::Logger::WithFields", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 0.0, + "precision": null, + "repo": "logrus" + }, + { + "symbol": "main::Logger::Trace", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 0.0, + "precision": null, + "repo": "logrus" + }, + { + "symbol": "main::Logger::Traceln", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 0.0, + "precision": null, + "repo": "logrus" + }, + { + "symbol": "main::Logger::SetOutput", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "logrus" + }, + { + "symbol": "main::Logger::GetLevel", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "logrus" + }, + { + "symbol": "main::Entry::Printf", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "logrus" + }, + { + "symbol": "main::Logger::WriterLevel", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "logrus" + }, + { + "symbol": "main::Logger::Panic", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 0.0, + "precision": null, + "repo": "logrus" + }, + { + "symbol": "main::Logger::Infof", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 0.0, + "precision": null, + "repo": "logrus" + }, + { + "symbol": "main::Logger::Warnln", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 0.5, + "precision": 1.0, + "repo": "logrus" + }, + { + "symbol": "main::Entry::Info", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 0.5, + "precision": 1.0, + "repo": "logrus" + }, + { + "symbol": "main::Logger::PanicFn", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "logrus" + }, + { + "symbol": "main::Logger::Fatal", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 0.0, + "precision": null, + "repo": "logrus" + }, + { + "symbol": "main::Level::String", + "lang": "go", + "server_recall": 1.0, + "server_precision": 0.8, + "recall": 0.5, + "precision": 1.0, + "repo": "logrus" + }, + { + "symbol": "hooks::slog::SlogLevel::Level", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 0.0, + "precision": null, + "repo": "logrus" + }, + { + "symbol": "main::Entry::WithFields", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "logrus" + }, + { + "symbol": "itertools::Itertools::next_array", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 0.5, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::adaptors::PutBack::put_back", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::Itertools::sorted", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::Itertools::minmax_by", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 0.0, + "precision": null, + "repo": "itertools" + }, + { + "symbol": "itertools::peek_nth::PeekNth::peek_nth", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::Itertools::intersperse", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::Itertools::intersperse_with", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::multipeek_impl::MultiPeek::peek", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::Itertools::sorted_unstable", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::peek_nth::PeekNth::peek", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::grouping_map::GroupingMap::minmax_by", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::put_back_n_impl::PutBackN::put_back", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + }, + { + "symbol": "itertools::grouping_map::GroupingMap::reduce", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "itertools" + } + ] + }, + "timing": { + "pflag": { + "server": "gopls", + "ready_seconds": 0.0, + "seconds_per_function": 0.4 + }, + "mux": { + "server": "gopls", + "ready_seconds": 0.0, + "seconds_per_function": 0.35 + }, + "byteorder": { + "server": "rust-analyzer", + "ready_seconds": 10.8, + "seconds_per_function": 0.15 + }, + "either": { + "server": "rust-analyzer", + "ready_seconds": 3.8, + "seconds_per_function": 0.33 + }, + "strsim": { + "server": "rust-analyzer", + "ready_seconds": 3.6, + "seconds_per_function": 0.06 + }, + "ufo": { + "server": "tsserver", + "ready_seconds": 0.0, + "seconds_per_function": 0.06 + }, + "pathe": { + "server": "tsserver", + "ready_seconds": 0.0, + "seconds_per_function": 0.22 + }, + "urfave-cli": { + "server": "gopls", + "ready_seconds": 0.0, + "seconds_per_function": 0.59 + }, + "logrus": { + "server": "gopls", + "ready_seconds": 0.0, + "seconds_per_function": 0.35 + }, + "itertools": { + "server": "rust-analyzer", + "ready_seconds": 6.9, + "seconds_per_function": 0.1 + } + } +} \ No newline at end of file diff --git a/eval/results/heldout.lsp.md b/eval/results/heldout.lsp.md new file mode 100644 index 0000000..d1a97ad --- /dev/null +++ b/eval/results/heldout.lsp.md @@ -0,0 +1,35 @@ +# Language servers on the functions of the run `heldout` + +References of the definition, asked from gopls (Go), rust-analyzer (Rust) and tsserver (TypeScript); every reference is put into the function around it. The truth is the run's own (the compiler's uses). ± is half of a 90% bootstrap interval over the functions. + +## Names that occur once + +| | functions | server: recall | server: precision | gitnext: recall | gitnext: precision | search: recall | search: precision | +|---|---|---|---|---|---|---|---| +| all three | 124 | 100% ±0 | 100% ±1 | 99% ±1 | 95% ±3 | 100% ±0 | 84% ±4 | +| go | 39 | 100% ±0 | 100% ±0 | 98% ±2 | 91% ±6 | 100% ±0 | 81% ±8 | +| rust | 46 | 99% ±1 | 99% ±2 | 100% ±0 | 94% ±5 | 100% ±0 | 76% ±7 | +| typescript | 39 | 100% ±0 | 100% ±0 | 100% ±0 | 100% ±0 | 100% ±0 | 96% ±4 | + +## Methods that share a name + +| | functions | server: recall | server: precision | gitnext: recall | gitnext: precision | search: recall | search: precision | +|---|---|---|---|---|---|---|---| +| all three | 108 | 99% ±1 | 99% ±1 | 73% ±7 | 99% ±2 | 100% ±0 | 51% ±5 | +| go | 90 | 100% ±0 | 98% ±2 | 70% ±7 | 99% ±2 | 100% ±0 | 53% ±5 | +| rust | 18 | 96% ±6 | 100% ±0 | 84% ±11 | 100% ±0 | 100% ±0 | 40% ±9 | + +## Time + +| project | server | ready after | per function | +|---|---|---|---| +| pflag | gopls | 0.0 s | 0.4 s | +| mux | gopls | 0.0 s | 0.35 s | +| byteorder | rust-analyzer | 10.8 s | 0.15 s | +| either | rust-analyzer | 3.8 s | 0.33 s | +| strsim | rust-analyzer | 3.6 s | 0.06 s | +| ufo | tsserver | 0.0 s | 0.06 s | +| pathe | tsserver | 0.0 s | 0.22 s | +| urfave-cli | gopls | 0.0 s | 0.59 s | +| logrus | gopls | 0.0 s | 0.35 s | +| itertools | rust-analyzer | 6.9 s | 0.1 s | diff --git a/eval/results/heldout.md b/eval/results/heldout.md new file mode 100644 index 0000000..9e079ca --- /dev/null +++ b/eval/results/heldout.md @@ -0,0 +1,53 @@ +| repo | lang | symbols | index s | callers recall | callers precision | callers recall, picked blind | shared names: recall (+maybe) | shared names: precision | rename ok | tests recall | tests precision | top-10 fail (best possible) | caught by top-10 | look / file | +|---|---|---:|---:|---:|---:|---:|---:|---:|---:|---:|---:|---:|---:|---:| +| pflag | go | 756 | 0.1 | 98% ±10 (10) | 100% ±10 | 98% ±13 (8) | 89% ±7 (89% ±7) (34) | 97% ±5 | 82% ±19 (11) | 100% ±15 (7) | 64% ±23 | 64% ±22 (80% ±20) | 100% ±15 | 10% ±6 | +| mux | go | 128 | 0.1 | 100% ±20 (5) | 100% ±20 | 100% ±34 (3) | 100% ±10 (100% ±10) (10) | 100% ±10 | 100% ±20 (5) | 68% ±29 (4) | 100% ±25 | 100% ±25 (100% ±25) | 100% ±25 | 4% ±1 | +| itsdangerous | python | 79 | 0.1 | — | — | — | — | — | 100% ±13 (8) | 18% ±13 (8) | 70% ±17 | 73% ±15 (75% ±16) | 100% ±13 | 50% ±25 | +| more-itertools | python | 596 | 0.1 | — | — | — | — | — | 100% ±50 (2) | — | — | — | — | 1% ±1 | +| byteorder | rust | 198 | 0.4 | — | — | 0% ±25 (4) | 73% ±20 (73% ±20) (5) | 100% ±20 | — | — | — | — | — | — | +| either | rust | 150 | 0.3 | 100% ±50 (2) | 100% ±50 | 100% ±100 (1) | — | — | 100% ±50 (2) | — | — | — | — | 2% ±1 | +| strsim | rust | 48 | 0.4 | 100% ±20 (5) | 100% ±20 | 100% ±20 (5) | — | — | 100% ±8 (13) | 100% ±10 (11) | 75% ±17 | 90% ±14 (90% ±14) | 100% ±10 | 5% ±1 | +| ufo | typescript | 83 | 0.1 | 100% ±4 (28) | 100% ±4 | 85% ±12 (26) | — | — | 100% ±4 (28) | 77% ±8 (17) | 89% ±7 | 89% ±7 (89% ±7) | 100% ±6 | 20% ±7 | +| pathe | typescript | 57 | 0.1 | 100% ±10 (11) | 100% ±10 | 100% ±10 (11) | — | — | 18% ±19 (11) | 89% ±10 (11) | 100% ±10 | 100% ±10 (100% ±10) | 100% ±10 | 34% ±31 | +| urfave-cli | go | 703 | 0.9 | 96% ±6 (18) | 89% ±10 | 65% ±20 (13) | 60% ±40 (100% ±20) (5) | 100% ±34 | 84% ±14 (19) | 41% ±18 (13) | 42% ±17 | 53% ±17 (58% ±18) | 100% ±8 | 16% ±7 | +| logrus | go | 311 | 0.4 | 100% ±17 (6) | 92% ±17 | 100% ±17 (6) | 49% ±13 (96% ±5) (41) | 100% ±5 | 33% ±34 (6) | 59% ±20 (5) | 65% ±25 | 72% ±28 (72% ±28) | 100% ±20 | 9% ±2 | +| marshmallow | python | 352 | 0.2 | — | — | — | — | — | 69% ±16 (26) | 54% ±21 (13) | 38% ±17 | 39% ±18 (54% ±20) | 62% ±24 | 35% ±9 | +| boltons | python | 1171 | 0.2 | — | — | — | — | — | 69% ±11 (48) | 98% ±5 (23) | 40% ±13 | 42% ±11 (48% ±13) | 100% ±5 | 8% ±2 | +| itertools | rust | 1013 | 0.4 | 100% ±3 (39) | 93% ±6 | 96% ±6 (26) | 88% ±14 (96% ±8) (13) | 100% ±9 | 79% ±10 (47) | 61% ±15 (23) | 65% ±15 | 65% ±15 (68% ±15) | 78% ±16 | 20% ±8 | + +`77% ±6 (20)`: the mean over 20 functions; a change smaller than ±6 points is noise. The ± is half the 90% interval +the number stays in when the functions are drawn again (bootstrap), and never less than what one function weighs. + +| per language | all | go | python | rust | typescript | +|---|---:|---:|---:|---:|---:| +| callers recall | 99% ±1 (124) | 98% ±3 (39) | — | 100% ±3 (46) | 100% ±3 (39) | +| callers precision | 96% ±3 (124) | 94% ±6 (39) | — | 94% ±5 (46) | 100% ±3 (39) | +| callers recall, picked blind | 87% ±6 (103) | 84% ±11 (30) | — | 86% ±10 (36) | 89% ±9 (37) | +| shared names: recall | 73% ±7 (108) | 70% ±8 (90) | — | 84% ±12 (18) | — | +| shared names: recall with maybe | 94% ±4 (108) | 94% ±4 (90) | — | 90% ±8 (18) | — | +| shared names: precision | 99% ±2 (86) | 99% ±3 (69) | — | 100% ±6 (17) | — | +| rename ok (tests pass) | 77% ±5 (226) | 78% ±11 (41) | 73% ±8 (84) | 84% ±9 (62) | 77% ±11 (39) | +| tests recall | 72% ±6 (135) | 62% ±12 (29) | 70% ±10 (44) | 74% ±11 (34) | 82% ±7 (28) | +| tests precision | 64% ±6 (135) | 59% ±12 (29) | 44% ±9 (44) | 68% ±12 (34) | 93% ±5 (28) | +| top-10 that fail | 67% ±6 (135) | 65% ±12 (29) | 47% ±9 (44) | 73% ±11 (34) | 93% ±5 (28) | +| … best possible order | 71% ±6 (135) | 72% ±11 (29) | 54% ±10 (44) | 75% ±11 (34) | 93% ±5 (28) | +| caught by the top 10 | 93% ±4 (135) | 100% ±4 (29) | 89% ±8 (44) | 85% ±9 (34) | 100% ±4 (28) | +| look / file | 18% ±4 (226) | 12% ±4 (41) | 20% ±5 (84) | 16% ±6 (62) | 24% ±10 (39) | + +| all repos | mean | functions | 90% interval | on each seed | 2 × SD of the seeds | threshold | +|---|---:|---:|---:|---:|---:|---:| +| callers recall | 99.2% | 124 | 98–100% | 99 / 99 / 99 | 0.0 | ±1 | +| callers precision | 95.9% | 124 | 93–98% | 96 / 96 / 97 | 1.0 | ±3 | +| callers recall, picked blind | 86.7% | 103 | 81–92% | 91 / 88 / 80 | 11.2 | ±6 | +| shared names: recall | 72.7% | 108 | 66–79% | 75 / 78 / 81 | 6.2 | ±7 | +| shared names: recall with maybe | 93.6% | 108 | 90–96% | 94 / 94 / 93 | 1.4 | ±4 | +| shared names: precision | 98.8% | 86 | 96–100% | 98 / 98 / 100 | 2.4 | ±2 | +| rename ok (tests pass) | 77.4% | 226 | 73–82% | 78 / 78 / 79 | 1.2 | ±5 | +| tests recall | 71.7% | 135 | 66–77% | 66 / 70 / 69 | 4.2 | ±6 | +| tests precision | 63.8% | 135 | 58–69% | 65 / 65 / 67 | 2.6 | ±6 | +| top-10 that fail | 67.1% | 135 | 62–72% | 69 / 68 / 71 | 2.4 | ±6 | +| … best possible order | 71.4% | 135 | 66–77% | 73 / 73 / 75 | 2.4 | ±6 | +| caught by the top 10 | 92.6% | 135 | 89–96% | 92 / 92 / 95 | 2.8 | ±4 | +| look / file | 18.2% | 226 | 15–22% | 18 / 20 / 20 | 2.2 | ±4 | + +Sample `n20-m8-seeds7,8,9`. 14 projects measured in 3 runs (heldout-a, heldout-c, heldout-b); run time together: 112 min; of the compilers' and test suites' answers 209 came from the cache, 845 were asked. diff --git a/eval/results/heldout.noise.json b/eval/results/heldout.noise.json new file mode 100644 index 0000000..8a4fe44 --- /dev/null +++ b/eval/results/heldout.noise.json @@ -0,0 +1,813 @@ +{ + "config": "n20-m8-seeds7,8,9", + "seconds": 6759, + "truth": { + "cached": 209, + "asked": 845 + }, + "scopes": { + "all": { + "callers_recall": { + "mean": 0.992, + "functions": 124, + "boot_lo": 0.984, + "boot_hi": 0.998, + "boot_half": 0.007, + "seeds": [ + 0.99, + 0.99, + 0.99 + ], + "seed_sd": 0.0, + "threshold": 0.01 + }, + "callers_precision": { + "mean": 0.959, + "functions": 124, + "boot_lo": 0.933, + "boot_hi": 0.981, + "boot_half": 0.024, + "seeds": [ + 0.962, + 0.958, + 0.967 + ], + "seed_sd": 0.005, + "threshold": 0.03 + }, + "blind_recall": { + "mean": 0.867, + "functions": 103, + "boot_lo": 0.809, + "boot_hi": 0.92, + "boot_half": 0.056, + "seeds": [ + 0.909, + 0.877, + 0.8 + ], + "seed_sd": 0.056, + "threshold": 0.06 + }, + "common_recall": { + "mean": 0.727, + "functions": 108, + "boot_lo": 0.662, + "boot_hi": 0.793, + "boot_half": 0.066, + "seeds": [ + 0.747, + 0.779, + 0.808 + ], + "seed_sd": 0.031, + "threshold": 0.07 + }, + "common_recall_with_maybe": { + "mean": 0.936, + "functions": 108, + "boot_lo": 0.903, + "boot_hi": 0.964, + "boot_half": 0.03, + "seeds": [ + 0.94, + 0.937, + 0.927 + ], + "seed_sd": 0.007, + "threshold": 0.04 + }, + "common_precision": { + "mean": 0.988, + "functions": 86, + "boot_lo": 0.965, + "boot_hi": 1.0, + "boot_half": 0.017, + "seeds": [ + 0.978, + 0.98, + 1.0 + ], + "seed_sd": 0.012, + "threshold": 0.02 + }, + "rename_ok": { + "mean": 0.774, + "functions": 226, + "boot_lo": 0.73, + "boot_hi": 0.819, + "boot_half": 0.044, + "seeds": [ + 0.783, + 0.777, + 0.79 + ], + "seed_sd": 0.006, + "threshold": 0.05 + }, + "tests_recall": { + "mean": 0.717, + "functions": 135, + "boot_lo": 0.663, + "boot_hi": 0.767, + "boot_half": 0.052, + "seeds": [ + 0.664, + 0.705, + 0.694 + ], + "seed_sd": 0.021, + "threshold": 0.06 + }, + "tests_precision": { + "mean": 0.638, + "functions": 135, + "boot_lo": 0.58, + "boot_hi": 0.691, + "boot_half": 0.055, + "seeds": [ + 0.649, + 0.653, + 0.673 + ], + "seed_sd": 0.013, + "threshold": 0.06 + }, + "tests_top10_precision": { + "mean": 0.671, + "functions": 135, + "boot_lo": 0.615, + "boot_hi": 0.723, + "boot_half": 0.054, + "seeds": [ + 0.69, + 0.681, + 0.706 + ], + "seed_sd": 0.012, + "threshold": 0.06 + }, + "tests_top10_best": { + "mean": 0.714, + "functions": 135, + "boot_lo": 0.661, + "boot_hi": 0.766, + "boot_half": 0.052, + "seeds": [ + 0.73, + 0.732, + 0.752 + ], + "seed_sd": 0.012, + "threshold": 0.06 + }, + "tests_caught": { + "mean": 0.926, + "functions": 135, + "boot_lo": 0.889, + "boot_hi": 0.963, + "boot_half": 0.037, + "seeds": [ + 0.925, + 0.925, + 0.95 + ], + "seed_sd": 0.014, + "threshold": 0.04 + }, + "look_vs_file": { + "mean": 0.182, + "functions": 226, + "boot_lo": 0.154, + "boot_hi": 0.215, + "boot_half": 0.03, + "seeds": [ + 0.183, + 0.205, + 0.196 + ], + "seed_sd": 0.011, + "threshold": 0.04 + } + }, + "go": { + "callers_recall": { + "mean": 0.976, + "functions": 39, + "boot_lo": 0.95, + "boot_hi": 0.995, + "boot_half": 0.022, + "seeds": [ + 0.976, + 0.976, + 0.976 + ], + "seed_sd": 0.0, + "threshold": 0.03 + }, + "callers_precision": { + "mean": 0.938, + "functions": 39, + "boot_lo": 0.882, + "boot_hi": 0.983, + "boot_half": 0.05, + "seeds": [ + 0.938, + 0.938, + 0.938 + ], + "seed_sd": 0.0, + "threshold": 0.06 + }, + "blind_recall": { + "mean": 0.843, + "functions": 30, + "boot_lo": 0.737, + "boot_hi": 0.943, + "boot_half": 0.103, + "seeds": [ + 1.0, + 0.816, + 0.779 + ], + "seed_sd": 0.118, + "threshold": 0.11 + }, + "common_recall": { + "mean": 0.704, + "functions": 90, + "boot_lo": 0.628, + "boot_hi": 0.772, + "boot_half": 0.072, + "seeds": [ + 0.736, + 0.743, + 0.789 + ], + "seed_sd": 0.029, + "threshold": 0.08 + }, + "common_recall_with_maybe": { + "mean": 0.943, + "functions": 90, + "boot_lo": 0.909, + "boot_hi": 0.974, + "boot_half": 0.032, + "seeds": [ + 0.964, + 0.945, + 0.944 + ], + "seed_sd": 0.011, + "threshold": 0.04 + }, + "common_precision": { + "mean": 0.986, + "functions": 69, + "boot_lo": 0.957, + "boot_hi": 1.0, + "boot_half": 0.022, + "seeds": [ + 0.971, + 0.973, + 1.0 + ], + "seed_sd": 0.016, + "threshold": 0.03 + }, + "rename_ok": { + "mean": 0.78, + "functions": 41, + "boot_lo": 0.659, + "boot_hi": 0.878, + "boot_half": 0.11, + "seeds": [ + 0.78, + 0.78, + 0.78 + ], + "seed_sd": 0.0, + "threshold": 0.11 + }, + "tests_recall": { + "mean": 0.621, + "functions": 29, + "boot_lo": 0.502, + "boot_hi": 0.74, + "boot_half": 0.119, + "seeds": [ + 0.649, + 0.65, + 0.715 + ], + "seed_sd": 0.038, + "threshold": 0.12 + }, + "tests_precision": { + "mean": 0.592, + "functions": 29, + "boot_lo": 0.477, + "boot_hi": 0.708, + "boot_half": 0.116, + "seeds": [ + 0.62, + 0.614, + 0.628 + ], + "seed_sd": 0.007, + "threshold": 0.12 + }, + "tests_top10_precision": { + "mean": 0.654, + "functions": 29, + "boot_lo": 0.539, + "boot_hi": 0.766, + "boot_half": 0.114, + "seeds": [ + 0.655, + 0.658, + 0.684 + ], + "seed_sd": 0.016, + "threshold": 0.12 + }, + "tests_top10_best": { + "mean": 0.716, + "functions": 29, + "boot_lo": 0.606, + "boot_hi": 0.824, + "boot_half": 0.109, + "seeds": [ + 0.726, + 0.717, + 0.755 + ], + "seed_sd": 0.02, + "threshold": 0.11 + }, + "tests_caught": { + "mean": 1.0, + "functions": 29, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.04 + }, + "look_vs_file": { + "mean": 0.118, + "functions": 41, + "boot_lo": 0.088, + "boot_hi": 0.156, + "boot_half": 0.034, + "seeds": [ + 0.118, + 0.118, + 0.118 + ], + "seed_sd": 0.0, + "threshold": 0.04 + } + }, + "python": { + "callers_recall": null, + "callers_precision": null, + "blind_recall": null, + "common_recall": null, + "common_recall_with_maybe": null, + "common_precision": null, + "rename_ok": { + "mean": 0.726, + "functions": 84, + "boot_lo": 0.643, + "boot_hi": 0.798, + "boot_half": 0.077, + "seeds": [ + 0.8, + 0.76, + 0.78 + ], + "seed_sd": 0.02, + "threshold": 0.08 + }, + "tests_recall": { + "mean": 0.702, + "functions": 44, + "boot_lo": 0.597, + "boot_hi": 0.796, + "boot_half": 0.099, + "seeds": [ + 0.476, + 0.547, + 0.534 + ], + "seed_sd": 0.038, + "threshold": 0.1 + }, + "tests_precision": { + "mean": 0.445, + "functions": 44, + "boot_lo": 0.355, + "boot_hi": 0.532, + "boot_half": 0.089, + "seeds": [ + 0.425, + 0.458, + 0.496 + ], + "seed_sd": 0.036, + "threshold": 0.09 + }, + "tests_top10_precision": { + "mean": 0.467, + "functions": 44, + "boot_lo": 0.383, + "boot_hi": 0.548, + "boot_half": 0.083, + "seeds": [ + 0.459, + 0.475, + 0.506 + ], + "seed_sd": 0.024, + "threshold": 0.09 + }, + "tests_top10_best": { + "mean": 0.544, + "functions": 44, + "boot_lo": 0.451, + "boot_hi": 0.633, + "boot_half": 0.091, + "seeds": [ + 0.521, + 0.575, + 0.573 + ], + "seed_sd": 0.03, + "threshold": 0.1 + }, + "tests_caught": { + "mean": 0.886, + "functions": 44, + "boot_lo": 0.795, + "boot_hi": 0.955, + "boot_half": 0.08, + "seeds": [ + 0.833, + 0.833, + 0.875 + ], + "seed_sd": 0.024, + "threshold": 0.08 + }, + "look_vs_file": { + "mean": 0.203, + "functions": 84, + "boot_lo": 0.159, + "boot_hi": 0.251, + "boot_half": 0.046, + "seeds": [ + 0.24, + 0.264, + 0.26 + ], + "seed_sd": 0.013, + "threshold": 0.05 + } + }, + "rust": { + "callers_recall": { + "mean": 1.0, + "functions": 46, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.03 + }, + "callers_precision": { + "mean": 0.943, + "functions": 46, + "boot_lo": 0.895, + "boot_hi": 0.989, + "boot_half": 0.047, + "seeds": [ + 0.951, + 0.933, + 0.972 + ], + "seed_sd": 0.02, + "threshold": 0.05 + }, + "blind_recall": { + "mean": 0.861, + "functions": 36, + "boot_lo": 0.75, + "boot_hi": 0.944, + "boot_half": 0.097, + "seeds": [ + 0.789, + 0.789, + 0.737 + ], + "seed_sd": 0.03, + "threshold": 0.1 + }, + "common_recall": { + "mean": 0.843, + "functions": 18, + "boot_lo": 0.722, + "boot_hi": 0.944, + "boot_half": 0.111, + "seeds": [ + 0.782, + 0.91, + 0.869 + ], + "seed_sd": 0.065, + "threshold": 0.12 + }, + "common_recall_with_maybe": { + "mean": 0.898, + "functions": 18, + "boot_lo": 0.815, + "boot_hi": 0.972, + "boot_half": 0.079, + "seeds": [ + 0.859, + 0.91, + 0.869 + ], + "seed_sd": 0.027, + "threshold": 0.08 + }, + "common_precision": { + "mean": 1.0, + "functions": 17, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.06 + }, + "rename_ok": { + "mean": 0.839, + "functions": 62, + "boot_lo": 0.758, + "boot_hi": 0.919, + "boot_half": 0.081, + "seeds": [ + 0.829, + 0.857, + 0.886 + ], + "seed_sd": 0.029, + "threshold": 0.09 + }, + "tests_recall": { + "mean": 0.735, + "functions": 34, + "boot_lo": 0.625, + "boot_hi": 0.837, + "boot_half": 0.106, + "seeds": [ + 0.823, + 0.857, + 0.757 + ], + "seed_sd": 0.051, + "threshold": 0.11 + }, + "tests_precision": { + "mean": 0.684, + "functions": 34, + "boot_lo": 0.572, + "boot_hi": 0.792, + "boot_half": 0.11, + "seeds": [ + 0.718, + 0.703, + 0.722 + ], + "seed_sd": 0.01, + "threshold": 0.12 + }, + "tests_top10_precision": { + "mean": 0.732, + "functions": 34, + "boot_lo": 0.62, + "boot_hi": 0.838, + "boot_half": 0.109, + "seeds": [ + 0.819, + 0.755, + 0.785 + ], + "seed_sd": 0.032, + "threshold": 0.11 + }, + "tests_top10_best": { + "mean": 0.753, + "functions": 34, + "boot_lo": 0.642, + "boot_hi": 0.857, + "boot_half": 0.107, + "seeds": [ + 0.819, + 0.774, + 0.81 + ], + "seed_sd": 0.024, + "threshold": 0.11 + }, + "tests_caught": { + "mean": 0.853, + "functions": 34, + "boot_lo": 0.765, + "boot_hi": 0.941, + "boot_half": 0.088, + "seeds": [ + 0.875, + 0.875, + 0.938 + ], + "seed_sd": 0.036, + "threshold": 0.09 + }, + "look_vs_file": { + "mean": 0.159, + "functions": 62, + "boot_lo": 0.108, + "boot_hi": 0.216, + "boot_half": 0.054, + "seeds": [ + 0.108, + 0.167, + 0.161 + ], + "seed_sd": 0.032, + "threshold": 0.06 + } + }, + "typescript": { + "callers_recall": { + "mean": 1.0, + "functions": 39, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.03 + }, + "callers_precision": { + "mean": 1.0, + "functions": 39, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.03 + }, + "blind_recall": { + "mean": 0.892, + "functions": 37, + "boot_lo": 0.811, + "boot_hi": 0.973, + "boot_half": 0.081, + "seeds": [ + 0.957, + 1.0, + 0.87 + ], + "seed_sd": 0.066, + "threshold": 0.09 + }, + "common_recall": null, + "common_recall_with_maybe": null, + "common_precision": null, + "rename_ok": { + "mean": 0.769, + "functions": 39, + "boot_lo": 0.667, + "boot_hi": 0.872, + "boot_half": 0.103, + "seeds": [ + 0.71, + 0.71, + 0.71 + ], + "seed_sd": 0.0, + "threshold": 0.11 + }, + "tests_recall": { + "mean": 0.82, + "functions": 28, + "boot_lo": 0.756, + "boot_hi": 0.879, + "boot_half": 0.062, + "seeds": [ + 0.807, + 0.872, + 0.839 + ], + "seed_sd": 0.033, + "threshold": 0.07 + }, + "tests_precision": { + "mean": 0.933, + "functions": 28, + "boot_lo": 0.884, + "boot_hi": 0.975, + "boot_half": 0.046, + "seeds": [ + 0.958, + 0.952, + 0.958 + ], + "seed_sd": 0.004, + "threshold": 0.05 + }, + "tests_top10_precision": { + "mean": 0.933, + "functions": 28, + "boot_lo": 0.884, + "boot_hi": 0.975, + "boot_half": 0.046, + "seeds": [ + 0.958, + 0.952, + 0.958 + ], + "seed_sd": 0.004, + "threshold": 0.05 + }, + "tests_top10_best": { + "mean": 0.933, + "functions": 28, + "boot_lo": 0.884, + "boot_hi": 0.975, + "boot_half": 0.046, + "seeds": [ + 0.958, + 0.952, + 0.958 + ], + "seed_sd": 0.004, + "threshold": 0.05 + }, + "tests_caught": { + "mean": 1.0, + "functions": 28, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.04 + }, + "look_vs_file": { + "mean": 0.241, + "functions": 39, + "boot_lo": 0.156, + "boot_hi": 0.351, + "boot_half": 0.098, + "seeds": [ + 0.261, + 0.268, + 0.235 + ], + "seed_sd": 0.017, + "threshold": 0.1 + } + } + } +} \ No newline at end of file diff --git a/eval/results/latest.baselines.json b/eval/results/latest.baselines.json new file mode 100644 index 0000000..2186c91 --- /dev/null +++ b/eval/results/latest.baselines.json @@ -0,0 +1,7285 @@ +{ + "callers": [ + { + "symbol": "main::Command::NamePadding", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::CheckErr", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::CommandPathPadding", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::GenPowerShellCompletionWithDesc", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::Print", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.5, + "recall": 1.0, + "precision": 0.75, + "repo": "cobra" + }, + { + "symbol": "main::Command::OutOrStderr", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::PrintErrf", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::MinimumNArgs", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::Flags", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.9333333333333333, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::LocalFlags", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.8571428571428571, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::Println", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.6, + "recall": 1.0, + "precision": 0.75, + "repo": "cobra" + }, + { + "symbol": "main::Command::Execute", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.3333333333333333, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::CalledAs", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::HasAvailableInheritedFlags", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::Parent", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::CompError", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::CompErrorln", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::LocalNonPersistentFlags", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::ParseFlags", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.75, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::InitDefaultCompletionCmd", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::ValidateFlagGroups", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::PrintErrln", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::Help", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::HasParent", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::InitDefaultVersionFlag", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::Commands", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::HelpFunc", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "doc::GenMarkdownCustom", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::GenBashCompletionV2", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::InheritedFlags", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.9166666666666666, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::Root", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "doc::GenMarkdownTreeCustom", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::FlagErrorFunc", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::SetGlobalNormalizationFunc", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::UseLine", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::GenZshCompletion", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::HasPersistentFlags", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::PrintErr", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "doc::GenYamlCustom", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::HasSubCommands", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::Traverse", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::SuggestionsFor", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::Usage", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.2222222222222222, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::ValidateArgs", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::HasFlags", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.2, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "middleware::GetLogEntry", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "main::Chain", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "middleware::NewCompressor", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "main::RouteContext", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.8888888888888888, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "middleware::RequestLogger", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "main::NewMux", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "middleware::GetClientIPAddr", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "main::Middlewares::HandlerFunc", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.029850746268656716, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "main::NewRouteContext", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "middleware::NewPattern", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "main::Context::RoutePattern", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "main::Mux::NotFoundHandler", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "main::endpoints::Value", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.14285714285714285, + "recall": 1.0, + "precision": 0.25, + "repo": "chi" + }, + { + "symbol": "main::node::InsertRoute", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "main::node::FindRoute", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "main::URLParamFromCtx", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "middleware::GetReqID", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "middleware::NewWrapResponseWriter", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "middleware::compressResponseWriter::Close", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "main::NewRouter", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "middleware::Compressor::SetEncoder", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "main::Mux::MethodNotAllowedHandler", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "middleware::PrintPrettyStack", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "middleware::HeaderRoute::IsMatch", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "middleware::ThrottleWithOpts", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "middleware::WithLogEntry", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "src::middleware::persist::createJSONStorage", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 0.5, + "recall": 1.0, + "precision": 1.0, + "repo": "zustand" + }, + { + "symbol": "src::compose::resolve_flow_scalar::resolveFlowScalar", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::compose::resolve_end::resolveEnd", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::nodes::toJS::ToJSContext::resolveAlias", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::public_api::parseAllDocuments", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 0.5, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::nodes::YAMLMap::YAMLMap::#stringifyFlowMap", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::compose::util_flow_indent_check::flowIndentCheck", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::compose::compose_collection::composeCollection", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::doc::Document::Document::setSchema", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 0.5, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::doc::directives::Directives::atDocument", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::compose::resolve_flow_collection::resolveFlowCollection", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::compose::resolve_block_scalar::resolveBlockScalar", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::nodes::YAMLMap::YAMLMap::#stringifyBlockMap", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::public_api::parseDocument", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::doc::anchors::anchorIsValid", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::nodes::toJS::ToJSContext::setAnchor", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::doc::anchors::anchorNames", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::parse::cst::prettyToken", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::log::warn", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 0.3333333333333333, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::nodes::toJS::ToJSContext::setSource", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::stringify::stringifyComment::lineComment", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::nodes::YAMLSeq::YAMLSeq::#stringifyBlockSeq", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::compose::composer::Composer::compose", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::doc::NodeCreator::NodeCreator::setAnchors", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::compose::resolve_block_seq::resolveBlockSeq", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::compose::compose_scalar::composeScalar", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 0.6666666666666666, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::parse::cst::tokenType", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::parse::lexer::Lexer::flow", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 0.023809523809523808, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::compose::resolve_block_map::resolveBlockMap", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::nodes::YAMLSet::YAMLSet::#stringifyFlowSet", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::nodes::YAMLSeq::YAMLSeq::#stringifyFlowSeq", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::compose::util_contains_newline::containsNewline", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::nodes::YAMLSet::YAMLSet::#stringifyBlockSet", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::compose::compose_doc::composeDoc", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::schema::yaml_1_1::pairs::resolvePairs", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::stringify::stringify::createStringifyContext", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::schema::tags::getTags", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::errors::prettifyError", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::compose::resolve_props::resolveProps", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "org::jsoup::internal::SoftPool::release", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.6363636363636364, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::internal::StringUtil::appendNormalisedWhitespace", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::internal::LegacyMatching::cssAttributeMatches", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::select::Evaluator::asPredicate", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::parser::TokenQueue::matchesWord", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::internal::StringUtil::isAsciiLetter", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::parser::TokenQueue::matchesWhitespace", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::nodes::DocumentType::publicId", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.5, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::parser::ParseErrorList::tracking", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.13333333333333333, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::nodes::Node::ownerDocument", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::select::Collector::findFirst", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.5, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::internal::CssMatching::isQuirksMode", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::nodes::Attributes::hasKey", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.875, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::internal::NamespaceBindings::isDeclaration", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.2857142857142857, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::select::Collector::streamNodes", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::Jsoup::newSession", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.5, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::nodes::Document::location", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.125, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::nodes::Entities::isBaseNamedEntity", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::nodes::Attribute::getValue", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.37037037037037035, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::nodes::Element::wholeOwnText", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.6, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::safety::Safelist::addTags", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::internal::StringUtil::isActuallyWhitespace", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.5, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::nodes::Attributes::getIgnoreCase", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::parser::Parser::getMaxDepth", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.5, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::parser::Tag::isFormSubmittable", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::nodes::Attributes::removeIgnoreCase", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::parser::Token::Doctype::getSystemIdentifier", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::internal::Normalizer::lowerCase", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::parser::TokenQueue::remainder", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.5714285714285714, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::select::Selector::evaluatorOf", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.9166666666666666, + "recall": 0.8, + "precision": 0.8, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::nodes::Range::AttributeRange::valueRange", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::nodes::TextNode::getWholeText", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.9090909090909091, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::internal::LineMap::addLineStart", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::parser::Tag::isInline", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::nodes::Element::lastElementChild", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.6, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::parser::Parser::isTrackErrors", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::internal::LegacyMatching::attributeMatches", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::nodes::Range::AttributeRange::nameRange", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::nodes::DocumentType::systemId", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.25, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::internal::StringUtil::trimAsciiWhitespace", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::safety::Safelist::addEnforcedAttribute", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.5, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::parser::TokenQueue::consumeCssIdentifier", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::nodes::Attributes::deduplicate", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::nodes::Entities::isNamedEntity", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.5, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::nodes::Attribute::getValidKey", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::internal::LegacyMatching::hasAttributeFlag", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::nodes::Node::siblingIndex", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.6923076923076923, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::nodes::Attributes::normalize", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.2, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::internal::StringUtil::joining", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.8333333333333334, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::json::JSONObject::putOnce", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.5, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONObject::toMap", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::XMLParserConfiguration::getXsiTypeMap", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONTokener::more", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.4, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONPointer::queryFrom", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::XMLParserConfiguration::withKeepBooleanAsString", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.5, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONTokener::nextClean", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONTokener::getJsonParserConfiguration", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONArray::toList", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONParserConfiguration::isOverwriteDuplicateKey", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONTokener::nextValue", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONObject::putOpt", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::XMLTokener::nextMeta", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::XML::noSpace", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::XMLParserConfiguration::isKeepNumberAsString", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::XMLParserConfiguration::withKeepNumberAsString", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONTokener::nextString", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONParserConfiguration::getMaxSharedKeys", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONParserConfiguration::isUseNativeNulls", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.6666666666666666, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::ParserConfiguration::isKeepStrings", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::ParserConfiguration::getMaxNumberLength", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::XMLParserConfiguration::getForceList", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONObject::numberToString", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONObject::keys", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.1, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::ParserConfiguration::getMaxNestingDepth", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONTokener::dehexchar", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONParserConfiguration::isStrictMode", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::XMLParserConfiguration::isCloseEmptyTag", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONObject::accumulate", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::XMLTokener::nextCDATA", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::XMLParserConfiguration::isConvertNilAttributeToNull", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::XMLTokener::skipPast", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.75, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::XMLParserConfiguration::shouldTrimWhiteSpace", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.3333333333333333, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONTokener::back", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.9285714285714286, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::XMLParserConfiguration::isKeepBooleanAsString", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::XMLTokener::nextEntity", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "semver::identifier::Identifier::ptr_eq", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "semver" + }, + { + "symbol": "semver::eval::matches_req", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "semver" + }, + { + "symbol": "semver::identifier::Identifier::new_unchecked", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 0.3333333333333333, + "recall": 1.0, + "precision": 1.0, + "repo": "semver" + }, + { + "symbol": "semver::eval::matches_comparator", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "semver" + }, + { + "symbol": "semver::identifier::Identifier::empty", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 0.7142857142857143, + "recall": 1.0, + "precision": 1.0, + "repo": "semver" + }, + { + "symbol": "indexmap::map::IndexMap::sort_unstable_keys", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::set::IndexSet::is_subset", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::serde::cautious_capacity", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::set::IndexSet::difference", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::raw_entry_v1::RawEntryBuilder::index_from_hash", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 0.6666666666666666, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::inner::Core::split_splice", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::inner::extract::ExtractCore::remaining", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 0.4, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::raw_entry_v1::RawOccupiedEntryMut::into_key_value_mut", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::IndexMap::sort_keys", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::raw_entry_v1::RawVacantEntryMut::insert_hashed_nocheck", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::set::IndexSet::contains", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 0.7692307692307693, + "recall": 0.8, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::util::simplify_range", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::rayon::set::IndexSet::par_is_subset", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::disjoint::get_disjoint_opt_mut", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::set::IndexSet::union", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::util::assert_index_lt", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::util::try_simplify_range", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::inner::Core::shift_insert_unique", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::set::IndexSet::swap_take", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::inner::Core::replace_index_unique", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::IndexMap::contains_key", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::inner::Core::retain_in_order", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::rayon::set::IndexSet::par_difference", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::inner::Core::get_index_of_raw", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::slice::Slice::from_mut_slice", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 0.9230769230769231, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::set::IndexSet::intersection", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::util::third", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::util::assert_index_le", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::raw_entry_v1::RawVacantEntryMut::shift_insert_hashed_nocheck", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::IndexMap::get_index_entry", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::set::IndexSet::symmetric_difference", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::util::slice_eq", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + } + ], + "callers_common": [ + { + "symbol": "main::Command::MarkFlagRequired", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.3333333333333333, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Mux::Method", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.2, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "main::Context::Reset", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.25, + "recall": 0.0, + "precision": null, + "repo": "chi" + }, + { + "symbol": "main::Mux::Find", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.16666666666666666, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "main::Context::URLParam", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.3333333333333333, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "main::Mux::Mount", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.25, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "main::Mux::With", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.2, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "main::Mux::Handle", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.2, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "main::Mux::MethodNotAllowed", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.3333333333333333, + "recall": 0.0, + "precision": null, + "repo": "chi" + }, + { + "symbol": "main::Mux::NotFound", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.25, + "recall": 0.0, + "precision": null, + "repo": "chi" + }, + { + "symbol": "main::Middlewares::Handler", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.014285714285714285, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "src::doc::NodeCreator::NodeCreator::createPair", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::nodes::YAMLSet::YAMLSet::keyOf", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 0.5, + "recall": 0.0, + "precision": null, + "repo": "yaml" + }, + { + "symbol": "src::parse::parser::Parser::next", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 0.023809523809523808, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::nodes::YAMLMap::YAMLMap::create", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 0.0625, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::parse::lexer::Lexer::document", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 0.043478260869565216, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::doc::directives::Directives::tagName", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 0.2222222222222222, + "recall": 0.0, + "precision": null, + "repo": "yaml" + }, + { + "symbol": "src::parse::lexer::Lexer::stream", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 0.09090909090909091, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::nodes::YAMLMap::YAMLMap::getPair", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 0.5, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::nodes::YAMLSeq::YAMLSeq::create", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 0.0625, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::nodes::YAMLSeq::YAMLSeq::tagName", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 0.2222222222222222, + "recall": 0.0, + "precision": null, + "repo": "yaml" + }, + { + "symbol": "org::jsoup::parser::Tag::isSelfClosing", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.375, + "recall": 0.6666666666666666, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::nodes::Document::shallowClone", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.2, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::internal::StringUtil::isWhitespace", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.8888888888888888, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::internal::ControllableInputStream::onProgress", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.3333333333333333, + "recall": 0.0, + "precision": null, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::helper::Regex::compile", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.375, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::nodes::Node::normalName", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.07272727272727272, + "recall": 0.75, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::parser::Tag::getName", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.2, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::nodes::Document::body", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.13725490196078433, + "recall": 0.8571428571428571, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::parser::TokenQueue::escapeCssIdentifier", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::nodes::NodeInternals::sourceDataStart", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.6666666666666666, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::parser::Parser::parseAttributes", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.25, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::internal::StringUtil::normaliseWhitespace", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::parser::Parser::unescapeEntities", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.25, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::nodes::NodeInternals::clearEndSourceRange", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.5, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::nodes::Element::toggleClass", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::parser::CharacterReader::current", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.11538461538461539, + "recall": 0.8888888888888888, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::parser::Tag::localName", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.5, + "recall": 0.0, + "precision": null, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::nodes::Attributes::attribute", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.012658227848101266, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::parser::Tag::isBlock", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.16666666666666666, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::internal::CssMatching::sameType", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.25, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::helper::HttpConnection::Base::multiHeaders", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.25, + "recall": 0.0, + "precision": null, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::nodes::Attribute::prefix", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.1, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::parser::Tag::isEmpty", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.05, + "recall": 0.8, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::nodes::Node::hasAttr", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.7857142857142857, + "recall": 0.9090909090909091, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::internal::NamespaceBindings::clear", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.03571428571428571, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::nodes::Attributes::dataset", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.5, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::select::Elements::forms", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.2, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::parser::TokenQueue::advance", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.36363636363636365, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::internal::QueryMode::current", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.08974358974358974, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::nodes::Element::removeClass", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::parser::TokenQueue::matchesAny", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.16666666666666666, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::nodes::Element::addClass", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::nodes::Attributes::size", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.06474820143884892, + "recall": 0.7777777777777778, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::internal::LineMap::complete", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.05, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::nodes::Node::nodeValue", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.5, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::internal::StringUtil::isBlank", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.7142857142857143, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::internal::ControllableInputStream::resetFullyRead", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.5, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::nodes::Element::hasText", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.75, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::parser::Tag::prefix", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.03333333333333333, + "recall": 0.0, + "precision": null, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::nodes::Comment::getData", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.25, + "recall": 1.0, + "precision": 0.7142857142857143, + "repo": "jsoup" + }, + { + "symbol": "org::json::Cookie::escape", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.18181818181818182, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONArray::getJSONObject", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.5, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONArray::similar", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.2, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONObject::valueToString", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.3333333333333333, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONObject::isEmpty", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.1111111111111111, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONObject::getBoolean", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.4, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::Cookie::unescape", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.4, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONArray::remove", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.16666666666666666, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::XMLTokener::nextToken", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.5, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONArray::length", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.3103448275862069, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONArray::getString", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.375, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONArray::getBoolean", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.4, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONArray::isEmpty", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.16666666666666666, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONObject::length", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.08620689655172414, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::XML::escape", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.18181818181818182, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::HTTPTokener::nextToken", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.25, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "semver::BuildMetadata::as_str", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 0.2222222222222222, + "recall": 1.0, + "precision": 1.0, + "repo": "semver" + }, + { + "symbol": "semver::identifier::Identifier::is_empty", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 0.2222222222222222, + "recall": 1.0, + "precision": 1.0, + "repo": "semver" + }, + { + "symbol": "indexmap::set::IndexSet::with_capacity", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 0.125, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::inner::Core::drain", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 0.18181818181818182, + "recall": 0.5, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::raw_entry_v1::RawOccupiedEntryMut::swap_remove_entry", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 0.1, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::inner::Core::with_entries", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 0.038461538461538464, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::IndexMap::append", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 0.3333333333333333, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::set::IndexSet::sort_unstable_by_key", + "lang": "rust", + "grep_recall": null, + "grep_precision": 0.0, + "recall": null, + "precision": null, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::IndexMap::move_index", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 0.25, + "recall": 0.5, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::slice::Slice::binary_search_by", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 0.4444444444444444, + "recall": 0.75, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::IndexMap::clear", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 0.2, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::inner::Core::truncate", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 0.5, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::inner::entry::OccupiedEntry::into_core", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 0.3333333333333333, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::IndexMap::swap_remove", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 0.2222222222222222, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::entry::IndexedEntry::get_mut", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 0.06666666666666667, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::IndexMap::get_key_value", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 0.5, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::IndexMap::hasher", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 0.125, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::IndexMap::is_empty", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 0.5, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::slice::Slice::partition_point", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 0.3333333333333333, + "recall": 0.0, + "precision": null, + "repo": "indexmap" + }, + { + "symbol": "indexmap::set::IndexSet::split_off", + "lang": "rust", + "grep_recall": null, + "grep_precision": 0.0, + "recall": null, + "precision": null, + "repo": "indexmap" + }, + { + "symbol": "indexmap::inner::Core::into_entries", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 0.038461538461538464, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::IndexMap::swap_remove_full", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 0.75, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::set::IndexSet::binary_search_by", + "lang": "rust", + "grep_recall": null, + "grep_precision": 0.0, + "recall": null, + "precision": null, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::IndexMap::is_sorted_by", + "lang": "rust", + "grep_recall": null, + "grep_precision": 0.0, + "recall": null, + "precision": null, + "repo": "indexmap" + }, + { + "symbol": "indexmap::inner::entry::OccupiedEntry::from_hash", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 0.2, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::slice::Slice::from_boxed", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 0.4444444444444444, + "recall": 1.0, + "precision": 0.8, + "repo": "indexmap" + }, + { + "symbol": "indexmap::inner::Core::par_drain", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 0.0, + "precision": null, + "repo": "indexmap" + }, + { + "symbol": "indexmap::set::IndexSet::try_reserve", + "lang": "rust", + "grep_recall": null, + "grep_precision": 0.0, + "recall": null, + "precision": null, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::IndexMap::shift_insert", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 0.14285714285714285, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::set::IndexSet::try_reserve_exact", + "lang": "rust", + "grep_recall": null, + "grep_precision": 0.0, + "recall": null, + "precision": null, + "repo": "indexmap" + }, + { + "symbol": "indexmap::set::slice::Slice::is_sorted", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 0.3333333333333333, + "recall": 0.0, + "precision": null, + "repo": "indexmap" + }, + { + "symbol": "indexmap::set::IndexSet::reverse", + "lang": "rust", + "grep_recall": null, + "grep_precision": 0.0, + "recall": null, + "precision": null, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::IndexMap::get_index_of", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 0.625, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::raw_entry_v1::RawOccupiedEntryMut::get_key_value_mut", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 0.5, + "recall": 0.0, + "precision": null, + "repo": "indexmap" + }, + { + "symbol": "indexmap::set::slice::Slice::is_sorted_by_key", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 0.3333333333333333, + "recall": 0.0, + "precision": null, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::IndexMap::shift_remove_full", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 0.75, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::set::IndexSet::insert_full", + "lang": "rust", + "grep_recall": null, + "grep_precision": 0.0, + "recall": null, + "precision": null, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::IndexMap::swap_remove_index", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 0.3333333333333333, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::IndexMap::last_mut", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 0.5, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + } + ], + "callers_blind": [ + { + "symbol": "main::Command::NamePadding", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::CheckErr", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::CommandPathPadding", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::GenPowerShellCompletionWithDesc", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::Print", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.5, + "recall": 1.0, + "precision": 0.75, + "repo": "cobra" + }, + { + "symbol": "main::Command::OutOrStderr", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::PrintErrf", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::MinimumNArgs", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::Flags", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.9333333333333333, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::LocalFlags", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.8571428571428571, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::Println", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.6, + "recall": 1.0, + "precision": 0.75, + "repo": "cobra" + }, + { + "symbol": "main::Command::Execute", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.3333333333333333, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::ValidateFlagGroups", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::PrintErrln", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::Help", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::CalledAs", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::CompErrorln", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::HasParent", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::InitDefaultVersionFlag", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::Commands", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::Parent", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::HelpFunc", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "doc::GenMarkdownCustom", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::GenBashCompletionV2", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::FlagErrorFunc", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::SetGlobalNormalizationFunc", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::UseLine", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::GenZshCompletion", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::Root", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::HasPersistentFlags", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::PrintErr", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "middleware::GetLogEntry", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "main::Chain", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "middleware::NewCompressor", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "main::RouteContext", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 0.8888888888888888, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "middleware::RequestLogger", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "main::URLParamFromCtx", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "middleware::GetReqID", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "main::Mux::NotFoundHandler", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "middleware::NewWrapResponseWriter", + "lang": "go", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "src::middleware::persist::createJSONStorage", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 0.5, + "recall": 1.0, + "precision": 1.0, + "repo": "zustand" + }, + { + "symbol": "src::react::shallow::useShallow", + "lang": "typescript", + "grep_recall": null, + "grep_precision": null, + "recall": null, + "precision": null, + "repo": "zustand" + }, + { + "symbol": "src::compose::resolve_flow_scalar::resolveFlowScalar", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::parse::cst_scalar::setScalarValue", + "lang": "typescript", + "grep_recall": null, + "grep_precision": null, + "recall": null, + "precision": null, + "repo": "yaml" + }, + { + "symbol": "src::compose::resolve_end::resolveEnd", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::nodes::toJS::ToJSContext::resolveAlias", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::public_api::parseAllDocuments", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 0.5, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::nodes::YAMLMap::YAMLMap::#stringifyFlowMap", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::compose::util_flow_indent_check::flowIndentCheck", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::compose::compose_collection::composeCollection", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::doc::Document::Document::setSchema", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 0.5, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::doc::directives::Directives::atDocument", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::compose::resolve_flow_collection::resolveFlowCollection", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::compose::resolve_block_scalar::resolveBlockScalar", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::nodes::YAMLMap::YAMLMap::#stringifyBlockMap", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::visit::visitAsync", + "lang": "typescript", + "grep_recall": null, + "grep_precision": null, + "recall": null, + "precision": null, + "repo": "yaml" + }, + { + "symbol": "src::public_api::parseDocument", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::doc::anchors::anchorIsValid", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::nodes::toJS::ToJSContext::setAnchor", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::doc::anchors::anchorNames", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::parse::cst::prettyToken", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::nodes::YAMLSeq::YAMLSeq::#stringifyBlockSeq", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::compose::composer::Composer::compose", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::doc::NodeCreator::NodeCreator::setAnchors", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::compose::resolve_block_seq::resolveBlockSeq", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::compose::compose_scalar::composeScalar", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 0.6666666666666666, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::parse::cst::tokenType", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::parse::lexer::Lexer::flow", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 0.023809523809523808, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::compose::resolve_block_map::resolveBlockMap", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::log::debug", + "lang": "typescript", + "grep_recall": null, + "grep_precision": 0.0, + "recall": null, + "precision": null, + "repo": "yaml" + }, + { + "symbol": "src::nodes::YAMLSet::YAMLSet::#stringifyFlowSet", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::compose::util_contains_newline::containsNewline", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::nodes::YAMLSet::YAMLSet::#stringifyBlockSet", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::compose::compose_doc::composeDoc", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::schema::yaml_1_1::pairs::resolvePairs", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::stringify::stringify::createStringifyContext", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::parse::cst_scalar::createScalarToken", + "lang": "typescript", + "grep_recall": null, + "grep_precision": null, + "recall": null, + "precision": null, + "repo": "yaml" + }, + { + "symbol": "src::schema::tags::getTags", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::errors::prettifyError", + "lang": "typescript", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "org::jsoup::internal::SoftPool::release", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.6363636363636364, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::internal::StringUtil::appendNormalisedWhitespace", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::internal::LegacyMatching::cssAttributeMatches", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::select::Evaluator::asPredicate", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::parser::TokenQueue::matchesWord", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::internal::StringUtil::isAsciiLetter", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::parser::TokenQueue::matchesWhitespace", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::nodes::DocumentType::publicId", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.5, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::parser::ParseErrorList::tracking", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.13333333333333333, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::nodes::Node::ownerDocument", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::safety::Safelist::addTags", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::internal::StringUtil::isActuallyWhitespace", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.5, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::nodes::Attributes::getIgnoreCase", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::parser::Parser::getMaxDepth", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.5, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::parser::Tag::isFormSubmittable", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::nodes::Attributes::removeIgnoreCase", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::parser::Token::Doctype::getSystemIdentifier", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::internal::Normalizer::lowerCase", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::parser::TokenQueue::remainder", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.5714285714285714, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::select::Selector::evaluatorOf", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.9166666666666666, + "recall": 0.8, + "precision": 0.8, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::safety::Safelist::isSafeTag", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 0.0, + "precision": null, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::nodes::Range::AttributeRange::valueRange", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::nodes::TextNode::getWholeText", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.9090909090909091, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::internal::LineMap::addLineStart", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::parser::Tag::isInline", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::internal::StringUtil::trimAsciiWhitespace", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::safety::Safelist::addEnforcedAttribute", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.5, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::parser::TokenQueue::consumeCssIdentifier", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::nodes::Attributes::deduplicate", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::nodes::Entities::isNamedEntity", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.5, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::nodes::Attribute::getValidKey", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::nodes::Element::wholeOwnText", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.6, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::internal::LegacyMatching::hasAttributeFlag", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::nodes::DocumentType::systemId", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.25, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::select::Collector::findFirst", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.5, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::json::JSONObject::putOnce", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.5, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONObject::toMap", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::XMLParserConfiguration::getXsiTypeMap", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONTokener::more", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.4, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONPointer::queryFrom", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::XMLParserConfiguration::withKeepBooleanAsString", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.5, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONTokener::nextClean", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONTokener::getJsonParserConfiguration", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONArray::toList", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONParserConfiguration::isOverwriteDuplicateKey", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONTokener::nextValue", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONObject::putOpt", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::XMLTokener::nextMeta", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::XML::noSpace", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::ParserConfiguration::isKeepStrings", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::ParserConfiguration::getMaxNumberLength", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONParserConfiguration::getMaxSharedKeys", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::XMLParserConfiguration::getForceList", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONObject::numberToString", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONObject::keys", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.1, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::XMLTokener::nextCDATA", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONTokener::nextString", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONParserConfiguration::isStrictMode", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::XMLParserConfiguration::isConvertNilAttributeToNull", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::XMLTokener::skipPast", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.75, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::XMLParserConfiguration::shouldTrimWhiteSpace", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.3333333333333333, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONParserConfiguration::isUseNativeNulls", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.6666666666666666, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONTokener::back", + "lang": "java", + "grep_recall": 1.0, + "grep_precision": 0.9285714285714286, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "semver::identifier::Identifier::ptr_eq", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "semver" + }, + { + "symbol": "semver::eval::matches_req", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "semver" + }, + { + "symbol": "semver::identifier::Identifier::new_unchecked", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 0.3333333333333333, + "recall": 1.0, + "precision": 1.0, + "repo": "semver" + }, + { + "symbol": "semver::eval::matches_comparator", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "semver" + }, + { + "symbol": "semver::identifier::Identifier::empty", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 0.7142857142857143, + "recall": 1.0, + "precision": 1.0, + "repo": "semver" + }, + { + "symbol": "indexmap::map::IndexMap::sort_unstable_keys", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::slice::Slice::split_last_mut", + "lang": "rust", + "grep_recall": null, + "grep_precision": null, + "recall": null, + "precision": null, + "repo": "indexmap" + }, + { + "symbol": "indexmap::set::IndexSet::take", + "lang": "rust", + "grep_recall": null, + "grep_precision": 0.0, + "recall": null, + "precision": null, + "repo": "indexmap" + }, + { + "symbol": "indexmap::set::IndexSet::is_disjoint", + "lang": "rust", + "grep_recall": null, + "grep_precision": null, + "recall": null, + "precision": null, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::entry::Entry::or_default", + "lang": "rust", + "grep_recall": null, + "grep_precision": null, + "recall": null, + "precision": null, + "repo": "indexmap" + }, + { + "symbol": "indexmap::set::IndexSet::is_subset", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::serde::cautious_capacity", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::set::IndexSet::difference", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::raw_entry_v1::RawEntryBuilder::index_from_hash", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 0.6666666666666666, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::inner::Core::split_splice", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::IndexMap::last_entry", + "lang": "rust", + "grep_recall": null, + "grep_precision": null, + "recall": null, + "precision": null, + "repo": "indexmap" + }, + { + "symbol": "indexmap::inner::extract::ExtractCore::remaining", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 0.4, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::raw_entry_v1::RawOccupiedEntryMut::into_key_value_mut", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::IndexMap::sort_keys", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::set::IndexSet::sort_unstable", + "lang": "rust", + "grep_recall": null, + "grep_precision": null, + "recall": null, + "precision": null, + "repo": "indexmap" + }, + { + "symbol": "indexmap::set::IndexSet::union", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::inner::Core::replace_index_unique", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::rayon::set::IndexSet::par_is_disjoint", + "lang": "rust", + "grep_recall": null, + "grep_precision": null, + "recall": null, + "precision": null, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::IndexMap::contains_key", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::inner::Core::retain_in_order", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::rayon::set::IndexSet::par_difference", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::inner::Core::shift_insert_unique", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::rayon::set::IndexSet::par_symmetric_difference", + "lang": "rust", + "grep_recall": null, + "grep_precision": null, + "recall": null, + "precision": null, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::slice::Slice::new_mut", + "lang": "rust", + "grep_recall": null, + "grep_precision": null, + "recall": null, + "precision": null, + "repo": "indexmap" + }, + { + "symbol": "indexmap::rayon::set::IndexSet::par_is_superset", + "lang": "rust", + "grep_recall": null, + "grep_precision": null, + "recall": null, + "precision": null, + "repo": "indexmap" + }, + { + "symbol": "indexmap::util::assert_index_le", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::slice::Slice::split_first_mut", + "lang": "rust", + "grep_recall": null, + "grep_precision": null, + "recall": null, + "precision": null, + "repo": "indexmap" + }, + { + "symbol": "indexmap::util::third", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::rayon::set::IndexSet::par_union", + "lang": "rust", + "grep_recall": null, + "grep_precision": null, + "recall": null, + "precision": null, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::raw_entry_v1::RawVacantEntryMut::shift_insert_hashed_nocheck", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::slice::Slice::from_mut_slice", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 0.9230769230769231, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::set::IndexSet::swap_take", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::IndexMap::get_disjoint_indices_mut", + "lang": "rust", + "grep_recall": null, + "grep_precision": null, + "recall": null, + "precision": null, + "repo": "indexmap" + }, + { + "symbol": "indexmap::set::IndexSet::is_superset", + "lang": "rust", + "grep_recall": null, + "grep_precision": null, + "recall": null, + "precision": null, + "repo": "indexmap" + }, + { + "symbol": "indexmap::set::IndexSet::intersection", + "lang": "rust", + "grep_recall": 1.0, + "grep_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + } + ], + "tests": [ + { + "symbol": "main::Command::NamePadding", + "lang": "go", + "tests_in_project": 279, + "failing": 21, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.5488560706865635, + "random_precision": 0.07526881720430108, + "recall": 0.9047619047619048, + "precision": 0.152, + "caught": 0.0, + "repo": "cobra" + }, + { + "symbol": "main::CheckErr", + "lang": "go", + "tests_in_project": 279, + "failing": 109, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.9936592586039631, + "random_precision": 0.3906810035842294, + "recall": 0.926605504587156, + "precision": 0.4353448275862069, + "caught": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::CommandPathPadding", + "lang": "go", + "tests_in_project": 279, + "failing": 1, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.03584229390681004, + "random_precision": 0.0035842293906810036, + "recall": 1.0, + "precision": 0.008, + "caught": 0.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::Print", + "lang": "go", + "tests_in_project": 279, + "failing": 59, + "grep_recall": 0.05084745762711865, + "grep_precision": 0.75, + "grep_caught": 1.0, + "random_caught": 0.9111001119408798, + "random_precision": 0.2114695340501792, + "recall": 1.0, + "precision": 0.28095238095238095, + "caught": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::OutOrStderr", + "lang": "go", + "tests_in_project": 279, + "failing": 87, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.9779038133828912, + "random_precision": 0.3118279569892473, + "recall": 0.9885057471264368, + "precision": 0.4236453201970443, + "caught": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::PrintErrf", + "lang": "go", + "tests_in_project": 279, + "failing": 7, + "grep_recall": 0.14285714285714285, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.2276720226509943, + "random_precision": 0.025089605734767026, + "recall": 0.8571428571428571, + "precision": 0.02926829268292683, + "caught": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::MinimumNArgs", + "lang": "go", + "tests_in_project": 279, + "failing": 204, + "grep_recall": 0.058823529411764705, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.9999987609302428, + "random_precision": 0.7311827956989247, + "recall": 0.9803921568627451, + "precision": 0.9803921568627451, + "caught": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::LocalFlags", + "lang": "go", + "tests_in_project": 279, + "failing": 149, + "grep_recall": 0.026845637583892617, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.9996017886852806, + "random_precision": 0.5340501792114696, + "recall": 0.053691275167785234, + "precision": 0.8888888888888888, + "caught": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::ValidateFlagGroups", + "lang": "go", + "tests_in_project": 279, + "failing": 116, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.9958847744282068, + "random_precision": 0.4157706093189964, + "recall": 0.9655172413793104, + "precision": 0.5544554455445545, + "caught": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::PrintErrln", + "lang": "go", + "tests_in_project": 279, + "failing": 61, + "grep_recall": 0.01639344262295082, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.9190158553981986, + "random_precision": 0.21863799283154123, + "recall": 0.9836065573770492, + "precision": 0.2898550724637681, + "caught": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::Help", + "lang": "go", + "tests_in_project": 279, + "failing": 7, + "grep_recall": 0.14285714285714285, + "grep_precision": 0.5, + "grep_caught": 1.0, + "random_caught": 0.2276720226509943, + "random_precision": 0.025089605734767026, + "recall": 1.0, + "precision": 0.03139013452914798, + "caught": 0.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::CalledAs", + "lang": "go", + "tests_in_project": 279, + "failing": 47, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.8471441329375758, + "random_precision": 0.16845878136200718, + "recall": 1.0, + "precision": 0.23039215686274508, + "caught": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::CompErrorln", + "lang": "go", + "tests_in_project": 279, + "failing": 1, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.03584229390681004, + "random_precision": 0.0035842293906810036, + "recall": 1.0, + "precision": 0.0049261083743842365, + "caught": 0.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::InitDefaultVersionFlag", + "lang": "go", + "tests_in_project": 279, + "failing": 197, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.9999968022463755, + "random_precision": 0.7060931899641577, + "recall": 0.9796954314720813, + "precision": 0.8894009216589862, + "caught": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::Commands", + "lang": "go", + "tests_in_project": 279, + "failing": 96, + "grep_recall": 0.09375, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.9864906607155625, + "random_precision": 0.34408602150537637, + "recall": 1.0, + "precision": 0.4155844155844156, + "caught": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::FlagErrorFunc", + "lang": "go", + "tests_in_project": 279, + "failing": 17, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.4723858789618397, + "random_precision": 0.06093189964157706, + "recall": 1.0, + "precision": 0.08415841584158416, + "caught": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::SetGlobalNormalizationFunc", + "lang": "go", + "tests_in_project": 279, + "failing": 4, + "grep_recall": 1.0, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.13654020252438714, + "random_precision": 0.014336917562724014, + "recall": 1.0, + "precision": 0.017467248908296942, + "caught": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::UseLine", + "lang": "go", + "tests_in_project": 279, + "failing": 86, + "grep_recall": 0.023255813953488372, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.9766963714912459, + "random_precision": 0.30824372759856633, + "recall": 0.11627906976744186, + "precision": 0.5263157894736842, + "caught": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::GenZshCompletion", + "lang": "go", + "tests_in_project": 279, + "failing": 3, + "grep_recall": 0.6666666666666666, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.10407930788244679, + "random_precision": 0.010752688172043012, + "recall": 1.0, + "precision": 0.014634146341463415, + "caught": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::Root", + "lang": "go", + "tests_in_project": 279, + "failing": 248, + "grep_recall": 0.012096774193548387, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.9999999999337033, + "random_precision": 0.8888888888888888, + "recall": 0.9435483870967742, + "precision": 0.9873417721518988, + "caught": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::HasPersistentFlags", + "lang": "go", + "tests_in_project": 279, + "failing": 4, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.13654020252438714, + "random_precision": 0.014336917562724014, + "recall": 1.0, + "precision": 0.36363636363636365, + "caught": 1.0, + "repo": "cobra" + }, + { + "symbol": "middleware::GetLogEntry", + "lang": "go", + "tests_in_project": 137, + "failing": 2, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.14115500214684418, + "random_precision": 0.014598540145985401, + "recall": 0.0, + "precision": 0.0, + "caught": 0.0, + "repo": "chi" + }, + { + "symbol": "main::Chain", + "lang": "go", + "tests_in_project": 137, + "failing": 11, + "grep_recall": 0.09090909090909091, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.5798438839888738, + "random_precision": 0.08029197080291971, + "recall": 0.18181818181818182, + "precision": 1.0, + "caught": 1.0, + "repo": "chi" + }, + { + "symbol": "middleware::NewCompressor", + "lang": "go", + "tests_in_project": 137, + "failing": 3, + "grep_recall": 0.6666666666666666, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.20477315013596675, + "random_precision": 0.021897810218978103, + "recall": 1.0, + "precision": 1.0, + "caught": 1.0, + "repo": "chi" + }, + { + "symbol": "main::Walk", + "lang": "go", + "tests_in_project": 137, + "failing": 5, + "grep_recall": 1.0, + "grep_precision": 0.8333333333333334, + "grep_caught": 1.0, + "random_caught": 0.319447878233294, + "random_precision": 0.0364963503649635, + "recall": 1.0, + "precision": 1.0, + "caught": 1.0, + "repo": "chi" + }, + { + "symbol": "main::RouteContext", + "lang": "go", + "tests_in_project": 137, + "failing": 31, + "grep_recall": 0.06451612903225806, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.930532393433657, + "random_precision": 0.22627737226277372, + "recall": 0.7419354838709677, + "precision": 0.8518518518518519, + "caught": 1.0, + "repo": "chi" + }, + { + "symbol": "main::NewMux", + "lang": "go", + "tests_in_project": 137, + "failing": 101, + "grep_recall": 0.009900990099009901, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.9999994456574952, + "random_precision": 0.7372262773722628, + "recall": 0.9801980198019802, + "precision": 0.9519230769230769, + "caught": 1.0, + "repo": "chi" + }, + { + "symbol": "middleware::GetClientIPAddr", + "lang": "go", + "tests_in_project": 137, + "failing": 24, + "grep_recall": 0.08333333333333333, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.8645943699316276, + "random_precision": 0.17518248175182483, + "recall": 0.7916666666666666, + "precision": 1.0, + "caught": 1.0, + "repo": "chi" + }, + { + "symbol": "main::Middlewares::HandlerFunc", + "lang": "go", + "tests_in_project": 137, + "failing": 1, + "grep_recall": 1.0, + "grep_precision": 0.03125, + "grep_caught": 0.0, + "random_caught": 0.07299270072992703, + "random_precision": 0.0072992700729927005, + "recall": 0.0, + "precision": 0.0, + "caught": 0.0, + "repo": "chi" + }, + { + "symbol": "main::URLParamFromCtx", + "lang": "go", + "tests_in_project": 137, + "failing": 20, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.8054769888315447, + "random_precision": 0.145985401459854, + "recall": 1.0, + "precision": 0.8695652173913043, + "caught": 1.0, + "repo": "chi" + }, + { + "symbol": "middleware::GetReqID", + "lang": "go", + "tests_in_project": 137, + "failing": 4, + "grep_recall": 0.25, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.2641184374392529, + "random_precision": 0.029197080291970802, + "recall": 0.25, + "precision": 1.0, + "caught": 1.0, + "repo": "chi" + }, + { + "symbol": "main::Mux::NotFoundHandler", + "lang": "go", + "tests_in_project": 137, + "failing": 14, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.6728332744572041, + "random_precision": 0.10218978102189781, + "recall": 0.6428571428571429, + "precision": 0.20930232558139536, + "caught": 1.0, + "repo": "chi" + }, + { + "symbol": "middleware::NewWrapResponseWriter", + "lang": "go", + "tests_in_project": 137, + "failing": 5, + "grep_recall": 0.4, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.319447878233294, + "random_precision": 0.0364963503649635, + "recall": 0.6, + "precision": 0.375, + "caught": 1.0, + "repo": "chi" + }, + { + "symbol": "middleware::compressResponseWriter::Close", + "lang": "go", + "tests_in_project": 137, + "failing": 2, + "grep_recall": 1.0, + "grep_precision": 0.03773584905660377, + "grep_caught": 1.0, + "random_caught": 0.14115500214684418, + "random_precision": 0.014598540145985401, + "recall": 1.0, + "precision": 0.043478260869565216, + "caught": 1.0, + "repo": "chi" + }, + { + "symbol": "main::endpoints::Value", + "lang": "go", + "tests_in_project": 137, + "failing": 105, + "grep_recall": 0.0761904761904762, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.9999998593087098, + "random_precision": 0.7664233576642335, + "recall": 0.45714285714285713, + "precision": 0.9230769230769231, + "caught": 1.0, + "repo": "chi" + }, + { + "symbol": "main::Mux::MethodNotAllowedHandler", + "lang": "go", + "tests_in_project": 137, + "failing": 4, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.2641184374392529, + "random_precision": 0.029197080291970802, + "recall": 1.0, + "precision": 0.0975609756097561, + "caught": 1.0, + "repo": "chi" + }, + { + "symbol": "middleware::HeaderRoute::IsMatch", + "lang": "go", + "tests_in_project": 137, + "failing": 1, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.07299270072992703, + "random_precision": 0.0072992700729927005, + "recall": 1.0, + "precision": 0.5, + "caught": 1.0, + "repo": "chi" + }, + { + "symbol": "click::types::Path::coerce_path_result", + "lang": "python", + "tests_in_project": 617, + "failing": 9, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.13759676087580708, + "random_precision": 0.014586709886547812, + "recall": 0.0, + "precision": 0.0, + "caught": 0.0, + "repo": "click" + }, + { + "symbol": "click::core::Option::get_help_extra", + "lang": "python", + "tests_in_project": 617, + "failing": 92, + "grep_recall": 0.11956521739130435, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.8036060818619305, + "random_precision": 0.14910858995137763, + "recall": 0.11956521739130435, + "precision": 1.0, + "caught": 1.0, + "repo": "click" + }, + { + "symbol": "click::formatting::HelpFormatter::write_heading", + "lang": "python", + "tests_in_project": 617, + "failing": 78, + "grep_recall": 0.01282051282051282, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.7439049345582556, + "random_precision": 0.12641815235008103, + "recall": 0.1282051282051282, + "precision": 0.43478260869565216, + "caught": 1.0, + "repo": "click" + }, + { + "symbol": "click::formatting::HelpFormatter::indentation", + "lang": "python", + "tests_in_project": 617, + "failing": 11, + "grep_recall": 0.09090909090909091, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.16575497814214757, + "random_precision": 0.017828200972447326, + "recall": 0.45454545454545453, + "precision": 0.21739130434782608, + "caught": 1.0, + "repo": "click" + }, + { + "symbol": "click::globals::push_context", + "lang": "python", + "tests_in_project": 617, + "failing": 379, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.9999352071545414, + "random_precision": 0.6142625607779578, + "recall": 0.0, + "precision": 0.0, + "caught": 0.0, + "repo": "click" + }, + { + "symbol": "click::_textwrap::TextWrapper::extra_indent", + "lang": "python", + "tests_in_project": 617, + "failing": 79, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.7486562344736867, + "random_precision": 0.1280388978930308, + "recall": 0.012658227848101266, + "precision": 0.08333333333333333, + "caught": 1.0, + "repo": "click" + }, + { + "symbol": "click::termui::confirm", + "lang": "python", + "tests_in_project": 617, + "failing": 6, + "grep_recall": 0.6666666666666666, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.09375385508629863, + "random_precision": 0.009724473257698542, + "recall": 0.8333333333333334, + "precision": 0.07352941176470588, + "caught": 1.0, + "repo": "click" + }, + { + "symbol": "click::decorators::argument", + "lang": "python", + "tests_in_project": 617, + "failing": 86, + "grep_recall": 0.9883720930232558, + "grep_precision": 0.8333333333333334, + "grep_caught": 1.0, + "random_caught": 0.7797550547231733, + "random_precision": 0.1393841166936791, + "recall": 0.9883720930232558, + "precision": 0.8854166666666666, + "caught": 1.0, + "repo": "click" + }, + { + "symbol": "click::testing::make_input_stream", + "lang": "python", + "tests_in_project": 617, + "failing": 359, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.9998526033361366, + "random_precision": 0.5818476499189628, + "recall": 0.016713091922005572, + "precision": 1.0, + "caught": 1.0, + "repo": "click" + }, + { + "symbol": "click::utils::format_filename", + "lang": "python", + "tests_in_project": 617, + "failing": 8, + "grep_recall": 0.125, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.12319937791880886, + "random_precision": 0.012965964343598054, + "recall": 0.125, + "precision": 1.0, + "caught": 1.0, + "repo": "click" + }, + { + "symbol": "click::formatting::HelpFormatter::indent", + "lang": "python", + "tests_in_project": 617, + "failing": 78, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.7439049345582556, + "random_precision": 0.12641815235008103, + "recall": 0.1282051282051282, + "precision": 0.43478260869565216, + "caught": 1.0, + "repo": "click" + }, + { + "symbol": "click::_compat::get_text_stdout", + "lang": "python", + "tests_in_project": 617, + "failing": 292, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.9984615168400393, + "random_precision": 0.473257698541329, + "recall": 0.0136986301369863, + "precision": 0.25, + "caught": 1.0, + "repo": "click" + }, + { + "symbol": "click::_termui_impl::Editor::get_editor", + "lang": "python", + "tests_in_project": 617, + "failing": 8, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.12319937791880886, + "random_precision": 0.012965964343598054, + "recall": 1.0, + "precision": 0.8888888888888888, + "caught": 1.0, + "repo": "click" + }, + { + "symbol": "click::types::Choice::get_invalid_choice_message", + "lang": "python", + "tests_in_project": 617, + "failing": 8, + "grep_recall": 0.125, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.12319937791880886, + "random_precision": 0.012965964343598054, + "recall": 0.125, + "precision": 1.0, + "caught": 1.0, + "repo": "click" + }, + { + "symbol": "click::testing::_NamedTextIOWrapper::fileno", + "lang": "python", + "tests_in_project": 617, + "failing": 2, + "grep_recall": 0.5, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.03217811362057721, + "random_precision": 0.0032414910858995136, + "recall": 1.0, + "precision": 0.044444444444444446, + "caught": 1.0, + "repo": "click" + }, + { + "symbol": "click::core::Command::get_short_help_str", + "lang": "python", + "tests_in_project": 617, + "failing": 13, + "grep_recall": 0.07692307692307693, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.19308302743574823, + "random_precision": 0.02106969205834684, + "recall": 0.0, + "precision": 0.0, + "caught": 0.0, + "repo": "click" + }, + { + "symbol": "click::core::Context::get_parameter_source", + "lang": "python", + "tests_in_project": 617, + "failing": 370, + "grep_recall": 0.01891891891891892, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.9999054199420013, + "random_precision": 0.5996758508914101, + "recall": 0.021621621621621623, + "precision": 1.0, + "caught": 1.0, + "repo": "click" + }, + { + "symbol": "click::_compat::open_stream", + "lang": "python", + "tests_in_project": 617, + "failing": 17, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.24533542797769103, + "random_precision": 0.027552674230145867, + "recall": 0.47058823529411764, + "precision": 0.5, + "caught": 1.0, + "repo": "click" + }, + { + "symbol": "click::_termui_impl::ProgressBar::format_bar", + "lang": "python", + "tests_in_project": 617, + "failing": 9, + "grep_recall": 0.1111111111111111, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.13759676087580708, + "random_precision": 0.014586709886547812, + "recall": 0.3333333333333333, + "precision": 1.0, + "caught": 1.0, + "repo": "click" + }, + { + "symbol": "click::_termui_impl::ProgressBar::format_progress_line", + "lang": "python", + "tests_in_project": 617, + "failing": 8, + "grep_recall": 0.25, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.12319937791880886, + "random_precision": 0.012965964343598054, + "recall": 0.25, + "precision": 1.0, + "caught": 1.0, + "repo": "click" + }, + { + "symbol": "click::core::Parameter::value_is_missing", + "lang": "python", + "tests_in_project": 617, + "failing": 59, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.6368344885099197, + "random_precision": 0.09562398703403566, + "recall": 0.0, + "precision": 0.0, + "caught": 0.0, + "repo": "click" + }, + { + "symbol": "click::utils::make_str", + "lang": "python", + "tests_in_project": 617, + "failing": 45, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.5337811222700758, + "random_precision": 0.07293354943273905, + "recall": 0.1111111111111111, + "precision": 0.19230769230769232, + "caught": 1.0, + "repo": "click" + }, + { + "symbol": "click::testing::_FDCapture::start", + "lang": "python", + "tests_in_project": 617, + "failing": 7, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.10858603421745572, + "random_precision": 0.011345218800648298, + "recall": 1.0, + "precision": 0.15555555555555556, + "caught": 0.0, + "repo": "click" + }, + { + "symbol": "sqlparse::engine::grouping::group_values", + "lang": "python", + "tests_in_project": 324, + "failing": 226, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.9999954129648345, + "random_precision": 0.6975308641975309, + "recall": 0.28761061946902655, + "precision": 0.5241935483870968, + "caught": 1.0, + "repo": "sqlparse" + }, + { + "symbol": "sqlparse::lexer::Lexer::default_initialization", + "lang": "python", + "tests_in_project": 324, + "failing": 190, + "grep_recall": 0.010526315789473684, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.9998805748319977, + "random_precision": 0.5864197530864198, + "recall": 0.021052631578947368, + "precision": 0.3333333333333333, + "caught": 1.0, + "repo": "sqlparse" + }, + { + "symbol": "sqlparse::parsestream", + "lang": "python", + "tests_in_project": 324, + "failing": 167, + "grep_recall": 0.017964071856287425, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.9993870927451058, + "random_precision": 0.5154320987654321, + "recall": 1.0, + "precision": 1.0, + "caught": 1.0, + "repo": "sqlparse" + }, + { + "symbol": "sqlparse::sql::TokenList::insert_before", + "lang": "python", + "tests_in_project": 324, + "failing": 49, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.8108115068442763, + "random_precision": 0.15123456790123457, + "recall": 0.0, + "precision": 0.0, + "caught": 0.0, + "repo": "sqlparse" + }, + { + "symbol": "sqlparse::engine::grouping::group_comments", + "lang": "python", + "tests_in_project": 324, + "failing": 234, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.9999981264083126, + "random_precision": 0.7222222222222222, + "recall": 0.2905982905982906, + "precision": 0.5483870967741935, + "caught": 1.0, + "repo": "sqlparse" + }, + { + "symbol": "sqlparse::engine::grouping::group_typed_literal", + "lang": "python", + "tests_in_project": 324, + "failing": 226, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.9999954129648345, + "random_precision": 0.6975308641975309, + "recall": 0.28761061946902655, + "precision": 0.5241935483870968, + "caught": 1.0, + "repo": "sqlparse" + }, + { + "symbol": "sqlparse::engine::grouping::group_where", + "lang": "python", + "tests_in_project": 324, + "failing": 226, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.9999954129648345, + "random_precision": 0.6975308641975309, + "recall": 0.28761061946902655, + "precision": 0.5241935483870968, + "caught": 1.0, + "repo": "sqlparse" + }, + { + "symbol": "sqlparse::engine::grouping::group_arrays", + "lang": "python", + "tests_in_project": 324, + "failing": 226, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.9999954129648345, + "random_precision": 0.6975308641975309, + "recall": 0.28761061946902655, + "precision": 0.5241935483870968, + "caught": 1.0, + "repo": "sqlparse" + }, + { + "symbol": "sqlparse::sql::TokenList::token_not_matching", + "lang": "python", + "tests_in_project": 324, + "failing": 26, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.572102296498137, + "random_precision": 0.08024691358024691, + "recall": 0.0, + "precision": 0.0, + "caught": 0.0, + "repo": "sqlparse" + }, + { + "symbol": "sqlparse::engine::grouping::group_assignment", + "lang": "python", + "tests_in_project": 324, + "failing": 226, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.9999954129648345, + "random_precision": 0.6975308641975309, + "recall": 0.28761061946902655, + "precision": 0.5241935483870968, + "caught": 1.0, + "repo": "sqlparse" + }, + { + "symbol": "sqlparse::sql::TokenList::token_next_by", + "lang": "python", + "tests_in_project": 324, + "failing": 234, + "grep_recall": 0.017094017094017096, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.9999981264083126, + "random_precision": 0.7222222222222222, + "recall": 0.0811965811965812, + "precision": 1.0, + "caught": 1.0, + "repo": "sqlparse" + }, + { + "symbol": "sqlparse::formatter::validate_options", + "lang": "python", + "tests_in_project": 324, + "failing": 102, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.9786360898653805, + "random_precision": 0.3148148148148148, + "recall": 0.8725490196078431, + "precision": 0.967391304347826, + "caught": 1.0, + "repo": "sqlparse" + }, + { + "symbol": "sqlparse::engine::grouping::align_comments", + "lang": "python", + "tests_in_project": 324, + "failing": 226, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.9999954129648345, + "random_precision": 0.6975308641975309, + "recall": 0.28761061946902655, + "precision": 0.5241935483870968, + "caught": 1.0, + "repo": "sqlparse" + }, + { + "symbol": "sqlparse::cli::create_parser", + "lang": "python", + "tests_in_project": 324, + "failing": 21, + "grep_recall": 0.047619047619047616, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.49334869651937485, + "random_precision": 0.06481481481481481, + "recall": 1.0, + "precision": 0.9545454545454546, + "caught": 1.0, + "repo": "sqlparse" + }, + { + "symbol": "sqlparse::formatter::build_filter_stack", + "lang": "python", + "tests_in_project": 324, + "failing": 93, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.967952090989916, + "random_precision": 0.28703703703703703, + "recall": 0.8709677419354839, + "precision": 0.8804347826086957, + "caught": 1.0, + "repo": "sqlparse" + }, + { + "symbol": "sqlparse::sql::IdentifierList::get_identifiers", + "lang": "python", + "tests_in_project": 324, + "failing": 28, + "grep_recall": 0.10714285714285714, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.6003851424688724, + "random_precision": 0.08641975308641975, + "recall": 0.14285714285714285, + "precision": 0.5, + "caught": 1.0, + "repo": "sqlparse" + }, + { + "symbol": "sqlparse::parse", + "lang": "python", + "tests_in_project": 324, + "failing": 164, + "grep_recall": 1.0, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.999255217072014, + "random_precision": 0.5061728395061729, + "recall": 1.0, + "precision": 0.9879518072289156, + "caught": 1.0, + "repo": "sqlparse" + }, + { + "symbol": "sqlparse::sql::TokenList::token_first", + "lang": "python", + "tests_in_project": 324, + "failing": 8, + "grep_recall": 0.25, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.2239981552531528, + "random_precision": 0.024691358024691357, + "recall": 1.0, + "precision": 1.0, + "caught": 1.0, + "repo": "sqlparse" + }, + { + "symbol": "sqlparse::engine::grouping::group_over", + "lang": "python", + "tests_in_project": 324, + "failing": 226, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.9999954129648345, + "random_precision": 0.6975308641975309, + "recall": 0.28761061946902655, + "precision": 0.5241935483870968, + "caught": 1.0, + "repo": "sqlparse" + }, + { + "symbol": "sqlparse::sql::TokenList::insert_after", + "lang": "python", + "tests_in_project": 324, + "failing": 11, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.29558220490217213, + "random_precision": 0.033950617283950615, + "recall": 0.0, + "precision": 0.0, + "caught": 0.0, + "repo": "sqlparse" + }, + { + "symbol": "src::middleware::persist::createJSONStorage", + "lang": "typescript", + "tests_in_project": 16, + "failing": 6, + "grep_recall": 0.5, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.9998751248751249, + "random_precision": 0.375, + "recall": 0.5, + "precision": 1.0, + "caught": 1.0, + "repo": "zustand" + }, + { + "symbol": "src::compose::resolve_end::resolveEnd", + "lang": "typescript", + "tests_in_project": 28, + "failing": 19, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 1.0, + "random_precision": 0.6785714285714286, + "recall": 0.5789473684210527, + "precision": 0.8461538461538461, + "caught": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::nodes::toJS::ToJSContext::resolveAlias", + "lang": "typescript", + "tests_in_project": 28, + "failing": 6, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.9507246376811594, + "random_precision": 0.21428571428571427, + "recall": 0.0, + "precision": 0.0, + "caught": 0.0, + "repo": "yaml" + }, + { + "symbol": "src::public_api::parseAllDocuments", + "lang": "typescript", + "tests_in_project": 28, + "failing": 4, + "grep_recall": 1.0, + "grep_precision": 0.8, + "grep_caught": 1.0, + "random_caught": 0.8505494505494505, + "random_precision": 0.14285714285714285, + "recall": 0.25, + "precision": 0.5, + "caught": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::nodes::YAMLMap::YAMLMap::#stringifyFlowMap", + "lang": "typescript", + "tests_in_project": 28, + "failing": 8, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.9859213250517598, + "random_precision": 0.2857142857142857, + "recall": 0.0, + "precision": 0.0, + "caught": 0.0, + "repo": "yaml" + }, + { + "symbol": "src::compose::util_flow_indent_check::flowIndentCheck", + "lang": "typescript", + "tests_in_project": 28, + "failing": 1, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.3571428571428571, + "random_precision": 0.03571428571428571, + "recall": 0.0, + "precision": 0.0, + "caught": 0.0, + "repo": "yaml" + }, + { + "symbol": "src::compose::compose_collection::composeCollection", + "lang": "typescript", + "tests_in_project": 28, + "failing": 17, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.9999991617840588, + "random_precision": 0.6071428571428571, + "recall": 0.0, + "precision": 0.0, + "caught": 0.0, + "repo": "yaml" + }, + { + "symbol": "src::doc::Document::Document::setSchema", + "lang": "typescript", + "tests_in_project": 28, + "failing": 20, + "grep_recall": 0.05, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 1.0, + "random_precision": 0.7142857142857143, + "recall": 0.05, + "precision": 1.0, + "caught": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::doc::directives::Directives::atDocument", + "lang": "typescript", + "tests_in_project": 28, + "failing": 18, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.9999999237985508, + "random_precision": 0.6428571428571429, + "recall": 0.0, + "precision": 0.0, + "caught": 0.0, + "repo": "yaml" + }, + { + "symbol": "src::nodes::YAMLSeq::YAMLSeq::#stringifyBlockSeq", + "lang": "typescript", + "tests_in_project": 28, + "failing": 12, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.9993897787948132, + "random_precision": 0.42857142857142855, + "recall": 0.0, + "precision": 0.0, + "caught": 0.0, + "repo": "yaml" + }, + { + "symbol": "src::compose::composer::Composer::compose", + "lang": "typescript", + "tests_in_project": 28, + "failing": 17, + "grep_recall": 0.058823529411764705, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.9999991617840588, + "random_precision": 0.6071428571428571, + "recall": 0.7058823529411765, + "precision": 0.8571428571428571, + "caught": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::nodes::toJS::ToJSContext::setAnchor", + "lang": "typescript", + "tests_in_project": 28, + "failing": 6, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.9507246376811594, + "random_precision": 0.21428571428571427, + "recall": 0.0, + "precision": 0.0, + "caught": 0.0, + "repo": "yaml" + }, + { + "symbol": "src::doc::NodeCreator::NodeCreator::setAnchors", + "lang": "typescript", + "tests_in_project": 28, + "failing": 20, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 1.0, + "random_precision": 0.7142857142857143, + "recall": 0.35, + "precision": 1.0, + "caught": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::compose::resolve_block_seq::resolveBlockSeq", + "lang": "typescript", + "tests_in_project": 28, + "failing": 13, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.9997711670480549, + "random_precision": 0.4642857142857143, + "recall": 0.0, + "precision": 0.0, + "caught": 0.0, + "repo": "yaml" + }, + { + "symbol": "src::compose::compose_scalar::composeScalar", + "lang": "typescript", + "tests_in_project": 28, + "failing": 18, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.9999999237985508, + "random_precision": 0.6428571428571429, + "recall": 0.0, + "precision": 0.0, + "caught": 0.0, + "repo": "yaml" + }, + { + "symbol": "src::parse::cst::tokenType", + "lang": "typescript", + "tests_in_project": 28, + "failing": 19, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 1.0, + "random_precision": 0.6785714285714286, + "recall": 0.631578947368421, + "precision": 0.8571428571428571, + "caught": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::compose::util_contains_newline::containsNewline", + "lang": "typescript", + "tests_in_project": 28, + "failing": 17, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.9999991617840588, + "random_precision": 0.6071428571428571, + "recall": 0.0, + "precision": 0.0, + "caught": 0.0, + "repo": "yaml" + }, + { + "symbol": "src::nodes::YAMLSet::YAMLSet::#stringifyBlockSet", + "lang": "typescript", + "tests_in_project": 28, + "failing": 2, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.5952380952380952, + "random_precision": 0.07142857142857142, + "recall": 0.0, + "precision": 0.0, + "caught": 0.0, + "repo": "yaml" + }, + { + "symbol": "src::compose::compose_doc::composeDoc", + "lang": "typescript", + "tests_in_project": 28, + "failing": 18, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.9999999237985508, + "random_precision": 0.6428571428571429, + "recall": 0.6111111111111112, + "precision": 0.8461538461538461, + "caught": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::schema::yaml_1_1::pairs::resolvePairs", + "lang": "typescript", + "tests_in_project": 28, + "failing": 4, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.8505494505494505, + "random_precision": 0.14285714285714285, + "recall": 0.0, + "precision": 0.0, + "caught": 0.0, + "repo": "yaml" + }, + { + "symbol": "src::parse::lexer::Lexer::flow", + "lang": "typescript", + "tests_in_project": 28, + "failing": 15, + "grep_recall": 0.6, + "grep_precision": 0.75, + "grep_caught": 1.0, + "random_caught": 0.999978206385529, + "random_precision": 0.5357142857142857, + "recall": 0.6, + "precision": 0.5625, + "caught": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::nodes::YAMLSet::YAMLSet::#stringifyFlowSet", + "lang": "typescript", + "tests_in_project": 28, + "failing": 1, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.3571428571428571, + "random_precision": 0.03571428571428571, + "recall": 0.0, + "precision": 0.0, + "caught": 0.0, + "repo": "yaml" + }, + { + "symbol": "org::jsoup::internal::SoftPool::release", + "lang": "java", + "tests_in_project": 2378, + "failing": 1755, + "grep_recall": 0.0011396011396011395, + "grep_precision": 0.4, + "grep_caught": 1.0, + "random_caught": 0.99999855635295, + "random_precision": 0.7380151387720774, + "recall": 0.46495726495726497, + "precision": 0.9784172661870504, + "caught": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::internal::StringUtil::appendNormalisedWhitespace", + "lang": "java", + "tests_in_project": 2378, + "failing": 446, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.8752473255562776, + "random_precision": 0.18755256518082422, + "recall": 0.289237668161435, + "precision": 0.9148936170212766, + "caught": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::internal::LegacyMatching::cssAttributeMatches", + "lang": "java", + "tests_in_project": 2378, + "failing": 7, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.029104007116137143, + "random_precision": 0.002943650126156434, + "recall": 0.0, + "precision": 0.0, + "caught": 0.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::select::Evaluator::asPredicate", + "lang": "java", + "tests_in_project": 2378, + "failing": 957, + "grep_recall": 0.0010449320794148381, + "grep_precision": 0.3333333333333333, + "grep_caught": 1.0, + "random_caught": 0.9942685081448507, + "random_precision": 0.4024390243902439, + "recall": 0.022988505747126436, + "precision": 0.9565217391304348, + "caught": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::parser::TokenQueue::matchesWord", + "lang": "java", + "tests_in_project": 2378, + "failing": 1717, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.9999973793045361, + "random_precision": 0.7220353238015139, + "recall": 0.0029120559114735, + "precision": 0.22727272727272727, + "caught": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::internal::StringUtil::isAsciiLetter", + "lang": "java", + "tests_in_project": 2378, + "failing": 1699, + "grep_recall": 0.0005885815185403178, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.9999965652828249, + "random_precision": 0.7144659377628259, + "recall": 0.020011771630370805, + "precision": 0.8717948717948718, + "caught": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::parser::TokenQueue::matchesWhitespace", + "lang": "java", + "tests_in_project": 2378, + "failing": 1721, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.9999975346765789, + "random_precision": 0.723717409587889, + "recall": 0.06624055781522371, + "precision": 0.957983193277311, + "caught": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::nodes::DocumentType::publicId", + "lang": "java", + "tests_in_project": 2378, + "failing": 115, + "grep_recall": 0.017391304347826087, + "grep_precision": 0.5, + "grep_caught": 1.0, + "random_caught": 0.391433199512111, + "random_precision": 0.048359966358284275, + "recall": 0.02608695652173913, + "precision": 0.42857142857142855, + "caught": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::safety::Safelist::addTags", + "lang": "java", + "tests_in_project": 2378, + "failing": 72, + "grep_recall": 0.19444444444444445, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.26511864358830706, + "random_precision": 0.030277544154751892, + "recall": 0.9861111111111112, + "precision": 1.0, + "caught": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::internal::StringUtil::isActuallyWhitespace", + "lang": "java", + "tests_in_project": 2378, + "failing": 446, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.8752473255562776, + "random_precision": 0.18755256518082422, + "recall": 0.27802690582959644, + "precision": 0.9393939393939394, + "caught": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::nodes::Attributes::getIgnoreCase", + "lang": "java", + "tests_in_project": 2378, + "failing": 610, + "grep_recall": 0.001639344262295082, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.9487304271632875, + "random_precision": 0.25651808242220353, + "recall": 0.3540983606557377, + "precision": 0.8605577689243028, + "caught": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::parser::Parser::getMaxDepth", + "lang": "java", + "tests_in_project": 2378, + "failing": 1467, + "grep_recall": 0.0013633265167007499, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.9999339660764205, + "random_precision": 0.6169049621530698, + "recall": 0.0027266530334014998, + "precision": 0.4, + "caught": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::parser::Tag::isFormSubmittable", + "lang": "java", + "tests_in_project": 2378, + "failing": 16, + "grep_recall": 0.0625, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.06540251019163634, + "random_precision": 0.00672834314550042, + "recall": 1.0, + "precision": 0.9411764705882353, + "caught": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::nodes::Attributes::removeIgnoreCase", + "lang": "java", + "tests_in_project": 2378, + "failing": 28, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.11189986534420693, + "random_precision": 0.011774600504625737, + "recall": 0.07142857142857142, + "precision": 0.06451612903225806, + "caught": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::parser::Token::Doctype::getSystemIdentifier", + "lang": "java", + "tests_in_project": 2378, + "failing": 130, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.4306648479964671, + "random_precision": 0.054667788057190914, + "recall": 0.0, + "precision": 0.0, + "caught": 0.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::internal::Normalizer::lowerCase", + "lang": "java", + "tests_in_project": 2378, + "failing": 1689, + "grep_recall": 0.0005920663114268798, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.9999960206960907, + "random_precision": 0.7102607232968882, + "recall": 0.6956779159265838, + "precision": 0.9932375316990701, + "caught": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::internal::StringUtil::trimAsciiWhitespace", + "lang": "java", + "tests_in_project": 2378, + "failing": 1811, + "grep_recall": 0.0005521811154058532, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.9999994411703161, + "random_precision": 0.7615643397813289, + "recall": 0.07675317504141359, + "precision": 0.9858156028368794, + "caught": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::safety::Safelist::addEnforcedAttribute", + "lang": "java", + "tests_in_project": 2378, + "failing": 38, + "grep_recall": 0.07894736842105263, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.1490456721978064, + "random_precision": 0.0159798149705635, + "recall": 1.0, + "precision": 1.0, + "caught": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::parser::TokenQueue::consumeCssIdentifier", + "lang": "java", + "tests_in_project": 2378, + "failing": 383, + "grep_recall": 0.013054830287206266, + "grep_precision": 0.8333333333333334, + "grep_caught": 1.0, + "random_caught": 0.8279209034869162, + "random_precision": 0.16105971404541633, + "recall": 0.02349869451697128, + "precision": 0.9, + "caught": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::nodes::Attributes::deduplicate", + "lang": "java", + "tests_in_project": 2378, + "failing": 780, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.9813952241318153, + "random_precision": 0.3280067283431455, + "recall": 0.010256410256410256, + "precision": 1.0, + "caught": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::nodes::Entities::isNamedEntity", + "lang": "java", + "tests_in_project": 2378, + "failing": 51, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.19524307054387502, + "random_precision": 0.02144659377628259, + "recall": 0.1568627450980392, + "precision": 0.3333333333333333, + "caught": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::json::JSONObject::putOnce", + "lang": "java", + "tests_in_project": 714, + "failing": 5, + "grep_recall": 0.8, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.06827988941690588, + "random_precision": 0.0070028011204481795, + "recall": 1.0, + "precision": 0.028901734104046242, + "caught": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONObject::toMap", + "lang": "java", + "tests_in_project": 714, + "failing": 2, + "grep_recall": 0.5, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.027834415673702817, + "random_precision": 0.0028011204481792717, + "recall": 1.0, + "precision": 0.011627906976744186, + "caught": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::XMLParserConfiguration::getXsiTypeMap", + "lang": "java", + "tests_in_project": 714, + "failing": 22, + "grep_recall": 0.045454545454545456, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.27020528674338695, + "random_precision": 0.03081232492997199, + "recall": 1.0, + "precision": 0.27848101265822783, + "caught": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONTokener::more", + "lang": "java", + "tests_in_project": 714, + "failing": 136, + "grep_recall": 0.007352941176470588, + "grep_precision": 0.25, + "grep_caught": 1.0, + "random_caught": 0.8809330185308577, + "random_precision": 0.19047619047619047, + "recall": 1.0, + "precision": 0.9444444444444444, + "caught": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONPointer::queryFrom", + "lang": "java", + "tests_in_project": 714, + "failing": 70, + "grep_recall": 0.07142857142857142, + "grep_precision": 0.8333333333333334, + "grep_caught": 1.0, + "random_caught": 0.6461059405042328, + "random_precision": 0.09803921568627451, + "recall": 1.0, + "precision": 0.9859154929577465, + "caught": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::XMLParserConfiguration::withKeepBooleanAsString", + "lang": "java", + "tests_in_project": 714, + "failing": 2, + "grep_recall": 1.0, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.027834415673702817, + "random_precision": 0.0028011204481792717, + "recall": 1.0, + "precision": 0.02531645569620253, + "caught": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONTokener::nextClean", + "lang": "java", + "tests_in_project": 714, + "failing": 271, + "grep_recall": 0.0036900369003690036, + "grep_precision": 0.5, + "grep_caught": 1.0, + "random_caught": 0.9918695535161292, + "random_precision": 0.3795518207282913, + "recall": 0.02214022140221402, + "precision": 1.0, + "caught": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONTokener::getJsonParserConfiguration", + "lang": "java", + "tests_in_project": 714, + "failing": 271, + "grep_recall": 0.01845018450184502, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.9918695535161292, + "random_precision": 0.3795518207282913, + "recall": 0.01845018450184502, + "precision": 1.0, + "caught": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONObject::putOpt", + "lang": "java", + "tests_in_project": 714, + "failing": 3, + "grep_recall": 0.3333333333333333, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.041488426689521685, + "random_precision": 0.004201680672268907, + "recall": 0.6666666666666666, + "precision": 0.011627906976744186, + "caught": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::ParserConfiguration::isKeepStrings", + "lang": "java", + "tests_in_project": 714, + "failing": 34, + "grep_recall": 0.058823529411764705, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.3880360166173408, + "random_precision": 0.047619047619047616, + "recall": 1.0, + "precision": 0.2857142857142857, + "caught": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::ParserConfiguration::getMaxNumberLength", + "lang": "java", + "tests_in_project": 714, + "failing": 82, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.7071782077449031, + "random_precision": 0.11484593837535013, + "recall": 0.32926829268292684, + "precision": 0.1956521739130435, + "caught": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONParserConfiguration::getMaxSharedKeys", + "lang": "java", + "tests_in_project": 714, + "failing": 224, + "grep_recall": 0.004464285714285714, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.9774924653287883, + "random_precision": 0.3137254901960784, + "recall": 0.16517857142857142, + "precision": 0.6166666666666667, + "caught": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::XMLParserConfiguration::getForceList", + "lang": "java", + "tests_in_project": 714, + "failing": 64, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.6114641822542841, + "random_precision": 0.0896358543417367, + "recall": 1.0, + "precision": 0.8205128205128205, + "caught": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::XMLTokener::nextMeta", + "lang": "java", + "tests_in_project": 714, + "failing": 6, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.0814212167876125, + "random_precision": 0.008403361344537815, + "recall": 1.0, + "precision": 0.05128205128205128, + "caught": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::XML::noSpace", + "lang": "java", + "tests_in_project": 714, + "failing": 12, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.15682662090543287, + "random_precision": 0.01680672268907563, + "recall": 1.0, + "precision": 0.8571428571428571, + "caught": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::XMLTokener::nextCDATA", + "lang": "java", + "tests_in_project": 714, + "failing": 5, + "grep_recall": 0.2, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.06827988941690588, + "random_precision": 0.0070028011204481795, + "recall": 1.0, + "precision": 0.0423728813559322, + "caught": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONObject::numberToString", + "lang": "java", + "tests_in_project": 714, + "failing": 46, + "grep_recall": 0.08695652173913043, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.4884593296419453, + "random_precision": 0.06442577030812324, + "recall": 0.1956521739130435, + "precision": 0.5625, + "caught": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONTokener::nextString", + "lang": "java", + "tests_in_project": 714, + "failing": 235, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.9821024251200787, + "random_precision": 0.3291316526610644, + "recall": 0.02127659574468085, + "precision": 1.0, + "caught": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONParserConfiguration::isStrictMode", + "lang": "java", + "tests_in_project": 714, + "failing": 268, + "grep_recall": 0.04477611940298507, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.9912958421246861, + "random_precision": 0.3753501400560224, + "recall": 0.05223880597014925, + "precision": 1.0, + "caught": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::XMLParserConfiguration::isConvertNilAttributeToNull", + "lang": "java", + "tests_in_project": 714, + "failing": 22, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.27020528674338695, + "random_precision": 0.03081232492997199, + "recall": 1.0, + "precision": 0.28205128205128205, + "caught": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::XMLTokener::skipPast", + "lang": "java", + "tests_in_project": 714, + "failing": 88, + "grep_recall": 0.022727272727272728, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.7340031216191236, + "random_precision": 0.12324929971988796, + "recall": 1.0, + "precision": 0.7394957983193278, + "caught": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::XMLParserConfiguration::shouldTrimWhiteSpace", + "lang": "java", + "tests_in_project": 714, + "failing": 93, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.7546448014765259, + "random_precision": 0.13025210084033614, + "recall": 1.0, + "precision": 0.7815126050420168, + "caught": 1.0, + "repo": "json-java" + }, + { + "symbol": "semver::identifier::Identifier::ptr_eq", + "lang": "rust", + "tests_in_project": 47, + "failing": 20, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.9983707654988475, + "random_precision": 0.425531914893617, + "recall": 0.0, + "precision": 0.0, + "caught": 0.0, + "repo": "semver" + }, + { + "symbol": "semver::eval::matches_req", + "lang": "rust", + "tests_in_project": 47, + "failing": 11, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.9509108576186449, + "random_precision": 0.23404255319148937, + "recall": 1.0, + "precision": 1.0, + "caught": 1.0, + "repo": "semver" + }, + { + "symbol": "semver::identifier::Identifier::new_unchecked", + "lang": "rust", + "tests_in_project": 47, + "failing": 24, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.9997790553781912, + "random_precision": 0.5106382978723404, + "recall": 0.8333333333333334, + "precision": 0.9090909090909091, + "caught": 1.0, + "repo": "semver" + }, + { + "symbol": "indexmap::map::IndexMap::sort_unstable_keys", + "lang": "rust", + "tests_in_project": 172, + "failing": 1, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.05813953488372092, + "random_precision": 0.005813953488372093, + "recall": 1.0, + "precision": 0.14285714285714285, + "caught": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::set::IndexSet::is_subset", + "lang": "rust", + "tests_in_project": 172, + "failing": 4, + "grep_recall": 0.25, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.21476831735641977, + "random_precision": 0.023255813953488372, + "recall": 0.5, + "precision": 0.4, + "caught": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::set::IndexSet::difference", + "lang": "rust", + "tests_in_project": 172, + "failing": 2, + "grep_recall": 0.5, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.11321909424724608, + "random_precision": 0.011627906976744186, + "recall": 0.5, + "precision": 0.2, + "caught": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::inner::extract::ExtractCore::remaining", + "lang": "rust", + "tests_in_project": 172, + "failing": 2, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.11321909424724608, + "random_precision": 0.011627906976744186, + "recall": 0.0, + "precision": 0.0, + "caught": 0.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::set::IndexSet::contains", + "lang": "rust", + "tests_in_project": 172, + "failing": 5, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.26150829846615664, + "random_precision": 0.029069767441860465, + "recall": 0.6, + "precision": 0.6, + "caught": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::util::simplify_range", + "lang": "rust", + "tests_in_project": 172, + "failing": 6, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.3057293584382431, + "random_precision": 0.03488372093023256, + "recall": 0.0, + "precision": 0.0, + "caught": 0.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::disjoint::get_disjoint_opt_mut", + "lang": "rust", + "tests_in_project": 172, + "failing": 8, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.38709514008896373, + "random_precision": 0.046511627906976744, + "recall": 1.0, + "precision": 0.8888888888888888, + "caught": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::set::IndexSet::union", + "lang": "rust", + "tests_in_project": 172, + "failing": 2, + "grep_recall": 0.5, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.11321909424724608, + "random_precision": 0.011627906976744186, + "recall": 0.5, + "precision": 0.2, + "caught": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::inner::Core::replace_index_unique", + "lang": "rust", + "tests_in_project": 172, + "failing": 2, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.11321909424724608, + "random_precision": 0.011627906976744186, + "recall": 0.5, + "precision": 0.5, + "caught": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::IndexMap::contains_key", + "lang": "rust", + "tests_in_project": 172, + "failing": 15, + "grep_recall": 0.6666666666666666, + "grep_precision": 0.9090909090909091, + "grep_caught": 1.0, + "random_caught": 0.6087823339424827, + "random_precision": 0.0872093023255814, + "recall": 0.26666666666666666, + "precision": 1.0, + "caught": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::inner::Core::retain_in_order", + "lang": "rust", + "tests_in_project": 172, + "failing": 2, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.11321909424724608, + "random_precision": 0.011627906976744186, + "recall": 0.5, + "precision": 0.5, + "caught": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::inner::Core::shift_insert_unique", + "lang": "rust", + "tests_in_project": 172, + "failing": 6, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.3057293584382431, + "random_precision": 0.03488372093023256, + "recall": 0.0, + "precision": 0.0, + "caught": 0.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::util::try_simplify_range", + "lang": "rust", + "tests_in_project": 172, + "failing": 3, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.16538267693858444, + "random_precision": 0.01744186046511628, + "recall": 1.0, + "precision": 1.0, + "caught": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::slice::Slice::from_mut_slice", + "lang": "rust", + "tests_in_project": 172, + "failing": 13, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.5543184197942612, + "random_precision": 0.0755813953488372, + "recall": 0.9230769230769231, + "precision": 1.0, + "caught": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::util::assert_index_le", + "lang": "rust", + "tests_in_project": 172, + "failing": 6, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.3057293584382431, + "random_precision": 0.03488372093023256, + "recall": 1.0, + "precision": 0.75, + "caught": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::util::third", + "lang": "rust", + "tests_in_project": 172, + "failing": 11, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.4931232889139149, + "random_precision": 0.06395348837209303, + "recall": 0.0, + "precision": 0.0, + "caught": 0.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::raw_entry_v1::RawVacantEntryMut::shift_insert_hashed_nocheck", + "lang": "rust", + "tests_in_project": 172, + "failing": 1, + "grep_recall": 0.0, + "grep_precision": 0.0, + "grep_caught": 0.0, + "random_caught": 0.05813953488372092, + "random_precision": 0.005813953488372093, + "recall": 0.0, + "precision": 0.0, + "caught": 0.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::set::IndexSet::swap_take", + "lang": "rust", + "tests_in_project": 172, + "failing": 2, + "grep_recall": 0.5, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.11321909424724608, + "random_precision": 0.011627906976744186, + "recall": 1.0, + "precision": 0.25, + "caught": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::set::IndexSet::intersection", + "lang": "rust", + "tests_in_project": 172, + "failing": 2, + "grep_recall": 0.5, + "grep_precision": 1.0, + "grep_caught": 1.0, + "random_caught": 0.11321909424724608, + "random_precision": 0.011627906976744186, + "recall": 0.5, + "precision": 0.2, + "caught": 1.0, + "repo": "indexmap" + } + ] +} \ No newline at end of file diff --git a/eval/results/latest.baselines.md b/eval/results/latest.baselines.md new file mode 100644 index 0000000..05cfd6e --- /dev/null +++ b/eval/results/latest.baselines.md @@ -0,0 +1,46 @@ +# Baselines on the functions of the run `latest` + +The search for the name: `git grep -w ` in the files of the language; every hit is put into the function around it (callers) or counted for the test whose body has it (tests). The truth is the run's own: the compiler's uses, the tests that fail when the function throws. ± is half of a 90% bootstrap interval over the functions. + +## Callers — names that occur once + +| | functions | search: recall | search: precision | gitnext: recall | gitnext: precision | +|---|---|---|---|---|---| +| all | 232 | 100% ±0 | 89% ±3 | 100% ±0 | 99% ±1 | +| go | 71 | 100% ±0 | 92% ±4 | 100% ±0 | 98% ±2 | +| rust | 37 | 100% ±0 | 94% ±4 | 99% ±1 | 100% ±0 | +| java | 85 | 100% ±0 | 83% ±5 | 100% ±0 | 100% ±0 | +| typescript | 39 | 100% ±0 | 91% ±6 | 100% ±0 | 100% ±0 | + +## Callers — methods that share a name + +| | functions | search: recall | search: precision | gitnext: recall | gitnext: precision | +|---|---|---|---|---|---| +| all | 108 | 100% ±0 | 32% ±4 | 83% ±5 | 99% ±1 | +| go | 11 | 100% ±0 | 23% ±4 | 73% ±23 | 100% ±0 | +| rust | 31 | 100% ±0 | 27% ±7 | 80% ±11 | 99% ±1 | +| java | 56 | 100% ±0 | 36% ±6 | 90% ±6 | 99% ±1 | +| typescript | 10 | 100% ±0 | 32% ±19 | 65% ±25 | 100% ±0 | + +## Callers — whether or not gitnext sees a caller + +| | functions | search: recall | search: precision | gitnext: recall | gitnext: precision | +|---|---|---|---|---|---| +| all | 163 | 100% ±0 | 89% ±3 | 99% ±1 | 100% ±0 | +| go | 40 | 100% ±0 | 95% ±4 | 100% ±0 | 99% ±1 | +| rust | 26 | 100% ±0 | 89% ±8 | 100% ±0 | 100% ±0 | +| java | 63 | 100% ±0 | 84% ±5 | 98% ±3 | 100% ±0 | +| typescript | 34 | 100% ±0 | 89% ±7 | 100% ±0 | 100% ±0 | + +## The tests of a function + +"Caught": at least one of the first 10 tests named fails when the function throws. "Ten at random": the chance of that for ten tests drawn from all tests of the project; their precision is the share of the project's tests that fail. + +| | functions | ten at random: caught | ten at random: precision | search: caught | search: recall | search: precision | gitnext: caught | gitnext: recall | gitnext: precision | +|---|---|---|---|---|---|---|---|---|---| +| all | 167 | 61% ±5 | 24% ±3 | 47% ±6 | 12% ±3 | 43% ±6 | 79% ±5 | 49% ±5 | 50% ±5 | +| go | 37 | 57% ±10 | 21% ±7 | 57% ±14 | 19% ±9 | 52% ±13 | 84% ±9 | 79% ±9 | 47% ±10 | +| rust | 22 | 34% ±10 | 8% ±4 | 27% ±16 | 13% ±8 | 27% ±16 | 73% ±14 | 53% ±14 | 43% ±13 | +| java | 43 | 59% ±10 | 22% ±6 | 63% ±12 | 8% ±5 | 55% ±12 | 95% ±5 | 49% ±11 | 61% ±10 | +| typescript | 22 | 90% ±7 | 43% ±8 | 23% ±14 | 10% ±8 | 21% ±14 | 41% ±18 | 19% ±9 | 34% ±15 | +| python | 43 | 64% ±9 | 29% ±7 | 44% ±12 | 11% ±6 | 44% ±12 | 81% ±9 | 36% ±9 | 53% ±10 | diff --git a/eval/results/latest.codebase-memory.json b/eval/results/latest.codebase-memory.json new file mode 100644 index 0000000..08690fb --- /dev/null +++ b/eval/results/latest.codebase-memory.json @@ -0,0 +1,4778 @@ +{ + "callers": [ + { + "symbol": "main::Command::NamePadding", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::CheckErr", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::CommandPathPadding", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::GenPowerShellCompletionWithDesc", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::Print", + "lang": "go", + "other_recall": 1.0, + "other_precision": 0.75, + "recall": 1.0, + "precision": 0.75, + "repo": "cobra" + }, + { + "symbol": "main::Command::OutOrStderr", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::PrintErrf", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::MinimumNArgs", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::Flags", + "lang": "go", + "other_recall": 0.8571428571428571, + "other_precision": 0.8571428571428571, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::LocalFlags", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::Println", + "lang": "go", + "other_recall": 1.0, + "other_precision": 0.6, + "recall": 1.0, + "precision": 0.75, + "repo": "cobra" + }, + { + "symbol": "main::Command::Execute", + "lang": "go", + "other_recall": 1.0, + "other_precision": 0.5, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::CalledAs", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::HasAvailableInheritedFlags", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::Parent", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::CompError", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::CompErrorln", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::LocalNonPersistentFlags", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::ParseFlags", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::InitDefaultCompletionCmd", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::ValidateFlagGroups", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::PrintErrln", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::Help", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::HasParent", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::InitDefaultVersionFlag", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::Commands", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::HelpFunc", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "doc::GenMarkdownCustom", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::GenBashCompletionV2", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::InheritedFlags", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::Root", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "doc::GenMarkdownTreeCustom", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::FlagErrorFunc", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::SetGlobalNormalizationFunc", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::UseLine", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::GenZshCompletion", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::HasPersistentFlags", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::PrintErr", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "doc::GenYamlCustom", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::HasSubCommands", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::Traverse", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::SuggestionsFor", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::Usage", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::ValidateArgs", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::HasFlags", + "lang": "go", + "other_recall": 1.0, + "other_precision": 0.2, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "middleware::GetLogEntry", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "main::Chain", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "middleware::NewCompressor", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "main::RouteContext", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "middleware::RequestLogger", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "main::NewMux", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "middleware::GetClientIPAddr", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "main::Middlewares::HandlerFunc", + "lang": "go", + "other_recall": 1.0, + "other_precision": 0.05405405405405406, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "main::NewRouteContext", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "middleware::NewPattern", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "main::Context::RoutePattern", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "main::Mux::NotFoundHandler", + "lang": "go", + "other_recall": 0.6666666666666666, + "other_precision": 0.6666666666666666, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "main::endpoints::Value", + "lang": "go", + "other_recall": 1.0, + "other_precision": 0.14285714285714285, + "recall": 1.0, + "precision": 0.25, + "repo": "chi" + }, + { + "symbol": "main::node::InsertRoute", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "main::node::FindRoute", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "main::URLParamFromCtx", + "lang": "go", + "other_recall": 0.0, + "other_precision": 0.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "middleware::GetReqID", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "middleware::NewWrapResponseWriter", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "middleware::compressResponseWriter::Close", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "main::NewRouter", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "middleware::Compressor::SetEncoder", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "main::Mux::MethodNotAllowedHandler", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "middleware::PrintPrettyStack", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "middleware::HeaderRoute::IsMatch", + "lang": "go", + "other_recall": 0.0, + "other_precision": 0.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "middleware::ThrottleWithOpts", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "middleware::WithLogEntry", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "src::middleware::persist::createJSONStorage", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "zustand" + }, + { + "symbol": "src::compose::resolve_flow_scalar::resolveFlowScalar", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::compose::resolve_end::resolveEnd", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::nodes::toJS::ToJSContext::resolveAlias", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::public_api::parseAllDocuments", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::nodes::YAMLMap::YAMLMap::#stringifyFlowMap", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::compose::util_flow_indent_check::flowIndentCheck", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::compose::compose_collection::composeCollection", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::doc::Document::Document::setSchema", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::doc::directives::Directives::atDocument", + "lang": "typescript", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::compose::resolve_flow_collection::resolveFlowCollection", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::compose::resolve_block_scalar::resolveBlockScalar", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::nodes::YAMLMap::YAMLMap::#stringifyBlockMap", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::public_api::parseDocument", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::doc::anchors::anchorIsValid", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::nodes::toJS::ToJSContext::setAnchor", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::doc::anchors::anchorNames", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::parse::cst::prettyToken", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::log::warn", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::nodes::toJS::ToJSContext::setSource", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::stringify::stringifyComment::lineComment", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::nodes::YAMLSeq::YAMLSeq::#stringifyBlockSeq", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::compose::composer::Composer::compose", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::doc::NodeCreator::NodeCreator::setAnchors", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::compose::resolve_block_seq::resolveBlockSeq", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::compose::compose_scalar::composeScalar", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::parse::cst::tokenType", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::parse::lexer::Lexer::flow", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::compose::resolve_block_map::resolveBlockMap", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::nodes::YAMLSet::YAMLSet::#stringifyFlowSet", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::nodes::YAMLSeq::YAMLSeq::#stringifyFlowSeq", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::compose::util_contains_newline::containsNewline", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::nodes::YAMLSet::YAMLSet::#stringifyBlockSet", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::compose::compose_doc::composeDoc", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::schema::yaml_1_1::pairs::resolvePairs", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::stringify::stringify::createStringifyContext", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::schema::tags::getTags", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::errors::prettifyError", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::compose::resolve_props::resolveProps", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "org::jsoup::internal::SoftPool::release", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::internal::StringUtil::appendNormalisedWhitespace", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::internal::LegacyMatching::cssAttributeMatches", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::select::Evaluator::asPredicate", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::parser::TokenQueue::matchesWord", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::internal::StringUtil::isAsciiLetter", + "lang": "java", + "other_recall": 0.8, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::parser::TokenQueue::matchesWhitespace", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::nodes::DocumentType::publicId", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::parser::ParseErrorList::tracking", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::nodes::Node::ownerDocument", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::select::Collector::findFirst", + "lang": "java", + "other_recall": 1.0, + "other_precision": 0.75, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::internal::CssMatching::isQuirksMode", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::nodes::Attributes::hasKey", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::internal::NamespaceBindings::isDeclaration", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::select::Collector::streamNodes", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::Jsoup::newSession", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::nodes::Document::location", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::nodes::Entities::isBaseNamedEntity", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::nodes::Attribute::getValue", + "lang": "java", + "other_recall": 1.0, + "other_precision": 0.37037037037037035, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::nodes::Element::wholeOwnText", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::safety::Safelist::addTags", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::internal::StringUtil::isActuallyWhitespace", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::nodes::Attributes::getIgnoreCase", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::parser::Parser::getMaxDepth", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::parser::Tag::isFormSubmittable", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::nodes::Attributes::removeIgnoreCase", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::parser::Token::Doctype::getSystemIdentifier", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::internal::Normalizer::lowerCase", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::parser::TokenQueue::remainder", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::select::Selector::evaluatorOf", + "lang": "java", + "other_recall": 0.8, + "other_precision": 1.0, + "recall": 0.8, + "precision": 0.8, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::nodes::Range::AttributeRange::valueRange", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::nodes::TextNode::getWholeText", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::internal::LineMap::addLineStart", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::parser::Tag::isInline", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::nodes::Element::lastElementChild", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::parser::Parser::isTrackErrors", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::internal::LegacyMatching::attributeMatches", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::nodes::Range::AttributeRange::nameRange", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::nodes::DocumentType::systemId", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::internal::StringUtil::trimAsciiWhitespace", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::safety::Safelist::addEnforcedAttribute", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::parser::TokenQueue::consumeCssIdentifier", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::nodes::Attributes::deduplicate", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::nodes::Entities::isNamedEntity", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::nodes::Attribute::getValidKey", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::internal::LegacyMatching::hasAttributeFlag", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::nodes::Node::siblingIndex", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::nodes::Attributes::normalize", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::internal::StringUtil::joining", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::json::JSONObject::putOnce", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONObject::toMap", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::XMLParserConfiguration::getXsiTypeMap", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONTokener::more", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONPointer::queryFrom", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::XMLParserConfiguration::withKeepBooleanAsString", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONTokener::nextClean", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONTokener::getJsonParserConfiguration", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONArray::toList", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONParserConfiguration::isOverwriteDuplicateKey", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONTokener::nextValue", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONObject::putOpt", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::XMLTokener::nextMeta", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::XML::noSpace", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::XMLParserConfiguration::isKeepNumberAsString", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::XMLParserConfiguration::withKeepNumberAsString", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONTokener::nextString", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONParserConfiguration::getMaxSharedKeys", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONParserConfiguration::isUseNativeNulls", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::ParserConfiguration::isKeepStrings", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::ParserConfiguration::getMaxNumberLength", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::XMLParserConfiguration::getForceList", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONObject::numberToString", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONObject::keys", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::ParserConfiguration::getMaxNestingDepth", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONTokener::dehexchar", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONParserConfiguration::isStrictMode", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::XMLParserConfiguration::isCloseEmptyTag", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONObject::accumulate", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::XMLTokener::nextCDATA", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::XMLParserConfiguration::isConvertNilAttributeToNull", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::XMLTokener::skipPast", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::XMLParserConfiguration::shouldTrimWhiteSpace", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONTokener::back", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::XMLParserConfiguration::isKeepBooleanAsString", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::XMLTokener::nextEntity", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "semver::identifier::Identifier::ptr_eq", + "lang": "rust", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "semver" + }, + { + "symbol": "semver::eval::matches_req", + "lang": "rust", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "semver" + }, + { + "symbol": "semver::identifier::Identifier::new_unchecked", + "lang": "rust", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "semver" + }, + { + "symbol": "semver::eval::matches_comparator", + "lang": "rust", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "semver" + }, + { + "symbol": "semver::identifier::Identifier::empty", + "lang": "rust", + "other_recall": 0.6, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "semver" + }, + { + "symbol": "indexmap::map::IndexMap::sort_unstable_keys", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::set::IndexSet::is_subset", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::serde::cautious_capacity", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::set::IndexSet::difference", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::raw_entry_v1::RawEntryBuilder::index_from_hash", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::inner::Core::split_splice", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::inner::extract::ExtractCore::remaining", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::raw_entry_v1::RawOccupiedEntryMut::into_key_value_mut", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::IndexMap::sort_keys", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::raw_entry_v1::RawVacantEntryMut::insert_hashed_nocheck", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::set::IndexSet::contains", + "lang": "rust", + "other_recall": 0.0, + "other_precision": 0.0, + "recall": 0.8, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::util::simplify_range", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::rayon::set::IndexSet::par_is_subset", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::disjoint::get_disjoint_opt_mut", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::set::IndexSet::union", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::util::assert_index_lt", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::util::try_simplify_range", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::inner::Core::shift_insert_unique", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::set::IndexSet::swap_take", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::inner::Core::replace_index_unique", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::IndexMap::contains_key", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::inner::Core::retain_in_order", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::rayon::set::IndexSet::par_difference", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::inner::Core::get_index_of_raw", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::slice::Slice::from_mut_slice", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 0.9230769230769231, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::set::IndexSet::intersection", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::util::third", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::util::assert_index_le", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::raw_entry_v1::RawVacantEntryMut::shift_insert_hashed_nocheck", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::IndexMap::get_index_entry", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::set::IndexSet::symmetric_difference", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::util::slice_eq", + "lang": "rust", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + } + ], + "callers_common": [ + { + "symbol": "main::Command::MarkFlagRequired", + "lang": "go", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Mux::Method", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "main::Context::Reset", + "lang": "go", + "other_recall": 0.0, + "other_precision": 0.0, + "recall": 0.0, + "precision": null, + "repo": "chi" + }, + { + "symbol": "main::Mux::Find", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "main::Context::URLParam", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "main::Mux::Mount", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "main::Mux::With", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "main::Mux::Handle", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "main::Mux::MethodNotAllowed", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 0.0, + "precision": null, + "repo": "chi" + }, + { + "symbol": "main::Mux::NotFound", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 0.0, + "precision": null, + "repo": "chi" + }, + { + "symbol": "main::Middlewares::Handler", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "src::doc::NodeCreator::NodeCreator::createPair", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::nodes::YAMLSet::YAMLSet::keyOf", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 0.0, + "precision": null, + "repo": "yaml" + }, + { + "symbol": "src::parse::parser::Parser::next", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::nodes::YAMLMap::YAMLMap::create", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::parse::lexer::Lexer::document", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::doc::directives::Directives::tagName", + "lang": "typescript", + "other_recall": 0.0, + "other_precision": null, + "recall": 0.0, + "precision": null, + "repo": "yaml" + }, + { + "symbol": "src::parse::lexer::Lexer::stream", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::nodes::YAMLMap::YAMLMap::getPair", + "lang": "typescript", + "other_recall": 0.5, + "other_precision": 1.0, + "recall": 0.5, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::nodes::YAMLSeq::YAMLSeq::create", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::nodes::YAMLSeq::YAMLSeq::tagName", + "lang": "typescript", + "other_recall": 0.0, + "other_precision": null, + "recall": 0.0, + "precision": null, + "repo": "yaml" + }, + { + "symbol": "org::jsoup::parser::Tag::isSelfClosing", + "lang": "java", + "other_recall": 1.0, + "other_precision": 0.5, + "recall": 0.6666666666666666, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::nodes::Document::shallowClone", + "lang": "java", + "other_recall": 1.0, + "other_precision": 0.5, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::internal::StringUtil::isWhitespace", + "lang": "java", + "other_recall": 0.9375, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::internal::ControllableInputStream::onProgress", + "lang": "java", + "other_recall": 0.0, + "other_precision": 0.0, + "recall": 0.0, + "precision": null, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::helper::Regex::compile", + "lang": "java", + "other_recall": 1.0, + "other_precision": 0.8571428571428571, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::nodes::Node::normalName", + "lang": "java", + "other_recall": 0.25, + "other_precision": 0.5, + "recall": 0.75, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::parser::Tag::getName", + "lang": "java", + "other_recall": 1.0, + "other_precision": 0.5, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::nodes::Document::body", + "lang": "java", + "other_recall": 0.42857142857142855, + "other_precision": 1.0, + "recall": 0.8571428571428571, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::parser::TokenQueue::escapeCssIdentifier", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::nodes::NodeInternals::sourceDataStart", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::parser::Parser::parseAttributes", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::internal::StringUtil::normaliseWhitespace", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::parser::Parser::unescapeEntities", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::nodes::NodeInternals::clearEndSourceRange", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::nodes::Element::toggleClass", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::parser::CharacterReader::current", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 0.8888888888888888, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::parser::Tag::localName", + "lang": "java", + "other_recall": 0.0, + "other_precision": null, + "recall": 0.0, + "precision": null, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::nodes::Attributes::attribute", + "lang": "java", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::parser::Tag::isBlock", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::internal::CssMatching::sameType", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::helper::HttpConnection::Base::multiHeaders", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 0.0, + "precision": null, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::nodes::Attribute::prefix", + "lang": "java", + "other_recall": 1.0, + "other_precision": 0.75, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::parser::Tag::isEmpty", + "lang": "java", + "other_recall": 0.8, + "other_precision": 0.5714285714285714, + "recall": 0.8, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::nodes::Node::hasAttr", + "lang": "java", + "other_recall": 0.2727272727272727, + "other_precision": 1.0, + "recall": 0.9090909090909091, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::internal::NamespaceBindings::clear", + "lang": "java", + "other_recall": 1.0, + "other_precision": 0.25, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::nodes::Attributes::dataset", + "lang": "java", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::select::Elements::forms", + "lang": "java", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::parser::TokenQueue::advance", + "lang": "java", + "other_recall": 0.875, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::internal::QueryMode::current", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::nodes::Element::removeClass", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::parser::TokenQueue::matchesAny", + "lang": "java", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::nodes::Element::addClass", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::nodes::Attributes::size", + "lang": "java", + "other_recall": 0.6666666666666666, + "other_precision": 1.0, + "recall": 0.7777777777777778, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::internal::LineMap::complete", + "lang": "java", + "other_recall": 1.0, + "other_precision": 0.3333333333333333, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::nodes::Node::nodeValue", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::internal::StringUtil::isBlank", + "lang": "java", + "other_recall": 1.0, + "other_precision": 0.9090909090909091, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::internal::ControllableInputStream::resetFullyRead", + "lang": "java", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::nodes::Element::hasText", + "lang": "java", + "other_recall": 0.6666666666666666, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::parser::Tag::prefix", + "lang": "java", + "other_recall": 0.0, + "other_precision": null, + "recall": 0.0, + "precision": null, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::nodes::Comment::getData", + "lang": "java", + "other_recall": 1.0, + "other_precision": 0.8333333333333334, + "recall": 1.0, + "precision": 0.7142857142857143, + "repo": "jsoup" + }, + { + "symbol": "org::json::Cookie::escape", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONArray::getJSONObject", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONArray::similar", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONObject::valueToString", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONObject::isEmpty", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONObject::getBoolean", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::Cookie::unescape", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONArray::remove", + "lang": "java", + "other_recall": 1.0, + "other_precision": 0.3333333333333333, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::XMLTokener::nextToken", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONArray::length", + "lang": "java", + "other_recall": 1.0, + "other_precision": 0.4186046511627907, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONArray::getString", + "lang": "java", + "other_recall": 1.0, + "other_precision": 0.75, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONArray::getBoolean", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONArray::isEmpty", + "lang": "java", + "other_recall": 1.0, + "other_precision": 0.17647058823529413, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONObject::length", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::XML::escape", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::HTTPTokener::nextToken", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "semver::BuildMetadata::as_str", + "lang": "rust", + "other_recall": 0.5, + "other_precision": 0.5, + "recall": 1.0, + "precision": 1.0, + "repo": "semver" + }, + { + "symbol": "semver::identifier::Identifier::is_empty", + "lang": "rust", + "other_recall": 1.0, + "other_precision": 0.26666666666666666, + "recall": 1.0, + "precision": 1.0, + "repo": "semver" + }, + { + "symbol": "indexmap::set::IndexSet::with_capacity", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::inner::Core::drain", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 0.5, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::raw_entry_v1::RawOccupiedEntryMut::swap_remove_entry", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::inner::Core::with_entries", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::IndexMap::append", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::set::IndexSet::sort_unstable_by_key", + "lang": "rust", + "other_recall": null, + "other_precision": null, + "recall": null, + "precision": null, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::IndexMap::move_index", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 0.5, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::slice::Slice::binary_search_by", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 0.75, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::IndexMap::clear", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::inner::Core::truncate", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::inner::entry::OccupiedEntry::into_core", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::IndexMap::swap_remove", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::entry::IndexedEntry::get_mut", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::IndexMap::get_key_value", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::IndexMap::hasher", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::IndexMap::is_empty", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::slice::Slice::partition_point", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 0.0, + "precision": null, + "repo": "indexmap" + }, + { + "symbol": "indexmap::set::IndexSet::split_off", + "lang": "rust", + "other_recall": null, + "other_precision": null, + "recall": null, + "precision": null, + "repo": "indexmap" + }, + { + "symbol": "indexmap::inner::Core::into_entries", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::IndexMap::swap_remove_full", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::set::IndexSet::binary_search_by", + "lang": "rust", + "other_recall": null, + "other_precision": null, + "recall": null, + "precision": null, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::IndexMap::is_sorted_by", + "lang": "rust", + "other_recall": null, + "other_precision": null, + "recall": null, + "precision": null, + "repo": "indexmap" + }, + { + "symbol": "indexmap::inner::entry::OccupiedEntry::from_hash", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::slice::Slice::from_boxed", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 0.8, + "repo": "indexmap" + }, + { + "symbol": "indexmap::inner::Core::par_drain", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 0.0, + "precision": null, + "repo": "indexmap" + }, + { + "symbol": "indexmap::set::IndexSet::try_reserve", + "lang": "rust", + "other_recall": null, + "other_precision": null, + "recall": null, + "precision": null, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::IndexMap::shift_insert", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::set::IndexSet::try_reserve_exact", + "lang": "rust", + "other_recall": null, + "other_precision": null, + "recall": null, + "precision": null, + "repo": "indexmap" + }, + { + "symbol": "indexmap::set::slice::Slice::is_sorted", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 0.0, + "precision": null, + "repo": "indexmap" + }, + { + "symbol": "indexmap::set::IndexSet::reverse", + "lang": "rust", + "other_recall": null, + "other_precision": null, + "recall": null, + "precision": null, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::IndexMap::get_index_of", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::raw_entry_v1::RawOccupiedEntryMut::get_key_value_mut", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 0.0, + "precision": null, + "repo": "indexmap" + }, + { + "symbol": "indexmap::set::slice::Slice::is_sorted_by_key", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 0.0, + "precision": null, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::IndexMap::shift_remove_full", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::set::IndexSet::insert_full", + "lang": "rust", + "other_recall": null, + "other_precision": null, + "recall": null, + "precision": null, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::IndexMap::swap_remove_index", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::IndexMap::last_mut", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + } + ], + "callers_blind": [ + { + "symbol": "main::Command::NamePadding", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::CheckErr", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::CommandPathPadding", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::GenPowerShellCompletionWithDesc", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::Print", + "lang": "go", + "other_recall": 1.0, + "other_precision": 0.75, + "recall": 1.0, + "precision": 0.75, + "repo": "cobra" + }, + { + "symbol": "main::Command::OutOrStderr", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::PrintErrf", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::MinimumNArgs", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::Flags", + "lang": "go", + "other_recall": 0.8571428571428571, + "other_precision": 0.8571428571428571, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::LocalFlags", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::Println", + "lang": "go", + "other_recall": 1.0, + "other_precision": 0.6, + "recall": 1.0, + "precision": 0.75, + "repo": "cobra" + }, + { + "symbol": "main::Command::Execute", + "lang": "go", + "other_recall": 1.0, + "other_precision": 0.5, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::ValidateFlagGroups", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::PrintErrln", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::Help", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::CalledAs", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::CompErrorln", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::HasParent", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::InitDefaultVersionFlag", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::Commands", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::Parent", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::HelpFunc", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "doc::GenMarkdownCustom", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::GenBashCompletionV2", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::FlagErrorFunc", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::SetGlobalNormalizationFunc", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::UseLine", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::GenZshCompletion", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::Root", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::HasPersistentFlags", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::PrintErr", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "middleware::GetLogEntry", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "main::Chain", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "middleware::NewCompressor", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "main::RouteContext", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "middleware::RequestLogger", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "main::URLParamFromCtx", + "lang": "go", + "other_recall": 0.0, + "other_precision": 0.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "middleware::GetReqID", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "main::Mux::NotFoundHandler", + "lang": "go", + "other_recall": 0.6666666666666666, + "other_precision": 0.6666666666666666, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "middleware::NewWrapResponseWriter", + "lang": "go", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "src::middleware::persist::createJSONStorage", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "zustand" + }, + { + "symbol": "src::react::shallow::useShallow", + "lang": "typescript", + "other_recall": null, + "other_precision": null, + "recall": null, + "precision": null, + "repo": "zustand" + }, + { + "symbol": "src::compose::resolve_flow_scalar::resolveFlowScalar", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::parse::cst_scalar::setScalarValue", + "lang": "typescript", + "other_recall": null, + "other_precision": null, + "recall": null, + "precision": null, + "repo": "yaml" + }, + { + "symbol": "src::compose::resolve_end::resolveEnd", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::nodes::toJS::ToJSContext::resolveAlias", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::public_api::parseAllDocuments", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::nodes::YAMLMap::YAMLMap::#stringifyFlowMap", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::compose::util_flow_indent_check::flowIndentCheck", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::compose::compose_collection::composeCollection", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::doc::Document::Document::setSchema", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::doc::directives::Directives::atDocument", + "lang": "typescript", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::compose::resolve_flow_collection::resolveFlowCollection", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::compose::resolve_block_scalar::resolveBlockScalar", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::nodes::YAMLMap::YAMLMap::#stringifyBlockMap", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::visit::visitAsync", + "lang": "typescript", + "other_recall": null, + "other_precision": null, + "recall": null, + "precision": null, + "repo": "yaml" + }, + { + "symbol": "src::public_api::parseDocument", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::doc::anchors::anchorIsValid", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::nodes::toJS::ToJSContext::setAnchor", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::doc::anchors::anchorNames", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::parse::cst::prettyToken", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::nodes::YAMLSeq::YAMLSeq::#stringifyBlockSeq", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::compose::composer::Composer::compose", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::doc::NodeCreator::NodeCreator::setAnchors", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::compose::resolve_block_seq::resolveBlockSeq", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::compose::compose_scalar::composeScalar", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::parse::cst::tokenType", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::parse::lexer::Lexer::flow", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::compose::resolve_block_map::resolveBlockMap", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::log::debug", + "lang": "typescript", + "other_recall": null, + "other_precision": null, + "recall": null, + "precision": null, + "repo": "yaml" + }, + { + "symbol": "src::nodes::YAMLSet::YAMLSet::#stringifyFlowSet", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::compose::util_contains_newline::containsNewline", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::nodes::YAMLSet::YAMLSet::#stringifyBlockSet", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::compose::compose_doc::composeDoc", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::schema::yaml_1_1::pairs::resolvePairs", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::stringify::stringify::createStringifyContext", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::parse::cst_scalar::createScalarToken", + "lang": "typescript", + "other_recall": null, + "other_precision": null, + "recall": null, + "precision": null, + "repo": "yaml" + }, + { + "symbol": "src::schema::tags::getTags", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::errors::prettifyError", + "lang": "typescript", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "org::jsoup::internal::SoftPool::release", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::internal::StringUtil::appendNormalisedWhitespace", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::internal::LegacyMatching::cssAttributeMatches", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::select::Evaluator::asPredicate", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::parser::TokenQueue::matchesWord", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::internal::StringUtil::isAsciiLetter", + "lang": "java", + "other_recall": 0.8, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::parser::TokenQueue::matchesWhitespace", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::nodes::DocumentType::publicId", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::parser::ParseErrorList::tracking", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::nodes::Node::ownerDocument", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::safety::Safelist::addTags", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::internal::StringUtil::isActuallyWhitespace", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::nodes::Attributes::getIgnoreCase", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::parser::Parser::getMaxDepth", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::parser::Tag::isFormSubmittable", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::nodes::Attributes::removeIgnoreCase", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::parser::Token::Doctype::getSystemIdentifier", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::internal::Normalizer::lowerCase", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::parser::TokenQueue::remainder", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::select::Selector::evaluatorOf", + "lang": "java", + "other_recall": 0.8, + "other_precision": 1.0, + "recall": 0.8, + "precision": 0.8, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::safety::Safelist::isSafeTag", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 0.0, + "precision": null, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::nodes::Range::AttributeRange::valueRange", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::nodes::TextNode::getWholeText", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::internal::LineMap::addLineStart", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::parser::Tag::isInline", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::internal::StringUtil::trimAsciiWhitespace", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::safety::Safelist::addEnforcedAttribute", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::parser::TokenQueue::consumeCssIdentifier", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::nodes::Attributes::deduplicate", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::nodes::Entities::isNamedEntity", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::nodes::Attribute::getValidKey", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::nodes::Element::wholeOwnText", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::internal::LegacyMatching::hasAttributeFlag", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::nodes::DocumentType::systemId", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::jsoup::select::Collector::findFirst", + "lang": "java", + "other_recall": 1.0, + "other_precision": 0.75, + "recall": 1.0, + "precision": 1.0, + "repo": "jsoup" + }, + { + "symbol": "org::json::JSONObject::putOnce", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONObject::toMap", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::XMLParserConfiguration::getXsiTypeMap", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONTokener::more", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONPointer::queryFrom", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::XMLParserConfiguration::withKeepBooleanAsString", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONTokener::nextClean", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONTokener::getJsonParserConfiguration", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONArray::toList", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONParserConfiguration::isOverwriteDuplicateKey", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONTokener::nextValue", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONObject::putOpt", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::XMLTokener::nextMeta", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::XML::noSpace", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::ParserConfiguration::isKeepStrings", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::ParserConfiguration::getMaxNumberLength", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONParserConfiguration::getMaxSharedKeys", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::XMLParserConfiguration::getForceList", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONObject::numberToString", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONObject::keys", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::XMLTokener::nextCDATA", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONTokener::nextString", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONParserConfiguration::isStrictMode", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::XMLParserConfiguration::isConvertNilAttributeToNull", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::XMLTokener::skipPast", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::XMLParserConfiguration::shouldTrimWhiteSpace", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONParserConfiguration::isUseNativeNulls", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "org::json::JSONTokener::back", + "lang": "java", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "json-java" + }, + { + "symbol": "semver::identifier::Identifier::ptr_eq", + "lang": "rust", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "semver" + }, + { + "symbol": "semver::eval::matches_req", + "lang": "rust", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "semver" + }, + { + "symbol": "semver::identifier::Identifier::new_unchecked", + "lang": "rust", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "semver" + }, + { + "symbol": "semver::eval::matches_comparator", + "lang": "rust", + "other_recall": 1.0, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "semver" + }, + { + "symbol": "semver::identifier::Identifier::empty", + "lang": "rust", + "other_recall": 0.6, + "other_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "semver" + }, + { + "symbol": "indexmap::map::IndexMap::sort_unstable_keys", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::slice::Slice::split_last_mut", + "lang": "rust", + "other_recall": null, + "other_precision": null, + "recall": null, + "precision": null, + "repo": "indexmap" + }, + { + "symbol": "indexmap::set::IndexSet::take", + "lang": "rust", + "other_recall": null, + "other_precision": null, + "recall": null, + "precision": null, + "repo": "indexmap" + }, + { + "symbol": "indexmap::set::IndexSet::is_disjoint", + "lang": "rust", + "other_recall": null, + "other_precision": null, + "recall": null, + "precision": null, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::entry::Entry::or_default", + "lang": "rust", + "other_recall": null, + "other_precision": null, + "recall": null, + "precision": null, + "repo": "indexmap" + }, + { + "symbol": "indexmap::set::IndexSet::is_subset", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::serde::cautious_capacity", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::set::IndexSet::difference", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::raw_entry_v1::RawEntryBuilder::index_from_hash", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::inner::Core::split_splice", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::IndexMap::last_entry", + "lang": "rust", + "other_recall": null, + "other_precision": null, + "recall": null, + "precision": null, + "repo": "indexmap" + }, + { + "symbol": "indexmap::inner::extract::ExtractCore::remaining", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::raw_entry_v1::RawOccupiedEntryMut::into_key_value_mut", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::IndexMap::sort_keys", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::set::IndexSet::sort_unstable", + "lang": "rust", + "other_recall": null, + "other_precision": null, + "recall": null, + "precision": null, + "repo": "indexmap" + }, + { + "symbol": "indexmap::set::IndexSet::union", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::inner::Core::replace_index_unique", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::rayon::set::IndexSet::par_is_disjoint", + "lang": "rust", + "other_recall": null, + "other_precision": null, + "recall": null, + "precision": null, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::IndexMap::contains_key", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::inner::Core::retain_in_order", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::rayon::set::IndexSet::par_difference", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::inner::Core::shift_insert_unique", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::rayon::set::IndexSet::par_symmetric_difference", + "lang": "rust", + "other_recall": null, + "other_precision": null, + "recall": null, + "precision": null, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::slice::Slice::new_mut", + "lang": "rust", + "other_recall": null, + "other_precision": null, + "recall": null, + "precision": null, + "repo": "indexmap" + }, + { + "symbol": "indexmap::rayon::set::IndexSet::par_is_superset", + "lang": "rust", + "other_recall": null, + "other_precision": null, + "recall": null, + "precision": null, + "repo": "indexmap" + }, + { + "symbol": "indexmap::util::assert_index_le", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::slice::Slice::split_first_mut", + "lang": "rust", + "other_recall": null, + "other_precision": null, + "recall": null, + "precision": null, + "repo": "indexmap" + }, + { + "symbol": "indexmap::util::third", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::rayon::set::IndexSet::par_union", + "lang": "rust", + "other_recall": null, + "other_precision": null, + "recall": null, + "precision": null, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::raw_entry_v1::RawVacantEntryMut::shift_insert_hashed_nocheck", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::slice::Slice::from_mut_slice", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 0.9230769230769231, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::set::IndexSet::swap_take", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::IndexMap::get_disjoint_indices_mut", + "lang": "rust", + "other_recall": null, + "other_precision": null, + "recall": null, + "precision": null, + "repo": "indexmap" + }, + { + "symbol": "indexmap::set::IndexSet::is_superset", + "lang": "rust", + "other_recall": null, + "other_precision": null, + "recall": null, + "precision": null, + "repo": "indexmap" + }, + { + "symbol": "indexmap::set::IndexSet::intersection", + "lang": "rust", + "other_recall": 0.0, + "other_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + } + ] +} \ No newline at end of file diff --git a/eval/results/latest.codebase-memory.md b/eval/results/latest.codebase-memory.md new file mode 100644 index 0000000..ae496d6 --- /dev/null +++ b/eval/results/latest.codebase-memory.md @@ -0,0 +1,33 @@ +# Codebase-Memory on the functions of the run `latest` + +`codebase-memory-mcp 0.12.1`. Its `CALLS` edges into each sampled function against the compiler's uses, next to gitnext on the same functions. ± is half of a 90% bootstrap interval over the functions; precision is over the functions for which the tool names a caller. + +## Callers — names that occur once + +| | functions | Codebase-Memory: recall | Codebase-Memory: precision | gitnext: recall | gitnext: precision | +|---|---|---|---|---|---| +| all | 232 | 85% ±4 | 96% ±2 | 100% ±0 | 99% ±1 | +| go | 71 | 97% ±3 | 91% ±5 | 100% ±0 | 98% ±2 | +| rust | 37 | 15% ±10 | 86% ±21 | 99% ±1 | 100% ±0 | +| java | 85 | 100% ±1 | 99% ±1 | 100% ±0 | 100% ±0 | +| typescript | 39 | 97% ±4 | 100% ±0 | 100% ±0 | 100% ±0 | + +## Callers — methods that share a name + +| | functions | Codebase-Memory: recall | Codebase-Memory: precision | gitnext: recall | gitnext: precision | +|---|---|---|---|---|---| +| all | 108 | 58% ±8 | 85% ±5 | 83% ±5 | 99% ±1 | +| go | 11 | 82% ±18 | 90% ±15 | 73% ±23 | 100% ±0 | +| rust | 31 | 5% ±6 | 38% ±12 | 80% ±11 | 99% ±1 | +| java | 56 | 80% ±8 | 84% ±6 | 90% ±6 | 99% ±1 | +| typescript | 10 | 75% ±22 | 100% ±0 | 65% ±25 | 100% ±0 | + +## Callers — whether or not gitnext sees a caller + +| | functions | Codebase-Memory: recall | Codebase-Memory: precision | gitnext: recall | gitnext: precision | +|---|---|---|---|---|---| +| all | 163 | 85% ±5 | 98% ±1 | 99% ±1 | 100% ±0 | +| go | 40 | 96% ±4 | 93% ±5 | 100% ±0 | 99% ±1 | +| rust | 26 | 18% ±12 | 100% ±0 | 100% ±0 | 100% ±0 | +| java | 63 | 99% ±1 | 100% ±1 | 98% ±3 | 100% ±0 | +| typescript | 34 | 97% ±4 | 100% ±0 | 100% ±0 | 100% ±0 | diff --git a/eval/results/latest.lsp-rename.json b/eval/results/latest.lsp-rename.json new file mode 100644 index 0000000..ebe8e3e --- /dev/null +++ b/eval/results/latest.lsp-rename.json @@ -0,0 +1,650 @@ +[ + { + "repo": "cobra", + "symbol": "main::Command::NamePadding", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "cobra", + "symbol": "main::CheckErr", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "cobra", + "symbol": "main::Command::CommandPathPadding", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "cobra", + "symbol": "main::Command::GenPowerShellCompletionWithDesc", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "cobra", + "symbol": "main::Command::Print", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "cobra", + "symbol": "main::Command::OutOrStderr", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "cobra", + "symbol": "main::Command::PrintErrf", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "cobra", + "symbol": "main::MinimumNArgs", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "cobra", + "symbol": "main::Command::Flags", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "cobra", + "symbol": "main::Command::LocalFlags", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "cobra", + "symbol": "main::Command::Println", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": false + }, + { + "repo": "cobra", + "symbol": "main::Command::Execute", + "server_ok": false, + "server_stage": "tests", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "cobra", + "symbol": "main::Command::CalledAs", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "cobra", + "symbol": "main::Command::HasAvailableInheritedFlags", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "cobra", + "symbol": "main::Command::Parent", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "cobra", + "symbol": "main::CompError", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "cobra", + "symbol": "main::CompErrorln", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "cobra", + "symbol": "main::Command::LocalNonPersistentFlags", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "cobra", + "symbol": "main::Command::ParseFlags", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "cobra", + "symbol": "main::Command::InitDefaultCompletionCmd", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "cobra", + "symbol": "main::Command::ValidateFlagGroups", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "cobra", + "symbol": "main::Command::PrintErrln", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "cobra", + "symbol": "main::Command::Help", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "cobra", + "symbol": "main::Command::HasParent", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "cobra", + "symbol": "main::Command::InitDefaultVersionFlag", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "cobra", + "symbol": "main::Command::Commands", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "cobra", + "symbol": "main::Command::HelpFunc", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "cobra", + "symbol": "doc::GenMarkdownCustom", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "cobra", + "symbol": "main::Command::GenBashCompletionV2", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "cobra", + "symbol": "main::Command::InheritedFlags", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "cobra", + "symbol": "main::Command::Root", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "cobra", + "symbol": "doc::GenMarkdownTreeCustom", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "cobra", + "symbol": "main::Command::FlagErrorFunc", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "cobra", + "symbol": "main::Command::SetGlobalNormalizationFunc", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "cobra", + "symbol": "main::Command::UseLine", + "server_ok": false, + "server_stage": "tests", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "cobra", + "symbol": "main::Command::GenZshCompletion", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "cobra", + "symbol": "main::flagCompError::Error", + "server_ok": false, + "server_stage": "rename", + "server_detail": "gopls: cobra/completions.go:52:25: renaming this method \"Error\" to \"ErrorGnx\"\n\twould make *github.com/spf13/cobra.flagCompError no longer assignable to interface error\n\t(rename error.Error if you intend to change both types)\n", + "gitnext_ok": false + }, + { + "repo": "cobra", + "symbol": "main::Command::HasPersistentFlags", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "cobra", + "symbol": "main::Command::PrintErr", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": false + }, + { + "repo": "cobra", + "symbol": "doc::GenYamlCustom", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "cobra", + "symbol": "main::Command::HasSubCommands", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "cobra", + "symbol": "main::Command::Traverse", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "cobra", + "symbol": "main::Command::SuggestionsFor", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "cobra", + "symbol": "main::Command::Usage", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": false + }, + { + "repo": "cobra", + "symbol": "main::Command::ValidateArgs", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "cobra", + "symbol": "main::Command::HasFlags", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "chi", + "symbol": "middleware::GetLogEntry", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "chi", + "symbol": "_examples::fileserver::FileServer", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "chi", + "symbol": "main::Chain", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "chi", + "symbol": "middleware::NewCompressor", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "chi", + "symbol": "main::Walk", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "chi", + "symbol": "main::RouteContext", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "chi", + "symbol": "middleware::RequestLogger", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "chi", + "symbol": "main::NewMux", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "chi", + "symbol": "_examples::rest::NewArticleListResponse", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "chi", + "symbol": "middleware::GetClientIPAddr", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "chi", + "symbol": "main::Middlewares::HandlerFunc", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "chi", + "symbol": "main::NewRouteContext", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "chi", + "symbol": "middleware::NewPattern", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "chi", + "symbol": "middleware::Throttle", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "chi", + "symbol": "middleware::Timeout", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "chi", + "symbol": "main::Context::RoutePattern", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "chi", + "symbol": "main::Mux::NotFoundHandler", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "chi", + "symbol": "main::endpoints::Value", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": false + }, + { + "repo": "chi", + "symbol": "main::node::InsertRoute", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "chi", + "symbol": "main::node::FindRoute", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "chi", + "symbol": "main::URLParamFromCtx", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "chi", + "symbol": "middleware::GetReqID", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "chi", + "symbol": "middleware::NewWrapResponseWriter", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "chi", + "symbol": "middleware::compressResponseWriter::Close", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": false + }, + { + "repo": "chi", + "symbol": "main::NewRouter", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "chi", + "symbol": "middleware::Compressor::SetEncoder", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "chi", + "symbol": "_examples::rest::ErrRender", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "chi", + "symbol": "_examples::rest::NewUserPayloadResponse", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "chi", + "symbol": "main::Mux::MethodNotAllowedHandler", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "chi", + "symbol": "middleware::PrintPrettyStack", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "chi", + "symbol": "_examples::rest::ErrInvalidRequest", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "chi", + "symbol": "middleware::HeaderRoute::IsMatch", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "chi", + "symbol": "main::RegisterMethod", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "chi", + "symbol": "middleware::ThrottleWithOpts", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + }, + { + "repo": "chi", + "symbol": "middleware::WithLogEntry", + "server_ok": true, + "server_stage": "", + "server_detail": "", + "gitnext_ok": true + } +] \ No newline at end of file diff --git a/eval/results/latest.lsp-rename.md b/eval/results/latest.lsp-rename.md new file mode 100644 index 0000000..ceafca5 --- /dev/null +++ b/eval/results/latest.lsp-rename.md @@ -0,0 +1,16 @@ +# The rename of a language server on the functions of the run `latest` + +`gopls rename` at the name in the definition, then the same check as for the tool: the project builds and the tests that passed before still pass. ± is half of a 90% bootstrap interval over the functions. + +| | renames | gopls: builds and tests pass | gitnext: builds and tests pass | both | only gopls | only gitnext | neither | +|---|---|---|---|---|---|---|---| +| all | 81 | 96% ±4 | 93% ±4 | 73 | 5 | 2 | 1 | +| cobra | 46 | 93% ±5 | 91% ±7 | 40 | 3 | 2 | 1 | +| chi | 35 | 100% ±0 | 94% ±7 | 33 | 2 | 0 | 0 | + +## Where the server's rename did not pass + +- `cobra` `main::Command::Execute` — tests: +- `cobra` `main::Command::UseLine` — tests: +- `cobra` `main::flagCompError::Error` — rename: gopls: cobra/completions.go:52:25: renaming this method "Error" to "ErrorGnx" + would make *github.com/spf13/cobra.flagCompError no longer assignable to interfac diff --git a/eval/results/latest.lsp.json b/eval/results/latest.lsp.json new file mode 100644 index 0000000..496ff28 --- /dev/null +++ b/eval/results/latest.lsp.json @@ -0,0 +1,1903 @@ +{ + "rows": { + "callers": [ + { + "symbol": "main::Command::NamePadding", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::CheckErr", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::CommandPathPadding", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::GenPowerShellCompletionWithDesc", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::Print", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 0.75, + "repo": "cobra" + }, + { + "symbol": "main::Command::OutOrStderr", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::PrintErrf", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::MinimumNArgs", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::Flags", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::LocalFlags", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::Println", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 0.75, + "repo": "cobra" + }, + { + "symbol": "main::Command::Execute", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::CalledAs", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::HasAvailableInheritedFlags", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::Parent", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::CompError", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::CompErrorln", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::LocalNonPersistentFlags", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::ParseFlags", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::InitDefaultCompletionCmd", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::ValidateFlagGroups", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::PrintErrln", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::Help", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::HasParent", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::InitDefaultVersionFlag", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::Commands", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::HelpFunc", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "doc::GenMarkdownCustom", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::GenBashCompletionV2", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::InheritedFlags", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::Root", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "doc::GenMarkdownTreeCustom", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::FlagErrorFunc", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::SetGlobalNormalizationFunc", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::UseLine", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::GenZshCompletion", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::HasPersistentFlags", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::PrintErr", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "doc::GenYamlCustom", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::HasSubCommands", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::Traverse", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::SuggestionsFor", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::Usage", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::ValidateArgs", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Command::HasFlags", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "middleware::GetLogEntry", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "main::Chain", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "middleware::NewCompressor", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "main::RouteContext", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "middleware::RequestLogger", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "main::NewMux", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "middleware::GetClientIPAddr", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "main::Middlewares::HandlerFunc", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "main::NewRouteContext", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "middleware::NewPattern", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "main::Context::RoutePattern", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "main::Mux::NotFoundHandler", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "main::endpoints::Value", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 0.25, + "repo": "chi" + }, + { + "symbol": "main::node::InsertRoute", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "main::node::FindRoute", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "main::URLParamFromCtx", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "middleware::GetReqID", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "middleware::NewWrapResponseWriter", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "middleware::compressResponseWriter::Close", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "main::NewRouter", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "middleware::Compressor::SetEncoder", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "main::Mux::MethodNotAllowedHandler", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "middleware::PrintPrettyStack", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "middleware::HeaderRoute::IsMatch", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "middleware::ThrottleWithOpts", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "middleware::WithLogEntry", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "src::middleware::persist::createJSONStorage", + "lang": "typescript", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "zustand" + }, + { + "symbol": "src::compose::resolve_flow_scalar::resolveFlowScalar", + "lang": "typescript", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::compose::resolve_end::resolveEnd", + "lang": "typescript", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::nodes::toJS::ToJSContext::resolveAlias", + "lang": "typescript", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::public_api::parseAllDocuments", + "lang": "typescript", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::nodes::YAMLMap::YAMLMap::#stringifyFlowMap", + "lang": "typescript", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::compose::util_flow_indent_check::flowIndentCheck", + "lang": "typescript", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::compose::compose_collection::composeCollection", + "lang": "typescript", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::doc::Document::Document::setSchema", + "lang": "typescript", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::doc::directives::Directives::atDocument", + "lang": "typescript", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::compose::resolve_flow_collection::resolveFlowCollection", + "lang": "typescript", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::compose::resolve_block_scalar::resolveBlockScalar", + "lang": "typescript", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::nodes::YAMLMap::YAMLMap::#stringifyBlockMap", + "lang": "typescript", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::public_api::parseDocument", + "lang": "typescript", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::doc::anchors::anchorIsValid", + "lang": "typescript", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::nodes::toJS::ToJSContext::setAnchor", + "lang": "typescript", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::doc::anchors::anchorNames", + "lang": "typescript", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::parse::cst::prettyToken", + "lang": "typescript", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::log::warn", + "lang": "typescript", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::nodes::toJS::ToJSContext::setSource", + "lang": "typescript", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::stringify::stringifyComment::lineComment", + "lang": "typescript", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::nodes::YAMLSeq::YAMLSeq::#stringifyBlockSeq", + "lang": "typescript", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::compose::composer::Composer::compose", + "lang": "typescript", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::doc::NodeCreator::NodeCreator::setAnchors", + "lang": "typescript", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::compose::resolve_block_seq::resolveBlockSeq", + "lang": "typescript", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::compose::compose_scalar::composeScalar", + "lang": "typescript", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::parse::cst::tokenType", + "lang": "typescript", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::parse::lexer::Lexer::flow", + "lang": "typescript", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::compose::resolve_block_map::resolveBlockMap", + "lang": "typescript", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::nodes::YAMLSet::YAMLSet::#stringifyFlowSet", + "lang": "typescript", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::nodes::YAMLSeq::YAMLSeq::#stringifyFlowSeq", + "lang": "typescript", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::compose::util_contains_newline::containsNewline", + "lang": "typescript", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::nodes::YAMLSet::YAMLSet::#stringifyBlockSet", + "lang": "typescript", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::compose::compose_doc::composeDoc", + "lang": "typescript", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::schema::yaml_1_1::pairs::resolvePairs", + "lang": "typescript", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::stringify::stringify::createStringifyContext", + "lang": "typescript", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::schema::tags::getTags", + "lang": "typescript", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::errors::prettifyError", + "lang": "typescript", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::compose::resolve_props::resolveProps", + "lang": "typescript", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "semver::identifier::Identifier::ptr_eq", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "semver" + }, + { + "symbol": "semver::eval::matches_req", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "semver" + }, + { + "symbol": "semver::identifier::Identifier::new_unchecked", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "semver" + }, + { + "symbol": "semver::eval::matches_comparator", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "semver" + }, + { + "symbol": "semver::identifier::Identifier::empty", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "semver" + }, + { + "symbol": "indexmap::map::IndexMap::sort_unstable_keys", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::set::IndexSet::is_subset", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::serde::cautious_capacity", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::set::IndexSet::difference", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::raw_entry_v1::RawEntryBuilder::index_from_hash", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::inner::Core::split_splice", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::inner::extract::ExtractCore::remaining", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::raw_entry_v1::RawOccupiedEntryMut::into_key_value_mut", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::IndexMap::sort_keys", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::raw_entry_v1::RawVacantEntryMut::insert_hashed_nocheck", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::set::IndexSet::contains", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 0.8, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::util::simplify_range", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::rayon::set::IndexSet::par_is_subset", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::disjoint::get_disjoint_opt_mut", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::set::IndexSet::union", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::util::assert_index_lt", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::util::try_simplify_range", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::inner::Core::shift_insert_unique", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::set::IndexSet::swap_take", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::inner::Core::replace_index_unique", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::IndexMap::contains_key", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::inner::Core::retain_in_order", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::rayon::set::IndexSet::par_difference", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::inner::Core::get_index_of_raw", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::slice::Slice::from_mut_slice", + "lang": "rust", + "server_recall": 0.9230769230769231, + "server_precision": 1.0, + "recall": 0.9230769230769231, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::set::IndexSet::intersection", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::util::third", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::util::assert_index_le", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::raw_entry_v1::RawVacantEntryMut::shift_insert_hashed_nocheck", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::IndexMap::get_index_entry", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::set::IndexSet::symmetric_difference", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::util::slice_eq", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + } + ], + "callers_common": [ + { + "symbol": "main::Command::MarkFlagRequired", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "cobra" + }, + { + "symbol": "main::Mux::Method", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "main::Context::Reset", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 0.0, + "precision": null, + "repo": "chi" + }, + { + "symbol": "main::Mux::Find", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "main::Context::URLParam", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "main::Mux::Mount", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "main::Mux::With", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "main::Mux::Handle", + "lang": "go", + "server_recall": 1.0, + "server_precision": 0.5, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "main::Mux::MethodNotAllowed", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 0.0, + "precision": null, + "repo": "chi" + }, + { + "symbol": "main::Mux::NotFound", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 0.0, + "precision": null, + "repo": "chi" + }, + { + "symbol": "main::Middlewares::Handler", + "lang": "go", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "chi" + }, + { + "symbol": "src::doc::NodeCreator::NodeCreator::createPair", + "lang": "typescript", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::nodes::YAMLSet::YAMLSet::keyOf", + "lang": "typescript", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 0.0, + "precision": null, + "repo": "yaml" + }, + { + "symbol": "src::parse::parser::Parser::next", + "lang": "typescript", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::nodes::YAMLMap::YAMLMap::create", + "lang": "typescript", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::parse::lexer::Lexer::document", + "lang": "typescript", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::doc::directives::Directives::tagName", + "lang": "typescript", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 0.0, + "precision": null, + "repo": "yaml" + }, + { + "symbol": "src::parse::lexer::Lexer::stream", + "lang": "typescript", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::nodes::YAMLMap::YAMLMap::getPair", + "lang": "typescript", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 0.5, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::nodes::YAMLSeq::YAMLSeq::create", + "lang": "typescript", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "yaml" + }, + { + "symbol": "src::nodes::YAMLSeq::YAMLSeq::tagName", + "lang": "typescript", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 0.0, + "precision": null, + "repo": "yaml" + }, + { + "symbol": "semver::BuildMetadata::as_str", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "semver" + }, + { + "symbol": "semver::identifier::Identifier::is_empty", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "semver" + }, + { + "symbol": "indexmap::set::IndexSet::with_capacity", + "lang": "rust", + "server_recall": 0.0, + "server_precision": null, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::inner::Core::drain", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 0.5, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::raw_entry_v1::RawOccupiedEntryMut::swap_remove_entry", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::inner::Core::with_entries", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::IndexMap::append", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::set::IndexSet::sort_unstable_by_key", + "lang": "rust", + "server_recall": null, + "server_precision": null, + "recall": null, + "precision": null, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::IndexMap::move_index", + "lang": "rust", + "server_recall": 0.5, + "server_precision": 1.0, + "recall": 0.5, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::slice::Slice::binary_search_by", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 0.75, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::IndexMap::clear", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::inner::Core::truncate", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::inner::entry::OccupiedEntry::into_core", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::IndexMap::swap_remove", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::entry::IndexedEntry::get_mut", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::IndexMap::get_key_value", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::IndexMap::hasher", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::IndexMap::is_empty", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::slice::Slice::partition_point", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 0.0, + "precision": null, + "repo": "indexmap" + }, + { + "symbol": "indexmap::set::IndexSet::split_off", + "lang": "rust", + "server_recall": null, + "server_precision": null, + "recall": null, + "precision": null, + "repo": "indexmap" + }, + { + "symbol": "indexmap::inner::Core::into_entries", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::IndexMap::swap_remove_full", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::set::IndexSet::binary_search_by", + "lang": "rust", + "server_recall": null, + "server_precision": null, + "recall": null, + "precision": null, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::IndexMap::is_sorted_by", + "lang": "rust", + "server_recall": null, + "server_precision": null, + "recall": null, + "precision": null, + "repo": "indexmap" + }, + { + "symbol": "indexmap::inner::entry::OccupiedEntry::from_hash", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::slice::Slice::from_boxed", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 0.8, + "repo": "indexmap" + }, + { + "symbol": "indexmap::inner::Core::par_drain", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 0.0, + "precision": null, + "repo": "indexmap" + }, + { + "symbol": "indexmap::set::IndexSet::try_reserve", + "lang": "rust", + "server_recall": null, + "server_precision": null, + "recall": null, + "precision": null, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::IndexMap::shift_insert", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::set::IndexSet::try_reserve_exact", + "lang": "rust", + "server_recall": null, + "server_precision": null, + "recall": null, + "precision": null, + "repo": "indexmap" + }, + { + "symbol": "indexmap::set::slice::Slice::is_sorted", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 0.0, + "precision": null, + "repo": "indexmap" + }, + { + "symbol": "indexmap::set::IndexSet::reverse", + "lang": "rust", + "server_recall": null, + "server_precision": null, + "recall": null, + "precision": null, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::IndexMap::get_index_of", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::raw_entry_v1::RawOccupiedEntryMut::get_key_value_mut", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 0.0, + "precision": null, + "repo": "indexmap" + }, + { + "symbol": "indexmap::set::slice::Slice::is_sorted_by_key", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 0.0, + "precision": null, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::IndexMap::shift_remove_full", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::set::IndexSet::insert_full", + "lang": "rust", + "server_recall": null, + "server_precision": null, + "recall": null, + "precision": null, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::IndexMap::swap_remove_index", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + }, + { + "symbol": "indexmap::map::IndexMap::last_mut", + "lang": "rust", + "server_recall": 1.0, + "server_precision": 1.0, + "recall": 1.0, + "precision": 1.0, + "repo": "indexmap" + } + ] + }, + "timing": { + "cobra": { + "server": "gopls", + "ready_seconds": 0.0, + "seconds_per_function": 0.62 + }, + "chi": { + "server": "gopls", + "ready_seconds": 0.0, + "seconds_per_function": 0.65 + }, + "zustand": { + "server": "tsserver", + "ready_seconds": 0.0, + "seconds_per_function": 3.99 + }, + "yaml": { + "server": "tsserver", + "ready_seconds": 0.0, + "seconds_per_function": 0.09 + }, + "semver": { + "server": "rust-analyzer", + "ready_seconds": 11.0, + "seconds_per_function": 0.33 + }, + "indexmap": { + "server": "rust-analyzer", + "ready_seconds": 9.4, + "seconds_per_function": 0.05 + } + } +} \ No newline at end of file diff --git a/eval/results/latest.lsp.md b/eval/results/latest.lsp.md new file mode 100644 index 0000000..174268d --- /dev/null +++ b/eval/results/latest.lsp.md @@ -0,0 +1,32 @@ +# Language servers on the functions of the run `latest` + +References of the definition, asked from gopls (Go), rust-analyzer (Rust) and tsserver (TypeScript); every reference is put into the function around it. The truth is the run's own (the compiler's uses). ± is half of a 90% bootstrap interval over the functions. + +## Names that occur once + +| | functions | server: recall | server: precision | gitnext: recall | gitnext: precision | search: recall | search: precision | +|---|---|---|---|---|---|---|---| +| all three | 147 | 100% ±0 | 100% ±0 | 100% ±0 | 99% ±1 | 100% ±0 | 92% ±3 | +| go | 71 | 100% ±0 | 100% ±0 | 100% ±0 | 98% ±2 | 100% ±0 | 92% ±4 | +| rust | 37 | 100% ±0 | 100% ±0 | 99% ±1 | 100% ±0 | 100% ±0 | 94% ±4 | +| typescript | 39 | 100% ±0 | 100% ±0 | 100% ±0 | 100% ±0 | 100% ±0 | 91% ±6 | + +## Methods that share a name + +| | functions | server: recall | server: precision | gitnext: recall | gitnext: precision | search: recall | search: precision | +|---|---|---|---|---|---|---|---| +| all three | 52 | 97% ±3 | 99% ±1 | 75% ±9 | 100% ±1 | 100% ±0 | 27% ±5 | +| go | 11 | 100% ±0 | 95% ±7 | 73% ±23 | 100% ±0 | 100% ±0 | 23% ±4 | +| rust | 31 | 95% ±6 | 100% ±0 | 80% ±11 | 99% ±1 | 100% ±0 | 27% ±7 | +| typescript | 10 | 100% ±0 | 100% ±0 | 65% ±25 | 100% ±0 | 100% ±0 | 32% ±19 | + +## Time + +| project | server | ready after | per function | +|---|---|---|---| +| cobra | gopls | 0.0 s | 0.62 s | +| chi | gopls | 0.0 s | 0.65 s | +| zustand | tsserver | 0.0 s | 3.99 s | +| yaml | tsserver | 0.0 s | 0.09 s | +| semver | rust-analyzer | 11.0 s | 0.33 s | +| indexmap | rust-analyzer | 9.4 s | 0.05 s | diff --git a/eval/results/lsp-refined.compare.md b/eval/results/lsp-refined.compare.md new file mode 100644 index 0000000..6f074c2 --- /dev/null +++ b/eval/results/lsp-refined.compare.md @@ -0,0 +1,99 @@ +# latest (A) → lsp-refined (B) + +Paired: each function is measured by both versions, the difference B − A is taken per function, and the 90% interval comes from drawing the functions again (within each repo). `better` / `worse`: the whole interval is on one side of zero. `can't tell`: it covers zero. `same`: no function changed. `< 0.5 pt`: the whole interval is within half a point. `changed`: functions whose value differs — a difference rests on them alone, read them below. `± alone`: the noise of one version on its own (as in latest.md): two separate runs would need a difference that large. + +Not paired: +- click: only in A (or failed in the other run) — left out +- json-java: only in A (or failed in the other run) — left out +- jsoup: only in A (or failed in the other run) — left out +- sqlparse: only in A (or failed in the other run) — left out +- yaml: only in A (or failed in the other run) — left out +- zustand: only in A (or failed in the other run) — left out + +## All repos + +| metric | functions | changed | A | B | B − A, points | 90% interval | ± alone | verdict | +|---|---:|---:|---:|---:|---:|---:|---:|---| +| callers recall | 108 | 0 | 99.7% | 99.7% | +0.0 | +0.0 … +0.0 | ±0.3 | **same** | +| callers precision | 108 | 0 | 98.8% | 98.8% | +0.0 | +0.0 … +0.0 | ±1.2 | **same** | +| callers recall, picked blind | 66 | 0 | 99.9% | 99.9% | +0.0 | +0.0 … +0.0 | ±0.2 | **same** | +| shared names: recall | 42 | 9 | 78.0% | 96.4% | +18.5 | +9.5 … +27.4 | ±10.1 | **better** | +| shared names: recall with maybe | 42 | 0 | 100.0% | 100.0% | +0.0 | +0.0 … +0.0 | ±0.0 | **same** | +| shared names: precision | 34 | 1 | 99.4% | 100.0% | +0.6 | +0.0 … +1.8 | ±0.9 | **can't tell** | +| rename ok (tests pass) | 119 | 1 | 90.8% | 91.6% | +0.8 | +0.0 … +2.5 | ±4.2 | **can't tell** | +| tests recall | 59 | 11 | 69.4% | 77.9% | +8.5 | +3.4 … +13.9 | ±7.9 | **better** | +| tests precision | 59 | 9 | 45.7% | 51.1% | +5.4 | +1.5 … +9.8 | ±8.2 | **better** | +| top-10 that fail | 59 | 8 | 50.2% | 55.9% | +5.7 | +1.9 … +10.1 | ±8.4 | **better** | +| … best possible order | 59 | 8 | 63.6% | 68.3% | +4.7 | +0.4 … +9.5 | ±8.3 | **better** | +| caught by the top 10 | 59 | 4 | 79.7% | 86.4% | +6.8 | +1.7 … +11.9 | ±8.5 | **better** | +| look / file | 119 | 33 | 13.5% | 14.0% | +0.5 | +0.2 … +0.9 | ±3.1 | **better** | + +## go + +| metric | functions | changed | A | B | B − A, points | 90% interval | ± alone | verdict | +|---|---:|---:|---:|---:|---:|---:|---:|---| +| callers recall | 71 | 0 | 100.0% | 100.0% | +0.0 | +0.0 … +0.0 | ±0.0 | **same** | +| callers precision | 71 | 0 | 98.2% | 98.2% | +0.0 | +0.0 … +0.0 | ±1.8 | **same** | +| callers recall, picked blind | 40 | 0 | 100.0% | 100.0% | +0.0 | +0.0 … +0.0 | ±0.0 | **same** | +| shared names: recall | 11 | 3 | 72.7% | 100.0% | +27.3 | +9.1 … +45.5 | ±22.7 | **better** | +| shared names: recall with maybe | 11 | 0 | 100.0% | 100.0% | +0.0 | +0.0 … +0.0 | ±0.0 | **same** | +| shared names: precision | 8 | 0 | 100.0% | 100.0% | +0.0 | +0.0 … +0.0 | ±0.0 | **same** | +| rename ok (tests pass) | 81 | 0 | 92.6% | 92.6% | +0.0 | +0.0 … +0.0 | ±4.9 | **same** | +| tests recall | 37 | 2 | 79.3% | 78.2% | -1.1 | -3.8 … +0.5 | ±9.2 | **can't tell** | +| tests precision | 37 | 1 | 47.1% | 46.7% | -0.4 | -1.3 … +0.0 | ±10.1 | **can't tell** | +| top-10 that fail | 37 | 1 | 54.0% | 53.7% | -0.3 | -0.8 … +0.0 | ±10.4 | **can't tell** | +| … best possible order | 37 | 1 | 75.3% | 73.4% | -1.9 | -5.7 … +0.0 | ±9.3 | **can't tell** | +| caught by the top 10 | 37 | 0 | 83.8% | 83.8% | +0.0 | +0.0 … +0.0 | ±10.8 | **same** | +| look / file | 81 | 9 | 13.5% | 13.7% | +0.2 | +0.0 … +0.4 | ±3.7 | **< 0.5 pt** | + +## rust + +| metric | functions | changed | A | B | B − A, points | 90% interval | ± alone | verdict | +|---|---:|---:|---:|---:|---:|---:|---:|---| +| callers recall | 37 | 0 | 99.3% | 99.3% | +0.0 | +0.0 … +0.0 | ±0.9 | **same** | +| callers precision | 37 | 0 | 100.0% | 100.0% | +0.0 | +0.0 … +0.0 | ±0.0 | **same** | +| callers recall, picked blind | 26 | 0 | 99.7% | 99.7% | +0.0 | +0.0 … +0.0 | ±0.4 | **same** | +| shared names: recall | 31 | 6 | 79.8% | 95.2% | +15.3 | +5.6 … +25.8 | ±10.5 | **better** | +| shared names: recall with maybe | 31 | 0 | 100.0% | 100.0% | +0.0 | +0.0 … +0.0 | ±0.0 | **same** | +| shared names: precision | 26 | 1 | 99.2% | 100.0% | +0.8 | +0.0 … +2.3 | ±1.2 | **can't tell** | +| rename ok (tests pass) | 38 | 1 | 86.8% | 89.5% | +2.6 | +0.0 … +7.9 | ±9.2 | **can't tell** | +| tests recall | 22 | 9 | 52.8% | 77.4% | +24.6 | +11.8 … +38.1 | ±14.0 | **better** | +| tests precision | 22 | 8 | 43.4% | 58.6% | +15.2 | +4.9 … +26.2 | ±13.2 | **better** | +| top-10 that fail | 22 | 7 | 43.8% | 59.6% | +15.8 | +5.7 … +26.8 | ±13.4 | **better** | +| … best possible order | 22 | 7 | 43.8% | 59.6% | +15.8 | +5.7 … +26.8 | ±13.4 | **better** | +| caught by the top 10 | 22 | 4 | 72.7% | 90.9% | +18.2 | +4.5 … +31.8 | ±15.9 | **better** | +| look / file | 38 | 24 | 13.6% | 14.8% | +1.2 | +0.4 … +2.2 | ±5.2 | **better** | + +## Per repo (metrics where a function changed) + +| repo | metric | functions | changed | A | B | B − A | 90% interval | verdict | +|---|---|---:|---:|---:|---:|---:|---:|---| +| chi | shared names: recall | 10 | 3 | 70.0% | 100.0% | +30.0 | +10.0 … +50.0 | better | +| chi | tests recall | 16 | 2 | 66.5% | 64.0% | -2.6 | -8.8 … +1.1 | can't tell | +| chi | tests precision | 16 | 1 | 61.4% | 60.4% | -1.0 | -3.0 … +0.0 | can't tell | +| chi | top-10 that fail | 16 | 1 | 66.7% | 66.1% | -0.6 | -1.9 … +0.0 | can't tell | +| chi | … best possible order | 16 | 1 | 71.1% | 66.7% | -4.4 | -13.1 … +0.0 | can't tell | +| chi | look / file | 35 | 6 | 21.9% | 22.3% | +0.4 | -0.0 … +1.0 | can't tell | +| cobra | look / file | 46 | 3 | 7.1% | 7.2% | +0.0 | +0.0 … +0.1 | < 0.5 pt | +| indexmap | shared names: recall | 29 | 6 | 78.4% | 94.8% | +16.4 | +6.0 … +27.6 | better | +| indexmap | shared names: precision | 24 | 1 | 99.2% | 100.0% | +0.8 | +0.0 … +2.5 | can't tell | +| indexmap | rename ok (tests pass) | 33 | 1 | 84.8% | 87.9% | +3.0 | +0.0 … +9.1 | can't tell | +| indexmap | tests recall | 19 | 9 | 51.5% | 80.0% | +28.5 | +13.7 … +44.1 | better | +| indexmap | tests precision | 19 | 8 | 40.2% | 57.7% | +17.6 | +5.7 … +30.3 | better | +| indexmap | top-10 that fail | 19 | 7 | 40.2% | 58.5% | +18.3 | +6.9 … +31.0 | better | +| indexmap | … best possible order | 19 | 7 | 40.2% | 58.5% | +18.3 | +6.9 … +31.0 | better | +| indexmap | caught by the top 10 | 19 | 4 | 73.7% | 94.7% | +21.1 | +5.3 … +36.8 | better | +| indexmap | look / file | 33 | 21 | 13.4% | 14.7% | +1.3 | +0.4 … +2.5 | better | +| semver | look / file | 5 | 3 | 15.0% | 15.2% | +0.2 | -0.0 … +0.4 | < 0.5 pt | + +## Functions that changed (up to 10 per metric, largest first) + +- **shared names: recall** (9): chi `main::Context::Reset` 0% → 100%; chi `main::Mux::MethodNotAllowed` 0% → 100%; chi `main::Mux::NotFound` 0% → 100%; indexmap `indexmap::map::slice::Slice::partition_point` 0% → 100%; indexmap `indexmap::set::slice::Slice::is_sorted` 0% → 100%; indexmap `indexmap::map::raw_entry_v1::RawOccupiedEntryMut::get_key_value_mut` 0% → 100%; indexmap `indexmap::set::slice::Slice::is_sorted_by_key` 0% → 100%; indexmap `indexmap::inner::Core::drain` 50% → 100%; indexmap `indexmap::map::slice::Slice::binary_search_by` 75% → 100% +- **shared names: precision** (1): indexmap `indexmap::map::slice::Slice::from_boxed` 80% → 100% +- **rename ok (tests pass)** (1): indexmap `indexmap::map::IndexMap::get_index_entry` 0% → 100% +- **tests recall** (11): indexmap `indexmap::util::simplify_range` 0% → 100%; indexmap `indexmap::inner::Core::shift_insert_unique` 0% → 100%; indexmap `indexmap::util::third` 0% → 100%; indexmap `indexmap::map::raw_entry_v1::RawVacantEntryMut::shift_insert_hashed_nocheck` 0% → 100%; indexmap `indexmap::map::IndexMap::contains_key` 27% → 80%; chi `main::Mux::NotFoundHandler` 64% → 14%; indexmap `indexmap::inner::Core::replace_index_unique` 50% → 100%; indexmap `indexmap::inner::Core::retain_in_order` 50% → 100%; indexmap `indexmap::set::IndexSet::contains` 60% → 40%; chi `main::Chain` 18% → 27% +- **tests precision** (9): indexmap `indexmap::util::simplify_range` 0% → 100%; indexmap `indexmap::util::third` 0% → 100%; indexmap `indexmap::inner::Core::shift_insert_unique` 0% → 67%; indexmap `indexmap::map::raw_entry_v1::RawVacantEntryMut::shift_insert_hashed_nocheck` 0% → 50%; indexmap `indexmap::set::IndexSet::swap_take` 25% → 50%; indexmap `indexmap::inner::Core::retain_in_order` 50% → 67%; chi `main::Mux::NotFoundHandler` 21% → 5%; indexmap `indexmap::map::IndexMap::contains_key` 100% → 86%; indexmap `indexmap::set::IndexSet::contains` 60% → 50% +- **top-10 that fail** (8): indexmap `indexmap::util::simplify_range` 0% → 100%; indexmap `indexmap::util::third` 0% → 100%; indexmap `indexmap::inner::Core::shift_insert_unique` 0% → 67%; indexmap `indexmap::map::raw_entry_v1::RawVacantEntryMut::shift_insert_hashed_nocheck` 0% → 50%; indexmap `indexmap::set::IndexSet::swap_take` 25% → 50%; indexmap `indexmap::inner::Core::retain_in_order` 50% → 67%; chi `main::Mux::NotFoundHandler` 30% → 20%; indexmap `indexmap::set::IndexSet::contains` 60% → 50% +- **… best possible order** (8): indexmap `indexmap::util::simplify_range` 0% → 100%; indexmap `indexmap::util::third` 0% → 100%; chi `main::Mux::NotFoundHandler` 90% → 20%; indexmap `indexmap::inner::Core::shift_insert_unique` 0% → 67%; indexmap `indexmap::map::raw_entry_v1::RawVacantEntryMut::shift_insert_hashed_nocheck` 0% → 50%; indexmap `indexmap::set::IndexSet::swap_take` 25% → 50%; indexmap `indexmap::inner::Core::retain_in_order` 50% → 67%; indexmap `indexmap::set::IndexSet::contains` 60% → 50% +- **caught by the top 10** (4): indexmap `indexmap::util::simplify_range` 0% → 100%; indexmap `indexmap::inner::Core::shift_insert_unique` 0% → 100%; indexmap `indexmap::util::third` 0% → 100%; indexmap `indexmap::map::raw_entry_v1::RawVacantEntryMut::shift_insert_hashed_nocheck` 0% → 100% +- **look / file** (33): indexmap `indexmap::util::third` 14% → 30%; indexmap `indexmap::util::simplify_range` 50% → 60%; indexmap `indexmap::util::assert_index_lt` 41% → 51%; chi `main::Middlewares::HandlerFunc` 38% → 48%; chi `main::Chain` 38% → 43%; indexmap `indexmap::util::assert_index_le` 40% → 43%; indexmap `indexmap::inner::Core::shift_insert_unique` 7% → 9%; indexmap `indexmap::util::try_simplify_range` 48% → 49%; cobra `doc::GenYamlCustom` 43% → 44%; indexmap `indexmap::inner::Core::replace_index_unique` 5% → 6% diff --git a/eval/results/lsp-refined.json b/eval/results/lsp-refined.json new file mode 100644 index 0000000..3096e10 --- /dev/null +++ b/eval/results/lsp-refined.json @@ -0,0 +1,9594 @@ +[ + { + "repo": "cobra", + "lang": "go", + "commit": "adbc8813901b", + "index_seconds": 0.0, + "symbols": 288, + "files": 19, + "seeds": [ + 7, + 8, + 9 + ], + "edges": 5106, + "sample": [ + "main::Command::NamePadding", + "main::CheckErr", + "main::Command::CommandPathPadding", + "main::Command::GenPowerShellCompletionWithDesc", + "main::Command::Print", + "main::Command::OutOrStderr", + "main::Command::PrintErrf", + "main::MinimumNArgs", + "main::Command::Flags", + "main::Command::LocalFlags", + "main::Command::Println", + "main::Command::Execute", + "main::Command::CalledAs", + "main::Command::HasAvailableInheritedFlags", + "main::Command::Parent", + "main::CompError", + "main::CompErrorln", + "main::Command::LocalNonPersistentFlags", + "main::Command::ParseFlags", + "main::Command::InitDefaultCompletionCmd", + "main::Command::ValidateFlagGroups", + "main::Command::PrintErrln", + "main::Command::Help", + "main::Command::HasParent", + "main::Command::InitDefaultVersionFlag", + "main::Command::Commands", + "main::Command::HelpFunc", + "doc::GenMarkdownCustom", + "main::Command::GenBashCompletionV2", + "main::Command::InheritedFlags", + "main::Command::Root", + "doc::GenMarkdownTreeCustom", + "main::Command::FlagErrorFunc", + "main::Command::SetGlobalNormalizationFunc", + "main::Command::UseLine", + "main::Command::GenZshCompletion", + "main::flagCompError::Error", + "main::Command::HasPersistentFlags", + "main::Command::PrintErr", + "doc::GenYamlCustom", + "main::Command::HasSubCommands", + "main::Command::Traverse", + "main::Command::SuggestionsFor", + "main::Command::Usage", + "main::Command::ValidateArgs", + "main::Command::HasFlags" + ], + "sample_common": [ + "main::Command::MarkFlagRequired" + ], + "samples": { + "7": [ + "main::Command::NamePadding", + "main::CheckErr", + "main::Command::CommandPathPadding", + "main::Command::GenPowerShellCompletionWithDesc", + "main::Command::Print", + "main::Command::OutOrStderr", + "main::Command::PrintErrf", + "main::MinimumNArgs", + "main::Command::Flags", + "main::Command::LocalFlags", + "main::Command::Println", + "main::Command::Execute", + "main::Command::CalledAs", + "main::Command::HasAvailableInheritedFlags", + "main::Command::Parent", + "main::CompError", + "main::CompErrorln", + "main::Command::LocalNonPersistentFlags", + "main::Command::ParseFlags", + "main::Command::InitDefaultCompletionCmd" + ], + "8": [ + "main::Command::ValidateFlagGroups", + "main::Command::PrintErrln", + "main::Command::Help", + "main::Command::CalledAs", + "main::Command::CommandPathPadding", + "main::CompErrorln", + "main::Command::HasParent", + "main::Command::InitDefaultVersionFlag", + "main::Command::Commands", + "main::Command::Parent", + "main::Command::HelpFunc", + "main::MinimumNArgs", + "main::Command::OutOrStderr", + "doc::GenMarkdownCustom", + "main::Command::GenBashCompletionV2", + "main::Command::InitDefaultCompletionCmd", + "main::Command::InheritedFlags", + "main::Command::Root", + "doc::GenMarkdownTreeCustom", + "main::Command::NamePadding" + ], + "9": [ + "main::Command::FlagErrorFunc", + "main::Command::SetGlobalNormalizationFunc", + "main::Command::UseLine", + "main::Command::GenZshCompletion", + "main::Command::GenPowerShellCompletionWithDesc", + "main::Command::LocalFlags", + "main::flagCompError::Error", + "main::Command::Root", + "main::Command::HasPersistentFlags", + "main::Command::OutOrStderr", + "main::Command::PrintErr", + "doc::GenYamlCustom", + "main::Command::CalledAs", + "main::Command::HasSubCommands", + "main::Command::Traverse", + "main::Command::SuggestionsFor", + "main::Command::Usage", + "main::Command::ValidateArgs", + "main::Command::HasFlags", + "main::Command::InitDefaultVersionFlag" + ] + }, + "samples_common": { + "7": [ + "main::Command::MarkFlagRequired" + ], + "8": [ + "main::Command::MarkFlagRequired" + ], + "9": [ + "main::Command::MarkFlagRequired" + ] + }, + "samples_blind": { + "7": [ + "main::Command::NamePadding", + "main::Command::SetHelpFunc", + "main::Command::HasLocalFlags", + "main::CheckErr", + "main::Command::CommandPathPadding", + "main::Command::VersionTemplate", + "main::Command::RegisterFlagCompletionFunc", + "main::Command::GenPowerShellCompletionWithDesc", + "main::Command::Print", + "main::Command::OutOrStderr", + "main::AddTemplateFunc", + "main::Command::PrintErrf", + "main::FixedCompletions", + "main::MinimumNArgs", + "main::Command::Flags", + "main::Command::LocalFlags", + "main::Command::Println", + "main::Command::Execute", + "main::Command::SetHelpCommand", + "main::Command::UsagePadding" + ], + "8": [ + "main::Command::ValidateFlagGroups", + "main::Command::PrintErrln", + "main::Command::Help", + "main::Command::CalledAs", + "main::Command::CommandPathPadding", + "main::Command::MarkZshCompPositionalArgumentFile", + "main::Command::GenBashCompletionFile", + "main::CompErrorln", + "main::Command::HasParent", + "main::Command::AddGroup", + "main::Command::InitDefaultVersionFlag", + "main::Command::Commands", + "main::Command::SetHelpCommand", + "main::Command::Parent", + "main::Command::HelpFunc", + "main::MinimumNArgs", + "main::Command::OutOrStderr", + "doc::GenMarkdownCustom", + "main::Command::GenBashCompletionV2", + "main::Command::SetUsageTemplate" + ], + "9": [ + "main::Command::FlagErrorFunc", + "main::Command::DebugFlags", + "main::CompDebugln", + "main::Command::SetGlobalNormalizationFunc", + "main::Command::UseLine", + "main::Command::GenZshCompletion", + "main::Command::GenPowerShellCompletionWithDesc", + "main::Command::LocalFlags", + "main::RangeArgs", + "main::flagCompError::Error", + "main::Command::Root", + "doc::GenYaml", + "main::Command::ResetCommands", + "main::Command::HasPersistentFlags", + "main::Command::SetFlagErrorFunc", + "main::Command::OutOrStderr", + "main::Command::SetUsageFunc", + "doc::GenReST", + "main::CompletionOptions::SetDefaultShellCompDirective", + "main::Command::PrintErr" + ] + }, + "baseline_failing_tests": [ + "TestFailGenFishCompletionFile" + ], + "callers": [ + { + "symbol": "main::Command::NamePadding", + "truth": [ + "main::defaultUsageFunc" + ], + "found": [ + "main::defaultUsageFunc" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::CheckErr", + "truth": [ + "main::Command::InitDefaultHelpCmd", + "main::Command::UsageString", + "main::WriteStringAndCheck" + ], + "found": [ + "main::Command::InitDefaultHelpCmd", + "main::Command::UsageString", + "main::WriteStringAndCheck" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Command::CommandPathPadding", + "truth": [ + "main::defaultUsageFunc" + ], + "found": [ + "main::defaultUsageFunc" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Command::GenPowerShellCompletionWithDesc", + "truth": [ + "main::Command::InitDefaultCompletionCmd" + ], + "found": [ + "main::Command::InitDefaultCompletionCmd" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Command::Print", + "truth": [ + "main::Command::ParseFlags", + "main::Command::Printf", + "main::Command::Println" + ], + "found": [ + "main::Command::ParseFlags", + "main::Command::Printf", + "main::Command::Println", + "main::preExecHook" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 0.75, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Command::OutOrStderr", + "truth": [ + "main::Command::Print", + "main::Command::UsageFunc" + ], + "found": [ + "main::Command::Print", + "main::Command::UsageFunc" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Command::PrintErrf", + "truth": [ + "main::Command::ExecuteC" + ], + "found": [ + "main::Command::ExecuteC" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::MinimumNArgs", + "truth": [ + "main::Command::initCompleteCmd" + ], + "found": [ + "main::Command::initCompleteCmd" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Command::Flags", + "truth": [ + "main::Command::ArgsLenAtDash", + "main::Command::Flag", + "main::Command::HasAvailableFlags", + "main::Command::HasFlags", + "main::Command::InitDefaultCompletionCmd", + "main::Command::InitDefaultHelpFlag", + "main::Command::InitDefaultVersionFlag", + "main::Command::LocalFlags", + "main::Command::MarkFlagCustom", + "main::Command::MarkFlagDirname", + "main::Command::MarkFlagFilename", + "main::Command::MarkFlagRequired", + "main::Command::MarkFlagsMutuallyExclusive", + "main::Command::MarkFlagsOneRequired", + "main::Command::MarkFlagsRequiredTogether", + "main::Command::ParseFlags", + "main::Command::SetGlobalNormalizationFunc", + "main::Command::Traverse", + "main::Command::ValidateFlagGroups", + "main::Command::ValidateRequiredFlags", + "main::Command::argsMinusFirstX", + "main::Command::enforceFlagGroupsForCompletion", + "main::Command::execute", + "main::Command::getCompletions", + "main::Command::mergePersistentFlags", + "main::findFlag", + "main::helpOrVersionFlagPresent", + "main::stripFlags" + ], + "found": [ + "main::Command::ArgsLenAtDash", + "main::Command::Flag", + "main::Command::HasAvailableFlags", + "main::Command::HasFlags", + "main::Command::InitDefaultCompletionCmd", + "main::Command::InitDefaultHelpFlag", + "main::Command::InitDefaultVersionFlag", + "main::Command::LocalFlags", + "main::Command::MarkFlagCustom", + "main::Command::MarkFlagDirname", + "main::Command::MarkFlagFilename", + "main::Command::MarkFlagRequired", + "main::Command::MarkFlagsMutuallyExclusive", + "main::Command::MarkFlagsOneRequired", + "main::Command::MarkFlagsRequiredTogether", + "main::Command::ParseFlags", + "main::Command::SetGlobalNormalizationFunc", + "main::Command::Traverse", + "main::Command::ValidateFlagGroups", + "main::Command::ValidateRequiredFlags", + "main::Command::argsMinusFirstX", + "main::Command::enforceFlagGroupsForCompletion", + "main::Command::execute", + "main::Command::getCompletions", + "main::Command::mergePersistentFlags", + "main::findFlag", + "main::helpOrVersionFlagPresent", + "main::stripFlags" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Command::LocalFlags", + "truth": [ + "main::Command::HasAvailableLocalFlags", + "main::Command::HasLocalFlags", + "main::Command::InheritedFlags", + "main::Command::LocalNonPersistentFlags", + "main::Command::NonInheritedFlags", + "main::defaultUsageFunc" + ], + "found": [ + "main::Command::HasAvailableLocalFlags", + "main::Command::HasLocalFlags", + "main::Command::InheritedFlags", + "main::Command::LocalNonPersistentFlags", + "main::Command::NonInheritedFlags", + "main::defaultUsageFunc" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Command::Println", + "truth": [ + "main::Command::DebugFlags", + "main::Command::ExecuteC", + "main::Command::execute" + ], + "found": [ + "main::Command::DebugFlags", + "main::Command::ExecuteC", + "main::Command::execute", + "main::preExecHook" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 0.75, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Command::Execute", + "truth": [ + "main::Command::ExecuteContext" + ], + "found": [ + "main::Command::ExecuteContext" + ], + "maybe": [ + "main::tmpl" + ], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Command::CalledAs", + "truth": [ + "main::Command::initCompleteCmd" + ], + "found": [ + "main::Command::initCompleteCmd" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Command::HasAvailableInheritedFlags", + "truth": [ + "main::defaultUsageFunc" + ], + "found": [ + "main::defaultUsageFunc" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Command::Parent", + "truth": [ + "doc::GenMarkdownCustom", + "doc::GenReSTCustom", + "doc::GenYamlCustom", + "doc::genMan", + "main::Command::CommandPath", + "main::Command::HelpFunc", + "main::Command::IsAvailableCommand", + "main::Command::Root", + "main::Command::UsageFunc", + "main::Command::VisitParents", + "main::Command::execute" + ], + "found": [ + "doc::GenMarkdownCustom", + "doc::GenReSTCustom", + "doc::GenYamlCustom", + "doc::genMan", + "main::Command::CommandPath", + "main::Command::HelpFunc", + "main::Command::IsAvailableCommand", + "main::Command::Root", + "main::Command::UsageFunc", + "main::Command::VisitParents", + "main::Command::execute" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::CompError", + "truth": [ + "main::CompErrorln" + ], + "found": [ + "main::CompErrorln" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::CompErrorln", + "truth": [ + "main::Command::initCompleteCmd" + ], + "found": [ + "main::Command::initCompleteCmd" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Command::LocalNonPersistentFlags", + "truth": [ + "main::Command::getCompletions", + "main::writeFlags" + ], + "found": [ + "main::Command::getCompletions", + "main::writeFlags" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Command::ParseFlags", + "truth": [ + "main::Command::Traverse", + "main::Command::execute", + "main::Command::getCompletions" + ], + "found": [ + "main::Command::Traverse", + "main::Command::execute", + "main::Command::getCompletions" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Command::InitDefaultCompletionCmd", + "truth": [ + "main::Command::ExecuteC" + ], + "found": [ + "main::Command::ExecuteC" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Command::ValidateFlagGroups", + "truth": [ + "main::Command::execute" + ], + "found": [ + "main::Command::execute" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Command::PrintErrln", + "truth": [ + "main::Command::ExecuteC", + "main::Command::HelpFunc", + "main::Command::UsageFunc" + ], + "found": [ + "main::Command::ExecuteC", + "main::Command::HelpFunc", + "main::Command::UsageFunc" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Command::Help", + "truth": [ + "main::Command::InitDefaultHelpCmd" + ], + "found": [ + "main::Command::InitDefaultHelpCmd" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Command::HasParent", + "truth": [ + "doc::GenMarkdownCustom", + "doc::GenReSTCustom", + "doc::GenYamlCustom", + "doc::genMan", + "doc::hasSeeAlso", + "main::Command::CommandPath", + "main::Command::ErrPrefix", + "main::Command::ExecuteC", + "main::Command::FlagErrorFunc", + "main::Command::HelpFunc", + "main::Command::HelpTemplate", + "main::Command::IsAvailableCommand", + "main::Command::Root", + "main::Command::UsageFunc", + "main::Command::UsageTemplate", + "main::Command::UseLine", + "main::Command::VersionTemplate", + "main::Command::VisitParents", + "main::Command::getErr", + "main::Command::getHelpTemplateFunc", + "main::Command::getIn", + "main::Command::getOut", + "main::Command::getUsageTemplateFunc", + "main::Command::getVersionTemplateFunc", + "main::legacyArgs" + ], + "found": [ + "doc::GenMarkdownCustom", + "doc::GenReSTCustom", + "doc::GenYamlCustom", + "doc::genMan", + "doc::hasSeeAlso", + "main::Command::CommandPath", + "main::Command::ErrPrefix", + "main::Command::ExecuteC", + "main::Command::FlagErrorFunc", + "main::Command::HelpFunc", + "main::Command::HelpTemplate", + "main::Command::IsAvailableCommand", + "main::Command::Root", + "main::Command::UsageFunc", + "main::Command::UsageTemplate", + "main::Command::UseLine", + "main::Command::VersionTemplate", + "main::Command::VisitParents", + "main::Command::getErr", + "main::Command::getHelpTemplateFunc", + "main::Command::getIn", + "main::Command::getOut", + "main::Command::getUsageTemplateFunc", + "main::Command::getVersionTemplateFunc", + "main::legacyArgs" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Command::InitDefaultVersionFlag", + "truth": [ + "main::Command::InitDefaultHelpCmd", + "main::Command::execute", + "main::Command::getCompletions" + ], + "found": [ + "main::Command::InitDefaultHelpCmd", + "main::Command::execute", + "main::Command::getCompletions" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Command::Commands", + "truth": [ + "doc::GenManTreeFromOpts", + "doc::GenMarkdownCustom", + "doc::GenMarkdownTreeCustom", + "doc::GenReSTCustom", + "doc::GenReSTTreeCustom", + "doc::GenYamlCustom", + "doc::GenYamlTreeCustom", + "doc::genMan", + "doc::hasSeeAlso", + "main::Command::InitDefaultHelpCmd", + "main::Command::getCompletions", + "main::defaultUsageFunc", + "main::gen", + "main::writeCommands" + ], + "found": [ + "doc::GenManTreeFromOpts", + "doc::GenMarkdownCustom", + "doc::GenMarkdownTreeCustom", + "doc::GenReSTCustom", + "doc::GenReSTTreeCustom", + "doc::GenYamlCustom", + "doc::GenYamlTreeCustom", + "doc::genMan", + "doc::hasSeeAlso", + "main::Command::InitDefaultHelpCmd", + "main::Command::getCompletions", + "main::defaultUsageFunc", + "main::gen", + "main::writeCommands" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Command::HelpFunc", + "truth": [ + "main::Command::ExecuteC", + "main::Command::Help" + ], + "found": [ + "main::Command::ExecuteC", + "main::Command::Help" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "doc::GenMarkdownCustom", + "truth": [ + "doc::GenMarkdown", + "doc::GenMarkdownTreeCustom" + ], + "found": [ + "doc::GenMarkdown", + "doc::GenMarkdownTreeCustom" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Command::GenBashCompletionV2", + "truth": [ + "main::Command::GenBashCompletionFileV2", + "main::Command::InitDefaultCompletionCmd" + ], + "found": [ + "main::Command::GenBashCompletionFileV2", + "main::Command::InitDefaultCompletionCmd" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Command::InheritedFlags", + "truth": [ + "doc::GenYamlCustom", + "doc::manPrintOptions", + "doc::printOptions", + "doc::printOptionsReST", + "main::Command::HasAvailableInheritedFlags", + "main::Command::HasInheritedFlags", + "main::Command::getCompletions", + "main::completeRequireFlags", + "main::defaultUsageFunc", + "main::findFlag", + "main::writeFlags" + ], + "found": [ + "doc::GenYamlCustom", + "doc::manPrintOptions", + "doc::printOptions", + "doc::printOptionsReST", + "main::Command::HasAvailableInheritedFlags", + "main::Command::HasInheritedFlags", + "main::Command::getCompletions", + "main::completeRequireFlags", + "main::defaultUsageFunc", + "main::findFlag", + "main::writeFlags" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Command::Root", + "truth": [ + "main::Command::ExecuteC", + "main::Command::InitDefaultCompletionCmd", + "main::Command::InitDefaultHelpCmd", + "main::Command::SetCompletionCommandGroupID", + "main::Command::getCompletions", + "main::Command::updateParentsPflags", + "main::GetActiveHelpConfig", + "main::gen", + "main::getEnvConfig", + "main::prepareCustomAnnotationsForFlags", + "main::writeFlagHandler", + "main::writeFlags" + ], + "found": [ + "main::Command::ExecuteC", + "main::Command::InitDefaultCompletionCmd", + "main::Command::InitDefaultHelpCmd", + "main::Command::SetCompletionCommandGroupID", + "main::Command::getCompletions", + "main::Command::updateParentsPflags", + "main::GetActiveHelpConfig", + "main::gen", + "main::getEnvConfig", + "main::prepareCustomAnnotationsForFlags", + "main::writeFlagHandler", + "main::writeFlags" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "doc::GenMarkdownTreeCustom", + "truth": [ + "doc::GenMarkdownTree" + ], + "found": [ + "doc::GenMarkdownTree" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Command::FlagErrorFunc", + "truth": [ + "main::Command::execute" + ], + "found": [ + "main::Command::execute" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Command::SetGlobalNormalizationFunc", + "truth": [ + "main::Command::AddCommand" + ], + "found": [ + "main::Command::AddCommand" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Command::UseLine", + "truth": [ + "doc::GenMarkdownCustom", + "doc::GenReSTCustom", + "doc::GenYamlCustom", + "doc::manPreamble", + "main::defaultUsageFunc" + ], + "found": [ + "doc::GenMarkdownCustom", + "doc::GenReSTCustom", + "doc::GenYamlCustom", + "doc::manPreamble", + "main::defaultUsageFunc" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Command::GenZshCompletion", + "truth": [ + "main::Command::InitDefaultCompletionCmd" + ], + "found": [ + "main::Command::InitDefaultCompletionCmd" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::flagCompError::Error", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Command::HasPersistentFlags", + "truth": [ + "main::Command::DebugFlags", + "main::Command::persistentFlag" + ], + "found": [ + "main::Command::DebugFlags", + "main::Command::persistentFlag" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Command::PrintErr", + "truth": [ + "main::Command::PrintErrf", + "main::Command::PrintErrln" + ], + "found": [ + "main::Command::PrintErrf", + "main::Command::PrintErrln" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "doc::GenYamlCustom", + "truth": [ + "doc::GenYaml", + "doc::GenYamlTreeCustom" + ], + "found": [ + "doc::GenYaml", + "doc::GenYamlTreeCustom" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Command::HasSubCommands", + "truth": [ + "main::Command::DebugFlags", + "main::Command::InitDefaultHelpCmd", + "main::defaultHelpFunc", + "main::legacyArgs" + ], + "found": [ + "main::Command::DebugFlags", + "main::Command::InitDefaultHelpCmd", + "main::defaultHelpFunc", + "main::legacyArgs" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Command::Traverse", + "truth": [ + "main::Command::ExecuteC", + "main::Command::getCompletions" + ], + "found": [ + "main::Command::ExecuteC", + "main::Command::getCompletions" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Command::SuggestionsFor", + "truth": [ + "main::Command::findSuggestions" + ], + "found": [ + "main::Command::findSuggestions" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Command::Usage", + "truth": [ + "main::Command::InitDefaultHelpCmd", + "main::Command::UsageString" + ], + "found": [ + "main::Command::InitDefaultHelpCmd", + "main::Command::UsageString" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Command::ValidateArgs", + "truth": [ + "main::Command::execute" + ], + "found": [ + "main::Command::execute" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Command::HasFlags", + "truth": [ + "main::Command::DebugFlags" + ], + "found": [ + "main::Command::DebugFlags" + ], + "maybe": [ + "doc::GenYamlCustom", + "main::Command::HasInheritedFlags", + "main::Command::HasLocalFlags", + "main::Command::HasPersistentFlags" + ], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + } + ], + "callers_common": [ + { + "symbol": "main::Command::MarkFlagRequired", + "truth": [ + "main::Command::enforceFlagGroupsForCompletion" + ], + "found": [ + "main::Command::enforceFlagGroupsForCompletion" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + } + ], + "callers_blind": [ + { + "symbol": "main::Command::NamePadding", + "truth": [ + "main::defaultUsageFunc" + ], + "found": [ + "main::defaultUsageFunc" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Command::SetHelpFunc", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Command::HasLocalFlags", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::CheckErr", + "truth": [ + "main::Command::InitDefaultHelpCmd", + "main::Command::UsageString", + "main::WriteStringAndCheck" + ], + "found": [ + "main::Command::InitDefaultHelpCmd", + "main::Command::UsageString", + "main::WriteStringAndCheck" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Command::CommandPathPadding", + "truth": [ + "main::defaultUsageFunc" + ], + "found": [ + "main::defaultUsageFunc" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Command::VersionTemplate", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Command::RegisterFlagCompletionFunc", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Command::GenPowerShellCompletionWithDesc", + "truth": [ + "main::Command::InitDefaultCompletionCmd" + ], + "found": [ + "main::Command::InitDefaultCompletionCmd" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Command::Print", + "truth": [ + "main::Command::ParseFlags", + "main::Command::Printf", + "main::Command::Println" + ], + "found": [ + "main::Command::ParseFlags", + "main::Command::Printf", + "main::Command::Println", + "main::preExecHook" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 0.75, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Command::OutOrStderr", + "truth": [ + "main::Command::Print", + "main::Command::UsageFunc" + ], + "found": [ + "main::Command::Print", + "main::Command::UsageFunc" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::AddTemplateFunc", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Command::PrintErrf", + "truth": [ + "main::Command::ExecuteC" + ], + "found": [ + "main::Command::ExecuteC" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::FixedCompletions", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::MinimumNArgs", + "truth": [ + "main::Command::initCompleteCmd" + ], + "found": [ + "main::Command::initCompleteCmd" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Command::Flags", + "truth": [ + "main::Command::ArgsLenAtDash", + "main::Command::Flag", + "main::Command::HasAvailableFlags", + "main::Command::HasFlags", + "main::Command::InitDefaultCompletionCmd", + "main::Command::InitDefaultHelpFlag", + "main::Command::InitDefaultVersionFlag", + "main::Command::LocalFlags", + "main::Command::MarkFlagCustom", + "main::Command::MarkFlagDirname", + "main::Command::MarkFlagFilename", + "main::Command::MarkFlagRequired", + "main::Command::MarkFlagsMutuallyExclusive", + "main::Command::MarkFlagsOneRequired", + "main::Command::MarkFlagsRequiredTogether", + "main::Command::ParseFlags", + "main::Command::SetGlobalNormalizationFunc", + "main::Command::Traverse", + "main::Command::ValidateFlagGroups", + "main::Command::ValidateRequiredFlags", + "main::Command::argsMinusFirstX", + "main::Command::enforceFlagGroupsForCompletion", + "main::Command::execute", + "main::Command::getCompletions", + "main::Command::mergePersistentFlags", + "main::findFlag", + "main::helpOrVersionFlagPresent", + "main::stripFlags" + ], + "found": [ + "main::Command::ArgsLenAtDash", + "main::Command::Flag", + "main::Command::HasAvailableFlags", + "main::Command::HasFlags", + "main::Command::InitDefaultCompletionCmd", + "main::Command::InitDefaultHelpFlag", + "main::Command::InitDefaultVersionFlag", + "main::Command::LocalFlags", + "main::Command::MarkFlagCustom", + "main::Command::MarkFlagDirname", + "main::Command::MarkFlagFilename", + "main::Command::MarkFlagRequired", + "main::Command::MarkFlagsMutuallyExclusive", + "main::Command::MarkFlagsOneRequired", + "main::Command::MarkFlagsRequiredTogether", + "main::Command::ParseFlags", + "main::Command::SetGlobalNormalizationFunc", + "main::Command::Traverse", + "main::Command::ValidateFlagGroups", + "main::Command::ValidateRequiredFlags", + "main::Command::argsMinusFirstX", + "main::Command::enforceFlagGroupsForCompletion", + "main::Command::execute", + "main::Command::getCompletions", + "main::Command::mergePersistentFlags", + "main::findFlag", + "main::helpOrVersionFlagPresent", + "main::stripFlags" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Command::LocalFlags", + "truth": [ + "main::Command::HasAvailableLocalFlags", + "main::Command::HasLocalFlags", + "main::Command::InheritedFlags", + "main::Command::LocalNonPersistentFlags", + "main::Command::NonInheritedFlags", + "main::defaultUsageFunc" + ], + "found": [ + "main::Command::HasAvailableLocalFlags", + "main::Command::HasLocalFlags", + "main::Command::InheritedFlags", + "main::Command::LocalNonPersistentFlags", + "main::Command::NonInheritedFlags", + "main::defaultUsageFunc" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Command::Println", + "truth": [ + "main::Command::DebugFlags", + "main::Command::ExecuteC", + "main::Command::execute" + ], + "found": [ + "main::Command::DebugFlags", + "main::Command::ExecuteC", + "main::Command::execute", + "main::preExecHook" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 0.75, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Command::Execute", + "truth": [ + "main::Command::ExecuteContext" + ], + "found": [ + "main::Command::ExecuteContext" + ], + "maybe": [ + "main::tmpl" + ], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Command::SetHelpCommand", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Command::UsagePadding", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Command::ValidateFlagGroups", + "truth": [ + "main::Command::execute" + ], + "found": [ + "main::Command::execute" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Command::PrintErrln", + "truth": [ + "main::Command::ExecuteC", + "main::Command::HelpFunc", + "main::Command::UsageFunc" + ], + "found": [ + "main::Command::ExecuteC", + "main::Command::HelpFunc", + "main::Command::UsageFunc" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Command::Help", + "truth": [ + "main::Command::InitDefaultHelpCmd" + ], + "found": [ + "main::Command::InitDefaultHelpCmd" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Command::CalledAs", + "truth": [ + "main::Command::initCompleteCmd" + ], + "found": [ + "main::Command::initCompleteCmd" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Command::MarkZshCompPositionalArgumentFile", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Command::GenBashCompletionFile", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::CompErrorln", + "truth": [ + "main::Command::initCompleteCmd" + ], + "found": [ + "main::Command::initCompleteCmd" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Command::HasParent", + "truth": [ + "doc::GenMarkdownCustom", + "doc::GenReSTCustom", + "doc::GenYamlCustom", + "doc::genMan", + "doc::hasSeeAlso", + "main::Command::CommandPath", + "main::Command::ErrPrefix", + "main::Command::ExecuteC", + "main::Command::FlagErrorFunc", + "main::Command::HelpFunc", + "main::Command::HelpTemplate", + "main::Command::IsAvailableCommand", + "main::Command::Root", + "main::Command::UsageFunc", + "main::Command::UsageTemplate", + "main::Command::UseLine", + "main::Command::VersionTemplate", + "main::Command::VisitParents", + "main::Command::getErr", + "main::Command::getHelpTemplateFunc", + "main::Command::getIn", + "main::Command::getOut", + "main::Command::getUsageTemplateFunc", + "main::Command::getVersionTemplateFunc", + "main::legacyArgs" + ], + "found": [ + "doc::GenMarkdownCustom", + "doc::GenReSTCustom", + "doc::GenYamlCustom", + "doc::genMan", + "doc::hasSeeAlso", + "main::Command::CommandPath", + "main::Command::ErrPrefix", + "main::Command::ExecuteC", + "main::Command::FlagErrorFunc", + "main::Command::HelpFunc", + "main::Command::HelpTemplate", + "main::Command::IsAvailableCommand", + "main::Command::Root", + "main::Command::UsageFunc", + "main::Command::UsageTemplate", + "main::Command::UseLine", + "main::Command::VersionTemplate", + "main::Command::VisitParents", + "main::Command::getErr", + "main::Command::getHelpTemplateFunc", + "main::Command::getIn", + "main::Command::getOut", + "main::Command::getUsageTemplateFunc", + "main::Command::getVersionTemplateFunc", + "main::legacyArgs" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Command::AddGroup", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Command::InitDefaultVersionFlag", + "truth": [ + "main::Command::InitDefaultHelpCmd", + "main::Command::execute", + "main::Command::getCompletions" + ], + "found": [ + "main::Command::InitDefaultHelpCmd", + "main::Command::execute", + "main::Command::getCompletions" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Command::Commands", + "truth": [ + "doc::GenManTreeFromOpts", + "doc::GenMarkdownCustom", + "doc::GenMarkdownTreeCustom", + "doc::GenReSTCustom", + "doc::GenReSTTreeCustom", + "doc::GenYamlCustom", + "doc::GenYamlTreeCustom", + "doc::genMan", + "doc::hasSeeAlso", + "main::Command::InitDefaultHelpCmd", + "main::Command::getCompletions", + "main::defaultUsageFunc", + "main::gen", + "main::writeCommands" + ], + "found": [ + "doc::GenManTreeFromOpts", + "doc::GenMarkdownCustom", + "doc::GenMarkdownTreeCustom", + "doc::GenReSTCustom", + "doc::GenReSTTreeCustom", + "doc::GenYamlCustom", + "doc::GenYamlTreeCustom", + "doc::genMan", + "doc::hasSeeAlso", + "main::Command::InitDefaultHelpCmd", + "main::Command::getCompletions", + "main::defaultUsageFunc", + "main::gen", + "main::writeCommands" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Command::Parent", + "truth": [ + "doc::GenMarkdownCustom", + "doc::GenReSTCustom", + "doc::GenYamlCustom", + "doc::genMan", + "main::Command::CommandPath", + "main::Command::HelpFunc", + "main::Command::IsAvailableCommand", + "main::Command::Root", + "main::Command::UsageFunc", + "main::Command::VisitParents", + "main::Command::execute" + ], + "found": [ + "doc::GenMarkdownCustom", + "doc::GenReSTCustom", + "doc::GenYamlCustom", + "doc::genMan", + "main::Command::CommandPath", + "main::Command::HelpFunc", + "main::Command::IsAvailableCommand", + "main::Command::Root", + "main::Command::UsageFunc", + "main::Command::VisitParents", + "main::Command::execute" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Command::HelpFunc", + "truth": [ + "main::Command::ExecuteC", + "main::Command::Help" + ], + "found": [ + "main::Command::ExecuteC", + "main::Command::Help" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "doc::GenMarkdownCustom", + "truth": [ + "doc::GenMarkdown", + "doc::GenMarkdownTreeCustom" + ], + "found": [ + "doc::GenMarkdown", + "doc::GenMarkdownTreeCustom" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Command::GenBashCompletionV2", + "truth": [ + "main::Command::GenBashCompletionFileV2", + "main::Command::InitDefaultCompletionCmd" + ], + "found": [ + "main::Command::GenBashCompletionFileV2", + "main::Command::InitDefaultCompletionCmd" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Command::SetUsageTemplate", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Command::FlagErrorFunc", + "truth": [ + "main::Command::execute" + ], + "found": [ + "main::Command::execute" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Command::DebugFlags", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::CompDebugln", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Command::SetGlobalNormalizationFunc", + "truth": [ + "main::Command::AddCommand" + ], + "found": [ + "main::Command::AddCommand" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Command::UseLine", + "truth": [ + "doc::GenMarkdownCustom", + "doc::GenReSTCustom", + "doc::GenYamlCustom", + "doc::manPreamble", + "main::defaultUsageFunc" + ], + "found": [ + "doc::GenMarkdownCustom", + "doc::GenReSTCustom", + "doc::GenYamlCustom", + "doc::manPreamble", + "main::defaultUsageFunc" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Command::GenZshCompletion", + "truth": [ + "main::Command::InitDefaultCompletionCmd" + ], + "found": [ + "main::Command::InitDefaultCompletionCmd" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::RangeArgs", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::flagCompError::Error", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Command::Root", + "truth": [ + "main::Command::ExecuteC", + "main::Command::InitDefaultCompletionCmd", + "main::Command::InitDefaultHelpCmd", + "main::Command::SetCompletionCommandGroupID", + "main::Command::getCompletions", + "main::Command::updateParentsPflags", + "main::GetActiveHelpConfig", + "main::gen", + "main::getEnvConfig", + "main::prepareCustomAnnotationsForFlags", + "main::writeFlagHandler", + "main::writeFlags" + ], + "found": [ + "main::Command::ExecuteC", + "main::Command::InitDefaultCompletionCmd", + "main::Command::InitDefaultHelpCmd", + "main::Command::SetCompletionCommandGroupID", + "main::Command::getCompletions", + "main::Command::updateParentsPflags", + "main::GetActiveHelpConfig", + "main::gen", + "main::getEnvConfig", + "main::prepareCustomAnnotationsForFlags", + "main::writeFlagHandler", + "main::writeFlags" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "doc::GenYaml", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Command::ResetCommands", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Command::HasPersistentFlags", + "truth": [ + "main::Command::DebugFlags", + "main::Command::persistentFlag" + ], + "found": [ + "main::Command::DebugFlags", + "main::Command::persistentFlag" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Command::SetFlagErrorFunc", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Command::SetUsageFunc", + "skipped": "compiler reported no uses" + }, + { + "symbol": "doc::GenReST", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::CompletionOptions::SetDefaultShellCompDirective", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Command::PrintErr", + "truth": [ + "main::Command::PrintErrf", + "main::Command::PrintErrln" + ], + "found": [ + "main::Command::PrintErrf", + "main::Command::PrintErrln" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + } + ], + "rename": [ + { + "symbol": "main::Command::NamePadding", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "main::CheckErr", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "main::Command::CommandPathPadding", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "main::Command::GenPowerShellCompletionWithDesc", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "main::Command::Print", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "bash_completionsV2.go:179: # Print the activeHelp statements before we finish\nbash_completionsV2.go:184: # Print the activeHelp statements\nbash_completions_test.go:134:\t\tShort: \"Print anything to the screen\",\ncommand.go:1434:// Print is a convenience method to Print to the defined output, fall", + "detail": "" + }, + { + "symbol": "main::Command::OutOrStderr", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "main::Command::PrintErrf", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "main::MinimumNArgs", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "main::Command::Flags", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "command.go:1686:// Flags returns the complete FlagSet that applies\ncommand.go:1961:Flags:\ncommand.go:1964:Global Flags:\ncommand.go:2024:\t\tfmt.Fprintf(w, \"\\n\\nGlobal Flags:\\n\")\ncommand_test.go:984:Flags:", + "detail": "" + }, + { + "symbol": "main::Command::LocalFlags", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "main::Command::Println", + "ok": false, + "compiled": true, + "tests_ok": false, + "tests_failed": [ + "TestDeadcodeElimination" + ], + "old_name_left": "command.go:1439:// Println is a convenience method to Println to the defined output, fallback to Stderr if not set.\ncommand.go:1454:// PrintErrln is a convenience method to Println to the defined Err output, fallback to Stderr if not set.\ndoc/yaml_docs.go:139:\t\tfmt.Println(err)", + "detail": "" + }, + { + "symbol": "main::Command::Execute", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "cobra.go:98:// Execute method is called.\ncobra.go:104:// Execute method is terminated.\ncobra.go:186:\t\t\treturn t.Execute(w, data)\ncommand.go:266:// Notice that a call to Execute and ExecuteC will replace a nil context of\ncommand.go:976:\t\t\t// - Execute all persistent pre-runs from the root parent till", + "detail": "" + }, + { + "symbol": "main::Command::CalledAs", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "main::Command::HasAvailableInheritedFlags", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "main::Command::Parent", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "command.go:1891:// Parent returns a commands parent command.", + "detail": "" + }, + { + "symbol": "main::CompError", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "main::CompErrorln", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "main::Command::LocalNonPersistentFlags", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "main::Command::ParseFlags", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "main::Command::InitDefaultCompletionCmd", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "main::Command::ValidateFlagGroups", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "main::Command::PrintErrln", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "main::Command::Help", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "cobra.go:83:// AddTemplateFunc adds a template function that's available to Usage and Help\ncobra.go:90:// Help template generation.\ncommand.go:517:// Help puts out the help for the command.\ncommand.go:1271:\t\t\tShort: \"Help about any command\",\ncommand_test.go:994:\t\tt.Errorf(\"Help text mismatch.\\nExpec", + "detail": "" + }, + { + "symbol": "main::Command::HasParent", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "main::Command::InitDefaultVersionFlag", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "main::Command::Commands", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "cobra.go:15:// Commands similar to git, go tools and other modern CLI tools\ncommand.go:1331:// Commands returns a sorted slice of child commands.\ncommand.go:1952:Available Commands:{{range $cmds}}{{if (or .IsAvailableCommand (eq .Name \"help\"))}}\ncommand.go:1958:Additional Commands:{{range $cmds}}{{i", + "detail": "" + }, + { + "symbol": "main::Command::HelpFunc", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "doc::GenMarkdownCustom", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "main::Command::GenBashCompletionV2", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "main::Command::InheritedFlags", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "main::Command::Root", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "command.go:891:// Root finds root command.\ncommand.go:1089:\t// Regardless of what command execute is called on, run on Root only\ncommand.go:1281:\t\t\t\t\t// Root help command.\ncommand_test.go:194:\t\tt.Errorf(\"Root command must not fail: %+v\", err)\ncommand_test.go:223:\t\tt.Errorf(\"Root command must not fai", + "detail": "" + }, + { + "symbol": "doc::GenMarkdownTreeCustom", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "main::Command::FlagErrorFunc", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "main::Command::SetGlobalNormalizationFunc", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "main::Command::UseLine", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "main::Command::GenZshCompletion", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "main::flagCompError::Error", + "ok": false, + "compiled": false, + "tests_ok": null, + "tests_failed": [], + "old_name_left": "bash_completions.go:120: # Error code. No completion.\nbash_completionsV2.go:107: # Error code. No completion.\nbash_completions_test.go:49:\t\tt.Errorf(\"Error thrown performing MatchString: \\n %s\\n\", err)\ncobra.go:234:// CheckErr prints the msg with the prefix 'Error:' and exits with er", + "detail": "go:377:135: err.ErrorGnx undefined (type error has no field or method ErrorGnx)\n./completions.go:388:15: impossible type assertion: flagErr.(*flagCompError)\n\t*flagCompError does not implement error (missing method Error)\n./completions.go:727:33: cannot use &flagCompError{…} (value of type *flagCompError) as error value in return statement: *flagCompError does not implement error (missing method Error)\nFAIL\tgithub.com/spf13/cobra [build failed]\nFAIL\tgithub.com/spf13/cobra/doc [build failed]\nFAIL\n" + }, + { + "symbol": "main::Command::HasPersistentFlags", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "main::Command::PrintErr", + "ok": false, + "compiled": true, + "tests_ok": false, + "tests_failed": [ + "TestCommandPrintRedirection" + ], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "doc::GenYamlCustom", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "main::Command::HasSubCommands", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "main::Command::Traverse", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "command.go:819:// Traverse the command tree to find the command, and parse args for\ncommand_test.go:2390:\t// Traverse.\ncompletions_test.go:256:\t// Test that we don't use Traverse when we shouldn't.", + "detail": "" + }, + { + "symbol": "main::Command::SuggestionsFor", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "main::Command::Usage", + "ok": false, + "compiled": true, + "tests_ok": false, + "tests_failed": [ + "TestFlagErrorFuncHelp", + "TestHelpCommandExecutedOnChildWithFlagThatShadowsParentFlag" + ], + "old_name_left": "cobra.go:83:// AddTemplateFunc adds a template function that's available to Usage and Help\ncobra.go:89:// AddTemplateFuncs adds multiple template functions that are available to Usage and\ncommand.go:312:// SetUsageFunc sets usage function. Usage can be defined by application.\ncommand.go:475:// Usage", + "detail": "" + }, + { + "symbol": "main::Command::ValidateArgs", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "main::Command::HasFlags", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "command.go:1802:\treturn c.Flags().HasFlags()\ncommand.go:1807:\treturn c.PersistentFlags().HasFlags()\ncommand.go:1812:\treturn c.LocalFlags().HasFlags()\ncommand.go:1817:\treturn c.InheritedFlags().HasFlags()\ndoc/yaml_docs.go:112:\tif flags.HasFlags() {", + "detail": "" + } + ], + "mutants": { + "7": [ + "main::Command::NamePadding", + "main::CheckErr", + "main::Command::CommandPathPadding", + "main::Command::GenPowerShellCompletionWithDesc", + "main::Command::Print", + "main::Command::OutOrStderr", + "main::Command::PrintErrf", + "main::MinimumNArgs", + "main::Command::Flags", + "main::Command::LocalFlags" + ], + "8": [ + "main::Command::ValidateFlagGroups", + "main::Command::PrintErrln", + "main::Command::Help", + "main::Command::CalledAs", + "main::Command::CommandPathPadding", + "main::CompErrorln", + "main::Command::HasParent", + "main::Command::InitDefaultVersionFlag", + "main::Command::Commands" + ], + "9": [ + "main::Command::FlagErrorFunc", + "main::Command::SetGlobalNormalizationFunc", + "main::Command::UseLine", + "main::Command::GenZshCompletion", + "main::Command::GenPowerShellCompletionWithDesc", + "main::Command::LocalFlags", + "main::flagCompError::Error", + "main::Command::Root", + "main::Command::HasPersistentFlags", + "main::Command::OutOrStderr" + ] + }, + "tests": [ + { + "symbol": "main::Command::NamePadding", + "level": "name", + "truth": 21, + "predicted": 125, + "recall": 0.9047619047619048, + "precision": 0.152, + "top_hits": 0, + "top_n": 10, + "top_precision": 0.0, + "top_best": 1.0, + "caught": 0.0, + "missed": [ + "TestDefaultCompletionCmd", + "TestValidateFlagGroups" + ], + "recall_graph_only": 0.0 + }, + { + "symbol": "main::CheckErr", + "level": "name", + "truth": 109, + "predicted": 232, + "recall": 0.926605504587156, + "precision": 0.4353448275862069, + "top_hits": 8, + "top_n": 10, + "top_precision": 0.8, + "top_best": 1.0, + "caught": 1.0, + "missed": [ + "TestBashCompletionV2WithActiveHelp", + "TestCompleteCmdInZshScript", + "TestCompleteNoDesCmdInZshScript", + "TestGenFishCompletionFile", + "TestGenManTree", + "TestHelpFuncExecuted", + "TestPwshCompletionNoActiveHelp", + "TestZshCompletionWithActiveHelp" + ], + "recall_graph_only": 0.926605504587156 + }, + { + "symbol": "main::Command::CommandPathPadding", + "level": "name", + "truth": 1, + "predicted": 125, + "recall": 1.0, + "precision": 0.008, + "top_hits": 0, + "top_n": 10, + "top_precision": 0.0, + "top_best": 0.1, + "caught": 0.0, + "missed": [], + "recall_graph_only": 0.0 + }, + { + "symbol": "main::Command::GenPowerShellCompletionWithDesc", + "skipped": "no test fails when it throws", + "predicted": 203 + }, + { + "symbol": "main::Command::Print", + "level": "name", + "truth": 59, + "predicted": 210, + "recall": 1.0, + "precision": 0.28095238095238095, + "top_hits": 3, + "top_n": 10, + "top_precision": 0.3, + "top_best": 1.0, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "main::Command::OutOrStderr", + "level": "name", + "truth": 87, + "predicted": 203, + "recall": 0.9885057471264368, + "precision": 0.4236453201970443, + "top_hits": 4, + "top_n": 10, + "top_precision": 0.4, + "top_best": 1.0, + "caught": 1.0, + "missed": [ + "TestValidateFlagGroups" + ], + "recall_graph_only": 0.9885057471264368 + }, + { + "symbol": "main::Command::PrintErrf", + "level": "name", + "truth": 7, + "predicted": 205, + "recall": 0.8571428571428571, + "precision": 0.02926829268292683, + "top_hits": 1, + "top_n": 10, + "top_precision": 0.1, + "top_best": 0.6, + "caught": 1.0, + "missed": [ + "TestCalledAs" + ], + "recall_graph_only": 0.8571428571428571 + }, + { + "symbol": "main::MinimumNArgs", + "level": "name", + "truth": 204, + "predicted": 204, + "recall": 0.9803921568627451, + "precision": 0.9803921568627451, + "top_hits": 10, + "top_n": 10, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [ + "TestCalledAs", + "TestExecuteContext", + "TestHelpFuncExecuted", + "TestSetContextPreRunOverwrite" + ], + "recall_graph_only": 0.9803921568627451 + }, + { + "symbol": "main::Command::Flags", + "skipped": "mutant does not compile" + }, + { + "symbol": "main::Command::LocalFlags", + "level": "name", + "truth": 149, + "predicted": 9, + "recall": 0.053691275167785234, + "precision": 0.8888888888888888, + "top_hits": 8, + "top_n": 9, + "top_precision": 0.8888888888888888, + "top_best": 0.8888888888888888, + "caught": 1.0, + "missed": [ + "TestActiveHelpAlone", + "TestActiveHelpWithComps", + "TestAddGroup", + "TestArbitraryArgs_WithValidOnly_WithInvalidArgs", + "TestArgAliasesCompletionInGo", + "TestArgsNotDetectedAsFlagsCompletionInGo", + "TestBashCompletionDeprecatedFlag", + "TestBashCompletionHiddenFlag" + ], + "recall_graph_only": 0.053691275167785234 + }, + { + "symbol": "main::Command::ValidateFlagGroups", + "level": "name", + "truth": 116, + "predicted": 202, + "recall": 0.9655172413793104, + "precision": 0.5544554455445545, + "top_hits": 10, + "top_n": 10, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [ + "TestCalledAs", + "TestExecuteContext", + "TestHelpFuncExecuted", + "TestSetContextPreRunOverwrite" + ], + "recall_graph_only": 0.9655172413793104 + }, + { + "symbol": "main::Command::PrintErrln", + "level": "name", + "truth": 61, + "predicted": 207, + "recall": 0.9836065573770492, + "precision": 0.2898550724637681, + "top_hits": 2, + "top_n": 10, + "top_precision": 0.2, + "top_best": 1.0, + "caught": 1.0, + "missed": [ + "TestCalledAs" + ], + "recall_graph_only": 0.9836065573770492 + }, + { + "symbol": "main::Command::Help", + "level": "name", + "truth": 7, + "predicted": 223, + "recall": 1.0, + "precision": 0.03139013452914798, + "top_hits": 0, + "top_n": 10, + "top_precision": 0.0, + "top_best": 0.7, + "caught": 0.0, + "missed": [], + "recall_graph_only": 0.8571428571428571 + }, + { + "symbol": "main::Command::CalledAs", + "level": "name", + "truth": 47, + "predicted": 204, + "recall": 1.0, + "precision": 0.23039215686274508, + "top_hits": 2, + "top_n": 10, + "top_precision": 0.2, + "top_best": 1.0, + "caught": 1.0, + "missed": [], + "recall_graph_only": 0.9787234042553191 + }, + { + "symbol": "main::CompErrorln", + "level": "name", + "truth": 1, + "predicted": 203, + "recall": 1.0, + "precision": 0.0049261083743842365, + "top_hits": 0, + "top_n": 10, + "top_precision": 0.0, + "top_best": 0.1, + "caught": 0.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "main::Command::HasParent", + "skipped": "mutant does not compile" + }, + { + "symbol": "main::Command::InitDefaultVersionFlag", + "level": "name", + "truth": 197, + "predicted": 217, + "recall": 0.9796954314720813, + "precision": 0.8894009216589862, + "top_hits": 8, + "top_n": 10, + "top_precision": 0.8, + "top_best": 1.0, + "caught": 1.0, + "missed": [ + "TestCalledAs", + "TestExecuteContext", + "TestHelpFuncExecuted", + "TestSetContextPreRunOverwrite" + ], + "recall_graph_only": 0.9796954314720813 + }, + { + "symbol": "main::Command::Commands", + "level": "name", + "truth": 96, + "predicted": 231, + "recall": 1.0, + "precision": 0.4155844155844156, + "top_hits": 10, + "top_n": 10, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "main::Command::FlagErrorFunc", + "level": "name", + "truth": 17, + "predicted": 202, + "recall": 1.0, + "precision": 0.08415841584158416, + "top_hits": 2, + "top_n": 10, + "top_precision": 0.2, + "top_best": 1.0, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "main::Command::SetGlobalNormalizationFunc", + "level": "name", + "truth": 4, + "predicted": 229, + "recall": 1.0, + "precision": 0.017467248908296942, + "top_hits": 4, + "top_n": 10, + "top_precision": 0.4, + "top_best": 0.4, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "main::Command::UseLine", + "level": "name", + "truth": 86, + "predicted": 19, + "recall": 0.11627906976744186, + "precision": 0.5263157894736842, + "top_hits": 4, + "top_n": 10, + "top_precision": 0.4, + "top_best": 1.0, + "caught": 1.0, + "missed": [ + "TestAddGroup", + "TestArbitraryArgs_WithValidOnly_WithInvalidArgs", + "TestChildFlagWithParentLocalFlag", + "TestChildTakesNoArgs", + "TestExactArgs_WithInvalidCount", + "TestExactArgs_WithInvalidCount_WithValid", + "TestExactArgs_WithInvalidCount_WithValidOnly_WithInvalidArgs", + "TestExactArgs_WithInvalidCount_WithValid_WithInvalidArgs" + ], + "recall_graph_only": 0.11627906976744186 + }, + { + "symbol": "main::Command::GenZshCompletion", + "level": "name", + "truth": 3, + "predicted": 205, + "recall": 1.0, + "precision": 0.014634146341463415, + "top_hits": 3, + "top_n": 10, + "top_precision": 0.3, + "top_best": 0.3, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "main::flagCompError::Error", + "skipped": "no test fails when it throws", + "predicted": 208 + }, + { + "symbol": "main::Command::Root", + "level": "name", + "truth": 248, + "predicted": 237, + "recall": 0.9435483870967742, + "precision": 0.9873417721518988, + "top_hits": 10, + "top_n": 10, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [ + "TestAddTemplateFunctions", + "TestCalledAs", + "TestCompletionFuncCompatibility", + "TestFind", + "TestGenManTree", + "TestGenMdTree", + "TestGenRSTTree", + "TestGenYamlTree" + ], + "recall_graph_only": 0.9435483870967742 + }, + { + "symbol": "main::Command::HasPersistentFlags", + "level": "name", + "truth": 4, + "predicted": 11, + "recall": 1.0, + "precision": 0.36363636363636365, + "top_hits": 3, + "top_n": 10, + "top_precision": 0.3, + "top_best": 0.4, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + } + ], + "look": [ + { + "symbol": "main::Command::NamePadding", + "look_tokens": 255, + "file_tokens": 15286 + }, + { + "symbol": "main::CheckErr", + "look_tokens": 315, + "file_tokens": 1871 + }, + { + "symbol": "main::Command::CommandPathPadding", + "look_tokens": 279, + "file_tokens": 15286 + }, + { + "symbol": "main::Command::GenPowerShellCompletionWithDesc", + "look_tokens": 303, + "file_tokens": 3403 + }, + { + "symbol": "main::Command::Print", + "look_tokens": 284, + "file_tokens": 15286 + }, + { + "symbol": "main::Command::OutOrStderr", + "look_tokens": 250, + "file_tokens": 15286 + }, + { + "symbol": "main::Command::PrintErrf", + "look_tokens": 263, + "file_tokens": 15286 + }, + { + "symbol": "main::MinimumNArgs", + "look_tokens": 346, + "file_tokens": 1120 + }, + { + "symbol": "main::Command::Flags", + "look_tokens": 403, + "file_tokens": 15286 + }, + { + "symbol": "main::Command::LocalFlags", + "look_tokens": 510, + "file_tokens": 15286 + }, + { + "symbol": "main::Command::Println", + "look_tokens": 273, + "file_tokens": 15286 + }, + { + "symbol": "main::Command::Execute", + "look_tokens": 274, + "file_tokens": 15286 + }, + { + "symbol": "main::Command::CalledAs", + "look_tokens": 262, + "file_tokens": 15286 + }, + { + "symbol": "main::Command::HasAvailableInheritedFlags", + "look_tokens": 302, + "file_tokens": 15286 + }, + { + "symbol": "main::Command::Parent", + "look_tokens": 320, + "file_tokens": 15286 + }, + { + "symbol": "main::CompError", + "look_tokens": 277, + "file_tokens": 9767 + }, + { + "symbol": "main::CompErrorln", + "look_tokens": 262, + "file_tokens": 9767 + }, + { + "symbol": "main::Command::LocalNonPersistentFlags", + "look_tokens": 403, + "file_tokens": 15286 + }, + { + "symbol": "main::Command::ParseFlags", + "look_tokens": 428, + "file_tokens": 15286 + }, + { + "symbol": "main::Command::InitDefaultCompletionCmd", + "look_tokens": 1797, + "file_tokens": 9767 + }, + { + "symbol": "main::Command::ValidateFlagGroups", + "look_tokens": 525, + "file_tokens": 2405 + }, + { + "symbol": "main::Command::PrintErrln", + "look_tokens": 272, + "file_tokens": 15286 + }, + { + "symbol": "main::Command::Help", + "look_tokens": 257, + "file_tokens": 15286 + }, + { + "symbol": "main::Command::HasParent", + "look_tokens": 315, + "file_tokens": 15286 + }, + { + "symbol": "main::Command::InitDefaultVersionFlag", + "look_tokens": 430, + "file_tokens": 15286 + }, + { + "symbol": "main::Command::Commands", + "look_tokens": 390, + "file_tokens": 15286 + }, + { + "symbol": "main::Command::HelpFunc", + "look_tokens": 373, + "file_tokens": 15286 + }, + { + "symbol": "doc::GenMarkdownCustom", + "look_tokens": 665, + "file_tokens": 1164 + }, + { + "symbol": "main::Command::GenBashCompletionV2", + "look_tokens": 298, + "file_tokens": 4463 + }, + { + "symbol": "main::Command::InheritedFlags", + "look_tokens": 535, + "file_tokens": 15286 + }, + { + "symbol": "main::Command::Root", + "look_tokens": 346, + "file_tokens": 15286 + }, + { + "symbol": "doc::GenMarkdownTreeCustom", + "look_tokens": 409, + "file_tokens": 1164 + }, + { + "symbol": "main::Command::FlagErrorFunc", + "look_tokens": 306, + "file_tokens": 15286 + }, + { + "symbol": "main::Command::SetGlobalNormalizationFunc", + "look_tokens": 353, + "file_tokens": 15286 + }, + { + "symbol": "main::Command::UseLine", + "look_tokens": 360, + "file_tokens": 15286 + }, + { + "symbol": "main::Command::GenZshCompletion", + "look_tokens": 276, + "file_tokens": 2755 + }, + { + "symbol": "main::flagCompError::Error", + "look_tokens": 245, + "file_tokens": 9767 + }, + { + "symbol": "main::Command::HasPersistentFlags", + "look_tokens": 321, + "file_tokens": 15286 + }, + { + "symbol": "main::Command::PrintErr", + "look_tokens": 268, + "file_tokens": 15286 + }, + { + "symbol": "doc::GenYamlCustom", + "look_tokens": 540, + "file_tokens": 1237 + }, + { + "symbol": "main::Command::HasSubCommands", + "look_tokens": 263, + "file_tokens": 15286 + }, + { + "symbol": "main::Command::Traverse", + "look_tokens": 556, + "file_tokens": 15286 + }, + { + "symbol": "main::Command::SuggestionsFor", + "look_tokens": 402, + "file_tokens": 15286 + }, + { + "symbol": "main::Command::Usage", + "look_tokens": 267, + "file_tokens": 15286 + }, + { + "symbol": "main::Command::ValidateArgs", + "look_tokens": 236, + "file_tokens": 15286 + }, + { + "symbol": "main::Command::HasFlags", + "look_tokens": 270, + "file_tokens": 15286 + } + ], + "seconds": 66, + "summary": { + "callers_recall": 1.0, + "callers_precision": 0.989, + "callers_checked": 45, + "blind_recall": 1.0, + "blind_checked": 31, + "common_recall": 1.0, + "common_precision": 1.0, + "common_recall_with_maybe": 1.0, + "common_checked": 1, + "rename_ok": 0.913, + "rename_checked": 46, + "tests_recall": 0.89, + "tests_precision": 0.362, + "tests_top10_precision": 0.442, + "tests_top10_best": 0.785, + "tests_caught": 0.81, + "tests_checked": 21, + "look_vs_file": 0.072 + }, + "summary_seeds": { + "7": { + "callers_recall": 1.0, + "callers_precision": 0.975, + "callers_checked": 20, + "blind_recall": 1.0, + "blind_checked": 12, + "common_recall": 1.0, + "common_precision": 1.0, + "common_recall_with_maybe": 1.0, + "common_checked": 1, + "rename_ok": 0.95, + "rename_checked": 20, + "tests_recall": 0.839, + "tests_precision": 0.4, + "tests_top10_precision": 0.436, + "tests_top10_best": 0.824, + "tests_caught": 0.75, + "tests_checked": 8, + "look_vs_file": 0.055 + }, + "8": { + "callers_recall": 1.0, + "callers_precision": 1.0, + "callers_checked": 20, + "blind_recall": 1.0, + "blind_checked": 15, + "common_recall": 1.0, + "common_precision": 1.0, + "common_recall_with_maybe": 1.0, + "common_checked": 1, + "rename_ok": 1.0, + "rename_checked": 20, + "tests_recall": 0.991, + "tests_precision": 0.303, + "tests_top10_precision": 0.4, + "tests_top10_best": 0.738, + "tests_caught": 0.625, + "tests_checked": 8, + "look_vs_file": 0.1 + }, + "9": { + "callers_recall": 1.0, + "callers_precision": 1.0, + "callers_checked": 19, + "blind_recall": 1.0, + "blind_checked": 10, + "common_recall": 1.0, + "common_precision": 1.0, + "common_recall_with_maybe": 1.0, + "common_checked": 1, + "rename_ok": 0.85, + "rename_checked": 20, + "tests_recall": 0.763, + "tests_precision": 0.413, + "tests_top10_precision": 0.486, + "tests_top10_best": 0.749, + "tests_caught": 1.0, + "tests_checked": 8, + "look_vs_file": 0.05 + } + }, + "noise": { + "callers_recall": { + "mean": 1.0, + "functions": 45, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.03 + }, + "callers_precision": { + "mean": 0.989, + "functions": 45, + "boot_lo": 0.978, + "boot_hi": 1.0, + "boot_half": 0.011, + "seeds": [ + 0.975, + 1.0, + 1.0 + ], + "seed_sd": 0.014, + "threshold": 0.03 + }, + "blind_recall": { + "mean": 1.0, + "functions": 31, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.04 + }, + "common_recall": { + "mean": 1.0, + "functions": 1, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 1.0 + }, + "common_recall_with_maybe": { + "mean": 1.0, + "functions": 1, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 1.0 + }, + "common_precision": { + "mean": 1.0, + "functions": 1, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 1.0 + }, + "rename_ok": { + "mean": 0.913, + "functions": 46, + "boot_lo": 0.848, + "boot_hi": 0.978, + "boot_half": 0.065, + "seeds": [ + 0.95, + 1.0, + 0.85 + ], + "seed_sd": 0.076, + "threshold": 0.07 + }, + "tests_recall": { + "mean": 0.89, + "functions": 21, + "boot_lo": 0.794, + "boot_hi": 0.977, + "boot_half": 0.091, + "seeds": [ + 0.839, + 0.991, + 0.763 + ], + "seed_sd": 0.116, + "threshold": 0.1 + }, + "tests_precision": { + "mean": 0.362, + "functions": 21, + "boot_lo": 0.244, + "boot_hi": 0.486, + "boot_half": 0.121, + "seeds": [ + 0.4, + 0.303, + 0.413 + ], + "seed_sd": 0.06, + "threshold": 0.13 + }, + "tests_top10_precision": { + "mean": 0.442, + "functions": 21, + "boot_lo": 0.305, + "boot_hi": 0.576, + "boot_half": 0.135, + "seeds": [ + 0.436, + 0.4, + 0.486 + ], + "seed_sd": 0.043, + "threshold": 0.14 + }, + "tests_top10_best": { + "mean": 0.785, + "functions": 21, + "boot_lo": 0.665, + "boot_hi": 0.895, + "boot_half": 0.115, + "seeds": [ + 0.824, + 0.738, + 0.749 + ], + "seed_sd": 0.047, + "threshold": 0.12 + }, + "tests_caught": { + "mean": 0.81, + "functions": 21, + "boot_lo": 0.667, + "boot_hi": 0.952, + "boot_half": 0.143, + "seeds": [ + 0.75, + 0.625, + 1.0 + ], + "seed_sd": 0.191, + "threshold": 0.15 + }, + "look_vs_file": { + "mean": 0.072, + "functions": 46, + "boot_lo": 0.044, + "boot_hi": 0.101, + "boot_half": 0.029, + "seeds": [ + 0.055, + 0.1, + 0.05 + ], + "seed_sd": 0.028, + "threshold": 0.03 + } + } + }, + { + "repo": "chi", + "lang": "go", + "commit": "c64ed7d6635f", + "index_seconds": 0.0, + "symbols": 351, + "files": 55, + "seeds": [ + 7, + 8, + 9 + ], + "edges": 5078, + "sample": [ + "middleware::GetLogEntry", + "_examples::fileserver::FileServer", + "main::Chain", + "middleware::NewCompressor", + "main::Walk", + "main::RouteContext", + "middleware::RequestLogger", + "main::NewMux", + "_examples::rest::NewArticleListResponse", + "middleware::GetClientIPAddr", + "main::Middlewares::HandlerFunc", + "main::NewRouteContext", + "middleware::NewPattern", + "middleware::Throttle", + "middleware::Timeout", + "main::Context::RoutePattern", + "main::Mux::NotFoundHandler", + "main::endpoints::Value", + "main::node::InsertRoute", + "main::node::FindRoute", + "main::URLParamFromCtx", + "middleware::GetReqID", + "middleware::NewWrapResponseWriter", + "middleware::compressResponseWriter::Close", + "main::NewRouter", + "middleware::Compressor::SetEncoder", + "_examples::rest::ErrRender", + "_examples::rest::NewUserPayloadResponse", + "main::Mux::MethodNotAllowedHandler", + "middleware::PrintPrettyStack", + "_examples::rest::ErrInvalidRequest", + "middleware::HeaderRoute::IsMatch", + "main::RegisterMethod", + "middleware::ThrottleWithOpts", + "middleware::WithLogEntry" + ], + "sample_common": [ + "main::Mux::Method", + "middleware::defaultLogEntry::Write", + "middleware::basicWriter::WriteHeader", + "main::contextKey::String", + "_examples::custom_handler::Handler::ServeHTTP", + "main::Context::Reset", + "main::Mux::Find", + "middleware::hijackWriter::Hijack", + "middleware::httpFancyWriter::Flush", + "main::Context::URLParam", + "middleware::compressResponseWriter::Push", + "_examples::todos_resource::usersResource::Routes", + "main::Mux::Match", + "main::Mux::Mount", + "main::Mux::With", + "main::Mux::Handle", + "main::Mux::MethodNotAllowed", + "main::Mux::Query", + "main::Mux::NotFound", + "main::Middlewares::Handler", + "middleware::flushHijackWriter::Flush", + "middleware::httpFancyWriter::Hijack", + "middleware::http2FancyWriter::Push", + "middleware::basicWriter::Write", + "main::ChainHandler::ServeHTTP", + "middleware::http2FancyWriter::Flush" + ], + "samples": { + "7": [ + "middleware::GetLogEntry", + "_examples::fileserver::FileServer", + "main::Chain", + "middleware::NewCompressor", + "main::Walk", + "main::RouteContext", + "middleware::RequestLogger", + "main::NewMux", + "_examples::rest::NewArticleListResponse", + "middleware::GetClientIPAddr", + "main::Middlewares::HandlerFunc", + "main::NewRouteContext", + "middleware::NewPattern", + "middleware::Throttle", + "middleware::Timeout", + "main::Context::RoutePattern", + "main::Mux::NotFoundHandler", + "main::endpoints::Value", + "main::node::InsertRoute", + "main::node::FindRoute" + ], + "8": [ + "middleware::GetLogEntry", + "_examples::fileserver::FileServer", + "main::URLParamFromCtx", + "middleware::GetReqID", + "main::RouteContext", + "main::Mux::NotFoundHandler", + "middleware::NewWrapResponseWriter", + "middleware::Throttle", + "middleware::compressResponseWriter::Close", + "main::Walk", + "main::Context::RoutePattern", + "main::NewRouter", + "middleware::Compressor::SetEncoder", + "_examples::rest::ErrRender", + "_examples::rest::NewUserPayloadResponse", + "main::Mux::MethodNotAllowedHandler", + "main::NewRouteContext", + "middleware::Timeout", + "main::node::FindRoute", + "middleware::PrintPrettyStack" + ], + "9": [ + "main::Chain", + "middleware::NewWrapResponseWriter", + "_examples::rest::ErrInvalidRequest", + "_examples::rest::NewUserPayloadResponse", + "middleware::NewCompressor", + "middleware::compressResponseWriter::Close", + "main::URLParamFromCtx", + "main::endpoints::Value", + "main::Mux::MethodNotAllowedHandler", + "middleware::HeaderRoute::IsMatch", + "middleware::GetClientIPAddr", + "middleware::GetLogEntry", + "main::node::FindRoute", + "_examples::rest::ErrRender", + "middleware::Timeout", + "middleware::GetReqID", + "main::RegisterMethod", + "middleware::ThrottleWithOpts", + "middleware::WithLogEntry", + "main::NewMux" + ] + }, + "samples_common": { + "7": [ + "main::Mux::Method", + "middleware::defaultLogEntry::Write", + "middleware::basicWriter::WriteHeader", + "main::contextKey::String", + "_examples::custom_handler::Handler::ServeHTTP", + "main::Context::Reset", + "main::Mux::Find", + "middleware::hijackWriter::Hijack", + "middleware::httpFancyWriter::Flush", + "main::Context::URLParam", + "middleware::compressResponseWriter::Push", + "_examples::todos_resource::usersResource::Routes", + "main::Mux::Match", + "main::Mux::Mount", + "main::Mux::With", + "main::Mux::Handle", + "main::Mux::MethodNotAllowed", + "main::Mux::Query", + "main::Mux::NotFound", + "main::Middlewares::Handler" + ], + "8": [ + "middleware::flushHijackWriter::Flush", + "_examples::custom_handler::Handler::ServeHTTP", + "middleware::defaultLogEntry::Write", + "main::Mux::Query", + "_examples::todos_resource::usersResource::Routes", + "middleware::httpFancyWriter::Hijack", + "main::contextKey::String", + "main::Mux::Match", + "main::Middlewares::Handler", + "middleware::http2FancyWriter::Push", + "main::Context::URLParam", + "main::Context::Reset", + "middleware::basicWriter::WriteHeader", + "main::Mux::Method", + "main::Mux::NotFound", + "main::Mux::With", + "main::Mux::Handle", + "main::Mux::Mount", + "main::Mux::MethodNotAllowed", + "main::Mux::Find" + ], + "9": [ + "middleware::basicWriter::Write", + "main::Mux::Mount", + "main::Context::URLParam", + "_examples::todos_resource::usersResource::Routes", + "middleware::http2FancyWriter::Push", + "main::ChainHandler::ServeHTTP", + "main::Mux::MethodNotAllowed", + "main::Middlewares::Handler", + "middleware::http2FancyWriter::Flush", + "main::Mux::Match", + "main::Mux::Handle", + "middleware::httpFancyWriter::Hijack", + "main::Context::Reset", + "middleware::basicWriter::WriteHeader", + "main::Mux::With", + "main::Mux::Query", + "main::Mux::Method", + "main::Mux::NotFound", + "main::Mux::Find", + "main::contextKey::String" + ] + }, + "samples_blind": { + "7": [ + "middleware::SetHeader", + "middleware::GetLogEntry", + "_examples::fileserver::FileServer", + "main::Chain", + "middleware::RedirectSlashes", + "middleware::Compress", + "middleware::Sunset", + "main::Context::Clone", + "_examples::rest::ListArticles", + "middleware::NewCompressor", + "middleware::URLFormat", + "middleware::ClientIPFromRemoteAddr", + "main::Walk", + "middleware::ClientIPFromXFFTrustedProxies", + "middleware::PageRoute", + "main::RouteContext", + "middleware::Profiler", + "middleware::Heartbeat", + "_examples::rest::GetArticle", + "middleware::RequestLogger" + ], + "8": [ + "middleware::HeaderRouter::RouteAny", + "middleware::GetLogEntry", + "middleware::CleanPath", + "_examples::fileserver::FileServer", + "middleware::RouteHeaders", + "middleware::Deprecation", + "middleware::Compress", + "middleware::AllowContentEncoding", + "main::URLParamFromCtx", + "main::Context::Clone", + "middleware::GetReqID", + "_examples::rest::AdminOnly", + "middleware::RealIP", + "main::RouteContext", + "middleware::PathRewrite", + "middleware::GetHead", + "main::Mux::NotFoundHandler", + "middleware::Logger", + "middleware::Recoverer", + "middleware::RequestID" + ], + "9": [ + "middleware::GetHead", + "middleware::Deprecation", + "main::Chain", + "middleware::NewWrapResponseWriter", + "_examples::versions::data::PresentError", + "_examples::rest::ErrInvalidRequest", + "middleware::RequestSize", + "middleware::ClientIPFromXFFTrustedProxies", + "middleware::StripPrefix", + "middleware::ClientIPFromXFF", + "middleware::RealIP", + "middleware::ClientIPFromRemoteAddr", + "_examples::rest::NewUserPayloadResponse", + "_examples::rest::ListArticles", + "middleware::HeaderRouter::RouteAny", + "main::Context::Clone", + "middleware::SupressNotFound", + "middleware::SetHeader", + "middleware::NewCompressor", + "middleware::WithValue" + ] + }, + "baseline_failing_tests": [], + "callers": [ + { + "symbol": "middleware::GetLogEntry", + "truth": [ + "middleware::Recoverer" + ], + "found": [ + "middleware::Recoverer" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "_examples::fileserver::FileServer", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Chain", + "truth": [ + "main::Mux::MethodNotAllowed", + "main::Mux::NotFound", + "main::Mux::handle" + ], + "found": [ + "main::Mux::MethodNotAllowed", + "main::Mux::NotFound", + "main::Mux::handle" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "middleware::NewCompressor", + "truth": [ + "middleware::Compress" + ], + "found": [ + "middleware::Compress" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Walk", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::RouteContext", + "truth": [ + "main::Mux::Mount", + "main::URLParamFromCtx", + "middleware::CleanPath", + "middleware::GetHead", + "middleware::RedirectSlashes", + "middleware::StripSlashes", + "middleware::SupressNotFound", + "middleware::URLFormat" + ], + "found": [ + "main::Mux::Mount", + "main::URLParamFromCtx", + "middleware::CleanPath", + "middleware::GetHead", + "middleware::RedirectSlashes", + "middleware::StripSlashes", + "middleware::SupressNotFound", + "middleware::URLFormat" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "middleware::RequestLogger", + "truth": [ + "middleware::init" + ], + "found": [ + "middleware::init" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::NewMux", + "truth": [ + "main::NewRouter" + ], + "found": [ + "main::NewRouter" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "_examples::rest::NewArticleListResponse", + "skipped": "compiler reported no uses" + }, + { + "symbol": "middleware::GetClientIPAddr", + "truth": [ + "middleware::GetClientIP" + ], + "found": [ + "middleware::GetClientIP" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Middlewares::HandlerFunc", + "truth": [ + "main::Mux::MethodNotAllowed", + "main::Mux::NotFound" + ], + "found": [ + "main::Mux::MethodNotAllowed", + "main::Mux::NotFound" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::NewRouteContext", + "truth": [ + "main::NewMux", + "middleware::GetHead", + "middleware::SupressNotFound" + ], + "found": [ + "main::NewMux", + "middleware::GetHead", + "middleware::SupressNotFound" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "middleware::NewPattern", + "truth": [ + "middleware::HeaderRouter::Route", + "middleware::HeaderRouter::RouteAny" + ], + "found": [ + "middleware::HeaderRouter::Route", + "middleware::HeaderRouter::RouteAny" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "middleware::Throttle", + "skipped": "compiler reported no uses" + }, + { + "symbol": "middleware::Timeout", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Context::RoutePattern", + "truth": [ + "main::Mux::routeHTTP" + ], + "found": [ + "main::Mux::routeHTTP" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Mux::NotFoundHandler", + "truth": [ + "main::Mux::ServeHTTP", + "main::Mux::routeHTTP", + "middleware::SupressNotFound" + ], + "found": [ + "main::Mux::ServeHTTP", + "main::Mux::routeHTTP", + "middleware::SupressNotFound" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::endpoints::Value", + "truth": [ + "main::node::setEndpoint" + ], + "found": [ + "main::RouteContext", + "main::node::setEndpoint", + "middleware::GetClientIPAddr", + "middleware::GetReqID" + ], + "maybe": [ + "main::Mux::ServeHTTP", + "main::Mux::routeHTTP", + "middleware::GetLogEntry" + ], + "import_files": [], + "recall": 1.0, + "precision": 0.25, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::node::InsertRoute", + "truth": [ + "main::Mux::handle" + ], + "found": [ + "main::Mux::handle" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::node::FindRoute", + "truth": [ + "main::Mux::Find", + "main::Mux::routeHTTP" + ], + "found": [ + "main::Mux::Find", + "main::Mux::routeHTTP" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::URLParamFromCtx", + "truth": [ + "main::URLParam" + ], + "found": [ + "main::URLParam" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "middleware::GetReqID", + "truth": [ + "middleware::DefaultLogFormatter::NewLogEntry" + ], + "found": [ + "middleware::DefaultLogFormatter::NewLogEntry" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "middleware::NewWrapResponseWriter", + "truth": [ + "middleware::RequestLogger" + ], + "found": [ + "middleware::RequestLogger" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "middleware::compressResponseWriter::Close", + "truth": [ + "middleware::Compressor::Handler" + ], + "found": [ + "middleware::Compressor::Handler" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::NewRouter", + "truth": [ + "main::Mux::Route", + "middleware::Profiler" + ], + "found": [ + "main::Mux::Route", + "middleware::Profiler" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "middleware::Compressor::SetEncoder", + "truth": [ + "middleware::NewCompressor" + ], + "found": [ + "middleware::NewCompressor" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "_examples::rest::ErrRender", + "skipped": "compiler reported no uses" + }, + { + "symbol": "_examples::rest::NewUserPayloadResponse", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Mux::MethodNotAllowedHandler", + "truth": [ + "main::Mux::routeHTTP" + ], + "found": [ + "main::Mux::routeHTTP" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "middleware::PrintPrettyStack", + "truth": [ + "middleware::Recoverer" + ], + "found": [ + "middleware::Recoverer" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "_examples::rest::ErrInvalidRequest", + "skipped": "compiler reported no uses" + }, + { + "symbol": "middleware::HeaderRoute::IsMatch", + "truth": [ + "middleware::HeaderRouter::Handler" + ], + "found": [ + "middleware::HeaderRouter::Handler" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::RegisterMethod", + "skipped": "compiler reported no uses" + }, + { + "symbol": "middleware::ThrottleWithOpts", + "truth": [ + "middleware::Throttle", + "middleware::ThrottleBacklog" + ], + "found": [ + "middleware::Throttle", + "middleware::ThrottleBacklog" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "middleware::WithLogEntry", + "truth": [ + "middleware::RequestLogger" + ], + "found": [ + "middleware::RequestLogger" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + } + ], + "callers_common": [ + { + "symbol": "main::Mux::Method", + "truth": [ + "main::Mux::Handle", + "main::Mux::MethodFunc" + ], + "found": [ + "main::Mux::Handle", + "main::Mux::MethodFunc" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "middleware::defaultLogEntry::Write", + "skipped": "compiler reported no uses" + }, + { + "symbol": "middleware::basicWriter::WriteHeader", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::contextKey::String", + "skipped": "compiler reported no uses" + }, + { + "symbol": "_examples::custom_handler::Handler::ServeHTTP", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Context::Reset", + "truth": [ + "main::Mux::ServeHTTP" + ], + "found": [ + "main::Mux::ServeHTTP" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Mux::Find", + "truth": [ + "main::Mux::Match" + ], + "found": [ + "main::Mux::Match" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "middleware::hijackWriter::Hijack", + "skipped": "compiler reported no uses" + }, + { + "symbol": "middleware::httpFancyWriter::Flush", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Context::URLParam", + "truth": [ + "main::URLParamFromCtx" + ], + "found": [ + "main::URLParamFromCtx" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "middleware::compressResponseWriter::Push", + "skipped": "compiler reported no uses" + }, + { + "symbol": "_examples::todos_resource::usersResource::Routes", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Mux::Match", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Mux::Mount", + "truth": [ + "main::Mux::Route" + ], + "found": [ + "main::Mux::Route" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Mux::With", + "truth": [ + "main::Mux::Group" + ], + "found": [ + "main::Mux::Group" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Mux::Handle", + "truth": [ + "main::Mux::HandleFunc" + ], + "found": [ + "main::Mux::HandleFunc" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Mux::MethodNotAllowed", + "truth": [ + "main::Mux::Mount" + ], + "found": [ + "main::Mux::Mount" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Mux::Query", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Mux::NotFound", + "truth": [ + "main::Mux::Mount" + ], + "found": [ + "main::Mux::Mount" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "main::Middlewares::Handler", + "truth": [ + "main::Mux::handle" + ], + "found": [ + "main::Mux::handle" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "middleware::flushHijackWriter::Flush", + "skipped": "compiler reported no uses" + }, + { + "symbol": "middleware::httpFancyWriter::Hijack", + "skipped": "compiler reported no uses" + }, + { + "symbol": "middleware::http2FancyWriter::Push", + "skipped": "compiler reported no uses" + }, + { + "symbol": "middleware::basicWriter::Write", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::ChainHandler::ServeHTTP", + "skipped": "compiler reported no uses" + }, + { + "symbol": "middleware::http2FancyWriter::Flush", + "skipped": "compiler reported no uses" + } + ], + "callers_blind": [ + { + "symbol": "middleware::SetHeader", + "skipped": "compiler reported no uses" + }, + { + "symbol": "middleware::GetLogEntry", + "truth": [ + "middleware::Recoverer" + ], + "found": [ + "middleware::Recoverer" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "_examples::fileserver::FileServer", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Chain", + "truth": [ + "main::Mux::MethodNotAllowed", + "main::Mux::NotFound", + "main::Mux::handle" + ], + "found": [ + "main::Mux::MethodNotAllowed", + "main::Mux::NotFound", + "main::Mux::handle" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "middleware::RedirectSlashes", + "skipped": "compiler reported no uses" + }, + { + "symbol": "middleware::Compress", + "skipped": "compiler reported no uses" + }, + { + "symbol": "middleware::Sunset", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Context::Clone", + "skipped": "compiler reported no uses" + }, + { + "symbol": "_examples::rest::ListArticles", + "skipped": "compiler reported no uses" + }, + { + "symbol": "middleware::NewCompressor", + "truth": [ + "middleware::Compress" + ], + "found": [ + "middleware::Compress" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "middleware::URLFormat", + "skipped": "compiler reported no uses" + }, + { + "symbol": "middleware::ClientIPFromRemoteAddr", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Walk", + "skipped": "compiler reported no uses" + }, + { + "symbol": "middleware::ClientIPFromXFFTrustedProxies", + "skipped": "compiler reported no uses" + }, + { + "symbol": "middleware::PageRoute", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::RouteContext", + "truth": [ + "main::Mux::Mount", + "main::URLParamFromCtx", + "middleware::CleanPath", + "middleware::GetHead", + "middleware::RedirectSlashes", + "middleware::StripSlashes", + "middleware::SupressNotFound", + "middleware::URLFormat" + ], + "found": [ + "main::Mux::Mount", + "main::URLParamFromCtx", + "middleware::CleanPath", + "middleware::GetHead", + "middleware::RedirectSlashes", + "middleware::StripSlashes", + "middleware::SupressNotFound", + "middleware::URLFormat" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "middleware::Profiler", + "skipped": "compiler reported no uses" + }, + { + "symbol": "middleware::Heartbeat", + "skipped": "compiler reported no uses" + }, + { + "symbol": "_examples::rest::GetArticle", + "skipped": "compiler reported no uses" + }, + { + "symbol": "middleware::RequestLogger", + "truth": [ + "middleware::init" + ], + "found": [ + "middleware::init" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "middleware::HeaderRouter::RouteAny", + "skipped": "compiler reported no uses" + }, + { + "symbol": "middleware::CleanPath", + "skipped": "compiler reported no uses" + }, + { + "symbol": "middleware::RouteHeaders", + "skipped": "compiler reported no uses" + }, + { + "symbol": "middleware::Deprecation", + "skipped": "compiler reported no uses" + }, + { + "symbol": "middleware::AllowContentEncoding", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::URLParamFromCtx", + "truth": [ + "main::URLParam" + ], + "found": [ + "main::URLParam" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "middleware::GetReqID", + "truth": [ + "middleware::DefaultLogFormatter::NewLogEntry" + ], + "found": [ + "middleware::DefaultLogFormatter::NewLogEntry" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "_examples::rest::AdminOnly", + "skipped": "compiler reported no uses" + }, + { + "symbol": "middleware::RealIP", + "skipped": "compiler reported no uses" + }, + { + "symbol": "middleware::PathRewrite", + "skipped": "compiler reported no uses" + }, + { + "symbol": "middleware::GetHead", + "skipped": "compiler reported no uses" + }, + { + "symbol": "main::Mux::NotFoundHandler", + "truth": [ + "main::Mux::ServeHTTP", + "main::Mux::routeHTTP", + "middleware::SupressNotFound" + ], + "found": [ + "main::Mux::ServeHTTP", + "main::Mux::routeHTTP", + "middleware::SupressNotFound" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "middleware::Logger", + "skipped": "compiler reported no uses" + }, + { + "symbol": "middleware::Recoverer", + "skipped": "compiler reported no uses" + }, + { + "symbol": "middleware::RequestID", + "skipped": "compiler reported no uses" + }, + { + "symbol": "middleware::NewWrapResponseWriter", + "truth": [ + "middleware::RequestLogger" + ], + "found": [ + "middleware::RequestLogger" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "_examples::versions::data::PresentError", + "skipped": "compiler reported no uses" + }, + { + "symbol": "_examples::rest::ErrInvalidRequest", + "skipped": "compiler reported no uses" + }, + { + "symbol": "middleware::RequestSize", + "skipped": "compiler reported no uses" + }, + { + "symbol": "middleware::StripPrefix", + "skipped": "compiler reported no uses" + }, + { + "symbol": "middleware::ClientIPFromXFF", + "skipped": "compiler reported no uses" + }, + { + "symbol": "_examples::rest::NewUserPayloadResponse", + "skipped": "compiler reported no uses" + }, + { + "symbol": "middleware::SupressNotFound", + "skipped": "compiler reported no uses" + }, + { + "symbol": "middleware::WithValue", + "skipped": "compiler reported no uses" + } + ], + "rename": [ + { + "symbol": "middleware::GetLogEntry", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "_examples::fileserver::FileServer", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "_examples/fileserver/main.go:62:\t\tfs := http.StripPrefix(pathPrefix, http.FileServer(root))", + "detail": "" + }, + { + "symbol": "main::Chain", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "chain.go:5:// Chain returns a Middlewares type from a slice of middleware handlers.", + "detail": "" + }, + { + "symbol": "middleware::NewCompressor", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "main::Walk", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "tree.go:878:// WalkFunc is the type of the function called for each method and route visited by Walk.\ntree.go:881:// Walk walks any router tree that implements Routes interface.\ntree_test.go:515:\t// Walk the muxBig router tree.\ntree_test.go:603:\t\t\tt.Fatalf(\"expected Walk to include %s, got %v\", rout", + "detail": "" + }, + { + "symbol": "main::RouteContext", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "middleware::RequestLogger", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "_examples/rest/routes.json:14: \"comment\": \"Logger is a middleware that logs the start and end of each request, along\\nwith some useful data about what was requested, what the response status was,\\nand how long it took to return. When standard output is a TTY, Logger will\\nprint in color, othe", + "detail": "" + }, + { + "symbol": "main::NewMux", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "_examples::rest::NewArticleListResponse", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "middleware::GetClientIPAddr", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "main::Middlewares::HandlerFunc", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "_examples/rest/main.go:125:\treturn http.HandlerFunc(func(w http.ResponseWriter, r *http.Request) {\n_examples/rest/main.go:236:\treturn http.HandlerFunc(func(w http.ResponseWriter, r *http.Request) {\n_examples/rest/main.go:249:\treturn http.HandlerFunc(func(w http.ResponseWriter, r *http.Request) {\n_ex", + "detail": "" + }, + { + "symbol": "main::NewRouteContext", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "middleware::NewPattern", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "middleware::Throttle", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "_examples/limits/main.go:1:// This example demonstrates the use of Timeout, and Throttle middlewares.\n_examples/limits/main.go:6:// Throttle: limit the number of in-flight requests along a particular\n_examples/limits/main.go:63:\t// Throttle very expensive handlers/operations.\nmiddleware/throttle.go:", + "detail": "" + }, + { + "symbol": "middleware::Timeout", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "_examples/limits/main.go:1:// This example demonstrates the use of Timeout, and Throttle middlewares.\n_examples/limits/main.go:3:// Timeout: cancel a request if processing takes longer than 2.5 seconds,\nmiddleware/throttle_test.go:32:\t\tTimeout: time.Second * 5, // Maximum waiting time.\nmiddleware/th", + "detail": "" + }, + { + "symbol": "main::Context::RoutePattern", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "main::Mux::NotFoundHandler", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "middleware/heartbeat_test.go:16:\tr.Handle(endpoint, http.NotFoundHandler())\nmiddleware/strip_test.go:277:\th := RedirectSlashes(http.NotFoundHandler())", + "detail": "" + }, + { + "symbol": "main::endpoints::Value", + "ok": false, + "compiled": false, + "tests_ok": null, + "tests_failed": [], + "old_name_left": "_examples/rest/main.go:177:\tarticle := r.Context().Value(\"article\").(*Article)\n_examples/rest/main.go:187:\tarticle := r.Context().Value(\"article\").(*Article)\n_examples/rest/main.go:207:\tarticle := r.Context().Value(\"article\").(*Article)\n_examples/rest/routes.json:28: \"comment\": \"URLFormat is ", + "detail": "# github.com/go-chi/chi/v5\n./context.go:26:16: ctx.ValueGnx undefined (type context.Context has no field or method ValueGnx)\nFAIL\tgithub.com/go-chi/chi/v5 [build failed]\nFAIL\tgithub.com/go-chi/chi/v5/middleware [build failed]\nFAIL\n" + }, + { + "symbol": "main::node::InsertRoute", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "main::node::FindRoute", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "main::URLParamFromCtx", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "middleware::GetReqID", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "middleware::NewWrapResponseWriter", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "middleware::compressResponseWriter::Close", + "ok": false, + "compiled": false, + "tests_ok": null, + "tests_failed": [], + "old_name_left": "middleware/compress_test.go:50:\tdefer ts.Close()\nmiddleware/compress_test.go:123:\t\t\tdefer ts.Close()\nmiddleware/compress_test.go:248:\treader.Close()\nmiddleware/get_head_test.go:38:\tdefer ts.Close()\nmiddleware/middleware_test.go:118:\tdefer server.Close()", + "detail": "sp.Body.CloseGnx undefined (type io.ReadCloser has no field or method CloseGnx)\nmiddleware/middleware_test.go:189:18: resp.Body.CloseGnx undefined (type io.ReadCloser has no field or method CloseGnx)\nmiddleware/strip_test.go:300:19: res.Body.CloseGnx undefined (type io.ReadCloser has no field or method CloseGnx)\nmiddleware/supress_notfound_test.go:66:20: resp.Body.CloseGnx undefined (type io.ReadCloser has no field or method CloseGnx)\nFAIL\tgithub.com/go-chi/chi/v5/middleware [build failed]\nFAIL\n" + }, + { + "symbol": "main::NewRouter", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "_examples/rest/main.go:58:\tr := chi.NewRouter()\n_examples/rest/main.go:220:\tr := chi.NewRouter()\n_examples/rest/routes.json:28: \"comment\": \"URLFormat is a middleware that parses the url extension from a request path and stores it\\non the context as a string under the key `middleware.URLFormat", + "detail": "" + }, + { + "symbol": "middleware::Compressor::SetEncoder", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "_examples::rest::ErrRender", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "_examples::rest::NewUserPayloadResponse", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "main::Mux::MethodNotAllowedHandler", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "middleware::PrintPrettyStack", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "_examples::rest::ErrInvalidRequest", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "middleware::HeaderRoute::IsMatch", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "main::RegisterMethod", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "middleware::ThrottleWithOpts", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "middleware::WithLogEntry", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + } + ], + "mutants": { + "7": [ + "middleware::GetLogEntry", + "_examples::fileserver::FileServer", + "main::Chain", + "middleware::NewCompressor", + "main::Walk", + "main::RouteContext", + "middleware::RequestLogger", + "main::NewMux", + "_examples::rest::NewArticleListResponse", + "middleware::GetClientIPAddr", + "main::Middlewares::HandlerFunc" + ], + "8": [ + "middleware::GetLogEntry", + "_examples::fileserver::FileServer", + "main::URLParamFromCtx", + "middleware::GetReqID", + "main::RouteContext", + "main::Mux::NotFoundHandler", + "middleware::NewWrapResponseWriter", + "middleware::Throttle", + "middleware::compressResponseWriter::Close", + "main::Walk" + ], + "9": [ + "main::Chain", + "middleware::NewWrapResponseWriter", + "_examples::rest::ErrInvalidRequest", + "_examples::rest::NewUserPayloadResponse", + "middleware::NewCompressor", + "middleware::compressResponseWriter::Close", + "main::URLParamFromCtx", + "main::endpoints::Value", + "main::Mux::MethodNotAllowedHandler", + "middleware::HeaderRoute::IsMatch" + ] + }, + "tests": [ + { + "symbol": "middleware::GetLogEntry", + "level": "name", + "truth": 2, + "predicted": 2, + "recall": 0.0, + "precision": 0.0, + "top_hits": 0, + "top_n": 2, + "top_precision": 0.0, + "top_best": 0.0, + "caught": 0.0, + "missed": [ + "TestRecoverer", + "TestRecovererNoColor" + ], + "recall_graph_only": 0.0 + }, + { + "symbol": "_examples::fileserver::FileServer", + "skipped": "no test fails when it throws", + "predicted": 0 + }, + { + "symbol": "main::Chain", + "level": "name", + "truth": 11, + "predicted": 3, + "recall": 0.2727272727272727, + "precision": 1.0, + "top_hits": 3, + "top_n": 3, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [ + "TestMuxComplicatedNotFound", + "TestMuxMiddlewareStack", + "TestMuxNestedNotFound", + "TestMuxRouteGroups", + "TestMuxWith", + "TestNestedGroups", + "TestRouterFromMuxWith", + "TestWalkMiddlewaresAcrossGroupAndRoute" + ], + "recall_graph_only": 0.2727272727272727 + }, + { + "symbol": "middleware::NewCompressor", + "level": "name", + "truth": 3, + "predicted": 3, + "recall": 1.0, + "precision": 1.0, + "top_hits": 3, + "top_n": 3, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "main::Walk", + "level": "name", + "truth": 5, + "predicted": 5, + "recall": 1.0, + "precision": 1.0, + "top_hits": 5, + "top_n": 5, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "main::RouteContext", + "level": "name", + "truth": 31, + "predicted": 27, + "recall": 0.7419354838709677, + "precision": 0.8518518518518519, + "top_hits": 10, + "top_n": 10, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [ + "TestCleanPath", + "TestMuxComplicatedNotFound", + "TestMuxNestedMethodNotAllowed", + "TestMuxNestedNotFound", + "TestMuxRegexp3", + "TestMuxSubroutes", + "TestNestedGroups", + "TestPattern" + ], + "recall_graph_only": 0.7419354838709677 + }, + { + "symbol": "middleware::RequestLogger", + "skipped": "mutant does not compile" + }, + { + "symbol": "main::NewMux", + "level": "name", + "truth": 101, + "predicted": 104, + "recall": 0.9801980198019802, + "precision": 0.9519230769230769, + "top_hits": 10, + "top_n": 10, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [ + "Example_clientIP", + "Example_clientIPFromXFFTrustedProxies" + ], + "recall_graph_only": 0.9801980198019802 + }, + { + "symbol": "_examples::rest::NewArticleListResponse", + "skipped": "no test fails when it throws", + "predicted": 0 + }, + { + "symbol": "middleware::GetClientIPAddr", + "level": "name", + "truth": 24, + "predicted": 19, + "recall": 0.7916666666666666, + "precision": 1.0, + "top_hits": 10, + "top_n": 10, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [ + "Example_clientIP", + "Example_clientIPFromXFFTrustedProxies", + "TestRecovererNoColor", + "TestRequestLogger", + "TestRequestLoggerReadFrom" + ], + "recall_graph_only": 0.7916666666666666 + }, + { + "symbol": "main::Middlewares::HandlerFunc", + "level": "name", + "truth": 1, + "predicted": 3, + "recall": 0.0, + "precision": 0.0, + "top_hits": 0, + "top_n": 3, + "top_precision": 0.0, + "top_best": 0.0, + "caught": 0.0, + "missed": [ + "TestMuxNestedNotFound" + ], + "recall_graph_only": 0.0 + }, + { + "symbol": "main::URLParamFromCtx", + "level": "name", + "truth": 20, + "predicted": 23, + "recall": 1.0, + "precision": 0.8695652173913043, + "top_hits": 10, + "top_n": 10, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "middleware::GetReqID", + "level": "name", + "truth": 4, + "predicted": 1, + "recall": 0.25, + "precision": 1.0, + "top_hits": 1, + "top_n": 1, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [ + "TestRecovererNoColor", + "TestRequestLogger", + "TestRequestLoggerReadFrom" + ], + "recall_graph_only": 0.25 + }, + { + "symbol": "main::Mux::NotFoundHandler", + "level": "name", + "truth": 14, + "predicted": 42, + "recall": 0.14285714285714285, + "precision": 0.047619047619047616, + "top_hits": 2, + "top_n": 10, + "top_precision": 0.2, + "top_best": 0.2, + "caught": 1.0, + "missed": [ + "TestGetHead", + "TestMuxBig", + "TestMuxComplicatedNotFound", + "TestMuxEmptyRoutes", + "TestMuxMissingParams", + "TestMuxNestedNotFound", + "TestMuxPlain", + "TestMuxTrailingSlash" + ], + "recall_graph_only": 0.14285714285714285 + }, + { + "symbol": "middleware::NewWrapResponseWriter", + "level": "name", + "truth": 5, + "predicted": 8, + "recall": 0.6, + "precision": 0.375, + "top_hits": 3, + "top_n": 8, + "top_precision": 0.375, + "top_best": 0.375, + "caught": 1.0, + "missed": [ + "TestRequestLogger", + "TestRequestLoggerReadFrom" + ], + "recall_graph_only": 0.6 + }, + { + "symbol": "middleware::Throttle", + "skipped": "no test fails when it throws", + "predicted": 7 + }, + { + "symbol": "middleware::compressResponseWriter::Close", + "level": "name", + "truth": 2, + "predicted": 46, + "recall": 1.0, + "precision": 0.043478260869565216, + "top_hits": 2, + "top_n": 10, + "top_precision": 0.2, + "top_best": 0.2, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "_examples::rest::ErrInvalidRequest", + "skipped": "no test fails when it throws", + "predicted": 0 + }, + { + "symbol": "_examples::rest::NewUserPayloadResponse", + "skipped": "no test fails when it throws", + "predicted": 0 + }, + { + "symbol": "main::endpoints::Value", + "level": "name", + "truth": 105, + "predicted": 52, + "recall": 0.45714285714285713, + "precision": 0.9230769230769231, + "top_hits": 9, + "top_n": 10, + "top_precision": 0.9, + "top_best": 1.0, + "caught": 1.0, + "missed": [ + "Example_clientIP", + "Example_clientIPFromXFFTrustedProxies", + "TestBasicAuth", + "TestCleanPath", + "TestCompressor", + "TestCompressorDefaultTextTypes", + "TestContentCharset", + "TestContentCharsetMediaParameters" + ], + "recall_graph_only": 0.4380952380952381 + }, + { + "symbol": "main::Mux::MethodNotAllowedHandler", + "level": "name", + "truth": 4, + "predicted": 41, + "recall": 1.0, + "precision": 0.0975609756097561, + "top_hits": 4, + "top_n": 10, + "top_precision": 0.4, + "top_best": 0.4, + "caught": 1.0, + "missed": [], + "recall_graph_only": 0.0 + }, + { + "symbol": "middleware::HeaderRoute::IsMatch", + "level": "name", + "truth": 1, + "predicted": 2, + "recall": 1.0, + "precision": 0.5, + "top_hits": 1, + "top_n": 2, + "top_precision": 0.5, + "top_best": 0.5, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + } + ], + "look": [ + { + "symbol": "middleware::GetLogEntry", + "look_tokens": 162, + "file_tokens": 1260 + }, + { + "symbol": "_examples::fileserver::FileServer", + "look_tokens": 278, + "file_tokens": 381 + }, + { + "symbol": "main::Chain", + "look_tokens": 162, + "file_tokens": 380 + }, + { + "symbol": "middleware::NewCompressor", + "look_tokens": 950, + "file_tokens": 3041 + }, + { + "symbol": "main::Walk", + "look_tokens": 187, + "file_tokens": 5518 + }, + { + "symbol": "main::RouteContext", + "look_tokens": 328, + "file_tokens": 1447 + }, + { + "symbol": "middleware::RequestLogger", + "look_tokens": 308, + "file_tokens": 1260 + }, + { + "symbol": "main::NewMux", + "look_tokens": 244, + "file_tokens": 4327 + }, + { + "symbol": "_examples::rest::NewArticleListResponse", + "look_tokens": 149, + "file_tokens": 3876 + }, + { + "symbol": "middleware::GetClientIPAddr", + "look_tokens": 352, + "file_tokens": 3263 + }, + { + "symbol": "main::Middlewares::HandlerFunc", + "look_tokens": 183, + "file_tokens": 380 + }, + { + "symbol": "main::NewRouteContext", + "look_tokens": 217, + "file_tokens": 1447 + }, + { + "symbol": "middleware::NewPattern", + "look_tokens": 153, + "file_tokens": 1042 + }, + { + "symbol": "middleware::Throttle", + "look_tokens": 297, + "file_tokens": 1175 + }, + { + "symbol": "middleware::Timeout", + "look_tokens": 417, + "file_tokens": 306 + }, + { + "symbol": "main::Context::RoutePattern", + "look_tokens": 390, + "file_tokens": 1447 + }, + { + "symbol": "main::Mux::NotFoundHandler", + "look_tokens": 285, + "file_tokens": 4327 + }, + { + "symbol": "main::endpoints::Value", + "look_tokens": 262, + "file_tokens": 5518 + }, + { + "symbol": "main::node::InsertRoute", + "look_tokens": 778, + "file_tokens": 5518 + }, + { + "symbol": "main::node::FindRoute", + "look_tokens": 392, + "file_tokens": 5518 + }, + { + "symbol": "main::URLParamFromCtx", + "look_tokens": 263, + "file_tokens": 1447 + }, + { + "symbol": "middleware::GetReqID", + "look_tokens": 172, + "file_tokens": 736 + }, + { + "symbol": "middleware::NewWrapResponseWriter", + "look_tokens": 415, + "file_tokens": 1604 + }, + { + "symbol": "middleware::compressResponseWriter::Close", + "look_tokens": 276, + "file_tokens": 3041 + }, + { + "symbol": "main::NewRouter", + "look_tokens": 316, + "file_tokens": 1203 + }, + { + "symbol": "middleware::Compressor::SetEncoder", + "look_tokens": 607, + "file_tokens": 3041 + }, + { + "symbol": "_examples::rest::ErrRender", + "look_tokens": 125, + "file_tokens": 3876 + }, + { + "symbol": "_examples::rest::NewUserPayloadResponse", + "look_tokens": 109, + "file_tokens": 3876 + }, + { + "symbol": "main::Mux::MethodNotAllowedHandler", + "look_tokens": 293, + "file_tokens": 4327 + }, + { + "symbol": "middleware::PrintPrettyStack", + "look_tokens": 143, + "file_tokens": 1291 + }, + { + "symbol": "_examples::rest::ErrInvalidRequest", + "look_tokens": 140, + "file_tokens": 3876 + }, + { + "symbol": "middleware::HeaderRoute::IsMatch", + "look_tokens": 166, + "file_tokens": 1042 + }, + { + "symbol": "main::RegisterMethod", + "look_tokens": 319, + "file_tokens": 5518 + }, + { + "symbol": "middleware::ThrottleWithOpts", + "look_tokens": 736, + "file_tokens": 1175 + }, + { + "symbol": "middleware::WithLogEntry", + "look_tokens": 194, + "file_tokens": 1260 + } + ], + "seconds": 420, + "summary": { + "callers_recall": 1.0, + "callers_precision": 0.971, + "callers_checked": 26, + "blind_recall": 1.0, + "blind_checked": 9, + "common_recall": 1.0, + "common_precision": 1.0, + "common_recall_with_maybe": 1.0, + "common_checked": 10, + "rename_ok": 0.943, + "rename_checked": 35, + "tests_recall": 0.64, + "tests_precision": 0.604, + "tests_top10_precision": 0.661, + "tests_top10_best": 0.667, + "tests_caught": 0.875, + "tests_checked": 16, + "look_vs_file": 0.223 + }, + "summary_seeds": { + "7": { + "callers_recall": 1.0, + "callers_precision": 0.95, + "callers_checked": 15, + "blind_recall": 1.0, + "blind_checked": 5, + "common_recall": 1.0, + "common_precision": 1.0, + "common_recall_with_maybe": 1.0, + "common_checked": 10, + "rename_ok": 0.95, + "rename_checked": 20, + "tests_recall": 0.598, + "tests_precision": 0.725, + "tests_top10_precision": 0.75, + "tests_top10_best": 0.75, + "tests_caught": 0.75, + "tests_checked": 8, + "look_vs_file": 0.265 + }, + "8": { + "callers_recall": 1.0, + "callers_precision": 1.0, + "callers_checked": 14, + "blind_recall": 1.0, + "blind_checked": 5, + "common_recall": 1.0, + "common_precision": 1.0, + "common_recall_with_maybe": 1.0, + "common_checked": 10, + "rename_ok": 0.95, + "rename_checked": 20, + "tests_recall": 0.592, + "tests_precision": 0.523, + "tests_top10_precision": 0.597, + "tests_top10_best": 0.597, + "tests_caught": 0.875, + "tests_checked": 8, + "look_vs_file": 0.238 + }, + "9": { + "callers_recall": 1.0, + "callers_precision": 0.95, + "callers_checked": 15, + "blind_recall": 1.0, + "blind_checked": 3, + "common_recall": 1.0, + "common_precision": 1.0, + "common_recall_with_maybe": 1.0, + "common_checked": 10, + "rename_ok": 0.9, + "rename_checked": 20, + "tests_recall": 0.791, + "tests_precision": 0.601, + "tests_top10_precision": 0.672, + "tests_top10_best": 0.684, + "tests_caught": 1.0, + "tests_checked": 8, + "look_vs_file": 0.222 + } + }, + "noise": { + "callers_recall": { + "mean": 1.0, + "functions": 26, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.04 + }, + "callers_precision": { + "mean": 0.971, + "functions": 26, + "boot_lo": 0.913, + "boot_hi": 1.0, + "boot_half": 0.043, + "seeds": [ + 0.95, + 1.0, + 0.95 + ], + "seed_sd": 0.029, + "threshold": 0.05 + }, + "blind_recall": { + "mean": 1.0, + "functions": 9, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.12 + }, + "common_recall": { + "mean": 1.0, + "functions": 10, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.1 + }, + "common_recall_with_maybe": { + "mean": 1.0, + "functions": 10, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.1 + }, + "common_precision": { + "mean": 1.0, + "functions": 10, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.1 + }, + "rename_ok": { + "mean": 0.943, + "functions": 35, + "boot_lo": 0.886, + "boot_hi": 1.0, + "boot_half": 0.057, + "seeds": [ + 0.95, + 0.95, + 0.9 + ], + "seed_sd": 0.029, + "threshold": 0.06 + }, + "tests_recall": { + "mean": 0.64, + "functions": 16, + "boot_lo": 0.48, + "boot_hi": 0.792, + "boot_half": 0.156, + "seeds": [ + 0.598, + 0.592, + 0.791 + ], + "seed_sd": 0.113, + "threshold": 0.16 + }, + "tests_precision": { + "mean": 0.604, + "functions": 16, + "boot_lo": 0.426, + "boot_hi": 0.772, + "boot_half": 0.173, + "seeds": [ + 0.725, + 0.523, + 0.601 + ], + "seed_sd": 0.102, + "threshold": 0.18 + }, + "tests_top10_precision": { + "mean": 0.661, + "functions": 16, + "boot_lo": 0.498, + "boot_hi": 0.819, + "boot_half": 0.16, + "seeds": [ + 0.75, + 0.597, + 0.672 + ], + "seed_sd": 0.077, + "threshold": 0.17 + }, + "tests_top10_best": { + "mean": 0.667, + "functions": 16, + "boot_lo": 0.503, + "boot_hi": 0.825, + "boot_half": 0.161, + "seeds": [ + 0.75, + 0.597, + 0.684 + ], + "seed_sd": 0.077, + "threshold": 0.17 + }, + "tests_caught": { + "mean": 0.875, + "functions": 16, + "boot_lo": 0.75, + "boot_hi": 1.0, + "boot_half": 0.125, + "seeds": [ + 0.75, + 0.875, + 1.0 + ], + "seed_sd": 0.125, + "threshold": 0.13 + }, + "look_vs_file": { + "mean": 0.223, + "functions": 35, + "boot_lo": 0.159, + "boot_hi": 0.299, + "boot_half": 0.07, + "seeds": [ + 0.265, + 0.238, + 0.222 + ], + "seed_sd": 0.022, + "threshold": 0.07 + } + } + }, + { + "repo": "semver", + "lang": "rust", + "commit": "280ebcb6edac", + "index_seconds": 0.0, + "symbols": 113, + "files": 13, + "seeds": [ + 7, + 8, + 9 + ], + "edges": 1192, + "sample": [ + "semver::identifier::Identifier::ptr_eq", + "semver::eval::matches_req", + "semver::identifier::Identifier::new_unchecked", + "semver::eval::matches_comparator", + "semver::identifier::Identifier::empty" + ], + "sample_common": [ + "semver::BuildMetadata::as_str", + "semver::identifier::Identifier::is_empty", + "semver::Prerelease::is_empty" + ], + "samples": { + "7": [ + "semver::identifier::Identifier::ptr_eq", + "semver::eval::matches_req", + "semver::identifier::Identifier::new_unchecked", + "semver::eval::matches_comparator", + "semver::identifier::Identifier::empty" + ], + "8": [ + "semver::identifier::Identifier::ptr_eq", + "semver::eval::matches_req", + "semver::identifier::Identifier::new_unchecked", + "semver::identifier::Identifier::empty", + "semver::eval::matches_comparator" + ], + "9": [ + "semver::eval::matches_req", + "semver::eval::matches_comparator", + "semver::identifier::Identifier::empty", + "semver::identifier::Identifier::ptr_eq", + "semver::identifier::Identifier::new_unchecked" + ] + }, + "samples_common": { + "7": [ + "semver::BuildMetadata::as_str", + "semver::identifier::Identifier::is_empty" + ], + "8": [ + "semver::Prerelease::is_empty", + "semver::BuildMetadata::as_str" + ], + "9": [ + "semver::BuildMetadata::as_str", + "semver::identifier::Identifier::is_empty" + ] + }, + "samples_blind": { + "7": [ + "semver::identifier::Identifier::ptr_eq", + "semver::eval::matches_req", + "semver::Version::cmp_precedence", + "semver::identifier::Identifier::new_unchecked", + "semver::eval::matches_comparator", + "semver::identifier::Identifier::empty" + ], + "8": [ + "semver::Version::cmp_precedence", + "semver::identifier::Identifier::ptr_eq", + "semver::eval::matches_req", + "semver::identifier::Identifier::new_unchecked", + "semver::identifier::Identifier::empty", + "semver::eval::matches_comparator" + ], + "9": [ + "semver::Version::cmp_precedence", + "semver::eval::matches_req", + "semver::eval::matches_comparator", + "semver::identifier::Identifier::empty", + "semver::identifier::Identifier::ptr_eq", + "semver::identifier::Identifier::new_unchecked" + ] + }, + "baseline_failing_tests": [], + "callers": [ + { + "symbol": "semver::identifier::Identifier::ptr_eq", + "truth": [ + "semver::identifier::Identifier::eq", + "semver::impls::BuildMetadata::cmp", + "semver::impls::Prerelease::cmp" + ], + "found": [ + "semver::identifier::Identifier::eq", + "semver::impls::BuildMetadata::cmp", + "semver::impls::Prerelease::cmp" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "semver::eval::matches_req", + "truth": [ + "semver::VersionReq::matches" + ], + "found": [ + "semver::VersionReq::matches" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "semver::identifier::Identifier::new_unchecked", + "truth": [ + "semver::parse::build_identifier", + "semver::parse::prerelease_identifier" + ], + "found": [ + "semver::parse::build_identifier", + "semver::parse::prerelease_identifier" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "semver::eval::matches_comparator", + "truth": [ + "semver::Comparator::matches" + ], + "found": [ + "semver::Comparator::matches" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "semver::identifier::Identifier::empty", + "truth": [ + "semver::BuildMetadata::EMPTY", + "semver::Prerelease::EMPTY", + "semver::identifier::Identifier::is_empty", + "semver::identifier::Identifier::new_unchecked", + "semver::impls::Identifier::default" + ], + "found": [ + "semver::BuildMetadata::EMPTY", + "semver::Prerelease::EMPTY", + "semver::identifier::Identifier::is_empty", + "semver::identifier::Identifier::new_unchecked", + "semver::impls::Identifier::default" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + } + ], + "callers_common": [ + { + "symbol": "semver::BuildMetadata::as_str", + "truth": [ + "semver::display::BuildMetadata::fmt", + "semver::impls::BuildMetadata::cmp" + ], + "found": [ + "semver::display::BuildMetadata::fmt", + "semver::impls::BuildMetadata::cmp" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "semver::identifier::Identifier::is_empty", + "truth": [ + "semver::BuildMetadata::is_empty", + "semver::Prerelease::is_empty", + "semver::identifier::Identifier::as_str", + "semver::identifier::Identifier::is_empty_or_inline" + ], + "found": [ + "semver::BuildMetadata::is_empty", + "semver::Prerelease::is_empty", + "semver::identifier::Identifier::as_str", + "semver::identifier::Identifier::is_empty_or_inline" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "semver::Prerelease::is_empty", + "skipped": "compiler reported no uses" + } + ], + "callers_blind": [ + { + "symbol": "semver::identifier::Identifier::ptr_eq", + "truth": [ + "semver::identifier::Identifier::eq", + "semver::impls::BuildMetadata::cmp", + "semver::impls::Prerelease::cmp" + ], + "found": [ + "semver::identifier::Identifier::eq", + "semver::impls::BuildMetadata::cmp", + "semver::impls::Prerelease::cmp" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "semver::eval::matches_req", + "truth": [ + "semver::VersionReq::matches" + ], + "found": [ + "semver::VersionReq::matches" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "semver::Version::cmp_precedence", + "skipped": "compiler reported no uses" + }, + { + "symbol": "semver::identifier::Identifier::new_unchecked", + "truth": [ + "semver::parse::build_identifier", + "semver::parse::prerelease_identifier" + ], + "found": [ + "semver::parse::build_identifier", + "semver::parse::prerelease_identifier" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "semver::eval::matches_comparator", + "truth": [ + "semver::Comparator::matches" + ], + "found": [ + "semver::Comparator::matches" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "semver::identifier::Identifier::empty", + "truth": [ + "semver::BuildMetadata::EMPTY", + "semver::Prerelease::EMPTY", + "semver::identifier::Identifier::is_empty", + "semver::identifier::Identifier::new_unchecked", + "semver::impls::Identifier::default" + ], + "found": [ + "semver::BuildMetadata::EMPTY", + "semver::Prerelease::EMPTY", + "semver::identifier::Identifier::is_empty", + "semver::identifier::Identifier::new_unchecked", + "semver::impls::Identifier::default" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + } + ], + "rename": [ + { + "symbol": "semver::identifier::Identifier::ptr_eq", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "semver::eval::matches_req", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "semver::identifier::Identifier::new_unchecked", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "src/identifier.rs:94: const HEAD: NonNull = unsafe { NonNull::new_unchecked(!0 as *mut u8) };\nsrc/identifier.rs:120: let size = bytes_for_varint(unsafe { NonZeroUsize::new_unchecked(len) }) + len;\nsrc/identifier.rs:292: unsafe { NonNull::new_unchecked(modified) }\nsrc/ide", + "detail": "" + }, + { + "symbol": "semver::eval::matches_comparator", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "semver::identifier::Identifier::empty", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "src/error.rs:35: ErrorKind::Empty => formatter.write_str(\"empty string, expected a semver version\"),\nsrc/error.rs:70: write!(formatter, \"empty identifier segment in {}\", pos)\nsrc/identifier.rs:169: let empty = Self::empty_gnx();\nsrc/identifier.rs:170: let is_e", + "detail": "" + } + ], + "mutants": { + "7": [ + "semver::identifier::Identifier::ptr_eq", + "semver::eval::matches_req", + "semver::identifier::Identifier::new_unchecked", + "semver::eval::matches_comparator", + "semver::identifier::Identifier::empty" + ], + "8": [ + "semver::identifier::Identifier::ptr_eq", + "semver::eval::matches_req", + "semver::identifier::Identifier::new_unchecked", + "semver::identifier::Identifier::empty", + "semver::eval::matches_comparator" + ], + "9": [ + "semver::eval::matches_req", + "semver::eval::matches_comparator", + "semver::identifier::Identifier::empty", + "semver::identifier::Identifier::ptr_eq", + "semver::identifier::Identifier::new_unchecked" + ] + }, + "tests": [ + { + "symbol": "semver::identifier::Identifier::ptr_eq", + "level": "name", + "truth": 20, + "predicted": 0, + "recall": 0.0, + "precision": 0.0, + "top_hits": 0, + "top_n": 0, + "top_precision": 0.0, + "top_best": 0.0, + "caught": 0.0, + "missed": [ + "test_basic", + "test_caret", + "test_cargo3202", + "test_eq", + "test_eq_hash", + "test_exact", + "test_ge", + "test_greater_than" + ], + "recall_graph_only": 0.0 + }, + { + "symbol": "semver::eval::matches_req", + "level": "name", + "truth": 11, + "predicted": 11, + "recall": 1.0, + "precision": 1.0, + "top_hits": 10, + "top_n": 10, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "semver::identifier::Identifier::new_unchecked", + "level": "name", + "truth": 24, + "predicted": 22, + "recall": 0.8333333333333334, + "precision": 0.9090909090909091, + "top_hits": 10, + "top_n": 10, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [ + "test_align", + "test_comparator_parse", + "test_leading_digit_in_pre_and_build", + "test_wildcard_and_another" + ], + "recall_graph_only": 0.8333333333333334 + }, + { + "symbol": "semver::eval::matches_comparator", + "skipped": "no test fails when it throws", + "predicted": 0 + }, + { + "symbol": "semver::identifier::Identifier::empty", + "skipped": "mutant does not compile" + } + ], + "look": [ + { + "symbol": "semver::identifier::Identifier::ptr_eq", + "look_tokens": 110, + "file_tokens": 4536 + }, + { + "symbol": "semver::eval::matches_req", + "look_tokens": 325, + "file_tokens": 1035 + }, + { + "symbol": "semver::identifier::Identifier::new_unchecked", + "look_tokens": 1109, + "file_tokens": 4536 + }, + { + "symbol": "semver::eval::matches_comparator", + "look_tokens": 133, + "file_tokens": 1035 + }, + { + "symbol": "semver::identifier::Identifier::empty", + "look_tokens": 221, + "file_tokens": 4536 + } + ], + "seconds": 1, + "summary": { + "callers_recall": 1.0, + "callers_precision": 1.0, + "callers_checked": 5, + "blind_recall": 1.0, + "blind_checked": 5, + "common_recall": 1.0, + "common_precision": 1.0, + "common_recall_with_maybe": 1.0, + "common_checked": 2, + "rename_ok": 1.0, + "rename_checked": 5, + "tests_recall": 0.611, + "tests_precision": 0.636, + "tests_top10_precision": 0.667, + "tests_top10_best": 0.667, + "tests_caught": 0.667, + "tests_checked": 3, + "look_vs_file": 0.152 + }, + "summary_seeds": { + "7": { + "callers_recall": 1.0, + "callers_precision": 1.0, + "callers_checked": 5, + "blind_recall": 1.0, + "blind_checked": 5, + "common_recall": 1.0, + "common_precision": 1.0, + "common_recall_with_maybe": 1.0, + "common_checked": 2, + "rename_ok": 1.0, + "rename_checked": 5, + "tests_recall": 0.611, + "tests_precision": 0.636, + "tests_top10_precision": 0.667, + "tests_top10_best": 0.667, + "tests_caught": 0.667, + "tests_checked": 3, + "look_vs_file": 0.152 + }, + "8": { + "callers_recall": 1.0, + "callers_precision": 1.0, + "callers_checked": 5, + "blind_recall": 1.0, + "blind_checked": 5, + "common_recall": 1.0, + "common_precision": 1.0, + "common_recall_with_maybe": 1.0, + "common_checked": 1, + "rename_ok": 1.0, + "rename_checked": 5, + "tests_recall": 0.611, + "tests_precision": 0.636, + "tests_top10_precision": 0.667, + "tests_top10_best": 0.667, + "tests_caught": 0.667, + "tests_checked": 3, + "look_vs_file": 0.152 + }, + "9": { + "callers_recall": 1.0, + "callers_precision": 1.0, + "callers_checked": 5, + "blind_recall": 1.0, + "blind_checked": 5, + "common_recall": 1.0, + "common_precision": 1.0, + "common_recall_with_maybe": 1.0, + "common_checked": 2, + "rename_ok": 1.0, + "rename_checked": 5, + "tests_recall": 0.611, + "tests_precision": 0.636, + "tests_top10_precision": 0.667, + "tests_top10_best": 0.667, + "tests_caught": 0.667, + "tests_checked": 3, + "look_vs_file": 0.152 + } + }, + "noise": { + "callers_recall": { + "mean": 1.0, + "functions": 5, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.2 + }, + "callers_precision": { + "mean": 1.0, + "functions": 5, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.2 + }, + "blind_recall": { + "mean": 1.0, + "functions": 5, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.2 + }, + "common_recall": { + "mean": 1.0, + "functions": 2, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.5 + }, + "common_recall_with_maybe": { + "mean": 1.0, + "functions": 2, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.5 + }, + "common_precision": { + "mean": 1.0, + "functions": 2, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.5 + }, + "rename_ok": { + "mean": 1.0, + "functions": 5, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.2 + }, + "tests_recall": { + "mean": 0.611, + "functions": 3, + "boot_lo": 0.278, + "boot_hi": 0.944, + "boot_half": 0.333, + "seeds": [ + 0.611, + 0.611, + 0.611 + ], + "seed_sd": 0.0, + "threshold": 0.34 + }, + "tests_precision": { + "mean": 0.636, + "functions": 3, + "boot_lo": 0.303, + "boot_hi": 0.97, + "boot_half": 0.333, + "seeds": [ + 0.636, + 0.636, + 0.636 + ], + "seed_sd": 0.0, + "threshold": 0.34 + }, + "tests_top10_precision": { + "mean": 0.667, + "functions": 3, + "boot_lo": 0.333, + "boot_hi": 1.0, + "boot_half": 0.333, + "seeds": [ + 0.667, + 0.667, + 0.667 + ], + "seed_sd": 0.0, + "threshold": 0.34 + }, + "tests_top10_best": { + "mean": 0.667, + "functions": 3, + "boot_lo": 0.333, + "boot_hi": 1.0, + "boot_half": 0.333, + "seeds": [ + 0.667, + 0.667, + 0.667 + ], + "seed_sd": 0.0, + "threshold": 0.34 + }, + "tests_caught": { + "mean": 0.667, + "functions": 3, + "boot_lo": 0.333, + "boot_hi": 1.0, + "boot_half": 0.333, + "seeds": [ + 0.667, + 0.667, + 0.667 + ], + "seed_sd": 0.0, + "threshold": 0.34 + }, + "look_vs_file": { + "mean": 0.152, + "functions": 5, + "boot_lo": 0.073, + "boot_hi": 0.24, + "boot_half": 0.083, + "seeds": [ + 0.152, + 0.152, + 0.152 + ], + "seed_sd": 0.0, + "threshold": 0.09 + } + } + }, + { + "repo": "indexmap", + "lang": "rust", + "commit": "41a870887c4c", + "index_seconds": 0.1, + "symbols": 1026, + "files": 32, + "seeds": [ + 7, + 8, + 9 + ], + "edges": 6794, + "sample": [ + "indexmap::map::IndexMap::sort_unstable_keys", + "indexmap::set::IndexSet::is_subset", + "indexmap::serde::cautious_capacity", + "indexmap::set::IndexSet::difference", + "indexmap::benches::bench::simple_sort", + "indexmap::map::raw_entry_v1::RawEntryBuilder::index_from_hash", + "indexmap::inner::Core::split_splice", + "indexmap::inner::extract::ExtractCore::remaining", + "indexmap::map::raw_entry_v1::RawOccupiedEntryMut::into_key_value_mut", + "indexmap::map::IndexMap::sort_keys", + "indexmap::map::raw_entry_v1::RawVacantEntryMut::insert_hashed_nocheck", + "indexmap::set::IndexSet::contains", + "indexmap::util::simplify_range", + "indexmap::rayon::set::IndexSet::par_is_subset", + "indexmap::map::disjoint::get_disjoint_opt_mut", + "indexmap::set::IndexSet::union", + "indexmap::util::assert_index_lt", + "indexmap::util::try_simplify_range", + "indexmap::inner::Core::shift_insert_unique", + "indexmap::set::IndexSet::swap_take", + "indexmap::inner::Core::replace_index_unique", + "indexmap::map::IndexMap::contains_key", + "indexmap::inner::Core::retain_in_order", + "indexmap::rayon::set::IndexSet::par_difference", + "indexmap::inner::Core::get_index_of_raw", + "indexmap::map::slice::Slice::from_mut_slice", + "indexmap::set::IndexSet::intersection", + "indexmap::util::third", + "indexmap::util::assert_index_le", + "indexmap::map::raw_entry_v1::RawVacantEntryMut::shift_insert_hashed_nocheck", + "indexmap::map::IndexMap::get_index_entry", + "indexmap::set::IndexSet::symmetric_difference", + "indexmap::util::slice_eq" + ], + "sample_common": [ + "indexmap::map::slice::Slice::split_at", + "indexmap::set::IndexSet::with_capacity", + "indexmap::inner::Core::drain", + "indexmap::map::raw_entry_v1::RawOccupiedEntryMut::swap_remove_entry", + "indexmap::inner::Core::with_entries", + "indexmap::map::IndexMap::append", + "indexmap::set::IndexSet::sort_unstable_by_key", + "indexmap::map::IndexMap::move_index", + "indexmap::map::slice::Slice::binary_search_by", + "indexmap::map::IndexMap::clear", + "indexmap::inner::Core::truncate", + "indexmap::inner::entry::OccupiedEntry::into_core", + "indexmap::map::IndexMap::swap_remove", + "indexmap::map::entry::IndexedEntry::get_mut", + "indexmap::set::IndexSet::splice", + "indexmap::map::raw_entry_v1::RawVacantEntryMut::shift_insert", + "indexmap::map::IndexMap::get_key_value", + "indexmap::map::IndexMap::hasher", + "indexmap::map::IndexMap::is_empty", + "indexmap::map::slice::Slice::partition_point", + "indexmap::set::IndexSet::split_off", + "indexmap::map::IndexMap::sort_by_key", + "indexmap::inner::Core::into_entries", + "indexmap::map::IndexMap::swap_remove_full", + "indexmap::map::raw_entry_v1::RawEntryMut::or_insert", + "indexmap::set::IndexSet::binary_search_by", + "indexmap::map::IndexMap::is_sorted_by", + "indexmap::set::IndexSet::shrink_to", + "indexmap::inner::entry::OccupiedEntry::from_hash", + "indexmap::map::slice::Slice::from_boxed", + "indexmap::rayon::set::IndexSet::par_sort_unstable_by_key", + "indexmap::inner::Core::par_drain", + "indexmap::set::IndexSet::try_reserve", + "indexmap::map::entry::IndexedEntry::move_index", + "indexmap::map::IndexMap::shift_insert", + "indexmap::set::IndexSet::try_reserve_exact", + "indexmap::set::slice::Slice::is_sorted", + "indexmap::set::IndexSet::reverse", + "indexmap::map::IndexMap::get_index_of", + "indexmap::map::entry::IndexedEntry::shift_remove", + "indexmap::map::raw_entry_v1::RawOccupiedEntryMut::get_key_value_mut", + "indexmap::map::slice::Slice::split_at_checked", + "indexmap::map::slice::Slice::first", + "indexmap::set::slice::Slice::is_sorted_by_key", + "indexmap::map::IndexMap::shift_remove_full", + "indexmap::set::IndexSet::insert_full", + "indexmap::map::IndexMap::swap_remove_index", + "indexmap::rayon::map::IndexMap::par_sort_by", + "indexmap::rayon::map::IndexMap::par_sort_by_cached_key", + "indexmap::map::IndexMap::last_mut" + ], + "samples": { + "7": [ + "indexmap::map::IndexMap::sort_unstable_keys", + "indexmap::set::IndexSet::is_subset", + "indexmap::serde::cautious_capacity", + "indexmap::set::IndexSet::difference", + "indexmap::benches::bench::simple_sort", + "indexmap::map::raw_entry_v1::RawEntryBuilder::index_from_hash", + "indexmap::inner::Core::split_splice", + "indexmap::inner::extract::ExtractCore::remaining", + "indexmap::map::raw_entry_v1::RawOccupiedEntryMut::into_key_value_mut", + "indexmap::map::IndexMap::sort_keys", + "indexmap::map::raw_entry_v1::RawVacantEntryMut::insert_hashed_nocheck", + "indexmap::set::IndexSet::contains", + "indexmap::util::simplify_range", + "indexmap::rayon::set::IndexSet::par_is_subset", + "indexmap::map::disjoint::get_disjoint_opt_mut", + "indexmap::set::IndexSet::union", + "indexmap::util::assert_index_lt", + "indexmap::util::try_simplify_range", + "indexmap::inner::Core::shift_insert_unique", + "indexmap::set::IndexSet::swap_take" + ], + "8": [ + "indexmap::set::IndexSet::union", + "indexmap::inner::Core::replace_index_unique", + "indexmap::map::IndexMap::contains_key", + "indexmap::benches::bench::simple_sort", + "indexmap::inner::Core::retain_in_order", + "indexmap::map::raw_entry_v1::RawOccupiedEntryMut::into_key_value_mut", + "indexmap::serde::cautious_capacity", + "indexmap::rayon::set::IndexSet::par_difference", + "indexmap::map::IndexMap::sort_keys", + "indexmap::inner::Core::shift_insert_unique", + "indexmap::set::IndexSet::is_subset", + "indexmap::map::raw_entry_v1::RawEntryBuilder::index_from_hash", + "indexmap::inner::Core::get_index_of_raw", + "indexmap::util::try_simplify_range", + "indexmap::rayon::set::IndexSet::par_is_subset", + "indexmap::map::slice::Slice::from_mut_slice", + "indexmap::map::disjoint::get_disjoint_opt_mut", + "indexmap::set::IndexSet::intersection", + "indexmap::set::IndexSet::contains", + "indexmap::util::third" + ], + "9": [ + "indexmap::util::assert_index_le", + "indexmap::util::third", + "indexmap::map::raw_entry_v1::RawVacantEntryMut::shift_insert_hashed_nocheck", + "indexmap::map::slice::Slice::from_mut_slice", + "indexmap::rayon::set::IndexSet::par_difference", + "indexmap::set::IndexSet::swap_take", + "indexmap::inner::Core::split_splice", + "indexmap::set::IndexSet::intersection", + "indexmap::map::raw_entry_v1::RawOccupiedEntryMut::into_key_value_mut", + "indexmap::map::IndexMap::sort_unstable_keys", + "indexmap::set::IndexSet::union", + "indexmap::set::IndexSet::difference", + "indexmap::map::IndexMap::get_index_entry", + "indexmap::util::simplify_range", + "indexmap::set::IndexSet::contains", + "indexmap::map::IndexMap::contains_key", + "indexmap::inner::Core::replace_index_unique", + "indexmap::set::IndexSet::symmetric_difference", + "indexmap::inner::Core::retain_in_order", + "indexmap::util::slice_eq" + ] + }, + "samples_common": { + "7": [ + "indexmap::map::slice::Slice::split_at", + "indexmap::set::IndexSet::with_capacity", + "indexmap::inner::Core::drain", + "indexmap::map::raw_entry_v1::RawOccupiedEntryMut::swap_remove_entry", + "indexmap::inner::Core::with_entries", + "indexmap::map::IndexMap::append", + "indexmap::set::IndexSet::sort_unstable_by_key", + "indexmap::map::IndexMap::move_index", + "indexmap::map::slice::Slice::binary_search_by", + "indexmap::map::IndexMap::clear", + "indexmap::inner::Core::truncate", + "indexmap::inner::entry::OccupiedEntry::into_core", + "indexmap::map::IndexMap::swap_remove", + "indexmap::map::entry::IndexedEntry::get_mut", + "indexmap::set::IndexSet::splice", + "indexmap::map::raw_entry_v1::RawVacantEntryMut::shift_insert", + "indexmap::map::IndexMap::get_key_value", + "indexmap::map::IndexMap::hasher", + "indexmap::map::IndexMap::is_empty", + "indexmap::map::slice::Slice::partition_point" + ], + "8": [ + "indexmap::set::IndexSet::split_off", + "indexmap::map::IndexMap::sort_by_key", + "indexmap::inner::Core::into_entries", + "indexmap::map::IndexMap::swap_remove_full", + "indexmap::map::raw_entry_v1::RawEntryMut::or_insert", + "indexmap::set::IndexSet::binary_search_by", + "indexmap::set::IndexSet::with_capacity", + "indexmap::map::IndexMap::append", + "indexmap::map::IndexMap::is_sorted_by", + "indexmap::set::IndexSet::shrink_to", + "indexmap::inner::Core::truncate", + "indexmap::inner::entry::OccupiedEntry::from_hash", + "indexmap::map::slice::Slice::from_boxed", + "indexmap::set::IndexSet::sort_unstable_by_key", + "indexmap::rayon::set::IndexSet::par_sort_unstable_by_key", + "indexmap::map::IndexMap::get_key_value", + "indexmap::inner::Core::par_drain", + "indexmap::set::IndexSet::try_reserve", + "indexmap::map::entry::IndexedEntry::move_index", + "indexmap::map::IndexMap::shift_insert" + ], + "9": [ + "indexmap::set::IndexSet::try_reserve_exact", + "indexmap::set::slice::Slice::is_sorted", + "indexmap::inner::Core::par_drain", + "indexmap::set::IndexSet::reverse", + "indexmap::map::IndexMap::get_index_of", + "indexmap::map::entry::IndexedEntry::shift_remove", + "indexmap::map::raw_entry_v1::RawOccupiedEntryMut::get_key_value_mut", + "indexmap::map::slice::Slice::split_at_checked", + "indexmap::inner::entry::OccupiedEntry::into_core", + "indexmap::map::IndexMap::get_key_value", + "indexmap::map::slice::Slice::first", + "indexmap::map::IndexMap::is_sorted_by", + "indexmap::set::slice::Slice::is_sorted_by_key", + "indexmap::map::IndexMap::shift_insert", + "indexmap::map::IndexMap::shift_remove_full", + "indexmap::set::IndexSet::insert_full", + "indexmap::map::IndexMap::swap_remove_index", + "indexmap::rayon::map::IndexMap::par_sort_by", + "indexmap::rayon::map::IndexMap::par_sort_by_cached_key", + "indexmap::map::IndexMap::last_mut" + ] + }, + "samples_blind": { + "7": [ + "indexmap::map::IndexMap::get_full_mut", + "indexmap::map::raw_entry_v1::RawEntryBuilder::from_hash_full", + "indexmap::map::IndexMap::sort_unstable_keys", + "indexmap::map::slice::Slice::split_last_mut", + "indexmap::set::IndexSet::take", + "indexmap::set::IndexSet::is_disjoint", + "indexmap::map::entry::Entry::or_default", + "indexmap::set::IndexSet::is_subset", + "indexmap::serde::cautious_capacity", + "indexmap::set::IndexSet::difference", + "indexmap::benches::bench::simple_sort", + "indexmap::map::raw_entry_v1::RawEntryBuilder::index_from_hash", + "indexmap::inner::Core::split_splice", + "indexmap::map::IndexMap::last_entry", + "indexmap::inner::extract::ExtractCore::remaining", + "indexmap::map::raw_entry_v1::RawOccupiedEntryMut::into_key_value_mut", + "indexmap::map::IndexMap::sort_keys", + "indexmap::set::IndexSet::sort_unstable", + "indexmap::set::IndexSet::sort", + "indexmap::rayon::set::IndexSet::par_sort_unstable" + ], + "8": [ + "indexmap::set::IndexSet::union", + "indexmap::inner::Core::replace_index_unique", + "indexmap::rayon::set::IndexSet::par_is_disjoint", + "indexmap::map::raw_entry_v1::RawEntryBuilder::from_hash_full", + "indexmap::map::IndexMap::contains_key", + "indexmap::benches::bench::simple_sort", + "indexmap::inner::Core::retain_in_order", + "indexmap::set::IndexSet::take", + "indexmap::map::raw_entry_v1::RawOccupiedEntryMut::into_key_value_mut", + "indexmap::map::entry::Entry::or_insert_with_key", + "indexmap::serde::cautious_capacity", + "indexmap::map::IndexMap::last_entry", + "indexmap::set::IndexSet::sort", + "indexmap::rayon::set::IndexSet::par_difference", + "indexmap::map::IndexMap::sort_keys", + "indexmap::inner::Core::shift_insert_unique", + "indexmap::map::IndexMap::get_full_mut", + "indexmap::rayon::set::IndexSet::par_symmetric_difference", + "indexmap::map::slice::Slice::new_mut", + "indexmap::rayon::set::IndexSet::par_is_superset" + ], + "9": [ + "indexmap::util::assert_index_le", + "indexmap::map::slice::Slice::split_first_mut", + "indexmap::util::third", + "indexmap::rayon::map::IndexMap::par_sort_unstable_keys", + "indexmap::map::entry::Entry::or_default", + "indexmap::set::IndexSet::take", + "indexmap::map::entry::Entry::or_insert_with_key", + "indexmap::rayon::set::IndexSet::par_union", + "indexmap::map::raw_entry_v1::RawEntryBuilder::from_hash_full", + "indexmap::map::raw_entry_v1::RawVacantEntryMut::shift_insert_hashed_nocheck", + "indexmap::map::slice::Slice::from_mut_slice", + "indexmap::rayon::set::IndexSet::par_difference", + "indexmap::set::IndexSet::swap_take", + "indexmap::map::IndexMap::last_entry", + "indexmap::map::IndexMap::get_disjoint_indices_mut", + "indexmap::set::IndexSet::is_superset", + "indexmap::rayon::set::IndexSet::par_sort", + "indexmap::inner::Core::split_splice", + "indexmap::set::IndexSet::intersection", + "indexmap::map::raw_entry_v1::RawOccupiedEntryMut::into_key_value_mut" + ] + }, + "baseline_failing_tests": [], + "callers": [ + { + "symbol": "indexmap::map::IndexMap::sort_unstable_keys", + "truth": [ + "indexmap::set::IndexSet::sort_unstable" + ], + "found": [ + "indexmap::set::IndexSet::sort_unstable" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "indexmap::set::IndexSet::is_subset", + "truth": [ + "indexmap::set::IndexSet::eq", + "indexmap::set::IndexSet::is_superset" + ], + "found": [ + "indexmap::set::IndexSet::eq", + "indexmap::set::IndexSet::is_superset" + ], + "maybe": [], + "import_files": [ + "src/set/tests.rs" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "indexmap::serde::cautious_capacity", + "truth": [ + "indexmap::map::serde_seq::SeqVisitor::visit_seq", + "indexmap::serde::IndexMapVisitor::visit_map", + "indexmap::serde::IndexSetVisitor::visit_seq" + ], + "found": [ + "indexmap::map::serde_seq::SeqVisitor::visit_seq", + "indexmap::serde::IndexMapVisitor::visit_map", + "indexmap::serde::IndexSetVisitor::visit_seq" + ], + "maybe": [], + "import_files": [ + "src/map/serde_seq.rs" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "indexmap::set::IndexSet::difference", + "truth": [ + "indexmap::rayon::set::ParDifference::fmt", + "indexmap::set::IndexSet::sub", + "indexmap::set::iter::SymmetricDifference::new", + "indexmap::set::iter::Union::new" + ], + "found": [ + "indexmap::rayon::set::ParDifference::fmt", + "indexmap::set::IndexSet::sub", + "indexmap::set::iter::SymmetricDifference::new", + "indexmap::set::iter::Union::new" + ], + "maybe": [], + "import_files": [ + "src/set/tests.rs" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "indexmap::benches::bench::simple_sort", + "skipped": "compiler reported no uses" + }, + { + "symbol": "indexmap::map::raw_entry_v1::RawEntryBuilder::index_from_hash", + "truth": [ + "indexmap::map::raw_entry_v1::RawEntryBuilder::from_hash", + "indexmap::map::raw_entry_v1::RawEntryBuilder::from_hash_full" + ], + "found": [ + "indexmap::map::raw_entry_v1::RawEntryBuilder::from_hash", + "indexmap::map::raw_entry_v1::RawEntryBuilder::from_hash_full" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "indexmap::inner::Core::split_splice", + "truth": [ + "indexmap::map::iter::Splice::new" + ], + "found": [ + "indexmap::map::iter::Splice::new" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "indexmap::inner::extract::ExtractCore::remaining", + "truth": [ + "indexmap::map::iter::ExtractIf::size_hint", + "indexmap::set::iter::ExtractIf::size_hint" + ], + "found": [ + "indexmap::map::iter::ExtractIf::size_hint", + "indexmap::set::iter::ExtractIf::size_hint" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "indexmap::map::raw_entry_v1::RawOccupiedEntryMut::into_key_value_mut", + "truth": [ + "indexmap::map::raw_entry_v1::RawEntryMut::or_insert", + "indexmap::map::raw_entry_v1::RawEntryMut::or_insert_with" + ], + "found": [ + "indexmap::map::raw_entry_v1::RawEntryMut::or_insert", + "indexmap::map::raw_entry_v1::RawEntryMut::or_insert_with" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "indexmap::map::IndexMap::sort_keys", + "truth": [ + "indexmap::set::IndexSet::sort" + ], + "found": [ + "indexmap::set::IndexSet::sort" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "indexmap::map::raw_entry_v1::RawVacantEntryMut::insert_hashed_nocheck", + "truth": [ + "indexmap::map::raw_entry_v1::RawVacantEntryMut::insert" + ], + "found": [ + "indexmap::map::raw_entry_v1::RawVacantEntryMut::insert" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "indexmap::set::IndexSet::contains", + "truth": [ + "indexmap::rayon::set::IndexSet::par_is_disjoint", + "indexmap::rayon::set::IndexSet::par_is_subset", + "indexmap::rayon::set::ParDifference::drive_unindexed", + "indexmap::rayon::set::ParIntersection::drive_unindexed", + "indexmap::set::IndexSet::is_disjoint", + "indexmap::set::IndexSet::is_subset", + "indexmap::set::iter::Difference::next", + "indexmap::set::iter::Difference::next_back", + "indexmap::set::iter::Intersection::next", + "indexmap::set::iter::Intersection::next_back" + ], + "found": [ + "indexmap::rayon::set::IndexSet::par_is_disjoint", + "indexmap::rayon::set::IndexSet::par_is_subset", + "indexmap::set::IndexSet::is_disjoint", + "indexmap::set::IndexSet::is_subset", + "indexmap::set::iter::Difference::next", + "indexmap::set::iter::Difference::next_back", + "indexmap::set::iter::Intersection::next", + "indexmap::set::iter::Intersection::next_back" + ], + "maybe": [], + "import_files": [], + "recall": 0.8, + "precision": 1.0, + "recall_with_maybe": 0.8 + }, + { + "symbol": "indexmap::util::simplify_range", + "truth": [ + "indexmap::inner::Core::drain", + "indexmap::inner::Core::par_drain", + "indexmap::inner::Core::split_splice", + "indexmap::inner::extract::Core::extract" + ], + "found": [ + "indexmap::inner::Core::drain", + "indexmap::inner::Core::par_drain", + "indexmap::inner::Core::split_splice", + "indexmap::inner::extract::Core::extract" + ], + "maybe": [], + "import_files": [ + "src/inner.rs", + "src/inner/extract.rs" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "indexmap::rayon::set::IndexSet::par_is_subset", + "truth": [ + "indexmap::rayon::set::IndexSet::par_eq", + "indexmap::rayon::set::IndexSet::par_is_superset" + ], + "found": [ + "indexmap::rayon::set::IndexSet::par_eq", + "indexmap::rayon::set::IndexSet::par_is_superset" + ], + "maybe": [], + "import_files": [ + "src/rayon/set.rs" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "indexmap::map::disjoint::get_disjoint_opt_mut", + "truth": [ + "indexmap::map::IndexMap::get_disjoint_mut" + ], + "found": [ + "indexmap::map::IndexMap::get_disjoint_mut" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "indexmap::set::IndexSet::union", + "truth": [ + "indexmap::rayon::set::ParUnion::fmt", + "indexmap::set::IndexSet::bitor" + ], + "found": [ + "indexmap::rayon::set::ParUnion::fmt", + "indexmap::set::IndexSet::bitor" + ], + "maybe": [], + "import_files": [ + "src/set/tests.rs" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "indexmap::util::assert_index_lt", + "truth": [ + "indexmap::inner::Core::move_index", + "indexmap::inner::Core::swap_indices", + "indexmap::inner::entry::OccupiedEntry::move_index", + "indexmap::inner::entry::OccupiedEntry::swap_indices", + "indexmap::inner::entry::VacantEntry::replace_index", + "indexmap::map::IndexMap::index", + "indexmap::map::IndexMap::index_mut", + "indexmap::map::IndexMap::replace_index", + "indexmap::map::IndexMap::shift_insert", + "indexmap::set::IndexSet::index" + ], + "found": [ + "indexmap::inner::Core::move_index", + "indexmap::inner::Core::swap_indices", + "indexmap::inner::entry::OccupiedEntry::move_index", + "indexmap::inner::entry::OccupiedEntry::swap_indices", + "indexmap::inner::entry::VacantEntry::replace_index", + "indexmap::map::IndexMap::index", + "indexmap::map::IndexMap::index_mut", + "indexmap::map::IndexMap::replace_index", + "indexmap::map::IndexMap::shift_insert", + "indexmap::set::IndexSet::index" + ], + "maybe": [], + "import_files": [ + "src/inner.rs", + "src/inner/entry.rs", + "src/map.rs", + "src/set.rs" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "indexmap::util::try_simplify_range", + "truth": [ + "indexmap::map::IndexMap::get_range", + "indexmap::map::IndexMap::get_range_mut", + "indexmap::map::slice::Slice::get_range", + "indexmap::map::slice::Slice::get_range_mut", + "indexmap::set::IndexSet::get_range", + "indexmap::set::slice::Slice::get_range" + ], + "found": [ + "indexmap::map::IndexMap::get_range", + "indexmap::map::IndexMap::get_range_mut", + "indexmap::map::slice::Slice::get_range", + "indexmap::map::slice::Slice::get_range_mut", + "indexmap::set::IndexSet::get_range", + "indexmap::set::slice::Slice::get_range" + ], + "maybe": [], + "import_files": [ + "src/map.rs", + "src/map/slice.rs", + "src/set.rs", + "src/set/slice.rs" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "indexmap::inner::Core::shift_insert_unique", + "truth": [ + "indexmap::inner::entry::VacantEntry::shift_insert", + "indexmap::map::raw_entry_v1::RawVacantEntryMut::shift_insert_hashed_nocheck" + ], + "found": [ + "indexmap::inner::entry::VacantEntry::shift_insert", + "indexmap::map::raw_entry_v1::RawVacantEntryMut::shift_insert_hashed_nocheck" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "indexmap::set::IndexSet::swap_take", + "truth": [ + "indexmap::set::IndexSet::take" + ], + "found": [ + "indexmap::set::IndexSet::take" + ], + "maybe": [], + "import_files": [ + "src/set/tests.rs" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "indexmap::inner::Core::replace_index_unique", + "truth": [ + "indexmap::map::IndexMap::replace_index" + ], + "found": [ + "indexmap::map::IndexMap::replace_index" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "indexmap::map::IndexMap::contains_key", + "truth": [ + "indexmap::set::IndexSet::contains" + ], + "found": [ + "indexmap::set::IndexSet::contains" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "indexmap::inner::Core::retain_in_order", + "truth": [ + "indexmap::map::IndexMap::retain", + "indexmap::map::mutable::IndexMap::retain2" + ], + "found": [ + "indexmap::map::IndexMap::retain", + "indexmap::map::mutable::IndexMap::retain2" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "indexmap::rayon::set::IndexSet::par_difference", + "truth": [ + "indexmap::rayon::set::ParSymmetricDifference::drive_unindexed", + "indexmap::rayon::set::ParUnion::drive_unindexed" + ], + "found": [ + "indexmap::rayon::set::ParSymmetricDifference::drive_unindexed", + "indexmap::rayon::set::ParUnion::drive_unindexed" + ], + "maybe": [], + "import_files": [ + "src/rayon/set.rs" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "indexmap::inner::Core::get_index_of_raw", + "truth": [ + "indexmap::map::raw_entry_v1::RawEntryBuilder::index_from_hash" + ], + "found": [ + "indexmap::map::raw_entry_v1::RawEntryBuilder::index_from_hash" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "indexmap::map::slice::Slice::from_mut_slice", + "truth": [ + "indexmap::map::IndexMap::as_mut_slice", + "indexmap::map::IndexMap::get_range_mut", + "indexmap::map::iter::IntoIter::as_mut_slice", + "indexmap::map::iter::IterMut2::into_slice", + "indexmap::map::iter::IterMut::into_slice", + "indexmap::map::slice::Slice::default", + "indexmap::map::slice::Slice::get_range_mut", + "indexmap::map::slice::Slice::new_mut", + "indexmap::map::slice::Slice::split_at_mut", + "indexmap::map::slice::Slice::split_at_mut_checked", + "indexmap::map::slice::Slice::split_first_mut", + "indexmap::map::slice::Slice::split_last_mut", + "indexmap::map::slice::impl_index" + ], + "found": [ + "indexmap::map::IndexMap::as_mut_slice", + "indexmap::map::IndexMap::get_range_mut", + "indexmap::map::iter::IntoIter::as_mut_slice", + "indexmap::map::iter::IterMut2::into_slice", + "indexmap::map::iter::IterMut::into_slice", + "indexmap::map::slice::Slice::default", + "indexmap::map::slice::Slice::get_range_mut", + "indexmap::map::slice::Slice::new_mut", + "indexmap::map::slice::Slice::split_at_mut", + "indexmap::map::slice::Slice::split_at_mut_checked", + "indexmap::map::slice::Slice::split_first_mut", + "indexmap::map::slice::Slice::split_last_mut" + ], + "maybe": [], + "import_files": [], + "recall": 0.9230769230769231, + "precision": 1.0, + "recall_with_maybe": 0.9230769230769231 + }, + { + "symbol": "indexmap::set::IndexSet::intersection", + "truth": [ + "indexmap::rayon::set::ParIntersection::fmt", + "indexmap::set::IndexSet::bitand" + ], + "found": [ + "indexmap::rayon::set::ParIntersection::fmt", + "indexmap::set::IndexSet::bitand" + ], + "maybe": [], + "import_files": [ + "src/set/tests.rs" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "indexmap::util::third", + "truth": [ + "indexmap::map::IndexMap::shift_remove", + "indexmap::map::IndexMap::swap_remove" + ], + "found": [ + "indexmap::map::IndexMap::shift_remove", + "indexmap::map::IndexMap::swap_remove" + ], + "maybe": [], + "import_files": [ + "src/map.rs" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "indexmap::util::assert_index_le", + "truth": [ + "indexmap::inner::Core::split_off", + "indexmap::map::IndexMap::insert_before", + "indexmap::map::IndexMap::shift_insert" + ], + "found": [ + "indexmap::inner::Core::split_off", + "indexmap::map::IndexMap::insert_before", + "indexmap::map::IndexMap::shift_insert" + ], + "maybe": [], + "import_files": [ + "src/inner.rs", + "src/map.rs" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "indexmap::map::raw_entry_v1::RawVacantEntryMut::shift_insert_hashed_nocheck", + "truth": [ + "indexmap::map::raw_entry_v1::RawVacantEntryMut::shift_insert" + ], + "found": [ + "indexmap::map::raw_entry_v1::RawVacantEntryMut::shift_insert" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "indexmap::map::IndexMap::get_index_entry", + "truth": [ + "indexmap::map::IndexMap::first_entry", + "indexmap::map::IndexMap::last_entry" + ], + "found": [ + "indexmap::map::IndexMap::first_entry", + "indexmap::map::IndexMap::last_entry" + ], + "maybe": [], + "import_files": [ + "src/map/tests.rs" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "indexmap::set::IndexSet::symmetric_difference", + "truth": [ + "indexmap::rayon::set::ParSymmetricDifference::fmt", + "indexmap::set::IndexSet::bitxor" + ], + "found": [ + "indexmap::rayon::set::ParSymmetricDifference::fmt", + "indexmap::set::IndexSet::bitxor" + ], + "maybe": [], + "import_files": [ + "src/set/tests.rs" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "indexmap::util::slice_eq", + "truth": [ + "indexmap::map::slice::Slice::eq", + "indexmap::set::slice::Slice::eq" + ], + "found": [ + "indexmap::map::slice::Slice::eq", + "indexmap::set::slice::Slice::eq" + ], + "maybe": [], + "import_files": [ + "src/map/slice.rs", + "src/set/slice.rs" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + } + ], + "callers_common": [ + { + "symbol": "indexmap::map::slice::Slice::split_at", + "skipped": "compiler reported no uses" + }, + { + "symbol": "indexmap::set::IndexSet::with_capacity", + "truth": [ + "indexmap::macros::indexset" + ], + "found": [ + "indexmap::macros::indexset" + ], + "maybe": [], + "import_files": [ + "src/set/tests.rs" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "indexmap::inner::Core::drain", + "truth": [ + "indexmap::map::IndexMap::drain", + "indexmap::set::IndexSet::drain" + ], + "found": [ + "indexmap::map::IndexMap::drain", + "indexmap::set::IndexSet::drain" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "indexmap::map::raw_entry_v1::RawOccupiedEntryMut::swap_remove_entry", + "truth": [ + "indexmap::map::raw_entry_v1::RawOccupiedEntryMut::remove_entry" + ], + "found": [ + "indexmap::map::raw_entry_v1::RawOccupiedEntryMut::remove_entry" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "indexmap::inner::Core::with_entries", + "truth": [ + "indexmap::map::IndexMap::with_entries" + ], + "found": [ + "indexmap::map::IndexMap::with_entries" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "indexmap::map::IndexMap::append", + "truth": [ + "indexmap::set::IndexSet::append" + ], + "found": [ + "indexmap::set::IndexSet::append" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "indexmap::set::IndexSet::sort_unstable_by_key", + "truth": [], + "found": [], + "maybe": [], + "import_files": [ + "src/set/tests.rs" + ], + "recall": null, + "precision": null, + "recall_with_maybe": null + }, + { + "symbol": "indexmap::map::IndexMap::move_index", + "truth": [ + "indexmap::map::tests::move_index_oob", + "indexmap::set::IndexSet::move_index" + ], + "found": [ + "indexmap::set::IndexSet::move_index" + ], + "maybe": [ + "indexmap::map::tests::move_index_oob" + ], + "import_files": [ + "src/map/tests.rs" + ], + "recall": 0.5, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "indexmap::map::slice::Slice::binary_search_by", + "truth": [ + "indexmap::inner::entry::VacantEntry::insert_sorted_by", + "indexmap::map::IndexMap::binary_search_by", + "indexmap::map::slice::Slice::binary_search_by_key", + "indexmap::map::slice::Slice::binary_search_keys" + ], + "found": [ + "indexmap::inner::entry::VacantEntry::insert_sorted_by", + "indexmap::map::IndexMap::binary_search_by", + "indexmap::map::slice::Slice::binary_search_by_key", + "indexmap::map::slice::Slice::binary_search_keys" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "indexmap::map::IndexMap::clear", + "truth": [ + "indexmap::set::IndexSet::clear" + ], + "found": [ + "indexmap::set::IndexSet::clear" + ], + "maybe": [], + "import_files": [ + "src/map/tests.rs" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "indexmap::inner::Core::truncate", + "truth": [ + "indexmap::map::IndexMap::truncate" + ], + "found": [ + "indexmap::map::IndexMap::truncate" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "indexmap::inner::entry::OccupiedEntry::into_core", + "truth": [ + "indexmap::map::entry::IndexedEntry::from" + ], + "found": [ + "indexmap::map::entry::IndexedEntry::from" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "indexmap::map::IndexMap::swap_remove", + "truth": [ + "indexmap::map::IndexMap::remove", + "indexmap::set::IndexSet::swap_remove" + ], + "found": [ + "indexmap::map::IndexMap::remove", + "indexmap::set::IndexSet::swap_remove" + ], + "maybe": [], + "import_files": [ + "src/map/tests.rs", + "src/rayon/map.rs" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "indexmap::map::entry::IndexedEntry::get_mut", + "truth": [ + "indexmap::map::entry::IndexedEntry::insert" + ], + "found": [ + "indexmap::map::entry::IndexedEntry::insert" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "indexmap::set::IndexSet::splice", + "skipped": "compiler reported no uses" + }, + { + "symbol": "indexmap::map::raw_entry_v1::RawVacantEntryMut::shift_insert", + "skipped": "compiler reported no uses" + }, + { + "symbol": "indexmap::map::IndexMap::get_key_value", + "truth": [ + "indexmap::map::raw_entry_v1::RawEntryBuilder::from_key", + "indexmap::set::IndexSet::get" + ], + "found": [ + "indexmap::map::raw_entry_v1::RawEntryBuilder::from_key", + "indexmap::set::IndexSet::get" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "indexmap::map::IndexMap::hasher", + "truth": [ + "indexmap::set::IndexSet::hasher" + ], + "found": [ + "indexmap::set::IndexSet::hasher" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "indexmap::map::IndexMap::is_empty", + "truth": [ + "indexmap::map::IndexMap::extend", + "indexmap::set::IndexSet::is_empty" + ], + "found": [ + "indexmap::map::IndexMap::extend", + "indexmap::set::IndexSet::is_empty" + ], + "maybe": [], + "import_files": [ + "src/map/tests.rs" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "indexmap::map::slice::Slice::partition_point", + "truth": [ + "indexmap::map::IndexMap::partition_point" + ], + "found": [ + "indexmap::map::IndexMap::partition_point" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "indexmap::set::IndexSet::split_off", + "truth": [], + "found": [], + "maybe": [], + "import_files": [ + "src/set/tests.rs" + ], + "recall": null, + "precision": null, + "recall_with_maybe": null + }, + { + "symbol": "indexmap::map::IndexMap::sort_by_key", + "skipped": "compiler reported no uses" + }, + { + "symbol": "indexmap::inner::Core::into_entries", + "truth": [ + "indexmap::map::IndexMap::into_entries" + ], + "found": [ + "indexmap::map::IndexMap::into_entries" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "indexmap::map::IndexMap::swap_remove_full", + "truth": [ + "indexmap::map::IndexMap::swap_remove", + "indexmap::map::IndexMap::swap_remove_entry", + "indexmap::set::IndexSet::swap_remove_full" + ], + "found": [ + "indexmap::map::IndexMap::swap_remove", + "indexmap::map::IndexMap::swap_remove_entry", + "indexmap::set::IndexSet::swap_remove_full" + ], + "maybe": [], + "import_files": [ + "src/map/tests.rs" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "indexmap::map::raw_entry_v1::RawEntryMut::or_insert", + "skipped": "compiler reported no uses" + }, + { + "symbol": "indexmap::set::IndexSet::binary_search_by", + "truth": [], + "found": [], + "maybe": [], + "import_files": [ + "src/set/tests.rs" + ], + "recall": null, + "precision": null, + "recall_with_maybe": null + }, + { + "symbol": "indexmap::map::IndexMap::is_sorted_by", + "truth": [], + "found": [], + "maybe": [], + "import_files": [ + "src/map/tests.rs" + ], + "recall": null, + "precision": null, + "recall_with_maybe": null + }, + { + "symbol": "indexmap::set::IndexSet::shrink_to", + "skipped": "compiler reported no uses" + }, + { + "symbol": "indexmap::inner::entry::OccupiedEntry::from_hash", + "truth": [ + "indexmap::map::raw_entry_v1::RawEntryBuilderMut::from_hash" + ], + "found": [ + "indexmap::map::raw_entry_v1::RawEntryBuilderMut::from_hash" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "indexmap::map::slice::Slice::from_boxed", + "truth": [ + "indexmap::map::IndexMap::into_boxed_slice", + "indexmap::map::slice::Box::clone", + "indexmap::map::slice::Box::default", + "indexmap::map::slice::Box::from" + ], + "found": [ + "indexmap::map::IndexMap::into_boxed_slice", + "indexmap::map::slice::Box::clone", + "indexmap::map::slice::Box::default", + "indexmap::map::slice::Box::from" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "indexmap::rayon::set::IndexSet::par_sort_unstable_by_key", + "skipped": "compiler reported no uses" + }, + { + "symbol": "indexmap::inner::Core::par_drain", + "truth": [ + "indexmap::rayon::map::IndexMap::par_drain", + "indexmap::rayon::set::IndexSet::par_drain" + ], + "found": [], + "maybe": [ + "indexmap::rayon::map::IndexMap::par_drain", + "indexmap::rayon::set::IndexSet::par_drain" + ], + "import_files": [], + "recall": 0.0, + "precision": null, + "recall_with_maybe": 1.0 + }, + { + "symbol": "indexmap::set::IndexSet::try_reserve", + "truth": [], + "found": [], + "maybe": [], + "import_files": [ + "src/set/tests.rs" + ], + "recall": null, + "precision": null, + "recall_with_maybe": null + }, + { + "symbol": "indexmap::map::entry::IndexedEntry::move_index", + "skipped": "compiler reported no uses" + }, + { + "symbol": "indexmap::map::IndexMap::shift_insert", + "truth": [ + "indexmap::set::IndexSet::shift_insert" + ], + "found": [ + "indexmap::set::IndexSet::shift_insert" + ], + "maybe": [], + "import_files": [ + "src/map/tests.rs" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "indexmap::set::IndexSet::try_reserve_exact", + "truth": [], + "found": [], + "maybe": [], + "import_files": [ + "src/set/tests.rs" + ], + "recall": null, + "precision": null, + "recall_with_maybe": null + }, + { + "symbol": "indexmap::set::slice::Slice::is_sorted", + "truth": [ + "indexmap::set::IndexSet::is_sorted" + ], + "found": [ + "indexmap::set::IndexSet::is_sorted" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "indexmap::set::IndexSet::reverse", + "truth": [], + "found": [], + "maybe": [], + "import_files": [ + "src/set/tests.rs" + ], + "recall": null, + "precision": null, + "recall_with_maybe": null + }, + { + "symbol": "indexmap::map::IndexMap::get_index_of", + "truth": [ + "indexmap::map::IndexMap::contains_key", + "indexmap::map::IndexMap::get", + "indexmap::map::IndexMap::get_disjoint_mut", + "indexmap::map::IndexMap::get_full", + "indexmap::map::IndexMap::get_full_mut", + "indexmap::map::IndexMap::get_key_value", + "indexmap::map::IndexMap::get_key_value_mut", + "indexmap::map::IndexMap::get_mut", + "indexmap::map::mutable::IndexMap::get_full_mut2", + "indexmap::set::IndexSet::get_index_of" + ], + "found": [ + "indexmap::map::IndexMap::contains_key", + "indexmap::map::IndexMap::get", + "indexmap::map::IndexMap::get_disjoint_mut", + "indexmap::map::IndexMap::get_full", + "indexmap::map::IndexMap::get_full_mut", + "indexmap::map::IndexMap::get_key_value", + "indexmap::map::IndexMap::get_key_value_mut", + "indexmap::map::IndexMap::get_mut", + "indexmap::map::mutable::IndexMap::get_full_mut2", + "indexmap::set::IndexSet::get_index_of" + ], + "maybe": [], + "import_files": [ + "src/map/tests.rs" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "indexmap::map::entry::IndexedEntry::shift_remove", + "skipped": "compiler reported no uses" + }, + { + "symbol": "indexmap::map::raw_entry_v1::RawOccupiedEntryMut::get_key_value_mut", + "truth": [ + "indexmap::map::raw_entry_v1::RawEntryMut::and_modify" + ], + "found": [ + "indexmap::map::raw_entry_v1::RawEntryMut::and_modify" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "indexmap::map::slice::Slice::split_at_checked", + "skipped": "compiler reported no uses" + }, + { + "symbol": "indexmap::map::slice::Slice::first", + "skipped": "compiler reported no uses" + }, + { + "symbol": "indexmap::set::slice::Slice::is_sorted_by_key", + "truth": [ + "indexmap::set::IndexSet::is_sorted_by_key" + ], + "found": [ + "indexmap::set::IndexSet::is_sorted_by_key" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "indexmap::map::IndexMap::shift_remove_full", + "truth": [ + "indexmap::map::IndexMap::shift_remove", + "indexmap::map::IndexMap::shift_remove_entry", + "indexmap::set::IndexSet::shift_remove_full" + ], + "found": [ + "indexmap::map::IndexMap::shift_remove", + "indexmap::map::IndexMap::shift_remove_entry", + "indexmap::set::IndexSet::shift_remove_full" + ], + "maybe": [], + "import_files": [ + "src/map/tests.rs" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "indexmap::set::IndexSet::insert_full", + "truth": [], + "found": [], + "maybe": [], + "import_files": [ + "src/set/tests.rs" + ], + "recall": null, + "precision": null, + "recall_with_maybe": null + }, + { + "symbol": "indexmap::map::IndexMap::swap_remove_index", + "truth": [ + "indexmap::set::IndexSet::swap_remove_index" + ], + "found": [ + "indexmap::set::IndexSet::swap_remove_index" + ], + "maybe": [], + "import_files": [ + "src/map/tests.rs" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "indexmap::rayon::map::IndexMap::par_sort_by", + "skipped": "compiler reported no uses" + }, + { + "symbol": "indexmap::rayon::map::IndexMap::par_sort_by_cached_key", + "skipped": "compiler reported no uses" + }, + { + "symbol": "indexmap::map::IndexMap::last_mut", + "truth": [ + "indexmap::map::IndexMap::pop_if" + ], + "found": [ + "indexmap::map::IndexMap::pop_if" + ], + "maybe": [], + "import_files": [ + "src/map/tests.rs" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + } + ], + "callers_blind": [ + { + "symbol": "indexmap::map::IndexMap::get_full_mut", + "skipped": "compiler reported no uses" + }, + { + "symbol": "indexmap::map::raw_entry_v1::RawEntryBuilder::from_hash_full", + "skipped": "compiler reported no uses" + }, + { + "symbol": "indexmap::map::IndexMap::sort_unstable_keys", + "truth": [ + "indexmap::set::IndexSet::sort_unstable" + ], + "found": [ + "indexmap::set::IndexSet::sort_unstable" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "indexmap::map::slice::Slice::split_last_mut", + "truth": [], + "found": [], + "maybe": [], + "import_files": [ + "src/map/slice.rs" + ], + "recall": null, + "precision": null, + "recall_with_maybe": null + }, + { + "symbol": "indexmap::set::IndexSet::take", + "truth": [], + "found": [], + "maybe": [], + "import_files": [ + "src/set/tests.rs" + ], + "recall": null, + "precision": null, + "recall_with_maybe": null + }, + { + "symbol": "indexmap::set::IndexSet::is_disjoint", + "truth": [], + "found": [], + "maybe": [], + "import_files": [ + "src/set/tests.rs" + ], + "recall": null, + "precision": null, + "recall_with_maybe": null + }, + { + "symbol": "indexmap::map::entry::Entry::or_default", + "truth": [], + "found": [], + "maybe": [], + "import_files": [ + "src/map/tests.rs" + ], + "recall": null, + "precision": null, + "recall_with_maybe": null + }, + { + "symbol": "indexmap::set::IndexSet::is_subset", + "truth": [ + "indexmap::set::IndexSet::eq", + "indexmap::set::IndexSet::is_superset" + ], + "found": [ + "indexmap::set::IndexSet::eq", + "indexmap::set::IndexSet::is_superset" + ], + "maybe": [], + "import_files": [ + "src/set/tests.rs" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "indexmap::serde::cautious_capacity", + "truth": [ + "indexmap::map::serde_seq::SeqVisitor::visit_seq", + "indexmap::serde::IndexMapVisitor::visit_map", + "indexmap::serde::IndexSetVisitor::visit_seq" + ], + "found": [ + "indexmap::map::serde_seq::SeqVisitor::visit_seq", + "indexmap::serde::IndexMapVisitor::visit_map", + "indexmap::serde::IndexSetVisitor::visit_seq" + ], + "maybe": [], + "import_files": [ + "src/map/serde_seq.rs" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "indexmap::set::IndexSet::difference", + "truth": [ + "indexmap::rayon::set::ParDifference::fmt", + "indexmap::set::IndexSet::sub", + "indexmap::set::iter::SymmetricDifference::new", + "indexmap::set::iter::Union::new" + ], + "found": [ + "indexmap::rayon::set::ParDifference::fmt", + "indexmap::set::IndexSet::sub", + "indexmap::set::iter::SymmetricDifference::new", + "indexmap::set::iter::Union::new" + ], + "maybe": [], + "import_files": [ + "src/set/tests.rs" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "indexmap::benches::bench::simple_sort", + "skipped": "compiler reported no uses" + }, + { + "symbol": "indexmap::map::raw_entry_v1::RawEntryBuilder::index_from_hash", + "truth": [ + "indexmap::map::raw_entry_v1::RawEntryBuilder::from_hash", + "indexmap::map::raw_entry_v1::RawEntryBuilder::from_hash_full" + ], + "found": [ + "indexmap::map::raw_entry_v1::RawEntryBuilder::from_hash", + "indexmap::map::raw_entry_v1::RawEntryBuilder::from_hash_full" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "indexmap::inner::Core::split_splice", + "truth": [ + "indexmap::map::iter::Splice::new" + ], + "found": [ + "indexmap::map::iter::Splice::new" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "indexmap::map::IndexMap::last_entry", + "truth": [], + "found": [], + "maybe": [], + "import_files": [ + "src/map/tests.rs" + ], + "recall": null, + "precision": null, + "recall_with_maybe": null + }, + { + "symbol": "indexmap::inner::extract::ExtractCore::remaining", + "truth": [ + "indexmap::map::iter::ExtractIf::size_hint", + "indexmap::set::iter::ExtractIf::size_hint" + ], + "found": [ + "indexmap::map::iter::ExtractIf::size_hint", + "indexmap::set::iter::ExtractIf::size_hint" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "indexmap::map::raw_entry_v1::RawOccupiedEntryMut::into_key_value_mut", + "truth": [ + "indexmap::map::raw_entry_v1::RawEntryMut::or_insert", + "indexmap::map::raw_entry_v1::RawEntryMut::or_insert_with" + ], + "found": [ + "indexmap::map::raw_entry_v1::RawEntryMut::or_insert", + "indexmap::map::raw_entry_v1::RawEntryMut::or_insert_with" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "indexmap::map::IndexMap::sort_keys", + "truth": [ + "indexmap::set::IndexSet::sort" + ], + "found": [ + "indexmap::set::IndexSet::sort" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "indexmap::set::IndexSet::sort_unstable", + "truth": [], + "found": [], + "maybe": [], + "import_files": [ + "src/set/tests.rs" + ], + "recall": null, + "precision": null, + "recall_with_maybe": null + }, + { + "symbol": "indexmap::set::IndexSet::sort", + "skipped": "compiler reported no uses" + }, + { + "symbol": "indexmap::rayon::set::IndexSet::par_sort_unstable", + "skipped": "compiler reported no uses" + }, + { + "symbol": "indexmap::set::IndexSet::union", + "truth": [ + "indexmap::rayon::set::ParUnion::fmt", + "indexmap::set::IndexSet::bitor" + ], + "found": [ + "indexmap::rayon::set::ParUnion::fmt", + "indexmap::set::IndexSet::bitor" + ], + "maybe": [], + "import_files": [ + "src/set/tests.rs" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "indexmap::inner::Core::replace_index_unique", + "truth": [ + "indexmap::map::IndexMap::replace_index" + ], + "found": [ + "indexmap::map::IndexMap::replace_index" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "indexmap::rayon::set::IndexSet::par_is_disjoint", + "truth": [], + "found": [], + "maybe": [], + "import_files": [ + "src/rayon/set.rs" + ], + "recall": null, + "precision": null, + "recall_with_maybe": null + }, + { + "symbol": "indexmap::map::IndexMap::contains_key", + "truth": [ + "indexmap::set::IndexSet::contains" + ], + "found": [ + "indexmap::set::IndexSet::contains" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "indexmap::inner::Core::retain_in_order", + "truth": [ + "indexmap::map::IndexMap::retain", + "indexmap::map::mutable::IndexMap::retain2" + ], + "found": [ + "indexmap::map::IndexMap::retain", + "indexmap::map::mutable::IndexMap::retain2" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "indexmap::map::entry::Entry::or_insert_with_key", + "skipped": "compiler reported no uses" + }, + { + "symbol": "indexmap::rayon::set::IndexSet::par_difference", + "truth": [ + "indexmap::rayon::set::ParSymmetricDifference::drive_unindexed", + "indexmap::rayon::set::ParUnion::drive_unindexed" + ], + "found": [ + "indexmap::rayon::set::ParSymmetricDifference::drive_unindexed", + "indexmap::rayon::set::ParUnion::drive_unindexed" + ], + "maybe": [], + "import_files": [ + "src/rayon/set.rs" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "indexmap::inner::Core::shift_insert_unique", + "truth": [ + "indexmap::inner::entry::VacantEntry::shift_insert", + "indexmap::map::raw_entry_v1::RawVacantEntryMut::shift_insert_hashed_nocheck" + ], + "found": [ + "indexmap::inner::entry::VacantEntry::shift_insert", + "indexmap::map::raw_entry_v1::RawVacantEntryMut::shift_insert_hashed_nocheck" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "indexmap::rayon::set::IndexSet::par_symmetric_difference", + "truth": [], + "found": [], + "maybe": [], + "import_files": [ + "src/rayon/set.rs" + ], + "recall": null, + "precision": null, + "recall_with_maybe": null + }, + { + "symbol": "indexmap::map::slice::Slice::new_mut", + "truth": [], + "found": [], + "maybe": [], + "import_files": [ + "src/map/slice.rs" + ], + "recall": null, + "precision": null, + "recall_with_maybe": null + }, + { + "symbol": "indexmap::rayon::set::IndexSet::par_is_superset", + "truth": [], + "found": [], + "maybe": [], + "import_files": [ + "src/rayon/set.rs" + ], + "recall": null, + "precision": null, + "recall_with_maybe": null + }, + { + "symbol": "indexmap::util::assert_index_le", + "truth": [ + "indexmap::inner::Core::split_off", + "indexmap::map::IndexMap::insert_before", + "indexmap::map::IndexMap::shift_insert" + ], + "found": [ + "indexmap::inner::Core::split_off", + "indexmap::map::IndexMap::insert_before", + "indexmap::map::IndexMap::shift_insert" + ], + "maybe": [], + "import_files": [ + "src/inner.rs", + "src/map.rs" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "indexmap::map::slice::Slice::split_first_mut", + "truth": [], + "found": [], + "maybe": [], + "import_files": [ + "src/map/slice.rs" + ], + "recall": null, + "precision": null, + "recall_with_maybe": null + }, + { + "symbol": "indexmap::util::third", + "truth": [ + "indexmap::map::IndexMap::shift_remove", + "indexmap::map::IndexMap::swap_remove" + ], + "found": [ + "indexmap::map::IndexMap::shift_remove", + "indexmap::map::IndexMap::swap_remove" + ], + "maybe": [], + "import_files": [ + "src/map.rs" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "indexmap::rayon::map::IndexMap::par_sort_unstable_keys", + "skipped": "compiler reported no uses" + }, + { + "symbol": "indexmap::rayon::set::IndexSet::par_union", + "truth": [], + "found": [], + "maybe": [], + "import_files": [ + "src/rayon/set.rs" + ], + "recall": null, + "precision": null, + "recall_with_maybe": null + }, + { + "symbol": "indexmap::map::raw_entry_v1::RawVacantEntryMut::shift_insert_hashed_nocheck", + "truth": [ + "indexmap::map::raw_entry_v1::RawVacantEntryMut::shift_insert" + ], + "found": [ + "indexmap::map::raw_entry_v1::RawVacantEntryMut::shift_insert" + ], + "maybe": [], + "import_files": [], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "indexmap::map::slice::Slice::from_mut_slice", + "truth": [ + "indexmap::map::IndexMap::as_mut_slice", + "indexmap::map::IndexMap::get_range_mut", + "indexmap::map::iter::IntoIter::as_mut_slice", + "indexmap::map::iter::IterMut2::into_slice", + "indexmap::map::iter::IterMut::into_slice", + "indexmap::map::slice::Slice::default", + "indexmap::map::slice::Slice::get_range_mut", + "indexmap::map::slice::Slice::new_mut", + "indexmap::map::slice::Slice::split_at_mut", + "indexmap::map::slice::Slice::split_at_mut_checked", + "indexmap::map::slice::Slice::split_first_mut", + "indexmap::map::slice::Slice::split_last_mut", + "indexmap::map::slice::impl_index" + ], + "found": [ + "indexmap::map::IndexMap::as_mut_slice", + "indexmap::map::IndexMap::get_range_mut", + "indexmap::map::iter::IntoIter::as_mut_slice", + "indexmap::map::iter::IterMut2::into_slice", + "indexmap::map::iter::IterMut::into_slice", + "indexmap::map::slice::Slice::default", + "indexmap::map::slice::Slice::get_range_mut", + "indexmap::map::slice::Slice::new_mut", + "indexmap::map::slice::Slice::split_at_mut", + "indexmap::map::slice::Slice::split_at_mut_checked", + "indexmap::map::slice::Slice::split_first_mut", + "indexmap::map::slice::Slice::split_last_mut" + ], + "maybe": [], + "import_files": [], + "recall": 0.9230769230769231, + "precision": 1.0, + "recall_with_maybe": 0.9230769230769231 + }, + { + "symbol": "indexmap::set::IndexSet::swap_take", + "truth": [ + "indexmap::set::IndexSet::take" + ], + "found": [ + "indexmap::set::IndexSet::take" + ], + "maybe": [], + "import_files": [ + "src/set/tests.rs" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + }, + { + "symbol": "indexmap::map::IndexMap::get_disjoint_indices_mut", + "truth": [], + "found": [], + "maybe": [], + "import_files": [ + "src/map/tests.rs" + ], + "recall": null, + "precision": null, + "recall_with_maybe": null + }, + { + "symbol": "indexmap::set::IndexSet::is_superset", + "truth": [], + "found": [], + "maybe": [], + "import_files": [ + "src/set/tests.rs" + ], + "recall": null, + "precision": null, + "recall_with_maybe": null + }, + { + "symbol": "indexmap::rayon::set::IndexSet::par_sort", + "skipped": "compiler reported no uses" + }, + { + "symbol": "indexmap::set::IndexSet::intersection", + "truth": [ + "indexmap::rayon::set::ParIntersection::fmt", + "indexmap::set::IndexSet::bitand" + ], + "found": [ + "indexmap::rayon::set::ParIntersection::fmt", + "indexmap::set::IndexSet::bitand" + ], + "maybe": [], + "import_files": [ + "src/set/tests.rs" + ], + "recall": 1.0, + "precision": 1.0, + "recall_with_maybe": 1.0 + } + ], + "rename": [ + { + "symbol": "indexmap::map::IndexMap::sort_unstable_keys", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "indexmap::set::IndexSet::is_subset", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "indexmap::serde::cautious_capacity", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "indexmap::set::IndexSet::difference", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "src/inner/entry.rs:82: /// difference if the key type has any distinguishing features outside of `Hash` and `Eq`, like\nsrc/map/raw_entry_v1.rs:387: /// difference if the key type has any distinguishing features outside of `Hash` and `Eq`, like\nsrc/map/raw_entry_v1.rs:396: /// difference if ", + "detail": "" + }, + { + "symbol": "indexmap::benches::bench::simple_sort", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "indexmap::map::raw_entry_v1::RawEntryBuilder::index_from_hash", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "indexmap::inner::Core::split_splice", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "indexmap::inner::extract::ExtractCore::remaining", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "src/inner/extract.rs:52: // Nothing was extracted, so any remaining items can be left in place.\nsrc/inner/extract.rs:55: // Need to shift the remaining items down.\nsrc/map.rs:328: /// or the iteration short-circuits, then the remaining elements will be retained.\nsrc/", + "detail": "" + }, + { + "symbol": "indexmap::map::raw_entry_v1::RawOccupiedEntryMut::into_key_value_mut", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "indexmap::map::IndexMap::sort_keys", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "indexmap::map::raw_entry_v1::RawVacantEntryMut::insert_hashed_nocheck", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "indexmap::set::IndexSet::contains", + "ok": false, + "compiled": false, + "tests_ok": null, + "tests_failed": [], + "old_name_left": "src/map.rs:233: /// Returns true if the map contains no elements.\nsrc/map/disjoint.rs:17: } else if indices[..i].contains(&idx) {\nsrc/map/disjoint.rs:43: } else if indices[..i].contains(&Some(idx)) {\nsrc/map/raw_entry_v1.rs:91: /// so that the map now contains keys which comp", + "detail": "be used if the trait is implemented and in scope\n = note: the following traits define an item `contains`, perhaps you need to implement one of them:\n candidate #1: `Itertools`\n candidate #2: `core::ops::RangeBounds`\nhelp: there is a method `contains_gnx` with a similar name\n |\n382 | .filter(move |&item| set2.contains_gnx(item))\n | ++++\n\nerror: could not compile `indexmap` (lib test) due to 2 previous errors\n" + }, + { + "symbol": "indexmap::util::simplify_range", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "indexmap::rayon::set::IndexSet::par_is_subset", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "indexmap::map::disjoint::get_disjoint_opt_mut", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "indexmap::set::IndexSet::union", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "LICENSE-APACHE:15: \"Legal Entity\" shall mean the union of the acting entity and all\nsrc/rayon/set.rs:435:/// A parallel iterator producing elements in the union of [`IndexSet`]s.\nsrc/set.rs:1432: /// Returns the set union, cloned into a new set.\nsrc/set/iter.rs:439:/// A lazy iterator producing", + "detail": "" + }, + { + "symbol": "indexmap::util::assert_index_lt", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "indexmap::util::try_simplify_range", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "indexmap::inner::Core::shift_insert_unique", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "indexmap::set::IndexSet::swap_take", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "src/set/tests.rs:600:fn swap_take() {", + "detail": "" + }, + { + "symbol": "indexmap::inner::Core::replace_index_unique", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "indexmap::map::IndexMap::contains_key", + "ok": false, + "compiled": false, + "tests_ok": null, + "tests_failed": [], + "old_name_left": "", + "detail": "|\n651 | assert!(b.contains_key_gnx(key), \"b does not contain {:?}\", key);\n | ^^^^^^^^^^^^^^^^\n |\nhelp: there is a method `contains_key` with a similar name\n |\n651 - assert!(b.contains_key_gnx(key), \"b does not contain {:?}\", key);\n651 + assert!(b.contains_key(key), \"b does not contain {:?}\", key);\n |\n\nFor more information about this error, try `rustc --explain E0599`.\nerror: could not compile `indexmap` (test \"quick\") due to 1 previous error\n" + }, + { + "symbol": "indexmap::inner::Core::retain_in_order", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "indexmap::rayon::set::IndexSet::par_difference", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "indexmap::inner::Core::get_index_of_raw", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "indexmap::map::slice::Slice::from_mut_slice", + "ok": false, + "compiled": false, + "tests_ok": null, + "tests_failed": [], + "old_name_left": "src/map/slice.rs:527: Slice::from_mut_slice(&mut self.as_entries_mut()[range])\nsrc/map/slice.rs:541: Self::from_mut_slice(&mut self.entries[range])", + "detail": "eFull,\n... |\n553 | | (Bound, Bound)\n554 | | );\n | |_- in this macro invocation\n |\n = note: this error originates in the macro `impl_index` (in Nightly builds, run with -Z macro-backtrace for more info)\n\nFor more information about this error, try `rustc --explain E0599`.\nerror: could not compile `indexmap` (lib) due to 14 previous errors\nwarning: build failed, waiting for other jobs to finish...\nerror: could not compile `indexmap` (lib test) due to 14 previous errors\n" + }, + { + "symbol": "indexmap::set::IndexSet::intersection", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "src/rayon/set.rs:339:/// A parallel iterator producing elements in the intersection of [`IndexSet`]s.\nsrc/set.rs:1416: /// Returns the set intersection, cloned into a new set.\nsrc/set/iter.rs:267:/// A lazy iterator producing elements in the intersection of [`IndexSet`]s.", + "detail": "" + }, + { + "symbol": "indexmap::util::third", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "LICENSE-APACHE:115: wherever such third-party notices normally appear. The contents\nLICENSE-APACHE:187: identification within third-party archives.", + "detail": "" + }, + { + "symbol": "indexmap::util::assert_index_le", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "indexmap::map::raw_entry_v1::RawVacantEntryMut::shift_insert_hashed_nocheck", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "indexmap::map::IndexMap::get_index_entry", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "src/map/tests.rs:413:fn get_index_entry() {", + "detail": "" + }, + { + "symbol": "indexmap::set::IndexSet::symmetric_difference", + "ok": true, + "compiled": true, + "tests_ok": true, + "tests_failed": [], + "old_name_left": "", + "detail": "" + }, + { + "symbol": "indexmap::util::slice_eq", + "ok": false, + "compiled": false, + "tests_ok": null, + "tests_failed": [], + "old_name_left": "src/map/slice.rs:450: slice_eq(self, &other.entries, |t, b| t.0 == b.key && t.1 == b.value)\nsrc/set/slice.rs:297: slice_eq(self, &other.entries, |o, b| *o == b.key)", + "detail": "q(self, &other.entries, |o, b| *o == b.key)\n | ^^^^^^^^------------------------------------------\n | |\n | help: try calling `slice_eq` as a method: `self.slice_eq(&other.entries, |o, b| *o == b.key)`\n\nFor more information about this error, try `rustc --explain E0425`.\nerror: could not compile `indexmap` (lib) due to 2 previous errors\nwarning: build failed, waiting for other jobs to finish...\nerror: could not compile `indexmap` (lib test) due to 2 previous errors\n" + } + ], + "mutants": { + "7": [ + "indexmap::map::IndexMap::sort_unstable_keys", + "indexmap::set::IndexSet::is_subset", + "indexmap::serde::cautious_capacity", + "indexmap::set::IndexSet::difference", + "indexmap::benches::bench::simple_sort", + "indexmap::map::raw_entry_v1::RawEntryBuilder::index_from_hash", + "indexmap::inner::Core::split_splice", + "indexmap::inner::extract::ExtractCore::remaining", + "indexmap::map::raw_entry_v1::RawOccupiedEntryMut::into_key_value_mut", + "indexmap::map::IndexMap::sort_keys", + "indexmap::map::raw_entry_v1::RawVacantEntryMut::insert_hashed_nocheck", + "indexmap::set::IndexSet::contains", + "indexmap::util::simplify_range", + "indexmap::rayon::set::IndexSet::par_is_subset", + "indexmap::map::disjoint::get_disjoint_opt_mut", + "indexmap::set::IndexSet::union" + ], + "8": [ + "indexmap::set::IndexSet::union", + "indexmap::inner::Core::replace_index_unique", + "indexmap::map::IndexMap::contains_key", + "indexmap::benches::bench::simple_sort", + "indexmap::inner::Core::retain_in_order", + "indexmap::map::raw_entry_v1::RawOccupiedEntryMut::into_key_value_mut", + "indexmap::serde::cautious_capacity", + "indexmap::rayon::set::IndexSet::par_difference", + "indexmap::map::IndexMap::sort_keys", + "indexmap::inner::Core::shift_insert_unique", + "indexmap::set::IndexSet::is_subset", + "indexmap::map::raw_entry_v1::RawEntryBuilder::index_from_hash", + "indexmap::inner::Core::get_index_of_raw", + "indexmap::util::try_simplify_range", + "indexmap::rayon::set::IndexSet::par_is_subset", + "indexmap::map::slice::Slice::from_mut_slice" + ], + "9": [ + "indexmap::util::assert_index_le", + "indexmap::util::third", + "indexmap::map::raw_entry_v1::RawVacantEntryMut::shift_insert_hashed_nocheck", + "indexmap::map::slice::Slice::from_mut_slice", + "indexmap::rayon::set::IndexSet::par_difference", + "indexmap::set::IndexSet::swap_take", + "indexmap::inner::Core::split_splice", + "indexmap::set::IndexSet::intersection", + "indexmap::map::raw_entry_v1::RawOccupiedEntryMut::into_key_value_mut", + "indexmap::map::IndexMap::sort_unstable_keys", + "indexmap::set::IndexSet::union" + ] + }, + "tests": [ + { + "symbol": "indexmap::map::IndexMap::sort_unstable_keys", + "level": "name", + "truth": 1, + "predicted": 7, + "recall": 1.0, + "precision": 0.14285714285714285, + "top_hits": 1, + "top_n": 7, + "top_precision": 0.14285714285714285, + "top_best": 0.14285714285714285, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "indexmap::set::IndexSet::is_subset", + "level": "name", + "truth": 4, + "predicted": 5, + "recall": 0.5, + "precision": 0.4, + "top_hits": 2, + "top_n": 5, + "top_precision": 0.4, + "top_best": 0.4, + "caught": 1.0, + "missed": [ + "from_array", + "ops" + ], + "recall_graph_only": 0.25 + }, + { + "symbol": "indexmap::serde::cautious_capacity", + "skipped": "no test fails when it throws", + "predicted": 0 + }, + { + "symbol": "indexmap::set::IndexSet::difference", + "level": "name", + "truth": 2, + "predicted": 5, + "recall": 0.5, + "precision": 0.2, + "top_hits": 1, + "top_n": 5, + "top_precision": 0.2, + "top_best": 0.2, + "caught": 1.0, + "missed": [ + "ops" + ], + "recall_graph_only": 0.5 + }, + { + "symbol": "indexmap::benches::bench::simple_sort", + "skipped": "no test fails when it throws", + "predicted": 0 + }, + { + "symbol": "indexmap::map::raw_entry_v1::RawEntryBuilder::index_from_hash", + "skipped": "no test fails when it throws", + "predicted": 1 + }, + { + "symbol": "indexmap::inner::Core::split_splice", + "skipped": "no test fails when it throws", + "predicted": 1 + }, + { + "symbol": "indexmap::inner::extract::ExtractCore::remaining", + "level": "name", + "truth": 2, + "predicted": 0, + "recall": 0.0, + "precision": 0.0, + "top_hits": 0, + "top_n": 0, + "top_precision": 0.0, + "top_best": 0.0, + "caught": 0.0, + "missed": [ + "extract_if_odd", + "extract_if_odd_limit" + ], + "recall_graph_only": 0.0 + }, + { + "symbol": "indexmap::map::raw_entry_v1::RawOccupiedEntryMut::into_key_value_mut", + "skipped": "no test fails when it throws", + "predicted": 1 + }, + { + "symbol": "indexmap::map::IndexMap::sort_keys", + "skipped": "no test fails when it throws", + "predicted": 6 + }, + { + "symbol": "indexmap::map::raw_entry_v1::RawVacantEntryMut::insert_hashed_nocheck", + "skipped": "no test fails when it throws", + "predicted": 1 + }, + { + "symbol": "indexmap::set::IndexSet::contains", + "level": "name", + "truth": 5, + "predicted": 4, + "recall": 0.4, + "precision": 0.5, + "top_hits": 2, + "top_n": 4, + "top_precision": 0.5, + "top_best": 0.5, + "caught": 1.0, + "missed": [ + "from_array", + "iter_comparisons", + "ops" + ], + "recall_graph_only": 0.4 + }, + { + "symbol": "indexmap::util::simplify_range", + "level": "name", + "truth": 6, + "predicted": 6, + "recall": 1.0, + "precision": 1.0, + "top_hits": 6, + "top_n": 6, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "indexmap::rayon::set::IndexSet::par_is_subset", + "skipped": "no test fails when it throws", + "predicted": 5 + }, + { + "symbol": "indexmap::map::disjoint::get_disjoint_opt_mut", + "level": "name", + "truth": 8, + "predicted": 9, + "recall": 1.0, + "precision": 0.8888888888888888, + "top_hits": 8, + "top_n": 9, + "top_precision": 0.8888888888888888, + "top_best": 0.8888888888888888, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "indexmap::set::IndexSet::union", + "level": "name", + "truth": 2, + "predicted": 5, + "recall": 0.5, + "precision": 0.2, + "top_hits": 1, + "top_n": 5, + "top_precision": 0.2, + "top_best": 0.2, + "caught": 1.0, + "missed": [ + "ops" + ], + "recall_graph_only": 0.5 + }, + { + "symbol": "indexmap::inner::Core::replace_index_unique", + "level": "name", + "truth": 2, + "predicted": 4, + "recall": 1.0, + "precision": 0.5, + "top_hits": 2, + "top_n": 4, + "top_precision": 0.5, + "top_best": 0.5, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "indexmap::map::IndexMap::contains_key", + "level": "name", + "truth": 15, + "predicted": 14, + "recall": 0.8, + "precision": 0.8571428571428571, + "top_hits": 10, + "top_n": 10, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [ + "from_array", + "iter_comparisons", + "ops" + ], + "recall_graph_only": 0.8 + }, + { + "symbol": "indexmap::inner::Core::retain_in_order", + "level": "name", + "truth": 2, + "predicted": 3, + "recall": 1.0, + "precision": 0.6666666666666666, + "top_hits": 2, + "top_n": 3, + "top_precision": 0.6666666666666666, + "top_best": 0.6666666666666666, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "indexmap::rayon::set::IndexSet::par_difference", + "skipped": "no test fails when it throws", + "predicted": 5 + }, + { + "symbol": "indexmap::inner::Core::shift_insert_unique", + "level": "name", + "truth": 6, + "predicted": 9, + "recall": 1.0, + "precision": 0.6666666666666666, + "top_hits": 6, + "top_n": 9, + "top_precision": 0.6666666666666666, + "top_best": 0.6666666666666666, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "indexmap::inner::Core::get_index_of_raw", + "skipped": "no test fails when it throws", + "predicted": 1 + }, + { + "symbol": "indexmap::util::try_simplify_range", + "level": "name", + "truth": 3, + "predicted": 3, + "recall": 1.0, + "precision": 1.0, + "top_hits": 3, + "top_n": 3, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "indexmap::map::slice::Slice::from_mut_slice", + "level": "name", + "truth": 13, + "predicted": 13, + "recall": 1.0, + "precision": 1.0, + "top_hits": 10, + "top_n": 10, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "indexmap::util::assert_index_le", + "level": "name", + "truth": 6, + "predicted": 8, + "recall": 1.0, + "precision": 0.75, + "top_hits": 6, + "top_n": 8, + "top_precision": 0.75, + "top_best": 0.75, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "indexmap::util::third", + "level": "name", + "truth": 11, + "predicted": 11, + "recall": 1.0, + "precision": 1.0, + "top_hits": 10, + "top_n": 10, + "top_precision": 1.0, + "top_best": 1.0, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "indexmap::map::raw_entry_v1::RawVacantEntryMut::shift_insert_hashed_nocheck", + "level": "name", + "truth": 1, + "predicted": 2, + "recall": 1.0, + "precision": 0.5, + "top_hits": 1, + "top_n": 2, + "top_precision": 0.5, + "top_best": 0.5, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "indexmap::set::IndexSet::swap_take", + "level": "name", + "truth": 2, + "predicted": 4, + "recall": 1.0, + "precision": 0.5, + "top_hits": 2, + "top_n": 4, + "top_precision": 0.5, + "top_best": 0.5, + "caught": 1.0, + "missed": [], + "recall_graph_only": 1.0 + }, + { + "symbol": "indexmap::set::IndexSet::intersection", + "level": "name", + "truth": 2, + "predicted": 5, + "recall": 0.5, + "precision": 0.2, + "top_hits": 1, + "top_n": 5, + "top_precision": 0.2, + "top_best": 0.2, + "caught": 1.0, + "missed": [ + "ops" + ], + "recall_graph_only": 0.5 + } + ], + "look": [ + { + "symbol": "indexmap::map::IndexMap::sort_unstable_keys", + "look_tokens": 305, + "file_tokens": 16052 + }, + { + "symbol": "indexmap::set::IndexSet::is_subset", + "look_tokens": 266, + "file_tokens": 12371 + }, + { + "symbol": "indexmap::serde::cautious_capacity", + "look_tokens": 263, + "file_tokens": 1111 + }, + { + "symbol": "indexmap::set::IndexSet::difference", + "look_tokens": 291, + "file_tokens": 12371 + }, + { + "symbol": "indexmap::benches::bench::simple_sort", + "look_tokens": 152, + "file_tokens": 4289 + }, + { + "symbol": "indexmap::map::raw_entry_v1::RawEntryBuilder::index_from_hash", + "look_tokens": 197, + "file_tokens": 5897 + }, + { + "symbol": "indexmap::inner::Core::split_splice", + "look_tokens": 258, + "file_tokens": 6263 + }, + { + "symbol": "indexmap::inner::extract::ExtractCore::remaining", + "look_tokens": 111, + "file_tokens": 918 + }, + { + "symbol": "indexmap::map::raw_entry_v1::RawOccupiedEntryMut::into_key_value_mut", + "look_tokens": 195, + "file_tokens": 5897 + }, + { + "symbol": "indexmap::map::IndexMap::sort_keys", + "look_tokens": 335, + "file_tokens": 16052 + }, + { + "symbol": "indexmap::map::raw_entry_v1::RawVacantEntryMut::insert_hashed_nocheck", + "look_tokens": 208, + "file_tokens": 5897 + }, + { + "symbol": "indexmap::set::IndexSet::contains", + "look_tokens": 291, + "file_tokens": 12371 + }, + { + "symbol": "indexmap::util::simplify_range", + "look_tokens": 411, + "file_tokens": 684 + }, + { + "symbol": "indexmap::rayon::set::IndexSet::par_is_subset", + "look_tokens": 265, + "file_tokens": 5574 + }, + { + "symbol": "indexmap::map::disjoint::get_disjoint_opt_mut", + "look_tokens": 539, + "file_tokens": 551 + }, + { + "symbol": "indexmap::set::IndexSet::union", + "look_tokens": 280, + "file_tokens": 12371 + }, + { + "symbol": "indexmap::util::assert_index_lt", + "look_tokens": 349, + "file_tokens": 684 + }, + { + "symbol": "indexmap::util::try_simplify_range", + "look_tokens": 332, + "file_tokens": 684 + }, + { + "symbol": "indexmap::inner::Core::shift_insert_unique", + "look_tokens": 542, + "file_tokens": 6263 + }, + { + "symbol": "indexmap::set::IndexSet::swap_take", + "look_tokens": 308, + "file_tokens": 12371 + }, + { + "symbol": "indexmap::inner::Core::replace_index_unique", + "look_tokens": 347, + "file_tokens": 6263 + }, + { + "symbol": "indexmap::map::IndexMap::contains_key", + "look_tokens": 271, + "file_tokens": 16052 + }, + { + "symbol": "indexmap::inner::Core::retain_in_order", + "look_tokens": 221, + "file_tokens": 6263 + }, + { + "symbol": "indexmap::rayon::set::IndexSet::par_difference", + "look_tokens": 321, + "file_tokens": 5574 + }, + { + "symbol": "indexmap::inner::Core::get_index_of_raw", + "look_tokens": 192, + "file_tokens": 6263 + }, + { + "symbol": "indexmap::map::slice::Slice::from_mut_slice", + "look_tokens": 363, + "file_tokens": 6099 + }, + { + "symbol": "indexmap::set::IndexSet::intersection", + "look_tokens": 281, + "file_tokens": 12371 + }, + { + "symbol": "indexmap::util::third", + "look_tokens": 203, + "file_tokens": 684 + }, + { + "symbol": "indexmap::util::assert_index_le", + "look_tokens": 295, + "file_tokens": 684 + }, + { + "symbol": "indexmap::map::raw_entry_v1::RawVacantEntryMut::shift_insert_hashed_nocheck", + "look_tokens": 302, + "file_tokens": 5897 + }, + { + "symbol": "indexmap::map::IndexMap::get_index_entry", + "look_tokens": 322, + "file_tokens": 16052 + }, + { + "symbol": "indexmap::set::IndexSet::symmetric_difference", + "look_tokens": 323, + "file_tokens": 12371 + }, + { + "symbol": "indexmap::util::slice_eq", + "look_tokens": 238, + "file_tokens": 684 + } + ], + "seconds": 41, + "summary": { + "callers_recall": 0.991, + "callers_precision": 1.0, + "callers_checked": 32, + "blind_recall": 0.996, + "blind_checked": 21, + "common_recall": 0.948, + "common_precision": 1.0, + "common_recall_with_maybe": 1.0, + "common_checked": 29, + "rename_ok": 0.879, + "rename_checked": 33, + "tests_recall": 0.8, + "tests_precision": 0.577, + "tests_top10_precision": 0.585, + "tests_top10_best": 0.585, + "tests_caught": 0.947, + "tests_checked": 19, + "look_vs_file": 0.147 + }, + "summary_seeds": { + "7": { + "callers_recall": 0.989, + "callers_precision": 1.0, + "callers_checked": 19, + "blind_recall": 1.0, + "blind_checked": 9, + "common_recall": 0.969, + "common_precision": 1.0, + "common_recall_with_maybe": 1.0, + "common_checked": 16, + "rename_ok": 0.95, + "rename_checked": 20, + "tests_recall": 0.613, + "tests_precision": 0.416, + "tests_top10_precision": 0.416, + "tests_top10_best": 0.416, + "tests_caught": 0.875, + "tests_checked": 8, + "look_vs_file": 0.17 + }, + "8": { + "callers_recall": 0.985, + "callers_precision": 1.0, + "callers_checked": 19, + "blind_recall": 1.0, + "blind_checked": 9, + "common_recall": 0.9, + "common_precision": 1.0, + "common_recall_with_maybe": 1.0, + "common_checked": 10, + "rename_ok": 0.85, + "rename_checked": 20, + "tests_recall": 0.85, + "tests_precision": 0.661, + "tests_top10_precision": 0.679, + "tests_top10_best": 0.679, + "tests_caught": 1.0, + "tests_checked": 8, + "look_vs_file": 0.13 + }, + "9": { + "callers_recall": 0.986, + "callers_precision": 1.0, + "callers_checked": 20, + "blind_recall": 0.991, + "blind_checked": 9, + "common_recall": 0.909, + "common_precision": 1.0, + "common_recall_with_maybe": 1.0, + "common_checked": 11, + "rename_ok": 0.8, + "rename_checked": 20, + "tests_recall": 0.875, + "tests_precision": 0.537, + "tests_top10_precision": 0.537, + "tests_top10_best": 0.537, + "tests_caught": 1.0, + "tests_checked": 8, + "look_vs_file": 0.11 + } + }, + "noise": { + "callers_recall": { + "mean": 0.991, + "functions": 32, + "boot_lo": 0.979, + "boot_hi": 1.0, + "boot_half": 0.011, + "seeds": [ + 0.989, + 0.985, + 0.986 + ], + "seed_sd": 0.002, + "threshold": 0.04 + }, + "callers_precision": { + "mean": 1.0, + "functions": 32, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.04 + }, + "blind_recall": { + "mean": 0.996, + "functions": 21, + "boot_lo": 0.989, + "boot_hi": 1.0, + "boot_half": 0.005, + "seeds": [ + 1.0, + 1.0, + 0.991 + ], + "seed_sd": 0.005, + "threshold": 0.05 + }, + "common_recall": { + "mean": 0.948, + "functions": 29, + "boot_lo": 0.879, + "boot_hi": 1.0, + "boot_half": 0.06, + "seeds": [ + 0.969, + 0.9, + 0.909 + ], + "seed_sd": 0.037, + "threshold": 0.07 + }, + "common_recall_with_maybe": { + "mean": 1.0, + "functions": 29, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.04 + }, + "common_precision": { + "mean": 1.0, + "functions": 28, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.04 + }, + "rename_ok": { + "mean": 0.879, + "functions": 33, + "boot_lo": 0.788, + "boot_hi": 0.97, + "boot_half": 0.091, + "seeds": [ + 0.95, + 0.85, + 0.8 + ], + "seed_sd": 0.076, + "threshold": 0.1 + }, + "tests_recall": { + "mean": 0.8, + "functions": 19, + "boot_lo": 0.679, + "boot_hi": 0.905, + "boot_half": 0.113, + "seeds": [ + 0.613, + 0.85, + 0.875 + ], + "seed_sd": 0.145, + "threshold": 0.12 + }, + "tests_precision": { + "mean": 0.577, + "functions": 19, + "boot_lo": 0.451, + "boot_hi": 0.699, + "boot_half": 0.124, + "seeds": [ + 0.416, + 0.661, + 0.537 + ], + "seed_sd": 0.122, + "threshold": 0.13 + }, + "tests_top10_precision": { + "mean": 0.585, + "functions": 19, + "boot_lo": 0.456, + "boot_hi": 0.708, + "boot_half": 0.126, + "seeds": [ + 0.416, + 0.679, + 0.537 + ], + "seed_sd": 0.132, + "threshold": 0.13 + }, + "tests_top10_best": { + "mean": 0.585, + "functions": 19, + "boot_lo": 0.456, + "boot_hi": 0.708, + "boot_half": 0.126, + "seeds": [ + 0.416, + 0.679, + 0.537 + ], + "seed_sd": 0.132, + "threshold": 0.13 + }, + "tests_caught": { + "mean": 0.947, + "functions": 19, + "boot_lo": 0.842, + "boot_hi": 1.0, + "boot_half": 0.079, + "seeds": [ + 0.875, + 1.0, + 1.0 + ], + "seed_sd": 0.072, + "threshold": 0.08 + }, + "look_vs_file": { + "mean": 0.147, + "functions": 33, + "boot_lo": 0.088, + "boot_hi": 0.216, + "boot_half": 0.064, + "seeds": [ + 0.17, + 0.13, + 0.11 + ], + "seed_sd": 0.03, + "threshold": 0.07 + } + } + } +] \ No newline at end of file diff --git a/eval/results/lsp-refined.md b/eval/results/lsp-refined.md new file mode 100644 index 0000000..fd7cb36 --- /dev/null +++ b/eval/results/lsp-refined.md @@ -0,0 +1,43 @@ +| repo | lang | symbols | index s | callers recall | callers precision | callers recall, picked blind | shared names: recall (+maybe) | shared names: precision | rename ok | tests recall | tests precision | top-10 fail (best possible) | caught by top-10 | look / file | +|---|---|---:|---:|---:|---:|---:|---:|---:|---:|---:|---:|---:|---:|---:| +| cobra | go | 288 | 0.0 | 100% ±3 (45) | 99% ±3 | 100% ±4 (31) | 100% ±100 (100% ±100) (1) | 100% ±100 | 91% ±7 (46) | 89% ±10 (21) | 36% ±13 | 44% ±14 (78% ±12) | 81% ±15 | 7% ±3 | +| chi | go | 351 | 0.0 | 100% ±4 (26) | 97% ±5 | 100% ±12 (9) | 100% ±10 (100% ±10) (10) | 100% ±10 | 94% ±6 (35) | 64% ±16 (16) | 60% ±18 | 66% ±17 (67% ±17) | 88% ±13 | 22% ±7 | +| semver | rust | 113 | 0.0 | 100% ±20 (5) | 100% ±20 | 100% ±20 (5) | 100% ±50 (100% ±50) (2) | 100% ±50 | 100% ±20 (5) | 61% ±34 (3) | 64% ±34 | 67% ±34 (67% ±34) | 67% ±34 | 15% ±9 | +| indexmap | rust | 1026 | 0.1 | 99% ±4 (32) | 100% ±4 | 100% ±5 (21) | 95% ±7 (100% ±4) (29) | 100% ±4 | 88% ±10 (33) | 80% ±12 (19) | 58% ±13 | 58% ±13 (58% ±13) | 95% ±8 | 15% ±7 | + +`77% ±6 (20)`: the mean over 20 functions; a change smaller than ±6 points is noise. The ± is half the 90% interval +the number stays in when the functions are drawn again (bootstrap), and never less than what one function weighs. + +| per language | all | go | rust | +|---|---:|---:|---:| +| callers recall | 100% ±1 (108) | 100% ±2 (71) | 99% ±3 (37) | +| callers precision | 99% ±2 (108) | 98% ±2 (71) | 100% ±3 (37) | +| callers recall, picked blind | 100% ±2 (66) | 100% ±3 (40) | 100% ±4 (26) | +| shared names: recall | 96% ±5 (42) | 100% ±10 (11) | 95% ±6 (31) | +| shared names: recall with maybe | 100% ±3 (42) | 100% ±10 (11) | 100% ±4 (31) | +| shared names: precision | 100% ±3 (41) | 100% ±10 (11) | 100% ±4 (30) | +| rename ok (tests pass) | 92% ±5 (119) | 93% ±5 (81) | 90% ±8 (38) | +| tests recall | 78% ±8 (59) | 78% ±10 (37) | 77% ±12 (22) | +| tests precision | 51% ±9 (59) | 47% ±11 (37) | 59% ±12 (22) | +| top-10 that fail | 56% ±9 (59) | 54% ±11 (37) | 60% ±13 (22) | +| … best possible order | 68% ±8 (59) | 73% ±10 (37) | 60% ±13 (22) | +| caught by the top 10 | 86% ±8 (59) | 84% ±10 (37) | 91% ±10 (22) | +| look / file | 14% ±4 (119) | 14% ±4 (81) | 15% ±6 (38) | + +| all repos | mean | functions | 90% interval | on each seed | 2 × SD of the seeds | threshold | +|---|---:|---:|---:|---:|---:|---:| +| callers recall | 99.7% | 108 | 99–100% | 100 / 100 / 100 | 0.2 | ±1 | +| callers precision | 98.8% | 108 | 98–100% | 98 / 100 / 99 | 2.2 | ±2 | +| callers recall, picked blind | 99.9% | 66 | 100–100% | 100 / 100 / 100 | 0.4 | ±2 | +| shared names: recall | 96.4% | 42 | 92–100% | 98 / 96 / 96 | 3.0 | ±5 | +| shared names: recall with maybe | 100.0% | 42 | 100–100% | 100 / 100 / 100 | 0.0 | ±3 | +| shared names: precision | 100.0% | 41 | 100–100% | 100 / 100 / 100 | 0.0 | ±3 | +| rename ok (tests pass) | 91.6% | 119 | 87–96% | 95 / 94 / 86 | 9.8 | ±5 | +| tests recall | 77.9% | 59 | 71–85% | 68 / 79 / 79 | 13.0 | ±8 | +| tests precision | 51.1% | 59 | 43–59% | 53 / 51 / 53 | 2.0 | ±9 | +| top-10 that fail | 55.9% | 59 | 48–64% | 55 / 57 / 58 | 2.8 | ±9 | +| … best possible order | 68.3% | 59 | 61–76% | 66 / 67 / 66 | 1.4 | ±8 | +| caught by the top 10 | 86.4% | 59 | 78–93% | 78 / 82 / 96 | 19.6 | ±8 | +| look / file | 14.0% | 119 | 11–17% | 16 / 16 / 13 | 3.4 | ±4 | + +Sample `n20-m8-seeds7,8,9`: 20 functions and 8 mutants per repo and seed, seeds 7, 8, 9. Run time: 8 min 49 s; of the compilers' and test suites' answers 512 came from the cache, 37 were asked now. diff --git a/eval/results/lsp-refined.noise.json b/eval/results/lsp-refined.noise.json new file mode 100644 index 0000000..9b5cac5 --- /dev/null +++ b/eval/results/lsp-refined.noise.json @@ -0,0 +1,562 @@ +{ + "config": "n20-m8-seeds7,8,9", + "seconds": 529, + "truth": { + "cached": 512, + "asked": 37 + }, + "scopes": { + "all": { + "callers_recall": { + "mean": 0.997, + "functions": 108, + "boot_lo": 0.994, + "boot_hi": 1.0, + "boot_half": 0.003, + "seeds": [ + 0.997, + 0.995, + 0.995 + ], + "seed_sd": 0.001, + "threshold": 0.01 + }, + "callers_precision": { + "mean": 0.988, + "functions": 108, + "boot_lo": 0.975, + "boot_hi": 0.998, + "boot_half": 0.012, + "seeds": [ + 0.979, + 1.0, + 0.987 + ], + "seed_sd": 0.011, + "threshold": 0.02 + }, + "blind_recall": { + "mean": 0.999, + "functions": 66, + "boot_lo": 0.997, + "boot_hi": 1.0, + "boot_half": 0.002, + "seeds": [ + 1.0, + 1.0, + 0.997 + ], + "seed_sd": 0.002, + "threshold": 0.02 + }, + "common_recall": { + "mean": 0.964, + "functions": 42, + "boot_lo": 0.917, + "boot_hi": 1.0, + "boot_half": 0.042, + "seeds": [ + 0.983, + 0.955, + 0.958 + ], + "seed_sd": 0.015, + "threshold": 0.05 + }, + "common_recall_with_maybe": { + "mean": 1.0, + "functions": 42, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.03 + }, + "common_precision": { + "mean": 1.0, + "functions": 41, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.03 + }, + "rename_ok": { + "mean": 0.916, + "functions": 119, + "boot_lo": 0.874, + "boot_hi": 0.958, + "boot_half": 0.042, + "seeds": [ + 0.954, + 0.938, + 0.862 + ], + "seed_sd": 0.049, + "threshold": 0.05 + }, + "tests_recall": { + "mean": 0.779, + "functions": 59, + "boot_lo": 0.706, + "boot_hi": 0.85, + "boot_half": 0.072, + "seeds": [ + 0.675, + 0.789, + 0.788 + ], + "seed_sd": 0.065, + "threshold": 0.08 + }, + "tests_precision": { + "mean": 0.511, + "functions": 59, + "boot_lo": 0.428, + "boot_hi": 0.591, + "boot_half": 0.081, + "seeds": [ + 0.528, + 0.512, + 0.53 + ], + "seed_sd": 0.01, + "threshold": 0.09 + }, + "tests_top10_precision": { + "mean": 0.559, + "functions": 59, + "boot_lo": 0.476, + "boot_hi": 0.643, + "boot_half": 0.084, + "seeds": [ + 0.549, + 0.571, + 0.576 + ], + "seed_sd": 0.014, + "threshold": 0.09 + }, + "tests_top10_best": { + "mean": 0.683, + "functions": 59, + "boot_lo": 0.607, + "boot_hi": 0.759, + "boot_half": 0.076, + "seeds": [ + 0.664, + 0.671, + 0.658 + ], + "seed_sd": 0.007, + "threshold": 0.08 + }, + "tests_caught": { + "mean": 0.864, + "functions": 59, + "boot_lo": 0.78, + "boot_hi": 0.932, + "boot_half": 0.076, + "seeds": [ + 0.778, + 0.815, + 0.963 + ], + "seed_sd": 0.098, + "threshold": 0.08 + }, + "look_vs_file": { + "mean": 0.14, + "functions": 119, + "boot_lo": 0.11, + "boot_hi": 0.172, + "boot_half": 0.031, + "seeds": [ + 0.162, + 0.156, + 0.129 + ], + "seed_sd": 0.017, + "threshold": 0.04 + } + }, + "go": { + "callers_recall": { + "mean": 1.0, + "functions": 71, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.02 + }, + "callers_precision": { + "mean": 0.982, + "functions": 71, + "boot_lo": 0.961, + "boot_hi": 0.996, + "boot_half": 0.018, + "seeds": [ + 0.964, + 1.0, + 0.978 + ], + "seed_sd": 0.018, + "threshold": 0.02 + }, + "blind_recall": { + "mean": 1.0, + "functions": 40, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.03 + }, + "common_recall": { + "mean": 1.0, + "functions": 11, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.1 + }, + "common_recall_with_maybe": { + "mean": 1.0, + "functions": 11, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.1 + }, + "common_precision": { + "mean": 1.0, + "functions": 11, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.1 + }, + "rename_ok": { + "mean": 0.926, + "functions": 81, + "boot_lo": 0.877, + "boot_hi": 0.975, + "boot_half": 0.049, + "seeds": [ + 0.95, + 0.975, + 0.875 + ], + "seed_sd": 0.052, + "threshold": 0.05 + }, + "tests_recall": { + "mean": 0.782, + "functions": 37, + "boot_lo": 0.688, + "boot_hi": 0.87, + "boot_half": 0.091, + "seeds": [ + 0.719, + 0.791, + 0.777 + ], + "seed_sd": 0.039, + "threshold": 0.1 + }, + "tests_precision": { + "mean": 0.467, + "functions": 37, + "boot_lo": 0.36, + "boot_hi": 0.571, + "boot_half": 0.105, + "seeds": [ + 0.563, + 0.413, + 0.507 + ], + "seed_sd": 0.076, + "threshold": 0.11 + }, + "tests_top10_precision": { + "mean": 0.537, + "functions": 37, + "boot_lo": 0.432, + "boot_hi": 0.641, + "boot_half": 0.104, + "seeds": [ + 0.593, + 0.498, + 0.579 + ], + "seed_sd": 0.051, + "threshold": 0.11 + }, + "tests_top10_best": { + "mean": 0.734, + "functions": 37, + "boot_lo": 0.636, + "boot_hi": 0.829, + "boot_half": 0.096, + "seeds": [ + 0.787, + 0.667, + 0.716 + ], + "seed_sd": 0.06, + "threshold": 0.1 + }, + "tests_caught": { + "mean": 0.838, + "functions": 37, + "boot_lo": 0.73, + "boot_hi": 0.919, + "boot_half": 0.095, + "seeds": [ + 0.75, + 0.75, + 1.0 + ], + "seed_sd": 0.144, + "threshold": 0.1 + }, + "look_vs_file": { + "mean": 0.137, + "functions": 81, + "boot_lo": 0.102, + "boot_hi": 0.175, + "boot_half": 0.037, + "seeds": [ + 0.16, + 0.169, + 0.136 + ], + "seed_sd": 0.017, + "threshold": 0.04 + } + }, + "rust": { + "callers_recall": { + "mean": 0.993, + "functions": 37, + "boot_lo": 0.982, + "boot_hi": 1.0, + "boot_half": 0.009, + "seeds": [ + 0.992, + 0.988, + 0.989 + ], + "seed_sd": 0.002, + "threshold": 0.03 + }, + "callers_precision": { + "mean": 1.0, + "functions": 37, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.03 + }, + "blind_recall": { + "mean": 0.997, + "functions": 26, + "boot_lo": 0.991, + "boot_hi": 1.0, + "boot_half": 0.004, + "seeds": [ + 1.0, + 1.0, + 0.995 + ], + "seed_sd": 0.003, + "threshold": 0.04 + }, + "common_recall": { + "mean": 0.952, + "functions": 31, + "boot_lo": 0.887, + "boot_hi": 1.0, + "boot_half": 0.056, + "seeds": [ + 0.972, + 0.909, + 0.923 + ], + "seed_sd": 0.033, + "threshold": 0.06 + }, + "common_recall_with_maybe": { + "mean": 1.0, + "functions": 31, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.04 + }, + "common_precision": { + "mean": 1.0, + "functions": 30, + "boot_lo": 1.0, + "boot_hi": 1.0, + "boot_half": 0.0, + "seeds": [ + 1.0, + 1.0, + 1.0 + ], + "seed_sd": 0.0, + "threshold": 0.04 + }, + "rename_ok": { + "mean": 0.895, + "functions": 38, + "boot_lo": 0.816, + "boot_hi": 0.974, + "boot_half": 0.079, + "seeds": [ + 0.96, + 0.88, + 0.84 + ], + "seed_sd": 0.061, + "threshold": 0.08 + }, + "tests_recall": { + "mean": 0.774, + "functions": 22, + "boot_lo": 0.656, + "boot_hi": 0.882, + "boot_half": 0.113, + "seeds": [ + 0.612, + 0.785, + 0.803 + ], + "seed_sd": 0.105, + "threshold": 0.12 + }, + "tests_precision": { + "mean": 0.586, + "functions": 22, + "boot_lo": 0.467, + "boot_hi": 0.704, + "boot_half": 0.118, + "seeds": [ + 0.476, + 0.655, + 0.564 + ], + "seed_sd": 0.089, + "threshold": 0.12 + }, + "tests_top10_precision": { + "mean": 0.596, + "functions": 22, + "boot_lo": 0.475, + "boot_hi": 0.716, + "boot_half": 0.12, + "seeds": [ + 0.485, + 0.676, + 0.572 + ], + "seed_sd": 0.096, + "threshold": 0.13 + }, + "tests_top10_best": { + "mean": 0.596, + "functions": 22, + "boot_lo": 0.475, + "boot_hi": 0.716, + "boot_half": 0.12, + "seeds": [ + 0.485, + 0.676, + 0.572 + ], + "seed_sd": 0.096, + "threshold": 0.13 + }, + "tests_caught": { + "mean": 0.909, + "functions": 22, + "boot_lo": 0.818, + "boot_hi": 1.0, + "boot_half": 0.091, + "seeds": [ + 0.818, + 0.909, + 0.909 + ], + "seed_sd": 0.052, + "threshold": 0.1 + }, + "look_vs_file": { + "mean": 0.148, + "functions": 38, + "boot_lo": 0.095, + "boot_hi": 0.207, + "boot_half": 0.056, + "seeds": [ + 0.166, + 0.134, + 0.119 + ], + "seed_sd": 0.024, + "threshold": 0.06 + } + } + } +} \ No newline at end of file diff --git a/eval/run.py b/eval/run.py index 0dd520f..13b6405 100644 --- a/eval/run.py +++ b/eval/run.py @@ -1099,6 +1099,8 @@ def main() -> None: "eval/results) instead of drawing them again: the sample asks gitnext, so a change of the graph\n" "would move it. Then --compare pairs every function. Same --seeds as that run") ap.add_argument("--repos", default="", help="comma-separated names (default: all)") + ap.add_argument("--repos-file", default="repos.json", help="the list of projects, a file in eval/ (default: repos.json; " + "repos-heldout.json: projects that took no part in tuning the tool)") ap.add_argument("--n", type=int, default=20, help="functions sampled per repo and seed") ap.add_argument("--mutants", type=int, default=8, help="of those, how many get the test-suite check (one that cannot be\n" "measured is replaced by the next of the sample; at most twice as many are tried)") @@ -1124,7 +1126,7 @@ def main() -> None: SAMPLE_FROM = {r["repo"]: r for r in _load_run(args.sample_from) if "error" not in r} seeds = [args.seed] if args.seed is not None else [int(x) for x in args.seeds.split(",") if x.strip()] cfg = f"n{args.n}-m{args.mutants}-seeds{','.join(map(str, seeds))}" # a baseline belongs to one sample - repos = json.loads((HERE / "repos.json").read_text()) + repos = json.loads((HERE / args.repos_file).read_text()) if args.repos: want = set(args.repos.split(",")) repos = [r for r in repos if r["name"] in want]