Repository navigation
Conversation
Keep one current, reproducible result set per model and device, and remove the measurements that newer runs replaced and the notes that only recorded how a result was produced. - Replace the September 7 aggregate in the benchmark index with a latest-results table per model and device, refresh the coverage gaps, and drop the H200 engine-mechanism section and the October 14 prefix GELU note. - Remove the pi0.5 Thor and RTX 4090 quantization replays and the early 1,600-frame rows that the November presets supersede, and add the AGX Orin tuned-kernel result. - Delete the August 3B-navigation evaluation reports; qwenvl-benchmark holds the newer latency results for the same models. - Condense the ActiveVLN, GR00T and other model READMEs to results, conditions and commands, without rejected candidates, local report paths, snapshot archives or checksum lists. - Name the VLN device sections by protocol and date, and add the VLN and RLinf tables to the Chinese README. Signed-off-by: longxmas <1185267696@qq.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Keep one current, reproducible result set per model and device. Remove measurements that newer runs replaced, and notes that only recorded how a result was produced. H200 numbers are not kept in the published benchmark index.
Summary
docs/{en,zh}/benchmark.mdwith a latest-results table (one row per model × device), refresh coverage gaps, and drop the H200 engine-mechanism section and the October 14 prefix GELU note.3B-navigationevaluation reports; latency for those models now points atqwenvl-benchmark.reports/paths, snapshot tars or checksum lists).README.zh-CN.md; fix related anchors indocs/{en,zh}/api.md.Type of change
Verification
Docs-only change; no CUDA or weight runs.
Engine invariants
through
ActionDecoder/RLDecoderand the shared metadata.intentional difference is documented with numbers.
uv.lockis consistent.use the versioned API.
Checklist
commit policy,
and every author/coauthor has supplied their own DCO
Signed-off-by.CONTRIBUTING.mdand have a design document under
docs/proposals/(N/A: no new model).docs/en/benchmark.mdare updated when they change.
addresses, private paths, or machine-specific scripts are included.
CONTRIBUTING.md.