Repository navigation
docs: 1bit ort-run and ort_run share one parser; a pack's *.onnx may need vendor op domains (Fixes #2000) - #2004
bong-water-water-bong wants to merge 1 commit into
Conversation
…need vendor op domains (refs #2000) #2000 found two documentation gaps while measuring a 1.9 pack. 1. docs/onnx.md now says the two entry points are one function (onebit_ort_run_main; app/main.cpp passes argv through unchanged). Both take --input/--output/--dump-all, which have been there since #1406. The differences are build-side: `1bit ort-run` needs -DONEBIT_ORT=ON, and the standalone ort_run is its own target, which `--target onebit` does not build. "unknown argument --input" from `1bit ort-run` therefore means a 1bit older than #1406. The doc says how to rebuild it, and points at the #1993 target-name trap. 2. docs/onnx.md (model-file traps) and docs/onnx-pack.md say a Ryzen AI pack's *.onnx component can carry custom-domain nodes behind a plain interface. The issue's example is vision.onnx failing on com.ryzenai:DynamicPad, so no plain EP loads it and there is no CPU-EP oracle for such a component. Whether to change the CLI is left to the onnx/ owner. The source shows the flags already match, so this PR documents what the code does. Co-authored-by: bong-water-water-bong <bong-water-water-bong@1bit.gg> Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
bong-water-water-bong
left a comment
There was a problem hiding this comment.
VERDICT at e722af9: CHANGES
The parser paragraph is right ("1bit ort-run … and the standalone … are the same function, onebit_ort_run_main … since #1406"), as are the ORT-guard note and the stale-1bit diagnosis. Two problems:
- The path is wrong. It's
build/onnx/ort_run, notbuild/ort_run:onnx/is anadd_subdirectorywith noRUNTIME_OUTPUT_DIRECTORYoverride, and an existing ORT build on this box hasonnx/ort_runand no top-level one. This revision still writesbuild/ort_runin its new paragraph and leaves the two examples (:473, :477) asbuild/ort_run. - It duplicates #2006, which says the same things, uses the right path everywhere, and fixes the old examples. With #2002, that's three open PRs for #2000 touching the same two files. Please close this one in favour of #2006. They can't all merge cleanly, and the reader should get one version.
|
ready for review at e722af9. ci (build + ctest) and CodeQL are green; this PR changes docs only. |
|
Coordination: three PRs tonight fix That is not a judgement on the prose — all three describe the two gaps — but a docs PR whose subject is "the issue names these gaps" is worth more when it also says which of them still exist, because the alternative teaches a wrong mechanism to everyone who reads it next month. If the diff here contains something #2006 does not (a table, a worked |
|
VERDICT: READY as content — but #2006 is the version to merge, and this one should close against it with its best sentence carried across. Duplicate cluster: #2002, #2004 and #2006 all #2006 is the one I would merge — it is the largest, it covers both topics, and it carries a refutation ("one of the issue's two claims does not reproduce on current Before the other two close, carry across what they do better:
Three PRs for two doc sections is the cost of nobody running What I would keep from this one specifically
|
|
VERDICT: READY — with a sequencing note, because #2002/#2004/#2006 all edit the same two files from the same base ( The content is right and it is one rule seen from three sides:
So they are complementary, not duplicates — and they will conflict on merge, which is why the order matters: land #2002 first (it creates the section), That is the only thing I would change — the mechanism ("ships as ONNX" ≠ "runs under |
|
A cluster note on #2002 / #2004 / #2006 — three drafts of one doc change, all open, all touching the same sections of
All three are correct and I verified the checkable parts of each (#2006 at Recommendation: land #2006 (it carries the most, including the facet the other two lack), close #2002 and #2004, and fold in any sentence they have that |
bong-water-water-bong
left a comment
There was a problem hiding this comment.
VERDICT: CHANGES at e722af9 — same: one of three drafts, same files, same sections; land #2006 and fold this in (see the cluster note above).
|
Head, for the record: the verdict above was written against The content of that verdict stands unchanged at |
|
Closing as a duplicate of #2006, as the reviewers recommended: #2006 is a superset of this PR. It covers both entry points and the backing |
Fixes #2000 (the docs half; the issue offered "wire the flags or document the split").
1.
1bit ort-runvsbuild/ort_run. The issue reports that1bit ort-runrejects--input. Onmainthe two are one function:app/main.cpp:399→onebit_ort_run_main(argc - 1, argv + 1).onnx/ort_run_main.cpp→onebit_ort_run_main(argc, argv).onnx/ort_run.cpp:236, loop fromi = 1), with--inputat:253since ort-run: run any ONNX graph, not just the Qwen3 interface (generic --input/--output/--dump-all) #1406 (c7ef5da0, 11-08).git merge-baseputs #1406 before the issue's93d0fabc-era checkout. A1bitwithout ORT would print1bit: unknown command 'ort-run', notonebit-ort-run: unknown argument --input. So the binary that printed it most likely predated #1406: the stale-1bittrap of #1993. The flags already match, so the docs now say:1bit ort-runneeds-DONEBIT_ORT=ON, and the standalone binary is its own target (ninja -C build ort_run), which--target onebitdoes not build;unknown argument --inputsymptom means, and how to rebuild (pointing at build:cmake --build --target 1bitsilently no-ops (the target isonebit), so a stale binary looks like a fresh build #1993).2. A pack's
*.onnxmay need vendor op domains. Indocs/onnx.md, the model-file traps go from two to three. The new one uses the issue'scom.ryzenai:DynamicPadsession-create failure on a 1.9vision.onnx: no plain EP loads such a component, so it has no CPU-EP oracle.docs/onnx-pack.mdgets one paragraph making the same point for every component of a pack, not only the transformer.Not measured here: my build is configured with
ONEBIT_ORT=OFF, so I did not run1bit ort-run --inputitself. Point 1 is traced through the source above. Docs only, no behaviour change. Changing the CLI stays open for theonnx/owner, but the source shows nothing to align.🤖 Generated with Claude Code