From 0dc6546247f1b2c5e4a82734d2c34cbd1ebb3b6f Mon Sep 17 00:00:00 2001 From: "claude[bot]" <41898282+claude[bot]@users.noreply.github.com> Date: Mon, 21 Sep 2026 01:08:11 +0000 Subject: [PATCH] perf(b200): update qwen3.8next-fp4-b200-sglang-agentic-mtp SGLang image to v0.5.20-cu130 MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit Move the family from the model-branch tag lmsysorg/sglang:qwen38flashnext (commit 593134d1, 2026-09-03) to the official lmsysorg/sglang:v0.5.20-cu130 release (commit 94602c9c), which ships upstream Qwen3.8-Flash-Next support (sgl-project/sglang#37500). v0.5.20 removed the deprecated --cuda-graph-max-bs alias (sgl-project/sglang#38375), so the unshared recipe now passes the same value through --cuda-graph-max-bs-decode. 将该配置从模型分支标签 lmsysorg/sglang:qwen38flashnext（提交 593134d1，2026-09-03） 迁移到官方发布镜像 lmsysorg/sglang:v0.5.20-cu130（提交 94602c9c），该版本已包含 上游 Qwen3.8-Flash-Next 支持（sgl-project/sglang#37500）。v0.5.20 移除了已弃用的 --cuda-graph-max-bs 别名（sgl-project/sglang#38375），因此该配方独有的脚本改用 --cuda-graph-max-bs-decode 传递相同的值。 Co-Authored-By: Claude Fable 5.1 --- .../single_node/agentic/qwen3.8next_fp4_b200_sglang_mtp.sh | 4 +++- configs/nvidia-master.yaml | 2 +- 2 files changed, 4 insertions(+), 2 deletions(-) diff --git a/benchmarks/single_node/agentic/qwen3.8next_fp4_b200_sglang_mtp.sh b/benchmarks/single_node/agentic/qwen3.8next_fp4_b200_sglang_mtp.sh index ef23585e29..43b792b892 100755 --- a/benchmarks/single_node/agentic/qwen3.8next_fp4_b200_sglang_mtp.sh +++ b/benchmarks/single_node/agentic/qwen3.8next_fp4_b200_sglang_mtp.sh @@ -156,7 +156,9 @@ SGLANG_CMD=( # NEXTN silently resets --max-running-requests to 48 when it is unset, so # this must stay explicit and sized to the AgentX concurrency. --max-running-requests "$MAX_RUNNING_REQUESTS" - --cuda-graph-max-bs "$CUDA_GRAPH_MAX_BS" + # SGLang v0.5.20 removed the deprecated --cuda-graph-max-bs alias + # (sgl-project/sglang#38375); the decode-phase flag is its replacement. + --cuda-graph-max-bs-decode "$CUDA_GRAPH_MAX_BS" --mem-fraction-static "$MEM_FRACTION_STATIC" "${MAMBA_CACHE_ARGS[@]}" --stream-interval 50 diff --git a/configs/nvidia-master.yaml b/configs/nvidia-master.yaml index c5d5edac68..a36adc0533 100644 --- a/configs/nvidia-master.yaml +++ b/configs/nvidia-master.yaml @@ -5198,7 +5198,7 @@ qwen3.5-fp4-b200-sglang-agentic-mtp: # Qwen3.8-Flash-Next NVFP4 AgentX on B200 via SGLang with native NEXTN MTP. # TP1 matches the verified single-node recipe. qwen3.8next-fp4-b200-sglang-agentic-mtp: - image: lmsysorg/sglang:qwen38flashnext + image: lmsysorg/sglang:v0.5.20-cu130 model: RadixArk/Qwen3.8-Flash-Next-NVFP4 model-prefix: qwen3.8next runner: cluster:b200-nscale