Skip to content

feat: support Nemotron 3.5 Lightning training - #2033

Draft
j316chuck wants to merge 16 commits into
NovaSky-AI:mainfrom
j316chuck:agent/nemotron35-lightning
Draft

feat: support Nemotron 3.5 Lightning training#2033
j316chuck wants to merge 16 commits into
NovaSky-AI:mainfrom
j316chuck:agent/nemotron35-lightning

Conversation

@j316chuck

@j316chuck j316chuck commented Aug 13, 2026

Copy link
Copy Markdown
Contributor

Fixes

  • Pin vLLM, Megatron Bridge, and Megatron Core revisions that load Nemotron 3.5 Lightning.
  • Start non-colocated inference before trainer GPU allocation, then reconnect weight sync after policy creation.
  • Pass vLLM socket reuse, preserve explicit eager mode, and fall back from fused LM-head projection for HybridModel.
  • Use the current Megatron checkpoint queue API so saves finalize.
  • Remove the five-minute Tinker forwarding read timeout while retaining the ten-second connect timeout.

Verification

  • 6 focused SkyRL tests pass.
  • Baked image: us-central1-docker.pkg.dev/useful-memory-477923-v7/skyrl/megatron@sha256:064cb5cef0b0be163d4f03af577002367c6515a3bd68ca72d125f7ff6b4d5e3c

Ubuntu and others added 14 commits August 13, 2026 02:42
Signed-off-by: Ubuntu <ubuntu@chuck-cpu-personal.us-southcentral1-a.compute.internal>
Signed-off-by: Ubuntu <ubuntu@chuck-cpu-personal.us-southcentral1-a.compute.internal>
Signed-off-by: Charles Tang <j316chuck@users.noreply.github.com>
Signed-off-by: Charles Tang <j316chuck@users.noreply.github.com>
Signed-off-by: Charles Tang <j316chuck@users.noreply.github.com>
Signed-off-by: Charles Tang <j316chuck@users.noreply.github.com>
Signed-off-by: Charles Tang <j316chuck@users.noreply.github.com>
Signed-off-by: Charles Tang <j316chuck@users.noreply.github.com>
Signed-off-by: Charles Tang <j316chuck@users.noreply.github.com>
Signed-off-by: Charles Tang <j316chuck@users.noreply.github.com>
Signed-off-by: Charles Tang <j316chuck@users.noreply.github.com>
Signed-off-by: Charles Tang <j316chuck@users.noreply.github.com>
Signed-off-by: Charles Tang <j316chuck@users.noreply.github.com>
Signed-off-by: Charles Tang <j316chuck@users.noreply.github.com>
@erictang000

Copy link
Copy Markdown
Collaborator

hey @j316chuck, bumping megatron deps right now, will try to make sure the nemotron lightning is working when they're done

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants