Skip to content

K8s/XCalibur Support - #579

Open
sjayaram-nv wants to merge 11 commits into
NVIDIA-NeMo:mainfrom
sjayaram-nv:sjayaram/k8s-excalibur
Open

K8s/XCalibur Support#579
sjayaram-nv wants to merge 11 commits into
NVIDIA-NeMo:mainfrom
sjayaram-nv:sjayaram/k8s-excalibur

Conversation

@sjayaram-nv

Copy link
Copy Markdown

This branch contains changes for adding the XCalibur executor backend to enable llm benchmarking runs in K8s.

Signed-off-by: Smitha Jayaram <sjayaram@nvidia.com>
Comment thread nemo_run/run/torchx_backend/schedulers/nvcre.py
Comment thread nemo_run/core/execution/xcalibur.py Outdated
Comment thread nemo_run/run/torchx_backend/schedulers/nvcre.py
Comment thread nemo_run/run/torchx_backend/schedulers/xcalibur.py Outdated
Comment thread nemo_run/core/execution/xcalibur.py Outdated
launch_path = os.path.join(self.job_dir, "launch.sh")
with open(launch_path, "w") as f:
f.write(script)
os.chmod(launch_path, 0o755)

Copy link
Copy Markdown
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Changed it to 0o555 now.

Comment thread nemo_run/core/execution/xcalibur.py Outdated
val = labels.get("excalibur.nvidia.com/job")
if val and val != workloadrun_name:
return val
except json.JSONDecodeError:

Copy link
Copy Markdown
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Changed the "pass" to a DEBUG log statement.

sjayaram-nv and others added 9 commits August 11, 2026 17:40
Address review comments

Signed-off-by: Smitha Jayaram <sjayaram@nvidia.com>
Signed-off-by: Smitha Jayaram <sjayaram@nvidia.com>
Signed-off-by: Smitha Jayaram <sjayaram@nvidia.com>
Signed-off-by: Smitha Jayaram <sjayaram@nvidia.com>
Signed-off-by: Smitha Jayaram <sjayaram@nvidia.com>
Signed-off-by: Ajay <abalasa@nvidia.com>

Signed-off-by: Smitha Jayaram <sjayaram@nvidia.com>
…VIDIA-NeMo#595)

* chore: add build constraint for setuptools version in pyproject.toml

Added a build constraint to specify that setuptools must be less than version 82. This change ensures compatibility with existing dependencies.

Signed-off-by: Ajay Balasa <abalasa@nvidia.com>

* chore: add build constraint for setuptools version in uv.lock

Included a build constraint to specify that setuptools must be less than version 82, ensuring compatibility with existing dependencies.

Signed-off-by: Ajay Balasa <abalasa@nvidia.com>

---------

Signed-off-by: Ajay Balasa <abalasa@nvidia.com>

Signed-off-by: Smitha Jayaram <sjayaram@nvidia.com>
Signed-off-by: Smitha Jayaram <sjayaram@nvidia.com>
Signed-off-by: sjayaram-nv <sjayaram@nvidia.com>
@sjayaram-nv
sjayaram-nv force-pushed the sjayaram/k8s-excalibur branch from 0a4a6b3 to c3fe84c Compare September 8, 2026 15:17
@sjayaram-nv
sjayaram-nv marked this pull request as ready for review September 8, 2026 15:17
Comment thread nemo_run/run/torchx_backend/schedulers/nvcre.py Outdated
Comment thread nemo_run/core/execution/nvcre.py Outdated
Comment thread nemo_run/core/execution/nvcre.py Outdated
Comment thread nemo_run/core/execution/nvcre.py Outdated
Comment thread nemo_run/core/execution/nvcre.py Outdated
Comment thread nemo_run/run/torchx_backend/schedulers/nvcre.py Outdated
Comment thread nemo_run/core/execution/nvcre.py Outdated
Comment thread nemo_run/core/execution/nvcre.py Outdated
Signed-off-by: Smitha Jayaram <sjayaram@nvidia.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants