Skip to content

[SDK] Add Dynamo deployment support; bump platform-api-python-client to 4.23.1 - #146

Merged
HanFa merged 1 commit into
mainfrom
fangh/dynamo-sdk-support
Jul 30, 2026
Merged

[SDK] Add Dynamo deployment support; bump platform-api-python-client to 4.23.1#146
HanFa merged 1 commit into
mainfrom
fangh/dynamo-sdk-support

Conversation

@HanFa

@HanFa HanFa commented Jul 30, 2026

Copy link
Copy Markdown
Contributor

Summary

  • upgrade platform-api-python-client to 4.23.1, the generated client release containing Dynamo APIs
  • add high-level Dynamo get/create/update SDK helpers; deletion continues through the existing type-independent client.delete(id) lifecycle helper
  • add environment-driven Dynamo creation and read-only authentication validation examples
  • document interactive and service-account authentication and expose hardware instance IDs for example setup

Validation

  • pytest (63 passed)
  • Black
  • Pylint (10.00/10)
  • mypy
  • package build/install and dependency check
  • fresh browser login plus read-only examples/sdk/validate_auth.py call against the Platform API

@HanFa

HanFa commented Jul 30, 2026

Copy link
Copy Markdown
Contributor Author

Live production SDK smoke validation completed on 2026-07-30:

  • created Dynamo deployment 14771 through CentMLClient.create_dynamo
  • used hardware profile gpu.1xb200 (NVIDIA-B200, exactly one GPU) with min_replicas=1 and max_replicas=1
  • deployed public model Qwen/Qwen3-0.6B
  • confirmed rollout Healthy with frontend and worker pods Running
  • authenticated GET /v1/models returned HTTP 200 and one model
  • authenticated POST /v1/chat/completions returned HTTP 200 and one choice
  • deleted only deployment 14771 through CentMLClient.delete
  • confirmed the deployment returns 404 and B200 usage returned to the pre-test baseline (5/8)

No test deployment or GPU allocation remains.

@HanFa
HanFa requested review from anandj91 and michaelshin July 30, 2026 19:36
@HanFa HanFa self-assigned this Jul 30, 2026
"""Create and inspect a fixed-replica NVIDIA Dynamo deployment.

Run `centml login` or configure service-account credentials first. This example
creates a billable GPU deployment and intentionally leaves cleanup to the user.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: you don't need to mention billable since we don't charge credit. maybe more that it's active

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I see. agree

@HanFa HanFa changed the title [SDK] Add Dynamo deployment support [SDK] Add Dynamo deployment support; bump platform-api-python-client to 4.23.1 Jul 30, 2026
from centml.sdk.api import get_centml_client


def required_env(name: str) -> str:

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Maybe a future TODO to make this function shared so we can enforce better env var checks

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

make sense. for now as an example script this should be fine (allowing doc-reader to copy and paste from single file).

Comment thread README.md

Use `python examples/sdk/get_clusters.py` and
`python examples/sdk/manage_hardware_instances.py` to discover the required IDs.
Creating the example reserves GPU capacity and may incur usage charges. It does not

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: also here too for billing

@michaelshin

Copy link
Copy Markdown
Contributor

I like the more generic approach rather than hardcoding the cluster id/hardware id

@HanFa
HanFa merged commit ad8e09b into main Jul 30, 2026
5 checks passed
@HanFa
HanFa deleted the fangh/dynamo-sdk-support branch July 30, 2026 19:46
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants