Skip to content

feat(llm): add Atlas Cloud router - #534

Open
binyangzhu000-sudo wants to merge 1 commit into
IBM:mainfrom
binyangzhu000-sudo:codex/add-atlascloud-router
Open

feat(llm): add Atlas Cloud router#534
binyangzhu000-sudo wants to merge 1 commit into
IBM:mainfrom
binyangzhu000-sudo:codex/add-atlascloud-router

Conversation

@binyangzhu000-sudo

Copy link
Copy Markdown

Description

Add Atlas Cloud as an opt-in OpenAI-compatible router for the direct-llm-agent baseline. The atlascloud/ prefix strips cleanly before requests, uses the hosted API URL by default, and reads credentials from ATLASCLOUD_API_KEY.

Atlas Cloud requests explicitly configure the OpenAI SDK with max_retries=0, preventing an implicit duplicate generation request. Existing TokenRouter, LiteLLM, and runner defaults are unchanged.

Type of Change

  • New Benchmark Scenario (Industry/Asset type)
  • Evaluation Metric / Scorer
  • Agentic Orchestration Logic (ReAct, Plan-Execute, etc.)
  • Infrastructure / Tooling Improvement

Industry Relevance

This adds another model endpoint for reproducible direct-model benchmark baselines while retaining the existing provider-prefixed model ID convention.

Related Issues

  • Refs: N/A

Testing & Validation

  • Unit Tests: focused src/llm/tests suite passed (25 tests).
  • Scenario Validation: not applicable; no scenario definitions or trajectories changed.
  • Data Integrity: no PII or industrial data added.

Additional validation: Ruff format/lint, mypy, py_compile, git diff --check, secret scan, current Atlas model catalog lookup, and one non-retried live chat-completions smoke request.

Checklist

  • My code follows the project's Ruff formatting and linting rules.
  • I have performed a self-review of my code.
  • I have updated the documentation (README or /docs) accordingly.
  • I have signed off my commits (DCO).

Signed-off-by: binyangzhu000-sudo <224954946+binyangzhu000-sudo@users.noreply.github.com>
@DhavalRepo18

Copy link
Copy Markdown
Collaborator

@binyangzhu000-sudo Thanks for adding a support for atlas cloud. We added other router support as we get funding to run the model the respective platform host.

Do you pla to provide support ($$$) for Atlas cloud?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants