Skip to content

Send CI traces to an AgentLoop server - #362

Merged
dipeshbabu merged 1 commit into
mainfrom
feat/ci-upload
Nov 20, 2026
Merged

dipeshbabu merged 1 commit into
mainfrom
feat/ci-upload

Conversation

@dipeshbabu

Copy link
Copy Markdown
Owner

With a shared AgentLoop server in place, CI had no easy way to fill it: `agentloop upload` took one file and the reusable comparison workflow could not send traces anywhere.

`agentloop upload`

  • `--path` is repeatable and accepts directories (all `*.json`, sorted); an empty directory is an error.
  • Every file is parsed before anything is sent, so a broken file means no partial upload.
  • `--label KEY=VALUE` (repeatable) is merged into `metadata.labels`, keeping existing labels; keys are `[A-Za-z0-9][A-Za-z0-9_.-]{0,63}`, values up to 500 chars.

`application-performance.yml`: optional `agentloop_api_url` input and `agentloop_api_key` secret. When the URL is set, after the comparison (pass or fail, not cancelled) it uploads the baseline and candidate traces labelled `condition`, `repository`, `commit`, `ref`, `workflow_run`; it fails clearly if the secret is missing and never uses an admin key.

Tests: upload of files + directories with labels, malformed labels, validate-before-send, empty directory; a workflow test pinning the guard, secret use, labels and step order. The smoke workflow calls the reusable workflow at this commit, so the new inputs are validated by GitHub on this PR. Docs: CI.md section, CLOUD_DEPLOY pointer, changelog.

🤖 Generated with Claude Code

agentloop upload took a single file, and the reusable comparison
workflow could not send traces anywhere. upload now accepts repeated
--path values and directories, validates every file before sending any,
and adds --label KEY=VALUE pairs under metadata.labels. The reusable
workflow takes an optional agentloop_api_url input and agentloop_api_key
secret and uploads the compared baseline and candidate traces labelled
with condition, repository, commit, ref and workflow run.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@coderabbitai

coderabbitai Bot commented Nov 20, 2026

Copy link
Copy Markdown

Important

  • Trigger review

This repository does not receive automatic reviews because it has fewer than 10 stars.

Run configuration

  • Autofix · Keep fixing CodeRabbit findings and required CI, and resolving merge conflicts

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

Share

@github-actions

Copy link
Copy Markdown

AgentLoop replay self-test

This required repository check evaluates generated synthetic demo traces. It tests the replay and CI machinery; it does not show that this PR improves application performance.

AgentLoop CI Report

  • Status: passed
  • Replay: Replay passed: latency improvement 69.68%, cost improvement 78.82%, retry delta -1.
  • Merge recommendation: synthetic self-test only; assess application traces before merge
  • Findings: 1 total, 0 high severity, 1 patchable

Performance Gates

Gate Status Detail
latency_regression pass 0.00% regression <= 0.00% allowed
cost_regression pass 0.00% regression <= 0.00% allowed
latency_improvement pass 69.68% improvement >= 20.00% required
cost_improvement pass 78.82% improvement >= 5.00% required
retry_non_increase pass 0 candidate retries <= 1 baseline retries

Trace inputs

This comparison includes synthetic data. It does not establish application performance gains from a pull request.

Side Run ID Path Synthetic marker Source
baseline run_04f7461ad0f244da runs/research_agent_baseline.json yes agentloop_demo
candidate run_7a48d8abde69478b runs/research_agent_optimized.json yes agentloop_demo

Metric Impact

Metric Impact
Latency improvement 69.68%
Cost improvement 78.82%
Retry delta -1
Candidate schema validity not provided
Candidate quality score not provided

Top Findings

Finding Severity Type Rewrite
al_cache_context_35b0ea502f00: Cache repeated prompt/context prefix medium cache_context Move stable instructions into cached prefixes, summaries, or framework-level memory instead of resending full text.

@dipeshbabu
dipeshbabu merged commit a7140ca into main Nov 20, 2026
27 checks passed
@dipeshbabu
dipeshbabu deleted the feat/ci-upload branch November 20, 2026 08:14
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant