[cquil11]

Problem

Since native srt-slurm single-node runs landed (fixed-sequence in SemiAnalysisAI/InferenceX#3352 on 2026-09-24, AgentX in SemiAnalysisAI/InferenceX#3428 on 2026-09-26), the server_logs_* artifact no longer contains results/server.log. The job's whole logs/ directory, including the server worker log <host>_agg_w0.out, is uploaded inside srt-single-node-logs.tar.gz instead.

serverLogArtifactRoot only unpacked multinode_server_logs.tar.gz, so for these runs ingest stored just results/benchmark.log and srt-setup.log. Every single-node point since then has no server log in the DB.

Change

• server_logs_* artifacts that contain srt-single-node-logs.tar.gz are extracted in place to srt-single-node-logs/. Their .log/.out files are stored next to the root files with artifact-relative paths, for example srt-single-node-logs/logs/<host>_agg_w0.out.
• Backwards compatible: artifacts without the archive read exactly as before, multinode handling is unchanged (now through a shared helper), and the primary file stays results/benchmark.log for new artifacts, the same as today. KV-cache derivation is untouched.
• Normal CI ingest and the GCS-backup ingest both go through readServerLogArtifact, so both pick this up.
• db:backfill-server-log-files now honors the already-parsed --force flag. Affected bundles are marked files_complete, so they were skipped; with --force they are revisited, and only filenames the bundle does not already hold are inserted.
• docs/data-pipeline.md documents the archive and --force.

Backfill after merge

The first affected run in the DB is 36270056341 (AgentX, 2026-09-26); fixed-sequence rows start at 36507377618 (2026-09-29).

bun run --cwd packages/db db:backfill-server-log-files --all --from-run 36270056341 --force --yes

---

Note

Medium Risk
Touches ETL server-log expansion for all new single-node artifacts and backfill recovery; changes are backward compatible but require a forced backfill to repair already-ingested incomplete bundles.

Overview
Native srt-slurm single-node server_logs_* artifacts now unpack srt-single-node-logs.tar.gz in place so worker .log/.out files (e.g. <host>_agg_w0.out) are ingested under srt-single-node-logs/ next to root client logs. Legacy layouts without the archive and multinode multinode_server_logs.tar.gz behavior stay the same, with extraction refactored through a shared extractArchiveOnce helper.

db:backfill-server-log-files finally applies the existing --force flag: bundles already marked files_complete are revisited and only missing filenames are inserted, so historical runs can pick up archive contents without re-downloading everything blindly. docs/data-pipeline.md documents the archive layout and --force.

^{Reviewed by Cursor Bugbot for commit 275de85. Bugbot is set up for automated code reviews on this repo. Configure here.}

[vercel]

The latest updates on your projects. Learn more about Vercel for GitHub.

Project	Deployment	Actions	Updated
inferencemax-app	Ready	Preview	Oct 9, 2026 7:51pm UTC