Command Once, and Self-Evolve: Your Personal Infra Agent for All Environments.
English | 简体中文 | 📄 Paper (PDF) | 🌐 Blog, documentation & navigation
InfraRSI improves the training infrastructure around your existing codebase. Give it a working launch script, Python entry point, or repository; it searches for faster configurations and code changes, checks them against your original job, and saves verified experience for future runs.
Across four dense and MoE workloads on H100 and H200, the blog's reported results show 1.83× geometric-mean speedup, up to 2.75×, with mean Model FLOPs Utilization (MFU) rising from 17.4% to 30.0%. The comparison uses the same task contracts for InfraRSI, RE-Bench, Auto-Research, and OptiCo; failed and audit-excluded attempts still count toward token consumption.
| Workload | Hardware | InfraRSI speedup | MFU: baseline → optimized |
|---|---|---|---|
| Qwen3.5-9B | 8×H100 | 1.73× | 25.3% → 43.8% |
| Gemma-4-26B-A4B MoE | 8×H200 | 2.75× | 6.4% → 17.6% |
| Qwen3.8-27B | 8×H200 | 1.55× | 29.3% → 45.4% |
| Qwen3.5-35B-A3B MoE | 16×H100, 2 nodes | 1.51× | 8.7% → 13.2% |
| Geomean speedup / mean MFU | 1.83× | 17.4% → 30.0% |
The figure is reused from the blog. See full results and per-workload trajectories for the comparisons and measurement details.
- 🚀 Optimize parameters and code together. B-Comp searches launch flags, environment variables, configuration keys, and allowed code patches—combining memory savings with faster kernels, compilation, and communication settings.
- 🧩 Use your stack and model service. Supports Megatron-Core, FSDP2/TorchTitan, DeepSpeed, HF Trainer/TRL, and native PyTorch DDP, on one or multiple nodes. Choose Claude Code, Codex, DeepSeek, Anthropic/OpenAI APIs, an OpenAI-compatible endpoint, or self-hosted vLLM.
- 🔁 Carry experience to the next job. Verified results become reusable experience. In the blog's cross-hardware study, experience from other GPU types improved Qwen3.5-9B on 8×H100 from 1.70× to 1.82×, reaching 90% of the peak log-speedup in 9 trials.
- ✨ Start with one command.
infrarsi optimize ./train.shhandlesinit → doctor → run → report → applyand writesinfrarsi_optimized.shfor the verified result. - 🛡️ Check before adopting. The harness checks workload, data, optimizer steps, and numerical tolerance, then tests the winner in fresh re-runs. Add natural-language requirements or optional second-model review; the report identifies checks your project does not yet support.
See the blog highlights for examples and the verification guide for the checks.
Requires Python 3.10+.
git clone https://github.com/TokenRhythm/InfraRSI.git
cd InfraRSI
pip install -e .
infrarsi --version./train.sh with your project's launch script.
| Path | Setup | InfraRSI backend |
|---|---|---|
| Claude Code | Installed and signed in | claude-cli |
| Codex | Installed and signed in | codex-cli |
| DeepSeek API | DEEPSEEK_API_KEY |
deepseek:deepseek-chat |
| OpenAI-compatible API / gateway | Provider key and endpoint | openai-compat:MODEL |
# Claude Code
infrarsi optimize ./train.sh --llm claude-cli --screens 16
# Codex, with an optional token cap
infrarsi optimize ./train.sh --llm codex-cli --screens 16 --token-budget 500k
# DeepSeek, with an optional API spend cap
export DEEPSEEK_API_KEY="your-key"
infrarsi optimize ./train.sh --llm deepseek:deepseek-chat --screens 16 --budget-usd 10
# OpenAI-compatible endpoint (OpenRouter example)
export OPENROUTER_API_KEY="your-key"
infrarsi optimize ./train.sh --llm openai-compat:anthropic/claude-sonnet-4 --api-base https://openrouter.ai/api/v1 --api-key-env OPENROUTER_API_KEYinfrarsi ./train.sh is shorthand for infrarsi optimize ./train.sh. Python entries and repository paths work too. The blog quick start includes SiliconFlow, self-hosted vLLM, and manifest examples.
From your training repository:
infrarsi init
infrarsi doctor
infrarsi run --strategy bcomp --llm codex-cli
infrarsi report
infrarsi apply --writeSee the five-stage workflow and CLI reference for details.
Install the infrarsi-optimize skill, open a session in your training repository and ask it to make the job faster:
python agent_skill/install_skill.pyThe session adapts the project and talks to you; the same engine runs, checks and reports; each question the search asks is answered by a fresh sub-agent of the session's own model, so no API key is needed. See agent_skill/README.md.
- Checklist: Review six settings; Enter starts, a number edits,
moreopens advanced options, andqquits.--yesskips prompts and disables live chat. - Requirements: Use
--requirements "do not change the optimizer". Add--second-llm claude-clifor optional second-model review; it is off by default. - Budget: New projects default to 16 full runs. Time, token, GPU-hour, and dollar caps are optional; existing limits remain in force. Baseline checks, diagnosis, and final verification are separate from the search budget. See targets and budgets.
- Launch fails: Choose
rto retry,mto edit the command, ordfor model diagnosis. Diagnosis shows a separate allowance; a proposed command needs your confirmation before retrying. - Live chat: On a POSIX terminal, Ctrl-G opens the panel. Use
/status,/pause,/resume,/stop, or/note your guidance. Replies and control changes wait for trial boundaries; confirmation pairs finish together. Chat uses the search budget, and paused time still counts. - Stop: Ctrl-C stops search and re-verifies the best result; a second Ctrl-C exits immediately. After a killed or disconnected run,
infrarsi finish RUN_DIRcan complete verification.
💾 Resume B-Comp (bcomp) from the project directory:
infrarsi run --resume latest --screens 32You can replace latest with a run directory; for a custom output root, add --out /path/to/runs. Budgets are totals including work already done, so raise any exhausted caps. This resumes the optimization search, not the training job's own checkpoint.
If InfraRSI supports your work, please cite our paper (PDF):
@misc{infrarsiteam2026infrarsiharnessingrecursiveselfimprovement,
title={InfraRSI: Harnessing Recursive Self-Improvement for Training Infrastructure},
author={{InfraRSI Team} and Yuchuan Tian and Haocheng Mei and Ye Yuan and Chao Xu and Boxun Li and Guohao Dai and Kai Han and Allen Chen and Yunhe Wang and Yu Wang},
year={2026},
eprint={2611.11558},
archivePrefix={arXiv},
primaryClass={cs.AI},
url={https://arxiv.org/abs/2611.11558},
}📖 The full navigation, usage guide, and experiment write-up are on the InfraRSI blog.
