Skip to content

About

Local AI routing stack: OmniRoute + free-router + one-command start (glue, credits in CREDITS.md)

Resources

Stars

0 stars

Watchers

0 watching

Forks

Repository files navigation

Local AI routing stack

Run Claude Code against local models (Ollama) or free OpenRouter models through one gateway, with a one-command start.

This repo is the glue, not the parts. It pulls in upstream projects at pinned versions and adds:

  • free-router: a small proxy that rotates OpenRouter free models, with cooldowns when one fails.
  • Claude settings profiles: templates that point Claude Code at the gateway, or at Ollama directly.
  • Start scripts: one command brings up the gateway, free-router and the Paperclip server, and skips anything already running.
  • Handoff rules: when a task should go to a local model and when to keep it on Claude (see skills.md).

Requirements

  • Windows with PowerShell 5.1 or newer
  • Git, Node.js (check .nvmrc in OmniRoute for the version), npm
  • Ollama, if you want local models
  • An OpenRouter key, if you want free cloud models

Setup

git clone https://github.com/<your-account>/ais-local-stack.git
cd ais-local-stack
powershell -ExecutionPolicy Bypass -File .\bootstrap.ps1

Then:

  1. Add your keys to OmniRoute\.env. Never commit that file.
  2. Set OPENROUTER_API_KEY as a user environment variable (free-router reads it).
  3. Copy the profile you want from claude-profiles\ into %USERPROFILE%\.claude\, replacing <YOUR_KEY> with your key.
  4. Start with .\paperclip-launch.ps1, or only the gateway with .\start-omniroute.ps1.

Credits and licenses

See CREDITS.md. OmniRoute, Paperclip, Ollama, OpenRouter and Claude Code are separate projects with their own licenses and terms. This repo is not affiliated with any of them.

License

MIT for the files in this repo. See LICENSE.

About

Local AI routing stack: OmniRoute + free-router + one-command start (glue, credits in CREDITS.md)

Resources

Stars

0 stars

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages