Antirion
Antirion is an open-source AI gateway written in Rust that sits between your apps and model providers, shipping the gateway, admin API and web console as one binary with routing, budgets, guardrails, caching and a request log.
Why it matters
For teams calling several LLM providers, it puts keys, spending limits, fallbacks and safety filters in one self-hosted place instead of scattering them across apps, and its maker says it adds far less latency than LiteLLM or Bifrost.
Highlights
- One API in front of OpenAI, Azure OpenAI, Anthropic, Bedrock, Vertex AI, Gemini, Mistral, Groq, DeepSeek, xAI and any OpenAI- or Anthropic-compatible server; clients can speak OpenAI, Anthropic, Gemini or Bedrock formats.
- Routing with fallback chains, weighted splits, least cost or latency, retries, hedging and circuit breakers, recorded per request.
- Rate limits and budgets in dollars or tokens at the organization, team, project and key level, with a cost ledger and alerts.
- Guardrails for PII, secrets, regexes, JSON schemas and tool permissions, plus exact and semantic caching, SSO (OIDC, SAML, SCIM) and an audit log.
- The maker's benchmark on a 4-vCPU AWS machine reports about 0.5 ms median overhead at 5,000 requests per second, versus 19.7 ms for Bifrost 2.2.4, with LiteLLM failing at that rate.unverified
Taken from the project's own README, docs or launch page. Claims about speed or accuracy are the maker's unless stated otherwise.
Worth knowing: A very new project (created October 17, 2026, v0.1.1). Performance figures come from the maker's own benchmark, though the harness is published for reproduction.
Quick facts
| Pricing | Free |
|---|---|
| Free or paid | Free (open source) |
| License | Apache-2.0 |
| Language | Rust (runs via Docker or a Linux binary) |
| Platform | Docker image or Linux binaries (amd64, arm64); standalone node or cluster on PostgreSQL and Valkey; macOS and Windows binaries not mentioned |
| GitHub stars | ★ 152 (as of 2026-10-21) |
| Maker | eliasbiondo (GitHub) |
Links
- Official site: https://antirion.ai
- Repository: https://github.com/eliasbiondo/antirion
- Release notes: https://github.com/eliasbiondo/antirion/releases
Related ranking
See how established tools compare in Best AI Coding Tools for Developers. New releases aren't scored until we review them against the rubric.
What we couldn't verify
- highlights[4] (maker's benchmark, not reproduced)
Checked 2026-10-21 from the tool's own pages. Prices and star counts change, so confirm on the official site. Listing here is not a ranking or an endorsement.
One email a week on AI that saves business owners time
Every Friday: one tool pick with the business use case, what changed in tools you already use, and the week's AI news in plain English. No spam.
Free. Unsubscribe any time. See our privacy policy.