Routing strategies

AI Gateway ยท all 18 combo strategies animated โ€” with an honest map of what runs here today vs OmniRoute.

All 18 combo routing strategies, animated. Each tile below animates the path its strategy takes โ€” โ— request โ†’ โ–ฎ targets, green outline = the pick. The grid is OmniRoute's (MIT); the badges underneath say honestly which flows this gateway runs today. From OmniRoute โ†— ยท try the live ones on Connections.
Animated grid of 18 routing-strategy tiles
What runs here today โ€” no vaporware: live, partial, or roadmap
priorityโœ… live here
the fallback chain: router-ranked candidates tried in order
auto (12-factor)โœ… live here (our flavor)
the router scores fit ยท cost ยท speed per task with transparent rationale
cost-optimizedโœ… live here
model "auto/cheap" โ€” cheapest that clears the quality floor
headroomโœ… live here
model "auto/free" โ€” drains the free-tier pool with most remaining allowance first
fill-firstโ— effectively
cooldowns drain a model until it 429s, then move on โ€” fill-first by consequence
reset-awareโ— partially
429 cooldowns honor Retry-After โ€” reset-time awareness without the ranking
โš  A caveat on fusion / panel strategies. Fanning a prompt out to several models and synthesizing the answers buys less diversity than it looks: โ€œArtificial Hivemindโ€ (Jiang et al., arXiv 2510.22954) finds widespread mode collapse on open-ended prompts โ€” both within a model (repetition) and across models (homogeneity) โ€” and that LM judges are poorly calibrated exactly where humans disagree. Route across models for cost, speed and capability with confidence; route for a second opinion on open-ended questions with much less.
Roadmap (OmniRoute-only today): weightedround-robinp2cleast-usedrandomstrict-randomreset-windowcontext-relaycontext-optimizedlkgpfusionpipeline
Feature comparison โ€” OmniRoute's table, plus an honest column for this app
FeatureOmniRouteOther routersLLM Switchboard
๐ŸŒ Providers27820โ€“1003 wired + 25-provider directory
๐Ÿ†“ Free providers90+ (40+ free forever)1โ€“53 wired free tiers โ€” see the Free-tier page
๐Ÿ”€ Routing strategies18โ€“19 strategies1โ€“34 live + 2 partial (priority ยท auto ยท cost ยท headroom)
๐Ÿ—œ๏ธ Token compressionRTK + Caveman stacked (15โ€“95%)None / 20โ€“40%None โ€” roadmap
๐Ÿงฐ Built-in MCP server104 tools, 3 transports, 31 scopesRareNone โ€” the app is the tool
๐Ÿค A2A agent protocol6 skills, JSON-RPC 2.0NoneNone
๐Ÿง  Memory (FTS5 + vector)YesRareNone โ€” stateless by design
๐Ÿ›ก๏ธ Guardrails (PII, injection)YesRareAuthlee SSO gate only
โ˜๏ธ Cloud agentsCodex, Cursor, Devin, JulesNonen/a โ€” bring your own agent, point it at /v1
๐Ÿฅท TLS fingerprint stealthJA3/JA4 via wreq-jsNonen/a โ€” transparent, nothing to hide
๐Ÿ–ฅ๏ธ Multi-platformWeb ยท Desktop ยท Termux ยท PWAWeb onlyZero-dep Node โ€” self-host anywhere (Railway, laptop, edge box)
๐ŸŒ i18n43 locales0โ€“4EN
The honest read: OmniRoute is a Swiss-army proxy platform; this gateway is the routing core โ€” one endpoint, smart fallback, free-tier headroom โ€” inside a product that also does benchmarks, architectures, RSI and more. Different shapes, shared idea.
Sign in to continue

LLM Switchboard is private โ€” sign in with Authlee to access the control room.

Sign in with Authlee
โ† Back to home