back to home

diegosouzapw / OmniRoute

OmniRoute is an AI gateway for multi-provider LLMs: an OpenAI-compatible endpoint with smart routing, load balancing, retries, and fallbacks. Add policies, rate limits, caching, and observability for reliable, cost-aware inference.

915 stars
148 forks
9 issues
TypeScriptJavaScriptShell

AI Architecture Analysis

This repository is indexed by RepoMind. By analyzing diegosouzapw/OmniRoute in our AI interface, you can instantly generate complete architecture diagrams, visualize control flows, and perform automated security audits across the entire codebase.

Our Agentic Context Augmented Generation (Agentic CAG) engine loads full source files into context on-demand, avoiding the fragmentation of traditional RAG systems. Ask questions about the architecture, dependencies, or specific features to see it in action.

Source files are only loaded when you start an analysis to optimize performance.

Embed this Badge

Showcase RepoMind's analysis directly in your repository's README.

[![Analyzed by RepoMind](https://img.shields.io/badge/Analyzed%20by-RepoMind-4F46E5?style=for-the-badge)](https://repomind.in/repo/diegosouzapw/OmniRoute)
Preview:Analyzed by RepoMind

Repository Overview (README excerpt)

Crawler view

🚀 OmniRoute — The Free AI Gateway Never stop coding. Smart routing to **FREE & low-cost AI models** with automatic fallback. _Your universal API proxy — one endpoint, 44+ providers, zero downtime. Now with **MCP & A2A** agent orchestration._ **Chat Completions • Embeddings • Image Generation • Video • Music • Audio • Reranking • MCP Server • A2A Protocol • 100% TypeScript** --- 🌐 Website • 🚀 Quick Start • 💡 Features • 📖 Docs • 💰 Pricing • 💬 WhatsApp 🌐 **Available in:** 🇺🇸 English | 🇧🇷 Português (Brasil) | 🇪🇸 Español | 🇫🇷 Français | 🇮🇹 Italiano | 🇷🇺 Русский | 🇨🇳 中文 (简体) | 🇩🇪 Deutsch | 🇮🇳 हिन्दी | 🇹🇭 ไทย | 🇺🇦 Українська | 🇸🇦 العربية | 🇯🇵 日本語 | 🇻🇳 Tiếng Việt | 🇧🇬 Български | 🇩🇰 Dansk | 🇫🇮 Suomi | 🇮🇱 עברית | 🇭🇺 Magyar | 🇮🇩 Bahasa Indonesia | 🇰🇷 한국어 | 🇲🇾 Bahasa Melayu | 🇳🇱 Nederlands | 🇳🇴 Norsk | 🇵🇹 Português (Portugal) | 🇷🇴 Română | 🇵🇱 Polski | 🇸🇰 Slovenčina | 🇸🇪 Svenska | 🇵🇭 Filipino --- 🖼️ Main Dashboard --- 📸 Dashboard Preview Click to see dashboard screenshots | Page | Screenshot | | -------------- | ------------------------------------------------- | | **Providers** | | | **Combos** | | | **Analytics** | | | **Health** | | | **Translator** | | | **Settings** | | | **CLI Tools** | | | **Usage Logs** | | | **Endpoints** | | --- 🤖 Free AI Provider for your favorite coding agents _Connect any AI-powered IDE or CLI tool through OmniRoute — free API gateway for unlimited coding._ OpenClaw ⭐ 205K NanoBot ⭐ 20.9K PicoClaw ⭐ 14.6K ZeroClaw ⭐ 9.9K IronClaw ⭐ 2.1K OpenCode ⭐ 106K Codex CLI ⭐ 60.8K Claude Code ⭐ 67.3K Gemini CLI ⭐ 94.7K Kilo Code ⭐ 15.5K 📡 All agents connect via http://localhost:20128/v1 or http://cloud.omniroute.online/v1 — one config, unlimited models and quota --- 🤔 Why OmniRoute? **Stop wasting money and hitting limits:** • Subscription quota expires unused every month • Rate limits stop you mid-coding • Expensive APIs ($20-50/month per provider) • Manual switching between providers **OmniRoute solves this:** • ✅ **Maximize subscriptions** - Track quota, use every bit before reset • ✅ **Auto fallback** - Subscription → API Key → Cheap → Free, zero downtime • ✅ **Multi-account** - Round-robin between accounts per provider • ✅ **Universal** - Works with Claude Code, Codex, Gemini CLI, Cursor, Cline, OpenClaw, any CLI tool --- 📧 Support > 💬 **Join our community!** WhatsApp Group — Get help, share tips, and stay updated. • **Website**: omniroute.online • **GitHub**: github.com/diegosouzapw/OmniRoute • **Issues**: github.com/diegosouzapw/OmniRoute/issues • **WhatsApp**: Community Group • **Contributing**: See CONTRIBUTING.md, open a PR, or pick a • **Original Project**: 9router by decolua 🐛 Reporting a Bug? When opening an issue, please run the system-info command and attach the generated file: This generates a with your Node.js version, OmniRoute version, OS details, installed CLI tools (iflow, gemini, claude, codex, antigravity, droid, etc.), Docker/PM2 status, and system packages — everything we need to reproduce your issue quickly. Attach the file directly to your GitHub issue. --- 🔄 How It Works --- 🎯 What OmniRoute Solves — 30 Real Pain Points & Use Cases > **Every developer using AI tools faces these problems daily.** OmniRoute was built to solve them all — from cost overruns to regional blocks, from broken OAuth flows to protocol operations and enterprise observability. 💸 1. "I pay for an expensive subscription but still get interrupted by limits" Developers pay $20–200/month for Claude Pro, Codex Pro, or GitHub Copilot. Even paying, quota has a ceiling — 5h of usage, weekly limits, or per-minute rate limits. Mid-coding session, the provider stops responding and the developer loses flow and productivity. **How OmniRoute solves it:** • **Smart 4-Tier Fallback** — If subscription quota runs out, automatically redirects to API Key → Cheap → Free with zero manual intervention • **Real-Time Quota Tracking** — Shows token consumption in real-time with reset countdown (5h, daily, weekly) • **Multi-Account Support** — Multiple accounts per provider with auto round-robin — when one runs out, switches to the next • **Custom Combos** — Customizable fallback chains with 6 balancing strategies (fill-first, round-robin, P2C, random, least-used, cost-optimized) • **Codex Business Quotas** — Business/Team workspace quota monitoring directly in the dashboard 🔌 2. "I need to use multiple providers but each has a different API" OpenAI uses one format, Claude (Anthropic) uses another, Gemini yet another. If a dev wants to test models from different providers or fallback between them, they need to reconfigure SDKs, change endpoints, deal with incompatible formats. Custom providers (FriendLI, NIM) have non-standard model endpoints. **How OmniRoute solves it:** • **Unified Endpoint** — A single serves as proxy for all 44+ providers • **Format Translation** — Automatic and transparent: OpenAI ↔ Claude ↔ Gemini ↔ Responses API • **Response Sanitization** — Strips non-standard fields ( , , ) that break OpenAI SDK v1.83+ • **Role Normalization** — Converts → for non-OpenAI providers; → for GLM/ERNIE • **Think Tag Extraction** — Extracts blocks from models like DeepSeek R1 into standardized • **Structured Output for Gemini** — → / automatic conversion • ** defaults to ** — Aligns with OpenAI spec, avoiding unexpected SSE in Python/Rust/Go SDKs 🌐 3. "My AI provider blocks my region/country" Providers like OpenAI/Codex block access from certain geographic regions. Users get errors like during OAuth and API connections. This is especially frustrating for developers from developing countries. **How OmniRoute solves it:** • **3-Level Proxy Config** — Configurable proxy at 3 levels: global (all traffic), per-provider (one provider only), and per-connection/key • **Color-Coded Proxy Badges** — Visual indicators: 🟢 global proxy, 🟡 provider proxy…