GoModel Logo

About GoModel

GoModel is an open-source AI gateway that sits between your applications and AI model providers, offering a unified interface for routing, caching, monitoring, and controlling AI requests. It supports OpenAI and Anthropic SDKs natively, as well as standard chat completions endpoints, making it easy to integrate with existing codebases. The gateway provides a pipeline for authentication, workflow execution, guardrails, caching, rate limiting, and provider routing, with automatic failover and circuit breaker for reliability. Key capabilities include aliases and virtual models for flexible provider routing, scoped workflows for multi-step AI processes, exact and semantic caching to reduce costs and latency, and comprehensive usage analytics and audit logs. Administrators can set budgets, pricing overrides, multiple API keys, and guardrails to enforce safety and cost controls. The dashboard provides visibility into cache performance, prompt cache usage, and request lifecycle. GoModel is available as a free open-source version with core features. A Pro tier adds intelligent routing, context window compression, and OIDC SSO, with cluster mode planned for future release. The roadmap includes plugins, hardened guardrails, streaming image generation, and enhanced dashboard customization.