OpenAI-Compatible Gateway

One Endpoint.
Multi Upstreams.

ai-gateway 将多个上游能力收敛为一个统一入口。客户端只要发起标准 OpenAI 请求,网关就会按 model 自动路由、替换上游授权,并稳定透传流式与非流式响应。

2 Upstreams
openai / x.ai
4 Endpoints
chat · responses · image · video
1 Auth Layer
single gateway API key
Route Matrix
model = "grok-4" -> x.ai
prefix rule matched: grok-*
model = "gpt-5" -> openai
default provider fallback
GET /v1/models -> aggregate
merge upstream lists with dedup

[00:01.19] receive POST /v1/chat/completions

[00:01.19] extract model "gpt-5"

[00:01.20] resolve provider openai

[00:01.22] stream passthrough started

Routing
Model-Driven Forwarding
支持 exact 与 prefix 规则。默认 provider 兜底,个性化扩展模型策略。
Security
Single External Key
客户端只持有网关 API Key。上游密钥由网关内置并按 provider 注入。
Compatibility
Stream + Non-Stream
响应透传覆盖普通 JSON 与流式 chunk,客户端 SDK 无需改造。
Discovery
Upstream Model Merge
/v1/models 实时聚合上游结果并按 id 去重。

Quick Start

cp config.yaml.example config.yaml
go mod tidy
go run ./cmd/server

curl http://127.0.0.1:8080/v1/models -H "Authorization: Bearer sk-gateway"