Add OpenAI compatibility support and improve resource cleanup

- Introduced OpenAI compatibility configurations for external providers, enabling model alias routing via the OpenAI API format. - Enhanced provider logic in `GetProviderName` to handle OpenAI aliases and added new helper functions for compatibility checks. - Updated API handlers and client initialization to support OpenAI compatibility models. - Improved resource cleanup across clients by closing response bodies and streams using deferred functions.
2026-02-03 04:50:52 +08:00 · 2025-08-26 03:21:19 +08:00
parent 9102ff031d
commit ed8873fbb0
18 changed files with 671 additions and 72 deletions
--- a/README.md
+++ b/README.md
@@ -6,9 +6,9 @@ A proxy server that provides OpenAI/Gemini/Claude compatible API interfaces for

 It now also supports OpenAI Codex (GPT models) and Claude Code via OAuth.

-so you can use local or multi‑account CLI access with OpenAI‑compatible clients and SDKs.
+So you can use local or multi-account CLI access with OpenAI-compatible clients and SDKs.

-Now, We added the first Chinese provider: [Qwen Code](https://github.com/QwenLM/qwen-code).
+The first Chinese provider has now been added: [Qwen Code](https://github.com/QwenLM/qwen-code).

 ## Features

@@ -19,12 +19,13 @@ Now, We added the first Chinese provider: [Qwen Code](https://github.com/QwenLM/
 - Streaming and non-streaming responses
 - Function calling/tools support
 - Multimodal input support (text and images)
- Multiple accounts with round‑robin load balancing (Gemini, OpenAI, Claude and Qwen)
+- Multiple accounts with round-robin load balancing (Gemini, OpenAI, Claude and Qwen)
 - Simple CLI authentication flows (Gemini, OpenAI, Claude and Qwen)
 - Generative Language API Key support
- Gemini CLI multi‑account load balancing
- Claude Code multi‑account load balancing
- Qwen Code multi‑account load balancing
+- Gemini CLI multi-account load balancing
+- Claude Code multi-account load balancing
+- Qwen Code multi-account load balancing
+- OpenAI-compatible upstream providers via config (e.g., OpenRouter)

 ## Installation

@@ -59,13 +60,13 @@ You can authenticate for Gemini, OpenAI, and/or Claude. All can coexist in the s
  ```bash
  ./cli-proxy-api --login
  ```
-  If you are an old gemini code user, you may need to specify a project ID:
+  If you are an existing Gemini Code user, you may need to specify a project ID:
  ```bash
  ./cli-proxy-api --login --project_id <your_project_id>
  ```
  The local OAuth callback uses port `8085`.

-  Options: add `--no-browser` to print the login URL instead of opening a browser. The local OAuth callback uses port `1455`.
+  Options: add `--no-browser` to print the login URL instead of opening a browser. The local OAuth callback uses port `8085`.

 - OpenAI (Codex/GPT via OAuth):
  ```bash
@@ -126,7 +127,7 @@ Request body example:
 ```

 Notes:
- Use a `gemini-*` model for Gemini (e.g., `gemini-2.5-pro`), a `gpt-*` model for OpenAI (e.g., `gpt-5`), a `claude-*` model for Claude (e.g., `claude-3-5-sonnet-20241022`), or a `qwen-*` model for Qwen (e.g., `qwen3-coder-plus`). The proxy will route to the correct provider automatically.
+- Use a `gemini-*` model for Gemini (e.g., "gemini-2.5-pro"), a `gpt-*` model for OpenAI (e.g., "gpt-5"), a `claude-*` model for Claude (e.g., "claude-3-5-sonnet-20241022"), or a `qwen-*` model for Qwen (e.g., "qwen3-coder-plus"). The proxy will route to the correct provider automatically.

 #### Claude Messages (SSE-compatible)

@@ -226,7 +227,7 @@ console.log(await claudeResponse.json());
 - claude-3-5-haiku-20241022
 - qwen3-coder-plus
 - qwen3-coder-flash
- Gemini models auto‑switch to preview variants when needed
+- Gemini models auto-switch to preview variants when needed

 ## Configuration

@@ -238,21 +239,28 @@ The server uses a YAML configuration file (`config.yaml`) located in the project

 ### Configuration Options

-| Parameter                             | Type     | Default            | Description                                                                                   |
-|---------------------------------------|----------|--------------------|-----------------------------------------------------------------------------------------------|
-| `port`                                | integer  | 8317               | The port number on which the server will listen                                               |
-| `auth-dir`                            | string   | "~/.cli-proxy-api" | Directory where authentication tokens are stored. Supports using `~` for home directory       |
-| `proxy-url`                           | string   | ""                 | Proxy url, support socks5/http/https protocol, example: socks5://user:pass@192.168.1.1:1080/  |
-| `request-retry`                       | integer  | 0                  | Request retry times, if the response http code is 403, 408, 500, 502, 503, 504, it will retry |
-| `quota-exceeded`                      | object   | {}                 | Configuration for handling quota exceeded                                                     |
-| `quota-exceeded.switch-project`       | boolean  | true               | Whether to automatically switch to another project when a quota is exceeded                   |
-| `quota-exceeded.switch-preview-model` | boolean  | true               | Whether to automatically switch to a preview model when a quota is exceeded                   |
-| `debug`                               | boolean  | false              | Enable debug mode for verbose logging                                                         |
-| `api-keys`                            | string[] | []                 | List of API keys that can be used to authenticate requests                                    |
-| `generative-language-api-key`         | string[] | []                 | List of Generative Language API keys                                                          |
-| `claude-api-key`                      | object   | {}                 | List of Claude API keys                                                                       |
-| `claude-api-key.api-key`              | string   | ""                 | Claude API key                                                                                |
-| `claude-api-key.base-url`             | string   | ""                 | Custom Claude API endpoint, if you use the third party API endpoint                           |
+| Parameter                               | Type     | Default            | Description                                                                                             |
+|-----------------------------------------|----------|--------------------|---------------------------------------------------------------------------------------------------------|
+| `port`                                  | integer  | 8317               | The port number on which the server will listen.                                                        |
+| `auth-dir`                              | string   | "~/.cli-proxy-api" | Directory where authentication tokens are stored. Supports using `~` for the home directory.            |
+| `proxy-url`                             | string   | ""                 | Proxy URL. Supports socks5/http/https protocols. Example: socks5://user:pass@192.168.1.1:1080/           |
+| `request-retry`                         | integer  | 0                  | Number of times to retry a request. Retries will occur if the HTTP response code is 403, 408, 500, 502, 503, or 504. |
+| `quota-exceeded`                        | object   | {}                 | Configuration for handling quota exceeded.                                                              |
+| `quota-exceeded.switch-project`         | boolean  | true               | Whether to automatically switch to another project when a quota is exceeded.                            |
+| `quota-exceeded.switch-preview-model`   | boolean  | true               | Whether to automatically switch to a preview model when a quota is exceeded.                            |
+| `debug`                                 | boolean  | false              | Enable debug mode for verbose logging.                                                                  |
+| `api-keys`                              | string[] | []                 | List of API keys that can be used to authenticate requests.                                             |
+| `generative-language-api-key`           | string[] | []                 | List of Generative Language API keys.                                                                   |
+| `claude-api-key`                        | object   | {}                 | List of Claude API keys.                                                                                |
+| `claude-api-key.api-key`                | string   | ""                 | Claude API key.                                                                                         |
+| `claude-api-key.base-url`               | string   | ""                 | Custom Claude API endpoint, if you use a third-party API endpoint.                                      |
+| `openai-compatibility`                  | object[] | []                 | Upstream OpenAI-compatible providers configuration (name, base-url, api-keys, models).                  |
+| `openai-compatibility.*.name`           | string   | ""                 | The name of the provider. It will be used in the user agent and other places.                           |
+| `openai-compatibility.*.base-url`       | string   | ""                 | The base URL of the provider.                                                                           |
+| `openai-compatibility.*.api-keys`       | string[] | []                 | The API keys for the provider. Add multiple keys if needed. Omit if unauthenticated access is allowed. |
+| `openai-compatibility.*.models`         | object[] | []                 | The actual model name.                                                                                  |
+| `openai-compatibility.*.models.*.name`  | string   | ""                 | The models supported by the provider.                                                                   |
+| `openai-compatibility.*.models.*.alias` | string   | ""                 | The alias used in the API.                                                                              |

 ### Example Configuration File

@@ -266,10 +274,10 @@ auth-dir: "~/.cli-proxy-api"
 # Enable debug logging
 debug: false

-# Proxy url, support socks5/http/https protocol, example: socks5://user:pass@192.168.1.1:1080/
+# Proxy URL. Supports socks5/http/https protocols. Example: socks5://user:pass@192.168.1.1:1080/
 proxy-url: ""

-# Request retry times, if the response http code is 403, 408, 500, 502, 503, 504, it will retry
+# Number of times to retry a request. Retries will occur if the HTTP response code is 403, 408, 500, 502, 503, or 504.
 request-retry: 3

 # Quota exceeded behavior
@@ -294,8 +302,51 @@ claude-api-key:
  - api-key: "sk-atSM..." # use the official claude API key, no need to set the base url
  - api-key: "sk-atSM..."
    base-url: "https://www.example.com" # use the custom claude API endpoint
+
+# OpenAI compatibility providers
+openai-compatibility:
+  - name: "openrouter" # The name of the provider; it will be used in the user agent and other places.
+    base-url: "https://openrouter.ai/api/v1" # The base URL of the provider.
+    api-keys: # The API keys for the provider. Add multiple keys if needed. Omit if unauthenticated access is allowed.
+      - "sk-or-v1-...b780"
+      - "sk-or-v1-...b781"
+    models: # The models supported by the provider.
+      - name: "moonshotai/kimi-k2:free" # The actual model name.
+        alias: "kimi-k2" # The alias used in the API.
 ```

+### OpenAI Compatibility Providers
+
+Configure upstream OpenAI-compatible providers (e.g., OpenRouter) via `openai-compatibility`.
+
+- name: provider identifier used internally
+- base-url: provider base URL
+- api-keys: optional list of API keys (omit if provider allows unauthenticated requests)
+- models: list of mappings from upstream model `name` to local `alias`
+
+Example:
+
+```yaml
+openai-compatibility:
+  - name: "openrouter"
+    base-url: "https://openrouter.ai/api/v1"
+    api-keys:
+      - "sk-or-v1-...b780"
+      - "sk-or-v1-...b781"
+    models:
+      - name: "moonshotai/kimi-k2:free"
+        alias: "kimi-k2"
+```
+
+Usage: 
+
+Call OpenAI's endpoint `/v1/chat/completions` with `model` set to the alias (e.g., `kimi-k2`). The proxy routes to the configured provider/model automatically.
+
+Also, you may call Claude's endpoint `/v1/messages`, Gemini's `/v1beta/models/model-name:streamGenerateContent` or `/v1beta/models/model-name:generateContent`.
+
+And you can always use Gemini CLI with `CODE_ASSIST_ENDPOINT` set to `http://127.0.0.1:8317` for these OpenAI-compatible provider's models.
+
+
 ### Authentication Directory

 The `auth-dir` parameter specifies where authentication tokens are stored. When you run the login command, the application will create JSON files in this directory containing the authentication tokens for your Google accounts. Multiple accounts can be used for load balancing.
@@ -327,8 +378,8 @@ export CODE_ASSIST_ENDPOINT="http://127.0.0.1:8317"
 The server will relay the `loadCodeAssist`, `onboardUser`, and `countTokens` requests. And automatically load balance the text generation requests between the multiple accounts.

 > [!NOTE]  
-> This feature only allows local access because I couldn't find a way to authenticate the requests.   
-> I hardcoded `127.0.0.1` into the load balancing.
+> This feature only allows local access because there is currently no way to authenticate the requests.   
+> 127.0.0.1 is hardcoded for load balancing.

 ## Claude Code with multiple account load balancing

--- a/README_CN.md
+++ b/README_CN.md
@@ -6,9 +6,9 @@

 现已支持通过 OAuth 登录接入 OpenAI Codex（GPT 系列）和 Claude Code。

-可与本地或多账户方式配合，使用任何 OpenAI 兼容的客户端与 SDK。
+您可以使用本地或多账户的CLI方式，通过任何与OpenAI兼容的客户端和SDK进行访问。

-现在，我们添加了第一个中国提供商：[Qwen Code](https://github.com/QwenLM/qwen-code)。
+现已新增首个中国提供商：[Qwen Code](https://github.com/QwenLM/qwen-code)。

 ## 功能特性

@@ -25,6 +25,7 @@
 - 支持 Gemini CLI 多账户轮询
 - 支持 Claude Code 多账户轮询
 - 支持 Qwen Code 多账户轮询
+- 通过配置接入上游 OpenAI 兼容提供商（例如 OpenRouter）

 ## 安装

@@ -59,12 +60,14 @@
  ```bash
  ./cli-proxy-api --login
  ```
-  如果您是旧版 gemini code 用户，可能需要指定项目 ID：
+  如果您是现有的 Gemini Code 用户，可能需要指定一个项目ID：
  ```bash
  ./cli-proxy-api --login --project_id <your_project_id>
  ```
  本地 OAuth 回调端口为 `8085`。

+  选项：加上 `--no-browser` 可打印登录地址而不自动打开浏览器。本地 OAuth 回调端口为 `8085`。
+
 - OpenAI（Codex/GPT，OAuth）：
  ```bash
  ./cli-proxy-api --codex-login
@@ -123,7 +126,7 @@ POST http://localhost:8317/v1/chat/completions
 ```

 说明：
- 使用 `gemini-*` 模型（如 `gemini-2.5-pro`）走 Gemini，使用 `gpt-*` 模型（如 `gpt-5`）走 OpenAI，使用 `claude-*` 模型（如 `claude-3-5-sonnet-20241022`）走 Claude，使用 `qwen-*` 模型（如 `qwen3-coder-plus`）走 Qwen，服务会自动路由到对应提供商。
+- 使用 "gemini-*" 模型（例如 "gemini-2.5-pro"）来调用 Gemini，使用 "gpt-*" 模型（例如 "gpt-5"）来调用 OpenAI，使用 "claude-*" 模型（例如 "claude-3-5-sonnet-20241022"）来调用 Claude，或者使用 "qwen-*" 模型（例如 "qwen3-coder-plus"）来调用 Qwen。代理服务会自动将请求路由到相应的提供商。

 #### Claude 消息（SSE 兼容）

@@ -235,21 +238,28 @@ console.log(await claudeResponse.json());

 ### 配置选项

-| 参数                                    | 类型       | 默认值                | 描述                                                                     |
-|---------------------------------------|----------|--------------------|------------------------------------------------------------------------|
-| `port`                                | integer  | 8317               | 服务器监听的端口号                                                              |
-| `auth-dir`                            | string   | "~/.cli-proxy-api" | 存储身份验证令牌的目录。支持使用 `~` 表示主目录                                             |
-| `proxy-url`                           | string   | ""                 | 代理 URL，支持 socks5/http/https 协议，示例：socks5://user:pass@192.168.1.1:1080/ |
-| `request-retry`                       | integer  | 0                  | 请求失败重试次数，如果响应的http代码为403、408、500、502、503、504则会自动重试                     |
-| `quota-exceeded`                      | object   | {}                 | 处理配额超限的配置                                                              |
-| `quota-exceeded.switch-project`       | boolean  | true               | 当配额超限时是否自动切换到另一个项目                                                     |
-| `quota-exceeded.switch-preview-model` | boolean  | true               | 当配额超限时是否自动切换到预览模型                                                      |
-| `debug`                               | boolean  | false              | 启用调试模式以进行详细日志记录                                                        |
-| `api-keys`                            | string[] | []                 | 可用于验证请求的 API 密钥列表                                                      |
-| `generative-language-api-key`         | string[] | []                 | 生成式语言 API 密钥列表                                                         |
-| `claude-api-key`                      | object   | {}                 | Claude API 密钥列表                                                        |
-| `claude-api-key.api-key`              | string   | ""                 | Claude API 密钥                                                          |
-| `claude-api-key.base-url`             | string   | ""                 | 自定义 Claude API 端点（如果你使用的是第三方 Claude API 端点）                            |
+| 参数                                    | 类型       | 默认值                | 描述                                                                                          |
+|---------------------------------------|----------|--------------------|---------------------------------------------------------------------------------------------|
+| `port`                                | integer  | 8317               | 服务器将监听的端口号。                                                                          |
+| `auth-dir`                            | string   | "~/.cli-proxy-api" | 存储身份验证令牌的目录。支持使用 `~` 来表示主目录。                                                  |
+| `proxy-url`                           | string   | ""                 | 代理URL。支持socks5/http/https协议。例如：socks5://user:pass@192.168.1.1:1080/                  |
+| `request-retry`                       | integer  | 0                  | 请求重试次数。如果HTTP响应码为403、408、500、502、503或504，将会触发重试。                                |
+| `quota-exceeded`                      | object   | {}                 | 用于处理配额超限的配置。                                                                        |
+| `quota-exceeded.switch-project`       | boolean  | true               | 当配额超限时，是否自动切换到另一个项目。                                                              |
+| `quota-exceeded.switch-preview-model` | boolean  | true               | 当配额超限时，是否自动切换到预览模型。                                                                |
+| `debug`                               | boolean  | false              | 启用调试模式以获取详细日志。                                                                    |
+| `api-keys`                            | string[] | []                 | 可用于验证请求的API密钥列表。                                                                   |
+| `generative-language-api-key`         | string[] | []                 | 生成式语言API密钥列表。                                                                         |
+| `claude-api-key`                      | object   | {}                 | Claude API密钥列表。                                                                            |
+| `claude-api-key.api-key`              | string   | ""                 | Claude API密钥。                                                                                |
+| `claude-api-key.base-url`             | string   | ""                 | 自定义的Claude API端点，如果您使用第三方的API端点。                                                 |
+| `openai-compatibility`                | object[] | []                 | 上游OpenAI兼容提供商的配置（名称、基础URL、API密钥、模型）。                                        |
+| `openai-compatibility.*.name`           | string   | ""                 | 提供商的名称。它将被用于用户代理（User Agent）和其他地方。                                            |
+| `openai-compatibility.*.base-url`       | string   | ""                 | 提供商的基础URL。                                                                               |
+| `openai-compatibility.*.api-keys`       | string[] | []                 | 提供商的API密钥。如果需要，可以添加多个密钥。如果允许未经身份验证的访问，则可以省略。                         |
+| `openai-compatibility.*.models`         | object[] | []                 | 实际的模型名称。                                                                                |
+| `openai-compatibility.*.models.*.name`  | string   | ""                 | 提供商支持的模型。                                                                              |
+| `openai-compatibility.*.models.*.alias` | string   | ""                 | 在API中使用的别名。                                                                             |

 ### 配置文件示例

@@ -263,10 +273,10 @@ auth-dir: "~/.cli-proxy-api"
 # 启用调试日志
 debug: false

-# 代理 URL，支持 socks5/http/https 协议，示例：socks5://user:pass@192.168.1.1:1080/
+# 代理URL。支持socks5/http/https协议。例如：socks5://user:pass@192.168.1.1:1080/
 proxy-url: ""

-# 请求失败重试次数，如果响应的http代码为403、408、500、502、503、504则会自动重试
+# 请求重试次数。如果HTTP响应码为403、408、500、502、503或504，将会触发重试。
 request-retry: 3


@@ -292,8 +302,46 @@ claude-api-key:
  - api-key: "sk-atSM..." # use the official claude API key, no need to set the base url
  - api-key: "sk-atSM..."
    base-url: "https://www.example.com" # use the custom claude API endpoint
+
+# OpenAI 兼容提供商
+openai-compatibility:
+  - name: "openrouter" # 提供商的名称；它将被用于用户代理和其它地方。
+    base-url: "https://openrouter.ai/api/v1" # 提供商的基础URL。
+    api-keys: # 提供商的API密钥。如果需要，可以添加多个密钥。如果允许未经身份验证的访问，则可以省略。
+      - "sk-or-v1-...b780"
+      - "sk-or-v1-...b781"
+    models: # 提供商支持的模型。
+      - name: "moonshotai/kimi-k2:free" # 实际的模型名称。
+        alias: "kimi-k2" # 在API中使用的别名。
 ```

+### OpenAI 兼容上游提供商
+
+通过 `openai-compatibility` 配置上游 OpenAI 兼容提供商（例如 OpenRouter）。
+
+- name：内部识别名
+- base-url：提供商基础地址
+- api-keys：可选，多密钥轮询（若提供商支持无鉴权可省略）
+- models：将上游模型 `name` 映射为本地可用 `alias`
+
+示例：
+
+```yaml
+openai-compatibility:
+  - name: "openrouter"
+    base-url: "https://openrouter.ai/api/v1"
+    api-keys:
+      - "sk-or-v1-...b780"
+      - "sk-or-v1-...b781"
+    models:
+      - name: "moonshotai/kimi-k2:free"
+        alias: "kimi-k2"
+```
+
+使用方式：在 `/v1/chat/completions` 中将 `model` 设为别名（如 `kimi-k2`），代理将自动路由到对应提供商与模型。
+
+并且，对于这些与OpenAI兼容的提供商模型，您始终可以通过将CODE_ASSIST_ENDPOINT设置为 http://127.0.0.1:8317 来使用Gemini CLI。
+
 ### 身份验证目录

 `auth-dir` 参数指定身份验证令牌的存储位置。当您运行登录命令时，应用程序将在此目录中创建包含 Google 账户身份验证令牌的 JSON 文件。多个账户可用于轮询。
@@ -325,7 +373,7 @@ export CODE_ASSIST_ENDPOINT="http://127.0.0.1:8317"
 服务器将中继 `loadCodeAssist`、`onboardUser` 和 `countTokens` 请求。并自动在多个账户之间轮询文本生成请求。

 > [!NOTE]  
-> 此功能仅允许本地访问，因为找不到一个可以验证请求的方法。   
+> 此功能仅允许本地访问，因为找不到一个可以验证请求的方法。
 > 所以只能强制只有 `127.0.0.1` 可以访问。

 ## Claude Code 的使用方法
--- a/config.example.yaml
+++ b/config.example.yaml
@@ -1,23 +1,29 @@
-# Server configuration
+# Server port
 port: 8317
+
+# Authentication directory (supports ~ for home directory)
 auth-dir: "~/.cli-proxy-api"
-debug: true
+
+# Enable debug logging
+debug: false
+
+# Proxy URL. Supports socks5/http/https protocols. Example: socks5://user:pass@192.168.1.1:1080/
 proxy-url: ""

-# Request retry times, if the response http code is 403, 408, 500, 502, 503, 504, it will retry
+# Number of times to retry a request. Retries will occur if the HTTP response code is 403, 408, 500, 502, 503, or 504.
 request-retry: 3

 # Quota exceeded behavior
 quota-exceeded:
-  switch-project: true
-  switch-preview-model: true
+  switch-project: true # Whether to automatically switch to another project when a quota is exceeded
+  switch-preview-model: true # Whether to automatically switch to a preview model when a quota is exceeded

-# API keys for client authentication
+# API keys for authentication
 api-keys:
-  - "12345"
-  - "23456"
+  - "your-api-key-1"
+  - "your-api-key-2"

-# Generative language API keys
+# API keys for official Generative Language API
 generative-language-api-key:
  - "AIzaSy...01"
  - "AIzaSy...02"
@@ -29,3 +35,14 @@ claude-api-key:
  - api-key: "sk-atSM..." # use the official claude API key, no need to set the base url
  - api-key: "sk-atSM..."
    base-url: "https://www.example.com" # use the custom claude API endpoint
+
+# OpenAI compatibility providers
+openai-compatibility:
+  - name: "openrouter" # The name of the provider; it will be used in the user agent and other places.
+    base-url: "https://openrouter.ai/api/v1" # The base URL of the provider.
+    api-keys: # The API keys for the provider. Add multiple keys if needed. Omit if unauthenticated access is allowed.
+      - "sk-or-v1-...b780"
+      - "sk-or-v1-...b781"
+    models: # The models supported by the provider.
+      - name: "moonshotai/kimi-k2:free" # The actual model name.
+        alias: "kimi-k2" # The alias used in the API.
--- a/internal/api/handlers/claude/code_handlers.go
+++ b/internal/api/handlers/claude/code_handlers.go
@@ -148,7 +148,7 @@ outLoop:
 			// Detects when the HTTP client has disconnected and cleans up resources
 			case <-c.Request.Context().Done():
 				if c.Request.Context().Err().Error() == "context canceled" {
-					log.Debugf("GeminiClient disconnected: %v", c.Request.Context().Err())
+					log.Debugf("claude client disconnected: %v", c.Request.Context().Err())
 					cliCancel() // Cancel the backend request to prevent resource leaks
 					return
 				}
--- a/internal/api/handlers/gemini/gemini-cli_handlers.go
+++ b/internal/api/handlers/gemini/gemini-cli_handlers.go
@@ -188,7 +188,7 @@ outLoop:
 			// Handle client disconnection.
 			case <-c.Request.Context().Done():
 				if c.Request.Context().Err().Error() == "context canceled" {
-					log.Debugf("Client disconnected: %v", c.Request.Context().Err())
+					log.Debugf("gemini cli client disconnected: %v", c.Request.Context().Err())
 					cliCancel() // Cancel the backend request.
 					return
 				}
--- a/internal/api/handlers/gemini/gemini_handlers.go
+++ b/internal/api/handlers/gemini/gemini_handlers.go
@@ -290,7 +290,7 @@ outLoop:
 			// Handle client disconnection.
 			case <-c.Request.Context().Done():
 				if c.Request.Context().Err().Error() == "context canceled" {
-					log.Debugf("GeminiClient disconnected: %v", c.Request.Context().Err())
+					log.Debugf("gemini client disconnected: %v", c.Request.Context().Err())
 					cliCancel() // Cancel the backend request.
 					return
 				}
--- a/internal/api/handlers/handlers.go
+++ b/internal/api/handlers/handlers.go
@@ -136,6 +136,8 @@ func (h *BaseAPIHandler) GetClient(modelName string, isGenerateContent ...bool)
 				log.Debugf("Claude Model %s is quota exceeded for account %s", modelName, cliClient.GetEmail())
 			} else if cliClient.Provider() == "qwen" {
 				log.Debugf("Qwen Model %s is quota exceeded for account %s", modelName, cliClient.GetEmail())
+			} else if cliClient.Type() == "openai-compatibility" {
+				log.Debugf("OpenAI Compatibility Model %s is quota exceeded for provider %s", modelName, cliClient.Provider())
 			}
 			cliClient = nil
 			continue
@@ -145,7 +147,7 @@ func (h *BaseAPIHandler) GetClient(modelName string, isGenerateContent ...bool)
 	}

 	if len(reorderedClients) == 0 {
-		if util.GetProviderName(modelName) == "claude" {
+		if util.GetProviderName(modelName, h.Cfg) == "claude" {
 			// log.Debugf("Claude Model %s is quota exceeded for all accounts", modelName)
 			return nil, &interfaces.ErrorMessage{StatusCode: 429, Error: fmt.Errorf(`{"type":"error","error":{"type":"rate_limit_error","message":"This request would exceed your account's rate limit. Please try again later."}}`)}
 		}
--- a/internal/api/handlers/openai/openai_handlers.go
+++ b/internal/api/handlers/openai/openai_handlers.go
@@ -278,7 +278,7 @@ outLoop:
 			// Handle client disconnection.
 			case <-c.Request.Context().Done():
 				if c.Request.Context().Err().Error() == "context canceled" {
-					log.Debugf("Client disconnected: %v", c.Request.Context().Err())
+					log.Debugf("qwen client disconnected: %v", c.Request.Context().Err())
 					cliCancel() // Cancel the backend request.
 					return
 				}
--- a/internal/client/claude_client.go
+++ b/internal/client/claude_client.go
@@ -183,6 +183,7 @@ func (c *ClaudeClient) SendRawMessage(ctx context.Context, modelName string, raw
 		return nil, &interfaces.ErrorMessage{StatusCode: 500, Error: errReadAll}
 	}

+	_ = respBody.Close()
 	c.AddAPIResponseData(ctx, bodyBytes)

 	var param any
@@ -238,6 +239,9 @@ func (c *ClaudeClient) SendRawMessageStream(ctx context.Context, modelName strin
 			return
 		}
 		delete(c.modelQuotaExceeded, modelName)
+		defer func() {
+			_ = stream.Close()
+		}()

 		scanner := bufio.NewScanner(stream)
 		buffer := make([]byte, 10240*1024)
--- a/internal/client/codex_client.go
+++ b/internal/client/codex_client.go
@@ -132,6 +132,7 @@ func (c *CodexClient) SendRawMessage(ctx context.Context, modelName string, rawJ
 		return nil, &interfaces.ErrorMessage{StatusCode: 500, Error: errReadAll}
 	}

+	_ = respBody.Close()
 	c.AddAPIResponseData(ctx, bodyBytes)

 	var param any
@@ -188,6 +189,9 @@ func (c *CodexClient) SendRawMessageStream(ctx context.Context, modelName string
 			return
 		}
 		delete(c.modelQuotaExceeded, modelName)
+		defer func() {
+			_ = stream.Close()
+		}()

 		scanner := bufio.NewScanner(stream)
 		buffer := make([]byte, 10240*1024)
--- a/internal/client/gemini-cli_client.go
+++ b/internal/client/gemini-cli_client.go
@@ -497,6 +497,7 @@ func (c *GeminiCLIClient) SendRawMessage(ctx context.Context, modelName string,
 			return nil, &interfaces.ErrorMessage{StatusCode: 500, Error: errReadAll}
 		}

+		_ = respBody.Close()
 		c.AddAPIResponseData(ctx, bodyBytes)

 		newCtx := context.WithValue(ctx, "alt", alt)
@@ -571,6 +572,11 @@ func (c *GeminiCLIClient) SendRawMessageStream(ctx context.Context, modelName st
 			delete(c.modelQuotaExceeded, modelName)
 			break
 		}
+		defer func() {
+			if stream != nil {
+				_ = stream.Close()
+			}
+		}()

 		newCtx := context.WithValue(ctx, "alt", alt)
 		var param any
--- a/internal/client/gemini_client.go
+++ b/internal/client/gemini_client.go
@@ -249,6 +249,7 @@ func (c *GeminiClient) SendRawMessage(ctx context.Context, modelName string, raw
 		return nil, &interfaces.ErrorMessage{StatusCode: 500, Error: errReadAll}
 	}

+	_ = respBody.Close()
 	c.AddAPIResponseData(ctx, bodyBytes)

 	var param any
@@ -301,6 +302,9 @@ func (c *GeminiClient) SendRawMessageStream(ctx context.Context, modelName strin
 			return
 		}
 		delete(c.modelQuotaExceeded, modelName)
+		defer func() {
+			_ = stream.Close()
+		}()

 		newCtx := context.WithValue(ctx, "alt", alt)
 		var param any
--- a/internal/client/openai-compatibility_client.go
+++ b/internal/client/openai-compatibility_client.go
@@ -0,0 +1,360 @@
+// Package client defines the interface and base structure for AI API clients.
+// It provides a common interface that all supported AI service clients must implement,
+// including methods for sending messages, handling streams, and managing authentication.
+package client
+
+import (
+	"bufio"
+	"bytes"
+	"context"
+	"fmt"
+	"io"
+	"net/http"
+	"strings"
+	"sync"
+	"time"
+
+	"github.com/gin-gonic/gin"
+	"github.com/luispater/CLIProxyAPI/internal/auth"
+	"github.com/luispater/CLIProxyAPI/internal/config"
+	. "github.com/luispater/CLIProxyAPI/internal/constant"
+	"github.com/luispater/CLIProxyAPI/internal/interfaces"
+	"github.com/luispater/CLIProxyAPI/internal/translator/translator"
+	"github.com/luispater/CLIProxyAPI/internal/util"
+	log "github.com/sirupsen/logrus"
+	"github.com/tidwall/sjson"
+)
+
+// OpenAICompatibilityClient implements the Client interface for external OpenAI-compatible API providers.
+// This client handles requests to external services that support OpenAI-compatible APIs,
+// such as OpenRouter, Together.ai, and other similar services.
+type OpenAICompatibilityClient struct {
+	ClientBase
+	compatConfig       *config.OpenAICompatibility
+	currentAPIKeyIndex int
+}
+
+// NewOpenAICompatibilityClient creates a new OpenAI compatibility client instance.
+//
+// Parameters:
+//   - cfg: The application configuration.
+//   - compatConfig: The OpenAI compatibility configuration for the specific provider.
+//
+// Returns:
+//   - *OpenAICompatibilityClient: A new OpenAI compatibility client instance.
+//   - error: An error if the client creation fails.
+func NewOpenAICompatibilityClient(cfg *config.Config, compatConfig *config.OpenAICompatibility) (*OpenAICompatibilityClient, error) {
+	if compatConfig == nil {
+		return nil, fmt.Errorf("compatibility configuration is required")
+	}
+
+	if len(compatConfig.APIKeys) == 0 {
+		return nil, fmt.Errorf("at least one API key is required for OpenAI compatibility provider: %s", compatConfig.Name)
+	}
+
+	httpClient := util.SetProxy(cfg, &http.Client{})
+	client := &OpenAICompatibilityClient{
+		ClientBase: ClientBase{
+			RequestMutex:       &sync.Mutex{},
+			httpClient:         httpClient,
+			cfg:                cfg,
+			modelQuotaExceeded: make(map[string]*time.Time),
+		},
+		compatConfig:       compatConfig,
+		currentAPIKeyIndex: 0,
+	}
+
+	return client, nil
+}
+
+// Type returns the client type.
+func (c *OpenAICompatibilityClient) Type() string {
+	return OPENAI
+}
+
+// Provider returns the provider name for this client.
+func (c *OpenAICompatibilityClient) Provider() string {
+	return c.compatConfig.Name
+}
+
+// CanProvideModel checks if this client can provide the specified model alias.
+//
+// Parameters:
+//   - modelName: The name/alias of the model to check.
+//
+// Returns:
+//   - bool: True if the model alias is supported, false otherwise.
+func (c *OpenAICompatibilityClient) CanProvideModel(modelName string) bool {
+	for _, model := range c.compatConfig.Models {
+		if model.Alias == modelName {
+			return true
+		}
+	}
+	return false
+}
+
+// GetUserAgent returns the user agent string for OpenAI compatibility API requests.
+func (c *OpenAICompatibilityClient) GetUserAgent() string {
+	return fmt.Sprintf("cli-proxy-api-%s", c.compatConfig.Name)
+}
+
+// TokenStorage returns nil as this client doesn't use traditional token storage.
+func (c *OpenAICompatibilityClient) TokenStorage() auth.TokenStorage {
+	return nil
+}
+
+// GetCurrentAPIKey returns the current API key to use, with rotation support.
+func (c *OpenAICompatibilityClient) GetCurrentAPIKey() string {
+	if len(c.compatConfig.APIKeys) == 0 {
+		return ""
+	}
+
+	key := c.compatConfig.APIKeys[c.currentAPIKeyIndex]
+	// Rotate to next key for load balancing
+	c.currentAPIKeyIndex = (c.currentAPIKeyIndex + 1) % len(c.compatConfig.APIKeys)
+	return key
+}
+
+// GetActualModelName returns the actual model name to use with the external API
+// based on the provided alias.
+func (c *OpenAICompatibilityClient) GetActualModelName(alias string) string {
+	for _, model := range c.compatConfig.Models {
+		if model.Alias == alias {
+			return model.Name
+		}
+	}
+	return alias // fallback to alias if not found
+}
+
+// APIRequest makes an HTTP request to the OpenAI-compatible API.
+//
+// Parameters:
+//   - ctx: The context for the request.
+//   - modelName: The model name to use.
+//   - endpoint: The API endpoint path.
+//   - rawJSON: The raw JSON request data.
+//   - alt: Alternative response format (not used for OpenAI compatibility).
+//   - stream: Whether this is a streaming request.
+//
+// Returns:
+//   - io.ReadCloser: The response body reader.
+//   - *interfaces.ErrorMessage: An error message if the request fails.
+func (c *OpenAICompatibilityClient) APIRequest(ctx context.Context, modelName string, endpoint string, rawJSON []byte, alt string, stream bool) (io.ReadCloser, *interfaces.ErrorMessage) {
+	// Replace the model alias with the actual model name in the request
+	actualModelName := c.GetActualModelName(modelName)
+	modifiedJSON, errReplace := sjson.SetBytes(rawJSON, "model", actualModelName)
+	if errReplace != nil {
+		return nil, &interfaces.ErrorMessage{
+			StatusCode: http.StatusInternalServerError,
+			Error:      fmt.Errorf("failed to replace model name: %w", errReplace),
+		}
+	}
+
+	// Create the HTTP request
+	url := strings.TrimSuffix(c.compatConfig.BaseURL, "/") + endpoint
+	req, errReq := http.NewRequestWithContext(ctx, "POST", url, bytes.NewReader(modifiedJSON))
+	if errReq != nil {
+		return nil, &interfaces.ErrorMessage{
+			StatusCode: http.StatusInternalServerError,
+			Error:      fmt.Errorf("failed to create request: %w", errReq),
+		}
+	}
+
+	// Set headers
+	req.Header.Set("Content-Type", "application/json")
+	apiKey := c.GetCurrentAPIKey()
+	if apiKey != "" {
+		req.Header.Set("Authorization", fmt.Sprintf("Bearer %s", apiKey))
+	}
+	req.Header.Set("User-Agent", c.GetUserAgent())
+
+	if stream {
+		req.Header.Set("Accept", "text/event-stream")
+		req.Header.Set("Cache-Control", "no-cache")
+	}
+
+	log.Debugf("OpenAI Compatibility [%s] API request: %s", c.compatConfig.Name, util.HideAPIKey(apiKey))
+
+	// Send the request
+	resp, err := c.httpClient.Do(req)
+	if err != nil {
+		return nil, &interfaces.ErrorMessage{StatusCode: 500, Error: fmt.Errorf("failed to execute request: %v", err)}
+	}
+
+	if resp.StatusCode < 200 || resp.StatusCode >= 300 {
+		defer func() {
+			if err = resp.Body.Close(); err != nil {
+				log.Printf("warn: failed to close response body: %v", err)
+			}
+		}()
+		bodyBytes, _ := io.ReadAll(resp.Body)
+		// log.Debug(string(jsonBody))
+		return nil, &interfaces.ErrorMessage{StatusCode: resp.StatusCode, Error: fmt.Errorf("%s", string(bodyBytes))}
+	}
+
+	return resp.Body, nil
+}
+
+// SendRawMessage sends a raw message to the OpenAI-compatible API.
+//
+// Parameters:
+//   - ctx: The context for the request.
+//   - modelName: The model alias name to use.
+//   - rawJSON: The raw JSON request data.
+//   - alt: Alternative response format parameter.
+//
+// Returns:
+//   - []byte: The response data from the API.
+//   - *interfaces.ErrorMessage: An error message if the request fails.
+func (c *OpenAICompatibilityClient) SendRawMessage(ctx context.Context, modelName string, rawJSON []byte, alt string) ([]byte, *interfaces.ErrorMessage) {
+	handler := ctx.Value("handler").(interfaces.APIHandler)
+	handlerType := handler.HandlerType()
+	rawJSON = translator.Request(handlerType, c.Type(), modelName, rawJSON, false)
+
+	respBody, err := c.APIRequest(ctx, modelName, "/chat/completions", rawJSON, alt, false)
+	if err != nil {
+		if err.StatusCode == 429 {
+			now := time.Now()
+			c.modelQuotaExceeded[modelName] = &now
+		}
+		return nil, err
+	}
+	delete(c.modelQuotaExceeded, modelName)
+	bodyBytes, errReadAll := io.ReadAll(respBody)
+	if errReadAll != nil {
+		return nil, &interfaces.ErrorMessage{StatusCode: 500, Error: errReadAll}
+	}
+
+	_ = respBody.Close()
+	c.AddAPIResponseData(ctx, bodyBytes)
+
+	var param any
+	bodyBytes = []byte(translator.ResponseNonStream(handlerType, c.Type(), ctx, modelName, bodyBytes, &param))
+
+	return bodyBytes, nil
+}
+
+// SendRawMessageStream sends a raw streaming message to the OpenAI-compatible API.
+//
+// Parameters:
+//   - ctx: The context for the request.
+//   - modelName: The model alias name to use.
+//   - rawJSON: The raw JSON request data.
+//   - alt: Alternative response format parameter.
+//
+// Returns:
+//   - <-chan []byte: A channel that will receive response chunks.
+//   - <-chan *interfaces.ErrorMessage: A channel that will receive error messages.
+func (c *OpenAICompatibilityClient) SendRawMessageStream(ctx context.Context, modelName string, rawJSON []byte, alt string) (<-chan []byte, <-chan *interfaces.ErrorMessage) {
+	handler := ctx.Value("handler").(interfaces.APIHandler)
+	handlerType := handler.HandlerType()
+	rawJSON = translator.Request(handlerType, c.Type(), modelName, rawJSON, true)
+
+	dataTag := []byte("data: ")
+	doneTag := []byte("data: [DONE]")
+	errChan := make(chan *interfaces.ErrorMessage)
+	dataChan := make(chan []byte)
+	// log.Debugf(string(rawJSON))
+	// return dataChan, errChan
+	go func() {
+		defer close(errChan)
+		defer close(dataChan)
+
+		// Set streaming flag in the request
+		rawJSON, _ = sjson.SetBytes(rawJSON, "stream", true)
+
+		newCtx := context.WithValue(ctx, "gin", ctx.Value("gin").(*gin.Context))
+
+		stream, err := c.APIRequest(newCtx, modelName, "/chat/completions", rawJSON, alt, true)
+		if err != nil {
+			if err.StatusCode == 429 {
+				now := time.Now()
+				c.modelQuotaExceeded[modelName] = &now
+			}
+			errChan <- err
+			return
+		}
+		delete(c.modelQuotaExceeded, modelName)
+		defer func() {
+			_ = stream.Close()
+		}()
+
+		scanner := bufio.NewScanner(stream)
+
+		if translator.NeedConvert(handlerType, c.Type()) {
+			var param any
+			for scanner.Scan() {
+				line := scanner.Bytes()
+				if bytes.HasPrefix(line, dataTag) {
+					if bytes.Equal(line, doneTag) {
+						break
+					}
+					lines := translator.Response(handlerType, c.Type(), newCtx, modelName, line[6:], &param)
+					for i := 0; i < len(lines); i++ {
+						dataChan <- []byte(lines[i])
+					}
+				}
+			}
+		} else {
+			// No translation needed, stream data directly
+			for scanner.Scan() {
+				line := scanner.Bytes()
+				if bytes.HasPrefix(line, dataTag) {
+					if bytes.Equal(line, doneTag) {
+						break
+					}
+					c.AddAPIResponseData(newCtx, line[6:])
+					dataChan <- line[6:]
+				}
+			}
+		}
+
+		if scanner.Err() != nil {
+			errChan <- &interfaces.ErrorMessage{StatusCode: 500, Error: scanner.Err()}
+		}
+	}()
+
+	return dataChan, errChan
+}
+
+// SendRawTokenCount sends a token count request (not implemented for OpenAI compatibility).
+// This method is required by the Client interface but not supported by OpenAI compatibility clients.
+func (c *OpenAICompatibilityClient) SendRawTokenCount(ctx context.Context, modelName string, rawJSON []byte, alt string) ([]byte, *interfaces.ErrorMessage) {
+	return nil, &interfaces.ErrorMessage{
+		StatusCode: http.StatusNotImplemented,
+		Error:      fmt.Errorf("token counting not supported for OpenAI compatibility clients"),
+	}
+}
+
+// GetEmail returns a placeholder email for this OpenAI compatibility client.
+// Since these clients don't use traditional email-based authentication,
+// we return the provider name as an identifier.
+func (c *OpenAICompatibilityClient) GetEmail() string {
+	return fmt.Sprintf("openai-compatibility-%s", c.compatConfig.Name)
+}
+
+// IsModelQuotaExceeded checks if the specified model has exceeded its quota.
+// For OpenAI compatibility clients, this is based on tracked quota exceeded times.
+func (c *OpenAICompatibilityClient) IsModelQuotaExceeded(model string) bool {
+	if quota, exists := c.modelQuotaExceeded[model]; exists && quota != nil {
+		// Check if quota exceeded time is less than 5 minutes ago
+		if time.Since(*quota) < 5*time.Minute {
+			return true
+		}
+		// Clear expired quota tracking
+		delete(c.modelQuotaExceeded, model)
+	}
+	return false
+}
+
+// SaveTokenToFile returns nil as this client type doesn't use traditional token storage.
+func (c *OpenAICompatibilityClient) SaveTokenToFile() error {
+	// No token file to save for OpenAI compatibility clients
+	return nil
+}
+
+// RefreshTokens is not applicable for OpenAI compatibility clients as they use API keys.
+func (c *OpenAICompatibilityClient) RefreshTokens(ctx context.Context) error {
+	// API keys don't need refreshing
+	return nil
+}
--- a/internal/client/qwen_client.go
+++ b/internal/client/qwen_client.go
@@ -128,6 +128,7 @@ func (c *QwenClient) SendRawMessage(ctx context.Context, modelName string, rawJS
 		return nil, &interfaces.ErrorMessage{StatusCode: 500, Error: errReadAll}
 	}

+	_ = respBody.Close()
 	c.AddAPIResponseData(ctx, bodyBytes)

 	var param any
@@ -186,6 +187,9 @@ func (c *QwenClient) SendRawMessageStream(ctx context.Context, modelName string,
 			return
 		}
 		delete(c.modelQuotaExceeded, modelName)
+		defer func() {
+			_ = stream.Close()
+		}()

 		scanner := bufio.NewScanner(stream)
 		buffer := make([]byte, 10240*1024)
--- a/internal/cmd/run.go
+++ b/internal/cmd/run.go
@@ -150,6 +150,18 @@ func StartService(cfg *config.Config, configPath string) {
 		}
 	}

+	if len(cfg.OpenAICompatibility) > 0 {
+		// Initialize clients for OpenAI compatibility configurations
+		for _, compatConfig := range cfg.OpenAICompatibility {
+			log.Debugf("Initializing OpenAI compatibility client for provider: %s", compatConfig.Name)
+			compatClient, errClient := client.NewOpenAICompatibilityClient(cfg, &compatConfig)
+			if errClient != nil {
+				log.Fatalf("failed to create OpenAI compatibility client for %s: %v", compatConfig.Name, errClient)
+			}
+			cliClients = append(cliClients, compatClient)
+		}
+	}
+
 	// Create and start the API server with the pool of clients in a separate goroutine.
 	apiServer := api.NewServer(cfg, cliClients)
 	log.Infof("Starting API server on port %d", cfg.Port)
--- a/internal/config/config.go
+++ b/internal/config/config.go
@@ -41,6 +41,9 @@ type Config struct {
 	RequestRetry int `yaml:"request-retry"`

 	ClaudeKey []ClaudeKey `yaml:"claude-api-key"`
+
+	// OpenAICompatibility defines OpenAI API compatibility configurations for external providers.
+	OpenAICompatibility []OpenAICompatibility `yaml:"openai-compatibility"`
 }

 // QuotaExceeded defines the behavior when API quota limits are exceeded.
@@ -64,6 +67,32 @@ type ClaudeKey struct {
 	BaseURL string `yaml:"base-url"`
 }

+// OpenAICompatibility represents the configuration for OpenAI API compatibility
+// with external providers, allowing model aliases to be routed through OpenAI API format.
+type OpenAICompatibility struct {
+	// Name is the identifier for this OpenAI compatibility configuration.
+	Name string `yaml:"name"`
+
+	// BaseURL is the base URL for the external OpenAI-compatible API endpoint.
+	BaseURL string `yaml:"base-url"`
+
+	// APIKeys are the authentication keys for accessing the external API services.
+	APIKeys []string `yaml:"api-keys"`
+
+	// Models defines the model configurations including aliases for routing.
+	Models []OpenAICompatibilityModel `yaml:"models"`
+}
+
+// OpenAICompatibilityModel represents a model configuration for OpenAI compatibility,
+// including the actual model name and its alias for API routing.
+type OpenAICompatibilityModel struct {
+	// Name is the actual model name used by the external provider.
+	Name string `yaml:"name"`
+
+	// Alias is the model name alias that clients will use to reference this model.
+	Alias string `yaml:"alias"`
+}
+
 // LoadConfig reads a YAML configuration file from the given path,
 // unmarshals it into a Config struct, applies environment variable overrides,
 // and returns it.
--- a/internal/constant/constant.go
+++ b/internal/constant/constant.go
@@ -1,9 +1,10 @@
 package constant

 const (
-	GEMINI    = "gemini"
-	GEMINICLI = "gemini-cli"
-	CODEX     = "codex"
-	CLAUDE    = "claude"
-	OPENAI    = "openai"
+	GEMINI               = "gemini"
+	GEMINICLI            = "gemini-cli"
+	CODEX                = "codex"
+	CLAUDE               = "claude"
+	OPENAI               = "openai"
+	OPENAI_COMPATIBILITY = "openai-compatibility"
 )
--- a/internal/util/provider.go
+++ b/internal/util/provider.go
@@ -5,25 +5,33 @@ package util

 import (
 	"strings"
+
+	"github.com/luispater/CLIProxyAPI/internal/config"
 )

 // GetProviderName determines the AI service provider based on the model name.
 // It analyzes the model name string to identify which service provider it belongs to.
+// First checks for OpenAI compatibility aliases, then falls back to standard provider detection.
 //
 // Supported providers:
 //   - "gemini" for Google's Gemini models
 //   - "gpt" for OpenAI's GPT models
 //   - "claude" for Anthropic's Claude models
 //   - "qwen" for Alibaba's Qwen models
+//   - "openai-compatibility" for external OpenAI-compatible providers
 //   - "unknow" for unrecognized model names
 //
 // Parameters:
 //   - modelName: The name of the model to identify the provider for.
+//   - cfg: The application configuration containing OpenAI compatibility settings.
 //
 // Returns:
 //   - string: The name of the provider.
-func GetProviderName(modelName string) string {
-	if strings.Contains(modelName, "gemini") {
+func GetProviderName(modelName string, cfg *config.Config) string {
+	// First check if this model name is an OpenAI compatibility alias
+	if IsOpenAICompatibilityAlias(modelName, cfg) {
+		return "openai-compatibility"
+	} else if strings.Contains(modelName, "gemini") { // Fall back to standard provider detection
 		return "gemini"
 	} else if strings.Contains(modelName, "gpt") {
 		return "gpt"
@@ -37,6 +45,55 @@ func GetProviderName(modelName string) string {
 	return "unknow"
 }

+// IsOpenAICompatibilityAlias checks if the given model name is an alias
+// configured for OpenAI compatibility routing.
+//
+// Parameters:
+//   - modelName: The model name to check
+//   - cfg: The application configuration containing OpenAI compatibility settings
+//
+// Returns:
+//   - bool: True if the model name is an OpenAI compatibility alias, false otherwise
+func IsOpenAICompatibilityAlias(modelName string, cfg *config.Config) bool {
+	if cfg == nil {
+		return false
+	}
+
+	for _, compat := range cfg.OpenAICompatibility {
+		for _, model := range compat.Models {
+			if model.Alias == modelName {
+				return true
+			}
+		}
+	}
+	return false
+}
+
+// GetOpenAICompatibilityConfig returns the OpenAI compatibility configuration
+// and model details for the given alias.
+//
+// Parameters:
+//   - alias: The model alias to find configuration for
+//   - cfg: The application configuration containing OpenAI compatibility settings
+//
+// Returns:
+//   - *config.OpenAICompatibility: The matching compatibility configuration, or nil if not found
+//   - *config.OpenAICompatibilityModel: The matching model configuration, or nil if not found
+func GetOpenAICompatibilityConfig(alias string, cfg *config.Config) (*config.OpenAICompatibility, *config.OpenAICompatibilityModel) {
+	if cfg == nil {
+		return nil, nil
+	}
+
+	for _, compat := range cfg.OpenAICompatibility {
+		for _, model := range compat.Models {
+			if model.Alias == alias {
+				return &compat, &model
+			}
+		}
+	}
+	return nil, nil
+}
+
 // InArray checks if a string exists in a slice of strings.
 // It iterates through the slice and returns true if the target string is found,
 // otherwise it returns false.