54 Commits

• Add JSON annotations to configuration structs and new /config management endpoint

  - Added JSON annotations across all configuration structs in `config.go`.
  - Introduced `/config` management API endpoint to fetch complete configuration.
  - Updated management API documentation (`MANAGEMENT_API.md`, `MANAGEMENT_API_CN.md`) with `/config` usage.
  - Implemented `GetConfig` handler in `config_basic.go`.

  Luis Pater · 2025-09-06 20:45:51 +08:00
  6164f5c35b
• feat(api): implement granular client type metrics in server updates
  hkfires · 2025-09-05 19:26:57 +08:00
  28218ec550
• Add reverse mappings for original tool names and improve error logging

  - Introduced reverse mapping logic for tool names in translators to restore original names when shortened.
  - Enhanced error handling by logging API response errors consistently across handlers.
  - Refactored request and response loggers to include API error details, improving debugging capabilities.
  - Integrated robust tool name shortening and uniqueness mechanisms for OpenAI, Gemini, and Claude requests.
  - Improved handler retry logic to properly capture and respond to errors.

  Luis Pater · 2025-09-04 02:39:56 +08:00
  ad943b2d4d
• Refactor cliCancel calls to remove unused resp argument across handlers.
  Luis Pater · 2025-09-03 21:13:22 +08:00
  70e916942e
• feat(watcher): implement incremental client hot-reloading
  hkfires · 2025-09-03 20:47:43 +08:00
  f60ef0b2e7
• Add support for Codex API key authentication

  - Introduced functionality to handle Codex API keys, including initialization and management via new endpoints in the management API.
  - Updated Codex client to support both OAuth and API key authentication.
  - Documented Codex API key configuration in both English and Chinese README files.
  - Enhanced logging to distinguish between API key and OAuth usage scenarios.

  Luis Pater · 2025-09-03 03:36:56 +08:00
  c4a42eb1f0
• Refactor translator packages for OpenAI Chat Completions

  - Renamed `openai` packages to `chat_completions` across translator modules.
  - Introduced `openai_responses_handlers` with handlers for `/v1/models` and OpenAI-compatible chat completions endpoints.
  - Updated constants and registry identifiers for OpenAI response type.
  - Simplified request/response conversions and added detailed retry/error handling.
  - Added `golang.org/x/crypto` for additional cryptographic functions.

  Luis Pater · 2025-09-01 11:00:47 +08:00
  e11637dc62
• Refactor translator packages for OpenAI Chat Completions

  - Renamed `openai` packages to `chat_completions` across translator modules.
  - Introduced `openai_responses_handlers` with handlers for `/v1/models` and OpenAI-compatible chat completions endpoints.
  - Updated constants and registry identifiers for OpenAI response type.
  - Simplified request/response conversions and added detailed retry/error handling.
  - Added `golang.org/x/crypto` for additional cryptographic functions.

  Luis Pater · 2025-09-01 08:18:59 +08:00
  e3994ace33
• Add management API handlers for config and auth file management

  - Implemented CRUD operations for authentication files.
  - Added endpoints for managing API keys, quotas, proxy settings, and other configurations.
  - Enhanced management access with robust validation, remote access control, and persistence support.
  - Updated README with new configuration details.
  
  Fixed OpenAI Chat Completions for codex

  Luis Pater · 2025-08-31 14:29:23 +08:00
  db43930b98
• Add token refresh handling for 401 responses across clients

  - Implemented `RefreshTokens` method in client interfaces and Gemini clients.
  - Updated handlers to call `RefreshTokens` on 401 responses and retry requests if token refresh succeeds.
  - Enhanced error handling and retry logic to accommodate token refresh flow.

  Luis Pater · 2025-08-30 16:10:56 +08:00
  512c8b600a
• Update README documentation to clarify auth-dir configuration for Windows users

  - Added a note for setting `auth-dir` on Windows systems in both English and Chinese README files.
  - Improved descriptions for existing configuration options.
  
  Address Qwen3 tool injection issue to prevent random token insertions
  
  - Modify Qwen client to insert a placeholder tool when none is defined, avoiding erratic behavior in streaming responses.

  Luis Pater · 2025-08-29 17:28:55 +08:00
  f1d9364ef4
• Unlock mutex before returning error in handlers.go to prevent deadlocks
  Luis Pater · 2025-08-29 09:46:12 +08:00
  09b9d3b3fa
• Fix some bugs.
  Luis Pater · 2025-08-29 04:05:08 +08:00
  e9e0016a63
• Add nil-check for GetRequestMutex across handlers to prevent potential panics

  - Updated all handlers to safely unlock the request mutex only if it's non-nil.
  - Enhanced mutex locking and unlocking logic to avoid runtime errors.
  - Improved robustness of resource cleanup across clients.
  
  Add `GetRequestMutex` method for synchronization across clients
  
  - Introduced a new `GetRequestMutex` method in OpenAICompatibilityClient, CodexClient, GeminiCLIClient, GeminiClient, and QwenClient for request synchronization.
  - Ensures only one request is processed at a time to manage quotas effectively.

  Luis Pater · 2025-08-29 00:23:37 +08:00
  3704dae342
• Add /v1/completions endpoint with OpenAI compatibility

  - Implemented `/v1/completions` endpoint mirroring OpenAI's completions API specification.
  - Added conversion functions to translate between completions and chat completions formats.
  - Introduced streaming and non-streaming response handling for completions requests.
  - Updated `server.go` to register the new endpoint and include it in the API's metadata.

  Luis Pater · 2025-08-28 00:30:46 +08:00
  bea5f97cbf
• Suppress debug logs for model routing and ignore empty tools arrays

  - Comment out verbose routing logs in the API server to reduce noise.
  - Remove the `tools` field from Qwen client requests when it is an empty array.
  - Add guards in Claude, Codex, Gemini‑CLI, and Gemini translators to skip tool conversion when the `tools` array is empty, preventing unnecessary payload modifications.

  Luis Pater · 2025-08-27 22:29:08 +08:00
  7a6adfa97e
• Add support for localhost unauthenticated requests

  - Introduced `AllowLocalhostUnauthenticated` flag allowing unauthenticated requests from localhost.
  - Updated authentication middleware to bypass checks for localhost when enabled.
  
  Add new Gemini CLI models and update model registry function
  
  - Introduced `GetGeminiCLIModels` for updated Gemini CLI model definitions.
  - Added new models: "Gemini 2.5 Flash Lite" and "Gemini 2.5 Pro".
  - Updated `RegisterModels` to use `GetGeminiCLIModels` in Gemini client initialization.

  Luis Pater · 2025-08-27 21:20:25 +08:00
  1c4183d943
• Improved the /v1/models endpoint
  Luis Pater · 2025-08-27 21:01:37 +08:00
  dff31a7a4c
• Add OpenAI compatibility support and improve resource cleanup

  - Introduced OpenAI compatibility configurations for external providers, enabling model alias routing via the OpenAI API format.
  - Enhanced provider logic in `GetProviderName` to handle OpenAI aliases and added new helper functions for compatibility checks.
  - Updated API handlers and client initialization to support OpenAI compatibility models.
  - Improved resource cleanup across clients by closing response bodies and streams using deferred functions.

  Luis Pater · 2025-08-26 03:33:46 +08:00
  ed8873fbb0
• Refactor API handlers to implement retry mechanism with configurable limits and improved error handling

  - Introduced retry counter with a configurable ` RequestRetry ` limit in all handlers.
  - Enhanced error handling with specific HTTP status codes for switching clients.
  - Standardized response forwarding for non-retriable errors.
  - Improved logging for quota and client switch scenarios.

  Luis Pater · 2025-08-25 23:43:49 +08:00
  9102ff031d
• Refactor codebase
  Luis Pater · 2025-08-25 16:58:16 +08:00
  8c555c4e69
• Add Qwen support
  Luis Pater · 2025-08-21 15:22:53 +08:00
  aa2f37d54d
• Add claude code support
  Luis Pater · 2025-08-21 02:53:28 +08:00
  d58cc55cb2
• Refactor error handling and variable declarations in browser and logging modules

  - Simplified variable initialization in `browser.go` for readability.
  - Updated error handling in `request_logger.go` with better resource cleanup using deferred anonymous functions.
  
  Refactor API handlers to use `GetContextWithCancel` for streamlined context creation and response handling
  
  - Replaced redundant `context.WithCancel` and `context.WithValue` logic with the new `GetContextWithCancel` utility in all handlers.
  - Centralized API response storage in the given context during cancellation.
  - Updated associated cancellation calls for consistency and improved resource management.
  
  - Replaced `apiResponseData` with `AddAPIResponseData` for centralized response recording.
  - Simplified cancellation logic by switching to a boolean-based `cliCancel` method.
  - Removed unused `apiResponseData` slices across handlers to reduce memory usage.
  - Updated `handlers.go` to support unified response data storage per request context.

  Luis Pater · 2025-08-17 20:13:45 +08:00
  c5cc238308
• Refactor Gemini API handlers to standardize response field names and improve model descriptions
  Luis Pater · 2025-08-17 00:28:13 +08:00
  6bbdf67f96
• Add request logging capabilities to API handlers and update .gitignore

  Enhance API response handling by storing responses in context and updating request logger to include API responses

  Luis Pater · 2025-08-16 06:09:04 +08:00
  fcadf08921
• Add openai codex support
  Luis Pater · 2025-08-16 01:22:33 +08:00
  de7b8501cc
• Refactor API handlers organization and simplify error response handling

  - Modularized handlers into dedicated packages (`gemini`, `claude`, `cli`) for better structure.
  - Centralized `ErrorResponse` and `ErrorDetail` types under `handlers` package for reuse.
  - Updated all handlers to utilize the shared `ErrorResponse` model.
  - Introduced specialization of handler structs (`GeminiAPIHandlers`, `ClaudeCodeAPIHandlers`, `GeminiCLIAPIHandlers`) for improved clarity and separation of concerns.
  - Refactored `getClient` logic with additional properties and better state management.
  
  Refactor `translator` package by modularizing code for `claude` and `gemini`
  
  - Moved Claude-specific logic (`PrepareClaudeRequest`, `ConvertCliToClaude`) to `translator/claude/code`.
  - Moved Gemini-specific logic (`FixCLIToolResponse`) to `translator/gemini/cli` for better package structure.
  - Updated affected handler imports and method references.
  
  Add comprehensive package-level documentation across key modules
  
  - Introduced detailed package-level documentation for core modules: `auth`, `client`, `cmd`, `handlers`, `util`, `watcher`, `config`, `translator`, and `api`.
  - Enhanced code readability and maintainability by clarifying the purpose and functionality of each package.
  - Aligned documentation style and tone with existing codebase conventions.
  
  Refactor API handlers and translator modules for improved clarity and consistency
  
  - Standardized handler struct names (`GeminiAPIHandlers`, `ClaudeCodeAPIHandlers`, `GeminiCLIAPIHandlers`, `OpenAIAPIHandlers`) and updated related comments.
  - Fixed unnecessary `else` blocks in streaming logic for cleaner error handling.
  - Renamed variables for better readability (`responseIdResult` to `responseIDResult`, `activationUrl` to `activationURL`, etc.).
  - Addressed minor inconsistencies in API handler comments and SSE header initialization.
  - Improved modularization of `claude` and `gemini` translator components.
  
  Standardize configuration field naming for consistency across modules
  
  - Renamed `ProxyUrl` to `ProxyURL`, `ApiKeys` to `APIKeys`, and `ConfigQuotaExceeded` to `QuotaExceeded`.
  - Updated all relevant references and comments in `config`, `auth`, `api`, `util`, and `watcher`.
  - Ensured consistent casing for `GlAPIKey` debug logs.

  Luis Pater · 2025-08-05 23:11:31 +08:00
  1483c31c73
• Enhance Gemini request handling for contents support and improve error logging

  - Added conditional logic to process `contents` in Gemini request templates, ensuring fallback behavior.
  - Introduced detailed debug logs for quota errors and request issues.
  - Updated handling of `rawJson` to construct templates more dynamically.

  Luis Pater · 2025-08-04 02:51:00 +08:00
  00f33f5f3a
• Add file watcher for dynamic configuration and client reloading

  - Introduced `Watcher` for monitoring updates to the configuration file and authentication directory.
  - Integrated file watching into `StartService` to handle dynamic changes without restarting.
  - Enhanced API server and handlers to support client and configuration updates.
  - Updated `.gitignore` to include `docs/` directory.
  - Modified go dependencies to include `fsnotify` for the file watcher.

  Luis Pater · 2025-08-02 16:15:56 +08:00
  3c4dc07980
• Improve getClient logic with optional content generation flag

  - Added `isGenerateContent` optional parameter to `getClient` for conditional client selection.
  - Updated `gemini-handlers` to utilize the new parameter for enhanced control.

  Luis Pater · 2025-07-27 02:30:08 +08:00
  3b4634e2dc
• Fix SSE headers initialization for geminiStreamGenerateContent and internalStreamGenerateContent

  - Added conditional logic to properly initialize SSE headers only when `alt` is empty.
  - Ensured headers like `Content-Type`, `Cache-Control`, and `Access-Control-Allow-Origin` are set for better compatibility.

  Luis Pater · 2025-07-26 17:16:55 +08:00
  3b2ab0d7bd
• Enhance Gemini request handling with fallback support for contents

  - Added conditional logic to support `contents` as a fallback to `generateContentRequest`.
  - Improved template construction and ensured proper cleanup of request fields.
  - Introduced debug logging for troubleshooting request generation.

  Luis Pater · 2025-07-26 17:04:14 +08:00
  e64fa48823
• Add GeminiGetHandler, enhance Gemini functionality, and enable token counting

  - Added `GeminiGetHandler` for handling GET requests with extended Gemini model support.
  - Introduced `geminiCountTokens` function to calculate token usage.
  - Refactored `APIRequest` and related methods to support `alt` parameter for enhanced flexibility.
  - Updated routes and request processing to integrate new handler and functions.

  Luis Pater · 2025-07-26 06:51:49 +08:00
  31a9e2d11f
• Add GeminiModels handler and enhance API key validation

  - Introduced `GeminiModels` handler to serve Gemini model information under `/v1beta/models`.
  - Updated `AuthMiddleware` to validate API keys from query parameters for improved flexibility.
  - Adjusted route to use the new handler for model retrieval.

  Luis Pater · 2025-07-26 04:41:55 +08:00
  423faae3da
• Refactor client handling and improve error responses

  - Centralized client retrieval logic with `getClient` function for reduced redundancy.
  - Simplified client rotation and error handling by removing excessive load balancing logic.
  - Updated server address in `auth.go` to use dynamic binding (`:8085`).

  Luis Pater · 2025-07-15 17:03:18 +08:00
  f49a530c1a
• Add ClaudeMessages handler for SSE-compatible chat completions

  - Introduced `ClaudeMessages` to handle Claude-compatible streaming chat completions.
  - Implemented client rotation, quota management, and dynamic model name mapping for better load balancing and resource utilization.
  - Enhanced response streaming with real-time chunking and Claude format conversion.
  - Added error handling for quota exhaustion, client disconnections, and backend failures.

  Luis Pater · 2025-07-11 13:53:09 +08:00
  c601542f6f
• Add Claude compatibility and enhance API handling

  - Integrated Claude API compatibility in handlers, translators, and server routes.
  - Introduced `/messages` endpoint and upgraded `AuthMiddleware` for `X-Api-Key` header.
  - Improved streaming response handling with `ConvertCliToClaude` for SSE compatibility.
  - Enhanced request processing and tool-response mapping in translators.
  - Updated README to reflect Claude integration and clarify supported features.

  Luis Pater · 2025-07-11 13:46:27 +08:00
  3c0c61aaf1
• Restrict CLI access to localhost and update README for Gemini compatibility

  - Added localhost-only access restriction to `CLIHandler` for security.
  - Updated README to reflect Gemini-compatible API and local access limitation notes.

  Luis Pater · 2025-07-11 10:57:23 +08:00
  edeadfc389
• Add FixCLIToolResponse for enhanced function call-response mapping

  - Introduced `FixCLIToolResponse` in `translator` to group function calls with corresponding responses.
  - Updated Gemini handlers to integrate new function for improved response handling.
  - Enhanced error handling in case response mapping fails.

  Luis Pater · 2025-07-11 10:17:25 +08:00
  aa9fd057fe
• Add Gemini-compatible API and improve error handling

  - Introduced a new Gemini-compatible API with routes under `/v1beta`.
  - Added `GeminiHandler` to manage `generateContent` and `streamGenerateContent` actions.
  - Enhanced `AuthMiddleware` to support `X-Goog-Api-Key` header.
  - Improved client metadata handling and added conditional project ID updates in API calls.
  - Updated logging to debug raw API request payloads for better traceability.

  Luis Pater · 2025-07-11 04:01:45 +08:00
  b3607d3981
• Enhance response and request handling in translators

  - Refactored response handling to process multiple content parts effectively.
  - Improved `tool_calls` structure with unique ID generation and enhanced mapping logic.
  - Simplified `SystemInstruction` and tool message parsing in requests for better accuracy.
  - Enhanced handling of function calls and tool responses with improved data integration.

  Luis Pater · 2025-07-10 22:26:04 +08:00
  fa8d94971f
• Refactor API handlers and proxy logic

  - Centralized `getClient` logic into a dedicated function to reduce redundancy.
  - Moved proxy initialization to a new utility function `SetProxy` in `internal/util/proxy.go`.
  - Replaced `Internal` handler with `CLIHandler` in `server.go` for improved clarity and consistency.
  - Removed unused functions and redundant HTTP client setup across the codebase for better maintainability.

  Luis Pater · 2025-07-10 17:45:28 +08:00
  ef68a97526
• Add system instruction support and enhance internal API handlers

  - Introduced `SystemInstruction` field in `PrepareRequest` and `GenerateContentRequest` for better message parsing.
  - Updated `SendMessage` and `SendMessageStream` to handle system instructions in client API calls.
  - Enhanced error handling and manual flushing logic in response flows.
  - Added new internal API endpoints `/v1internal:generateContent` and `/v1internal:streamGenerateContent`.
  - Improved proxy handling and transport logic in HTTP client initialization.

  Luis Pater · 2025-07-10 05:16:54 +08:00
  273e1d9cbe
• Add support for Generative Language API Key and improve client initialization

  - Added `GlAPIKey` support in configuration to enable Generative Language API.
  - Integrated `GenerativeLanguageAPIKey` handling in client and API handlers.
  - Updated response translators to manage generative language responses properly.
  - Enhanced HTTP client initialization logic with proxy support for API requests.
  - Refactored streaming and non-streaming flows to account for generative language-specific logic.

  Luis Pater · 2025-07-06 02:13:11 +08:00
  589ae6d3aa
• Enhance quota management and refactor configuration handling

  - Introduced `QuotaExceeded` settings in configuration to handle quota limits more effectively.
  - Added preview model switching logic to `Client` to automatically use fallback models on quota exhaustion.
  - Refactored `APIHandlers` to leverage new configuration structure.
  - Simplified server initialization and removed redundant `ServerConfig` structure.
  - Streamlined client initialization by unifying configuration handling throughout the project.
  - Improved error handling and response mechanisms in both streaming and non-streaming flows.

  Luis Pater · 2025-07-05 07:53:46 +08:00
  7cb76ae1a5
• Refactor API handlers to streamline response handling

  - Replaced channel-based handling in `SendMessage` flow with direct synchronous execution.
  - Introduced `hasFirstResponse` flag to manage keep-alive signals in streaming handler.
  - Simplified error handling and removed redundant code for enhanced readability and maintainability.

  Luis Pater · 2025-07-05 04:10:00 +08:00
  e73f165070
• Refactor API request flow and streamline response handling

  - Replaced `SendMessageStream` with synchronous `SendMessage` in API handlers for better manageability.
  - Simplified `ConvertCliToOpenAINonStream` to reduce complexity and improve efficiency.
  - Adjusted `client.go` functions to handle both streaming and non-streaming API requests more effectively.
  - Improved error handling and channel communication in API handlers.
  - Removed redundant and unused code for cleaner implementation.

  Luis Pater · 2025-07-05 02:27:34 +08:00
  512f2d5247
• Numerous Comments Added and Extensive Optimization Performed using Roo-Code with CLIProxyAPI itself.
  Luis Pater · 2025-07-04 18:44:55 +08:00
  5ec6450c50
• Update model name to include release date in API handlers
  Luis Pater · 2025-07-04 17:26:23 +08:00
  8dd7f8e82f