318 Commits

  • Add ClaudeMessages handler for SSE-compatible chat completions
    - Introduced `ClaudeMessages` to handle Claude-compatible streaming chat completions.
    - Implemented client rotation, quota management, and dynamic model name mapping for better load balancing and resource utilization.
    - Enhanced response streaming with real-time chunking and Claude format conversion.
    - Added error handling for quota exhaustion, client disconnections, and backend failures.
  • Add Claude compatibility and enhance API handling
    - Integrated Claude API compatibility in handlers, translators, and server routes.
    - Introduced `/messages` endpoint and upgraded `AuthMiddleware` for `X-Api-Key` header.
    - Improved streaming response handling with `ConvertCliToClaude` for SSE compatibility.
    - Enhanced request processing and tool-response mapping in translators.
    - Updated README to reflect Claude integration and clarify supported features.
  • Restrict CLI access to localhost and update README for Gemini compatibility
    - Added localhost-only access restriction to `CLIHandler` for security.
    - Updated README to reflect Gemini-compatible API and local access limitation notes.
  • Add FixCLIToolResponse for enhanced function call-response mapping
    - Introduced `FixCLIToolResponse` in `translator` to group function calls with corresponding responses.
    - Updated Gemini handlers to integrate new function for improved response handling.
    - Enhanced error handling in case response mapping fails.
  • Add Gemini-compatible API and improve error handling
    - Introduced a new Gemini-compatible API with routes under `/v1beta`.
    - Added `GeminiHandler` to manage `generateContent` and `streamGenerateContent` actions.
    - Enhanced `AuthMiddleware` to support `X-Goog-Api-Key` header.
    - Improved client metadata handling and added conditional project ID updates in API calls.
    - Updated logging to debug raw API request payloads for better traceability.
  • Enhance response and request handling in translators
    - Refactored response handling to process multiple content parts effectively.
    - Improved `tool_calls` structure with unique ID generation and enhanced mapping logic.
    - Simplified `SystemInstruction` and tool message parsing in requests for better accuracy.
    - Enhanced handling of function calls and tool responses with improved data integration.
  • Refactor API handlers and proxy logic
    - Centralized `getClient` logic into a dedicated function to reduce redundancy.
    - Moved proxy initialization to a new utility function `SetProxy` in `internal/util/proxy.go`.
    - Replaced `Internal` handler with `CLIHandler` in `server.go` for improved clarity and consistency.
    - Removed unused functions and redundant HTTP client setup across the codebase for better maintainability.
  • Add system instruction support and enhance internal API handlers
    - Introduced `SystemInstruction` field in `PrepareRequest` and `GenerateContentRequest` for better message parsing.
    - Updated `SendMessage` and `SendMessageStream` to handle system instructions in client API calls.
    - Enhanced error handling and manual flushing logic in response flows.
    - Added new internal API endpoints `/v1internal:generateContent` and `/v1internal:streamGenerateContent`.
    - Improved proxy handling and transport logic in HTTP client initialization.
  • Add support for Generative Language API Key and improve client initialization
    - Added `GlAPIKey` support in configuration to enable Generative Language API.
    - Integrated `GenerativeLanguageAPIKey` handling in client and API handlers.
    - Updated response translators to manage generative language responses properly.
    - Enhanced HTTP client initialization logic with proxy support for API requests.
    - Refactored streaming and non-streaming flows to account for generative language-specific logic.
  • Enhance quota management and refactor configuration handling
    - Introduced `QuotaExceeded` settings in configuration to handle quota limits more effectively.
    - Added preview model switching logic to `Client` to automatically use fallback models on quota exhaustion.
    - Refactored `APIHandlers` to leverage new configuration structure.
    - Simplified server initialization and removed redundant `ServerConfig` structure.
    - Streamlined client initialization by unifying configuration handling throughout the project.
    - Improved error handling and response mechanisms in both streaming and non-streaming flows.
  • Refactor API handlers to streamline response handling
    - Replaced channel-based handling in `SendMessage` flow with direct synchronous execution.
    - Introduced `hasFirstResponse` flag to manage keep-alive signals in streaming handler.
    - Simplified error handling and removed redundant code for enhanced readability and maintainability.
  • Refactor API request flow and streamline response handling
    - Replaced `SendMessageStream` with synchronous `SendMessage` in API handlers for better manageability.
    - Simplified `ConvertCliToOpenAINonStream` to reduce complexity and improve efficiency.
    - Adjusted `client.go` functions to handle both streaming and non-streaming API requests more effectively.
    - Improved error handling and channel communication in API handlers.
    - Removed redundant and unused code for cleaner implementation.
  • Refactor token management, client initialization, and project handling
    - Consolidated `TokenStorage` struct into `internal/auth/models.go` for better organization.
    - Updated `Client` to use `TokenStorage` for managing email and project ID.
    - Simplified `SetupUser` method to ensure proper token and project assignment.
    - Refactored API handlers to leverage new `GetEmail` and `GetProjectID` methods in `Client`.
    - Cleanup: Removed unused structures and redundant code from `client.go` and `auth.go`.
    - Adjusted CLI flow in `login.go` and `run.go` for streamlined user onboarding.
  • Refactor authentication and service initialization code
    - Moved login and service management logic to `internal/cmd` package (`login.go` and `run.go`).
    - Introduced `DoLogin` and `StartService` functions for modularity.
    - Enhanced error handling by using structured `ErrorMessage` in `Client`.
    - Improved token file saving process and added project-specific token identification.
    - Updated API handlers to handle more detailed error responses, including status codes.
  • Add SOCKS5 and HTTP/HTTPS proxy support
    - Updated `GetAuthenticatedClient` to handle proxy configuration via `proxy-url`.
    - Extended `Config` to include `proxy-url` property.
    - Adjusted error handling and removed unused JSON error response logic for API handlers.
    - Updated documentation and configuration examples to reflect new proxy settings.