mirror of
https://github.com/musistudio/claude-code-router.git
synced 2026-02-02 06:40:50 +08:00
72 lines
2.8 KiB
Markdown
72 lines
2.8 KiB
Markdown
# Claude Code Router
|
||
|
||
> This is a repository for testing routing Claude Code requests to different models.
|
||
|
||
|
||
|
||
## Warning! This project is for testing purposes and may consume a lot of tokens! It may also fail to complete tasks!
|
||
|
||
## Implemented
|
||
|
||
- [x] Normal Mode and Router Mode
|
||
|
||
- [x] Using the qwen2.5-coder-3b model as the routing dispatcher (since it’s currently free on Alibaba Cloud’s official website)
|
||
|
||
- [x] Using the qwen-max-0125 model as the tool invoker
|
||
|
||
- [x] Using deepseek-v3 as the coder model
|
||
|
||
- [x] Using deepseek-r1 as the reasoning model
|
||
|
||
- [x] Support proxy
|
||
|
||
Thanks to the free qwen2.5-coder-3b model from Alibaba and deepseek’s KV-Cache, we can significantly reduce the cost of using Claude Code. Make sure to set appropriate ignorePatterns for the project. See: https://docs.anthropic.com/en/docs/agents-and-tools/claude-code/overview
|
||
|
||
## Usage
|
||
|
||
0. Install Claude Code
|
||
|
||
```shell
|
||
npm install -g @anthropic-ai/claude-code
|
||
```
|
||
|
||
1. Install claude-code-router
|
||
|
||
```shell
|
||
npm install -g @musistudio/claude-code-router
|
||
```
|
||
|
||
2. Start claude-code-router server
|
||
|
||
```shell
|
||
claude-code-router
|
||
```
|
||
|
||
3. Set environment variable to start claude code
|
||
|
||
```shell
|
||
export DISABLE_PROMPT_CACHING=1
|
||
export ANTHROPIC_BASE_URL="http://127.0.0.1:3456"
|
||
export API_TIMEOUT_MS=600000
|
||
claude
|
||
```
|
||
|
||
## Normal Mode
|
||
|
||
The initial version uses a single model to accomplish all tasks. This model needs to support function calling and must allow for a sufficiently large tool description length, ideally greater than 1754. If the model used in this mode does not support KV Cache, it will consume a significant number of tokens.
|
||
|
||
|
||
|
||
## Router Mode
|
||
|
||
Using multiple models to handle different tasks, this mode requires setting ENABLE_ROUTER to true and configuring four models: ROUTER_AGENT_MODEL, TOOL_AGENT_MODEL, CODER_AGENT_MODEL, and THINK_AGENT_MODEL.
|
||
|
||
ROUTER_AGENT_MODEL does not require high intelligence and is only responsible for request routing. A small model is sufficient for this task (testing has shown that the qwen-coder-3b model performs well).
|
||
TOOL_AGENT_MODEL must support function calling and allow for a sufficiently large tool description length, ideally greater than 1754. If the model used in this mode does not support KV Cache, it will consume a significant number of tokens.
|
||
|
||
CODER_AGENT_MODEL and THINK_AGENT_MODEL can use the DeepSeek series of models.
|
||
|
||
The purpose of router mode is to separate tool invocation from coding tasks, enabling the use of inference models like r1, which do not support function calling.
|
||
|
||
|