Python: Added Ollama example using OpenAIChatClient (#1100)

* Added Ollama example using OpenAIChatClient

* Small improvement
This commit is contained in:
Dmytro Struk
2025-10-02 15:14:29 +00:00
committed by GitHub
parent 79def868b6
commit c7f20c8ec5
4 changed files with 114 additions and 1 deletions
@@ -0,0 +1,30 @@
# Ollama Examples
This folder contains examples demonstrating how to use Ollama models with the Agent Framework.
## Prerequisites
1. **Install Ollama**: Download and install Ollama from [ollama.com](https://ollama.com/)
2. **Start Ollama**: Ensure Ollama is running on your local machine
3. **Pull a model**: Run `ollama pull mistral` (or any other model you prefer that supports function calling)
## Examples
| File | Description |
|------|-------------|
| [`ollama_with_openai_chat_client.py`](ollama_with_openai_chat_client.py) | Demonstrates how to configure OpenAI Chat Client to use local Ollama models. Shows both streaming and non-streaming responses with tool calling capabilities. |
## Configuration
The examples use environment variables for configuration:
### Environment Variables
Set the following environment variables before running the examples:
- `OLLAMA_ENDPOINT`: The base URL for your Ollama server
- Example: `export OLLAMA_ENDPOINT="http://localhost:11434/v1/"`
- `OLLAMA_MODEL`: The model name to use
- Example: `export OLLAMA_MODEL="mistral"`
- Must be a model you have pulled with Ollama