mirror of https://github.com/microsoft/agent-framework.git synced 2026-06-16 21:04:09 +08:00

Files

T

Mars Wang 3d31a4a204 Python: samples: add api_key for Ollama sample usage (#1240 )

* samples: add api_key for Ollama sample usage

* Update python/samples/getting_started/agents/ollama/ollama_with_openai_chat_client.py

Co-authored-by: Dmytro Struk <13853051+dmytrostruk@users.noreply.github.com>

* fix: update Ollama API key to an unused constant

---------

Co-authored-by: Dmytro Struk <13853051+dmytrostruk@users.noreply.github.com>

3d31a4a204 · 2025-10-08 20:45:24 +00:00

History

ollama_with_openai_chat_client.py

Python: samples: add api_key for Ollama sample usage (#1240 )

2025-10-08 20:45:24 +00:00

README.md

Python: Added Ollama example using OpenAIChatClient (#1100 )

2025-10-02 15:14:29 +00:00

README.md

Ollama Examples

This folder contains examples demonstrating how to use Ollama models with the Agent Framework.

Prerequisites

Install Ollama: Download and install Ollama from ollama.com
Start Ollama: Ensure Ollama is running on your local machine
Pull a model: Run ollama pull mistral (or any other model you prefer that supports function calling)

Examples

File	Description
`ollama_with_openai_chat_client.py`	Demonstrates how to configure OpenAI Chat Client to use local Ollama models. Shows both streaming and non-streaming responses with tool calling capabilities.

Configuration

The examples use environment variables for configuration:

Environment Variables

Set the following environment variables before running the examples:

OLLAMA_ENDPOINT: The base URL for your Ollama server
- Example: export OLLAMA_ENDPOINT="http://localhost:11434/v1/"
OLLAMA_MODEL: The model name to use
- Example: export OLLAMA_MODEL="mistral"
- Must be a model you have pulled with Ollama