agent-framework/python/packages/ollama/getting_started

Ollama Examples

This folder contains examples demonstrating how to use Ollama models with the Agent Framework.

Prerequisites

1. Install Ollama: Download and install Ollama from ollama.com
2. Start Ollama: Ensure Ollama is running on your local machine
3. Pull a model: Run ollama pull mistral (or any other model you prefer)
   • For function calling examples, use models that support tool calling like mistral or qwen2.5
   • For reasoning examples, use models that support reasoning like qwen2.5:8b
   • For Multimodality you can use models like gemma3:4b

Note

: Not all models support all features. Function calling and reasoning capabilities depend on the specific model you're using.

Examples

File	Description
ollama_agent_basic.py	Demonstrates basic Ollama agent usage with the native Ollama Chat Client. Shows both streaming and non-streaming responses with tool calling capabilities.
ollama_agent_reasoning.py	Demonstrates Ollama agent with reasoning capabilities using the native Ollama Chat Client. Shows how to enable thinking/reasoning mode.
ollama_chat_client.py	Ollama Chat Client with native Ollama Chat Client
ollama_chat_multimodal.py	Ollama Chat with multimodal native Ollama Chat Client

Configuration

The examples use environment variables for configuration. Set the appropriate variables based on which example you're running:

For Native Ollama Examples (ollama_agent_basic.py, ollama_agent_reasoning.py)

Set the following environment variables:

• OLLAMA_HOST: The base URL for your Ollama server (optional, defaults to http://localhost:11434)

  • Example: export OLLAMA_HOST="http://localhost:11434"

• OLLAMA_CHAT_MODEL_ID: The model name to use

  • Example: export OLLAMA_CHAT_MODEL_ID="qwen2.5:8b"
  • Must be a model you have pulled with Ollama