Files
agent-framework/python/samples/getting_started/context_providers
T
Eduard van Valkenburg 838a7fd61d Python: [BREAKING] Types API Review improvements (#3647)
* Replace Role and FinishReason classes with NewType + Literal

- Remove EnumLike metaclass from _types.py
- Replace Role class with NewType('Role', str) + RoleLiteral
- Replace FinishReason class with NewType('FinishReason', str) + FinishReasonLiteral
- Update all usages across codebase to use string literals
- Remove .value access patterns (direct string comparison now works)
- Add backward compatibility for legacy dict serialization format
- Update tests to reflect new string-based types

Addresses #3591, #3615

* Simplify ChatResponse and AgentResponse type hints (#3592)

- Remove overloads from ChatResponse.__init__
- Remove text parameter from ChatResponse.__init__
- Remove | dict[str, Any] from finish_reason and usage_details params
- Remove **kwargs from AgentResponse.__init__
- Both now accept ChatMessage | Sequence[ChatMessage] | None for messages
- Update docstrings and examples to reflect changes
- Fix tests that were using removed kwargs
- Fix Role type hint usage in ag-ui utils

* Remove text parameter from ChatResponseUpdate and AgentResponseUpdate (#3597)

- Remove text parameter from ChatResponseUpdate.__init__
- Remove text parameter from AgentResponseUpdate.__init__
- Remove **kwargs from both update classes
- Simplify contents parameter type to Sequence[Content] | None
- Update all usages to use contents=[Content.from_text(...)] pattern
- Fix imports in test files
- Update docstrings and examples

* Rename from_chat_response_updates to from_updates (#3593)

- ChatResponse.from_chat_response_updates โ†’ ChatResponse.from_updates
- ChatResponse.from_chat_response_generator โ†’ ChatResponse.from_update_generator
- AgentResponse.from_agent_run_response_updates โ†’ AgentResponse.from_updates

* Remove try_parse_value method from ChatResponse and AgentResponse (#3595)

- Remove try_parse_value method from ChatResponse
- Remove try_parse_value method from AgentResponse
- Remove try_parse_value calls from from_updates and from_update_generator methods
- Update samples to use try/except with response.value instead
- Update tests to use response.value pattern
- Users should now use response.value with try/except for safe parsing

* Add agent_id to AgentResponse and clarify author_name documentation (#3596)

- Add agent_id parameter to AgentResponse class
- Document that author_name is on ChatMessage objects, not responses
- Update ChatResponse docstring with author_name note
- Update AgentResponse docstring with author_name note

* Simplify ChatMessage.__init__ signature (#3618)

- Make contents a positional argument accepting Sequence[Content | str]
- Auto-convert strings in contents to TextContent
- Remove overloads, keep text kwarg for backward compatibility with serialization
- Update _parse_content_list to handle string items
- Update all usages across codebase to use new format: ChatMessage("role", ["text"])

* Allow Content as input on run and get_response

- Update prepare_messages and normalize_messages to accept Content
- Update type signatures in _agents.py and _clients.py
- Add tests for Content input handling

* Fix ChatMessage usage across packages and samples

Update all remaining ChatMessage(role=..., text=...) to use new
ChatMessage('role', ['text']) signature.

* Fix Role string usage and response format parsing

- Fix redis provider: remove .value access on string literals
- Fix durabletask ensure_response_format: set _response_format before accessing .value

* Fix ollama .value and ai_model_id issues, handle None in content list

- Fix ollama _chat_client: remove .value on string literals
- Fix ollama _chat_client: rename ai_model_id to model_id
- Fix _parse_content_list: skip None values gracefully

* Fix A2AAgent type signature to include Content

* Fix Role/FinishReason NewType dict annotations and improve test coverage to 95%

* Fix mypy errors for Role/FinishReason NewType usage

* Fix Role.TOOL and Role.ASSISTANT usage in _orchestrator_helpers.py

* Fix Role NewType usage in durabletask _models.py
838a7fd61d ยท 2026-02-04 10:13:23 +00:00
History
..

Context Provider Examples

Context providers enable agents to maintain memory, retrieve relevant information, and enhance conversations with external context. The Agent Framework supports various context providers for different use cases, from simple in-memory storage to advanced persistent solutions with search capabilities.

This folder contains examples demonstrating how to use different context providers with the Agent Framework.

Overview

Context providers implement two key methods:

  • invoking: Called before the agent processes a request. Provides additional context, instructions, or retrieved information to enhance the agent's response.
  • invoked: Called after the agent generates a response. Allows for storing information, updating memory, or performing post-processing.

Examples

Simple Context Provider

File Description Installation
simple_context_provider.py Demonstrates building a custom context provider that extracts and stores user information (name and age) from conversations. Shows how to use structured output to extract data and provide dynamic instructions based on stored context. No additional package required - uses core agent-framework

Install:

pip install agent-framework-azure-ai
File Description
azure_ai_search/azure_ai_with_search_context_agentic.py Agentic mode (recommended for most scenarios): Uses Knowledge Bases in Azure AI Search for query planning and multi-hop reasoning. Provides more accurate results through intelligent retrieval. Slightly slower with more token consumption.
azure_ai_search/azure_ai_with_search_context_semantic.py Semantic mode (fast queries): Fast hybrid search combining vector and keyword search with semantic ranking. Best for scenarios where speed is critical.

Install:

pip install agent-framework-azure-ai-search agent-framework-azure-ai

Prerequisites:

  • Azure AI Search service with a search index
  • Azure AI Foundry project with a model deployment
  • For agentic mode: Azure OpenAI resource for Knowledge Base model calls
  • Environment variables: AZURE_SEARCH_ENDPOINT, AZURE_SEARCH_INDEX_NAME, AZURE_AI_PROJECT_ENDPOINT

Key Concepts:

  • Agentic mode: Intelligent retrieval with multi-hop reasoning, better for complex queries
  • Semantic mode: Fast hybrid search with semantic ranking, better for simple queries and speed

Mem0

The mem0 folder contains examples using Mem0, a self-improving memory layer that enables applications to have long-term memory capabilities.

File Description
mem0/mem0_basic.py Basic example storing and retrieving user preferences across different conversation threads.
mem0/mem0_threads.py Advanced thread scoping strategies: global scope (memories shared), per-operation scope (memories isolated), and multiple agents with different memory configurations.
mem0/mem0_oss.py Using Mem0 Open Source self-hosted version as the context provider.

Install:

pip install agent-framework-mem0

Prerequisites:

  • Mem0 API key from app.mem0.ai OR self-host Mem0 Open Source
  • For Mem0 Platform: MEM0_API_KEY environment variable
  • For Mem0 OSS: OPENAI_API_KEY for embedding generation

Key Concepts:

  • Global Scope: Memories shared across all conversation threads
  • Thread Scope: Memories isolated per conversation thread
  • Memory Association: Records can be associated with user_id, agent_id, thread_id, or application_id

See the mem0 README for detailed documentation.

Redis

The redis folder contains examples using Redis (RediSearch) for persistent, searchable memory with full-text and optional hybrid vector search.

File Description
redis/redis_basics.py Standalone provider usage and agent integration. Demonstrates writing messages, full-text/hybrid search, persisting preferences, and tool output memory.
redis/redis_conversation.py Conversational examples showing memory persistence across sessions.
redis/redis_threads.py Thread scoping: global scope, per-operation scope, and multiple agents with isolated memory via different agent_id values.

Install:

pip install agent-framework-redis

Prerequisites:

  • Running Redis with RediSearch (Redis Stack or managed service)
  • Optional: OPENAI_API_KEY for vector embeddings (hybrid search)

Key Concepts:

  • Full-text search: Fast keyword-based retrieval
  • Hybrid vector search: Optional embeddings for semantic search (vectorizer_choice="openai" or "hf")
  • Memory scoping: Partition by application_id, agent_id, user_id, or thread_id
  • Thread scoping: scope_to_per_operation_thread_id=True isolates memory per operation

See the redis README for detailed documentation.

Choosing a Context Provider

Provider Use Case Persistence Search Complexity
Simple/Custom Learning, prototyping, simple memory needs No (in-memory) No Low
Azure AI Search RAG, document search, enterprise knowledge bases Yes Hybrid + Semantic Medium
Mem0 Long-term user memory, preferences, personalization Yes (cloud/self-hosted) Semantic Low-Medium
Redis Fast retrieval, session memory, full-text + vector search Yes Full-text + Hybrid Medium

Common Patterns

1. User Preference Memory

Store and retrieve user preferences, settings, or personal information across sessions.

  • Examples: simple_context_provider.py, mem0/mem0_basic.py, redis/redis_basics.py

2. Document Retrieval (RAG)

Retrieve relevant documents or knowledge base articles to answer questions.

  • Examples: azure_ai_search/azure_ai_with_search_context_*.py

3. Conversation History

Maintain conversation context across multiple turns and sessions.

  • Examples: redis/redis_conversation.py, mem0/mem0_threads.py

4. Thread Scoping

Isolate memory per conversation thread or share globally across threads.

  • Examples: mem0/mem0_threads.py, redis/redis_threads.py

5. Multi-Agent Memory

Different agents with isolated or shared memory configurations.

  • Examples: mem0/mem0_threads.py, redis/redis_threads.py

Building Custom Context Providers

To create a custom context provider, implement the ContextProvider protocol:

from agent_framework import ContextProvider, Context, ChatMessage
from collections.abc import MutableSequence, Sequence
from typing import Any

class MyContextProvider(ContextProvider):
    async def invoking(
        self,
        messages: ChatMessage | MutableSequence[ChatMessage],
        **kwargs: Any
    ) -> Context:
        """Provide context before the agent processes the request."""
        # Return additional instructions, messages, or context
        return Context(instructions="Additional instructions here")

    async def invoked(
        self,
        request_messages: ChatMessage | Sequence[ChatMessage],
        response_messages: ChatMessage | Sequence[ChatMessage] | None = None,
        invoke_exception: Exception | None = None,
        **kwargs: Any,
    ) -> None:
        """Process the response after the agent generates it."""
        # Store information, update memory, etc.
        pass

    def serialize(self) -> str:
        """Serialize the provider state for persistence."""
        return "{}"

See simple_context_provider.py for a complete example.

Additional Resources