8 Commits

• Python: chore(python): improve dependency range automation (#4343)

  * chore(python): improve dependency range automation
  
  - tighten dependency bounds and coding standards guidance\n- add dependency range validation workflow, reporting, and issue automation\n- update related tests and dependency pins for compatibility
  
  Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
  
  * updated text and pyarrow
  
  * new lock
  
  * fixed workflow
  
  * updated deps
  
  * fix tiktoken
  
  * chore(python): refine dependency validation workflows
  
  Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
  
  * docs(python): add high-level dependency validation comments
  
  Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
  
  * WIP
  
  * added additional comments and excludes
  
  * added dev dependency handling and workflow and updates to package ranges
  
  * added readme and simplified commands
  
  * fix markers
  
  * chore(python): address dependency review feedback
  
  Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
  
  * Tighten dependency bounds, remove stale overrides, restore Python 3.10 support
  
  - Apply dependency bound policy across all packages: stable >=1.0 deps use
    >=floor,<next_major; pre-1.0/prerelease deps use validated hard-bounded ranges
  - Remove stale root tool.uv.override-dependencies (uvicorn, websockets, grpcio)
  - Lower github_copilot requires-python to >=3.10 with github-copilot-sdk gated
    behind python_version >= 3.11 marker; import raises ImportError on 3.10
  - Skip github_copilot pyright/mypy/test tasks on Python <3.11
  - Use version-conditional pyrightconfig for samples on Python 3.10
  - Add compatibility fix in core responses client for older openai typed dicts
  - Normalize uv.lock prerelease mode and refresh dev dependencies
  - Update CODING_STANDARD.md, DEV_SETUP.md, and package management skill docs
  
  Closes #902
  
  Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
  
  * small tweaks
  
  * add note in workflow
  
  * fix workflows and several versions
  
  * fix duplicate
  
  ---------
  
  Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>

  Eduard van Valkenburg · 2026-03-13 12:32:37 +00:00
  50fdcbaf57
• Python: Add load_dotenv() to samples for .env file support (#4043)

  * Initial plan
  
  * Add load_dotenv() to 303 Python samples for environment variable loading
  
  Co-authored-by: TaoChenOSU <12570346+TaoChenOSU@users.noreply.github.com>
  
  * Update SAMPLE_GUIDELINES.md to document load_dotenv() requirement
  
  Co-authored-by: TaoChenOSU <12570346+TaoChenOSU@users.noreply.github.com>
  
  * Update samples README.md to document .env file usage
  
  Co-authored-by: TaoChenOSU <12570346+TaoChenOSU@users.noreply.github.com>
  
  * Run ruff format on all changed sample files
  
  Co-authored-by: TaoChenOSU <12570346+TaoChenOSU@users.noreply.github.com>
  
  * Clarify load_dotenv() usage in README - local dev vs production
  
  Co-authored-by: TaoChenOSU <12570346+TaoChenOSU@users.noreply.github.com>
  
  * Remove deprecated getting_started folder as requested
  
  Co-authored-by: TaoChenOSU <12570346+TaoChenOSU@users.noreply.github.com>
  
  * Document env_file_path parameter for per-client configuration
  
  Co-authored-by: TaoChenOSU <12570346+TaoChenOSU@users.noreply.github.com>
  
  * Merge main branch to resolve conflicts
  
  Co-authored-by: TaoChenOSU <12570346+TaoChenOSU@users.noreply.github.com>
  
  * Fix run_evaluation.py file that was empty in merge commit
  
  Co-authored-by: TaoChenOSU <12570346+TaoChenOSU@users.noreply.github.com>
  
  * Remove dotnet changes from merge - out of scope for this PR
  
  Co-authored-by: TaoChenOSU <12570346+TaoChenOSU@users.noreply.github.com>
  
  * Remove package and test changes from merge - only sample changes needed
  
  Co-authored-by: TaoChenOSU <12570346+TaoChenOSU@users.noreply.github.com>
  
  * Remove test_func_utils.py - only sample changes needed
  
  Co-authored-by: TaoChenOSU <12570346+TaoChenOSU@users.noreply.github.com>
  
  * Revert sample files not in original changeset - keep only load_dotenv additions
  
  Co-authored-by: TaoChenOSU <12570346+TaoChenOSU@users.noreply.github.com>
  
  * Move load_dotenv() outside snippet tag in 06_host_your_agent.py
  
  Co-authored-by: TaoChenOSU <12570346+TaoChenOSU@users.noreply.github.com>
  
  * Fix comment placement - move load_dotenv before code comments
  
  Co-authored-by: TaoChenOSU <12570346+TaoChenOSU@users.noreply.github.com>
  
  * Fix load_dotenv() placement across all samples - after docstring, before code comments
  
  Co-authored-by: TaoChenOSU <12570346+TaoChenOSU@users.noreply.github.com>
  
  * Merge latest main branch with load_dotenv changes
  
  Co-authored-by: TaoChenOSU <12570346+TaoChenOSU@users.noreply.github.com>
  
  * Remove non-sample changes from merge - keep only load_dotenv additions
  
  Co-authored-by: TaoChenOSU <12570346+TaoChenOSU@users.noreply.github.com>
  
  * Revert non-load_dotenv sample changes from merge
  
  Co-authored-by: TaoChenOSU <12570346+TaoChenOSU@users.noreply.github.com>
  
  * Fix run_evaluation.py - use main's improved version (file already had load_dotenv)
  
  Co-authored-by: TaoChenOSU <12570346+TaoChenOSU@users.noreply.github.com>
  
  * Manual update
  
  * Manual update 2
  
  * Fix Role usage and load_dotenv placement per PR review feedback
  
  Co-authored-by: eavanvalkenburg <13749212+eavanvalkenburg@users.noreply.github.com>
  
  * Fix Role usage - use string literals not enum attributes
  
  Co-authored-by: eavanvalkenburg <13749212+eavanvalkenburg@users.noreply.github.com>
  
  * Fix SAMPLE_GUIDELINES.md example - load_dotenv before docstring per guidance
  
  Co-authored-by: eavanvalkenburg <13749212+eavanvalkenburg@users.noreply.github.com>
  
  * Move load_dotenv() before docstrings in all samples per SAMPLE_GUIDELINES ordering
  
  Co-authored-by: eavanvalkenburg <13749212+eavanvalkenburg@users.noreply.github.com>
  
  * Address PR review: rename files, fix placement, add session usage, remove note
  
  Co-authored-by: eavanvalkenburg <13749212+eavanvalkenburg@users.noreply.github.com>
  
  * Update Redis README to reference renamed file redis_history_provider.py
  
  Co-authored-by: eavanvalkenburg <13749212+eavanvalkenburg@users.noreply.github.com>
  
  ---------
  
  Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
  Co-authored-by: TaoChenOSU <12570346+TaoChenOSU@users.noreply.github.com>
  Co-authored-by: Tao Chen <taochen@microsoft.com>
  Co-authored-by: eavanvalkenburg <13749212+eavanvalkenburg@users.noreply.github.com>
  Co-authored-by: Eduard van Valkenburg <eavanvalkenburg@users.noreply.github.com>

  Copilot · 2026-02-19 10:55:13 +00:00
  b05fc9e849
• Python: [BREAKING] PR2 — Wire context provider pipeline, remove old types, update all consumers (#3850)

  * PR2: Wire context provider pipeline and update all internal consumers
  
  - Replace AgentThread with AgentSession across all packages
  - Replace ContextProvider with BaseContextProvider across all packages
  - Replace context_provider param with context_providers (Sequence)
  - Replace thread= with session= in run() signatures
  - Replace get_new_thread() with create_session()
  - Add get_session(service_session_id) to agent interface
  - DurableAgentThread -> DurableAgentSession
  - Remove _notify_thread_of_new_messages from WorkflowAgent
  - Wire before_run/after_run context provider pipeline in RawAgent
  - Auto-inject InMemoryHistoryProvider when no providers configured
  
  * fix: update all tests for context provider pipeline, fix lazy-loaders, remove old test files
  
  * refactor: update all sample files for context provider pipeline (AgentThread→AgentSession, ContextProvider→BaseContextProvider)
  
  * fix: update remaining ag-ui references (client docstring, getting_started sample)
  
  * fix: make get_session service_session_id keyword-only to avoid confusion with session_id
  
  * refactor: rename _RunContext.thread_messages to session_messages
  
  * refactor: remove _threads.py, _memory.py, and old provider files; migrate devui to use plain message lists
  
  * rename: remove _new_ prefix from test files
  
  * refactor: rewrite SlidingWindowChatMessageStore as SlidingWindowHistoryProvider(InMemoryHistoryProvider)
  
  * fix: read full history from session state directly instead of reaching into provider internals
  
  * fix: update stale .pyi stubs, sample imports, and README references for new provider types
  
  * fix: remove stale message_store, _notify_thread_of_new_messages, and session_id.key references in samples
  
  * refactor: merge context_providers and sessions sample folders into sessions, remove aggregate_context_provider
  
  * refactor: UserInfoMemory stores state in session.state instead of instance attributes
  
  * feat: add Pydantic BaseModel support to session state serialization
  
  Pydantic models stored in session.state are now automatically serialized
  via model_dump() and restored via model_validate() during to_dict()/from_dict()
  round-trips. Models are auto-registered on first serialization; use
  register_state_type() for cold-start deserialization.
  
  Also export register_state_type as a public API.
  
  * fix mem0
  
  * Update sample README links and descriptions for session terminology
  
  - Replace 'thread' with 'session' in sample descriptions across all READMEs
  - Update file links for renamed samples (mem0_sessions, redis_sessions, etc.)
  - Fix Threads section → Sessions section in main samples/README.md
  - Update tools, middleware, workflows, durabletask, azure_functions READMEs
  - Update architecture diagrams in concepts/tools/README.md
  - Update migration guides (autogen, semantic-kernel)
  
  * Fix broken Redis README link to renamed sample
  
  * Fix Mem0 OSS client search: pass scoping params as direct kwargs
  
  AsyncMemory (OSS) expects user_id/agent_id/run_id as direct kwargs,
  while AsyncMemoryClient (Platform) expects them in a filters dict.
  Adds tests for both client types.
  
  Port of fix from #3844 to new Mem0ContextProvider.
  
  * Fix rebase issues: restore missing _conversation_state.py and checkpoint decode logic
  
  - Add back _conversation_state.py (encode/decode_chat_messages) lost in rebase
  - Fix on_checkpoint_restore to decode cache/conversation with decode_chat_messages
  - Fix on_checkpoint_restore to use decode_checkpoint_value for pending requests
  - Add tests/workflow/__init__.py for relative import support
  - Fix test_agent_executor checkpoint selection (checkpoints[1] not superstep)
  
  * Add STORES_BY_DEFAULT ClassVar to skip redundant InMemoryHistoryProvider injection
  
  Chat clients that store history server-side by default (OpenAI Responses API,
  Azure AI Agent) now declare STORES_BY_DEFAULT = True. The agent checks this
  during auto-injection and skips InMemoryHistoryProvider unless the user
  explicitly sets store=False.
  
  * Fix broken markdown links in azure_ai and redis READMEs
  
  * Fix getting-started samples to use session API instead of removed thread/ContextProvider API
  
  * updates to workflow as agent
  
  * fix group chat import
  
  * Rename Thread→Session throughout, fix service_session_id propagation, remove stale AGUIThread
  
  - Fix: Propagate conversation_id from ChatResponse back to session.service_session_id
    in both streaming and non-streaming paths in _agents.py
  - Rename AgentThreadException → AgentSessionException
  - Remove stale AGUIThread from ag_ui lazy-loader
  - Rename use_service_thread → use_service_session in ag-ui package
  - Rename test functions from *_thread_* to *_session_*
  - Rename sample files from *_thread* to *_session*
  - Update docstrings and comments: thread → session
  - Update _mcp.py kwargs filter: add 'session' alongside 'thread'
  - Fix ContinuationToken docstring example: thread=thread → session=session
  - Fix _clients.py docstring: 'Agent threads' → 'Agent sessions'
  
  * Fix broken markdown links after thread→session file renames
  
  * fix azure ai test

  Eduard van Valkenburg · 2026-02-12 21:00:32 +00:00
  1e350ea22f
• Python: restructure: Python samples into progressive 01-05 layout (#3862)

  * restructure: Python samples into progressive 01-05 layout
  
  - 01-get-started/: 6 numbered steps (hello agent → hosting)
  - 02-agents/: all agent concept samples (tools, middleware, providers, etc.)
  - 03-workflows/: ALL existing workflow samples preserved as-is
  - 04-hosting/: azure-functions, durabletask, a2a
  - 05-end-to-end/: demos, evaluation, hosted agents
  - Old files moved to _to_delete/ for review
  - Added AGENTS.md with structure documentation
  - autogen-migration/ and semantic-kernel-migration/ preserved at root
  
  * fix: switch to AzureOpenAI Foundry, fix CI failures
  
  - Switch all 01-get-started samples to AzureOpenAIResponsesClient with
    Azure AI Foundry project endpoint (AZURE_AI_PROJECT_ENDPOINT +
    AZURE_OPENAI_RESPONSES_DEPLOYMENT_NAME + AzureCliCredential)
  - Add _to_delete/ and 05-end-to-end/ to pyrightconfig.samples.json excludes
  - Fix test paths in packages/ that referenced old getting_started/ dirs:
    durabletask conftest + streaming test, azurefunctions conftest,
    devui conftest + capture_messages + openai_sdk_integration
  - Fix workflow_as_agent_human_in_the_loop.py import (sibling import)
  - Update hosting READMEs and tool comment paths
  - Replace root README.md with new structure overview
  - Update AGENTS.md to document Azure OpenAI Foundry as default provider
  
  * cleanup: remove _to_delete folder, copy resource files to active dirs
  
  All files in _to_delete/ were either:
  - Exact duplicates of files in the new structure (240 files)
  - Same file with only comment path updates (100 files)
  - One import-fix diff (workflow_as_agent_human_in_the_loop.py)
  - One superseded minimal_sample.py
  
  Resource files (sample.pdf, countries.json, employees.pdf, weather.json)
  copied to 02-agents/sample_assets/ and 02-agents/resources/ since active
  samples reference them.
  
  * fix: address PR review comments, centralize resources, remove root duplicates
  
  - Fix type annotation in 04_memory.py (string union -> proper types)
  - Fix old sample paths in observability files
  - Fix grammar/spelling in observability samples
  - Move sample_assets/ and resources/ to shared/ folder
  - Remove 8 duplicate observability files from 02-agents root
  - Update resource path references in multimodal_input and provider samples
  
  * fix: update broken links from old getting_started paths to new structure
  
  - Update relative paths in READMEs: getting_started/ → 01-get-started/,
    02-agents/, 03-workflows/, 04-hosting/, 05-end-to-end/
  - Fix absolute GitHub URLs in package READMEs
  - Fix broken link in ollama package README
  
  * fix: convert absolute GitHub URLs to relative paths for link checker
  
  Absolute URLs to python/samples/ on main branch 404 until PR merges.
  Converted to relative paths that linkspector can verify locally.
  
  * fix: update link for handoff sample moved to orchestrations/
  
  * fix: update chatkit-integration README path from demos/ to 05-end-to-end/
  
  * fix: update broken links in orchestrations README to match flat directory structure

  Eduard van Valkenburg · 2026-02-12 17:36:36 +00:00
  a2856d3b92
• Python: replace pre-commit with prek, add PEP 723 script deps, clean up dev dependencies (#3748)

  * python: replace pre-commit with prek, add PEP 723 script deps, clean up dev dependencies
  
  - Replace pre-commit with prek (Rust-native, faster pre-commit alternative)
  - Move supported hooks to repo: builtin for zero-clone speed
  - Add new builtin hooks: trailing-whitespace, check-merge-conflict, detect-private-key, check-added-large-files
  - Update all hook versions to latest (pre-commit-hooks v6, pyupgrade v3.21.2, bandit 1.9.3, uv-pre-commit 0.10.0)
  - Add PEP 723 inline script metadata to 34 samples with external deps
  - Remove autogen-agentchat/autogen-ext from dev deps (now declared per-sample)
  - Remove unused dev deps: pytest-env, tomli-w
  - Add agent-framework-core>=1.0.0b260130 lower bound to all 21 packages
  - Update CI workflow to use j178/prek-action
  - Update docs: DEV_SETUP.md, AGENTS.md, CODING_STANDARD.md, SAMPLE_GUIDELINES.md
  
  * updated lock
  
  * python: fix prek config paths for local execution and CI workflow
  
  Remove global 'files: ^python/' filter and strip python/ prefix from all path patterns in .pre-commit-config.yaml so prek finds files when run from the python/ directory. Update CI workflow to use --cd python instead of --config path. Include trailing whitespace fixes and dev dependency cleanup.
  
  * python: move helper scripts to scripts/ folder and exclude from checks
  
  * python: exclude AGENTS.md from prek markdown code lint
  
  * python: exclude AGENTS.md and azure_ai_search sample from markdown lint
  
  * fix m365 sample
  
  * python: ignore CPY rule for samples with PEP 723 headers
  
  * fix in dev_setup
  
  * python: replace aiofiles with regular open in samples
  
  * python: suppress reportUnusedImport in markdown code block checker
  
  * python: use samples pyright config for markdown code block checker
  
  Write a temp pyrightconfig.json matching pyrightconfig.samples.json rules (typeCheckingMode=off, only reportMissingImports and reportAttributeAccessIssue). Filter output to only fail on these rules since syntax-level errors (top-level await, undefined vars) are expected in README documentation snippets.
  
  * python: use markdown-code-lint with fixed globs instead of prek file list
  
  The prek-markdown-code-lint task received all changed files including non-README markdown and files with pre-existing broken imports. Replace with the standard markdown-code-lint task which uses the correct glob patterns (README.md, packages/**/README.md, samples/**/*.md).
  
  * python: exclude READMEs with pre-existing broken imports from markdown lint
  
  * python: fix broken README code snippets instead of excluding them
  
  - ag-ui: replace TextContent (removed) with content.type == 'text'
  - durabletask: fix import path to durabletask.worker.TaskHubGrpcWorker
  - orchestrations: use constructor params instead of .participants() method
  - observability: mark deprecated code blocks as plain text, filter
    reportMissingImports to agent_framework modules only
  - remove README excludes from markdown-code-lint task
  
  * add revision to gaia download
  
  * feat(python): parallelize checks across packages
  
  Run (package × task) cross-product in parallel using ThreadPoolExecutor
  and subprocesses. Key changes:
  
  - Add scripts/task_runner.py with shared parallel execution engine
  - Update run_tasks_in_packages_if_exists.py to accept multiple tasks
  - Update run_tasks_in_changed_packages.py with --files flag and parallel support
  - Add check-packages poe task (fmt+lint+pyright+mypy in parallel)
  - Add prek-markdown-code-lint and prek-samples-check with change detection
  - Split CI code quality workflow into parallel prek and mypy jobs
  - Update DEV_SETUP.md to document new parallel behavior
  
  Core package changes still trigger checks on all packages.
  
  * feat(ci): split code quality into 4 parallel jobs
  
  Split the single prek job into parallel jobs:
  - pre-commit-hooks: lightweight hooks (SKIP=poe-check)
  - package-checks: fmt/lint/pyright/mypy via check-packages
  - samples-markdown: samples-lint, samples-syntax, markdown-code-lint
  - mypy: change-detected mypy checks
  
  All 4 jobs run concurrently (×2 Python versions = 8 runners).
  
  * feat(ci): use only Python 3.10 for code quality checks
  
  * refactor(python): add future annotations and remove quoted types
  
  Add `from __future__ import annotations` to 93 package files that
  used quoted string annotations, then run pyupgrade --py310-plus to
  remove the now-unnecessary quotes.
  
  Fixes https://github.com/microsoft/agent-framework/issues/3578

  Eduard van Valkenburg · 2026-02-09 17:51:01 +00:00
  977c3adfb2
• docs: add missing pre flag (#1130)

  Co-authored-by: Eric Zhu <ekzhu@users.noreply.github.com>

  Vincent Koc · 2025-10-02 18:50:47 +00:00
  2696de7428
• Python: Update installation instructions (#1026)

  * Update installation instructions
  
  * address comments

  Tao Chen · 2025-09-30 19:28:54 +00:00
  f7e9490494
• Python: add RedisContextProvider (#716)

  * Setting up
  
  * Readme
  
  * Add redis tests path to all-tests
  
  * First pass integration
  
  * Keep provider convention
  
  * First pass integration
  
  * add redis integration tests
  
  * update README.md
  
  * Add basic sample for redis integration
  
  * Add partitioning, add partition-aware tests, improve sample script
  
  * Fix code quality check
  
  * Try to resolve pytest check
  
  * Try to identify if pytest is the cause of failed checks
  
  * Re-enable tests
  
  * Rename redis test file
  
  * Removing some tests to narrow down issue
  
  * Revert, no difference
  
  * Delete temp files
  
  * Starting refactor of RedisProvider
  
  * Build dynamic schema builder, still need to do dynamic embedding model config
  
  * Add scope control
  
  * Complete first pass functionality with OpenAI + HF vectors -> Tests, Samples, Demo to follow
  
  * Fix code quality
  
  * attempt to identify rootcause of failed test
  
  * attempt to identify rootcause of failed test
  
  * Attempt to resolve code quality fail
  
  * Update pyproject.toml for foundry to pin     azure-ai-projects == 1.1.0b3,azure-ai-agents == 1.2.0b3
  
  * Add tests for redisprovider
  
  * Remove invalid tests
  
  * Add API key handling for openai vectorizer
  
  * Update uv.locl
  
  * Use master uv.lock
  
  * Begin sample file, add lazy index creation, fix faulty override
  
  * Index drop and reinit depends on drop_redis_index not overwrite
  
  * Add samples, threading included, escaped queries, verify threading works, sample README.md
  
  * Refactor filters
  
  * Opinionated vars
  
  * Allow filter expression combination
  
  * Try inline stubs for mypy
  
  * Address mypy errors
  
  * Better docstrings, tweaks for feedback
  
  * Tweak example 3 in redis_threads.py sample
  
  * adjust confusing name
  
  * Enrich docstrings
  
  * Add descriptions and comments to samples, externalize vectorizer choice, remove nltk and sentencetransformers dependnecy
  
  * Add descriptions and comments to samples, externalize vectorizer choice, remove nltk and sentencetransformers dependnecy
  
  * Incorporate initial feedback from dmytrostruk
  
  * Fix uv.lock
  
  * Attempt to resolve conflict
  
  * Use remote .tomls
  
  * Sanity check
  
  * fix tests
  
  * Remove hardcoded API key from samples
  
  * Fix incorrect env var
  
  * Make add and redis_search private
  
  * Fix tests relying on private funcs
  
  * Expand tests
  
  * Explainer comments to each test
  
  * Add a 'get_conversation_history' function to RedisProvider - This just returns messages in sequential order. Added 'created_at_*' timestamps to facilitate sequential recovery. function has to be manually invoked by user
  
  * Add agent-framework-redis to  python/pyproject.toml
  
  * Remove get_conversation_history
  
  * improve redis context provider with pydantic techniques and safe index handling patterns
  
  * add RedisChatMessageStore
  
  * remove integration test :(
  
  * fix mypy error
  
  * Remove unused params
  
  * Redo schema validation to be order-invariant, handle attrs (previously throwing errors due to strict ==)
  
  * Expand explanation
  
  * Add ChatMessageStore example
  
  * Fix comments in redis_conversation.py
  
  * Resolving uv.lock conflict, update to match main
  
  * Fix test in redis provider
  
  * Apply suggestion from @ekzhu
  
  * Update python/packages/main/pyproject.toml
  
  ---------
  
  Co-authored-by: Tyler Hutcherson <tyler.hutcherson@redis.com>
  Co-authored-by: Eric Zhu <ekzhu@users.noreply.github.com>

  Han · 2025-09-23 00:36:27 +00:00
  ca810076e8