Python: replace pre-commit with prek, add PEP 723 script deps, clean up dev dependencies (#3748)

* python: replace pre-commit with prek, add PEP 723 script deps, clean up dev dependencies

- Replace pre-commit with prek (Rust-native, faster pre-commit alternative)
- Move supported hooks to repo: builtin for zero-clone speed
- Add new builtin hooks: trailing-whitespace, check-merge-conflict, detect-private-key, check-added-large-files
- Update all hook versions to latest (pre-commit-hooks v6, pyupgrade v3.21.2, bandit 1.9.3, uv-pre-commit 0.10.0)
- Add PEP 723 inline script metadata to 34 samples with external deps
- Remove autogen-agentchat/autogen-ext from dev deps (now declared per-sample)
- Remove unused dev deps: pytest-env, tomli-w
- Add agent-framework-core>=1.0.0b260130 lower bound to all 21 packages
- Update CI workflow to use j178/prek-action
- Update docs: DEV_SETUP.md, AGENTS.md, CODING_STANDARD.md, SAMPLE_GUIDELINES.md

* updated lock

* python: fix prek config paths for local execution and CI workflow

Remove global 'files: ^python/' filter and strip python/ prefix from all path patterns in .pre-commit-config.yaml so prek finds files when run from the python/ directory. Update CI workflow to use --cd python instead of --config path. Include trailing whitespace fixes and dev dependency cleanup.

* python: move helper scripts to scripts/ folder and exclude from checks

* python: exclude AGENTS.md from prek markdown code lint

* python: exclude AGENTS.md and azure_ai_search sample from markdown lint

* fix m365 sample

* python: ignore CPY rule for samples with PEP 723 headers

* fix in dev_setup

* python: replace aiofiles with regular open in samples

* python: suppress reportUnusedImport in markdown code block checker

* python: use samples pyright config for markdown code block checker

Write a temp pyrightconfig.json matching pyrightconfig.samples.json rules (typeCheckingMode=off, only reportMissingImports and reportAttributeAccessIssue). Filter output to only fail on these rules since syntax-level errors (top-level await, undefined vars) are expected in README documentation snippets.

* python: use markdown-code-lint with fixed globs instead of prek file list

The prek-markdown-code-lint task received all changed files including non-README markdown and files with pre-existing broken imports. Replace with the standard markdown-code-lint task which uses the correct glob patterns (README.md, packages/**/README.md, samples/**/*.md).

* python: exclude READMEs with pre-existing broken imports from markdown lint

* python: fix broken README code snippets instead of excluding them

- ag-ui: replace TextContent (removed) with content.type == 'text'
- durabletask: fix import path to durabletask.worker.TaskHubGrpcWorker
- orchestrations: use constructor params instead of .participants() method
- observability: mark deprecated code blocks as plain text, filter
  reportMissingImports to agent_framework modules only
- remove README excludes from markdown-code-lint task

* add revision to gaia download

* feat(python): parallelize checks across packages

Run (package × task) cross-product in parallel using ThreadPoolExecutor
and subprocesses. Key changes:

- Add scripts/task_runner.py with shared parallel execution engine
- Update run_tasks_in_packages_if_exists.py to accept multiple tasks
- Update run_tasks_in_changed_packages.py with --files flag and parallel support
- Add check-packages poe task (fmt+lint+pyright+mypy in parallel)
- Add prek-markdown-code-lint and prek-samples-check with change detection
- Split CI code quality workflow into parallel prek and mypy jobs
- Update DEV_SETUP.md to document new parallel behavior

Core package changes still trigger checks on all packages.

* feat(ci): split code quality into 4 parallel jobs

Split the single prek job into parallel jobs:
- pre-commit-hooks: lightweight hooks (SKIP=poe-check)
- package-checks: fmt/lint/pyright/mypy via check-packages
- samples-markdown: samples-lint, samples-syntax, markdown-code-lint
- mypy: change-detected mypy checks

All 4 jobs run concurrently (×2 Python versions = 8 runners).

* feat(ci): use only Python 3.10 for code quality checks

* refactor(python): add future annotations and remove quoted types

Add `from __future__ import annotations` to 93 package files that
used quoted string annotations, then run pyupgrade --py310-plus to
remove the now-unnecessary quotes.

Fixes https://github.com/microsoft/agent-framework/issues/3578

python/packages/devui/agent_framework_devui/_conversations.py

@@ -6,6 +6,8 @@ This module provides a clean abstraction layer for managing conversations
 while wrapping AgentFramework's AgentThread underneath.
 """
 
+from __future__ import annotations
+
 import time
 import uuid
 from abc import ABC, abstractmethod

python/packages/devui/agent_framework_devui/_discovery.py

@@ -2,6 +2,8 @@
 
 """Agent Framework entity discovery implementation."""
 
+from __future__ import annotations
+
 import ast
 import importlib
 import importlib.util

python/packages/devui/agent_framework_devui/_executor.py

@@ -2,6 +2,8 @@
 
 """Agent Framework executor implementation."""
 
+from __future__ import annotations
+
 import json
 import logging
 from collections.abc import AsyncGenerator
@@ -184,7 +186,7 @@ class AgentFrameworkExecutor:
             raise EntityNotFoundError(f"Entity '{entity_id}' not found")
         return entity_info
 
-    async def execute_streaming(self, request: AgentFrameworkRequest) -> AsyncGenerator[Any, None]:
+    async def execute_streaming(self, request: AgentFrameworkRequest) -> AsyncGenerator[Any]:
         """Execute request and stream results in OpenAI format.
 
         Args:
@@ -229,7 +231,7 @@ class AgentFrameworkExecutor:
         # Aggregate into final response
         return await self.message_mapper.aggregate_to_response(events, request)
 
-    async def execute_entity(self, entity_id: str, request: AgentFrameworkRequest) -> AsyncGenerator[Any, None]:
+    async def execute_entity(self, entity_id: str, request: AgentFrameworkRequest) -> AsyncGenerator[Any]:
         """Execute the entity and yield raw Agent Framework events plus trace events.
 
         Args:
@@ -286,7 +288,7 @@ class AgentFrameworkExecutor:
 
     async def _execute_agent(
         self, agent: SupportsAgentRun, request: AgentFrameworkRequest, trace_collector: Any
-    ) -> AsyncGenerator[Any, None]:
+    ) -> AsyncGenerator[Any]:
         """Execute Agent Framework agent with trace collection and optional thread support.
 
         Args:
@@ -361,7 +363,7 @@ class AgentFrameworkExecutor:
 
     async def _execute_workflow(
         self, workflow: Workflow, request: AgentFrameworkRequest, trace_collector: Any
-    ) -> AsyncGenerator[Any, None]:
+    ) -> AsyncGenerator[Any]:
         """Execute Agent Framework workflow with checkpoint support via conversation items.
 
         Args:

python/packages/devui/agent_framework_devui/_mapper.py

@@ -2,6 +2,8 @@
 
 """Agent Framework message mapper implementation."""
 
+from __future__ import annotations
+
 import json
 import logging
 import time

python/packages/devui/agent_framework_devui/_openai/_executor.py

@@ -6,6 +6,8 @@ This executor mirrors the AgentFrameworkExecutor interface but routes
 requests to OpenAI's API instead of executing local entities.
 """
 
+from __future__ import annotations
+
 import logging
 import os
 from collections.abc import AsyncGenerator
@@ -76,7 +78,7 @@ class OpenAIExecutor:
 
         return self._client
 
-    async def execute_streaming(self, request: AgentFrameworkRequest) -> AsyncGenerator[Any, None]:
+    async def execute_streaming(self, request: AgentFrameworkRequest) -> AsyncGenerator[Any]:
         """Execute request via OpenAI and stream results in OpenAI format.
 
         This mirrors AgentFrameworkExecutor.execute_streaming() interface.

python/packages/devui/agent_framework_devui/_server.py

@@ -2,6 +2,8 @@
 
 """FastAPI server implementation."""
 
+from __future__ import annotations
+
 import asyncio
 import importlib.metadata
 import inspect
@@ -287,7 +289,7 @@ class DevServer:
         """Create the FastAPI application."""
 
         @asynccontextmanager
-        async def lifespan(app: FastAPI) -> AsyncGenerator[None, None]:
+        async def lifespan(app: FastAPI) -> AsyncGenerator[None]:
             # Startup
             logger.info("Starting Agent Framework Server")
             await self._ensure_executor()
@@ -623,7 +625,7 @@ class DevServer:
                 entity_path = Path(entity_path_str)
 
                 # Stream deployment events
-                async def event_generator() -> AsyncGenerator[str, None]:
+                async def event_generator() -> AsyncGenerator[str]:
                     async for event in self.deployment_manager.deploy(config, entity_path):
                         # Format as SSE
                         import json
@@ -1085,7 +1087,7 @@ class DevServer:
 
     async def _stream_execution(
         self, executor: AgentFrameworkExecutor, request: AgentFrameworkRequest
-    ) -> AsyncGenerator[str, None]:
+    ) -> AsyncGenerator[str]:
         """Stream execution directly through executor."""
         try:
             # Collect events for final response.completed event
@@ -1155,7 +1157,7 @@ class DevServer:
 
     async def _stream_openai_execution(
         self, executor: OpenAIExecutor, request: AgentFrameworkRequest
-    ) -> AsyncGenerator[str, None]:
+    ) -> AsyncGenerator[str]:
         """Stream execution through OpenAI executor.
 
         OpenAI events are already in final format - no conversion or aggregation needed.
@@ -1212,7 +1214,7 @@ class DevServer:
 
     async def _stream_with_cancellation(
         self, executor: AgentFrameworkExecutor, request: AgentFrameworkRequest, response_id: str
-    ) -> AsyncGenerator[str, None]:
+    ) -> AsyncGenerator[str]:
         """Stream execution with automatic cancellation on client disconnect.
 
         This wrapper adds cancellation support to the execution stream:
@@ -1231,7 +1233,7 @@ class DevServer:
         """
         task = None
 
-        async def execution_wrapper() -> AsyncGenerator[str, None]:
+        async def execution_wrapper() -> AsyncGenerator[str]:
             """Inner wrapper to handle the actual execution."""
             try:
                 logger.debug(f"[CANCELLATION] Starting execution for {response_id}")

python/packages/devui/agent_framework_devui/_tracing.py

@@ -2,6 +2,8 @@
 
 """Simplified tracing integration for Agent Framework Server."""
 
+from __future__ import annotations
+
 import logging
 from collections.abc import Generator, Sequence
 from contextlib import contextmanager
@@ -120,9 +122,7 @@ class SimpleTraceCollector(SpanExporter):
 
 
 @contextmanager
-def capture_traces(
-    response_id: str | None = None, entity_id: str | None = None
-) -> Generator[SimpleTraceCollector, None, None]:
+def capture_traces(response_id: str | None = None, entity_id: str | None = None) -> Generator[SimpleTraceCollector]:
     """Context manager to capture traces during execution.
 
     Args: