Files
agent-framework/python/samples/semantic-kernel-migration/processes/nested_process.py
T
Eduard van Valkenburg 977c3adfb2 Python: replace pre-commit with prek, add PEP 723 script deps, clean up dev dependencies (#3748)
* python: replace pre-commit with prek, add PEP 723 script deps, clean up dev dependencies

- Replace pre-commit with prek (Rust-native, faster pre-commit alternative)
- Move supported hooks to repo: builtin for zero-clone speed
- Add new builtin hooks: trailing-whitespace, check-merge-conflict, detect-private-key, check-added-large-files
- Update all hook versions to latest (pre-commit-hooks v6, pyupgrade v3.21.2, bandit 1.9.3, uv-pre-commit 0.10.0)
- Add PEP 723 inline script metadata to 34 samples with external deps
- Remove autogen-agentchat/autogen-ext from dev deps (now declared per-sample)
- Remove unused dev deps: pytest-env, tomli-w
- Add agent-framework-core>=1.0.0b260130 lower bound to all 21 packages
- Update CI workflow to use j178/prek-action
- Update docs: DEV_SETUP.md, AGENTS.md, CODING_STANDARD.md, SAMPLE_GUIDELINES.md

* updated lock

* python: fix prek config paths for local execution and CI workflow

Remove global 'files: ^python/' filter and strip python/ prefix from all path patterns in .pre-commit-config.yaml so prek finds files when run from the python/ directory. Update CI workflow to use --cd python instead of --config path. Include trailing whitespace fixes and dev dependency cleanup.

* python: move helper scripts to scripts/ folder and exclude from checks

* python: exclude AGENTS.md from prek markdown code lint

* python: exclude AGENTS.md and azure_ai_search sample from markdown lint

* fix m365 sample

* python: ignore CPY rule for samples with PEP 723 headers

* fix in dev_setup

* python: replace aiofiles with regular open in samples

* python: suppress reportUnusedImport in markdown code block checker

* python: use samples pyright config for markdown code block checker

Write a temp pyrightconfig.json matching pyrightconfig.samples.json rules (typeCheckingMode=off, only reportMissingImports and reportAttributeAccessIssue). Filter output to only fail on these rules since syntax-level errors (top-level await, undefined vars) are expected in README documentation snippets.

* python: use markdown-code-lint with fixed globs instead of prek file list

The prek-markdown-code-lint task received all changed files including non-README markdown and files with pre-existing broken imports. Replace with the standard markdown-code-lint task which uses the correct glob patterns (README.md, packages/**/README.md, samples/**/*.md).

* python: exclude READMEs with pre-existing broken imports from markdown lint

* python: fix broken README code snippets instead of excluding them

- ag-ui: replace TextContent (removed) with content.type == 'text'
- durabletask: fix import path to durabletask.worker.TaskHubGrpcWorker
- orchestrations: use constructor params instead of .participants() method
- observability: mark deprecated code blocks as plain text, filter
  reportMissingImports to agent_framework modules only
- remove README excludes from markdown-code-lint task

* add revision to gaia download

* feat(python): parallelize checks across packages

Run (package × task) cross-product in parallel using ThreadPoolExecutor
and subprocesses. Key changes:

- Add scripts/task_runner.py with shared parallel execution engine
- Update run_tasks_in_packages_if_exists.py to accept multiple tasks
- Update run_tasks_in_changed_packages.py with --files flag and parallel support
- Add check-packages poe task (fmt+lint+pyright+mypy in parallel)
- Add prek-markdown-code-lint and prek-samples-check with change detection
- Split CI code quality workflow into parallel prek and mypy jobs
- Update DEV_SETUP.md to document new parallel behavior

Core package changes still trigger checks on all packages.

* feat(ci): split code quality into 4 parallel jobs

Split the single prek job into parallel jobs:
- pre-commit-hooks: lightweight hooks (SKIP=poe-check)
- package-checks: fmt/lint/pyright/mypy via check-packages
- samples-markdown: samples-lint, samples-syntax, markdown-code-lint
- mypy: change-detected mypy checks

All 4 jobs run concurrently (×2 Python versions = 8 runners).

* feat(ci): use only Python 3.10 for code quality checks

* refactor(python): add future annotations and remove quoted types

Add `from __future__ import annotations` to 93 package files that
used quoted string annotations, then run pyupgrade --py310-plus to
remove the now-unnecessary quotes.

Fixes https://github.com/microsoft/agent-framework/issues/3578
2026-02-09 17:51:01 +00:00

291 lines
9.4 KiB
Python

# /// script
# requires-python = ">=3.10"
# dependencies = [
# "semantic-kernel",
# ]
# ///
# Run with any PEP 723 compatible runner, e.g.:
# uv run samples/semantic-kernel-migration/processes/nested_process.py
# Copyright (c) Microsoft. All rights reserved.
"""Nested process comparison between Semantic Kernel Process Framework and Agent Framework sub-workflows."""
import asyncio
import logging
from collections.abc import Sequence
from dataclasses import dataclass
from enum import Enum
from typing import ClassVar, cast
######################################################################
# region Agent Framework imports
######################################################################
from agent_framework import (
Executor,
WorkflowBuilder,
WorkflowContext,
WorkflowExecutor,
handler,
)
from pydantic import BaseModel, Field
######################################################################
# region Semantic Kernel imports
######################################################################
from semantic_kernel import Kernel
from semantic_kernel.connectors.ai.open_ai import OpenAIChatCompletion
from semantic_kernel.functions import kernel_function
from semantic_kernel.processes.kernel_process.kernel_process import KernelProcess
from semantic_kernel.processes.kernel_process.kernel_process_event import KernelProcessEventVisibility
from semantic_kernel.processes.kernel_process.kernel_process_step import KernelProcessStep
from semantic_kernel.processes.kernel_process.kernel_process_step_context import KernelProcessStepContext
from semantic_kernel.processes.kernel_process.kernel_process_step_state import KernelProcessStepState
from semantic_kernel.processes.local_runtime.local_kernel_process import start
from semantic_kernel.processes.process_builder import ProcessBuilder
from typing_extensions import Never
######################################################################
# endregion
######################################################################
logging.basicConfig(level=logging.WARNING)
class ProcessEvents(Enum):
START_PROCESS = "StartProcess"
START_INNER_PROCESS = "StartInnerProcess"
OUTPUT_READY_PUBLIC = "OutputReadyPublic"
OUTPUT_READY_INTERNAL = "OutputReadyInternal"
######################################################################
# region Semantic Kernel nested process path
######################################################################
class StepState(BaseModel):
last_message: str | None = None
class EchoStep(KernelProcessStep[None]):
ECHO: ClassVar[str] = "echo"
@kernel_function(name=ECHO)
async def echo(self, message: str) -> str:
print(f"[ECHO] {message}")
return message
class RepeatStep(KernelProcessStep[StepState]):
REPEAT: ClassVar[str] = "repeat"
state: StepState = Field(default_factory=StepState)
async def activate(self, state: KernelProcessStepState[StepState]):
self.state = state.state
@kernel_function(name=REPEAT)
async def repeat(
self,
message: str,
context: KernelProcessStepContext,
count: int = 2,
) -> None:
output = " ".join([message] * count)
self.state.last_message = output
print(f"[REPEAT] {output}")
await context.emit_event(
process_event=ProcessEvents.OUTPUT_READY_PUBLIC.value,
data=output,
visibility=KernelProcessEventVisibility.Public,
)
await context.emit_event(
process_event=ProcessEvents.OUTPUT_READY_INTERNAL.value,
data=output,
visibility=KernelProcessEventVisibility.Internal,
)
def _create_linear_process(name: str) -> ProcessBuilder:
process_builder = ProcessBuilder(name=name)
echo_step = process_builder.add_step(step_type=EchoStep)
repeat_step = process_builder.add_step(step_type=RepeatStep)
process_builder.on_input_event(event_id=ProcessEvents.START_PROCESS.value).send_event_to(target=echo_step)
echo_step.on_function_result(function_name=EchoStep.ECHO).send_event_to(
target=repeat_step,
parameter_name="message",
)
return process_builder
_semantic_kernel = Kernel()
async def run_semantic_kernel_nested_process() -> None:
_semantic_kernel.add_service(OpenAIChatCompletion(service_id="default"))
process_builder = _create_linear_process("Outer")
nested_process_step = process_builder.add_step_from_process(_create_linear_process("Inner"))
process_builder.steps[1].on_event(ProcessEvents.OUTPUT_READY_INTERNAL.value).send_event_to(
nested_process_step.where_input_event_is(ProcessEvents.START_PROCESS.value)
)
kernel_process = process_builder.build()
process_handle = await start(
process=kernel_process,
kernel=_semantic_kernel,
initial_event=ProcessEvents.START_PROCESS.value,
data="Test",
)
process_info = await process_handle.get_executor_state()
inner_process: KernelProcess | None = next(
(s for s in process_info.steps if s.state.name == "Inner"),
None,
)
if inner_process is None:
raise RuntimeError("Inner process state missing")
repeat_state: KernelProcessStepState[StepState] | None = next(
(s.state for s in inner_process.steps if s.state.name == "RepeatStep"),
None,
)
if repeat_state is None or repeat_state.state is None:
raise RuntimeError("RepeatStep state missing")
assert repeat_state.state.last_message == "Test Test Test Test" # nosec
######################################################################
# region Agent Framework nested workflow path
######################################################################
@dataclass
class RepeatPayload:
message: str
count: int = 2
class KickoffExecutor(Executor):
def __init__(self) -> None:
super().__init__(id="kickoff")
@handler
async def start(self, message: str, ctx: WorkflowContext[RepeatPayload]) -> None:
print(f"[OUTER] Start with message: {message}")
await ctx.send_message(RepeatPayload(message=message, count=2))
class OuterEchoExecutor(Executor):
def __init__(self) -> None:
super().__init__(id="outer_echo")
@handler
async def echo(self, payload: RepeatPayload, ctx: WorkflowContext[RepeatPayload]) -> None:
print(f"[OUTER ECHO] {payload.message}")
await ctx.send_message(payload)
class OuterRepeatExecutor(Executor):
def __init__(self, *, inner_target_id: str) -> None:
super().__init__(id="outer_repeat")
self._inner_target_id = inner_target_id
@handler
async def repeat(self, payload: RepeatPayload, ctx: WorkflowContext[RepeatPayload]) -> None:
repeated = " ".join([payload.message] * payload.count)
print(f"[OUTER REPEAT] {repeated}")
await ctx.send_message(RepeatPayload(message=repeated, count=2), target_id=self._inner_target_id)
class InnerEchoExecutor(Executor):
def __init__(self) -> None:
super().__init__(id="inner_echo")
@handler
async def echo(self, payload: RepeatPayload, ctx: WorkflowContext[RepeatPayload]) -> None:
print(f" [INNER ECHO] {payload.message}")
await ctx.send_message(payload)
class InnerRepeatExecutor(Executor):
def __init__(self) -> None:
super().__init__(id="inner_repeat")
@handler
async def repeat(self, payload: RepeatPayload, ctx: WorkflowContext[Never, str]) -> None:
repeated = " ".join([payload.message] * payload.count)
print(f" [INNER REPEAT] {repeated}")
await ctx.yield_output(repeated)
class CollectResultExecutor(Executor):
def __init__(self) -> None:
super().__init__(id="collector")
@handler
async def collect(self, result: str, ctx: WorkflowContext[Never, str]) -> None:
print(f"[COLLECTOR] Final result -> {result}")
await ctx.yield_output(result)
def _build_inner_workflow() -> WorkflowExecutor:
inner_echo = InnerEchoExecutor()
inner_repeat = InnerRepeatExecutor()
inner_workflow = WorkflowBuilder(start_executor=inner_echo).add_edge(inner_echo, inner_repeat).build()
return WorkflowExecutor(inner_workflow, id="inner_workflow")
async def run_agent_framework_nested_workflow(initial_message: str) -> Sequence[str]:
inner_executor = _build_inner_workflow()
kickoff = KickoffExecutor()
outer_echo = OuterEchoExecutor()
outer_repeat = OuterRepeatExecutor(inner_target_id=inner_executor.id)
collector = CollectResultExecutor()
outer_workflow = (
WorkflowBuilder(start_executor=kickoff)
.add_edge(kickoff, outer_echo)
.add_edge(outer_echo, outer_repeat)
.add_edge(outer_repeat, inner_executor)
.add_edge(inner_executor, collector)
.build()
)
results: list[str] = []
async for event in outer_workflow.run(initial_message, stream=True):
if event.type == "output":
results.append(cast(str, event.data))
return results
######################################################################
# endregion
######################################################################
async def main() -> None:
print("===== Agent Framework Nested Workflow =====")
af_results = await run_agent_framework_nested_workflow("Test")
for index, value in enumerate(af_results, start=1):
print(f"Result {index}: {value}")
print("\n===== Semantic Kernel Nested Process =====")
await run_semantic_kernel_nested_process()
if __name__ == "__main__":
asyncio.run(main())