mirror of https://github.com/microsoft/agent-framework.git synced 2026-06-16 21:04:09 +08:00

Files

T

Ben Thomas c79f886dc3 .NET: Align Foundry sample environment variables and credentials. (#6422 )

* dotnet: refresh Foundry sample guidance

Carry forward the still-relevant sample guidance and Foundry-specific documentation fixes from the old stacked sample migration work, adapted to the current repo layout and policy.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>

* dotnet: rename Foundry sample env vars

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>

* dotnet: remove persistent provider sample

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>

* dotnet: drop SAMPLE_GUIDELINES.md from this PR

Defer the guidelines doc and its cross-link to a follow-on PR to avoid broken-link failures in CI.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>

* dotnet: add DefaultAzureCredential warning to remaining samples

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>

* dotnet: address PR review feedback

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>

---------

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>

c79f886dc3 · 2026-06-11 17:26:00 +00:00

History

Evaluation_WorkflowExpectedOutputs.csproj

.NET: feat(evals): add ground_truth/expected_output support for workflow evaluation (#5755 )

2026-05-13 19:03:27 +00:00

Program.cs

.NET: Align Foundry sample environment variables and credentials. (#6422 )

2026-06-11 17:26:00 +00:00

README.md

.NET: Align Foundry sample environment variables and credentials. (#6422 )

2026-06-11 17:26:00 +00:00

README.md

Evaluation - Workflow Expected Outputs

This sample demonstrates evaluating a multi-agent workflow's final answer against a golden expected output using Foundry's reference-based Similarity evaluator.

What this sample demonstrates

Building a small researcher → editor workflow
Running the workflow and obtaining a Run
Calling run.EvaluateAsync(evaluator, expectedOutput: ...) to attach a ground-truth answer to the overall workflow item
Using FoundryEvals.Similarity, which requires a ground_truth value per item

The expectedOutput value is stamped onto the overall EvalItem.ExpectedOutput and is surfaced to Foundry as ground_truth in the JSONL payload sent to the Evals API.

Prerequisites

.NET 10 SDK or later
Azure authentication available to DefaultAzureCredential (for local development, run az login)

Set the following environment variables:

$env:FOUNDRY_PROJECT_ENDPOINT="https://your-foundry-service.services.ai.azure.com/api/projects/your-foundry-project"
$env:FOUNDRY_MODEL="gpt-4o-mini"

Run the sample

cd dotnet/samples/03-workflows/Evaluation
dotnet run --project .\Evaluation_WorkflowExpectedOutputs