mirror of
https://github.com/microsoft/agent-framework.git
synced 2026-06-16 21:04:09 +08:00
Ben Thomas
c79f886dc3
* dotnet: refresh Foundry sample guidance Carry forward the still-relevant sample guidance and Foundry-specific documentation fixes from the old stacked sample migration work, adapted to the current repo layout and policy. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> * dotnet: rename Foundry sample env vars Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> * dotnet: remove persistent provider sample Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> * dotnet: drop SAMPLE_GUIDELINES.md from this PR Defer the guidelines doc and its cross-link to a follow-on PR to avoid broken-link failures in CI. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> * dotnet: add DefaultAzureCredential warning to remaining samples Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> * dotnet: address PR review feedback Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> --------- Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
c79f886dc3
·
2026-06-11 17:26:00 +00:00
History
Evaluation - Custom Evals
This sample demonstrates writing custom domain-specific evaluation functions using FunctionEvaluator.Create. Custom evaluators run locally with no cloud evaluator service needed — useful for enforcing business rules, format requirements, or safety guardrails.
What this sample demonstrates
- Writing custom checks with
FunctionEvaluator.Createfor domain-specific logic - Checking that a customer support agent doesn't refuse to help
- Verifying responses contain actionable steps (numbered lists or bullet points)
- Enforcing response length constraints
- Combining multiple custom checks into a
LocalEvaluator
Prerequisites
- .NET 10 SDK or later
- Azure authentication available to
DefaultAzureCredential(for local development, runaz login)
Set the following environment variables:
$env:FOUNDRY_PROJECT_ENDPOINT="https://your-foundry-service.services.ai.azure.com/api/projects/your-foundry-project"
$env:FOUNDRY_MODEL="gpt-4o-mini"
Run the sample
cd dotnet/samples/02-agents/Evaluation
dotnet run --project .\Evaluation_CustomEvals
See also
- Evaluation_SimpleEval — Simplest evaluation using Foundry quality evaluators (Relevance, Coherence)
- Evaluation_ExpectedOutputs — Evaluating against ground-truth expected outputs
- Evaluation_MixedProviders — Combining custom + Foundry evaluators in one call