Chetan Toshniwal d907590494 feat(evals): add ground_truth support for similarity evaluator ...

- Include expected_output as ground_truth in Foundry JSONL dataset rows
- Add ground_truth to item schema and data mapping for similarity evaluator
- Add expected_output parameter to evaluate_workflow
- Add similarity Pattern 3 to evaluate_agent and evaluate_workflow samples
- Add tests for ground_truth in dataset, schema, and evaluate_workflow

d907590494 · 2026-04-13 15:04:46 -07:00

History

..

assets

[BREAKING] Python: fix OpenAI Azure routing and provider samples (#4925)

2026-03-27 13:33:39 +00:00

foundry

Python: Strip tools from FoundryAgent request when agent_reference is present (#5101)

2026-04-08 04:35:01 +00:00

test_foundry_evals.py

feat(evals): add ground_truth support for similarity evaluator

2026-04-13 15:04:46 -07:00