chetantoshniwal aa582d021d Python: feat(evals): add ground_truth support for similarity evaluator (#5234) ...

* feat(evals): add ground_truth support for similarity evaluator

- Include expected_output as ground_truth in Foundry JSONL dataset rows
- Add ground_truth to item schema and data mapping for similarity evaluator
- Add expected_output parameter to evaluate_workflow
- Add similarity Pattern 3 to evaluate_agent and evaluate_workflow samples
- Add tests for ground_truth in dataset, schema, and evaluate_workflow

* Apply suggestions from code review

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* fix: wrap long line to satisfy ruff E501

---------

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

aa582d021d · 2026-04-21 19:40:53 +00:00

History

..

foundry_evals

Python: feat(evals): add ground_truth support for similarity evaluator (#5234)

2026-04-21 19:40:53 +00:00

red_teaming

Python: [BREAKING] update to v1.0.0 (#5062)

2026-04-02 15:26:30 +00:00

self_reflection

Python: Foundry Evals integration for Python (#4750)

2026-03-31 15:53:06 +00:00