Skip to content

Add tool and task evaluators to azure.ai.evaluation exports #46450

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
Copilot wants to merge 3 commits into from
Closed

Add tool and task evaluators to azure.ai.evaluation exports #46450

Changes from all commits
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
063d622
Expose additional private evaluators from azure.ai.evaluation package…
Copilot Apr 21, 2026
fe9439e
Merge branch 'main' into copilot/add-evaluators-to-init-file
m7md7sien Apr 21, 2026
7f4acf6
Merge branch 'main' into copilot/add-evaluators-to-init-file
m7md7sien Jun 28, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
6 changes: 6 additions & 0 deletions sdk/evaluation/azure-ai-evaluation/azure/ai/evaluation/__init__.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -34,6 +34,9 @@
from ._evaluators._document_retrieval import DocumentRetrievalEvaluator
from ._evaluators._tool_output_utilization import _ToolOutputUtilizationEvaluator
from ._evaluators._tool_call_success import _ToolCallSuccessEvaluator
from ._evaluators._task_completion import _TaskCompletionEvaluator
from ._evaluators._tool_input_accuracy import _ToolInputAccuracyEvaluator
from ._evaluators._tool_selection import _ToolSelectionEvaluator
from ._model_configurations import (
AzureAIProject,
AzureOpenAIModelConfiguration,
Expand Down Expand Up @@ -133,6 +136,9 @@ def lazy_import():
"CodeVulnerabilityEvaluator",
"UngroundedAttributesEvaluator",
"ToolCallAccuracyEvaluator",
"_TaskCompletionEvaluator",
"_ToolInputAccuracyEvaluator",
"_ToolSelectionEvaluator",
"_ToolOutputUtilizationEvaluator",
"_ToolCallSuccessEvaluator",
"AzureOpenAIGrader",
Expand Down
Loading