Skip to content

Add tool and task evaluators to azure.ai.evaluation exports - #46450

Closed
Mohamed Hessien (m7md7sien) with Copilot wants to merge 3 commits into
mainfrom
copilot/add-evaluators-to-init-file
Closed

Mohamed Hessien (m7md7sien) with Copilot wants to merge 3 commits into
mainfrom
copilot/add-evaluators-to-init-file

Conversation

Copilot AI commented Apr 21, 2026 •

Copy link
Copy Markdown
Contributor
  • Inspect target package and locate /home/runner/work/azure-sdk-for-python/azure-sdk-for-python/sdk/evaluation/azure-ai-evaluation/azure/ai/evaluation/__init__.py
  • Run existing package validation commands before edits to capture baseline status
  • Add _TaskCompletionEvaluator, _ToolInputAccuracyEvaluator, and _ToolSelectionEvaluator imports/exports in __init__.py
  • Run targeted validation after edits
  • Create the pull request

@github-actions

Copy link
Copy Markdown
Contributor

Hi Copilot. Thank you for your interest in helping to improve the Azure SDK experience and for your contribution. We've noticed that there hasn't been recent engagement on this pull request. If this is still an active work stream, please let us know by pushing some changes or leaving a comment. Otherwise, we'll close this out in 7 days.

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR adds three additional internal evaluators to the public surface of the azure.ai.evaluation package by importing them in the package's __init__.py and registering them in __all__. This follows the existing convention for other underscore-prefixed ("private/preview") evaluators such as _ToolOutputUtilizationEvaluator and _ToolCallSuccessEvaluator, making the new tool/task evaluators importable from the top-level package.

Changes:

  • Added module imports for _TaskCompletionEvaluator, _ToolInputAccuracyEvaluator, and _ToolSelectionEvaluator.
  • Registered the three new evaluator names in __all__.

@github-actions

Copy link
Copy Markdown
Contributor

Hi Copilot. Thank you for your interest in helping to improve the Azure SDK experience and for your contribution. We've noticed that there hasn't been recent engagement on this pull request. If this is still an active work stream, please let us know by pushing some changes or leaving a comment. Otherwise, we'll close this out in 7 days.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants