Skip to content

feat(vertexai): add google_vertex_ai_online_evaluator resource - #18921

Open
iliesicatrinel wants to merge 2 commits into
GoogleCloudPlatform:mainfrom
iliesicatrinel:online-evaluator-resource
Open

feat(vertexai): add google_vertex_ai_online_evaluator resource#18921
iliesicatrinel wants to merge 2 commits into
GoogleCloudPlatform:mainfrom
iliesicatrinel:online-evaluator-resource

Conversation

@iliesicatrinel

@iliesicatrinel iliesicatrinel commented Sep 8, 2026

Copy link
Copy Markdown

Adds a new resource google_vertex_ai_online_evaluator (GA + beta) for Vertex AI
online evaluation. It periodically samples traces/sessions from an agent and
evaluates them using configured metric sources, supporting both inline predefined
metrics and references to google_vertex_ai_evaluation_metric (via
metric_resource_name).

Release Notes

`google_vertex_ai_online_evaluator`

@modular-magician modular-magician added the awaiting-approval Pull requests that need reviewer's approval to run presubmit tests label Sep 8, 2026
@github-actions
github-actions Bot requested a review from roaks3 September 8, 2026 15:09
@github-actions

github-actions Bot commented Sep 8, 2026

Copy link
Copy Markdown

Googlers: For automatic test runs see go/terraform-auto-test-runs.

@roaks3, a repository maintainer, has been assigned to review your changes. If you have not received review feedback within 2 business days, please leave a comment on this PR asking them to take a look.

You can help make sure that review is quick by doing a self-review and by running impacted tests locally.

@iliesicatrinel
iliesicatrinel marked this pull request as draft September 8, 2026 15:25
@iliesicatrinel
iliesicatrinel marked this pull request as ready for review September 10, 2026 13:24
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

awaiting-approval Pull requests that need reviewer's approval to run presubmit tests

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants