feat(ai): instrument Agent Inspector funnel telemetry - #9580
Open
Dooriya Li (dooriya) wants to merge 3 commits into
Open
feat(ai): instrument Agent Inspector funnel telemetry#9580Dooriya Li (dooriya) wants to merge 3 commits into
Dooriya Li (dooriya) wants to merge 3 commits into
Conversation
Dooriya Li (dooriya)
force-pushed
the
dooriya-instrument-inspector-route-telemetry
branch
from
August 14, 2026 02:52
d85f04c to
cd09d23
Compare
Report categorical Inspector, Playground, and suppressed routes through extension telemetry. Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Dooriya Li (dooriya)
force-pushed
the
dooriya-instrument-inspector-route-telemetry
branch
from
August 14, 2026 02:58
cd09d23 to
8c79a76
Compare
Contributor
There was a problem hiding this comment.
Pull request overview
Adds local-client route telemetry for the Azure AI Agents extension.
Changes:
- Reports
inspector,playground, orsuppressedroute selection. - Adds route-selection tests and updates the azd SDK dependency.
- Documents the new telemetry contract.
Reviewed changes
Copilot reviewed 7 out of 8 changed files in this pull request and generated 1 comment.
Show a summary per file
| File | Description |
|---|---|
docs/specs/metrics-audit/telemetry-schema.md |
Defines the event contract. |
docs/specs/metrics-audit/feature-telemetry-matrix.md |
Adds routing telemetry coverage. |
docs/reference/telemetry-data.md |
Documents the public telemetry field. |
cli/azd/extensions/azure.ai.agents/README.md |
Explains route telemetry semantics. |
cli/azd/extensions/azure.ai.agents/internal/cmd/run.go |
Emits route-selection telemetry. |
cli/azd/extensions/azure.ai.agents/internal/cmd/run_test.go |
Tests route values and error handling. |
cli/azd/extensions/azure.ai.agents/go.mod |
Updates the azd SDK requirement. |
cli/azd/extensions/azure.ai.agents/go.sum |
Updates dependency checksums. |
💡 Configure MCP servers for context-aware, tailored reviews. Learn more in the docs.
Keep the Agents and Projects extensions on azd SDK v1.31.0 as required by their synthesis parity check. Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Dooriya Li (dooriya)
marked this pull request as ready for review
August 14, 2026 06:18
Dooriya Li (dooriya)
requested review from
JeffreyCA,
Rick Winter (RickWinter),
Glenn Harper (glharper),
Marina He (hemarina),
Hui Miao (huimiu),
Zhijie Huang (hund030),
Richard Park (richardpark-msft),
tg-msft,
John Miller (therealjohn),
Travis Angevine (trangevi),
Travis Wilson (trrwilson) and
Victor Vazquez (vhvb1989)
as code owners
August 14, 2026 06:18
|
Azure Pipelines: Successfully started running 1 pipeline(s). 6 pipeline(s) were filtered out due to trigger conditions. There may be pipelines that require an authorized user to comment /azp run to run. |
Zhijie Huang (hund030)
approved these changes
Aug 14, 2026
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Dooriya Li (dooriya)
requested review from
Xiaofu Huang (XiaofuHuang) and
anchenyi
as code owners
August 14, 2026 08:09
Contributor
There was a problem hiding this comment.
Pull request overview
Copilot reviewed 18 out of 21 changed files in this pull request and generated no new comments.
Suppressed comments (1)
docs/specs/metrics-audit/telemetry-schema.md:255
Fixes #9585is not satisfied by this contract. The issue also requires server/browser, agent-connection, first-request/response milestones and stable failure reasons, but this PR implements only route selection andui_ready. Please either implement the remaining funnel stages and failures before closing #9585, or stop auto-closing it and track the remaining work separately. [azd-code-reviewer]
| `azure.ai.inspector` | `inspector.funnel.stage` | The Inspector SPA sends `setViewReady` after mounting | `ext.stage`: fixed enum `ui_ready`; `ext.outcome`: fixed enum `succeeded`; this does not indicate agent connection |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
local_client.route.selectedfromazure.ai.agentsafter service/profile resolution, withext.route=inspector|playground|suppressedinspector.funnel.stagefromazure.ai.inspectorwhen the SPA sendssetViewReady, withext.stage=ui_readyandext.outcome=succeededFixes #9585
Validation
go test ./... -count=1incli/azd/extensions/azure.ai.agentsgo test ./... -count=1incli/azd/extensions/azure.ai.projectsgo test ./... -count=1,go build ./...,go vet ./..., andgo mod verifyincli/azd/extensions/azure.ai.inspectorTelemetryServicetests incli/azd/internal/grpcserver--trace-log-fileverification for all three route valuesext.usagespan forui_readysetViewReadynotification produced no duplicate spanTelemetry Change Checklist
Privacy review status: Required and pending approval before merge. The extension fields use fixed product-defined enums classified as
SystemMetadataforFeatureInsight; they contain no user-derived or customer content.New Fields
fields/fields.go; extension-suppliedext.*values are covered by the extension's own review instead — this PR usesext.route,ext.stage, andext.outcomeSystemMetadata/FeatureInsightdocs/specs/metrics-audit/telemetry-schema.mdNew Events
events/events.go— N/A for extension-owned events; constants are defined in their owning extensionsdocs/specs/metrics-audit/telemetry-schema.mdprefix.noun.verb)Privacy
CustomerContentemitted in telemetryTesting
Downstream
ext.usagealready supports dynamicext.*fieldsDocumentation
docs/specs/metrics-audit/feature-telemetry-matrix.md)docs/specs/metrics-audit/telemetry-schema.md) with the new fields/events