Enhance Copilot Review Analyst skill: v3 newsletter report + adoption-signal & fairness methodology, Fixes AB#3696013 - #449
Open
shahzaibj wants to merge 7 commits into
Conversation
…-signal & fairness methodology, Fixes AB#3696013 Report / rendering: - v3 newsletter Outlook report: 1200px hybrid-fluid shell, edge-to-edge newsletter masthead (inset hero + 1120px VML), big-number KPI hero grid, single-row meta-chips, Methodology section - Headline now leads with adoption % (Helpful & adopted), not precision - Document Outlook rendering learnings in report-formatting.md: single-row chip table (not inline-block), mso-line-height-rule:exactly for prose, edge-to-edge frame (whiten bgcolor AND inline CSS), inset masthead + VML width, Graph-draft delivery with Outlook COM fallback Classification / methodology: - Declined verdict + Copilot precision (Helpful / (Helpful + Incorrect)); Declined is neutral - Force-push confound validation before scoring precision - Engineer-intention nuance: correct-but-declined feedback is not a Copilot error - New adoption signals: reaction + apply-suggestion detection, merged-only PR filter, Phase 0 preflight coverage audit, review-coverage split, self-consistency gate, PR triage table Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Copilot-Session: d4fbe65f-9d71-4531-b63e-b5a12b21fba4
github-actions
Bot
changed the title
|
✅ Work item link check complete. Description contains link AB#3696013 to an Azure Boards work item. |
1 similar comment
|
✅ Work item link check complete. Description contains link AB#3696013 to an Azure Boards work item. |
…-signal & fairness methodology, Fixes AB#3696013 Report / rendering: - v3 newsletter Outlook report: 1200px hybrid-fluid shell, edge-to-edge newsletter masthead (inset hero + 1120px VML), big-number KPI hero grid, single-row meta-chips, Methodology section - Headline now leads with adoption % (Helpful & adopted), not precision - Document Outlook rendering learnings in report-formatting.md: single-row chip table (not inline-block), mso-line-height-rule:exactly for prose, edge-to-edge frame (whiten bgcolor AND inline CSS), inset masthead + VML width, Graph-draft delivery with Outlook COM fallback Classification / methodology: - Declined verdict + Copilot precision (Helpful / (Helpful + Incorrect)); Declined is neutral - Force-push confound validation before scoring precision - Engineer-intention nuance: correct-but-declined feedback is not a Copilot error - New adoption signals: reaction + apply-suggestion detection, merged-only PR filter, Phase 0 preflight coverage audit, review-coverage split, self-consistency gate, PR triage table Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Copilot-Session: d4fbe65f-9d71-4531-b63e-b5a12b21fba4
…-microsoft-copilot-review-analysis
…-signal & fairness methodology, Fixes AB#3696013 Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Copilot-Session: d4fbe65f-9d71-4531-b63e-b5a12b21fba4
…-microsoft-copilot-review-analysis
Removes the AuthClientAndroidPipelines and telemetry-platform ignore entries that were inadvertently carried over from earlier branch work; they are not part of the copilot-review-analyst skill changes. Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Copilot-Session: d4fbe65f-9d71-4531-b63e-b5a12b21fba4
Contributor
|
PR Body mentioned a .gitignore addition, but i'm not seeing it in the files, is it stale? |
somalaya
reviewed
Jul 29, 2026
| notHelpful = [ordered]@{ count = $confirmedNotHelpful; pct = $notHelpfulPct } | ||
| notHelpfulIncorrect = [ordered]@{ count = $confirmedNotHelpfulIncorrect; pct = $notHelpfulIncorrectPct } | ||
| declined = [ordered]@{ count = $declinedCount; pct = $declinedPct } | ||
| unresolved = [ordered]@{ count = $unresolved; pct = $unresolvedPct } |
Contributor
There was a problem hiding this comment.
unknown verdict is dropped from the snapshot - buckets won't reconcile to total.
$unknownCount is computed but never added to $snapshot. The emitted buckets are helpful + notHelpfulIncorrect + declined + unresolved, so any unknown comment makes them sum to less than total.
unknown does occur: in final-classification.ps1, a replied comment absent from ReplyVerdictsFile/OverridesFile stays "unknown", and that script's self-consistency gate treats unknown as a canonical bucket — so omitting it here makes the history inconsistent with the classification output.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
3 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Bakes this cycle's learnings into the copilot-review-analyst skill (
.github/skills/copilot-review-analyst). Two themes: a redesigned v3 newsletter report + hardened Outlook rendering, and a stronger, fairer classification methodology.Fixes AB#3696013
Report / rendering
assets/…-Outlook.html): 1200px hybrid-fluid shell, edge-to-edge newsletter masthead (inset hero + 1120px VML width), big-number KPI hero grid, single-row meta-chips, and a Methodology section. Committed as the anonymized sample, single-quoted (escaping-free).references/report-formatting.md§ v3 Newsletter Rendering:inline-blocktables stack vertically in classic Outlook.line-heightplusmso-line-height-rule:exactlyor the Word engine collapses leading.bgcolorand inline CSS (Word engine readsbgcolor).Classification / methodology
Helpful / (Helpful + Incorrect); Declined is neutral and never counted against Copilot.Notes
.md/.htmlassets remain structural references (illustrative prior-run data — computed fresh each run)..gitignoreadds sibling clone dirs so they're never committed.