review

Autonomous PR review — reads diff, cross-references knowledge base, posts inline comments, and leaves an overall verdict.

npx skills add https://github.com/microsoft/powerplatform-build-tools --skill review

Review Agent — Autonomous PR Review

Reads a PR diff, cross-references the full knowledge base, posts inline comments on specific issues, and leaves an overall verdict. Zero user input required.

Invoke as:

  • /review <pr-number-or-url> — review a specific PR
  • /review — review the open PR on the current branch

For creating PRs use /create-pr. For CLI version bumps use /pac-cli-update.


Core rule: never ask, always decide

ConditionAction
Line-level issue (wrong pattern, bug risk, breaking change)Post inline comment on that line
File-level concern (missing test, architecture violation)Post inline comment on first line of file
Overall concern (security, missing checklist item)Add to overall review body
No issues in a sectionSkip the section — don't pad the review

Step 1 — Sync knowledge if stale

grep "## Last sync" memory/ado-knowledge.md 2>/dev/null | tail -1

If last sync was > 7 days ago or file missing: run /knowledge-sync inline, then continue.


Step 2 — Resolve PR and classify type

# Resolve PR number, head SHA, base branch, changed files
gh pr view <number-or-url> --json number,title,body,headRefOid,baseRefName,author,url 2>&1
gh pr checks <number-or-url> 2>&1
gh pr view <number-or-url> --json baseRefName,files,author \
  --jq '{base:.baseRefName, author:.author.login, files:[.files[].path]}' 2>&1

Capture: PR_NUMBER, HEAD_SHA, BASE_BRANCH.

Classify the PR type — determines which checks run:

Changed filesPR typeChecks
nuget.json + extension/overview.md onlyPAC CLI bumpStep 3a
package.json + package-lock.json onlynpm dep updateStep 3b
package.json + ALL task.json filesNode target updateStep 3b + Step 5
src/tasks/*/index.ts or selective task.jsonFeature / new inputStep 5 (full)
Base = release/stable (any type)Release branch PRStep 3c first, then type check

Step 3 — Type-specific checks (run the section matching the PR type)

3a — PAC CLI bump checks (nuget.json changed)

# Verify both packages have the same version
node -e "
const n = require('./nuget.json');
const vers = n.packages.map(p => p.version);
console.log('versions:', [...new Set(vers)].join(', '));
console.log(vers.every(v => v === vers[0]) ? 'OK: match' : 'MISMATCH');
" 2>&1

# Verify the version exists on nuget.org
curl -s "https://api.nuget.org/v3-flatcontainer/microsoft.powerapps.cli/index.json" \
  | node -e "const d=JSON.parse(require('fs').readFileSync('/dev/stdin','utf8')); \
    const v=require('./nuget.json').packages[0].version; \
    console.log(d.versions.includes(v)?'nuget: found':'nuget: NOT FOUND')" 2>&1

Request changes immediately if:

  • nuget.json packages have mismatched versions
  • Version does not exist on nuget.org
  • overview.md has no entry for the new version
  • {{NextReleaseVersion}} placeholder was removed from overview.md

3b — npm dependency checks (package.json changed)

Check the diff for:

  • No flat minimatch@^3.x override — causes infinite npm resolution loop
  • ajv override stays at ^6.x — v8 breaks ESLint
  • New overrides are at minimum required version (not over-pinned)
  • inBundle: true entries in package-lock.json changes are intentional (overrides can't reach them)
  • No new direct dependency that should be in bundleDependencies

3c — Release/stable branch checks (base == release/stable)

Release PRs must be version bumps only. Request changes immediately if:

  • Contains .ts logic changes (not just version string changes)
  • Adds new dependencies not present in the corresponding main PR
  • No corresponding merged main PR exists with the same changes

Verify the paired main PR exists:

gh search prs --repo microsoft/powerplatform-build-tools \
  --state merged --base main "<version-or-keyword>" 2>&1

Step 4 — Research context

Run in parallel to inform the review:

# Find similar past PRs (2-3 keywords from PR title)
gh search prs --repo microsoft/powerplatform-build-tools \
  --state merged --limit 8 "<keyword1> <keyword2>" 2>&1

# For top matches, read the body:
gh pr view <past-pr-number> --json title,body,mergedAt 2>&1

Also check memory/ado-knowledge.md for related ADO work items. Skip ADO query for pure PAC CLI or dependency PRs — rarely adds value.


Step 5 — File-level review (feature/bug fix PRs, or any PR touching src/)

Fetch the full diff:

gh pr diff <PR_NUMBER> 2>&1

For each changed file apply:

File patternWhat to check
src/tasks/*/index.tstl.getInput() used correctly; errors reach tl.setResult(TaskResult.Failed, ...); no pac args assembled here
src/tasks/*/task.jsonInput names unchanged (renaming breaks customer pipelines); type correct; required set correctly
src/host/BuildToolsHost.tsALL 32 tasks affected — flag blast radius
src/params/auth/getCredentials.tsAll four auth types still work: UsernamePassword, SPN, ManagedIdentity, WorkloadIdentity
src/params/auth/getEnvironmentUrl.ts4-level fallback preserved: task input → pipeline variable → connection → default
extension/task-metadata.jsonLIVE GUIDs must never change
extension/extension-manifest.jsonPublisher and extension ID must not change
gulp/pack.mjstar imported via createRequire, not ESM import
test/unit-test/**New behaviour is tested; mocks use rewiremock

Security (every PR):

  • No secrets, tokens, or credentials committed
  • No --no-verify or commit hook bypasses

Architecture alignment:

  • Pipeline logic stays in build-tools; pac CLI arg construction stays in cli-wrapper
  • New tasks follow IIFE → isRunningOnAgent()main() → cli-wrapper pattern

Known failure patterns from knowledge base:

  • WhoAmI locale failure (ADO #4846644): flag any change near whoAmI or locale handling
  • AAD/OAuth authority (ADO #4863652): resolveCloudInstance() map must be preserved
  • PVA import failure (IcM 604312672): pac CLI version bumps should reference changelog

Step 6 — Post inline comments

HEAD_SHA=$(gh pr view <PR_NUMBER> --json headRefOid --jq .headRefOid)

gh api repos/microsoft/powerplatform-build-tools/pulls/<PR_NUMBER>/comments \
  --method POST \
  --field body="<comment>" \
  --field commit_id="$HEAD_SHA" \
  --field path="<file-path>" \
  --field line=<line-number> \
  --field side="RIGHT" 2>&1

Format: ⚠️ <risk> / 🚨 Breaking: <impact> / 💡 Suggestion: / ❓ <question>

Max 15 inline comments — consolidate minor points into the overall review body.


Step 7 — Post overall review and verdict

gh pr review <PR_NUMBER> --comment --body "$(cat <<'EOF'
## Review

**Reviewed by:** Claude Code (autonomous review agent)
**PR type:** <PAC CLI bump / npm dep update / feature / release branch>
**Similar PRs:** <titles + numbers, or "none">
**ADO context:** <relevant items, or "none">

### Breaking changes
<task.json, GUID, or interface changes — or "None detected">

### Security
<!-- Omit if no findings -->

### Architecture
<!-- Omit if no findings -->

### Dependencies
<!-- Omit if package files unchanged -->

### Suggestions
<!-- Omit if none -->

### Verdict
**✅ Approve** / **🔄 Request changes** / **💬 Comment** — <one line reason>
EOF
)" 2>&1

# Then execute the verdict:
gh pr review <PR_NUMBER> --approve 2>&1
# or
gh pr review <PR_NUMBER> --request-changes --body "<blocker>" 2>&1

Verdict decision table

ConditionVerdict
LIVE GUID changedRequest changes — critical breaking
task.json input renamedRequest changes — breaks customer pipelines
Secret/credential in diffRequest changes — security
CI failing on non-functional-test stepRequest changes
release/stable PR has logic changesRequest changes — version bumps only on release branch
release/stable PR missing paired main PRRequest changes
nuget.json package version mismatchRequest changes — CLI update incomplete
PAC CLI version not on nuget.orgRequest changes — version doesn't exist
Only non-blocking suggestionsApprove with inline suggestions
PAC CLI bump verified cleanApprove
No findingsApprove
Intent unclearComment

Never:

  • Approve a PR with a LIVE GUID change, renamed input, or committed secret
  • Block a PR because functional tests fail locally (expected — require live credentials)
  • Re-flag elliptic LOW vuln (known accepted risk, no patch exists)

More skills from microsoft

oss-growth
microsoft
OSS growth hacker persona
agent-framework-azure-ai-py
microsoft
Build Azure AI Foundry agents using the Microsoft Agent Framework Python SDK (agent-framework-azure-ai). Use when creating persistent agents with AzureAIAgentsProvider, using hosted tools (code interpreter, file search, web search), integrating MCP servers, managing conversation threads, or implementing streaming responses. Covers function tools, structured outputs, and multi-tool agents.
development
airunway-aks-setup
microsoft
Set up AI Runway on AKS — from bare cluster to running model. Covers cluster verification, controller install, GPU assessment, provider setup, and first deployment. WHEN: "setup AI Runway", "onboard AKS cluster", "install AI Runway", "airunway setup", "deploy model to AKS", "GPU inference on AKS", "KAITO setup on AKS", "run LLM on AKS", "vLLM on AKS", "set up model serving on AKS", "AI Runway controller".
devops
appinsights-instrumentation
microsoft
Guidance for instrumenting webapps with Azure Application Insights. Provides telemetry patterns, SDK setup, and configuration references. WHEN: how to instrument app, App Insights SDK, telemetry patterns, what is App Insights, Application Insights guidance, instrumentation examples, APM best practices.
devops
applicationinsights-web-ts
microsoft
Instrument browser/web apps with the Application Insights JavaScript SDK (@microsoft/applicationinsights-web). Use for Real User Monitoring (RUM) — page views, clicks, AJAX/fetch dependencies, exceptions, custom events, and browser-side GenAI agent traces correlated to backend OpenTelemetry traces. Covers SDK Loader Script and npm setup, framework extensions (React, React Native, Angular), Click Analytics, telemetry initializers, and OTel GenAI semantic conventions for agent/tool/model spans emitted from the browser.
devops
azure-ai-anomalydetector-java
microsoft
Build anomaly detection applications with Azure AI Anomaly Detector SDK for Java. Use when implementing univariate/multivariate anomaly detection, time-series analysis, or AI-powered monitoring.
development
azure-ai-language-conversations-py
microsoft
Implement Conversational Language Understanding (CLU) using the azure-ai-language-conversations Python SDK. Use when working with ConversationAnalysisClient to analyze conversation intent and entities, building NLP features, or integrating language understanding into applications.
development
azure-ai-ml-py
microsoft
Azure Machine Learning SDK v2 for Python. Use for ML workspaces, jobs, models, datasets, compute, and pipelines. Triggers: "azure-ai-ml", "MLClient", "workspace", "model registry", "training jobs", "datasets".
development