Skip to content

feat: add --no-ask-user flag to copilot agentic engine for fully autonomous runs#25822

Merged
pelikhan merged 2 commits intomainfrom
copilot/apply-flag-to-agent-and-detection-jobs
Apr 11, 2026
Merged

feat: add --no-ask-user flag to copilot agentic engine for fully autonomous runs#25822
pelikhan merged 2 commits intomainfrom
copilot/apply-flag-to-agent-and-detection-jobs

Conversation

Copy link
Copy Markdown
Contributor

Copilot AI commented Apr 11, 2026

Reapplies changes from #25772 onto HEAD. Emits --no-ask-user when invoking the Copilot CLI to suppress interactive prompts during both agent and detection jobs, version-gated to CLI ≥ 1.0.19.

Changes

  • pkg/constants/version_constants.go: Add CopilotNoAskUserMinVersion = "1.0.19"
  • pkg/workflow/copilot_engine_execution.go:
    • copilotSupportsNoAskUser() version-gate helper following the awfSupportsExcludeEnv/awfSupportsCliProxy pattern
    • Emit --no-ask-user for both agent and detection jobs when version supports it
    • Hoist isDetectionJob declaration to share between --no-ask-user and --autopilot guards
  • pkg/workflow/copilot_engine_test.go: TestCopilotEngineNoAskUser (8 cases) and TestCopilotSupportsNoAskUser (10 cases)
  • 187 lock files recompiled, 2 golden files updated

Version-gate logic

Version --no-ask-user emitted?
unspecified (default 1.0.21)
latest
>= 1.0.19
< 1.0.19
non-semver (e.g. branch name) ❌ (conservative)

ADR: ADR-0001: Version-Gated --no-ask-user Flag for Autonomous Copilot Agent Runs



✨ PR Review Safe Output Test - Run 24285347567

💥 [THE END] — Illustrated by Smoke Claude · ● 202K ·

…nomous runs

Emits --no-ask-user when invoking the Copilot CLI to suppress interactive
prompts during both agent and detection jobs, version-gated to CLI >= 1.0.19.

Agent-Logs-Url: https://github.com/github/gh-aw/sessions/ddd5fcf2-8532-4ae2-b7c7-77eebe7ba539

Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>
Copy link
Copy Markdown
Collaborator

@pelikhan pelikhan left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@copilot ensure agent and detection jobs have the flag

@@ -0,0 +1,80 @@
# ADR-0001: Version-Gated --no-ask-user Flag for Autonomous Copilot Agent Runs
Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@copilot renumber adr to PR number

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Renamed ADR from 0001 to 25822 in commit f4a1c10.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👋 The smoke test agent was here! Great work renaming the ADR — using the PR number as the filename is a much more collision-resistant approach. 🚀

📰 BREAKING: Report filed by Smoke Copilot · ● 792.3K

@pelikhan pelikhan marked this pull request as ready for review April 11, 2026 14:58
Copilot AI review requested due to automatic review settings April 11, 2026 14:58
Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR adds version-gated support for emitting Copilot CLI’s --no-ask-user flag so agentic runs can be fully non-interactive (including detection jobs), while avoiding failures on older CLI versions.

Changes:

  • Introduces a minimum supported version constant (CopilotNoAskUserMinVersion = 1.0.19) and a copilotSupportsNoAskUser() helper for version-gating.
  • Emits --no-ask-user in generated Copilot CLI invocations (agent + detection) when supported; updates tests accordingly.
  • Regenerates workflow lock files and updates wasm golden fixtures to reflect the new CLI arg.
Show a summary per file
File Description
pkg/constants/version_constants.go Adds CopilotNoAskUserMinVersion constant used for gating the flag.
pkg/workflow/copilot_engine_execution.go Adds semver-gated --no-ask-user emission and helper copilotSupportsNoAskUser().
pkg/workflow/copilot_engine_test.go Adds/updates unit tests covering --no-ask-user emission and version gating.
pkg/workflow/testdata/TestWasmGolden_CompileFixtures/basic-copilot.golden Updates expected generated workflow output to include --no-ask-user.
pkg/workflow/testdata/TestWasmGolden_CompileFixtures/with-imports.golden Updates expected generated workflow output to include --no-ask-user.
.github/workflows/workflow-health-manager.lock.yml Regenerated lock workflow to include --no-ask-user in Copilot invocations.
.github/workflows/workflow-generator.lock.yml Regenerated lock workflow to include --no-ask-user in Copilot invocations.
.github/workflows/weekly-safe-outputs-spec-review.lock.yml Regenerated lock workflow to include --no-ask-user in Copilot invocations.
.github/workflows/weekly-blog-post-writer.lock.yml Regenerated lock workflow to include --no-ask-user in Copilot invocations.
.github/workflows/update-astro.lock.yml Regenerated lock workflow to include --no-ask-user in Copilot invocations.
.github/workflows/test-workflow.lock.yml Regenerated lock workflow to include --no-ask-user in Copilot invocations.
.github/workflows/test-project-url-default.lock.yml Regenerated lock workflow to include --no-ask-user in Copilot invocations.
.github/workflows/test-dispatcher.lock.yml Regenerated lock workflow to include --no-ask-user in Copilot invocations.
.github/workflows/terminal-stylist.lock.yml Regenerated lock workflow to include --no-ask-user in Copilot invocations.
.github/workflows/technical-doc-writer.lock.yml Regenerated lock workflow to include --no-ask-user in Copilot invocations.
.github/workflows/super-linter.lock.yml Regenerated lock workflow to include --no-ask-user in Copilot invocations.
.github/workflows/sub-issue-closer.lock.yml Regenerated lock workflow to include --no-ask-user in Copilot invocations.
.github/workflows/smoke-update-cross-repo-pr.lock.yml Regenerated lock workflow to include --no-ask-user in Copilot invocations.
.github/workflows/smoke-service-ports.lock.yml Regenerated lock workflow to include --no-ask-user in Copilot invocations.
.github/workflows/smoke-create-cross-repo-pr.lock.yml Regenerated lock workflow to include --no-ask-user in Copilot invocations.
.github/workflows/security-review.lock.yml Regenerated lock workflow to include --no-ask-user in Copilot invocations.
.github/workflows/security-compliance.lock.yml Regenerated lock workflow to include --no-ask-user in Copilot invocations.
.github/workflows/repository-quality-improver.lock.yml Regenerated lock workflow to include --no-ask-user in Copilot invocations.
.github/workflows/repo-tree-map.lock.yml Regenerated lock workflow to include --no-ask-user in Copilot invocations.
.github/workflows/repo-audit-analyzer.lock.yml Regenerated lock workflow to include --no-ask-user in Copilot invocations.
.github/workflows/refiner.lock.yml Regenerated lock workflow to include --no-ask-user in Copilot invocations.
.github/workflows/refactoring-cadence.lock.yml Regenerated lock workflow to include --no-ask-user in Copilot invocations.
.github/workflows/q.lock.yml Regenerated lock workflow to include --no-ask-user in Copilot invocations.
.github/workflows/python-data-charts.lock.yml Regenerated lock workflow to include --no-ask-user in Copilot invocations.
.github/workflows/pr-triage-agent.lock.yml Regenerated lock workflow to include --no-ask-user in Copilot invocations.
.github/workflows/pr-nitpick-reviewer.lock.yml Regenerated lock workflow to include --no-ask-user in Copilot invocations.
.github/workflows/portfolio-analyst.lock.yml Regenerated lock workflow to include --no-ask-user in Copilot invocations.
.github/workflows/plan.lock.yml Regenerated lock workflow to include --no-ask-user in Copilot invocations.
.github/workflows/pdf-summary.lock.yml Regenerated lock workflow to include --no-ask-user in Copilot invocations.
.github/workflows/org-health-report.lock.yml Regenerated lock workflow to include --no-ask-user in Copilot invocations.
.github/workflows/notion-issue-summary.lock.yml Regenerated lock workflow to include --no-ask-user in Copilot invocations.
.github/workflows/metrics-collector.lock.yml Regenerated lock workflow to include --no-ask-user in Copilot invocations.
.github/workflows/jsweep.lock.yml Regenerated lock workflow to include --no-ask-user in Copilot invocations.
.github/workflows/issue-triage-agent.lock.yml Regenerated lock workflow to include --no-ask-user in Copilot invocations.
.github/workflows/issue-monster.lock.yml Regenerated lock workflow to include --no-ask-user in Copilot invocations.
.github/workflows/gpclean.lock.yml Regenerated lock workflow to include --no-ask-user in Copilot invocations.
.github/workflows/glossary-maintainer.lock.yml Regenerated lock workflow to include --no-ask-user in Copilot invocations.
.github/workflows/github-remote-mcp-auth-test.lock.yml Regenerated lock workflow to include --no-ask-user in Copilot invocations.
.github/workflows/functional-pragmatist.lock.yml Regenerated lock workflow to include --no-ask-user in Copilot invocations.
.github/workflows/firewall.lock.yml Regenerated lock workflow to include --no-ask-user in Copilot invocations.
.github/workflows/example-permissions-warning.lock.yml Regenerated lock workflow to include --no-ask-user in Copilot invocations.
.github/workflows/dictation-prompt.lock.yml Regenerated lock workflow to include --no-ask-user in Copilot invocations.
.github/workflows/dev.lock.yml Regenerated lock workflow to include --no-ask-user in Copilot invocations.
.github/workflows/dependabot-go-checker.lock.yml Regenerated lock workflow to include --no-ask-user in Copilot invocations.
.github/workflows/dependabot-burner.lock.yml Regenerated lock workflow to include --no-ask-user in Copilot invocations.
.github/workflows/dead-code-remover.lock.yml Regenerated lock workflow to include --no-ask-user in Copilot invocations.
.github/workflows/daily-workflow-updater.lock.yml Regenerated lock workflow to include --no-ask-user in Copilot invocations.
.github/workflows/daily-team-status.lock.yml Regenerated lock workflow to include --no-ask-user in Copilot invocations.
.github/workflows/daily-semgrep-scan.lock.yml Regenerated lock workflow to include --no-ask-user in Copilot invocations.
.github/workflows/daily-secrets-analysis.lock.yml Regenerated lock workflow to include --no-ask-user in Copilot invocations.
.github/workflows/daily-regulatory.lock.yml Regenerated lock workflow to include --no-ask-user in Copilot invocations.
.github/workflows/daily-malicious-code-scan.lock.yml Regenerated lock workflow to include --no-ask-user in Copilot invocations.
.github/workflows/daily-integrity-analysis.lock.yml Regenerated lock workflow to include --no-ask-user in Copilot invocations.
.github/workflows/daily-cli-tools-tester.lock.yml Regenerated lock workflow to include --no-ask-user in Copilot invocations.
.github/workflows/daily-cli-performance.lock.yml Regenerated lock workflow to include --no-ask-user in Copilot invocations.
.github/workflows/daily-assign-issue-to-user.lock.yml Regenerated lock workflow to include --no-ask-user in Copilot invocations.
.github/workflows/daily-architecture-diagram.lock.yml Regenerated lock workflow to include --no-ask-user in Copilot invocations.
.github/workflows/craft.lock.yml Regenerated lock workflow to include --no-ask-user in Copilot invocations.
.github/workflows/copilot-token-optimizer.lock.yml Regenerated lock workflow to include --no-ask-user in Copilot invocations.
.github/workflows/copilot-token-audit.lock.yml Regenerated lock workflow to include --no-ask-user in Copilot invocations.
.github/workflows/copilot-pr-merged-report.lock.yml Regenerated lock workflow to include --no-ask-user in Copilot invocations.
.github/workflows/contribution-check.lock.yml Regenerated lock workflow to include --no-ask-user in Copilot invocations.
.github/workflows/constraint-solving-potd.lock.yml Regenerated lock workflow to include --no-ask-user in Copilot invocations.
.github/workflows/code-simplifier.lock.yml Regenerated lock workflow to include --no-ask-user in Copilot invocations.
.github/workflows/code-scanning-fixer.lock.yml Regenerated lock workflow to include --no-ask-user in Copilot invocations.
.github/workflows/ci-coach.lock.yml Regenerated lock workflow to include --no-ask-user in Copilot invocations.
.github/workflows/brave.lock.yml Regenerated lock workflow to include --no-ask-user in Copilot invocations.
.github/workflows/bot-detection.lock.yml Regenerated lock workflow to include --no-ask-user in Copilot invocations.
.github/workflows/artifacts-summary.lock.yml Regenerated lock workflow to include --no-ask-user in Copilot invocations.
.github/workflows/archie.lock.yml Regenerated lock workflow to include --no-ask-user in Copilot invocations.
.github/workflows/agentic-observability-kit.lock.yml Regenerated lock workflow to include --no-ask-user in Copilot invocations.
.github/workflows/agent-persona-explorer.lock.yml Regenerated lock workflow to include --no-ask-user in Copilot invocations.
.github/workflows/agent-performance-analyzer.lock.yml Regenerated lock workflow to include --no-ask-user in Copilot invocations.
.github/workflows/ace-editor.lock.yml Regenerated lock workflow to include --no-ask-user in Copilot invocations.
.changeset/patch-add-copilot-no-ask-user-flag.md Adds release note entry for the new version-gated --no-ask-user behavior.

Copilot's findings

Tip

Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

  • Files reviewed: 130/130 changed files
  • Comments generated: 1

"gh-aw": patch
---

Enable `--no-ask-user` for Copilot agent jobs when the configured Copilot CLI version supports it (>= `1.0.19`), allowing fully autonomous runs while preserving conservative behavior for unsupported or non-semver versions.
Copy link

Copilot AI Apr 11, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The changeset description says this enables --no-ask-user for “Copilot agent jobs”, but the implementation also emits the flag for detection jobs (when version-gated). Please update the release note text to reflect both agent and detection runs (or use broader wording like “Copilot runs”).

Suggested change
Enable `--no-ask-user` for Copilot agent jobs when the configured Copilot CLI version supports it (>= `1.0.19`), allowing fully autonomous runs while preserving conservative behavior for unsupported or non-semver versions.
Enable `--no-ask-user` for Copilot runs when the configured Copilot CLI version supports it (>= `1.0.19`), allowing fully autonomous runs while preserving conservative behavior for unsupported or non-semver versions.

Copilot uses AI. Check for mistakes.
@github-actions
Copy link
Copy Markdown
Contributor

✅ Design Decision Gate — ADR Verified

The implementation in this PR aligns with the stated Architecture Decision Record.

ADR reviewed: ADR-0001: Version-Gated --no-ask-user Flag for Autonomous Copilot Agent Runs

Verification Summary

All normative (RFC 2119) requirements are satisfied:

Requirement Status
--no-ask-user emitted for both agent and detection jobs when version ≥ 1.0.19 copilot_engine_execution.go lines 65–71, before isDetectionJob branch
Flag NOT emitted for semver < 1.0.19 copilotSupportsNoAskUser returns false
Flag NOT emitted for non-semver strings (conservative) semverutil.Compare returns < 0 for non-semver like "main"
Nil or empty EngineConfig treated as supported ✅ Early return true when no version override is set
"latest" (case-insensitive) treated as supported strings.EqualFold guard present
Min version defined as named constant CopilotNoAskUserMinVersion, not inlined pkg/constants/version_constants.go:68
Logic encapsulated in copilotSupportsNoAskUser helper, matching awfSupportsExcludeEnv/awfSupportsCliProxy pattern copilot_engine_execution.go:481
Integration tests covering full agent/detection × version matrix TestCopilotEngineNoAskUser — 8 cases
Unit tests covering nil config, empty version, "latest", exact minimum, above minimum, below minimum, and non-semver TestCopilotSupportsNoAskUser — 10 cases (includes "LATEST" for case-insensitivity and "v1.0.19" for v-prefix handling)

The design decision has been recorded and the implementation follows it faithfully. Great work! 🏗️

🏗️ ADR gate enforced by Design Decision Gate 🏗️ · ● 114.7K ·

Copy link
Copy Markdown
Contributor

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Implementation verified: code aligns with the linked Architecture Decision Record (ADR-0001). All MUST/MUST NOT normative requirements are satisfied — version gating, conservative non-semver handling, constant definition, helper encapsulation pattern, and test coverage.

@github-actions
Copy link
Copy Markdown
Contributor

🧪 Test Quality Sentinel Report

Test Quality Score: 90/100

Excellent test quality

Metric Value
New/modified tests analyzed 3
✅ Design tests (behavioral contracts) 3 (100%)
⚠️ Implementation tests (low value) 0 (0%)
Tests with error/edge cases 3 (100%)
Duplicate test clusters 0
Test inflation detected ⚠️ Yes — 167 test lines added vs. 41 production lines (4.1:1 ratio, threshold 2:1)
🚨 Coding-guideline violations None

Test Classification Details

Test File Classification Issues Detected
TestCopilotEngineExecutionSteps (added assertion) pkg/workflow/copilot_engine_test.go:162 ✅ Design None — verifies --no-ask-user appears in generated step output for detection jobs
TestCopilotEngineNoAskUser pkg/workflow/copilot_engine_test.go:1540 ✅ Design None — 8 table cases covering version boundary, both job types, and the negative path
TestCopilotSupportsNoAskUser pkg/workflow/copilot_engine_test.go:~1620 ✅ Design None — 10 table cases covering version compatibility contract (semver, v-prefix, case, non-semver)

Detailed Analysis

TestCopilotEngineExecutionSteps (added assertion)
Verifies the observable output of GetExecutionSteps() contains --no-ask-user for detection jobs (where SafeOutputs == nil). Tests the real command generated — a behavioral assertion that would catch a regression in flag emission.

TestCopilotEngineNoAskUser — 8 table cases
An end-to-end table-driven test exercising GetExecutionSteps() directly. Covers:

  • Happy path: default version, "latest", explicit v1.0.19, v1.0.20
  • Boundary: v1.0.18 (below minimum → flag absent), v1.0.19 (exact minimum → flag present)
  • Old versions: v1.0.0 → flag absent
  • Both job types: agent job (SafeOutputs != nil) and detection job (SafeOutputs == nil)
  • Negative path explicitly tested: 2 of 8 cases assert the flag is NOT present (expectNoAsk: false)

TestCopilotSupportsNoAskUser — 10 table cases
Unit-tests the version-gating helper directly. Covers the full version compatibility contract: nil config, empty version, "latest", "LATEST" (case-insensitive), exact minimum 1.0.19, v1.0.19 (v-prefix), above minimum, below minimum, very old version, and a non-semver branch name ("main" → conservative false). Every case where the flag should be blocked is explicitly tested.


⚠️ Test Inflation Note

167 lines were added to copilot_engine_test.go vs. 41 lines to copilot_engine_execution.go (ratio ≈ 4.1:1, threshold 2:1). This triggers a score deduction of 10 points per the rubric.

In this case the ratio is justified: version-gating correctness at boundary conditions (v1.0.18 vs v1.0.19) requires more test cases than production code. The additional cases add genuine value and are not padding. No action required.


Language Support

Tests analyzed:

  • 🐹 Go (*_test.go): 3 tests — unit (//go:build !integration)
  • 🟨 JavaScript (*.test.cjs, *.test.js): 0 tests changed

Verdict

Check passed. 0% of new tests are implementation tests (threshold: 30%). All three test functions verify observable behavioral contracts, cover error/boundary paths, and use no forbidden mock libraries. The 4.1:1 test-to-production-line ratio is elevated but reflects thorough version-boundary coverage rather than test padding.


📖 Understanding Test Classifications

Design Tests (High Value) verify what the system does:

  • Assert on observable outputs, return values, or state changes
  • Cover error paths and boundary conditions
  • Would catch a behavioral regression if deleted
  • Remain valid even after internal refactoring

Implementation Tests (Low Value) verify how the system does it:

  • Assert on internal function calls (mocking internals)
  • Only test the happy path with typical inputs
  • Break during legitimate refactoring even when behavior is correct
  • Give false assurance: they pass even when the system is wrong

Goal: Shift toward tests that describe the system's behavioral contract — the promises it makes to its users and collaborators.

🧪 Test quality analysis by Test Quality Sentinel · ● 748.2K ·

Copy link
Copy Markdown
Contributor

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

✅ Test Quality Sentinel: 90/100. Test quality is excellent — 0% of new tests are implementation tests (threshold: 30%). All new tests verify observable behavioral contracts with thorough boundary and edge-case coverage.

Copy link
Copy Markdown
Contributor Author

Copilot AI commented Apr 11, 2026

@copilot ensure agent and detection jobs have the flag

Confirmed — --no-ask-user is already emitted for both agent and detection jobs when the version supports it. The flag is added unconditionally at line 69-72 of copilot_engine_execution.go (no isDetectionJob guard), and tests cover both cases: "detection job emits --no-ask-user with default version" and "default version emits --no-ask-user for agent job".

Copilot AI requested a review from pelikhan April 11, 2026 15:09
@pelikhan pelikhan added the smoke label Apr 11, 2026
@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 11, 2026

✅ All tools validated successfully! Agent Container Smoke Test confirms agent container is ready.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 11, 2026

✨ The prophecy is fulfilled... Smoke Codex has completed its mystical journey. The stars align. 🌟

@github-actions
Copy link
Copy Markdown
Contributor

📰 BREAKING: Smoke Copilot is now investigating this pull request. Sources say the story is developing...

@github-actions github-actions bot removed the smoke label Apr 11, 2026
@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 11, 2026

🎬 THE ENDSmoke Claude MISSION: ACCOMPLISHED! The hero saves the day! ✨

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 11, 2026

⚠️ Smoke Gemini failed. Gemini encountered unexpected challenges...

@github-actions
Copy link
Copy Markdown
Contributor

Agent Container Tool Check

Tool Status Version
bash 5.2.21
sh available
git 2.53.0
jq 1.7
yq 4.52.5
curl 8.5.0
gh 2.89.0
node 20.20.2
python3 3.12.3
go 1.24.13
java 10.0.201
dotnet 10.0.201

Result: 12/12 tools available ✅

Overall Status: PASS

🔧 Tool validation by Agent Container Smoke Test · ● 156.5K ·

@github-actions
Copy link
Copy Markdown
Contributor

Smoke Test Results — §24285347590

Test Status
GitHub MCP
GH CLI (mcpscripts)
Serena MCP
Playwright
Web Fetch
File Writing
Bash Tool
Discussion Interaction
Build gh-aw
Artifact Upload
Discussion Creation
Workflow Dispatch
PR Review

Overall: ✅ PASS

PR author: @Copilot — Assignees: @pelikhan, @Copilot

📰 BREAKING: Report filed by Smoke Copilot · ● 792.3K ·

Copy link
Copy Markdown
Contributor

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Smoke test review of PR #25822 (feat: add --no-ask-user flag). The version-gating logic is well-structured and follows existing patterns. Two inline suggestions: (1) use the description field in test table as sub-test names, and (2) update changeset wording to reflect both agent and detection jobs.

📰 BREAKING: Report filed by Smoke Copilot · ● 792.3K

"gh-aw": patch
---

Enable `--no-ask-user` for Copilot agent jobs when the configured Copilot CLI version supports it (>= `1.0.19`), allowing fully autonomous runs while preserving conservative behavior for unsupported or non-semver versions.
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The changeset mentions "Copilot agent jobs" but this flag is also emitted for detection jobs. Suggest broadening to "Copilot runs" to match the actual behavior (as suggested by the existing review comment from copilot-pull-request-reviewer).


tests := []struct {
name string
engineConfig *EngineConfig
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The test table structure is clean and comprehensive. One suggestion: the description field in the struct is only used implicitly (it's not passed to t.Run or logged on failure). Consider using it as a sub-test name via t.Run(tt.description, ...) so failures are easier to diagnose in test output.

@github-actions
Copy link
Copy Markdown
Contributor

Smoke Test: Codex (run 24285347576)
PRs: #25820 "feat: use PR number for ADR file naming to avoid collisions"; #25817 "Add allow-workflows field for GitHub App workflows:write permission on safe-outputs"
GitHub MCP: ✅
Serena MCP: ✅
Playwright: ✅
Web-fetch MCP: ❌ (tool unavailable)
File write: ✅
Bash cat verify: ✅
Build (make build): ✅
Overall: FAIL

🔮 The oracle has spoken through Smoke Codex ·

@github-actions
Copy link
Copy Markdown
Contributor

📰 VERDICT: Smoke Copilot has concluded. All systems operational. This is a developing story. 🎤

@pelikhan pelikhan merged commit 94f93e9 into main Apr 11, 2026
151 of 153 checks passed
@pelikhan pelikhan deleted the copilot/apply-flag-to-agent-and-detection-jobs branch April 11, 2026 15:24
@github-actions
Copy link
Copy Markdown
Contributor

🤖 Smoke Test Results — Run §24285347567

Overall: ⚠️ PARTIAL (1 tool unavailable, 2 skipped)

# Test Status
1 GitHub MCP (last 2 merged PRs)
2 mcpscripts-gh (query 2 PRs)
3 Serena MCP (activate + 3 symbols)
4 Make Build
5 Playwright (github.com)
6 Tavily Web Search ❌ Tool not configured
7 File Writing
8 Bash Tool
9 Discussion Interaction
10 Agentic Workflows MCP Status
11 Slack Safe Output
12 Code Scanning Alert
13 Update PR Body
14 PR Review Comments (×2)
15 Submit PR Review
16 Resolve Review Thread ⚠️ Skipped
17 Add Reviewer
18 Push to PR Branch
19 Close PR ⚠️ Skipped

💥 [THE END] — Illustrated by Smoke Claude · ● 202K ·

Copy link
Copy Markdown
Contributor

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💥 Automated smoke test review - all systems nominal! This PR correctly adds --no-ask-user to both agent and detection jobs with a clean version gate at >= 1.0.19. The implementation follows existing patterns (awfSupportsExcludeEnv, awfSupportsCliProxy). Run 24285347567.

💥 [THE END] — Illustrated by Smoke Claude · ● 202K

"gh-aw": patch
---

Enable `--no-ask-user` for Copilot agent jobs when the configured Copilot CLI version supports it (>= `1.0.19`), allowing fully autonomous runs while preserving conservative behavior for unsupported or non-semver versions.
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🤖 Smoke Test Review — The changeset description currently says "Copilot agent jobs" but the implementation also applies --no-ask-user to detection jobs. Consider broadening the wording to "Copilot runs" for accuracy. (Run 24285347567)

@@ -0,0 +1,5 @@
---
"gh-aw": patch
---
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🤖 Smoke Test Review — The patch-level version bump is appropriate since this is a backward-compatible enhancement with a version gate that preserves the existing behavior for older CLI versions. (Run 24285347567)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants