Skip to content

[detection-stats] Detection stats for github/gh-aw - 2026-10-13 #1266

Done

Description

@github-actions

Caution

agentic threat detected
Threat detection flagged this output in warn mode. Manual review is REQUIRED before any follow-up automation.

Details

Potential security threats were detected in the agent output.

Review the workflow run logs for details.

1182 external-detector runs analysed; detection-job error rate 0%; 0 soft failures; threat rate 0.21% (1 of 470 verdicts).

Summary

gh-aw detection statistics - 2026-10-13 (UTC)

Repository: github/gh-aw
Window: 2026-10-13T00:00:00Z .. 2026-10-13T23:59:59Z
API requests: 3018, rate-limit pauses: 1
Data complete: yes

Totals

Metric Count
Workflow runs in window 4935
Agentic runs (*.lock.yml) 1954
Runs with a detection job 1266
... using the external detector 1182
... using the built-in detector 84
... detector could not be determined 0
Agentic runs without a detection job 688

All rates below are over the external detector population (1182 runs). Since gh-aw #54111 the external detector is the compile-time default; a run counts as external when its detection job showed the Install threat-detect binary step, when another run of the same workflow did that day, or when the workflow is .lock.yml and no run showed the built-in shape (a completed detection job with steps but no marker). Runs on a workflow that opted out with features: gh-aw-detection: false count as built-in.

Detection job outcomes

Outcome Count Rate
skipped 680 57.53%
success 502 42.47%

Error rate (failure/timed_out/action_required): 0%

Verdict availability

State Meaning Count
present detection artifact downloaded and parsed 470
skipped detection job was skipped or was still running (nothing to fetch) 680
unreadable artifact zip could not be unpacked 32

Green detection jobs that published no verdict: 0 (detection steps are continue-on-error, so a missing verdict artifact is the only reliable signal for these).

Detection results

Result Count
Runs with a parsed verdict 470
Clean (no threat) 469
Any threat 1
prompt_injection 1
secret_leak 0
malicious_patch 0

Threat rate (of runs with a verdict): 0.21%

Reasons reported by gh-aw

From the [aw] Detection Runs tracking issue (warning/failure conclusions only), restricted to runs in the external-detector population above.

Reason Count
agent_failure 7

By workflow

Workflow Runs Failed Cancelled Skipped No verdict Threats
Q 157 0 0 157 0 0
Deployment Incident Monitor 134 0 0 134 0 0
PR Sous Chef 69 0 0 10 0 1
Daily Trajectory Grader Implementer 46 0 0 27 0 0
Test Quality Sentinel 45 0 0 6 0 0
[aw] Failure Investigator (6h) 45 0 0 42 0 0
Design Decision Gate 🏗️ 44 0 0 5 0 0
Matt Pocock Skills Reviewer 44 0 0 5 0 0
PR Code Quality Reviewer 44 0 0 5 0 0
Ponytail Reviewer 44 0 0 5 0 0
Issue Monster 43 0 0 7 0 0
Avenger 24 0 0 13 0 0
Auto-Triage Issues 20 0 0 12 0 0
Squad — Closing this stale automation report or health tracker as requested during backlog maintenance: it was created at least 24 hours before 2026-10-13 14:46 UTC. This closure does not indicate that any reported defect was fixed. 20 0 0 20 0 0
Workflow Generator 15 0 0 15 0 0
Smoke Copilot Routed 14 0 0 1 0 0
Daily Go Test Parallelizer 12 0 0 1 0 0
Squad — Deprecated — closing as part of backlog cleanup. 11 0 0 11 0 0
Squad — @copilot resolve the merge conflicts on this branch. 8 0 0 8 0 0
Contribution Check 6 0 0 0 0 0
Code Scanning Fixer 4 0 0 0 0 0
PR Triage Agent 4 0 0 0 0 0
Squad — Closing this historical report as requested following the merge of github/gh-aw#68183. The merged change corrects the demonstrated workflow-local publication/tool contract without changing permissions, credentials, sandbox restrictions, or output limits. Hosted completion remains unverified; the separate reviewer AWF API-translation failure is not fixed by this PR. 4 0 0 4 0 0
Squad — The agent encountered an error and was unable to start working on this issue: This may be caused by a repository ruleset violation. See granting bypass permissions for the agent, or please contact support if the issue persists. (Request id: EBF1:39E394:2679C:35F24:6ACE4536) 4 0 0 4 0 0
ESLint Factory Dispatcher 3 0 0 0 0 0

307 further workflows omitted; see stats.json.

Notable runs

Workflow Run Job conclusion Verdict Threats Reported reason
PR Sous Chef 38405658452 success present prompt_injection -
Agent Job Health Monitor 38483235574 success unreadable - agent_failure
Claude Code User Documentation Review 38399771371 success unreadable - -
Copilot Agent PR Analysis 38447452684 success unreadable - agent_failure
Copilot Agent Prompt Clustering Analysis 38379423429 success unreadable - -
Copilot Session Insights 38360462624 success unreadable - -
Daily AW Cross-Repo Compile Check 38372677921 success unreadable - -
Daily AgentRx Trace Optimizer 38352442172 success unreadable - -
Daily AstroStyleLite Markdown Spellcheck 38342137830 success unreadable - -
Daily BYOK Ollama Test 38477676843 success unreadable - agent_failure
Daily Choice Type Test 38389757557 success unreadable - -
Daily Elixir Credo Snippet Audit 38363556299 success unreadable - -
Daily Grader Audit 38365917300 success unreadable - -
Daily Reliability Review 38480674694 success unreadable - agent_failure
Daily Rendering Scripts Verifier 38365750510 success unreadable - -
Daily Safe Outputs Conformance Checker 38353484453 success unreadable - -
Detection Analysis Report 38483211746 success unreadable - agent_failure
ESLint Factory Dispatcher 38342097201 success unreadable - -
ESLint Factory Dispatcher 38350625222 success unreadable - -
ESLint Factory Dispatcher 38353382621 success unreadable - -
Engine Conformance Dispatcher 38377350960 success unreadable - -
GitHub API Consumption Report Agent 38386214820 success unreadable - -
GitHub MCP Structural Analysis 38393883708 success unreadable - -
Go Fan 38366811649 success unreadable - -
Go Logger Enhancement 38342297066 success unreadable - -
Linter Miner 38439325710 success unreadable - agent_failure
Lockfile Statistics Analysis Agent 38462485361 success unreadable - agent_failure
Multi-Device Docs Tester 38352416652 success unreadable - -
Safe Output Health Monitor 38346864920 success unreadable - -
Sergo - Serena Go Expert 38344311609 success unreadable - -
Static Analysis Report 38348693024 success unreadable - -
Step Name Alignment 38344653812 success unreadable - -
Typist - Go Type Analysis 38390786472 success unreadable - -

Change since 2026-10-12

Metric 2026-10-12 2026-10-13 Delta 7-day mean
External detector runs 1404 1182 -222 932.14
Error rate (%) 0.07 0 -0.07 0.01
Soft failures 0 0 0 0
Runs with verdict 461 470 +9 335
Any threat 1 1 0 1.43
Threat rate (%) 0.22 0.21 -0.01 0.34

Watch list

None

Collected by: https://github.com/github/gh-aw-threat-detection/actions/runs/38508833908
Full data: the detection-stats-38508833908 artifact on that run.

Generated by Detection Stats Daily · copilot · auto · 19.4 AIC · ⌖ 0.784 AIC · ⊞ 11.2K · ◷

Activity

  1. davidslater commented on Oct 15, 2026

    @davidslater
    Collaborator

    Reviewed during issue triage. Closing this historical daily report as superseded by #1277, which covers the next UTC day and includes the comparison against this report. The unreadable-artifact concern remains visible in #1277 (43 unreadable verdicts, versus 32 here); closing this report does not establish that those runs had clean verdicts or that artifact collection is fixed.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions