Repository navigation
[detection-analysis] Detection Analysis Report — 2026-11-09 (partial coverage) #76336
Closed
Replies: 1 comment
|
This discussion has been marked as outdated by Detection Analysis Report. A newer discussion is available at Discussion #76630. |
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Summary
gh-aw-detection: false): 0 (0%)Warning
Log collection for this run only reached 2026-11-09T11:55Z → 2026-11-09T23:13Z (~11.3 hours), not the full requested 24-hour window (~2026-11-08T23:14Z → 2026-11-09T23:xxZ). A
logsMCP continuation call to backfill the missing ~12.7 hours was attempted but hit the per-call count limit after collecting only ~2 additional hours (2026-11-09T12:27Z–14:38Z), with further continuation cursors remaining unresolved. This report covers the analyzed subset only — it does not represent the full 24-hour window.This gap very likely explains why 0 regular runs were observed today: historical trend data (see below) shows regular runs (
gh-aw-detection: false) occurring every prior day in this window (1–55/day), typically fromsmoke-*andengine-conformance-*workflows that trigger onpull_requestevents — none of which happened to fall inside the ~11.3h slice that was actually captured. Do not read "0 regular runs" or "0 misconfigured" as evidence those workflows are healthy or absent — they were simply outside the captured sample today.Comparison Chart
Note: the "Regular Runs" bar is empty because no
gh-aw-detection: falseruns fell inside the captured ~11.3h sample (see coverage caveat above), not because none exist.Misconfigured Workflows
No misconfigured workflows detected in this window (within the analyzed ~11.3h sample). Specifically:
gh-aw-detection: falsewith >3 runs/window): no runs with an explicitfalsevalue appeared in the captured sample at all.detectionjob conclusion.One non-detection issue worth flagging separately (out of scope for
gh-aw-detectionrules, since it's not a detection-job failure): the Auditor workflow failed in all 11 of its runs this window (example run §42712106891). In each case theagentjob itself wasskipped(0 tokens used), consistent with thecollect_failure_evidence/ "Collect health failures, cached logs and bounded audits" step failing before the agent could start (driver-exit failure, part of a cluster spanning 8 runs in the wider failure investigation). This looks like a trigger/permission or upstream-step issue, not a detection misconfiguration — recommend investigating thecollect_failure_evidencestep directly.View All Run Metrics
341 runs across 80 workflows were classified; top 25 by run count:
Aggregate: 341 detection-enabled, 0 regular; 83.0% detection success rate (58 failures); average 86,363 tokens/run (detection group).
View Historical Trend
41 historical daily data points (27 distinct days over the trailing window). Detection success rate has averaged ~85%, dipped to ~67% around Oct 30–Nov 1, and recovered to 83–90% over the past week. Detection run volume has risen from ~200/day in mid-October to 340–650/day recently. Regular-run counts and misconfigured-workflow counts have historically been non-zero most days (e.g. 2026-11-08: 1 regular run, 6 misconfigured; 2026-11-06: 5 regular runs, 1 misconfigured) — reinforcing that today's zero counts reflect the partial-coverage gap, not a real change.
Recommendations
smoke-*/engine-conformance-*regular runs and at least one misconfiguration exist in that gap.collect_failure_evidencestep — it failed in all 11 runs this window, preventing theagentjob from ever starting (§42712106891).gh-aw-detection-specific action needed based on the captured sample, but re-check once full-window coverage is available.References:
All reactions