Skip to content

test(audit): close harness fidelity gap (test-path + agnostic coverage)#6914

Merged
chubes4 merged 1 commit into
mainfrom
feat/audit-harness-fidelity
Jun 28, 2026
Merged

test(audit): close harness fidelity gap (test-path + agnostic coverage)#6914
chubes4 merged 1 commit into
mainfrom
feat/audit-harness-fidelity

Conversation

@chubes4

@chubes4 chubes4 commented Jun 28, 2026

Copy link
Copy Markdown
Member

The runtime audit harness (#6903) passed while #6906s real-codebase regression (test files wrongly scanned + CoreBoundaryLeak explosion) slipped through, because the fixture had no tests/ subdir (walker test-path skip never exercised) and no forbidden-ecosystem-term content (agnostic detector never triggered). Adds: a tests/-subdir fixture file containing a forbidden term that MUST be skipped (snapshot asserts its absence; a #6906-style regression makes it appear and fails the harness), a behavioral forbidden-term file that fires, and an explicit test-path-invariant test. Fixtures + test only; no detector/config change. This is the prerequisite for safely landing #6855 Phase 1.

@homeboy-ci

homeboy-ci Bot commented Jun 28, 2026

Copy link
Copy Markdown
Contributor

Homeboy Results — homeboy

Lint

lint — passed

ℹ️ Full options: homeboy docs commands/lint
ℹ️ Save lint baseline: homeboy lint homeboy --baseline
Deep dive: homeboy lint homeboy --changed-since 2ef1265

Artifacts and drill-down
  • CI results artifact: homeboy-ci-results-homeboy-lint-homeboy-Linux contains immediate command JSON for this action invocation.
  • Observation artifact: homeboy-observations-homeboy-lint-homeboy-Linux contains exported Homeboy run history for deeper queries.
  • Drill-down: download the observation artifact, then run homeboy runs import <dir>, homeboy runs list, and homeboy runs findings <run-id>.
  • Artifacts are attached to the workflow run: https://github.com/Extra-Chill/homeboy/actions/runs/28328877022

Test

⚠️ test — baseline red

ℹ️ No tests ran — the runner failed before producing results. See raw_output.stderr_tail / raw_output.stdout_tail for the underlying error (bootstrap failure, missing deps, DB connection, etc.).
ℹ️ To run specific tests: homeboy test homeboy -- --filter=TestName
ℹ️ Auto-fix lint issues: homeboy refactor homeboy --from lint --write
ℹ️ Collect coverage: homeboy test homeboy --coverage
ℹ️ Analyze failures: homeboy test homeboy --analyze
ℹ️ Pass args to test runner: homeboy test -- [args]
ℹ️ Full options: homeboy docs commands/test
Deep dive: homeboy test homeboy --changed-since 2ef1265

Artifacts and drill-down
  • CI results artifact: homeboy-ci-results-homeboy-test-homeboy-Linux contains immediate command JSON for this action invocation.
  • Observation artifact: homeboy-observations-homeboy-test-homeboy-Linux contains exported Homeboy run history for deeper queries.
  • Drill-down: download the observation artifact, then run homeboy runs import <dir>, homeboy runs list, and homeboy runs findings <run-id>.
  • Artifacts are attached to the workflow run: https://github.com/Extra-Chill/homeboy/actions/runs/28328877022

Audit

audit — passed

  • core_boundary_leak:core-agnostic-source — 70 finding(s)
  • structural — 57 finding(s)
  • intra-method-duplication — 47 finding(s)
  • field_patterns — 35 finding(s)
  • dead_code — 19 finding(s)
  • near-duplication — 17 finding(s)
  • test_quality — 13 finding(s)
  • duplication — 10 finding(s)
  • remote_execution_preflight — 9 finding(s)
  • thin_command_adapter — 8 finding(s)
  • Total: 310 finding(s)

Deep dive: homeboy audit homeboy --changed-since 2ef1265

Artifacts and drill-down
  • CI results artifact: homeboy-ci-results-homeboy-audit-homeboy-Linux contains immediate command JSON for this action invocation.
  • Observation artifact: homeboy-observations-homeboy-audit-homeboy-Linux contains exported Homeboy run history for deeper queries.
  • Drill-down: download the observation artifact, then run homeboy runs import <dir>, homeboy runs list, and homeboy runs findings <run-id>.
  • Artifacts are attached to the workflow run: https://github.com/Extra-Chill/homeboy/actions/runs/28328877022
Tooling versions
  • Homeboy CLI: homeboy 0.268.0+656b8ad09816+fabc65b98
  • Extension: rust from https://github.com/Extra-Chill/homeboy-extensions
  • Extension revision: dfe9fa31
  • Action: unknown@unknown

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant