ECC/tests/ci
Jamkris 7f971b7e6f fix(ci): treat 'permissions: write-all' as a write-permission gate
`WRITE_PERMISSION_PATTERN` in `validate-workflow-security.js`
enumerates named GitHub Actions scopes (`contents: write`,
`issues: write`, etc.) to decide whether a workflow needs to:
  - disable `persist-credentials` on `actions/checkout`
  - pass `--ignore-scripts` to `npm ci`

The pattern misses the top-level shorthand `permissions:
write-all`, which is the strictly broader form — it grants every
named scope write access in a single line. As a result, a
workflow that opts into write-all currently slips both gates.

Reproduced on `main` before this commit:

  $ cat /tmp/bad.yml
  name: bad
  on: [push]
  permissions: write-all
  jobs:
    do:
      runs-on: ubuntu-latest
      steps:
        - uses: actions/checkout@v4
        - run: npm ci

  $ ECC_WORKFLOWS_DIR=/tmp node scripts/ci/validate-workflow-security.js
  Validated workflow security for 1 workflow files
  $ echo $?
  0

Expected: at least two violations (missing `persist-credentials:
false`, missing `--ignore-scripts`).
Actual: passes silently.

Fix: add a sibling pattern `WRITE_ALL_PATTERN` that matches
`^\s*permissions:\s*write-all\b` and OR it with
`WRITE_PERMISSION_PATTERN` at the single gate. Both top-level
and job-level `permissions:` blocks satisfy the `^\s*` prefix.

After this commit the reproduction above exits 1 with:

  ERROR: bad.yml:8 - workflows with write permissions must disable checkout credential persistence
  ERROR: bad.yml:9 - workflows with write permissions must install npm dependencies with --ignore-scripts

Three new regression tests in `tests/ci/validate-workflow-security.test.js`:
  - rejects write-all + credential-persisting checkout
  - rejects write-all + `npm ci` without `--ignore-scripts`
  - allows write-all when both gates are satisfied (no over-block)

Test count: 14 → 17 in this file; full `yarn test` still green.

A separate `refs/pull/N/merge` bypass under `pull_request_target`
exists in the same validator and is fixed in the next commit.
2026-05-17 21:19:29 -04:00
..
agent-instruction-safety.test.js test: report instruction guardrails independently 2026-04-30 09:39:54 -04:00
agent-yaml-surface.test.js fix: remove canonical Anthropic skill duplicates 2026-04-30 00:21:13 -04:00
catalog.test.js feat: add command registry and coverage checks (#1906) 2026-05-14 22:02:36 -04:00
code-reviewer-false-positive-guard.test.js feat: salvage code-reviewer false-positive guardrails (#1817) 2026-05-12 15:01:46 -04:00
codex-skill-surface.test.js feat: add machine learning engineering workflow 2026-05-11 17:55:50 -04:00
command-registry.test.js feat: add command registry and coverage checks (#1906) 2026-05-14 22:02:36 -04:00
mle-workflow-coverage.test.js feat: add machine learning engineering workflow 2026-05-11 17:55:50 -04:00
no-personal-paths.test.js fix: harden CI validators 2026-05-11 03:08:43 -04:00
scan-supply-chain-iocs.test.js security: cover gh-token-monitor token persistence 2026-05-17 17:46:35 -04:00
supply-chain-advisory-sources.test.js Cover advisory source renderer branches 2026-05-15 23:09:54 -04:00
supply-chain-watch-workflow.test.js Add supply-chain advisory source refresh 2026-05-15 23:09:54 -04:00
validate-workflow-security.test.js fix(ci): treat 'permissions: write-all' as a write-permission gate 2026-05-17 21:19:29 -04:00
validators.test.js feat: add command registry and coverage checks (#1906) 2026-05-14 22:02:36 -04:00