DEL B chunk `interview` (+ discover/status/cleanup/help). Fasit written before the run predicted 8 defects and refuted 4 candidates; all 8 confirmed, all 4 refutations held, and three predictions turned out too narrow. - M-BUG-36: `drift --list` reached the command as 0 bytes. drift-cli accepted --output-file but list mode ignored it, and the listing goes to stderr, which the command discards per ux-rules rule 2. Fixing the caller alone would not have helped. - M-BUG-37: feature-gap's "Create backup" step ran fix-cli without --apply. Dry-run is the default, so no backup existed (backupId: null) while the command went on to edit config believing it could roll back. - M-BUG-38: fix-cli told users to recover with scanners/rollback-cli.mjs, which does not exist. Dead reference in the one message read after a bad fix. - M-BUG-21 fourth arm: five templates carried literal [--global]/[--full-machine] inside executable bash blocks. A bracketed placeholder does not start with a dash, so every scanner's arg loop takes it as the scan target. - interview and analyze never said which session they act on; interview could rewind a finished session; cleanup interpolated an unvalidated id into rm -rf (an empty id deletes every session); status advertised a `resume` command that does not exist and documented an `all` argument it never parsed. TDD: 9 red tests first, including a machine sweep for dead /config-audit references and for bracketed flags in bash blocks. Suite 1432 -> 1441/0. Frozen v5.0.0 snapshots untouched; --raw/--json contracts unchanged. Co-Authored-By: Claude Opus 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01UGvA1uUQn2hPBPMaCKK6x3
118 lines
4.8 KiB
Markdown
118 lines
4.8 KiB
Markdown
---
|
|
name: config-audit:drift
|
|
description: Compare current configuration against a saved baseline — shows new, resolved, and changed findings
|
|
argument-hint: "[path] [--baseline name] [--save]"
|
|
allowed-tools: Read, Write, Glob, Grep, Bash
|
|
model: sonnet
|
|
---
|
|
|
|
# Config-Audit: Drift Detection
|
|
|
|
Compare current configuration against a saved baseline to see what changed.
|
|
|
|
## Arguments
|
|
|
|
- `$ARGUMENTS` may contain:
|
|
- A target path (default: current working directory)
|
|
- `--save`: Save current state as baseline
|
|
- `--baseline <name>`: Compare against a specific named baseline (default: "default")
|
|
- `--raw`: Pass-through to the scanner; produces v5.0.0 verbatim diff output (bypasses the humanizer). Use when piping into v5.0.0-baseline diff tooling that depends on byte-stable output.
|
|
|
|
## Implementation
|
|
|
|
### Save a baseline
|
|
|
|
If `--save` is present:
|
|
|
|
Tell the user: **"Saving current configuration as baseline..."**
|
|
|
|
```bash
|
|
RAW_FLAG=""
|
|
if echo "$ARGUMENTS" | grep -q -- "--raw"; then RAW_FLAG="--raw"; fi
|
|
node ${CLAUDE_PLUGIN_ROOT}/scanners/drift-cli.mjs <path> --save --name <baseline-name> --json $RAW_FLAG 2>/dev/null
|
|
```
|
|
|
|
`--save` writes its human confirmation to **stderr**, which `2>/dev/null` discards — pass `--json` so the `{saved, name, path}` object lands on stdout. Read stdout for confirmation. Tell the user:
|
|
|
|
```markdown
|
|
### Baseline Saved
|
|
|
|
Captured current state as baseline "{name}".
|
|
Run `/config-audit drift` anytime to see what changed since this point.
|
|
```
|
|
|
|
### Compare against baseline
|
|
|
|
Without `--save`:
|
|
|
|
Tell the user: **"Comparing current configuration against baseline..."**
|
|
|
|
```bash
|
|
RAW_FLAG=""
|
|
if echo "$ARGUMENTS" | grep -q -- "--raw"; then RAW_FLAG="--raw"; fi
|
|
node ${CLAUDE_PLUGIN_ROOT}/scanners/drift-cli.mjs <path> --baseline <name> --output-file /tmp/config-audit-drift.json $RAW_FLAG 2>/dev/null; echo $?
|
|
```
|
|
|
|
Exit codes: `0` = stable/improving, `1` = degrading (both normal — present the result either way), `3` = a real error.
|
|
|
|
Then read `/tmp/config-audit-drift.json` with the **Read tool**. The default-mode report itself goes to stderr, so `--output-file` is the only way this command sees the diff at all.
|
|
|
|
**Check `_baselineAnchor` first.** If the baseline was saved from a different directory than the one being scanned, the diff is not a drift signal — every baseline finding shows as "resolved" and every current finding as "new", which renders as a falsely reassuring "improving" trend. When the anchor differs, say so plainly and offer to re-anchor with `/config-audit drift --save` instead of presenting the numbers as drift.
|
|
|
|
In default mode the diff sections are humanized — finding titles, descriptions, and recommendations have already been replaced with plain-language equivalents. New/resolved/changed finding lists carry `userImpactCategory`, `userActionLanguage`, and `relevanceContext` so you can group and prioritize without re-deriving severity prose. If `--raw` was passed, the v5.0.0 diff is verbatim — present it in a code block as-is.
|
|
|
|
If baseline not found, tell the user:
|
|
|
|
```
|
|
No baseline found. Save one first with:
|
|
/config-audit drift --save
|
|
```
|
|
|
|
Otherwise, parse and present the drift report. Use the Read tool on the captured stdout (or pipe it into a tmpfile first if you prefer):
|
|
|
|
```markdown
|
|
### Configuration Drift
|
|
|
|
**Trend:** {Improving|Degrading|Stable}
|
|
**Score:** {before} → {after} ({+/-delta} points)
|
|
|
|
{If new findings:}
|
|
#### New Issues ({count})
|
|
| ID | Action | Description |
|
|
|----|--------|-------------|
|
|
| {id} | {userActionLanguage — "Fix this now", "Fix soon", etc.} | {humanized title} |
|
|
|
|
{If resolved findings:}
|
|
#### Resolved ({count})
|
|
| ID | Description |
|
|
|----|-------------|
|
|
| {id} | {humanized title} |
|
|
|
|
{If area changes:}
|
|
#### Area Changes
|
|
| Area | Before | After | Change |
|
|
|------|--------|-------|--------|
|
|
| ... | ... | ... | ... |
|
|
```
|
|
|
|
When iterating new/resolved findings, prefer `userActionLanguage` over raw `severity` for the "Action" column — the humanizer already mapped severity to plain-language phrasing, and surfacing it consistently keeps the toolchain coherent. Mention `relevanceContext` when it isn't `affects-everyone` (the user wants to know if a fix touches shared config or just their machine).
|
|
|
|
### List baselines
|
|
|
|
If `$ARGUMENTS` contains `--list`:
|
|
|
|
```bash
|
|
node ${CLAUDE_PLUGIN_ROOT}/scanners/drift-cli.mjs --list --output-file /tmp/config-audit-baselines.json 2>/dev/null; echo $?
|
|
```
|
|
|
|
The human-readable listing goes to stderr, which `2>/dev/null` discards — read
|
|
`/tmp/config-audit-baselines.json` with the Read tool and render the `baselines`
|
|
array (`name`, `findingCount`, `savedAt`) as a table. If the array is empty, tell
|
|
the user no baselines are saved yet and point at `/config-audit drift --save`.
|
|
|
|
### What's next
|
|
|
|
After viewing drift:
|
|
- `/config-audit fix` — Auto-fix new findings
|
|
- `/config-audit posture` — Full posture assessment
|
|
- `/config-audit drift --save` — Update the baseline to current state
|