Dogfooding `plan` + `implement` against a throwaway config surfaced one root
defect with many arms: the command templates treat consecutive fenced blocks as
one shell. They are not. Every ```bash fence runs as its own Bash call in its own
process, so a variable set in one block is empty in the next, and `$$` is a
different PID (measured: 21710 vs 22109).
The planner agent confirmed the sharpest arm at runtime, reporting that
`Mode: $RAW_FLAG` "arrived literally unsubstituted" — `--raw` was documented in
three command files while being functionally dead. A machine sweep found the same
root in 20 places across 9 files, well past the two the written fasit predicted:
- `$RAW_FLAG` read from non-shell agent prompts (analyze, plan, implement)
- `$TMPFILE` read across blocks (tokens, manifest, whats-active,
plugin-health) — each command could not read the file it had just written
- `$GLOBAL_FLAG` across blocks (fix)
- `$TODAY` never assigned in any block (campaign), passing
`--reference-date ""` to a write CLI in six places
- three `$$` temp paths handed to the Read tool (fix), which expands neither
All now follow the hardened drift.md pattern: a fixed literal path, or a
re-derivation inside each block that needs it.
Also fixed, all confirmed against ground truth rather than inferred:
- `implement` printed a rollback ID it never captured (the timestamp lived only
inside a command substitution) — the one message a user reads after a bad run
- `plan` reported "No analysis results found" for valid sessions, because Read
was pointed at a glob it cannot expand; now uses Glob and verifies the
analysis report exists before spawning the agent
- five phase commands wrote state.yaml with two of four required fields; since
the agent writes all four, a follow-up write silently deleted the rest
- `implement` promised rollback deletes created files; rollback deliberately
leaves them (M-BUG-26 still open) — the doc, not the engine, was wrong
- `implement` claimed a score delta with no pre-change measurement
- `verifier-agent` was told to write a report it has no tool to write
- dead `Task` tool name in always-loaded rule context; planner-agent template
demonstrated the inline file content its own line 110 forbids
The sweeps land as tests/commands/command-shell-state-shape.test.mjs, verified
red before the fix and proven able to fail by reintroducing the defect. Two
existing tests asserted the old bash-block mechanism rather than the intent and
were updated. Suite 1449/0; frozen v5.0.0 snapshots and all scanner code
untouched.
Not fixed, deliberately: neither command scope-gates its actions to the audit
target. The generated plan included an edit to a real file under ~/.claude,
outside the throwaway target, because the skill/agent scanners are machine-wide.
That is a design change, not a side fix.
Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_0195udHgCcFegzm7ecKku2Yc
7.1 KiB
| name | description | argument-hint | allowed-tools | model |
|---|---|---|---|---|
| config-audit:whats-active | Show which plugins, skills, MCP servers, hooks, and CLAUDE.md files are active for a repo — with token estimates | [path] [--json] [--verbose] [--suggest-disables] | Read, Glob, Bash | sonnet |
Config-Audit: What's Active
Show a complete, read-only inventory of everything Claude Code loads for a given repo — plugins, skills, MCP servers, hooks, CLAUDE.md cascade — with source attribution and rough token estimates. Helps identify candidates for disabling without guessing.
UX Rules (MANDATORY — from .claude/rules/ux-rules.md)
- Never show raw JSON or stderr output. Always use
--output-file+2>/dev/null. - Narrate before acting. Tell the user what you're about to do.
- Read, don't dump. Read the JSON file and render formatted tables.
- End with context-sensitive next steps.
Implementation
Step 1: Parse $ARGUMENTS
Split $ARGUMENTS into a path and flags. Path is the first non-flag argument. Default to . (current working directory). Recognized flags:
--json— emit raw JSON instead of rendered tables (power-user mode)--raw— pass-through to the scanner; accepted for CLI surface consistency.whats-activeis an inventory-only output (no findings prose), so--rawis a no-op here, but the flag is still threaded through for uniform behaviour across the toolchain.--verbose— include per-file byte/line detail--suggest-disables— append deterministic disable-candidates + LLM-judgment pass
Step 2: Run the CLI silently
Tell the user: "Reading active configuration for <path>..."
RAW_FLAG=""
if echo "$ARGUMENTS" | grep -q -- "--raw"; then RAW_FLAG="--raw"; fi
# Set each to the flag itself when the user asked for it, otherwise leave empty.
# A placeholder in square brackets does not start with a dash, so the scanner's
# arg loop would take it as the TARGET PATH instead of a flag.
VERBOSE_FLAG="" # --verbose
SUGGEST_FLAG="" # --suggest-disables
node ${CLAUDE_PLUGIN_ROOT}/scanners/whats-active.mjs <path> --output-file /tmp/config-audit-whats-active.json $VERBOSE_FLAG $SUGGEST_FLAG $RAW_FLAG 2>/dev/null; echo $?
Exit code handling:
0→ continue3→ tell user: "Couldn't read configuration. Check that the path exists and is a directory." Stop.
Step 3: If --json was requested, cat the file and stop
cat /tmp/config-audit-whats-active.json
Do NOT render tables in JSON mode.
Step 4: Read JSON and render
Use the Read tool on /tmp/config-audit-whats-active.json. Extract:
meta.repoPath,meta.durationMs,meta.gitRoot,meta.projectKeytotals.estimatedTokens.grandTotal(and subtotals)claudeMd.files[]— render cascade tableplugins[]— render plugin tableskills[]— render skills tablemcpServers[]— render MCP table (disabled shown italic)hooks[]— render hooks table
Render as markdown:
**Active configuration for `<repoPath>`** — ~{grandTotal} tokens loaded at startup
{if gitRoot != repoPath: "Git root: `<gitRoot>`"}
{if projectKey: "`.claude.json` project slice: `<projectKey>`"}
### CLAUDE.md cascade ({claudeMd.files.length} files, ~{claudeMd.estimatedTokens} tokens)
| Scope | Path | Bytes | Lines |
|-------|------|-------|-------|
| {scope} | `<path>` | {bytes} | {lines} |
| ... | ... | ... | ... |
### Plugins ({plugins.length}, ~{plugins subtotal} tokens)
| Plugin | Version | Commands | Agents | Skills | Hooks | Rules | Tokens |
|--------|---------|----------|--------|--------|-------|-------|--------|
| {name} | {version} | {commands} | {agents} | {skills} | {hooks} | {rules} | ~{estimatedTokens} |
### Skills ({skills.length}, ~{skills subtotal} tokens)
| Skill | Source | Tokens |
|-------|--------|--------|
| {name} | {source}{if pluginName: ` (${pluginName})`} | ~{estimatedTokens} |
### MCP Servers ({mcpServers.length}, ~{mcpServers subtotal} tokens)
| Server | Source | Status | Command |
|--------|--------|--------|---------|
| {name} | {source} | {enabled ? "enabled" : "*disabled*"} | `{command}` |
### Hooks ({hooks.length}, ~{hooks subtotal} tokens)
| Event | Matcher | Source |
|-------|---------|--------|
| {event} | {matcher or "-"} | {source} |
### Settings cascade
| Scope | Path | Keys |
|-------|------|------|
| user | `<path>` | {keyCount} |
| project | `<path>` | {keyCount} |
| local | `<path>` | {keyCount or "(missing)"} |
### Totals
| Category | Items | Estimated tokens |
|----------|-------|------------------|
| CLAUDE.md | {claudeMdFiles} | ~{claudeMd} |
| Plugins | {plugins} | ~{plugins} |
| Skills | {skills} | ~{skills} |
| MCP servers | {mcpServers} | ~{mcpServers} |
| Hooks | {hooks} | ~{hooks} |
| **Grand total** | — | **~{grandTotal}** |
_Estimates assume ~4 chars/token (Claude ballpark). Real token count varies ±15%._
Step 5: If --verbose, add per-file detail
For each CLAUDE.md file, skill, and plugin, include a nested "Details" list with bytes, lines, and full path.
Step 6: If --suggest-disables, show candidates
First show deterministic signals from suggestDisables.candidates[]:
### Disable candidates (deterministic)
| Kind | Name | Reason | Confidence |
|------|------|--------|------------|
| {kind} | {name} | {reason} | {confidence} |
Then run LLM judgment — check git log --oneline -20 and project manifests (package.json/Cargo.toml/etc.) to propose up to 3 additional candidates. For each candidate, you MUST:
- Name the specific redundancy
- Name the signal the user should check to confirm
Do NOT suggest items you can't name concrete redundancy for. If you can't find 3 strong candidates, return fewer or zero.
Step 7: Cleanup and next steps
rm -f /tmp/config-audit-whats-active.json
### What's next
- **`/config-audit posture`** — check configuration health (A-F grades per area)
- **`/config-audit feature-gap`** — context-aware recommendations for features you aren't using
- **Disable a plugin:** edit `~/.claude/settings.json` → `enabledPlugins` (remove the entry)
- **Disable an MCP server:** edit `~/.claude.json` → `projects.<path>.disabledMcpjsonServers`
- **Re-run with flags:** `/config-audit whats-active --verbose` (details) or `--suggest-disables` (pruning help)
Scope and limits
- Read-only. This command never writes to configuration files — no mkdir, no edits, no deletes.
- Single repo. Scans one repo path per invocation. Cross-repo rollups are out of scope.
- Ballpark token counts. Estimates are deterministic but not calibrated against Claude's tokenizer. Use them to compare categories, not to predict exact billing.
- No runtime queries. We inspect config files only — we do not connect to MCP servers or invoke hooks.
Error handling
| Condition | Action |
|---|---|
| Exit code 3 | Tell user path is invalid, suggest checking path exists |
| JSON parse fails (shouldn't happen — CLI writes valid JSON) | Tell user to re-run, mention this as a bug to report |
| No plugins, no CLAUDE.md, no hooks found | Still render with zeroes; suggest /config-audit feature-gap for setup help |