docs(rules): the fixed test set stays as the one operator-run exception

Operator decision 2026-10-02: keep the test set that a person runs
through Anthropic's plugin eval tool. Voyage starts nothing; the gate
counts that entry exactly, and the binding rule and the gate header now
say so instead of claiming historical mentions only.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
This commit is contained in:
Kjell Tore Guttormsen 2026-10-02 15:48:36 +02:00
commit 82fc507886
Signed by: ktg
SSH key fingerprint: SHA256:JakMjO6FTBBzN0Bhfj9saOoEjaFxlSdYuZQQpM/lF9Q
2 changed files with 13 additions and 7 deletions

View file

@ -16,8 +16,11 @@ Voyage — a contract-driven Claude Code pipeline: brief, research, plan, execut
> another session becomes an order plus a starter line the user gives a session
> they open themselves (`/trekexecute` Phase 2.6, `lib/util/session-orders.mjs`);
> parallel work inside one session uses subagents. Enforced by
> `tests/lib/no-claude-code-launch.test.mjs` (historical mentions only in its
> exemption list, each with a reason and an exact count).
> `tests/lib/no-claude-code-launch.test.mjs`; its exemption list holds historical
> mentions plus one operator instrument (operator decision, 2026-10-02:
> `docs/proevesett.md` tells a person how to run Anthropic's plugin eval tool on
> the fixed test set; Voyage itself starts nothing), each with a reason and an
> exact count.
## Commands

View file

@ -15,10 +15,13 @@
// starts no session and is not a hit.
//
// Classes: (a) starts Claude Code, (b) tells a user or a session to start it,
// (c) historical mention (changelog, measurement records, recorded fixtures).
// (a) and (b) must be zero. A (c) file stands only in EXEMPT, with its reason
// and its EXACT hit count: a new hit in an exempt file fails, and so does an
// entry that no longer hits.
// (c) historical mention (changelog, measurement records, recorded fixtures),
// (operator-instrument) a documented tool a PERSON runs, kept by operator
// decision 2026-10-02: the fixed test set run through Anthropic's plugin eval
// tool; Voyage starts nothing.
// (a) and (b) must be zero. A (c) or operator-instrument file stands only in
// EXEMPT, with its reason and its EXACT hit count: a new hit in an exempt file
// fails, and so does an entry that no longer hits.
//
// When this test fails, remove the launch (work that needs another session
// becomes an order plus a starter the user runs in a session they open); do
@ -60,7 +63,7 @@ const EXEMPT = new Map([
['tests/fixtures/synthesis/digest.json', ['c', 1, 'recorded synthesis fixture']],
['tests/fixtures/synthesis/exploration/architecture-mapper.md', ['c', 3, 'recorded exploration fixture']],
['tests/fixtures/synthesis/exploration/dependency-tracer.md', ['c', 2, 'recorded exploration fixture']],
['docs/proevesett.md', ['operator-instrument', 3, "the operator's own eval run through Anthropic's `claude plugin eval`; Voyage starts nothing - open for the operator (see the order report)"]],
['docs/proevesett.md', ['operator-instrument', 3, "the operator's own eval run through Anthropic's `claude plugin eval`; Voyage starts nothing - kept by operator decision 2026-10-02"]],
['.gitignore', ['operator-instrument', 1, 'ignores the output of that same operator-run eval']],
]);