docs(rules): the fixed test set stays as the one operator-run exception

Operator decision 2026-10-02: keep the test set that a person runs
through Anthropic's plugin eval tool. Voyage starts nothing; the gate
counts that entry exactly, and the binding rule and the gate header now
say so instead of claiming historical mentions only.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
This commit is contained in:
Kjell Tore Guttormsen 2026-10-02 15:48:36 +02:00
commit 82fc507886
Signed by: ktg
SSH key fingerprint: SHA256:JakMjO6FTBBzN0Bhfj9saOoEjaFxlSdYuZQQpM/lF9Q
2 changed files with 13 additions and 7 deletions

View file

@ -15,10 +15,13 @@
// starts no session and is not a hit.
//
// Classes: (a) starts Claude Code, (b) tells a user or a session to start it,
// (c) historical mention (changelog, measurement records, recorded fixtures).
// (a) and (b) must be zero. A (c) file stands only in EXEMPT, with its reason
// and its EXACT hit count: a new hit in an exempt file fails, and so does an
// entry that no longer hits.
// (c) historical mention (changelog, measurement records, recorded fixtures),
// (operator-instrument) a documented tool a PERSON runs, kept by operator
// decision 2026-10-02: the fixed test set run through Anthropic's plugin eval
// tool; Voyage starts nothing.
// (a) and (b) must be zero. A (c) or operator-instrument file stands only in
// EXEMPT, with its reason and its EXACT hit count: a new hit in an exempt file
// fails, and so does an entry that no longer hits.
//
// When this test fails, remove the launch (work that needs another session
// becomes an order plus a starter the user runs in a session they open); do
@ -60,7 +63,7 @@ const EXEMPT = new Map([
['tests/fixtures/synthesis/digest.json', ['c', 1, 'recorded synthesis fixture']],
['tests/fixtures/synthesis/exploration/architecture-mapper.md', ['c', 3, 'recorded exploration fixture']],
['tests/fixtures/synthesis/exploration/dependency-tracer.md', ['c', 2, 'recorded exploration fixture']],
['docs/proevesett.md', ['operator-instrument', 3, "the operator's own eval run through Anthropic's `claude plugin eval`; Voyage starts nothing - open for the operator (see the order report)"]],
['docs/proevesett.md', ['operator-instrument', 3, "the operator's own eval run through Anthropic's `claude plugin eval`; Voyage starts nothing - kept by operator decision 2026-10-02"]],
['.gitignore', ['operator-instrument', 1, 'ignores the output of that same operator-run eval']],
]);