docs(rules): the fixed test set stays as the one operator-run exception
Operator decision 2026-10-02: keep the test set that a person runs through Anthropic's plugin eval tool. Voyage starts nothing; the gate counts that entry exactly, and the binding rule and the gate header now say so instead of claiming historical mentions only. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
This commit is contained in:
parent
dbc07b4006
commit
82fc507886
2 changed files with 13 additions and 7 deletions
|
|
@ -15,10 +15,13 @@
|
|||
// starts no session and is not a hit.
|
||||
//
|
||||
// Classes: (a) starts Claude Code, (b) tells a user or a session to start it,
|
||||
// (c) historical mention (changelog, measurement records, recorded fixtures).
|
||||
// (a) and (b) must be zero. A (c) file stands only in EXEMPT, with its reason
|
||||
// and its EXACT hit count: a new hit in an exempt file fails, and so does an
|
||||
// entry that no longer hits.
|
||||
// (c) historical mention (changelog, measurement records, recorded fixtures),
|
||||
// (operator-instrument) a documented tool a PERSON runs, kept by operator
|
||||
// decision 2026-10-02: the fixed test set run through Anthropic's plugin eval
|
||||
// tool; Voyage starts nothing.
|
||||
// (a) and (b) must be zero. A (c) or operator-instrument file stands only in
|
||||
// EXEMPT, with its reason and its EXACT hit count: a new hit in an exempt file
|
||||
// fails, and so does an entry that no longer hits.
|
||||
//
|
||||
// When this test fails, remove the launch (work that needs another session
|
||||
// becomes an order plus a starter the user runs in a session they open); do
|
||||
|
|
@ -60,7 +63,7 @@ const EXEMPT = new Map([
|
|||
['tests/fixtures/synthesis/digest.json', ['c', 1, 'recorded synthesis fixture']],
|
||||
['tests/fixtures/synthesis/exploration/architecture-mapper.md', ['c', 3, 'recorded exploration fixture']],
|
||||
['tests/fixtures/synthesis/exploration/dependency-tracer.md', ['c', 2, 'recorded exploration fixture']],
|
||||
['docs/proevesett.md', ['operator-instrument', 3, "the operator's own eval run through Anthropic's `claude plugin eval`; Voyage starts nothing - open for the operator (see the order report)"]],
|
||||
['docs/proevesett.md', ['operator-instrument', 3, "the operator's own eval run through Anthropic's `claude plugin eval`; Voyage starts nothing - kept by operator decision 2026-10-02"]],
|
||||
['.gitignore', ['operator-instrument', 1, 'ignores the output of that same operator-run eval']],
|
||||
]);
|
||||
|
||||
|
|
|
|||
Loading…
Add table
Add a link
Reference in a new issue