voyage/evals/plan-halts-without-phase-signals/graders
Kjell Tore Guttormsen a384ce6cab
fix(proevesett): case 4 reads the sequencing gate's own code from the trace
New grader names-code (regex, trace, code\W{1,12}BRIEF_V51_MISSING_SIGNALS),
the same form as the intent case's names-code. It checks what the case's
expected_outcome promised before any run: the validator reports the code.

Checked on this session's recorded traces before the commit: it matches
10 of 10 green runs and 0 of 3 runs with the check disabled.
Known-positive re-run in the scratch copy (validator check 'if (false)'):
0 of 3 cases pass, names-code fails in each, the other 5 graders pass.

Green: tests/lib/proevesett.test.mjs 10 of 10.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-23 10:50:48 +02:00
..
halt-names-signals.md test(evals): Voyage's fixed test set as a plugin eval suite, expectations written before the first run 2026-09-23 07:52:34 +02:00
names-code.md fix(proevesett): case 4 reads the sequencing gate's own code from the trace 2026-09-23 10:50:48 +02:00
no-agent.md test(evals): Voyage's fixed test set as a plugin eval suite, expectations written before the first run 2026-09-23 07:52:34 +02:00
no-intent-halt.md fix(proevesett): case 4's fixture is intent-approved, so only the sequencing gate can stop it 2026-09-23 10:49:05 +02:00
no-plan-file.md test(evals): Voyage's fixed test set as a plugin eval suite, expectations written before the first run 2026-09-23 07:52:34 +02:00
validator-ran.md test(evals): Voyage's fixed test set as a plugin eval suite, expectations written before the first run 2026-09-23 07:52:34 +02:00