voyage/evals
Kjell Tore Guttormsen a384ce6cab
fix(proevesett): case 4 reads the sequencing gate's own code from the trace
New grader names-code (regex, trace, code\W{1,12}BRIEF_V51_MISSING_SIGNALS),
the same form as the intent case's names-code. It checks what the case's
expected_outcome promised before any run: the validator reports the code.

Checked on this session's recorded traces before the commit: it matches
10 of 10 green runs and 0 of 3 runs with the check disabled.
Known-positive re-run in the scratch copy (validator check 'if (false)'):
0 of 3 cases pass, names-code fails in each, the other 5 graders pass.

Green: tests/lib/proevesett.test.mjs 10 of 10.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-23 10:50:48 +02:00
..
plan-halts-without-intent-approval test(proevesett): a case for the intent gate; case 5's error comes from code; graders see what they claim 2026-09-23 09:28:38 +02:00
plan-halts-without-phase-signals fix(proevesett): case 4 reads the sequencing gate's own code from the trace 2026-09-23 10:50:48 +02:00
plan-project-not-initialized test(evals): Voyage's fixed test set as a plugin eval suite, expectations written before the first run 2026-09-23 07:52:34 +02:00
plan-rejects-unknown-export test(proevesett): a case for the intent gate; case 5's error comes from code; graders see what they claim 2026-09-23 09:28:38 +02:00
plan-requires-brief test(proevesett): a case for the intent gate; case 5's error comes from code; graders see what they claim 2026-09-23 09:28:38 +02:00
review-requires-project test(proevesett): a case for the intent gate; case 5's error comes from code; graders see what they claim 2026-09-23 09:28:38 +02:00
review-validate-flags-bad-finding-id fix(proevesett): case 4's fixture is intent-approved, so only the sequencing gate can stop it 2026-09-23 10:49:05 +02:00
review-validate-passes-clean-review fix(proevesett): case 4's fixture is intent-approved, so only the sequencing gate can stop it 2026-09-23 10:49:05 +02:00