open/voyage
1
0
Fork 0
Code Issues Releases 5 Activity

fix(proevesett): case 4 reads the sequencing gate's own code from the trace

Browse source 
New grader names-code (regex, trace, code\W{1,12}BRIEF_V51_MISSING_SIGNALS),
the same form as the intent case's names-code. It checks what the case's
expected_outcome promised before any run: the validator reports the code.

Checked on this session's recorded traces before the commit: it matches
10 of 10 green runs and 0 of 3 runs with the check disabled.
Known-positive re-run in the scratch copy (validator check 'if (false)'):
0 of 3 cases pass, names-code fails in each, the other 5 graders pass.

Green: tests/lib/proevesett.test.mjs 10 of 10.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
This commit is contained in:
Kjell Tore Guttormsen 2026-09-23 10:50:48 +02:00
commit a384ce6cab
Signed by: ktg
SSH key fingerprint: SHA256:JakMjO6FTBBzN0Bhfj9saOoEjaFxlSdYuZQQpM/lF9Q
1 changed files with 5 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

5
evals/plan-halts-without-phase-signals/graders/names-code.md Normal file
View file

@ -0,0 +1,5 @@
---
type: regex
pattern: 'code\W{1,12}BRIEF_V51_MISSING_SIGNALS'
target: trace
---