Kjell Tore Guttormsen
a0ee9e863c
The scaffold writes a current intent_approved_hash (sha256 over ## Intent +
## Goal) into the case-4 brief. Chose a literal marker over running
intent-approval.mjs --stamp in the scaffold because --stamp emits a
brief-approved record into the live stats the yardstick reads: every eval
run would count as an approval.
New grader no-intent-halt (regex, trace, not_contains
code\W{1,12}BRIEF_INTENT_): a halt at the intent gate fails the case
instead of passing it for the wrong gate.
says-fail / says-pass take FAILED / PASSED as the verdict word. v2's word
boundary dropped them. The one says-fail failure (PM, 1 of 7) is not
explained: its trace was deleted, and 0 of 13 kept replies used another
spelling than FAIL.
Case 4 alone, 10 runs: 10 of 10. In 3 of 10 the child ran the intent gate
first, passed it and went on to the brief-validator. That order halted the
case before. Before the fix, same day: 5 of 6.
Green: tests/lib/proevesett.test.mjs 9 of 9.
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
41 lines
1.2 KiB
Bash
Executable file
41 lines
1.2 KiB
Bash
Executable file
#!/bin/bash
|
|
# Seeds the empty run workspace with a project folder whose brief declares
|
|
# brief_version 2.1 but carries neither phase_signals nor phase_signals_partial.
|
|
# The intent IS approved (a current intent_approved_hash over ## Intent + ## Goal),
|
|
# so the intent gate passes and only the sequencing gate can stop the run.
|
|
# The marker is written literally, not by `intent-approval.mjs --stamp`: --stamp
|
|
# emits a brief-approved record into the live stats the yardstick reads.
|
|
# Self-contained on purpose: the run cannot read the eval directory.
|
|
set -eu
|
|
mkdir -p proj
|
|
cat > proj/brief.md <<'BRIEF'
|
|
---
|
|
type: trekbrief
|
|
brief_version: "2.1"
|
|
created: 2026-09-23
|
|
task: "Eval fixture: add a greeting helper"
|
|
slug: eval-greeting
|
|
project_dir: proj/
|
|
research_topics: 0
|
|
research_status: skipped
|
|
auto_research: false
|
|
interview_turns: 1
|
|
source: fixture
|
|
intent_approved_hash: "sha256:d435093683f06b5832b1a546c5ea54b9b30aebf556bfbf6b05e91a2a85149542"
|
|
intent_approved_at: "2026-09-23T00:00:00.000Z"
|
|
---
|
|
|
|
# Task: add a greeting helper
|
|
|
|
## Intent
|
|
|
|
Eval fixture for the Voyage proevesett. Not a real task.
|
|
|
|
## Goal
|
|
|
|
A function `greet(name)` returns `Hello, <name>!`.
|
|
|
|
## Success Criteria
|
|
|
|
- `greet("Ada")` returns `Hello, Ada!`.
|
|
BRIEF
|