P10's model-free part (wave 4, order A1, decision 63). The routing test now
checks every case in evals/ for from=, not only the skill-tagged ones (R1):
a case with no skill tag is not routed, only checked, and the report gives
both counts ("45 cases checked for from=, 37 routed"). The eight test-set
cases get from=proevesett-eval-suite (d311f3b) or
from=proevesett-intent-gate (3892a83), the commits that added them.
The release gate that reads the last test-set run is written into the
runbook as exempted with its reason (it waits for the fixed test set to run
again) and still says where it goes (scripts/release-check.mjs).
review-630's prototype-tag stub gets from=test: under R1 an unrouted case is
still checked for from=, and the stub tests that a prototype name is never
routed, which stands.
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
11 lines
372 B
Markdown
11 lines
372 B
Markdown
---
|
|
description: "/trekplan --export with a removed format names the format and stops."
|
|
expected_outcome: "'Error: export format 'pr' is not supported.'; no Agent call, no file written."
|
|
tags: [proevesett, from=proevesett-eval-suite]
|
|
runs: 1
|
|
max_turns: 8
|
|
timeout_seconds: 300
|
|
allowed_tools: [Bash, Read, Glob, Grep, Write, Agent]
|
|
---
|
|
|
|
/voyage:trekplan --export pr plan.md
|