voyage/evals
Kjell Tore Guttormsen e226c33916
merge: main (7a skills workshop, 9 rettepakke) into wave2-skills-research
Conflict: CLAUDE.md command table. Kept both sides: this branch's
/trekresearch row (the external agents preload researching-sources) and
main's /trekplan row (open minors listed for the operator).

researching-sources adapted to contract S1, now that 7a's form check and
routing test run over it:
- SKILL.md takes the fixed headings (Overview, When to use, Process, Red
  flags, Enforced by, Credits); the five rules and the confidence scale move
  under Process unchanged; Red flags lists the thoughts the baseline runs
  showed; "text only" becomes "prose only" as the form check reads it.
- The description adds "official" documentation and "looking up online what
  an error message means or what causes it": the error-lookup case ranked
  #3 behind debugging. That prompt also said "our tests fail", which is
  debugging's job; it now asks only what the error means and where that is
  documented. No threshold changed.
- Eval cases carry the routing tags (skill-trigger / skill-no-trigger /
  skill-effect, skill=, owner= task-finder and trekplan, from=), 7a's
  Skill grader pattern, arm: both on the no-trigger graders, and the
  judge-model line on the effect case.
- The `## Skills` row in README and CLAUDE.md.
- tests/lib/skills-research-prose-pins.test.mjs drops its two form pins
  (skill-lint is the authority now): 14 -> 12.

npm test on the merged tree: 2055 = 2053 pass / 0 fail / 2 skipped
(main 2043 + 12).

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-09 19:34:38 +02:00
..
plan-halts-without-intent-approval test(proevesett): a case for the intent gate; case 5's error comes from code; graders see what they claim 2026-09-23 09:28:38 +02:00
plan-halts-without-phase-signals fix(proevesett): case 4 reads the sequencing gate's own code from the trace 2026-09-23 10:50:48 +02:00
plan-project-not-initialized test(evals): Voyage's fixed test set as a plugin eval suite, expectations written before the first run 2026-09-23 07:52:34 +02:00
plan-rejects-unknown-export test(proevesett): a case for the intent gate; case 5's error comes from code; graders see what they claim 2026-09-23 09:28:38 +02:00
plan-requires-brief test(proevesett): a case for the intent gate; case 5's error comes from code; graders see what they claim 2026-09-23 09:28:38 +02:00
review-requires-project test(proevesett): a case for the intent gate; case 5's error comes from code; graders see what they claim 2026-09-23 09:28:38 +02:00
review-validate-flags-bad-finding-id fix(proevesett): a capitalised opposite verdict refuses the says-* graders 2026-09-23 11:34:29 +02:00
review-validate-passes-clean-review fix(proevesett): a capitalised opposite verdict refuses the says-* graders 2026-09-23 11:34:29 +02:00
skill-debugging-effect feat(skills): skill workshop, test-first and debugging preloaded into the step helper 2026-10-08 21:38:58 +02:00
skill-debugging-fires-1 feat(skills): skill workshop, test-first and debugging preloaded into the step helper 2026-10-08 21:38:58 +02:00
skill-debugging-fires-2 feat(skills): skill workshop, test-first and debugging preloaded into the step helper 2026-10-08 21:38:58 +02:00
skill-debugging-fires-3 feat(skills): skill workshop, test-first and debugging preloaded into the step helper 2026-10-08 21:38:58 +02:00
skill-debugging-quiet-1 feat(skills): skill workshop, test-first and debugging preloaded into the step helper 2026-10-08 21:38:58 +02:00
skill-debugging-quiet-2 feat(skills): skill workshop, test-first and debugging preloaded into the step helper 2026-10-08 21:38:58 +02:00
skill-researching-sources-effect-injected-page merge: main (7a skills workshop, 9 rettepakke) into wave2-skills-research 2026-10-09 19:34:38 +02:00
skill-researching-sources-hit-advisories merge: main (7a skills workshop, 9 rettepakke) into wave2-skills-research 2026-10-09 19:34:38 +02:00
skill-researching-sources-hit-error-lookup merge: main (7a skills workshop, 9 rettepakke) into wave2-skills-research 2026-10-09 19:34:38 +02:00
skill-researching-sources-hit-official-docs merge: main (7a skills workshop, 9 rettepakke) into wave2-skills-research 2026-10-09 19:34:38 +02:00
skill-researching-sources-miss-local-search merge: main (7a skills workshop, 9 rettepakke) into wave2-skills-research 2026-10-09 19:34:38 +02:00
skill-researching-sources-miss-plan merge: main (7a skills workshop, 9 rettepakke) into wave2-skills-research 2026-10-09 19:34:38 +02:00
skill-test-first-effect feat(skills): skill workshop, test-first and debugging preloaded into the step helper 2026-10-08 21:38:58 +02:00
skill-test-first-fires-1 feat(skills): skill workshop, test-first and debugging preloaded into the step helper 2026-10-08 21:38:58 +02:00
skill-test-first-fires-2 feat(skills): skill workshop, test-first and debugging preloaded into the step helper 2026-10-08 21:38:58 +02:00
skill-test-first-fires-3 feat(skills): skill workshop, test-first and debugging preloaded into the step helper 2026-10-08 21:38:58 +02:00
skill-test-first-quiet-1 feat(skills): skill workshop, test-first and debugging preloaded into the step helper 2026-10-08 21:38:58 +02:00
skill-test-first-quiet-2 feat(skills): skill workshop, test-first and debugging preloaded into the step helper 2026-10-08 21:38:58 +02:00