feat(p19): the trace says HOW, and a run says what it spent and why it stopped
DEL C. P18 gave read_dir a window (filter/offset/limit) and then measured its
own paid round without being able to see it used: five of 31 documents read
lay outside the default window, so the window HAD been widened and the trace
could not say with which knob. ToolCall now carries the three arguments,
always present and empty/zero when not passed -- an absent key and "not
narrowed" must not read the same -- and the judge counts filter_calls and
paged_calls. _number_argument is a SIBLING of _string_argument, not a widening
of it: a model may send limit as 10 or as "10", and a reader that knew one
shape would report a paged call as unpaged.
DEL D. P18's finding 4 was WRONG AS WRITTEN. provenance.token_usage has been
stamped on every proposal artefact since S3.4 and stands in every one of round
2's; what was missing is a READER. The judge reads it now (round 2 measured:
289 054 tokens against round 1's 2 679 305, -89 %), and the P18 report gets a
dated correction UNDER its original paragraph rather than instead of it.
What was genuinely absent is {run_id}-coverage.json. settle prints the
coverage report and ApproachOutcome has carried not_evaluated since Trekk A3,
but neither ever reached a file, so a judge could see an approach had no
artefact and could not tell a budget stop from an approach nobody ordered.
Written from the finally IFF a mandate was given. stop_reason comes from a
CALLER-OWNED sink rather than from in_flight, and that is a measurement:
_evaluate_mandate SWALLOWS BudgetExceeded once something has been produced, so
run_project's own in_flight never sees it.
Load-bearing measured (10 arms), four mutations all red against the whole
suite, green control 1744/5 and the golden byte-unchanged. D-i stood GREEN
first -- the vacuous-gate class, 25th time: the arm called write_coverage
itself and therefore chose the reason it then asserted.
Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
This commit is contained in:
parent
d74f32dc1c
commit
4c6084e5df
12 changed files with 684 additions and 11 deletions
|
|
@ -304,9 +304,10 @@ async def test_a_refused_read_is_recorded_and_leaks_nothing(tmp_path) -> None:
|
|||
"nobody can audit"
|
||||
)
|
||||
payload = json.loads((outbox_dir / "verdict-gate-debate.json").read_text(encoding="utf-8"))
|
||||
assert {"name": "read_file", "bundle_id": bundle_id, "path": _VERDICT_FILE} in payload[
|
||||
"tool_calls"
|
||||
], f"the artefact does not carry the refused call: {payload['tool_calls']}"
|
||||
identity = [{k: c[k] for k in ("name", "bundle_id", "path")} for c in payload["tool_calls"]]
|
||||
assert {"name": "read_file", "bundle_id": bundle_id, "path": _VERDICT_FILE} in identity, (
|
||||
f"the artefact does not carry the refused call: {payload['tool_calls']}"
|
||||
)
|
||||
|
||||
|
||||
# ------------------------------------------------------ (5) the document, not the walk, decides
|
||||
|
|
|
|||
Loading…
Add table
Add a link
Reference in a new issue