feat(consume): the payload says what of the question it reached, and row 4 reads it
`coverage` carries three lists: the terms the pre-pass read the question as, the terms no concept in the bundle answers, and the terms no delivered excerpt answers. Without it a reader holding eight excerpts cannot tell a bundle that ANSWERED its question from one that merely ranked something -- the two payloads have the same shape. FACTS, AND NO VERDICT, which is a measurement and not caution. Two readings were built and both falsified over 81 questions (16 synthetic, 65 across the three real sets, 2026-09-20): the share of question terms a delivered excerpt answers separates the synthetic controls at 0.33 against 0.50 and REVERSES on real data (covered questions down to 0.27, one genuinely uncovered question at 0.71); the share of a bundle tying the best lexical match is ~0.00 for every real question either way. Question style dominates the first, corpus size the second. The one bar this repository declares is the gate's: `UNANSWERED_BAR = 2/3` over `unanswered_in_bundle`, swept and collapsing at both ends -- at 0.50 eleven real covered questions are marked, at 0.70 the row falls to 5 of 6, at 2/3 the row is 6 of 6 and 0 of 65 real questions are marked. The margin is thin (0.6087 against 0.6667) and is published that way, together with what it does not catch: r761-sk2's own known-negative sits at 0.2857. Row 4: 3 of 6 RED -> 6 of 6 GREEN, with the 10 answered synthetic questions held unmarked as the known-negative. The contract's SS 8 gains point 7, the consumption skill is told to read the block, and the SS 7.4 known-positive moves with the document (14 721/375 -> 16 389/417). Suite 2292 passed. Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
This commit is contained in:
parent
90394c383d
commit
05cb19087a
8 changed files with 216 additions and 42 deletions
|
|
@ -160,6 +160,11 @@ are permitted; the checker reads only the members this section names.
|
|||
"known_positive": { "case": "<name>", "expected": 10406, "measured": 10406 }
|
||||
},
|
||||
"denominators": { "considered": 439, "withheld": 401, "delivered": 38 },
|
||||
"coverage": {
|
||||
"question_terms": ["<the terms the pre-pass read the question as>"],
|
||||
"unanswered_in_bundle": ["<those no concept in the bundle answers>"],
|
||||
"unanswered_in_payload": ["<those no delivered excerpt answers>"]
|
||||
},
|
||||
"excerpts": [
|
||||
{
|
||||
"bundle_id": "<id>",
|
||||
|
|
@ -224,6 +229,27 @@ are permitted; the checker reads only the members this section names.
|
|||
the enclosing concept's text inside `parent` — `text`, with that concept's
|
||||
own `sha256`, and `truncated` where it was cut to fit — and then only from
|
||||
the room its cut left, so that inherited text never displaces an excerpt.
|
||||
7. A pre-pass SHOULD carry `coverage`: the terms it read the question as, the
|
||||
ones no concept in the bundle answers, and the ones no delivered excerpt
|
||||
answers. Without it a reader holding eight excerpts cannot tell a bundle
|
||||
that answered its question from one that merely ranked something — the two
|
||||
payloads have the same shape — and § 6's states are then unreachable from
|
||||
the payload alone.
|
||||
|
||||
**Facts, and no verdict.** The member carries lists and never a score, a
|
||||
confidence or a "weak" flag, because the two obvious verdicts were built
|
||||
and falsified against 81 questions on 2026-09-20: the share of a question's
|
||||
terms a delivered excerpt answers separates a synthetic corpus at 0.33
|
||||
against 0.50 and then reverses on real data, where covered questions run
|
||||
down to 0.27 while one genuinely uncovered question sits at 0.71; and the
|
||||
share of a bundle tying the best lexical match is ~0.00 for every question
|
||||
in a large bundle, covered or not. Question style dominates the first and
|
||||
corpus size the second, so a pre-pass emitting a verdict would assert
|
||||
across corpora what was measured on one. Where a bar belongs is in the
|
||||
consumer's own judgement or in a gate that publishes its sweep.
|
||||
|
||||
The checker does not read this member, for the same reason: it holds a
|
||||
payload's FORM, and these lists carry no claim a form can be held to.
|
||||
|
||||
## 9. Prohibitions
|
||||
|
||||
|
|
|
|||
Loading…
Add table
Add a link
Reference in a new issue