fix(retrieval-gate): row 8 is the three sets, and its headline is one granularity
Two of PM's eight attacks, closed where they were measured. J2 -- a set left out. `REQUIRED_REAL_SETS` names the three (`wiki-20`, `r761-sk2`, `vegnormal-32`) and the row is NOT RUN until all three are given, whatever the ones that ran scored. The numbers the run DID measure are still printed: a missing set must not cost the reader the set that was measured, and "not run" is the row's status, never a reason to withhold a figure. J2b -- the headline was `quoted_hits + concept_hits` over `quoted_units + concept_units`, written one line above the detail that says the two are not summed. The three sets do not share a unit: `wiki-20` names a citation, `r761-sk2` a section title, `vegnormal-32` a requirement number, and a citation hit plus a concept hit is a number that is neither. A QUESTION is the one unit all three have, so the headline is questions answered of questions asked -- answered meaning at least one of the question's fasit entries arrived, the reading row 1 already prints beside its own units -- and the two unit totals keep their own denominators below it, unsummed. 49 passed (was 46 passed, 3 failed). The gate is unchanged where it did not run: still exit 1, still `0 of 3 NOT RUN` with PM's recorded figures carried. Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
This commit is contained in:
parent
3d496de2c6
commit
b4f03e44cb
2 changed files with 53 additions and 14 deletions
|
|
@ -760,11 +760,7 @@ def _hitting_set(set_id: str, *, quote: str) -> gate.QuestionSet:
|
|||
gate.Question(
|
||||
id=f"{set_id}-1",
|
||||
question="Naar kontrolleres vinterberedskapen paa hytta?",
|
||||
fasit=(
|
||||
gate.Fasit(
|
||||
by="concept", value="haandbok/vinterberedskap", quote=quote
|
||||
),
|
||||
),
|
||||
fasit=(gate.Fasit(by="concept", value="haandbok/vinterberedskap", quote=quote),),
|
||||
),
|
||||
),
|
||||
controls=(),
|
||||
|
|
|
|||
Loading…
Add table
Add a link
Reference in a new issue