docs: general wording for the example-base document counts
Replace the exact document counts of earlier example bases (and the per-base counts in the sources-format note) with general wording or N-of-N in prose, comments and docstrings. Percentages and numerators stay; no constant, assertion or test data changes. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
This commit is contained in:
parent
0b7c853f3d
commit
6b1046bc23
16 changed files with 56 additions and 56 deletions
|
|
@ -47,7 +47,7 @@ What each arm pins, and what it refuses:
|
|||
none is byte-identical to before. That second half is what keeps ``demo-transcript.stdout``
|
||||
unchanged, and it is asserted here rather than left to the golden;
|
||||
(h) A4 — the judge counts a hit against THIS APPROACH'S fasit concepts, never against the base. A
|
||||
judge matching the whole base would mark every declaration a hit on a 2 756-document corpus,
|
||||
judge matching the whole base would mark every declaration a hit on a corpus of a few thousand documents,
|
||||
which is the P16 vacuity ``citation_scope`` already exists to refuse;
|
||||
(i) the declaration reaches ``{run_id}-debate.json``, so a paid run's evidence survives the process
|
||||
that produced it.
|
||||
|
|
@ -260,7 +260,7 @@ def test_the_binding_requirement_reaches_the_proposer_verbatim() -> None:
|
|||
|
||||
|
||||
def test_a_hit_is_counted_against_this_approachs_fasit_never_the_base() -> None:
|
||||
"""(h) The P16 vacuity, one column over: on a 2 756-document base everything is 'in the base'."""
|
||||
"""(h) The P16 vacuity, one column over: on a base of a few thousand documents everything is 'in the base'."""
|
||||
wanted = {"krav/12-1/a.md", "krav/12-12/b.md"}
|
||||
approach = Approach(
|
||||
id="a1",
|
||||
|
|
@ -392,7 +392,7 @@ def test_a_declaration_in_the_base_but_not_in_the_fasit_is_not_a_hit(tmp_path: P
|
|||
own ``wanted`` set — left the WHOLE suite green (1710/5), because the arm above drives
|
||||
``_attributable`` while the hit is computed at the call site in ``score_context_set``. The
|
||||
declaration here names a document the base really does hold; what it is not is the one the
|
||||
fasit asks for, which is the only distinction a 2 756-document corpus leaves standing.
|
||||
fasit asks for, which is the only distinction a corpus of a few thousand documents leaves standing.
|
||||
"""
|
||||
base = _minibase(tmp_path)
|
||||
ctx = _context_dir(tmp_path)
|
||||
|
|
|
|||
Loading…
Add table
Add a link
Reference in a new issue