docs: general wording for the remaining example-base totals

Replace the combined concept total, the distinct-token total and the
per-level document count of earlier example bases with general wording
in prose, comments and docstrings. No constant, assertion or test data
changes.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
This commit is contained in:
Kjell Tore Guttormsen 2026-09-23 17:51:10 +02:00
commit c66f4ae2b0
Signed by: ktg
SSH key fingerprint: SHA256:JakMjO6FTBBzN0Bhfj9saOoEjaFxlSdYuZQQpM/lF9Q
9 changed files with 16 additions and 16 deletions

View file

@ -884,7 +884,7 @@ when the seam is detached, so the loop cannot silently degrade into theater.
A code now grounds only if it is at least 3 characters long **and** appears in fewer than 5 % of A code now grounds only if it is at least 3 characters long **and** appears in fewer than 5 % of
the documents the input is made of, with an absolute floor of 10 documents so the share is never the documents the input is made of, with an absolute floor of 10 documents so the share is never
taken over a handful. Both numbers are measured, not chosen: across the four delivered corpora no taken over a handful. Both numbers are measured, not chosen: across the four delivered corpora no
code-shaped token of 1 692 distinct ones reaches 5 % (highest 1.35 %), and the shortest real code-shaped token of well over a thousand distinct ones reaches 5 % (highest 1.35 %), and the shortest real
identifier is 4 characters. The refusal names the denominator — "appears in N of the N identifier is 4 characters. The refusal names the denominator — "appears in N of the N
documents this run was given" — because that reason is fed verbatim into the next attempt's documents this run was given" — because that reason is fed verbatim into the next attempt's
prompt. A caller that declares no document boundaries is unchanged by construction: one document prompt. A caller that declares no document boundaries is unchanged by construction: one document

View file

@ -2319,7 +2319,7 @@
GJENNOM `_grounding_text` — samme funksjon gaten bruker. **Et mønster er tillatt HER og ikke i GJENNOM `_grounding_text` — samme funksjon gaten bruker. **Et mønster er tillatt HER og ikke i
gaten**, og det er skillet mellom rapport og gate: en ukjent form er et token som ikke telles, gaten**, og det er skillet mellom rapport og gate: en ukjent form er et token som ikke telles,
altså under-telling, aldri falsk avvisning. Formene er TRANSKRIBERT fra målingen (K2: 50 altså under-telling, aldri falsk avvisning. Formene er TRANSKRIBERT fra målingen (K2: 50
distinkte kodeformede, 0 kravnumre; kravkorpuset: 269–981 distinkte kravnumre, ≤3 kodeformede); distinkte kodeformede, 0 kravnumre; kravkorpuset: noen hundre til rundt tusen distinkte kravnumre, ≤3 kodeformede);
**rene tall er BEVISST utelatt med tallet** (46 394 / 2 117 i K2 — å telle dem gjør hver rapport **rene tall er BEVISST utelatt med tallet** (46 394 / 2 117 i K2 — å telle dem gjør hver rapport
positiv og målingen inert). `grounding_offer_notice` er ENESTE renderer og tier når kjøringen KAN positiv og målingen inert). `grounding_offer_notice` er ENESTE renderer og tier når kjøringen KAN
forankre — omisjon, aldri tom rad. Load-bearing MÅLT forankre — omisjon, aldri tom rad. Load-bearing MÅLT
@ -2363,7 +2363,7 @@
brutt `uv run pytest` i overleveringspakka), mens (a) mandatet laster og (d) ruting-mot-egen-base brutt `uv run pytest` i overleveringspakka), mens (a) mandatet laster og (d) ruting-mot-egen-base
er UBETINGEDE og aldri kan være fraværende. **FUNN, målt og IKKE fikset (egen ordre):** er UBETINGEDE og aldri kan være fraværende. **FUNN, målt og IKKE fikset (egen ordre):**
`okf.parse_frontmatter` er linjeorientert last-write-wins, så `sources:`-blokkens innrykkede `okf.parse_frontmatter` er linjeorientert last-write-wins, så `sources:`-blokkens innrykkede
`title` overskriver konseptets egen — `directory_listing` på ett kravnivå i en av kravbasene returnerte **269 `title` overskriver konseptets egen — `directory_listing` på ett kravnivå i en av kravbasene returnerte **noen hundre
dokumenter, alle med basens eget navn som `"title"`**, og navigasjonsstigens rung 2/3 skiller dem kun med dokumenter, alle med basens eget navn som `"title"`**, og navigasjonsstigens rung 2/3 skiller dem kun med
et UUID-filnavn og et tegnantall. En fasit-assert mot den tittelen ville vært VAKUØS, så gaten et UUID-filnavn og et tegnantall. En fasit-assert mot den tittelen ville vært VAKUØS, så gaten
leser toppnivå-nøkler (`own_frontmatter`, første forekomst vinner) og bærer en TRIPWIRE som leser toppnivå-nøkler (`own_frontmatter`, første forekomst vinner) og bærer en TRIPWIRE som
@ -2525,7 +2525,7 @@
hver `must_cite`-referanse og hver mandat-`affected_code` i de fire kontekstsettene er den hver `must_cite`-referanse og hver mandat-`affected_code` i de fire kontekstsettene er den
KORTESTE ekte identifikatoren FIRE tegn (`12.1`/`52.1`), så `_GROUNDING_MIN_LENGTH = 3` ligger ETT KORTESTE ekte identifikatoren FIRE tegn (`12.1`/`52.1`), så `_GROUNDING_MIN_LENGTH = 3` ligger ETT
under målingen og kan ikke nekte noe som er målt; og over dokumentfrekvensen til hvert under målingen og kan ikke nekte noe som er målt; og over dokumentfrekvensen til hvert
kodeformet token i hver base (`_IDENTIFIER_FORMS`) når **ingen av 1 692 distinkte** 5 % — kodeformet token i hver base (`_IDENTIFIER_FORMS`) når **ingen av godt over tusen distinkte** 5 % —
høyeste noe sted er **1,35 %** (6 dokumenter), høyeste en fasit faktisk navngir **0,67 %** (3 dokumenter), høyeste noe sted er **1,35 %** (6 dokumenter), høyeste en fasit faktisk navngir **0,67 %** (3 dokumenter),
mens basenavnet står i **alle dokumentene (100 %)**. `_GROUNDING_MAX_DOCUMENT_SHARE = 0.05` ligger altså mens basenavnet står i **alle dokumentene (100 %)**. `_GROUNDING_MAX_DOCUMENT_SHARE = 0.05` ligger altså
3,7× over det høyeste ekte tokenet og 20× under defekten. **Lengden er IKKE dét som gjør defekten 3,7× over det høyeste ekte tokenet og 20× under defekten. **Lengden er IKKE dét som gjør defekten

View file

@ -115,7 +115,7 @@ def _frontmatter_from_text(text: str) -> dict[str, str]:
key (``sources:\\n - title: …`` names the SOURCE, not the concept) and must never overwrite key (``sources:\\n - title: …`` names the SOURCE, not the concept) and must never overwrite
the concept's own field, however late it appears in the scan. Measured 2026-09-13 on the concept's own field, however late it appears in the scan. Measured 2026-09-13 on
the corpus build's concepts: without this, every ``sources:``-bearing file's nested ``title`` the corpus build's concepts: without this, every ``sources:``-bearing file's nested ``title``
replaced its own, collapsing 4605 concepts to 4 distinct titles. A nested line with no replaced its own, collapsing every concept to its base's one title. A nested line with no
top-level counterpart is still preserved (OKF SPEC §4, "unknown fields are preserved").""" top-level counterpart is still preserved (OKF SPEC §4, "unknown fields are preserved")."""
fm: dict[str, str] = {} fm: dict[str, str] = {}
top_level: set[str] = set() top_level: set[str] = set()
@ -804,7 +804,7 @@ def read_provenance(
# acts on. # acts on.
items = sum(1 for ln in continuation if ln.strip().startswith("- ")) items = sum(1 for ln in continuation if ln.strip().startswith("- "))
# P13b: the block sequence of mappings is SPEC §5.1's own example and the form all four # P13b: the block sequence of mappings is SPEC §5.1's own example and the form all four
# delivered bases actually write (4605/4605, measured). It is decoded by the second carrier # delivered bases actually write (every concept, measured). It is decoded by the second carrier
# of the one grammar; a block MAPPING (no item opened) and anything the grammar refuses # of the one grammar; a block MAPPING (no item opened) and anything the grammar refuses
# still come back unreadable, which is what keeps "we could not read it" from quietly # still come back unreadable, which is what keeps "we could not read it" from quietly
# becoming "there was nothing to read". # becoming "there was nothing to read".

View file

@ -295,7 +295,7 @@ _GROUNDING_MIN_LENGTH: Final = 3
#: The share of the grounding's DOCUMENTS above which a token identifies nothing. #: The share of the grounding's DOCUMENTS above which a token identifies nothing.
#: #:
#: MEASURED over the four delivered corpora, counting document frequency for every code-shaped #: MEASURED over the four delivered corpora, counting document frequency for every code-shaped
#: token (``generate._IDENTIFIER_FORMS``): 1 692 distinct tokens, and NOT ONE reaches 5 % of its #: token (``generate._IDENTIFIER_FORMS``): well over a thousand distinct tokens, and NOT ONE reaches 5 % of its
#: base's documents. The highest anywhere is 1.35 % (6 documents); the highest that a fasit or mandate #: base's documents. The highest anywhere is 1.35 % (6 documents); the highest that a fasit or mandate
#: actually names is 0.67 % (3 documents). P16's fabricated ``P900`` is in every one — 100 %. #: actually names is 0.67 % (3 documents). P16's fabricated ``P900`` is in every one — 100 %.
#: 5 % therefore sits 3.7x above the highest real token measured and 20x below the defect. #: 5 % therefore sits 3.7x above the highest real token measured and 20x below the defect.

View file

@ -1,9 +1,9 @@
"""P13b: a BLOCK sequence of mappings is provenance po can read, not provenance po cannot. """P13b: a BLOCK sequence of mappings is provenance po can read, not provenance po cannot.
RED-FIRST, measured 2026-09-12 with the full denominator: every concept file in all four RED-FIRST, measured 2026-09-12 with the full denominator: every concept file in all four
knowledge bases delivered at the time wrote ``sources`` as a BLOCK sequence — **4605 of 4605, and 0 knowledge bases delivered at the time wrote ``sources`` as a BLOCK sequence — **every one of them, and 0
in flow form**. ``read_provenance`` answered ``UnreadableProvenance(reason="block-sequence")`` for in flow form**. ``read_provenance`` answered ``UnreadableProvenance(reason="block-sequence")`` for
every one of them, so ``evidence_for`` reported ``state="unreadable"`` on 4605 of 4605 documents: every one of them, so ``evidence_for`` reported ``state="unreadable"`` on every document:
the falsification layer had no address for any document in any base po was about to be the falsification layer had no address for any document in any base po was about to be
stress-tested against. The package's two example bases write the same form (``sources`` read as stress-tested against. The package's two example bases write the same form (``sources`` read as
entries in 306 of 306 and 301 of 301 concept files, re-measured below rather than quoted). entries in 306 of 306 and 301 of 301 concept files, re-measured below rather than quoted).
@ -175,7 +175,7 @@ def test_an_item_with_no_pair_separator_is_refused(tmp_path: Path) -> None:
**This is the ONE arm that witnesses the colon-SPACE rule** (measured by mutation M5): a reader **This is the ONE arm that witnesses the colon-SPACE rule** (measured by mutation M5): a reader
splitting on the FIRST colon reads this item as ``{'https': '//a.example/d'}``, inventing a key splitting on the FIRST colon reads this item as ``{'https': '//a.example/d'}``, inventing a key
out of a URL scheme instead of refusing. Every delivered ``resource`` is a URL, so that reader out of a URL scheme instead of refusing. Every delivered ``resource`` is a URL, so that reader
would mint 4605 such keys rather than fail once.""" would mint one such key per concept rather than fail once."""
path = _write(tmp_path, "type: concept\nsources:\n - https://a.example/d\n") path = _write(tmp_path, "type: concept\nsources:\n - https://a.example/d\n")
result = okf.read_provenance(path, "sources") result = okf.read_provenance(path, "sources")
assert isinstance(result, okf.UnreadableProvenance) assert isinstance(result, okf.UnreadableProvenance)

View file

@ -133,7 +133,7 @@ def test_the_three_non_present_states_are_unchanged_for_any_key(tmp_path: Path)
absent = okf.evidence_for(_concept(tmp_path), key="adjudication") absent = okf.evidence_for(_concept(tmp_path), key="adjudication")
assert (absent.state, absent.tier, absent.items_seen) == ("absent", None, 0) assert (absent.state, absent.tier, absent.items_seen) == ("absent", None, 0)
# P13b made the block sequence of mappings READABLE (measured: 4605 of 4605 concepts in the # P13b made the block sequence of mappings READABLE (measured: every concept in the
# four delivered bases write exactly that form). The specimen therefore moved to one that is # four delivered bases write exactly that form). The specimen therefore moved to one that is
# still unreadable for a reason of its own — an item the flow decoder refuses — so this arm # still unreadable for a reason of its own — an item the flow decoder refuses — so this arm
# keeps asserting what it always asserted: an unreadable value is never tiered. # keeps asserting what it always asserted: an unreadable value is never tiered.

View file

@ -89,7 +89,7 @@ _ENERGI_BUNDLE = Path(__file__).resolve().parents[1] / "shared" / "examples" / "
def _unreadable_document(tmp_path: Path, entries: int = 1) -> Path: def _unreadable_document(tmp_path: Path, entries: int = 1) -> Path:
"""A document whose ``verified`` is a block sequence the decoder REFUSES, with a chosen count. """A document whose ``verified`` is a block sequence the decoder REFUSES, with a chosen count.
P13b widened the reader to the block sequence of mappings (measured: 4605 of 4605 concepts in P13b widened the reader to the block sequence of mappings (measured: every concept in
the four delivered bases write it, and po reported every one of them unreadable). The arms below the four delivered bases write it, and po reported every one of them unreadable). The arms below
need a specimen that is still unreadable for a reason of its own, or they would be asserting need a specimen that is still unreadable for a reason of its own, or they would be asserting
against a state the reader no longer produces. This one refuses on SPEC §5.2 — an entry naming against a state the reader no longer produces. This one refuses on SPEC §5.2 — an entry naming
@ -167,7 +167,7 @@ def test_the_committed_block_form_fixture_is_now_READ(tmp_path: Path) -> None:
"""The direction P13b reversed, pinned where the old arm stood so the change cannot be silent. """The direction P13b reversed, pinned where the old arm stood so the change cannot be silent.
``attested.md`` was the repo's specimen for "the reader cannot read this". It is the SPEC §5.1 ``attested.md`` was the repo's specimen for "the reader cannot read this". It is the SPEC §5.1
block form, which all four delivered knowledge bases write on 4605 of 4605 concepts, and it now block form, which all four delivered knowledge bases write on every concept, and it now
yields its single verification entry with the actor intact.""" yields its single verification entry with the actor intact."""
evidence = okf.evidence_for(_GOLDEN_DIR / "bundle" / "attested.md") evidence = okf.evidence_for(_GOLDEN_DIR / "bundle" / "attested.md")
assert evidence.state == "present" assert evidence.state == "present"

View file

@ -18,7 +18,7 @@ measurement (one of three is 33 % and says nothing).
shortest real identifier is FOUR characters (``12.1``, ``52.1``), so ``N = 3`` sits one below the shortest real identifier is FOUR characters (``12.1``, ``52.1``), so ``N = 3`` sits one below the
measurement and cannot refuse anything measured; measurement and cannot refuse anything measured;
* document frequency of every code-shaped token (``generate._IDENTIFIER_FORMS``) in each base: * document frequency of every code-shaped token (``generate._IDENTIFIER_FORMS``) in each base:
1 692 distinct tokens and NOT ONE reaches 5 % of its base's documents. Highest anywhere 1.35 % well over a thousand distinct tokens and NOT ONE reaches 5 % of its base's documents. Highest anywhere 1.35 %
(6 documents); highest that a fasit names 0.67 % (3 documents); the base's own name is in every (6 documents); highest that a fasit names 0.67 % (3 documents); the base's own name is in every
document (100 %). ``A = document (100 %). ``A =
0.05`` therefore sits 3.7x above the highest real token and 20x below the defect. 0.05`` therefore sits 3.7x above the highest real token and 20x below the defect.

View file

@ -320,8 +320,8 @@ def test_parse_frontmatter_top_level_title_survives_nested_sources_title(tmp_pat
``title:`` names the SOURCE document, not the concept (measured on a real concept of a ``title:`` names the SOURCE document, not the concept (measured on a real concept of a
delivered requirements corpus). Top-level keys carry no indentation and must win — a nested delivered requirements corpus). Top-level keys carry no indentation and must win — a nested
line must never overwrite a top-level key of the same name, however late it appears in the line must never overwrite a top-level key of the same name, however late it appears in the
scan. Without this, ``directory_listing`` on that corpus's level returned 269 documents that scan. Without this, ``directory_listing`` on that corpus's level returned a few hundred documents
all shared the one nested title, the source standard's own name — rung 2/3 of the navigation that all shared the one nested title, the source standard's own name — rung 2/3 of the navigation
ladder collapse to an opaque UUID filename and a character count (P14 finding; the ledger is ladder collapse to an opaque UUID filename and a character count (P14 finding; the ledger is
``docs/invarianter.md``). ``docs/invarianter.md``).