docs: general wording for the remaining example-base totals

Replace the combined concept total, the distinct-token total and the
per-level document count of earlier example bases with general wording
in prose, comments and docstrings. No constant, assertion or test data
changes.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
This commit is contained in:
Kjell Tore Guttormsen 2026-09-23 17:51:10 +02:00
commit c66f4ae2b0
Signed by: ktg
SSH key fingerprint: SHA256:JakMjO6FTBBzN0Bhfj9saOoEjaFxlSdYuZQQpM/lF9Q
9 changed files with 16 additions and 16 deletions

View file

@ -884,7 +884,7 @@ when the seam is detached, so the loop cannot silently degrade into theater.
A code now grounds only if it is at least 3 characters long **and** appears in fewer than 5 % of
the documents the input is made of, with an absolute floor of 10 documents so the share is never
taken over a handful. Both numbers are measured, not chosen: across the four delivered corpora no
code-shaped token of 1 692 distinct ones reaches 5 % (highest 1.35 %), and the shortest real
code-shaped token of well over a thousand distinct ones reaches 5 % (highest 1.35 %), and the shortest real
identifier is 4 characters. The refusal names the denominator — "appears in N of the N
documents this run was given" — because that reason is fed verbatim into the next attempt's
prompt. A caller that declares no document boundaries is unchanged by construction: one document

View file

@ -2319,7 +2319,7 @@
GJENNOM `_grounding_text` — samme funksjon gaten bruker. **Et mønster er tillatt HER og ikke i
gaten**, og det er skillet mellom rapport og gate: en ukjent form er et token som ikke telles,
altså under-telling, aldri falsk avvisning. Formene er TRANSKRIBERT fra målingen (K2: 50
distinkte kodeformede, 0 kravnumre; kravkorpuset: 269–981 distinkte kravnumre, ≤3 kodeformede);
distinkte kodeformede, 0 kravnumre; kravkorpuset: noen hundre til rundt tusen distinkte kravnumre, ≤3 kodeformede);
**rene tall er BEVISST utelatt med tallet** (46 394 / 2 117 i K2 — å telle dem gjør hver rapport
positiv og målingen inert). `grounding_offer_notice` er ENESTE renderer og tier når kjøringen KAN
forankre — omisjon, aldri tom rad. Load-bearing MÅLT
@ -2363,7 +2363,7 @@
brutt `uv run pytest` i overleveringspakka), mens (a) mandatet laster og (d) ruting-mot-egen-base
er UBETINGEDE og aldri kan være fraværende. **FUNN, målt og IKKE fikset (egen ordre):**
`okf.parse_frontmatter` er linjeorientert last-write-wins, så `sources:`-blokkens innrykkede
`title` overskriver konseptets egen — `directory_listing` på ett kravnivå i en av kravbasene returnerte **269
`title` overskriver konseptets egen — `directory_listing` på ett kravnivå i en av kravbasene returnerte **noen hundre
dokumenter, alle med basens eget navn som `"title"`**, og navigasjonsstigens rung 2/3 skiller dem kun med
et UUID-filnavn og et tegnantall. En fasit-assert mot den tittelen ville vært VAKUØS, så gaten
leser toppnivå-nøkler (`own_frontmatter`, første forekomst vinner) og bærer en TRIPWIRE som
@ -2525,7 +2525,7 @@
hver `must_cite`-referanse og hver mandat-`affected_code` i de fire kontekstsettene er den
KORTESTE ekte identifikatoren FIRE tegn (`12.1`/`52.1`), så `_GROUNDING_MIN_LENGTH = 3` ligger ETT
under målingen og kan ikke nekte noe som er målt; og over dokumentfrekvensen til hvert
kodeformet token i hver base (`_IDENTIFIER_FORMS`) når **ingen av 1 692 distinkte** 5 % —
kodeformet token i hver base (`_IDENTIFIER_FORMS`) når **ingen av godt over tusen distinkte** 5 % —
høyeste noe sted er **1,35 %** (6 dokumenter), høyeste en fasit faktisk navngir **0,67 %** (3 dokumenter),
mens basenavnet står i **alle dokumentene (100 %)**. `_GROUNDING_MAX_DOCUMENT_SHARE = 0.05` ligger altså
3,7× over det høyeste ekte tokenet og 20× under defekten. **Lengden er IKKE dét som gjør defekten

View file

@ -115,7 +115,7 @@ def _frontmatter_from_text(text: str) -> dict[str, str]:
key (``sources:\\n - title: …`` names the SOURCE, not the concept) and must never overwrite
the concept's own field, however late it appears in the scan. Measured 2026-09-13 on
the corpus build's concepts: without this, every ``sources:``-bearing file's nested ``title``
replaced its own, collapsing 4605 concepts to 4 distinct titles. A nested line with no
replaced its own, collapsing every concept to its base's one title. A nested line with no
top-level counterpart is still preserved (OKF SPEC §4, "unknown fields are preserved")."""
fm: dict[str, str] = {}
top_level: set[str] = set()
@ -804,7 +804,7 @@ def read_provenance(
# acts on.
items = sum(1 for ln in continuation if ln.strip().startswith("- "))
# P13b: the block sequence of mappings is SPEC §5.1's own example and the form all four
# delivered bases actually write (4605/4605, measured). It is decoded by the second carrier
# delivered bases actually write (every concept, measured). It is decoded by the second carrier
# of the one grammar; a block MAPPING (no item opened) and anything the grammar refuses
# still come back unreadable, which is what keeps "we could not read it" from quietly
# becoming "there was nothing to read".

View file

@ -295,7 +295,7 @@ _GROUNDING_MIN_LENGTH: Final = 3
#: The share of the grounding's DOCUMENTS above which a token identifies nothing.
#:
#: MEASURED over the four delivered corpora, counting document frequency for every code-shaped
#: token (``generate._IDENTIFIER_FORMS``): 1 692 distinct tokens, and NOT ONE reaches 5 % of its
#: token (``generate._IDENTIFIER_FORMS``): well over a thousand distinct tokens, and NOT ONE reaches 5 % of its
#: base's documents. The highest anywhere is 1.35 % (6 documents); the highest that a fasit or mandate
#: actually names is 0.67 % (3 documents). P16's fabricated ``P900`` is in every one — 100 %.
#: 5 % therefore sits 3.7x above the highest real token measured and 20x below the defect.

View file

@ -1,9 +1,9 @@
"""P13b: a BLOCK sequence of mappings is provenance po can read, not provenance po cannot.
RED-FIRST, measured 2026-09-12 with the full denominator: every concept file in all four
knowledge bases delivered at the time wrote ``sources`` as a BLOCK sequence — **4605 of 4605, and 0
knowledge bases delivered at the time wrote ``sources`` as a BLOCK sequence — **every one of them, and 0
in flow form**. ``read_provenance`` answered ``UnreadableProvenance(reason="block-sequence")`` for
every one of them, so ``evidence_for`` reported ``state="unreadable"`` on 4605 of 4605 documents:
every one of them, so ``evidence_for`` reported ``state="unreadable"`` on every document:
the falsification layer had no address for any document in any base po was about to be
stress-tested against. The package's two example bases write the same form (``sources`` read as
entries in 306 of 306 and 301 of 301 concept files, re-measured below rather than quoted).
@ -175,7 +175,7 @@ def test_an_item_with_no_pair_separator_is_refused(tmp_path: Path) -> None:
**This is the ONE arm that witnesses the colon-SPACE rule** (measured by mutation M5): a reader
splitting on the FIRST colon reads this item as ``{'https': '//a.example/d'}``, inventing a key
out of a URL scheme instead of refusing. Every delivered ``resource`` is a URL, so that reader
would mint 4605 such keys rather than fail once."""
would mint one such key per concept rather than fail once."""
path = _write(tmp_path, "type: concept\nsources:\n - https://a.example/d\n")
result = okf.read_provenance(path, "sources")
assert isinstance(result, okf.UnreadableProvenance)

View file

@ -133,7 +133,7 @@ def test_the_three_non_present_states_are_unchanged_for_any_key(tmp_path: Path)
absent = okf.evidence_for(_concept(tmp_path), key="adjudication")
assert (absent.state, absent.tier, absent.items_seen) == ("absent", None, 0)
# P13b made the block sequence of mappings READABLE (measured: 4605 of 4605 concepts in the
# P13b made the block sequence of mappings READABLE (measured: every concept in the
# four delivered bases write exactly that form). The specimen therefore moved to one that is
# still unreadable for a reason of its own — an item the flow decoder refuses — so this arm
# keeps asserting what it always asserted: an unreadable value is never tiered.

View file

@ -89,7 +89,7 @@ _ENERGI_BUNDLE = Path(__file__).resolve().parents[1] / "shared" / "examples" / "
def _unreadable_document(tmp_path: Path, entries: int = 1) -> Path:
"""A document whose ``verified`` is a block sequence the decoder REFUSES, with a chosen count.
P13b widened the reader to the block sequence of mappings (measured: 4605 of 4605 concepts in
P13b widened the reader to the block sequence of mappings (measured: every concept in
the four delivered bases write it, and po reported every one of them unreadable). The arms below
need a specimen that is still unreadable for a reason of its own, or they would be asserting
against a state the reader no longer produces. This one refuses on SPEC §5.2 — an entry naming
@ -167,7 +167,7 @@ def test_the_committed_block_form_fixture_is_now_READ(tmp_path: Path) -> None:
"""The direction P13b reversed, pinned where the old arm stood so the change cannot be silent.
``attested.md`` was the repo's specimen for "the reader cannot read this". It is the SPEC §5.1
block form, which all four delivered knowledge bases write on 4605 of 4605 concepts, and it now
block form, which all four delivered knowledge bases write on every concept, and it now
yields its single verification entry with the actor intact."""
evidence = okf.evidence_for(_GOLDEN_DIR / "bundle" / "attested.md")
assert evidence.state == "present"

View file

@ -18,7 +18,7 @@ measurement (one of three is 33 % and says nothing).
shortest real identifier is FOUR characters (``12.1``, ``52.1``), so ``N = 3`` sits one below the
measurement and cannot refuse anything measured;
* document frequency of every code-shaped token (``generate._IDENTIFIER_FORMS``) in each base:
1 692 distinct tokens and NOT ONE reaches 5 % of its base's documents. Highest anywhere 1.35 %
well over a thousand distinct tokens and NOT ONE reaches 5 % of its base's documents. Highest anywhere 1.35 %
(6 documents); highest that a fasit names 0.67 % (3 documents); the base's own name is in every
document (100 %). ``A =
0.05`` therefore sits 3.7x above the highest real token and 20x below the defect.

View file

@ -320,8 +320,8 @@ def test_parse_frontmatter_top_level_title_survives_nested_sources_title(tmp_pat
``title:`` names the SOURCE document, not the concept (measured on a real concept of a
delivered requirements corpus). Top-level keys carry no indentation and must win — a nested
line must never overwrite a top-level key of the same name, however late it appears in the
scan. Without this, ``directory_listing`` on that corpus's level returned 269 documents that
all shared the one nested title, the source standard's own name — rung 2/3 of the navigation
scan. Without this, ``directory_listing`` on that corpus's level returned a few hundred documents
that all shared the one nested title, the source standard's own name — rung 2/3 of the navigation
ladder collapse to an opaque UUID filename and a character count (P14 finding; the ledger is
``docs/invarianter.md``).