docs: general wording for the remaining example-base totals
Replace the combined concept total, the distinct-token total and the per-level document count of earlier example bases with general wording in prose, comments and docstrings. No constant, assertion or test data changes. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
This commit is contained in:
parent
6b1046bc23
commit
c66f4ae2b0
9 changed files with 16 additions and 16 deletions
|
|
@ -884,7 +884,7 @@ when the seam is detached, so the loop cannot silently degrade into theater.
|
||||||
A code now grounds only if it is at least 3 characters long **and** appears in fewer than 5 % of
|
A code now grounds only if it is at least 3 characters long **and** appears in fewer than 5 % of
|
||||||
the documents the input is made of, with an absolute floor of 10 documents so the share is never
|
the documents the input is made of, with an absolute floor of 10 documents so the share is never
|
||||||
taken over a handful. Both numbers are measured, not chosen: across the four delivered corpora no
|
taken over a handful. Both numbers are measured, not chosen: across the four delivered corpora no
|
||||||
code-shaped token of 1 692 distinct ones reaches 5 % (highest 1.35 %), and the shortest real
|
code-shaped token of well over a thousand distinct ones reaches 5 % (highest 1.35 %), and the shortest real
|
||||||
identifier is 4 characters. The refusal names the denominator — "appears in N of the N
|
identifier is 4 characters. The refusal names the denominator — "appears in N of the N
|
||||||
documents this run was given" — because that reason is fed verbatim into the next attempt's
|
documents this run was given" — because that reason is fed verbatim into the next attempt's
|
||||||
prompt. A caller that declares no document boundaries is unchanged by construction: one document
|
prompt. A caller that declares no document boundaries is unchanged by construction: one document
|
||||||
|
|
|
||||||
|
|
@ -2319,7 +2319,7 @@
|
||||||
GJENNOM `_grounding_text` — samme funksjon gaten bruker. **Et mønster er tillatt HER og ikke i
|
GJENNOM `_grounding_text` — samme funksjon gaten bruker. **Et mønster er tillatt HER og ikke i
|
||||||
gaten**, og det er skillet mellom rapport og gate: en ukjent form er et token som ikke telles,
|
gaten**, og det er skillet mellom rapport og gate: en ukjent form er et token som ikke telles,
|
||||||
altså under-telling, aldri falsk avvisning. Formene er TRANSKRIBERT fra målingen (K2: 50
|
altså under-telling, aldri falsk avvisning. Formene er TRANSKRIBERT fra målingen (K2: 50
|
||||||
distinkte kodeformede, 0 kravnumre; kravkorpuset: 269–981 distinkte kravnumre, ≤3 kodeformede);
|
distinkte kodeformede, 0 kravnumre; kravkorpuset: noen hundre til rundt tusen distinkte kravnumre, ≤3 kodeformede);
|
||||||
**rene tall er BEVISST utelatt med tallet** (46 394 / 2 117 i K2 — å telle dem gjør hver rapport
|
**rene tall er BEVISST utelatt med tallet** (46 394 / 2 117 i K2 — å telle dem gjør hver rapport
|
||||||
positiv og målingen inert). `grounding_offer_notice` er ENESTE renderer og tier når kjøringen KAN
|
positiv og målingen inert). `grounding_offer_notice` er ENESTE renderer og tier når kjøringen KAN
|
||||||
forankre — omisjon, aldri tom rad. Load-bearing MÅLT
|
forankre — omisjon, aldri tom rad. Load-bearing MÅLT
|
||||||
|
|
@ -2363,7 +2363,7 @@
|
||||||
brutt `uv run pytest` i overleveringspakka), mens (a) mandatet laster og (d) ruting-mot-egen-base
|
brutt `uv run pytest` i overleveringspakka), mens (a) mandatet laster og (d) ruting-mot-egen-base
|
||||||
er UBETINGEDE og aldri kan være fraværende. **FUNN, målt og IKKE fikset (egen ordre):**
|
er UBETINGEDE og aldri kan være fraværende. **FUNN, målt og IKKE fikset (egen ordre):**
|
||||||
`okf.parse_frontmatter` er linjeorientert last-write-wins, så `sources:`-blokkens innrykkede
|
`okf.parse_frontmatter` er linjeorientert last-write-wins, så `sources:`-blokkens innrykkede
|
||||||
`title` overskriver konseptets egen — `directory_listing` på ett kravnivå i en av kravbasene returnerte **269
|
`title` overskriver konseptets egen — `directory_listing` på ett kravnivå i en av kravbasene returnerte **noen hundre
|
||||||
dokumenter, alle med basens eget navn som `"title"`**, og navigasjonsstigens rung 2/3 skiller dem kun med
|
dokumenter, alle med basens eget navn som `"title"`**, og navigasjonsstigens rung 2/3 skiller dem kun med
|
||||||
et UUID-filnavn og et tegnantall. En fasit-assert mot den tittelen ville vært VAKUØS, så gaten
|
et UUID-filnavn og et tegnantall. En fasit-assert mot den tittelen ville vært VAKUØS, så gaten
|
||||||
leser toppnivå-nøkler (`own_frontmatter`, første forekomst vinner) og bærer en TRIPWIRE som
|
leser toppnivå-nøkler (`own_frontmatter`, første forekomst vinner) og bærer en TRIPWIRE som
|
||||||
|
|
@ -2525,7 +2525,7 @@
|
||||||
hver `must_cite`-referanse og hver mandat-`affected_code` i de fire kontekstsettene er den
|
hver `must_cite`-referanse og hver mandat-`affected_code` i de fire kontekstsettene er den
|
||||||
KORTESTE ekte identifikatoren FIRE tegn (`12.1`/`52.1`), så `_GROUNDING_MIN_LENGTH = 3` ligger ETT
|
KORTESTE ekte identifikatoren FIRE tegn (`12.1`/`52.1`), så `_GROUNDING_MIN_LENGTH = 3` ligger ETT
|
||||||
under målingen og kan ikke nekte noe som er målt; og over dokumentfrekvensen til hvert
|
under målingen og kan ikke nekte noe som er målt; og over dokumentfrekvensen til hvert
|
||||||
kodeformet token i hver base (`_IDENTIFIER_FORMS`) når **ingen av 1 692 distinkte** 5 % —
|
kodeformet token i hver base (`_IDENTIFIER_FORMS`) når **ingen av godt over tusen distinkte** 5 % —
|
||||||
høyeste noe sted er **1,35 %** (6 dokumenter), høyeste en fasit faktisk navngir **0,67 %** (3 dokumenter),
|
høyeste noe sted er **1,35 %** (6 dokumenter), høyeste en fasit faktisk navngir **0,67 %** (3 dokumenter),
|
||||||
mens basenavnet står i **alle dokumentene (100 %)**. `_GROUNDING_MAX_DOCUMENT_SHARE = 0.05` ligger altså
|
mens basenavnet står i **alle dokumentene (100 %)**. `_GROUNDING_MAX_DOCUMENT_SHARE = 0.05` ligger altså
|
||||||
3,7× over det høyeste ekte tokenet og 20× under defekten. **Lengden er IKKE dét som gjør defekten
|
3,7× over det høyeste ekte tokenet og 20× under defekten. **Lengden er IKKE dét som gjør defekten
|
||||||
|
|
|
||||||
|
|
@ -115,7 +115,7 @@ def _frontmatter_from_text(text: str) -> dict[str, str]:
|
||||||
key (``sources:\\n - title: …`` names the SOURCE, not the concept) and must never overwrite
|
key (``sources:\\n - title: …`` names the SOURCE, not the concept) and must never overwrite
|
||||||
the concept's own field, however late it appears in the scan. Measured 2026-09-13 on
|
the concept's own field, however late it appears in the scan. Measured 2026-09-13 on
|
||||||
the corpus build's concepts: without this, every ``sources:``-bearing file's nested ``title``
|
the corpus build's concepts: without this, every ``sources:``-bearing file's nested ``title``
|
||||||
replaced its own, collapsing 4605 concepts to 4 distinct titles. A nested line with no
|
replaced its own, collapsing every concept to its base's one title. A nested line with no
|
||||||
top-level counterpart is still preserved (OKF SPEC §4, "unknown fields are preserved")."""
|
top-level counterpart is still preserved (OKF SPEC §4, "unknown fields are preserved")."""
|
||||||
fm: dict[str, str] = {}
|
fm: dict[str, str] = {}
|
||||||
top_level: set[str] = set()
|
top_level: set[str] = set()
|
||||||
|
|
@ -804,7 +804,7 @@ def read_provenance(
|
||||||
# acts on.
|
# acts on.
|
||||||
items = sum(1 for ln in continuation if ln.strip().startswith("- "))
|
items = sum(1 for ln in continuation if ln.strip().startswith("- "))
|
||||||
# P13b: the block sequence of mappings is SPEC §5.1's own example and the form all four
|
# P13b: the block sequence of mappings is SPEC §5.1's own example and the form all four
|
||||||
# delivered bases actually write (4605/4605, measured). It is decoded by the second carrier
|
# delivered bases actually write (every concept, measured). It is decoded by the second carrier
|
||||||
# of the one grammar; a block MAPPING (no item opened) and anything the grammar refuses
|
# of the one grammar; a block MAPPING (no item opened) and anything the grammar refuses
|
||||||
# still come back unreadable, which is what keeps "we could not read it" from quietly
|
# still come back unreadable, which is what keeps "we could not read it" from quietly
|
||||||
# becoming "there was nothing to read".
|
# becoming "there was nothing to read".
|
||||||
|
|
|
||||||
|
|
@ -295,7 +295,7 @@ _GROUNDING_MIN_LENGTH: Final = 3
|
||||||
#: The share of the grounding's DOCUMENTS above which a token identifies nothing.
|
#: The share of the grounding's DOCUMENTS above which a token identifies nothing.
|
||||||
#:
|
#:
|
||||||
#: MEASURED over the four delivered corpora, counting document frequency for every code-shaped
|
#: MEASURED over the four delivered corpora, counting document frequency for every code-shaped
|
||||||
#: token (``generate._IDENTIFIER_FORMS``): 1 692 distinct tokens, and NOT ONE reaches 5 % of its
|
#: token (``generate._IDENTIFIER_FORMS``): well over a thousand distinct tokens, and NOT ONE reaches 5 % of its
|
||||||
#: base's documents. The highest anywhere is 1.35 % (6 documents); the highest that a fasit or mandate
|
#: base's documents. The highest anywhere is 1.35 % (6 documents); the highest that a fasit or mandate
|
||||||
#: actually names is 0.67 % (3 documents). P16's fabricated ``P900`` is in every one — 100 %.
|
#: actually names is 0.67 % (3 documents). P16's fabricated ``P900`` is in every one — 100 %.
|
||||||
#: 5 % therefore sits 3.7x above the highest real token measured and 20x below the defect.
|
#: 5 % therefore sits 3.7x above the highest real token measured and 20x below the defect.
|
||||||
|
|
|
||||||
|
|
@ -1,9 +1,9 @@
|
||||||
"""P13b: a BLOCK sequence of mappings is provenance po can read, not provenance po cannot.
|
"""P13b: a BLOCK sequence of mappings is provenance po can read, not provenance po cannot.
|
||||||
|
|
||||||
RED-FIRST, measured 2026-09-12 with the full denominator: every concept file in all four
|
RED-FIRST, measured 2026-09-12 with the full denominator: every concept file in all four
|
||||||
knowledge bases delivered at the time wrote ``sources`` as a BLOCK sequence — **4605 of 4605, and 0
|
knowledge bases delivered at the time wrote ``sources`` as a BLOCK sequence — **every one of them, and 0
|
||||||
in flow form**. ``read_provenance`` answered ``UnreadableProvenance(reason="block-sequence")`` for
|
in flow form**. ``read_provenance`` answered ``UnreadableProvenance(reason="block-sequence")`` for
|
||||||
every one of them, so ``evidence_for`` reported ``state="unreadable"`` on 4605 of 4605 documents:
|
every one of them, so ``evidence_for`` reported ``state="unreadable"`` on every document:
|
||||||
the falsification layer had no address for any document in any base po was about to be
|
the falsification layer had no address for any document in any base po was about to be
|
||||||
stress-tested against. The package's two example bases write the same form (``sources`` read as
|
stress-tested against. The package's two example bases write the same form (``sources`` read as
|
||||||
entries in 306 of 306 and 301 of 301 concept files, re-measured below rather than quoted).
|
entries in 306 of 306 and 301 of 301 concept files, re-measured below rather than quoted).
|
||||||
|
|
@ -175,7 +175,7 @@ def test_an_item_with_no_pair_separator_is_refused(tmp_path: Path) -> None:
|
||||||
**This is the ONE arm that witnesses the colon-SPACE rule** (measured by mutation M5): a reader
|
**This is the ONE arm that witnesses the colon-SPACE rule** (measured by mutation M5): a reader
|
||||||
splitting on the FIRST colon reads this item as ``{'https': '//a.example/d'}``, inventing a key
|
splitting on the FIRST colon reads this item as ``{'https': '//a.example/d'}``, inventing a key
|
||||||
out of a URL scheme instead of refusing. Every delivered ``resource`` is a URL, so that reader
|
out of a URL scheme instead of refusing. Every delivered ``resource`` is a URL, so that reader
|
||||||
would mint 4605 such keys rather than fail once."""
|
would mint one such key per concept rather than fail once."""
|
||||||
path = _write(tmp_path, "type: concept\nsources:\n - https://a.example/d\n")
|
path = _write(tmp_path, "type: concept\nsources:\n - https://a.example/d\n")
|
||||||
result = okf.read_provenance(path, "sources")
|
result = okf.read_provenance(path, "sources")
|
||||||
assert isinstance(result, okf.UnreadableProvenance)
|
assert isinstance(result, okf.UnreadableProvenance)
|
||||||
|
|
|
||||||
|
|
@ -133,7 +133,7 @@ def test_the_three_non_present_states_are_unchanged_for_any_key(tmp_path: Path)
|
||||||
absent = okf.evidence_for(_concept(tmp_path), key="adjudication")
|
absent = okf.evidence_for(_concept(tmp_path), key="adjudication")
|
||||||
assert (absent.state, absent.tier, absent.items_seen) == ("absent", None, 0)
|
assert (absent.state, absent.tier, absent.items_seen) == ("absent", None, 0)
|
||||||
|
|
||||||
# P13b made the block sequence of mappings READABLE (measured: 4605 of 4605 concepts in the
|
# P13b made the block sequence of mappings READABLE (measured: every concept in the
|
||||||
# four delivered bases write exactly that form). The specimen therefore moved to one that is
|
# four delivered bases write exactly that form). The specimen therefore moved to one that is
|
||||||
# still unreadable for a reason of its own — an item the flow decoder refuses — so this arm
|
# still unreadable for a reason of its own — an item the flow decoder refuses — so this arm
|
||||||
# keeps asserting what it always asserted: an unreadable value is never tiered.
|
# keeps asserting what it always asserted: an unreadable value is never tiered.
|
||||||
|
|
|
||||||
|
|
@ -89,7 +89,7 @@ _ENERGI_BUNDLE = Path(__file__).resolve().parents[1] / "shared" / "examples" / "
|
||||||
def _unreadable_document(tmp_path: Path, entries: int = 1) -> Path:
|
def _unreadable_document(tmp_path: Path, entries: int = 1) -> Path:
|
||||||
"""A document whose ``verified`` is a block sequence the decoder REFUSES, with a chosen count.
|
"""A document whose ``verified`` is a block sequence the decoder REFUSES, with a chosen count.
|
||||||
|
|
||||||
P13b widened the reader to the block sequence of mappings (measured: 4605 of 4605 concepts in
|
P13b widened the reader to the block sequence of mappings (measured: every concept in
|
||||||
the four delivered bases write it, and po reported every one of them unreadable). The arms below
|
the four delivered bases write it, and po reported every one of them unreadable). The arms below
|
||||||
need a specimen that is still unreadable for a reason of its own, or they would be asserting
|
need a specimen that is still unreadable for a reason of its own, or they would be asserting
|
||||||
against a state the reader no longer produces. This one refuses on SPEC §5.2 — an entry naming
|
against a state the reader no longer produces. This one refuses on SPEC §5.2 — an entry naming
|
||||||
|
|
@ -167,7 +167,7 @@ def test_the_committed_block_form_fixture_is_now_READ(tmp_path: Path) -> None:
|
||||||
"""The direction P13b reversed, pinned where the old arm stood so the change cannot be silent.
|
"""The direction P13b reversed, pinned where the old arm stood so the change cannot be silent.
|
||||||
|
|
||||||
``attested.md`` was the repo's specimen for "the reader cannot read this". It is the SPEC §5.1
|
``attested.md`` was the repo's specimen for "the reader cannot read this". It is the SPEC §5.1
|
||||||
block form, which all four delivered knowledge bases write on 4605 of 4605 concepts, and it now
|
block form, which all four delivered knowledge bases write on every concept, and it now
|
||||||
yields its single verification entry with the actor intact."""
|
yields its single verification entry with the actor intact."""
|
||||||
evidence = okf.evidence_for(_GOLDEN_DIR / "bundle" / "attested.md")
|
evidence = okf.evidence_for(_GOLDEN_DIR / "bundle" / "attested.md")
|
||||||
assert evidence.state == "present"
|
assert evidence.state == "present"
|
||||||
|
|
|
||||||
|
|
@ -18,7 +18,7 @@ measurement (one of three is 33 % and says nothing).
|
||||||
shortest real identifier is FOUR characters (``12.1``, ``52.1``), so ``N = 3`` sits one below the
|
shortest real identifier is FOUR characters (``12.1``, ``52.1``), so ``N = 3`` sits one below the
|
||||||
measurement and cannot refuse anything measured;
|
measurement and cannot refuse anything measured;
|
||||||
* document frequency of every code-shaped token (``generate._IDENTIFIER_FORMS``) in each base:
|
* document frequency of every code-shaped token (``generate._IDENTIFIER_FORMS``) in each base:
|
||||||
1 692 distinct tokens and NOT ONE reaches 5 % of its base's documents. Highest anywhere 1.35 %
|
well over a thousand distinct tokens and NOT ONE reaches 5 % of its base's documents. Highest anywhere 1.35 %
|
||||||
(6 documents); highest that a fasit names 0.67 % (3 documents); the base's own name is in every
|
(6 documents); highest that a fasit names 0.67 % (3 documents); the base's own name is in every
|
||||||
document (100 %). ``A =
|
document (100 %). ``A =
|
||||||
0.05`` therefore sits 3.7x above the highest real token and 20x below the defect.
|
0.05`` therefore sits 3.7x above the highest real token and 20x below the defect.
|
||||||
|
|
|
||||||
|
|
@ -320,8 +320,8 @@ def test_parse_frontmatter_top_level_title_survives_nested_sources_title(tmp_pat
|
||||||
``title:`` names the SOURCE document, not the concept (measured on a real concept of a
|
``title:`` names the SOURCE document, not the concept (measured on a real concept of a
|
||||||
delivered requirements corpus). Top-level keys carry no indentation and must win — a nested
|
delivered requirements corpus). Top-level keys carry no indentation and must win — a nested
|
||||||
line must never overwrite a top-level key of the same name, however late it appears in the
|
line must never overwrite a top-level key of the same name, however late it appears in the
|
||||||
scan. Without this, ``directory_listing`` on that corpus's level returned 269 documents that
|
scan. Without this, ``directory_listing`` on that corpus's level returned a few hundred documents
|
||||||
all shared the one nested title, the source standard's own name — rung 2/3 of the navigation
|
that all shared the one nested title, the source standard's own name — rung 2/3 of the navigation
|
||||||
ladder collapse to an opaque UUID filename and a character count (P14 finding; the ledger is
|
ladder collapse to an opaque UUID filename and a character count (P14 finding; the ledger is
|
||||||
``docs/invarianter.md``).
|
``docs/invarianter.md``).
|
||||||
|
|
||||||
|
|
|
||||||
Loading…
Add table
Add a link
Reference in a new issue