docs: general wording for the remaining example-base totals
Replace the combined concept total, the distinct-token total and the per-level document count of earlier example bases with general wording in prose, comments and docstrings. No constant, assertion or test data changes. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
This commit is contained in:
parent
6b1046bc23
commit
c66f4ae2b0
9 changed files with 16 additions and 16 deletions
|
|
@ -884,7 +884,7 @@ when the seam is detached, so the loop cannot silently degrade into theater.
|
|||
A code now grounds only if it is at least 3 characters long **and** appears in fewer than 5 % of
|
||||
the documents the input is made of, with an absolute floor of 10 documents so the share is never
|
||||
taken over a handful. Both numbers are measured, not chosen: across the four delivered corpora no
|
||||
code-shaped token of 1 692 distinct ones reaches 5 % (highest 1.35 %), and the shortest real
|
||||
code-shaped token of well over a thousand distinct ones reaches 5 % (highest 1.35 %), and the shortest real
|
||||
identifier is 4 characters. The refusal names the denominator — "appears in N of the N
|
||||
documents this run was given" — because that reason is fed verbatim into the next attempt's
|
||||
prompt. A caller that declares no document boundaries is unchanged by construction: one document
|
||||
|
|
|
|||
|
|
@ -2319,7 +2319,7 @@
|
|||
GJENNOM `_grounding_text` — samme funksjon gaten bruker. **Et mønster er tillatt HER og ikke i
|
||||
gaten**, og det er skillet mellom rapport og gate: en ukjent form er et token som ikke telles,
|
||||
altså under-telling, aldri falsk avvisning. Formene er TRANSKRIBERT fra målingen (K2: 50
|
||||
distinkte kodeformede, 0 kravnumre; kravkorpuset: 269–981 distinkte kravnumre, ≤3 kodeformede);
|
||||
distinkte kodeformede, 0 kravnumre; kravkorpuset: noen hundre til rundt tusen distinkte kravnumre, ≤3 kodeformede);
|
||||
**rene tall er BEVISST utelatt med tallet** (46 394 / 2 117 i K2 — å telle dem gjør hver rapport
|
||||
positiv og målingen inert). `grounding_offer_notice` er ENESTE renderer og tier når kjøringen KAN
|
||||
forankre — omisjon, aldri tom rad. Load-bearing MÅLT
|
||||
|
|
@ -2363,7 +2363,7 @@
|
|||
brutt `uv run pytest` i overleveringspakka), mens (a) mandatet laster og (d) ruting-mot-egen-base
|
||||
er UBETINGEDE og aldri kan være fraværende. **FUNN, målt og IKKE fikset (egen ordre):**
|
||||
`okf.parse_frontmatter` er linjeorientert last-write-wins, så `sources:`-blokkens innrykkede
|
||||
`title` overskriver konseptets egen — `directory_listing` på ett kravnivå i en av kravbasene returnerte **269
|
||||
`title` overskriver konseptets egen — `directory_listing` på ett kravnivå i en av kravbasene returnerte **noen hundre
|
||||
dokumenter, alle med basens eget navn som `"title"`**, og navigasjonsstigens rung 2/3 skiller dem kun med
|
||||
et UUID-filnavn og et tegnantall. En fasit-assert mot den tittelen ville vært VAKUØS, så gaten
|
||||
leser toppnivå-nøkler (`own_frontmatter`, første forekomst vinner) og bærer en TRIPWIRE som
|
||||
|
|
@ -2525,7 +2525,7 @@
|
|||
hver `must_cite`-referanse og hver mandat-`affected_code` i de fire kontekstsettene er den
|
||||
KORTESTE ekte identifikatoren FIRE tegn (`12.1`/`52.1`), så `_GROUNDING_MIN_LENGTH = 3` ligger ETT
|
||||
under målingen og kan ikke nekte noe som er målt; og over dokumentfrekvensen til hvert
|
||||
kodeformet token i hver base (`_IDENTIFIER_FORMS`) når **ingen av 1 692 distinkte** 5 % —
|
||||
kodeformet token i hver base (`_IDENTIFIER_FORMS`) når **ingen av godt over tusen distinkte** 5 % —
|
||||
høyeste noe sted er **1,35 %** (6 dokumenter), høyeste en fasit faktisk navngir **0,67 %** (3 dokumenter),
|
||||
mens basenavnet står i **alle dokumentene (100 %)**. `_GROUNDING_MAX_DOCUMENT_SHARE = 0.05` ligger altså
|
||||
3,7× over det høyeste ekte tokenet og 20× under defekten. **Lengden er IKKE dét som gjør defekten
|
||||
|
|
|
|||
|
|
@ -115,7 +115,7 @@ def _frontmatter_from_text(text: str) -> dict[str, str]:
|
|||
key (``sources:\\n - title: …`` names the SOURCE, not the concept) and must never overwrite
|
||||
the concept's own field, however late it appears in the scan. Measured 2026-09-13 on
|
||||
the corpus build's concepts: without this, every ``sources:``-bearing file's nested ``title``
|
||||
replaced its own, collapsing 4605 concepts to 4 distinct titles. A nested line with no
|
||||
replaced its own, collapsing every concept to its base's one title. A nested line with no
|
||||
top-level counterpart is still preserved (OKF SPEC §4, "unknown fields are preserved")."""
|
||||
fm: dict[str, str] = {}
|
||||
top_level: set[str] = set()
|
||||
|
|
@ -804,7 +804,7 @@ def read_provenance(
|
|||
# acts on.
|
||||
items = sum(1 for ln in continuation if ln.strip().startswith("- "))
|
||||
# P13b: the block sequence of mappings is SPEC §5.1's own example and the form all four
|
||||
# delivered bases actually write (4605/4605, measured). It is decoded by the second carrier
|
||||
# delivered bases actually write (every concept, measured). It is decoded by the second carrier
|
||||
# of the one grammar; a block MAPPING (no item opened) and anything the grammar refuses
|
||||
# still come back unreadable, which is what keeps "we could not read it" from quietly
|
||||
# becoming "there was nothing to read".
|
||||
|
|
|
|||
|
|
@ -295,7 +295,7 @@ _GROUNDING_MIN_LENGTH: Final = 3
|
|||
#: The share of the grounding's DOCUMENTS above which a token identifies nothing.
|
||||
#:
|
||||
#: MEASURED over the four delivered corpora, counting document frequency for every code-shaped
|
||||
#: token (``generate._IDENTIFIER_FORMS``): 1 692 distinct tokens, and NOT ONE reaches 5 % of its
|
||||
#: token (``generate._IDENTIFIER_FORMS``): well over a thousand distinct tokens, and NOT ONE reaches 5 % of its
|
||||
#: base's documents. The highest anywhere is 1.35 % (6 documents); the highest that a fasit or mandate
|
||||
#: actually names is 0.67 % (3 documents). P16's fabricated ``P900`` is in every one — 100 %.
|
||||
#: 5 % therefore sits 3.7x above the highest real token measured and 20x below the defect.
|
||||
|
|
|
|||
|
|
@ -1,9 +1,9 @@
|
|||
"""P13b: a BLOCK sequence of mappings is provenance po can read, not provenance po cannot.
|
||||
|
||||
RED-FIRST, measured 2026-09-12 with the full denominator: every concept file in all four
|
||||
knowledge bases delivered at the time wrote ``sources`` as a BLOCK sequence — **4605 of 4605, and 0
|
||||
knowledge bases delivered at the time wrote ``sources`` as a BLOCK sequence — **every one of them, and 0
|
||||
in flow form**. ``read_provenance`` answered ``UnreadableProvenance(reason="block-sequence")`` for
|
||||
every one of them, so ``evidence_for`` reported ``state="unreadable"`` on 4605 of 4605 documents:
|
||||
every one of them, so ``evidence_for`` reported ``state="unreadable"`` on every document:
|
||||
the falsification layer had no address for any document in any base po was about to be
|
||||
stress-tested against. The package's two example bases write the same form (``sources`` read as
|
||||
entries in 306 of 306 and 301 of 301 concept files, re-measured below rather than quoted).
|
||||
|
|
@ -175,7 +175,7 @@ def test_an_item_with_no_pair_separator_is_refused(tmp_path: Path) -> None:
|
|||
**This is the ONE arm that witnesses the colon-SPACE rule** (measured by mutation M5): a reader
|
||||
splitting on the FIRST colon reads this item as ``{'https': '//a.example/d'}``, inventing a key
|
||||
out of a URL scheme instead of refusing. Every delivered ``resource`` is a URL, so that reader
|
||||
would mint 4605 such keys rather than fail once."""
|
||||
would mint one such key per concept rather than fail once."""
|
||||
path = _write(tmp_path, "type: concept\nsources:\n - https://a.example/d\n")
|
||||
result = okf.read_provenance(path, "sources")
|
||||
assert isinstance(result, okf.UnreadableProvenance)
|
||||
|
|
|
|||
|
|
@ -133,7 +133,7 @@ def test_the_three_non_present_states_are_unchanged_for_any_key(tmp_path: Path)
|
|||
absent = okf.evidence_for(_concept(tmp_path), key="adjudication")
|
||||
assert (absent.state, absent.tier, absent.items_seen) == ("absent", None, 0)
|
||||
|
||||
# P13b made the block sequence of mappings READABLE (measured: 4605 of 4605 concepts in the
|
||||
# P13b made the block sequence of mappings READABLE (measured: every concept in the
|
||||
# four delivered bases write exactly that form). The specimen therefore moved to one that is
|
||||
# still unreadable for a reason of its own — an item the flow decoder refuses — so this arm
|
||||
# keeps asserting what it always asserted: an unreadable value is never tiered.
|
||||
|
|
|
|||
|
|
@ -89,7 +89,7 @@ _ENERGI_BUNDLE = Path(__file__).resolve().parents[1] / "shared" / "examples" / "
|
|||
def _unreadable_document(tmp_path: Path, entries: int = 1) -> Path:
|
||||
"""A document whose ``verified`` is a block sequence the decoder REFUSES, with a chosen count.
|
||||
|
||||
P13b widened the reader to the block sequence of mappings (measured: 4605 of 4605 concepts in
|
||||
P13b widened the reader to the block sequence of mappings (measured: every concept in
|
||||
the four delivered bases write it, and po reported every one of them unreadable). The arms below
|
||||
need a specimen that is still unreadable for a reason of its own, or they would be asserting
|
||||
against a state the reader no longer produces. This one refuses on SPEC §5.2 — an entry naming
|
||||
|
|
@ -167,7 +167,7 @@ def test_the_committed_block_form_fixture_is_now_READ(tmp_path: Path) -> None:
|
|||
"""The direction P13b reversed, pinned where the old arm stood so the change cannot be silent.
|
||||
|
||||
``attested.md`` was the repo's specimen for "the reader cannot read this". It is the SPEC §5.1
|
||||
block form, which all four delivered knowledge bases write on 4605 of 4605 concepts, and it now
|
||||
block form, which all four delivered knowledge bases write on every concept, and it now
|
||||
yields its single verification entry with the actor intact."""
|
||||
evidence = okf.evidence_for(_GOLDEN_DIR / "bundle" / "attested.md")
|
||||
assert evidence.state == "present"
|
||||
|
|
|
|||
|
|
@ -18,7 +18,7 @@ measurement (one of three is 33 % and says nothing).
|
|||
shortest real identifier is FOUR characters (``12.1``, ``52.1``), so ``N = 3`` sits one below the
|
||||
measurement and cannot refuse anything measured;
|
||||
* document frequency of every code-shaped token (``generate._IDENTIFIER_FORMS``) in each base:
|
||||
1 692 distinct tokens and NOT ONE reaches 5 % of its base's documents. Highest anywhere 1.35 %
|
||||
well over a thousand distinct tokens and NOT ONE reaches 5 % of its base's documents. Highest anywhere 1.35 %
|
||||
(6 documents); highest that a fasit names 0.67 % (3 documents); the base's own name is in every
|
||||
document (100 %). ``A =
|
||||
0.05`` therefore sits 3.7x above the highest real token and 20x below the defect.
|
||||
|
|
|
|||
|
|
@ -320,8 +320,8 @@ def test_parse_frontmatter_top_level_title_survives_nested_sources_title(tmp_pat
|
|||
``title:`` names the SOURCE document, not the concept (measured on a real concept of a
|
||||
delivered requirements corpus). Top-level keys carry no indentation and must win — a nested
|
||||
line must never overwrite a top-level key of the same name, however late it appears in the
|
||||
scan. Without this, ``directory_listing`` on that corpus's level returned 269 documents that
|
||||
all shared the one nested title, the source standard's own name — rung 2/3 of the navigation
|
||||
scan. Without this, ``directory_listing`` on that corpus's level returned a few hundred documents
|
||||
that all shared the one nested title, the source standard's own name — rung 2/3 of the navigation
|
||||
ladder collapse to an opaque UUID filename and a character count (P14 finding; the ledger is
|
||||
``docs/invarianter.md``).
|
||||
|
||||
|
|
|
|||
Loading…
Add table
Add a link
Reference in a new issue