docs: general wording for the remaining example-base totals

Replace the combined concept total, the distinct-token total and the
per-level document count of earlier example bases with general wording
in prose, comments and docstrings. No constant, assertion or test data
changes.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
This commit is contained in:
Kjell Tore Guttormsen 2026-09-23 17:51:10 +02:00
commit c66f4ae2b0
Signed by: ktg
SSH key fingerprint: SHA256:JakMjO6FTBBzN0Bhfj9saOoEjaFxlSdYuZQQpM/lF9Q
9 changed files with 16 additions and 16 deletions

View file

@ -18,7 +18,7 @@ measurement (one of three is 33 % and says nothing).
shortest real identifier is FOUR characters (``12.1``, ``52.1``), so ``N = 3`` sits one below the
measurement and cannot refuse anything measured;
* document frequency of every code-shaped token (``generate._IDENTIFIER_FORMS``) in each base:
1 692 distinct tokens and NOT ONE reaches 5 % of its base's documents. Highest anywhere 1.35 %
well over a thousand distinct tokens and NOT ONE reaches 5 % of its base's documents. Highest anywhere 1.35 %
(6 documents); highest that a fasit names 0.67 % (3 documents); the base's own name is in every
document (100 %). ``A =
0.05`` therefore sits 3.7x above the highest real token and 20x below the defect.