Kjell Tore Guttormsen
e3169ec50c
Measured 2026-09-20 on a 2313-concept bundle of one project's own documentation: `withheld` held 2 305 entries = 186 440 B of compact JSON = **65.5 % of the 284 850-byte payload**, and not one of those bytes counted against the budget the same payload reports (`spent` was 45 192). A reader was handed 239 658 bytes the budget line did not know about, to learn 2 305 concept ids with nothing beside them -- the title being exactly what `--withheld-titles` existed to buy, and which was off because buying it for 2 305 entries cost another 37.9 %. `withheld` is now a mapping: `total` (equal to `denominators.withheld`, so SS 5.2's identity is unmoved and closes on the NUMBERS), `by_rule` (the same total decomposed over the closed rule set, so "what kind of drop" is answerable without the list), `nearest` (the best-ranked drops BY NAME, with title and source document, so a reader who sees a near miss can ask for it) and `complete`. The near misses are read off the ranking, not off `cut`'s output: `cut` sorts by id so the partition is comparable, and that order says nothing about which concept a reader might want next. Same question, same bundle, after: **52 421 bytes, 18.4 % of the old file**. The whole list stays reachable behind `--withheld-full`, and the two instruments that classify EVERY miss by its rule -- the retrieval gate and `okf_consume_measure` -- now ask for it explicitly and assert `complete` rather than assuming it. `--withheld-nearest N` sets the cap (default 20, which is `k` plus the next twelve). `--withheld-titles` is retired: a flag whose only remaining effect would be to STRIP the title from a list the caller asked for in full names no decision worth two shapes for one list. `CONTRACT_REVISION` moves to `okf-consumption/2`, because a consumer indexing the old key as a list would otherwise break silently. Three checker rules move with it, and one of them is the interesting case: `parent_unfollowable` used `excerpts` + `withheld` as the bundle's own denominator, which a truncated block is not -- so that clause now runs only where the payload SAYS it is complete, stated in SS 8.6 rather than left as a silence, with the other two clauses (shape, self-reference) running either way. `Report` carries both denominators, because a report claiming it examined 2 305 entries it never saw is the same defect one level up. The generated skill's "breaking point" section goes with it: it extrapolated a concept count from the cost of ONE withheld entry, and there is no such slope any more. It now states what this bundle's bookkeeping cost and that the block is bounded by the cap rather than by the bundle -- an extrapolation from a slope the code no longer has would be a measurement of the previous revision. Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
82 lines
2.2 KiB
JSON
82 lines
2.2 KiB
JSON
{
|
|
"contract": "okf-consumption/2",
|
|
"bundle": {
|
|
"bundle_id": "example-corpus",
|
|
"ref": "9dd86b1f0c2e4a7b8d3f5061a2c4e6809bdf1357"
|
|
},
|
|
"budget": {
|
|
"unit": "o200k_base tokens",
|
|
"instrument": "<BUDGET_INSTRUMENT>",
|
|
"limit": 30000,
|
|
"spent": 18412,
|
|
"known_positive": {
|
|
"case": "commons reference document",
|
|
"expected": 10406,
|
|
"measured": 10406
|
|
}
|
|
},
|
|
"denominators": {
|
|
"considered": 5,
|
|
"withheld": 2,
|
|
"delivered": 3
|
|
},
|
|
"excerpts": [
|
|
{
|
|
"bundle_id": "example-corpus",
|
|
"concept_id": "fire-compartmentation-3-1",
|
|
"path": "concepts/fire-compartmentation-3-1.md",
|
|
"sha256": "39ccd5fdef696327c9b8bed873cb5d085fc2460e9a01cd12f872488cd8c74580",
|
|
"adjudication": "adjudicated",
|
|
"trust_tier": "human-reviewed",
|
|
"title": "Fire compartmentation",
|
|
"req_number": "Req 3.1-1",
|
|
"sources": [
|
|
{
|
|
"resource": "fire-code.pdf",
|
|
"title": "Fire code 2024"
|
|
}
|
|
],
|
|
"source_pages": "[11, 14]"
|
|
},
|
|
{
|
|
"bundle_id": "example-corpus",
|
|
"concept_id": "escape-routes-3-2",
|
|
"path": "concepts/escape-routes-3-2.md",
|
|
"sha256": "4352bb77959800ef35bb2b7afd82fbe764a93adc4252d635263388c8ef8811a6",
|
|
"adjudication": "proposed",
|
|
"trust_tier": "machine-confirmed",
|
|
"title": "Escape routes"
|
|
},
|
|
{
|
|
"bundle_id": "example-corpus",
|
|
"concept_id": "scope-1-0",
|
|
"path": "concepts/scope-1-0.md",
|
|
"sha256": "735ee94323f323b17bb567b9f02fa0926ade222f520c66641581e9be3c007088",
|
|
"adjudication": "unknown",
|
|
"trust_tier": "unverified",
|
|
"title": "Scope"
|
|
}
|
|
],
|
|
"withheld": {
|
|
"total": 2,
|
|
"by_rule": {
|
|
"over budget after knapsack": 1,
|
|
"type not in question scope": 1
|
|
},
|
|
"nearest": [
|
|
{
|
|
"concept_id": "appendix-a-tables",
|
|
"rule": "over budget after knapsack",
|
|
"title": "Appendix A — tables",
|
|
"source_file": "handbook.pdf"
|
|
},
|
|
{
|
|
"concept_id": "revision-log",
|
|
"rule": "type not in question scope",
|
|
"title": "Revision log",
|
|
"source_file": "handbook.pdf"
|
|
}
|
|
],
|
|
"complete": true
|
|
}
|
|
}
|