open/llm-ingestion-okf
1
0
Fork 0
Code Issues Releases 4 Activity

docs: the viewable-asset round, measured per image

Browse source 
README, CHANGELOG (under the untagged 0.10.1), CLAUDE.md and the round's
report. The numbers are the census's, not a summary of them.

- 9 714 image rows over 18 403 files and 67 PDFs, two pinned trees: exactly
  35 rows moved, 9 321 of 9 321 JPEG and PNG rows byte-identical.
- The 16 the round did not go looking for: JPEG 2000 objects out of PDF
  streams, also unreadable by a model, with no stdlib route to convert them.
  They become `asset_not_viewable` -- 16 pictures lost from a bundle, 16
  statements gained that a picture stood there. Stated in the README, the
  CHANGELOG, CLAUDE.md and the report rather than left in a total.
- The accounting gate: R761 0 -> 19 claimed-and-not-found when the conversion
  landed, 0 again after the judge learned its second route; row 6 90 of 111
  -> 110 of 111. The gate's verdict is the same `RED: rows 2, 3, 6` as before
  the round, with row 3's numbers identical.
- `<!-- asset-viewable-media-types: ... -->` is pinned to
  `assets.VIEWABLE_MEDIA_TYPES` by a test, compared as a whole set: a README
  naming three of four would pass every containment check and tell a consumer
  that a format is refused when it is carried.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
This commit is contained in:
Kjell Tore Guttormsen 2026-09-19 08:26:17 +02:00
commit c39b666c11
Signed by: ktg
SSH key fingerprint: SHA256:JakMjO6FTBBzN0Bhfj9saOoEjaFxlSdYuZQQpM/lF9Q
4 changed files with 104 additions and 5 deletions
Download patch file Download diff file Expand all files Collapse all files

9
README.md
View file

@ -335,6 +335,15 @@ and the size in pixels already live — states the original media type, the
original sha256 in full and the new one, so a reader can take the original
delivery, run `shasum -a 256` and find the row.
The cost is measured per image rather than per bundle, with a committed
script (`tools/okf_asset_census.py`) run from two pinned trees over 9 714
image rows: exactly **35 rows moved**. Nineteen are the BMPs, now PNG. The
other **16 are JPEG 2000 objects** carried out of PDF streams — a format no
model decodes either, and one no stdlib route converts, so they are refused
with `asset_not_viewable` and stated in the concept instead of being carried
unreadably. **9 321 of 9 321** JPEG and PNG rows are byte-identical across the
move.
<!-- asset-viewable-media-types: image/gif,image/jpeg,image/png,image/webp -->
**A size CEILING, read off the same corpora (0.10.1).** An image over