Order 20260907T141419Z-2723316647-from-.claude: a 12-document, three-question worksheet so the operator can answer the unit-of-knowledge question docs/2026-09-07-k3-arm-e.md left open before any new arm is attempted. The worksheet itself (concept splits per arm, extracted document structure, blank checkboxes) is local-only and gitignored because it quotes corpus content; this commit adds only the method record, which names no corpus path or document title. Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>
5 KiB
K3 unit worksheet, 2026-09-07
Order 20260907T141419Z-2723316647-from-.claude. Pure reading and
generation: no production code, no threshold, no rating performed by this
session. The worksheet itself is local-only and gitignored, because it
quotes corpus document titles, extracted text, and concept splits, and this
repo's public convention (CLAUDE.md) never tracks K2 corpus content or
paths. This file states what the worksheet is and how it was built, without
any of that content.
Why it exists
docs/2026-09-07-k3-arm-e.md § Verdict left the K3 result conditional on a
question no method text resolves: what counts as one unit of knowledge in
this corpus -- a top-level chapter, a numbered subsection, or something else
-- and whether a table is a unit on its own or only together with the prose
that introduces it. The question surfaced twice on identical material: once
under Arm D (two blind raters split on the same document), once under Arm E
(the same document, same split, changed reasoning). It is prior to any
threshold: a threshold on an undecided unit measures the rater, not the arm.
The operator asked for a concrete artifact rather than an abstract question. This worksheet is that artifact: one worked example per sample document, with the operator's answer left blank, that becomes the reference the next K3 round is measured against.
What the worksheet contains
One section per document in the K3 sample (n = 12, the same draw every K3 round has used), in canonical position order 0-11:
- The concept split under three arms -- Arm B (shipping default), Arm D
(
--outline-run 3), Arm E (--outline-run 3 --table-grid) -- as an indented list of concept title and character length per arm, capped at 25 lines with a... (+N)suffix when a document has more. - The document's own heading structure, independent of any arm: every
ATX (
#) and dotted-numbered heading the shipped grammar recognises, plus contiguous table spans (a maximal run of pipe-delimited rows and grid rule lines merged into ONE span, rather than fragmented the way the shipping per-row candidate rule reads them) -- capped at 30 lines. - Three checkbox questions per document -- what a unit is here, what a table is here, which arm is closest today -- plus one free-text line, all left blank for the operator.
- A closing summary table, 12 rows by 3 answer columns, that the operator fills in. That filled table is the deliverable: the next K3 round measures against it, stated as such at the top of the worksheet.
How it was built
Reading and generation only, run in the foreground this session, nothing
written under src/ or tools/:
- The sample draw was reproduced via the shipped
draw_samplefunction intools/okf_outline_measure.py(hex SHA-256 of the NFC-normalised filename, stratified 8 pdf / 3 docx / 1 xlsx) against the corpus directory, 12/12 matching the order published indocs/2026-09-07-k3-arm-e.md§ Appendix. - Concept splits per arm were read from the archived plan JSON files for
this K3 round -- Arm B from the archived baseline plans, Arm D from the
archived Arm D plans, Arm E from the Arm E round's own plans -- matched to
each sample document via each archive's own
_index.txt(position, exit code, filename), not by re-deriving a path prefix. - The document's own heading structure and table spans were read with the
shipped
_ATX,_NUMBERED,_TABLE_ROWand_GRID_RULEpatterns fromllm_ingestion_okf.propose, imported rather than re-implemented, for the same reason the reach instruments import them: a worksheet carrying its own copy of the grammar would describe a second definition that can drift from the shipped one without anything going red.
Verification
- Sample draw: 12/12 documents match the published Arm E appendix order.
- Entry counts per arm, all 12 positions: cross-checked against the
entries column of
docs/2026-09-07-k3-arm-e.md§ Appendix (Arm B / Arm D / Arm E). All 36 figures (12 documents x 3 arms) matched exactly, including the four documents where Arm B wrote no plan at all ("1 concept"). - Tracked-file content boundary: this file was checked for the corpus root directory name and any absolute filesystem path -> zero occurrences. It names no document title, no corpus path, and no extracted text.
- Worksheet content boundary: the local-only worksheet was checked for absolute paths and the corpus root directory name -> zero occurrences; it names document titles, which is expected and permitted in a local-only file, but carries no filesystem path into the corpus.
What this is not
No arm is built, changed, or shipped by this worksheet. No threshold is set.
No rating is entered by this session -- every checkbox and free-text line in
the worksheet is blank. The worksheet's own notes quote three findings
already published in docs/2026-09-07-k3-arm-e.md (positions 5, 10, 11) as
context for the operator's judgement; they are not new findings.