okf-wiki/docs/known-limitations.md
Kjell Tore Guttormsen 0fd86a23a3
okf-wiki 1.1.1
First public release, published as one snapshot. What changed between
versions is in CHANGELOG.md.

Co-Authored-By: Claude Fable 5.2 <noreply@anthropic.com>
2026-11-14 21:03:20 +01:00

3.2 KiB

Known limitations of v1

The review of v1 (06.11.2026) found 2 BLOCKER and 48 MAJOR findings. Both BLOCKERs and the MAJOR findings that are defects were fixed, each with a test. The MAJOR findings below were accepted: each one is a gap or a limitation, not wrong behaviour on the build path, and the reason is given. The finding numbers are the review's own order.

Guards that work but have no test of their own

The guard exists and was read in the code; what is missing is a test that would catch a regression in it.

# Where Untested guard
12 gates/answers.py breach rules for find actions, sed -i, absolute Glob patterns, unparseable Bash
14 gates/answerset.py gate on the held-out set; the threshold refusal; freeze without subset_of
15 gates/calibration.py the layout's refusal when too few distinct fillers remain; duplicate call names
18 gates/repair_gate.py the fix-case judgement (diff, excerpts, findings) on a handmade result
27 okfwiki/kassemble.py refusal of reserved (index, log) or unsafe concept ids
28 okfwiki/kassemble.py the stop after an unfinished swap (.<out>-old left behind)
31 okfwiki/kmerge.py the marked write: backup, marker and the recovery stop
34 okfwiki/kpack.py refusals to overwrite parts, home tasks, logs and the floor file
36 okfwiki/krepair.py unknown-key and ambiguous-key refusals in task and fix
37 okfwiki/krepair.py relink --work and its logged moved record
40 okfwiki/sources.py freeze's refusal of a bad name, a folder and a symlink; some check refusals

Measurement tooling

# Where Limitation Why accepted
13 gates/answerset.py, gates/multidoc.py run from a git worktree nested in the main checkout, a held-out path in the main checkout is not refused run the answer-set tools from the main checkout
16 gates/calibration.py, okfwiki/reader.py the gate reads the verdicts file twice (the green-run record now has one shared parser) extra reading, not a wrong result
22 okfwiki/cost.py user text between an unrecorded message and the next is counted as derived output it can only raise measured cost, so the cost stop comes earlier, never later
23 okfwiki/cost.py derived output before the first helper is projected per batch it can only raise the projection, which is reported, not used to stop
25 okfwiki/cost.py cost isolation takes no list of breaches set aside the rule that asked for it was removed with the rule cut of 06.11.2026
26 okfwiki/cost.py the read and diagnose breach count looks only at Read calls the reader and diagnoser agents are given the Read tool only

Other

# Where Limitation Why accepted
3 git history three merge commits (62d5438, 73e5bf7, ad63d41) are not Conventional Commits published history is not rewritten; later merges use merge(...)
39 okfwiki/reader.py when collect --gate-passed refuses a model, an older verdicts file at --out is left in place collect exits 1, and the skill then runs the calibration gate on that model before anything is scored; deleting the earlier file would destroy a valid reading