open/llm-ingestion-okf
1
0
Fork 0
Code Issues Releases 4 Activity

test(retrieval-gate): register the hold-out set for row 5 again, at a durable bundle path

Browse source 
The registration row 5 reads, in a commit of its own and after the
commit that lets row 5 read the set's own schema. It replaces the one
on okf-holdout-registrering (7b0ce41), which is left unmerged: that
registration pointed at a bundle in a job's temporary directory, which
disappears with the job.

The set is the one written blind in claude-code-llm-wiki (order
4350316446, commit 33735b4), pinned by sha256. The bundle is the same
bytes row 8 measures (v1.1.0, --gate none), copied to
~/okf/gate-bundles/claude-code-wiki-7141ab3f with its ref measured
identical to the source (sha256-tree:7141ab3f...) and diff -r empty.
Threshold 0.8 questions answered over questions asked, written
2026-09-23T06:56:47Z with no reading taken; readings stay empty.

No gate code, no src/, no MUTANT_BAR moves.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
This commit is contained in:
Kjell Tore Guttormsen 2026-09-23 08:59:31 +02:00
commit 8ba32a0278
Signed by: ktg
SSH key fingerprint: SHA256:JakMjO6FTBBzN0Bhfj9saOoEjaFxlSdYuZQQpM/lF9Q
1 changed files with 13 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

13
tests/fixtures/retrieval/holdout-registration.json vendored Normal file
View file

@ -0,0 +1,13 @@
{
"set": "/Users/ktg/repos/claude-code-llm-wiki/eval/okf-holdout-sporsmaal.json",
"sha256": "7c45e2dc787b72dec3db2252f6ebc2d14b28d55f7e220bf76b43bfbe28adab82",
"bundle": "/Users/ktg/okf/gate-bundles/claude-code-wiki-7141ab3f",
"bundle_ref": "sha256-tree:7141ab3f00a20387caa2c22e43761ba625fbe596091303ca6c2069d77d20095c",
"bundle_built_with": "llm-ingestion-okf v1.1.0 (43499c0), --gate none; the bundle row 8 measures, copied to a durable path with its ref measured identical",
"metric": "questions answered over questions asked",
"threshold": 0.8,
"threshold_written_at": "2026-09-23T06:56:47Z",
"written_by": "claude-code-llm-wiki, order 4350316446, commit 33735b4: written blind, not the session that changes the ranking",
"registered_by": "llm-ingestion-okf, order 20260923T063334Z-9190430443, a session that changes no ranking",
"readings": []
}