open/llm-ingestion-okf
1
0
Fork 0
Code Issues Releases 4 Activity

test(retrieval-gate): register the hold-out set for row 5 with ~/ paths

Browse source 
Same set, same sha256, same threshold and `threshold_written_at`, the same
`bundle_ref` (measured again on the durable bundle and identical), `readings`
empty. Only the two paths move from this machine's absolute form to `~/...`,
and `registered_by` names the order that did it. No share was read: the set
is absent on this machine, and row 5 stops before reading it.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
This commit is contained in:
Kjell Tore Guttormsen 2026-09-23 10:24:41 +02:00
commit af2d1d350e
Signed by: ktg
SSH key fingerprint: SHA256:JakMjO6FTBBzN0Bhfj9saOoEjaFxlSdYuZQQpM/lF9Q
1 changed files with 3 additions and 3 deletions
Download patch file Download diff file Expand all files Collapse all files

6
tests/fixtures/retrieval/holdout-registration.json vendored
View file

@ -1,13 +1,13 @@
{ {
"set": "/Users/ktg/repos/claude-code-llm-wiki/eval/okf-holdout-sporsmaal.json", "set": "~/repos/claude-code-llm-wiki/eval/okf-holdout-sporsmaal.json",
"sha256": "7c45e2dc787b72dec3db2252f6ebc2d14b28d55f7e220bf76b43bfbe28adab82", "sha256": "7c45e2dc787b72dec3db2252f6ebc2d14b28d55f7e220bf76b43bfbe28adab82",
"bundle": "/Users/ktg/okf/gate-bundles/claude-code-wiki-7141ab3f", "bundle": "~/okf/gate-bundles/claude-code-wiki-7141ab3f",
"bundle_ref": "sha256-tree:7141ab3f00a20387caa2c22e43761ba625fbe596091303ca6c2069d77d20095c", "bundle_ref": "sha256-tree:7141ab3f00a20387caa2c22e43761ba625fbe596091303ca6c2069d77d20095c",
"bundle_built_with": "llm-ingestion-okf v1.1.0 (43499c0), --gate none; the bundle row 8 measures, copied to a durable path with its ref measured identical", "bundle_built_with": "llm-ingestion-okf v1.1.0 (43499c0), --gate none; the bundle row 8 measures, copied to a durable path with its ref measured identical",
"metric": "questions answered over questions asked", "metric": "questions answered over questions asked",
"threshold": 0.8, "threshold": 0.8,
"threshold_written_at": "2026-09-23T06:56:47Z", "threshold_written_at": "2026-09-23T06:56:47Z",
"written_by": "claude-code-llm-wiki, order 4350316446, commit 33735b4: written blind, not the session that changes the ranking", "written_by": "claude-code-llm-wiki, order 4350316446, commit 33735b4: written blind, not the session that changes the ranking",
"registered_by": "llm-ingestion-okf, order 20260923T063334Z-9190430443, a session that changes no ranking", "registered_by": "llm-ingestion-okf, order 20260923T080931Z-3809217500, a session that changes no ranking",
"readings": [] "readings": []
} }