llm-ingestion-pipeline-security

open/llm-ingestion-pipeline-security

Fork 0

Commit graph

0184df9ed9 docs(limits): tags and description block the whole OKF corpus before sources is even read main Kjell Tore Guttormsen 2026-08-25 08:27:22 +02:00
9aeceb02c0 release: 1.2.0 -- the OKF mapping-form fix becomes pinnable v1.2.0 Kjell Tore Guttormsen 2026-08-23 20:13:50 +02:00
58704834b6 feat(okf): the mapping class gets one expressible form, typed and allowlisted Kjell Tore Guttormsen 2026-08-21 21:04:51 +02:00
7cb4553301 docs(llms): add llms.txt per org D2b decision (21.08) Kjell Tore Guttormsen 2026-08-21 11:24:00 +02:00
01f6f382c4 test(docs): pin docs/redos-sweep.py under test.py's contract Kjell Tore Guttormsen 2026-08-20 23:10:25 +02:00
74656123f9 docs(redos): the sweep now measures on the clock its own numbers justify Kjell Tore Guttormsen 2026-08-18 16:56:01 +02:00
4472f209a4 docs(limits): seven shipped behaviours were only in the code, and one of them was written down wrong Kjell Tore Guttormsen 2026-08-17 12:15:00 +02:00
2b03b8d643 docs(security): add contact email, https scheme on Forgejo URL Kjell Tore Guttormsen 2026-08-16 21:15:10 +02:00
246e1fc1d3 docs(readme): add table of contents Kjell Tore Guttormsen 2026-08-16 16:16:57 +02:00
45c2b06315 docs: "warn, clean" is graded, never cleaned bytes -- measured at okf's door Kjell Tore Guttormsen 2026-08-13 23:24:38 +02:00
869f9058f7 docs: the fix closed a type confusion, not pointer-smuggling as a class Kjell Tore Guttormsen 2026-08-13 23:05:52 +02:00
ca4f97c8c9 release: 1.1.0 -- the first behaviour change shipped under the freeze v1.1.0 Kjell Tore Guttormsen 2026-08-13 22:58:36 +02:00
da30211bc7 fix(okf): a mapping construct no longer degrades into a string, and there were two routes Kjell Tore Guttormsen 2026-08-13 22:58:27 +02:00
6cd4694613 docs(plan): Session G landed, D4's rationale lives where the promise does, and the ninth surface was verified not bumped Kjell Tore Guttormsen 2026-08-13 22:45:11 +02:00
98ebc07b56 release: 1.0.0 -- the exported Python surface is frozen under semver v1.0.0 Kjell Tore Guttormsen 2026-08-13 22:20:48 +02:00
e9d8fb2b9d docs(limits): two limits are conceded for 1.x, and the last 'pending' is retired Kjell Tore Guttormsen 2026-08-13 22:15:02 +02:00
ab6000b1af docs(gate): the surface claim covers okf too, and one branch of D4 is already a defect Kjell Tore Guttormsen 2026-08-13 22:07:18 +02:00
aff35118bf docs(gate): the v1.0 freeze is countable, and two of thirty-five limits are the gate Kjell Tore Guttormsen 2026-08-13 22:02:28 +02:00
2466d260d3 test(redos): the dead row had the wrong payload, and the last wall clock is retired Kjell Tore Guttormsen 2026-08-13 21:47:43 +02:00
c48a2923ac test(redos): one CPU clock for every bound, and a second row measured dead Kjell Tore Guttormsen 2026-08-13 21:25:36 +02:00
566706360a test(output): the ReDoS bounds move to CPU time, and the long-attribute row was dead Kjell Tore Guttormsen 2026-08-13 21:02:31 +02:00
be9759b4b3 docs(census): the two wiki corpora are measured, and the tightening is thinner than zero looked v0.7.0 Kjell Tore Guttormsen 2026-08-13 20:22:18 +02:00
72de0e0c15 docs(claude-md): the linking example published one machine's home directory Kjell Tore Guttormsen 2026-08-13 20:08:12 +02:00
fcfaee4589 feat(active-content): raw HTML graded on carrier, and a tag naming no target is inert Kjell Tore Guttormsen 2026-08-12 00:42:44 +02:00
0df7e87c2f test(docs-scripts): the census re-derived the URL reader it measures, and nothing would have caught the drift Kjell Tore Guttormsen 2026-08-11 23:01:58 +02:00
0903785187 release(0.6.1): the ZWJ fix gets a tag a consumer can pin v0.6.1 Kjell Tore Guttormsen 2026-08-11 22:30:32 +02:00
a59184bb7f fix(zwj): the zero-width check tested identity, so every emoji-composed document was hard-blocked Kjell Tore Guttormsen 2026-08-11 22:14:47 +02:00
1d49f83a61 test(redos): the lexicon-iframe-src row already discriminates at the shared N Kjell Tore Guttormsen 2026-08-11 21:52:04 +02:00
ee73062864 test(redos): the lexicon-script-tag row denied the literal but not the bound Kjell Tore Guttormsen 2026-08-11 21:40:43 +02:00
6bcb898632 release(0.6.0): the raw-html narrowing ships, and the version claims it already made become true v0.6.0 Kjell Tore Guttormsen 2026-08-11 18:01:36 +02:00
736f370cfb fix(active-content): raw-html graded two inert shapes HIGH, and the fix moved a second surface Kjell Tore Guttormsen 2026-08-11 16:56:31 +02:00
e671edb96f measure(rawhtml): the over-reach classes co-occur, so one-at-a-time understates both Kjell Tore Guttormsen 2026-08-11 13:50:29 +02:00
6e87a0ff16 docs(limitations): the raw-html FP rate was blamed on the wrong bullet Kjell Tore Guttormsen 2026-08-11 13:15:14 +02:00
0dce50fb05 docs(plan): the v1.0 gate rested on okf's old pin, and its file list on four surfaces Kjell Tore Guttormsen 2026-08-11 06:46:29 +02:00
f669479777 release(0.5.0): the assessment axis ships, and every version surface moves with it v0.5.0 Kjell Tore Guttormsen 2026-08-11 06:42:56 +02:00
d3d0928c17 docs(changelog,limitations): 0.3.3 named two behaviour-change classes, there were three Kjell Tore Guttormsen 2026-08-10 21:39:10 +02:00
d1bff6047d measure(fp): the upload door costs a human on 16-53% of benign documents Kjell Tore Guttormsen 2026-08-10 21:32:56 +02:00
398eb7407b docs(plan): kill the pointer that sent this session to the wrong section Kjell Tore Guttormsen 2026-08-10 21:01:19 +02:00
de097110d2 feat(disposition): separate the assessment axis from the action Kjell Tore Guttormsen 2026-08-10 20:55:46 +02:00
3c56d50e05 docs(readme,adoption-brief): advertise v0.4.0, now that it installs Kjell Tore Guttormsen 2026-08-10 14:51:11 +02:00
73ad5e1ed8 release(0.4.0): the raise is breaking, so the number says so v0.4.0 Kjell Tore Guttormsen 2026-08-10 14:49:47 +02:00
b90233481a feat(active-content,okf): bound the last two detection surfaces Kjell Tore Guttormsen 2026-08-10 14:48:54 +02:00
0bf07295c2 docs(readme,security,contributing): meet the repo standard — 0 ERROR Kjell Tore Guttormsen 2026-08-03 21:59:07 +02:00
0add3e7e96 docs(readme,limitations): stop advertising a version that was not chosen Kjell Tore Guttormsen 2026-08-02 21:21:21 +02:00
7ee1ed13af docs(changelog): the two consumers are not pinned the same way Kjell Tore Guttormsen 2026-08-02 21:15:07 +02:00
2d98d6809d feat(sanitize,fence,neutralize): reject oversize input instead of half-transforming it Kjell Tore Guttormsen 2026-08-02 21:13:08 +02:00
adf93e47fb release(0.3.4): three quadratic patterns outside the lexicon, two on the input path v0.3.4 Kjell Tore Guttormsen 2026-08-01 20:08:51 +02:00
73fa1b99ae fix(sanitize,okf,active_content): three quadratic patterns, two on the input path Kjell Tore Guttormsen 2026-08-01 20:06:36 +02:00
abbfe5f0fd docs(redos): sweep every regex surface, not just the lexicon Kjell Tore Guttormsen 2026-08-01 19:57:59 +02:00
23475f9ec6 docs(redos): preserve the arm-by-arm sweep that found the 0.3.3 patterns Kjell Tore Guttormsen 2026-07-31 21:55:51 +02:00
701a4a47c7 release(0.3.3): the lexicon ReDoS fix, and a correction to 0.3.2's claim v0.3.3 Kjell Tore Guttormsen 2026-07-31 21:51:00 +02:00
b8028ba870 fix(lexicon): two quadratic patterns, reachable through the output gate too Kjell Tore Guttormsen 2026-07-31 21:50:51 +02:00
75ae48277b release(0.3.2): the ReDoS fix, with both residuals measured against the v0.3.1 tag v0.3.2 Kjell Tore Guttormsen 2026-07-31 21:16:45 +02:00
cff043787d fix(output): 19 quadratic regex runs on the output path, worst ~5.7h at the cap Kjell Tore Guttormsen 2026-07-31 18:31:58 +02:00
8deca93ee1 docs(plan): scope the self-safety claim -- ReDoS duty is the lexicon path, not output Kjell Tore Guttormsen 2026-07-31 17:23:52 +02:00
c0899e9417 docs(limitations): withdraw the "two variables" explanation -- 394 was a scoping artifact Kjell Tore Guttormsen 2026-07-31 17:20:27 +02:00
f74245f01f test(output): the "pathological" DoS payload is not pathological -- bound was 6% over Kjell Tore Guttormsen 2026-07-31 17:18:15 +02:00
e25de560f9 docs(limitations): two variables moved between the 2400 and 2401 counts, not one Kjell Tore Guttormsen 2026-07-31 15:43:34 +02:00
05ee26aec8 docs(limitations): the entropy headroom is 0.099, not 0.36 -- measured in the field Kjell Tore Guttormsen 2026-07-31 15:39:15 +02:00
434b74e766 docs(limitations): close the slugger question -- both consumers read, both whitelists Kjell Tore Guttormsen 2026-07-31 15:35:48 +02:00
910a12455a docs(limitations): correct the percent-escape framing -- slugger class, not language Kjell Tore Guttormsen 2026-07-27 20:20:45 +02:00
f391b2cee3 docs(readme): sync two stale counts to ground truth Kjell Tore Guttormsen 2026-07-27 09:12:15 +02:00
2d5a9cd0c7 docs(okf): the mapping class is inexpressible, and T2 binds import not emission Kjell Tore Guttormsen 2026-07-27 09:11:22 +02:00
684ce3a45f docs(url-shape): make the rule reconstructable, and record what three corpora measured Kjell Tore Guttormsen 2026-07-27 08:56:24 +02:00
956c835d38 docs(limitations): bound two URL-shape false positives with field measurements Kjell Tore Guttormsen 2026-07-25 20:56:14 +02:00
55ce6265d4 docs(plan): state the gate requirement precisely -- fixture set, not tagged artifact Kjell Tore Guttormsen 2026-07-25 20:02:41 +02:00
6b705736cd docs(plan): record two consumer notification promises as release constraints Kjell Tore Guttormsen 2026-07-25 20:00:25 +02:00
d39033676a docs(plan): the v1.0 gate cannot be opened by a green result alone Kjell Tore Guttormsen 2026-07-25 19:57:41 +02:00
10a37d104e docs(plan): retarget the Session G integration gate at v0.3.1 Kjell Tore Guttormsen 2026-07-25 15:45:45 +02:00
207b2c1679 docs(plan): record Session H as landed — 0.3.1 tagged with measurements Kjell Tore Guttormsen 2026-07-25 15:45:14 +02:00
6e9b8168e3 fix(calibration): grade active content on URL shape, not construct type v0.3.1 Kjell Tore Guttormsen 2026-07-25 15:36:02 +02:00
da7421e6c8 docs(plan): scope Session H — 0.3.1 regression fix for active-content calibration Kjell Tore Guttormsen 2026-07-25 15:11:12 +02:00
7025759789 docs(plan): record the revised v1.0 gate and the 0.3.0 cut ahead of Session G Kjell Tore Guttormsen 2026-07-25 12:27:01 +02:00
467b9e3e13 chore(release): 0.3.0 — a gate-loosening change earns a minor, not a patch v0.3.0 Kjell Tore Guttormsen 2026-07-25 12:24:36 +02:00
80f741e9cc docs(changelog): record the three post-v0.2.0 behaviour changes; next cut is 0.3.0 Kjell Tore Guttormsen 2026-07-25 07:15:57 +02:00
99c57629f8 docs(readme): document the real install channel; drop false PyPI claim Kjell Tore Guttormsen 2026-07-25 06:26:25 +02:00
27cd7f3f25 chore(gitignore): ignore *.local.sh (local-only operator scripts) Kjell Tore Guttormsen 2026-07-15 19:47:34 +02:00
3dda1f68fa docs(readme): add concrete 'What it protects against' catalogue; split limitations Kjell Tore Guttormsen 2026-07-15 19:09:04 +02:00
d73cfc882f docs(readme): lead with write-time trust-boundary; feature shipped OKF adapter Kjell Tore Guttormsen 2026-07-15 18:58:21 +02:00
a1f3fe1983 docs(adoption): reusable consumer adoption brief for OKF second-brain repos Kjell Tore Guttormsen 2026-07-15 12:35:09 +02:00
f5eae9a16e test(coverage): runnable threat-coverage matrix (real-case validation gate) Kjell Tore Guttormsen 2026-07-15 11:20:22 +02:00
66f3cbf4f5 docs(pdf): concede .pdf as a deliberate design boundary (Session F1) Kjell Tore Guttormsen 2026-07-15 10:15:39 +02:00
1625f3893b docs: version-sync + SECURITY/CONTRIBUTING + honest-limits (Session E) Kjell Tore Guttormsen 2026-07-15 10:08:24 +02:00
ee402e4ea8 refactor(calibration): consolidate tunable thresholds into calibration.py Kjell Tore Guttormsen 2026-07-15 09:44:53 +02:00
4a9cfd2bbe docs: reframe novelty claim to composite write-time contract (review MAJOR #3) Kjell Tore Guttormsen 2026-07-15 09:22:38 +02:00
f4e89d2885 feat(egress): decode-rescan feeds base64 plaintext to secret-egress (review MINOR) Kjell Tore Guttormsen 2026-07-15 07:11:29 +02:00
0772dafb70 feat(okf): scan reserved index.md/log.md in mode-b import, not path-reject (review MAJOR #2) Kjell Tore Guttormsen 2026-07-15 06:43:50 +02:00
4d53765c63 feat(guard): active-content detector wired into the output gate (review MAJOR #1) Kjell Tore Guttormsen 2026-07-15 06:11:33 +02:00
31166d0af0 docs(readme): drop .xlsx from known gaps (covered in 2h) Kjell Tore Guttormsen 2026-07-07 07:41:00 +02:00
ca26e117ea feat(inbox): .xlsx extraction — formula gate, hidden sheets, cell comments (stage 2h) Kjell Tore Guttormsen 2026-07-07 07:41:00 +02:00
a46a96db0a docs(readme): drop docx-tables/pptx-groups from known gaps (covered in 2g) Kjell Tore Guttormsen 2026-07-07 07:32:38 +02:00
6f32e70c6d feat(inbox): docx table cells + grouped pptx shapes (stage 2g) Kjell Tore Guttormsen 2026-07-07 07:32:10 +02:00
abcdfa3663 docs(readme): honest-limits for the two-stage upload inbox (stage 2f) Kjell Tore Guttormsen 2026-07-06 11:18:07 +02:00
d8a95e465f feat(inbox): .pptx extraction — speaker notes, off-slide box, alt-text (stage 2e) Kjell Tore Guttormsen 2026-07-06 11:16:59 +02:00
26a231d6c4 feat(inbox): .docx extraction — hidden runs, comments, core metadata (stage 2d) Kjell Tore Guttormsen 2026-07-06 11:13:52 +02:00
02d59efeb2 feat(inbox): .csv formula injection + folder walk (stage 2c) Kjell Tore Guttormsen 2026-07-06 11:10:55 +02:00
52aa40b17a feat(inbox): .zip container threats — zip-slip, zip-bomb, symlink (stage 2b) Kjell Tore Guttormsen 2026-07-06 11:07:46 +02:00
24e57ca10b feat(inbox): two-stage upload front-end — text formats (stage 2a) Kjell Tore Guttormsen 2026-07-06 11:04:23 +02:00
0061c42f0b test(okf): OKF inbox showcase — mode-b receive/quarantine gate, end-to-end Kjell Tore Guttormsen 2026-07-06 10:49:01 +02:00
896ab4034a docs(plan): showcase covers realistic upload formats — two-stage extract→guard, dev-scoped parsers, honest binary-layer limits Kjell Tore Guttormsen 2026-07-06 10:18:43 +02:00