llm-ingestion-pipeline-security

open/llm-ingestion-pipeline-security

Fork 0

Commit graph

a1f3fe1983 docs(adoption): reusable consumer adoption brief for OKF second-brain repos main Kjell Tore Guttormsen 2026-07-15 12:35:09 +02:00
f5eae9a16e test(coverage): runnable threat-coverage matrix (real-case validation gate) Kjell Tore Guttormsen 2026-07-15 11:20:22 +02:00
66f3cbf4f5 docs(pdf): concede .pdf as a deliberate design boundary (Session F1) Kjell Tore Guttormsen 2026-07-15 10:15:39 +02:00
1625f3893b docs: version-sync + SECURITY/CONTRIBUTING + honest-limits (Session E) Kjell Tore Guttormsen 2026-07-15 10:08:24 +02:00
ee402e4ea8 refactor(calibration): consolidate tunable thresholds into calibration.py Kjell Tore Guttormsen 2026-07-15 09:44:53 +02:00
4a9cfd2bbe docs: reframe novelty claim to composite write-time contract (review MAJOR #3) Kjell Tore Guttormsen 2026-07-15 09:22:38 +02:00
f4e89d2885 feat(egress): decode-rescan feeds base64 plaintext to secret-egress (review MINOR) Kjell Tore Guttormsen 2026-07-15 07:11:29 +02:00
0772dafb70 feat(okf): scan reserved index.md/log.md in mode-b import, not path-reject (review MAJOR #2) Kjell Tore Guttormsen 2026-07-15 06:43:50 +02:00
4d53765c63 feat(guard): active-content detector wired into the output gate (review MAJOR #1) Kjell Tore Guttormsen 2026-07-15 06:11:33 +02:00
31166d0af0 docs(readme): drop .xlsx from known gaps (covered in 2h) Kjell Tore Guttormsen 2026-07-07 07:41:00 +02:00
ca26e117ea feat(inbox): .xlsx extraction — formula gate, hidden sheets, cell comments (stage 2h) Kjell Tore Guttormsen 2026-07-07 07:41:00 +02:00
a46a96db0a docs(readme): drop docx-tables/pptx-groups from known gaps (covered in 2g) Kjell Tore Guttormsen 2026-07-07 07:32:38 +02:00
6f32e70c6d feat(inbox): docx table cells + grouped pptx shapes (stage 2g) Kjell Tore Guttormsen 2026-07-07 07:32:10 +02:00
abcdfa3663 docs(readme): honest-limits for the two-stage upload inbox (stage 2f) Kjell Tore Guttormsen 2026-07-06 11:18:07 +02:00
d8a95e465f feat(inbox): .pptx extraction — speaker notes, off-slide box, alt-text (stage 2e) Kjell Tore Guttormsen 2026-07-06 11:16:59 +02:00
26a231d6c4 feat(inbox): .docx extraction — hidden runs, comments, core metadata (stage 2d) Kjell Tore Guttormsen 2026-07-06 11:13:52 +02:00
02d59efeb2 feat(inbox): .csv formula injection + folder walk (stage 2c) Kjell Tore Guttormsen 2026-07-06 11:10:55 +02:00
52aa40b17a feat(inbox): .zip container threats — zip-slip, zip-bomb, symlink (stage 2b) Kjell Tore Guttormsen 2026-07-06 11:07:46 +02:00
24e57ca10b feat(inbox): two-stage upload front-end — text formats (stage 2a) Kjell Tore Guttormsen 2026-07-06 11:04:23 +02:00
0061c42f0b test(okf): OKF inbox showcase — mode-b receive/quarantine gate, end-to-end Kjell Tore Guttormsen 2026-07-06 10:49:01 +02:00
896ab4034a docs(plan): showcase covers realistic upload formats — two-stage extract→guard, dev-scoped parsers, honest binary-layer limits Kjell Tore Guttormsen 2026-07-06 10:18:43 +02:00
ba7fc68c05 docs(plan): re-sequence v0.2+ streams — defer consumer integration, add OKF inbox showcase as next build Kjell Tore Guttormsen 2026-07-06 10:12:50 +02:00
542ac92349 release: v0.2.0 — OKF adapter (stream 1); version sync pyproject/__version__/badge/CHANGELOG v0.2.0 Kjell Tore Guttormsen 2026-07-06 09:45:53 +02:00
07e0b2153a feat(okf): wire adapter into public API — import_bundle carries link graph, package exposes okf namespace (TDD, +2) Kjell Tore Guttormsen 2026-07-06 09:44:41 +02:00
b80c896fd9 docs(changelog): release v0.1.0 + Unreleased OKF adapter (stream 1); test badge 214->275 Kjell Tore Guttormsen 2026-07-06 09:37:38 +02:00
30aa0a42a1 feat(okf): in-import cross-link graph — extract/resolve/reject links, dangling-link signal (T5a/A, TDD, +10) Kjell Tore Guttormsen 2026-07-06 09:35:59 +02:00
320a40244f feat(okf): bundle-import iterator (mode b) — per-concept validate+stamp, aggregate disposition, log.md (T7, TDD, +8) Kjell Tore Guttormsen 2026-07-06 09:32:50 +02:00
eac3c91b89 feat(okf): provenance stamping — origin/channel -> trust/disposition per concept, log.md entries (T6, TDD, +5) Kjell Tore Guttormsen 2026-07-06 07:53:14 +02:00
f9a89938b4 feat(okf): resource-URL https allowlist reject-gate (T3, TDD, +10) Kjell Tore Guttormsen 2026-07-06 07:43:37 +02:00
ec121f3259 feat(okf): path/reserved-name validation gate — traversal + index.md/log.md shadow (T4, TDD, +10) Kjell Tore Guttormsen 2026-07-06 07:40:56 +02:00
f8bc5db547 feat(okf): whole-concept scan surface — frontmatter values + resource + body (T1, TDD, +6) Kjell Tore Guttormsen 2026-07-06 07:39:18 +02:00
22e65dcec5 feat(okf): strict reject-by-default frontmatter parser (T2, TDD, +12) Kjell Tore Guttormsen 2026-07-06 07:36:14 +02:00
525eb194f5 docs(readme): surface OKF residual risks §7.2 dormant-link + §7.4 own-security-content (T8) Kjell Tore Guttormsen 2026-07-06 07:32:20 +02:00
43368e9684 docs(plan): lock v0.2+ stream sequencing (OKF->consumers->Node) + dependency rationale Kjell Tore Guttormsen 2026-07-06 07:30:09 +02:00
df30c7bcce docs(readme): correct test badge 201->214 before v0.1.0 tag v0.1.0 Kjell Tore Guttormsen 2026-07-06 07:12:52 +02:00
5cd9b451fb docs(okf): capture OKF-ingestion security brief as v0.2 future work Kjell Tore Guttormsen 2026-07-06 07:05:45 +02:00
5397ba15a1 fix(security): harden 5 adversarial-review findings (M1/M2/M3 + m4/m6) via TDD Kjell Tore Guttormsen 2026-07-05 10:45:05 +02:00
86726ed109 docs(readme): add house-style shields.io badges (version/status/python/tests/license) Kjell Tore Guttormsen 2026-07-05 07:05:16 +02:00
a44cf3c7b7 test(showcase): end-to-end multi-vuln pipeline + adversarial/FP corpora (recall) Kjell Tore Guttormsen 2026-07-04 23:34:51 +02:00
0af8f68cae feat(wiring): §6 bookends (prepare_input/screen_output) + full public API + README v0.1 (TDD) Kjell Tore Guttormsen 2026-07-04 23:34:28 +02:00
1e63643157 feat(grounding): SourceGroundingCheck protocol + pass-through default — the semantic-poisoning seam (TDD) [skip-docs] Kjell Tore Guttormsen 2026-07-04 22:44:41 +02:00
9b75bf0bb7 feat(contract): tool-less + credential-allowlist + env-scoping quarantine asserters (TDD) [skip-docs] Kjell Tore Guttormsen 2026-07-04 20:44:20 +02:00
409b847c42 feat(disposition): source-trust + provenance gate — WARN|QUARANTINE|FAIL_SECURE, compound + fail-closed (TDD) [skip-docs] Kjell Tore Guttormsen 2026-07-04 20:34:32 +02:00
19981623f5 feat(output): report-only OUTPUT gate — compose + secret egress (TDD) [skip-docs] Kjell Tore Guttormsen 2026-07-04 20:18:46 +02:00
78c9f2f7f1 feat(neutralize): opt-in pure defang of active-content output (TDD) [skip-docs] Kjell Tore Guttormsen 2026-07-04 18:55:12 +02:00
5fb7e0c9fa feat(fence): randomized unspoofable delimiter + attacker marker-strip (TDD) [skip-docs] Kjell Tore Guttormsen 2026-07-04 18:23:35 +02:00
a55404460a docs(plan): add end-to-end showcase pipeline test as the final deliverable Kjell Tore Guttormsen 2026-07-04 17:23:17 +02:00
f397cd94e1 feat(lexicon): JSON injection lexicon + variant-set scan (TDD) [skip-docs] Kjell Tore Guttormsen 2026-07-04 17:20:21 +02:00
e5e91df369 feat(entropy): high-entropy/encoded-blob detection with decode-and-rescan (TDD) Kjell Tore Guttormsen 2026-07-04 09:43:24 +02:00
a9c4ccd8c7 feat: scaffold package + report and sanitize modules (TDD) Kjell Tore Guttormsen 2026-07-04 09:24:20 +02:00
39991bd251 chore: repo scaffolding via /repo-init Kjell Tore Guttormsen 2026-07-04 08:39:23 +02:00
d983aa3c95 docs(brief): fold in ms-ai-architect Layer B learnings (first output-side impl) Kjell Tore Guttormsen 2026-07-04 08:32:38 +02:00
41473d9db2 docs(brief): add MS AI Security plugin as second consumer; source-trust disposition Kjell Tore Guttormsen 2026-07-04 06:26:55 +02:00
b505f70485 docs: design brief for reusable LLM ingestion-pipeline security library Kjell Tore Guttormsen 2026-07-04 06:18:32 +02:00