open/llm-security-commons
1
0
Fork 0
Code Issues Releases 1 Activity

fix(conformance): name the fixture field pattern_id, not id — the schema already owns that word

Browse source 
schema/finding.schema.json defines a finding `id` as DS-<scanner>-<counter>,
built from a process-global counter: stable across neither runs nor
processes, and the schema says so itself. The corpus keys its comparison on
the lexicon's stable rule identity. Two normative documents in one
repository using one word for both would produce runtimes failing every case
for a reason unrelated to detection.

Also adds spec section 3.1, which publishes the bridge a consumer actually
needs and which neither normative document named: a runtime's own label
reaches a pattern_id through the lexicon's `aliases` object, and a runtime
absent from that object has no published way to be compared -- a mapping
kept privately in a consumer is the drift this repository exists to prevent.

Regenerated all 83 fixtures; re-verified from the corpus alone against both
runtimes, 83 cases, 0 failures.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01WhXDL82FRrQWedEmUg12Pj
This commit is contained in:
Kjell Tore Guttormsen 2026-08-10 04:44:59 +02:00
commit 0ffee85a4b
85 changed files with 146 additions and 98 deletions
Download patch file Download diff file Expand all files Collapse all files

2
conformance/nl-indirection__send-external/expected.json
View file

@ -12,7 +12,7 @@
"match": "exact-within-scope",
"findings": [
{
"id": "nl-indirection:send-external"
"pattern_id": "nl-indirection:send-external"
}
],
"observed_out_of_scope": {}