{ "_meta": { "what": "Rebuilt idx-33b nets + the stage-2 adjudication verdicts, run 2026-08-20 under order 20260818T190638Z-221629388.", "why_tracked": "The 2026-08-13 and 2026-08-18 nets both lived in a scratchpad and were both gone by the next session, so the class had to be re-measured from scratch twice. This file is the third attempt made durable. It is DATA, not a gate: nothing validates it and no test reads it.", "not_reproducible_from_18_08": "Same corpus (283 stamps / 89 files) but this run's subtraction rules and vocabulary differ from 2026-08-18: 42 source-section + 18 link-entry subtractions -> 223 claim passages (18.08 measured 37 + 20 -> 226), and 32 container / 19 limiter (18.08: 16 / 26). Treat 18.08's numbers as unreproducible, not wrong.", "known_positive_control": "Run BEFORE any flag was read. ai-threat-modeling-stride.md:210 -> container (\"across Azure subscriptions\"); digital-accessibility-action-plan.md:160 -> container (\"for K-12 laerere\"). Both PASS. A net that fails this control proves nothing.", "sample_is_not_random": "The 17 stage-2 adjudications were hand-picked toward enumerations and explicit limiters - the stratum where narrowing is even possible. They carry NO rate. 21 of 32 container and 13 of 19 limiter candidates were never taken to a live source and are UNMEASURED, not clean. SUPERSEDED 2026-08-25: that sentence was true when written and is no longer. All 29 genuinely unmeasured candidates (34 without a stage-2 verdict, minus 5 that already had one from the 2026-08-18 round) were taken to live microsoft-learn sources on 2026-08-25 under order 20260825T063639Z-3599226074. See exhausted_2026_08_25 below.", "population_rule": "For each line containing \"Verified MCP\": the passage is that line plus following lines until a blank line, a heading, or the next stamp. A passage is excluded if its nearest preceding heading matches /kilde|source|referanse|reference|further reading|videre lesning/i, or if the stamped line is itself a markdown link list entry.", "exhausted_2026_08_25": "THIS NET IS EXHAUSTED. Every one of the 51 candidates now carries a verdict: 17 adjudicated 2026-08-20 (recorded in stage2 and in idx-33c), 5 adjudicated 2026-08-18, and the remaining 29 adjudicated 2026-08-25 (commit 02b9c2a). Outcomes over those 29: 19 faithful to source, 5 members of the under-claim class governed by form #34 (idx-33l, idx-33m, idx-33n, idx-33o, idx-33p), 4 of another class (idx-33q/idx-33r/idx-33s, one defect in three files, plus idx-33t), 0 not adjudicable, and 1 that is not a claim passage at all. The full batch record - denominator, outcome split, false-positive count and the source-per-passage findings - lives ONCE, in the summary of queue entry idx-33l, and is deliberately not restated here. Do not re-run this net expecting new candidates; a NEW net would need a different vocabulary or a different population rule, not another pass with this one.", "population_rule_decision_2026_08_25": "OPERATOR DECISION 2026-08-25: THE POPULATION RULE STAYS AS WRITTEN. It is a measured leak, not an oversight, and it is recorded here so nobody \"fixes\" it later as an obvious bug. The rule subtracts a passage whose NEAREST preceding heading matches the source-section pattern. When a source section is split by a sub-heading - \"## Kilder og verifisering\" followed by \"### Microsoft Learn (Verified via MCP)\" - the nearest heading is the sub-heading, the pattern does not match, and the passage stays in the population. Five of the 29 candidates adjudicated on 2026-08-25 entered this way: endpoint-health-and-capacity-planning 629 and 633, real-time-streaming-monitoring 547, security-and-audit-logging-ai 408, and data-residency-audit-monitoring 558. FOUR adjudicated faithful-to-source; the fifth became idx-33o, a genuine member of the #34 class. So tightening the rule to test every heading upward has a MEASURED COST as well as a benefit: it would have excluded a real finding, and the 2026-08-25 batch also showed that source-list annotations make repairable claims (idx-33u was raised against one, and the 2026-08-25 session before it repaired another at agent-365 373). The rule is therefore kept deliberately, with the leak understood, rather than tightened on the assumption that a source-section passage cannot carry a defect." }, "counts": { "stamps": 283, "files": 89, "in_source_section": 42, "link_entries": 18, "claim_passages": 223, "buckets": { "container": 32, "none": 170, "limiter": 19, "product-collision": 2 } }, "vocabulary": { "prepositions": [ "across", "within", "in", "inside", "for", "per", "to", "under", "på tvers av", "innenfor", "innen", "i", "for", "til", "per", "hos", "på" ], "containers": [ "subscription", "subscriptions", "abonnement", "tenant", "tenants", "tenanter", "region", "regions", "regioner", "environment", "environments", "miljø", "miljøer", "workspace", "workspaces", "arbeidsområde", "resource group", "ressursgruppe", "management group", "directory", "katalog", "geography", "geografi", "cloud", "clouds", "sky", "skyer", "platform", "platforms", "plattform", "plattformer", "service", "services", "tjeneste", "tjenester", "product", "products", "produkt", "produkter", "license", "licenses", "lisens", "lisenser", "sku", "plan", "plans", "portal", "portaler", "app", "apps", "applikasjon", "channel", "channels", "kanal", "kanaler", "model", "models", "modell", "modeller", "language", "languages", "språk", "role", "roles", "rolle", "roller", "user", "users", "bruker", "brukere", "lærere", "elever", "kunde", "kunder", "market", "markets", "marked", "country", "countries", "land", "datasenter", "data center", "endpoint", "endpoints", "endepunkt", "scenario", "scenarios", "scenarier", "ledelse", "organisasjon" ], "limiters": [ "kun", "bare", "only", "eneste", "utelukkende", "begrenset til", "limited to", "exclusively", "solely", "ikke tilgjengelig for", "ikke støttet i" ] }, "candidates": [ { "file": "skills/ms-ai-advisor/references/architecture/cost-models.md", "stamp_line": 601, "end_line": 603, "bucket": "container", "scope_hits": [ "til kanonisk register. Scenario" ], "limiter_hits": [], "stage2": null }, { "file": "skills/ms-ai-advisor/references/prompt-engineering/error-handling-and-fallback-prompting.md", "stamp_line": 377, "end_line": 385, "bucket": "limiter", "scope_hits": [], "limiter_hits": [ "kun" ], "stage2": null }, { "file": "skills/ms-ai-advisor/references/prompt-engineering/multimodal-prompt-design.md", "stamp_line": 190, "end_line": 198, "bucket": "limiter", "scope_hits": [], "limiter_hits": [ "kun" ], "stage2": null }, { "file": "skills/ms-ai-engineering/references/agent-orchestration/agent-365-governance-and-deployment.md", "stamp_line": 43, "end_line": 43, "bucket": "limiter", "scope_hits": [], "limiter_hits": [ "Kun" ], "stage2": { "stratum": "limiter", "verdict": "member", "entry": "idx-33g", "note": "\"Kun ... E7\" where source says \"based on licensed subscription\" and lists Agent 365 as its own license" } }, { "file": "skills/ms-ai-engineering/references/agent-orchestration/agent-365-governance-and-deployment.md", "stamp_line": 56, "end_line": 61, "bucket": "container", "scope_hits": [ "per tenant" ], "limiter_hits": [ "kun" ], "stage2": { "stratum": "container", "verdict": "not-adjudicable", "note": "source states both \"up to three agents ... in the organization\" and \"three slots ... for each user\"; \"per tenant\" cannot be falsified from it" } }, { "file": "skills/ms-ai-engineering/references/agent-orchestration/agent-365-governance-and-deployment.md", "stamp_line": 62, "end_line": 63, "bucket": "limiter", "scope_hits": [], "limiter_hits": [ "Kun" ], "stage2": { "stratum": "limiter", "verdict": "member", "entry": "idx-33h", "note": "\"Kun Agent Builder\" where source says \"Agent Builder and Copilot Studio agents\"" } }, { "file": "skills/ms-ai-engineering/references/agent-orchestration/agent-365-governance-and-deployment.md", "stamp_line": 215, "end_line": 217, "bucket": "container", "scope_hits": [ "for hele tenant", "i Admin Center for hele tenant" ], "limiter_hits": [ "kun" ], "stage2": null }, { "file": "skills/ms-ai-engineering/references/agent-orchestration/computer-using-agents-cua.md", "stamp_line": 130, "end_line": 130, "bucket": "container", "scope_hits": [ "til eksterne modeller", "for miljø" ], "limiter_hits": [], "stage2": { "stratum": "container", "verdict": "faithful", "note": "faithful to the computer-use page it cites; the second required admin action lives one link deeper on allow-llm-generative-responses" } }, { "file": "skills/ms-ai-engineering/references/data-engineering/microsoft-purview-governance.md", "stamp_line": 248, "end_line": 248, "bucket": "container", "scope_hits": [ "til data products" ], "limiter_hits": [ "kun" ], "stage2": null }, { "file": "skills/ms-ai-engineering/references/mlops-genaiops/genaiops-llm-specific-practices.md", "stamp_line": 210, "end_line": 212, "bucket": "container", "scope_hits": [ "til App Service, Container Apps" ], "limiter_hits": [], "stage2": null }, { "file": "skills/ms-ai-engineering/references/mlops-genaiops/model-versioning-registry-management.md", "stamp_line": 323, "end_line": 328, "bucket": "container", "scope_hits": [ "For production online endpoint", "i AI Builder\n- Eksporter modell", "til Azure ML online endpoint" ], "limiter_hits": [], "stage2": null }, { "file": "skills/ms-ai-engineering/references/mlops-genaiops/responsible-ai-mlops-integration.md", "stamp_line": 65, "end_line": 65, "bucket": "container", "scope_hits": [ "i public preview. Bruker" ], "limiter_hits": [], "stage2": null }, { "file": "skills/ms-ai-governance/references/monitoring-observability/alerting-strategies-escalation.md", "stamp_line": 41, "end_line": 43, "bucket": "container", "scope_hits": [ "under model" ], "limiter_hits": [], "stage2": null }, { "file": "skills/ms-ai-governance/references/monitoring-observability/alerting-strategies-escalation.md", "stamp_line": 84, "end_line": 84, "bucket": "container", "scope_hits": [ "For Automation Runbooks, Logic Apps", "i stedet for service", "til role" ], "limiter_hits": [], "stage2": { "stratum": "container", "verdict": "member-other-class", "entry": "idx-33k", "note": "contradicts source: Azure Function managed identity is Yes, file says No in table (76) and prose (84)" } }, { "file": "skills/ms-ai-governance/references/monitoring-observability/custom-dashboards-ai-operations.md", "stamp_line": 290, "end_line": 294, "bucket": "limiter", "scope_hits": [], "limiter_hits": [ "kun" ], "stage2": null }, { "file": "skills/ms-ai-governance/references/monitoring-observability/data-residency-audit-monitoring.md", "stamp_line": 73, "end_line": 75, "bucket": "limiter", "scope_hits": [], "limiter_hits": [ "kun" ], "stage2": null }, { "file": "skills/ms-ai-governance/references/monitoring-observability/data-residency-audit-monitoring.md", "stamp_line": 530, "end_line": 530, "bucket": "container", "scope_hits": [ "for nye tenants" ], "limiter_hits": [ "kun" ], "stage2": null }, { "file": "skills/ms-ai-governance/references/monitoring-observability/data-residency-audit-monitoring.md", "stamp_line": 558, "end_line": 558, "bucket": "container", "scope_hits": [ "for EU, Microsoft 365 services" ], "limiter_hits": [], "stage2": null }, { "file": "skills/ms-ai-governance/references/monitoring-observability/distributed-tracing-ai-pipelines.md", "stamp_line": 171, "end_line": 175, "bucket": "limiter", "scope_hits": [], "limiter_hits": [ "kun", "kun" ], "stage2": null }, { "file": "skills/ms-ai-governance/references/monitoring-observability/endpoint-health-and-capacity-planning.md", "stamp_line": 629, "end_line": 629, "bucket": "limiter", "scope_hits": [], "limiter_hits": [ "kun" ], "stage2": null }, { "file": "skills/ms-ai-governance/references/monitoring-observability/endpoint-health-and-capacity-planning.md", "stamp_line": 633, "end_line": 633, "bucket": "container", "scope_hits": [ "for custom endpoints" ], "limiter_hits": [], "stage2": null }, { "file": "skills/ms-ai-governance/references/monitoring-observability/real-time-streaming-monitoring.md", "stamp_line": 547, "end_line": 547, "bucket": "container", "scope_hits": [ "in Foundry Models" ], "limiter_hits": [], "stage2": null }, { "file": "skills/ms-ai-governance/references/monitoring-observability/security-and-audit-logging-ai.md", "stamp_line": 408, "end_line": 408, "bucket": "container", "scope_hits": [ "for Defender for Cloud" ], "limiter_hits": [], "stage2": null }, { "file": "skills/ms-ai-governance/references/monitoring-observability/sla-monitoring-ai-services.md", "stamp_line": 177, "end_line": 179, "bucket": "container", "scope_hits": [ "for Azure Service", "i samme workspace" ], "limiter_hits": [], "stage2": null }, { "file": "skills/ms-ai-governance/references/norwegian-public-sector-governance/digital-accessibility-action-plan.md", "stamp_line": 160, "end_line": 165, "bucket": "container", "scope_hits": [ "to create an inclusive learning environment", "for K-12 lærere", "for brukere" ], "limiter_hits": [], "stage2": null }, { "file": "skills/ms-ai-governance/references/norwegian-public-sector-governance/norge-ai-strategy-government.md", "stamp_line": 147, "end_line": 154, "bucket": "container", "scope_hits": [ "i Defender for Cloud" ], "limiter_hits": [], "stage2": null }, { "file": "skills/ms-ai-governance/references/responsible-ai/algorithmic-accountability-auditability.md", "stamp_line": 76, "end_line": 76, "bucket": "container", "scope_hits": [ "i Defender for Cloud Apps" ], "limiter_hits": [], "stage2": null }, { "file": "skills/ms-ai-governance/references/responsible-ai/continuous-improvement-feedback-loops.md", "stamp_line": 46, "end_line": 56, "bucket": "container", "scope_hits": [ "for å knytte bruker" ], "limiter_hits": [], "stage2": null }, { "file": "skills/ms-ai-security/references/ai-security-engineering/ai-incident-response-procedures.md", "stamp_line": 46, "end_line": 50, "bucket": "container", "scope_hits": [ "for AI Services", "for deteksjon av anomalous model" ], "limiter_hits": [], "stage2": null }, { "file": "skills/ms-ai-security/references/ai-security-engineering/ai-prompt-shield-network.md", "stamp_line": 237, "end_line": 237, "bucket": "container", "scope_hits": [ "for å styre modeller" ], "limiter_hits": [], "stage2": { "stratum": "container", "verdict": "member", "entry": "idx-33j", "note": "names 2 of the source's 3 top-level endpoint categories; \"Self-hosted models and endpoints\" dropped" } }, { "file": "skills/ms-ai-security/references/ai-security-engineering/ai-prompt-shield-network.md", "stamp_line": 254, "end_line": 265, "bucket": "limiter", "scope_hits": [], "limiter_hits": [ "bare" ], "stage2": null }, { "file": "skills/ms-ai-security/references/ai-security-engineering/ai-prompt-shield-network.md", "stamp_line": 304, "end_line": 304, "bucket": "limiter", "scope_hits": [], "limiter_hits": [ "Kun" ], "stage2": { "stratum": "limiter", "verdict": "member", "entry": "idx-33i", "note": "\"Kun engelsk\" where source names eight trained-and-tested languages" } }, { "file": "skills/ms-ai-security/references/ai-security-engineering/ai-threat-modeling-stride.md", "stamp_line": 210, "end_line": 213, "bucket": "container", "scope_hits": [ "across Azure subscriptions" ], "limiter_hits": [], "stage2": null }, { "file": "skills/ms-ai-security/references/ai-security-engineering/data-leakage-prevention-ai.md", "stamp_line": 47, "end_line": 47, "bucket": "limiter", "scope_hits": [], "limiter_hits": [ "kun" ], "stage2": { "stratum": "limiter", "verdict": "faithful", "note": "\"kun avsender-metadata evalueres\" is the source's own sentence" } }, { "file": "skills/ms-ai-security/references/ai-security-engineering/data-leakage-prevention-ai.md", "stamp_line": 69, "end_line": 73, "bucket": "limiter", "scope_hits": [], "limiter_hits": [ "kun" ], "stage2": { "stratum": "limiter", "verdict": "faithful", "note": "\"only available in the Custom policy template\" verbatim" } }, { "file": "skills/ms-ai-security/references/ai-security-engineering/data-leakage-prevention-ai.md", "stamp_line": 79, "end_line": 79, "bucket": "limiter", "scope_hits": [], "limiter_hits": [ "kun" ], "stage2": { "stratum": "limiter", "verdict": "faithful", "note": "\"DLP only checks the text you type into the prompt itself\" verbatim" } }, { "file": "skills/ms-ai-security/references/ai-security-engineering/data-leakage-prevention-ai.md", "stamp_line": 131, "end_line": 135, "bucket": "container", "scope_hits": [ "for Business\n- Labels med bruker" ], "limiter_hits": [ "Kun", "kun" ], "stage2": { "stratum": "container", "verdict": "member", "entry": "idx-33f", "note": "reproduces one of the source's two supported-file-type lists, drops the other plus MP4" } }, { "file": "skills/ms-ai-security/references/ai-security-engineering/entra-agent-id-zero-trust.md", "stamp_line": 136, "end_line": 136, "bucket": "container", "scope_hits": [ "for menneskelige brukere" ], "limiter_hits": [], "stage2": { "stratum": "container", "verdict": "faithful", "note": "paraphrase supported by conditional-access/agent-id and howto-target-agent-identities" } }, { "file": "skills/ms-ai-security/references/ai-security-engineering/entra-agent-id-zero-trust.md", "stamp_line": 138, "end_line": 138, "bucket": "container", "scope_hits": [ "per bruker" ], "limiter_hits": [], "stage2": { "stratum": "container", "verdict": "faithful", "note": "near-verbatim against conditional-access/agent-id" } }, { "file": "skills/ms-ai-security/references/ai-security-engineering/entra-agent-id-zero-trust.md", "stamp_line": 305, "end_line": 305, "bucket": "container", "scope_hits": [ "for hver Power Platform-connector agenten bruker" ], "limiter_hits": [ "kun" ], "stage2": null }, { "file": "skills/ms-ai-security/references/ai-security-engineering/entra-agent-id-zero-trust.md", "stamp_line": 454, "end_line": 454, "bucket": "container", "scope_hits": [ "per bruker" ], "limiter_hits": [], "stage2": { "stratum": "container", "verdict": "faithful", "note": "near-verbatim; duplicate of the 138 claim in the same file" } }, { "file": "skills/ms-ai-security/references/ai-security-engineering/jailbreak-prevention-production.md", "stamp_line": 351, "end_line": 357, "bucket": "limiter", "scope_hits": [], "limiter_hits": [ "kun" ], "stage2": null }, { "file": "skills/ms-ai-security/references/ai-security-engineering/pii-detection-norwegian-context.md", "stamp_line": 212, "end_line": 212, "bucket": "container", "scope_hits": [ "For opprettelse av Language" ], "limiter_hits": [], "stage2": null }, { "file": "skills/ms-ai-security/references/ai-security-engineering/security-copilot-integration.md", "stamp_line": 104, "end_line": 106, "bucket": "limiter", "scope_hits": [], "limiter_hits": [ "kun" ], "stage2": null }, { "file": "skills/ms-ai-security/references/ai-security-engineering/security-copilot-integration.md", "stamp_line": 122, "end_line": 122, "bucket": "container", "scope_hits": [ "på tvers av alle brukere" ], "limiter_hits": [], "stage2": { "stratum": "container", "verdict": "faithful", "note": "abbreviation of a six-property bullet list; the two dropped properties (default workspace, UI cost values informational only) are not scope-bearing" } }, { "file": "skills/ms-ai-security/references/ai-security-engineering/security-copilot-integration.md", "stamp_line": 124, "end_line": 128, "bucket": "container", "scope_hits": [ "for M365 E5-kunder som også bruker" ], "limiter_hits": [], "stage2": { "stratum": "container", "verdict": "member", "entry": "idx-33e", "note": "E5 where source says E5 and E7; file carries E7 at 112/114/452 from the same source" } }, { "file": "skills/ms-ai-security/references/ai-security-engineering/security-copilot-integration.md", "stamp_line": 262, "end_line": 267, "bucket": "limiter", "scope_hits": [], "limiter_hits": [ "begrenset til" ], "stage2": null }, { "file": "skills/ms-ai-security/references/ai-security-engineering/zero-trust-ai-services.md", "stamp_line": 130, "end_line": 130, "bucket": "container", "scope_hits": [ "for Azure AI Services" ], "limiter_hits": [], "stage2": { "stratum": "container", "verdict": "flagged-not-adjudicated", "note": "\"Bruk alltid DefaultAzureCredential\" sits against Microsoft best practice to move from DefaultAzureCredential to ManagedIdentityCredential in production; the page this passage rests on was not established" } }, { "file": "skills/ms-ai-security/references/cost-optimization/observability-cost-reduction.md", "stamp_line": 193, "end_line": 193, "bucket": "limiter", "scope_hits": [], "limiter_hits": [ "kun" ], "stage2": null }, { "file": "skills/ms-ai-security/references/cost-optimization/observability-cost-reduction.md", "stamp_line": 194, "end_line": 194, "bucket": "limiter", "scope_hits": [], "limiter_hits": [ "Kun" ], "stage2": null }, { "file": "skills/ms-ai-security/references/cost-optimization/rag-query-cost-reduction.md", "stamp_line": 161, "end_line": 161, "bucket": "limiter", "scope_hits": [], "limiter_hits": [ "kun" ], "stage2": null } ] }