chore(ms-ai-architect): refresh KB high-bucket — 49 files [skip-docs]

KB-currency refresh (high priority, 2026-06-19) via /architect:kb-update.
49 high-prioritets governance/security/monitoring-filer re-verifisert mot
Microsoft Learn (MCP) — delegert til 8 parallelle Opus-subagenter gruppert
etter delt kilde, verifisert i hovedkontekst (diff-review + tester).

Hovedendringer (faktuelle korreksjoner + currency):
- MITRE ATLAS-IDer korrigert (supply-chain): AML.T0050 -> AML.T0018.000
  (Poison AI Model); AML.T0020 = Poison Training Data; T1195 Supply Chain
  Compromise. Gamle IDer var utdaterte (verifisert mot MCSB v2 AI-1).
- OTel-sampling presisert (distributed-tracing): adaptive sampling = klassisk
  App Insights SDK; OTel-distroen sampler IKKE by default (fixed-rate/
  rate-limited maa konfigureres); Functions parent-based sampling er default.
- MCSB v2 AI-kontroller AI-1 -> AI-7 (risk-taxonomy three-pillar, scoring-
  framework, rubrics, red-team, adversarial); Defender for Cloud AI threat
  protection + AI-SPM (GA).
- AI gateway (APIM) multi-provider: Anthropic Messages API v2-tiers, Google
  Vertex, unified model API (preview), MCP/A2A, Foundry-integrasjon; eksakte
  policy-navn (llm-emit-token-metric maks 5 dims, llm-semantic-cache-*,
  score-threshold = avstand, MS-eks. 0.15).
- Purview Enterprise AI apps inkl. Anthropic Claude (Enterprise) + ChatGPT
  Enterprise; Security Dashboard for AI (Agent 365-inventar, MCP-servere,
  tredjepartsmodeller; Security Reader minimumsrolle).
- Entra Agent ID: CA-lisenskrav (Entra ID P1/P2 + Agent 365), CA-scoping per
  tilgangsmoenster (on-behalf-of/app-only/agent-as-user), CA-grenser,
  connector-permissions som API-permissions.
- Copilot DLP: Block SITs in web search (GA, Performing Web Searches) + Block
  external email (preview) som prompt injection-vern.
- Azure AI Language PII: tre feature-typer, GA-API 2026-05-01; NOIdentityNumber
  bekreftet dedikert kategori for norske foedselsnummer.
- Foundry Tools-rename forsterket paa tvers; alle 49 Last updated -> 2026-06-19.

Discovery: 500 kandidater (alle Databricks-stoey) -> kun registry-kandidater,
ingen nye skills/-filer -> 389-telling uendret. validate 239 PASS,
kb-integrity 115/115 (262 orphan-warnings uendret), gitleaks clean.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01REiKFhP4w6xGXXqWKpPCJJ
This commit is contained in:
Kjell Tore Guttormsen 2026-06-19 11:09:54 +02:00
commit 25bcb74d9a
49 changed files with 304 additions and 235 deletions

View file

@ -1,6 +1,6 @@
# Continuous Improvement and Feedback Loops - Iterative Governance
**Last updated:** 2026-04
**Last updated:** 2026-06-19
**Status:** GA
**Category:** Responsible AI & Governance
@ -323,13 +323,15 @@ response = client.chat.completions.create(
### Azure Machine Learning
**Model monitoring for GenAI:**
**Model monitoring for GenAI (public preview):**
- **Data collection**: Model Data Collector for production data
- **Evaluation metrics**: Groundedness, coherence, fluency, relevance, similarity (interoperable med Prompt Flow)
- **Evaluation metrics**: Groundedness, coherence, fluency, relevance, similarity (interoperable med Prompt Flow evaluation metrics)
- **Recurring monitoring**: Configurable cadence (daily, weekly, etc.)
- **Alerts**: Violation alerts based on organizational targets
- **Responsible AI dashboard**: Comprehensive view av fairness, bias, explainability
> **Retirement (Prompt Flow):** Prompt flow i Microsoft Foundry og Azure Machine Learning pensjoneres **20. april 2027** og anbefales ikke for ny utvikling. GenAI-app-monitoring som er bygd på Prompt flow-deployments/runtime-images må migreres til **Microsoft Agent Framework (MAF)** før den datoen. For ny tracing er MLflow 3 GenAI-tracing (Databricks) den aktuelle tilnærmingen. *(Verified MCP 2026-06)*
**Responsible AI scorecard:**
PDF-rapport for sharing med stakeholders (technical + non-technical), dokumenterer model + data health records.
@ -554,9 +556,9 @@ Models, prompts, eval datasets, scorers – full reproducibility er non-negotiab
- URL: https://learn.microsoft.com/en-us/compliance/assurance/assurance-artificial-intelligence
- Key content: Govern, Map, Measure, Manage phases; continuous learning
8. **Azure Machine Learning Model Monitoring for GenAI**
8. **Azure Machine Learning Model Monitoring for GenAI (public preview)**
- URL: https://learn.microsoft.com/en-us/azure/machine-learning/prompt-flow/how-to-monitor-generative-ai-applications?view=azureml-api-2
- Key content: Automated evaluation metrics, alerts, Responsible AI dashboard
- Key content: Automated evaluation metrics, alerts, Responsible AI dashboard. NB: Prompt flow pensjoneres 20.04.2027 → migrer til Microsoft Agent Framework.
9. **Human-in-the-Loop Security Guidance**
- URL: https://learn.microsoft.com/en-us/security/benchmark/azure/mcsb-v2-artificial-intelligence-security#ai-5-ensure-human-in-the-loop
@ -583,3 +585,4 @@ Models, prompts, eval datasets, scorers – full reproducibility er non-negotiab
**Total MCP calls:** 6 (3 searches + 2 fetches + 1 code sample search)
**Unique sources:** 12 verified Microsoft Learn URLs
**Confidence level:** 95% Verified (core concepts + implementation details), 5% Baseline (cost estimates, Norwegian public sector specifics)
**Last verified:** 2026-06-19