chore(ms-ai-architect): refresh KB high-bucket — 49 files [skip-docs]
KB-currency refresh (high priority, 2026-06-19) via /architect:kb-update. 49 high-prioritets governance/security/monitoring-filer re-verifisert mot Microsoft Learn (MCP) — delegert til 8 parallelle Opus-subagenter gruppert etter delt kilde, verifisert i hovedkontekst (diff-review + tester). Hovedendringer (faktuelle korreksjoner + currency): - MITRE ATLAS-IDer korrigert (supply-chain): AML.T0050 -> AML.T0018.000 (Poison AI Model); AML.T0020 = Poison Training Data; T1195 Supply Chain Compromise. Gamle IDer var utdaterte (verifisert mot MCSB v2 AI-1). - OTel-sampling presisert (distributed-tracing): adaptive sampling = klassisk App Insights SDK; OTel-distroen sampler IKKE by default (fixed-rate/ rate-limited maa konfigureres); Functions parent-based sampling er default. - MCSB v2 AI-kontroller AI-1 -> AI-7 (risk-taxonomy three-pillar, scoring- framework, rubrics, red-team, adversarial); Defender for Cloud AI threat protection + AI-SPM (GA). - AI gateway (APIM) multi-provider: Anthropic Messages API v2-tiers, Google Vertex, unified model API (preview), MCP/A2A, Foundry-integrasjon; eksakte policy-navn (llm-emit-token-metric maks 5 dims, llm-semantic-cache-*, score-threshold = avstand, MS-eks. 0.15). - Purview Enterprise AI apps inkl. Anthropic Claude (Enterprise) + ChatGPT Enterprise; Security Dashboard for AI (Agent 365-inventar, MCP-servere, tredjepartsmodeller; Security Reader minimumsrolle). - Entra Agent ID: CA-lisenskrav (Entra ID P1/P2 + Agent 365), CA-scoping per tilgangsmoenster (on-behalf-of/app-only/agent-as-user), CA-grenser, connector-permissions som API-permissions. - Copilot DLP: Block SITs in web search (GA, Performing Web Searches) + Block external email (preview) som prompt injection-vern. - Azure AI Language PII: tre feature-typer, GA-API 2026-05-01; NOIdentityNumber bekreftet dedikert kategori for norske foedselsnummer. - Foundry Tools-rename forsterket paa tvers; alle 49 Last updated -> 2026-06-19. Discovery: 500 kandidater (alle Databricks-stoey) -> kun registry-kandidater, ingen nye skills/-filer -> 389-telling uendret. validate 239 PASS, kb-integrity 115/115 (262 orphan-warnings uendret), gitleaks clean. Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01REiKFhP4w6xGXXqWKpPCJJ
This commit is contained in:
parent
41b390b38d
commit
25bcb74d9a
49 changed files with 304 additions and 235 deletions
|
|
@ -1,6 +1,6 @@
|
|||
# Continuous Improvement and Feedback Loops - Iterative Governance
|
||||
|
||||
**Last updated:** 2026-04
|
||||
**Last updated:** 2026-06-19
|
||||
**Status:** GA
|
||||
**Category:** Responsible AI & Governance
|
||||
|
||||
|
|
@ -323,13 +323,15 @@ response = client.chat.completions.create(
|
|||
|
||||
### Azure Machine Learning
|
||||
|
||||
**Model monitoring for GenAI:**
|
||||
**Model monitoring for GenAI (public preview):**
|
||||
- **Data collection**: Model Data Collector for production data
|
||||
- **Evaluation metrics**: Groundedness, coherence, fluency, relevance, similarity (interoperable med Prompt Flow)
|
||||
- **Evaluation metrics**: Groundedness, coherence, fluency, relevance, similarity (interoperable med Prompt Flow evaluation metrics)
|
||||
- **Recurring monitoring**: Configurable cadence (daily, weekly, etc.)
|
||||
- **Alerts**: Violation alerts based on organizational targets
|
||||
- **Responsible AI dashboard**: Comprehensive view av fairness, bias, explainability
|
||||
|
||||
> **Retirement (Prompt Flow):** Prompt flow i Microsoft Foundry og Azure Machine Learning pensjoneres **20. april 2027** og anbefales ikke for ny utvikling. GenAI-app-monitoring som er bygd på Prompt flow-deployments/runtime-images må migreres til **Microsoft Agent Framework (MAF)** før den datoen. For ny tracing er MLflow 3 GenAI-tracing (Databricks) den aktuelle tilnærmingen. *(Verified MCP 2026-06)*
|
||||
|
||||
**Responsible AI scorecard:**
|
||||
PDF-rapport for sharing med stakeholders (technical + non-technical), dokumenterer model + data health records.
|
||||
|
||||
|
|
@ -554,9 +556,9 @@ Models, prompts, eval datasets, scorers – full reproducibility er non-negotiab
|
|||
- URL: https://learn.microsoft.com/en-us/compliance/assurance/assurance-artificial-intelligence
|
||||
- Key content: Govern, Map, Measure, Manage phases; continuous learning
|
||||
|
||||
8. **Azure Machine Learning Model Monitoring for GenAI**
|
||||
8. **Azure Machine Learning Model Monitoring for GenAI (public preview)**
|
||||
- URL: https://learn.microsoft.com/en-us/azure/machine-learning/prompt-flow/how-to-monitor-generative-ai-applications?view=azureml-api-2
|
||||
- Key content: Automated evaluation metrics, alerts, Responsible AI dashboard
|
||||
- Key content: Automated evaluation metrics, alerts, Responsible AI dashboard. NB: Prompt flow pensjoneres 20.04.2027 → migrer til Microsoft Agent Framework.
|
||||
|
||||
9. **Human-in-the-Loop Security Guidance**
|
||||
- URL: https://learn.microsoft.com/en-us/security/benchmark/azure/mcsb-v2-artificial-intelligence-security#ai-5-ensure-human-in-the-loop
|
||||
|
|
@ -583,3 +585,4 @@ Models, prompts, eval datasets, scorers – full reproducibility er non-negotiab
|
|||
**Total MCP calls:** 6 (3 searches + 2 fetches + 1 code sample search)
|
||||
**Unique sources:** 12 verified Microsoft Learn URLs
|
||||
**Confidence level:** 95% Verified (core concepts + implementation details), 5% Baseline (cost estimates, Norwegian public sector specifics)
|
||||
**Last verified:** 2026-06-19
|
||||
|
|
|
|||
Loading…
Add table
Add a link
Reference in a new issue