open/ms-ai-architect
1
0
Fork 0
Code Issues Releases 4 Activity

fix(ms-ai-architect): Foundry URL-navnerom-migrering (ai-foundry → foundry/foundry-classic, 141 filer)

Browse source 
Task #5 del 1/3 (URL-migrering). Verifiseringen motbeviste STATE.md-premisset om ren prefix-swap: rebrand er per-URL, ikke mekanisk. En blind sed ai-foundry→foundry ville lagd 56 nye 404-er (classic-stiene finnes ikke under nytt foundry/-prefiks — bekreftet empirisk).

Metode: resolverte alle 237 unike KB-URLer mot live redirects (curl -L), bygde full-URL→full-URL-mapping fra faktisk url_effective. Bevarer locale-form, query (?view=) og #fragment per lenke.

- 231 navnerom-erstatninger over 141 filer (408 forekomster):
  - 161 → azure/foundry/ (98 ren prefix-swap + 10 sti-reorg + reorg-tilfeller)
  - 69 → azure/foundry-classic/ (eldre hub-spor: assistants, hub-DR, on-your-data; faktisk redirect-mål per operatorvalg)
  - 1 → azure/foundry-local/

- 2 døde lenker (404) fikset til verifiserte mål:
  - agent-service → azure/foundry/agents/overview
  - concepts/evaluation-evaluators/ → azure/foundry/how-to/evaluate-generative-ai-app

- 5 path-/display-referanser (uten https://, i backticks/lenketekst) rettet manuelt.

- 6 slug-baserte ai-foundry-treff urørt (scope-grense): managed-grafana-dashboard, security-baseline, power-platform prompt-builder, architecture baseline-chat (sistnevnte slug-rebrand i annet navnerom — mulig fremtidig funn).

- Parkert til task #5 del 2/3: Norway East GPT-5-datasuverenitet-fiks + modellkatalog-utvidelse (5.3/5.4/5.5, gpt-oss, sora-2).

Verifisert: 0 gjenværende azure/ai-foundry/-navnerom i skills/. validate-plugin.sh 219 PASS. test-kb-integrity.sh 117/117 passed.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>

Claude-Session: https://claude.ai/code/session_01REiKFhP4w6xGXXqWKpPCJJ
This commit is contained in:
Kjell Tore Guttormsen 2026-06-18 13:37:06 +02:00
commit dd1036ab8a
141 changed files with 399 additions and 399 deletions
Download patch file Download diff file Expand all files Collapse all files

4
skills/ms-ai-governance/references/monitoring-observability/compliance-monitoring-ai-governance.md
View file

@ -478,13 +478,13 @@ AppMetrics
**Azure Policy & monitoring:**
- [Azure Policy Regulatory Compliance controls for Azure AI Search](https://learn.microsoft.com/en-us/azure/search/security-controls-policy) — Verified 2026-02
- [Control AI model deployment with built-in policies in Microsoft Foundry portal](https://learn.microsoft.com/en-us/azure/ai-foundry/how-to/built-in-policy-model-deployment) — Verified 2026-02
- [Control AI model deployment with built-in policies in Microsoft Foundry portal](https://learn.microsoft.com/en-us/azure/foundry-classic/how-to/built-in-policy-model-deployment) — Verified 2026-02
- [AI gateway in Azure API Management (Observability and governance)](https://learn.microsoft.com/en-us/azure/api-management/genai-gateway-capabilities#observability-and-governance) — Verified 2026-02
**Security & observability:**
- [Assess your organization's AI risk with Microsoft Security Dashboard for AI (Preview)](https://learn.microsoft.com/en-us/security/security-for-ai/security-dashboard-for-ai) — Verified 2026-02
- [Governance and security for AI agents across the organization](https://learn.microsoft.com/en-us/azure/cloud-adoption-framework/ai-agents/governance-security-across-organization) — Verified 2026-02
- [Monitor Azure OpenAI (Dashboards)](https://learn.microsoft.com/en-us/azure/ai-foundry/openai/how-to/monitor-openai) — Verified 2026-02
- [Monitor Azure OpenAI (Dashboards)](https://learn.microsoft.com/en-us/azure/foundry-classic/openai/how-to/monitor-openai) — Verified 2026-02
### Konfidensnivå per seksjon

4
skills/ms-ai-governance/references/monitoring-observability/cost-monitoring-cost-attribution.md
View file

@ -439,7 +439,7 @@ if ($metrics.Data.Total -eq 0) {
### Kilder (Microsoft Learn)
1. **Plan to manage costs for Azure OpenAI**
https://learn.microsoft.com/en-us/azure/ai-foundry/openai/how-to/manage-costs
https://learn.microsoft.com/en-us/azure/foundry/concepts/manage-costs
*Konfidensgrad: Verified* – Komplett guide for cost management (budgets, alerts, export)
2. **Azure OpenAI in Foundry Models gateway monitoring** *(Verified MCP 2026-04)*
@ -455,7 +455,7 @@ if ($metrics.Data.Total -eq 0) {
*Konfidensgrad: Verified* – Best practices for TPM/RPM monitoring, commitment billing
5. **Plan and manage costs for Azure AI Foundry**
https://learn.microsoft.com/en-us/azure/ai-foundry/concepts/manage-costs
https://learn.microsoft.com/en-us/azure/foundry/concepts/manage-costs
*Konfidensgrad: Verified* – Marketplace models, fine-tuning costs, HTTP error billing
6. **Azure Cost Management API (Python SDK)**

2
skills/ms-ai-governance/references/monitoring-observability/custom-dashboards-ai-operations.md
View file

@ -483,7 +483,7 @@ Når kunden spør om dashboards for AI operations:
### Microsoft Learn
- [Azure Workbooks overview](https://learn.microsoft.com/en-us/azure/azure-monitor/visualize/workbooks-overview)
- [Create an Azure AI Foundry dashboard](https://learn.microsoft.com/en-us/azure/managed-grafana/azure-ai-foundry-dashboard)
- [Monitor Azure OpenAI](https://learn.microsoft.com/en-us/azure/ai-foundry/openai/how-to/monitor-openai)
- [Monitor Azure OpenAI](https://learn.microsoft.com/en-us/azure/foundry-classic/openai/how-to/monitor-openai)
- [Workbooks programmatic management](https://learn.microsoft.com/en-us/azure/azure-monitor/visualize/workbooks-automate) *(Verified MCP 2026-04)* — ARM/Bicep deployment, RBAC (Monitoring Contributor for redigering, Monitoring Reader for visning), `microsoft.insights/workbooks/write` for custom roles
- [Power BI + Azure Monitor](https://learn.microsoft.com/en-us/azure/azure-monitor/logs/log-powerbi)

8
skills/ms-ai-governance/references/monitoring-observability/endpoint-health-and-capacity-planning.md
View file

@ -587,19 +587,19 @@ az role assignment create \
### Microsoft Learn (Verified via MCP)
1. **Monitor Azure OpenAI:**
https://learn.microsoft.com/en-us/azure/ai-foundry/openai/how-to/monitor-openai
https://learn.microsoft.com/en-us/azure/foundry-classic/openai/how-to/monitor-openai
*Confidence: Verified* — Komplett guide til diagnostics, metrics, alerts, og KQL-queries
2. **Manage Azure OpenAI quota:**
https://learn.microsoft.com/en-us/azure/ai-foundry/openai/how-to/quota
https://learn.microsoft.com/en-us/azure/foundry-classic/openai/how-to/quota
*Confidence: Verified* — TPM/RPM-allokering, quota requests, 429-feilhåndtering
3. **Azure OpenAI quotas and limits:**
https://learn.microsoft.com/en-us/azure/ai-foundry/openai/quotas-limits
https://learn.microsoft.com/en-us/azure/foundry/openai/quotas-limits
*Confidence: Verified* — Rate limits per modell, Usage tiers, regional constraints
4. **Dynamic quota (Preview):**
https://learn.microsoft.com/en-us/azure/ai-foundry/openai/how-to/dynamic-quota
https://learn.microsoft.com/en-us/azure/foundry-classic/openai/how-to/dynamic-quota
*Confidence: Verified* — Opportunistic burst-kapasitet for Standard deployments
5. **Supported metrics for Microsoft.CognitiveServices/accounts:**

4
skills/ms-ai-governance/references/monitoring-observability/log-analytics-kql-ai-queries.md
View file

@ -723,7 +723,7 @@ AzureDiagnostics
- **KQL Quick Reference:** [learn.microsoft.com/kusto/query/kql-quick-reference](https://learn.microsoft.com/en-us/kusto/query/kql-quick-reference)
- **Azure Monitor KQL Samples:** [learn.microsoft.com/azure/azure-monitor/logs/queries](https://learn.microsoft.com/en-us/azure/azure-monitor/logs/queries)
- **Azure OpenAI Monitoring:** [learn.microsoft.com/azure/ai-foundry/openai/how-to/monitor-openai](https://learn.microsoft.com/en-us/azure/ai-foundry/openai/how-to/monitor-openai)
- **Azure OpenAI Monitoring:** [learn.microsoft.com/azure/foundry-classic/openai/how-to/monitor-openai](https://learn.microsoft.com/en-us/azure/foundry-classic/openai/how-to/monitor-openai)
- **Optimize Log Queries:** [learn.microsoft.com/azure/azure-monitor/logs/query-optimization](https://learn.microsoft.com/en-us/azure/azure-monitor/logs/query-optimization)
## Nøkkelinnsikter
@ -743,7 +743,7 @@ AzureDiagnostics
## Referanser
- Microsoft Learn: [Monitor Azure OpenAI](https://learn.microsoft.com/en-us/azure/ai-foundry/openai/how-to/monitor-openai)
- Microsoft Learn: [Monitor Azure OpenAI](https://learn.microsoft.com/en-us/azure/foundry-classic/openai/how-to/monitor-openai)
- Microsoft Learn: [Get started with log queries in Azure Monitor](https://learn.microsoft.com/en-us/azure/azure-monitor/logs/get-started-queries)
- Microsoft Learn: [Optimize log queries in Azure Monitor](https://learn.microsoft.com/en-us/azure/azure-monitor/logs/query-optimization) *(Verified MCP 2026-04)*
- Microsoft Learn: [Configure diagnostic logging for Azure AI Search](https://learn.microsoft.com/en-us/azure/search/search-monitor-enable-logging)

4
skills/ms-ai-governance/references/monitoring-observability/model-performance-drift-detection.md
View file

@ -377,8 +377,8 @@ Model monitoring er inkludert i Azure Machine Learning workspace, men du betaler
- [Azure Machine Learning model monitoring (concept)](https://learn.microsoft.com/en-us/azure/machine-learning/concept-model-monitoring?view=azureml-api-2) — **Verified** (fetched 2026-02)
- [Monitor performance of models deployed to production](https://learn.microsoft.com/en-us/azure/machine-learning/how-to-monitor-model-performance?view=azureml-api-2) — **Verified** (fetched 2026-02)
- [Data drift monitoring (legacy, retiring)](https://learn.microsoft.com/en-us/azure/machine-learning/how-to-monitor-datasets?view=azureml-api-1) — **Verified** (fetched 2026-02, kontext: migrering til Model Monitor)
- [Evaluate generative AI models (Azure AI Foundry)](https://learn.microsoft.com/en-us/azure/ai-foundry/how-to/evaluate-generative-ai-app?view=foundry-classic) — **Verified** (fetched 2026-02)
- [Observability in generative AI (Azure AI Foundry)](https://learn.microsoft.com/en-us/azure/ai-foundry/concepts/observability?view=foundry-classic) — **Verified** (fetched 2026-02)
- [Evaluate generative AI models (Azure AI Foundry)](https://learn.microsoft.com/en-us/azure/foundry/how-to/evaluate-generative-ai-app?view=foundry-classic) — **Verified** (fetched 2026-02)
- [Observability in generative AI (Azure AI Foundry)](https://learn.microsoft.com/en-us/azure/foundry/concepts/observability?view=foundry-classic) — **Verified** (fetched 2026-02)
- [Test and evaluate AI workloads on Azure](https://learn.microsoft.com/en-us/azure/well-architected/ai/test) — **Verified** (fetched 2026-02)
### Baseline (Model knowledge)

2
skills/ms-ai-governance/references/monitoring-observability/real-time-streaming-monitoring.md
View file

@ -525,7 +525,7 @@ Real-Time Dashboard er IKKE erstatning for data warehouse. Bruk for operational
**Confidence:** Verified (Feb 2026) - Real-time architecture patterns
7. **Observability in generative AI**
https://learn.microsoft.com/en-us/azure/ai-foundry/concepts/observability
https://learn.microsoft.com/en-us/azure/foundry/concepts/observability
**Confidence:** Verified (Feb 2026) - AI Foundry monitoring integration
8. **Implement advanced monitoring for Azure OpenAI in Foundry Models through a gateway**

12
skills/ms-ai-governance/references/monitoring-observability/response-quality-metrics-rag.md
View file

@ -591,14 +591,14 @@ PTU equivalent: ~300 PTUs @ $6/PTU = $1800/måned
### Microsoft Learn (Verified via MCP)
1. [Observability in generative AI - What are evaluators?](https://learn.microsoft.com/en-us/azure/ai-foundry/concepts/observability#what-are-evaluators) — RAG evaluators (Retrieval, Groundedness, Relevance, Response Completeness)
2. [Retrieval-Augmented Generation (RAG) evaluators](https://learn.microsoft.com/en-us/azure/ai-foundry/concepts/evaluation-evaluators/rag-evaluators) — Detaljert dokumentasjon for alle RAG-evaluatorer, input/output formats
1. [Observability in generative AI - What are evaluators?](https://learn.microsoft.com/en-us/azure/foundry/concepts/observability#what-are-evaluators) — RAG evaluators (Retrieval, Groundedness, Relevance, Response Completeness)
2. [Retrieval-Augmented Generation (RAG) evaluators](https://learn.microsoft.com/en-us/azure/foundry/concepts/evaluation-evaluators/rag-evaluators) — Detaljert dokumentasjon for alle RAG-evaluatorer, input/output formats
3. [Large language model end-to-end evaluation](https://learn.microsoft.com/en-us/azure/architecture/ai-ml/guide/rag/rag-llm-evaluation-phase) — Groundedness, completeness, utilization, relevance, correctness metrics
4. [Evaluate generative AI models and applications](https://learn.microsoft.com/en-us/azure/ai-foundry/how-to/evaluate-generative-ai-app) — Foundry portal evaluation workflow, testing criteria configuration
5. [Submit a batch run and evaluate a flow](https://learn.microsoft.com/en-us/azure/ai-foundry/how-to/flow-bulk-test-evaluation) — Built-in evaluation methods (QnA Groundedness, Relevance, Coherence)
4. [Evaluate generative AI models and applications](https://learn.microsoft.com/en-us/azure/foundry/how-to/evaluate-generative-ai-app) — Foundry portal evaluation workflow, testing criteria configuration
5. [Submit a batch run and evaluate a flow](https://learn.microsoft.com/en-us/azure/foundry-classic/how-to/flow-bulk-test-evaluation) — Built-in evaluation methods (QnA Groundedness, Relevance, Coherence)
6. [Evaluation of RAG performance basics](https://learn.microsoft.com/en-us/fabric/data-science/tutorial-evaluate-rag-performance) — AI-assisted metrics (groundedness, relevance, similarity), top-N retrieval rate
7. [Monitor Azure OpenAI](https://learn.microsoft.com/en-us/azure/ai-foundry/openai/how-to/monitor-openai) — Azure Monitor integration, KQL queries, diagnostic settings
8. [Use Risks & Safety monitoring](https://learn.microsoft.com/en-us/azure/ai-foundry/openai/how-to/risks-safety-monitor) — Content filtering metrics, severity distribution
7. [Monitor Azure OpenAI](https://learn.microsoft.com/en-us/azure/foundry-classic/openai/how-to/monitor-openai) — Azure Monitor integration, KQL queries, diagnostic settings
8. [Use Risks & Safety monitoring](https://learn.microsoft.com/en-us/azure/foundry-classic/openai/how-to/risks-safety-monitor) — Content filtering metrics, severity distribution
9. [Azure AI Evaluation SDK - Python samples](https://github.com/Azure-Samples/azureai-samples/blob/main/scenarios/evaluate/) — Code examples for groundedness, relevance evaluators
### Code samples (Verified via MCP)

4
skills/ms-ai-governance/references/monitoring-observability/security-and-audit-logging-ai.md
View file

@ -385,8 +385,8 @@ Ingen ekstra lisenser kreves for audit logging — funksjonen er inkludert i Azu
| Kilde | URL | Konfidensnivå |
|-------|-----|---------------|
| **Enable diagnostic logging for Azure AI services** | https://learn.microsoft.com/en-us/azure/ai-services/diagnostic-logging | ✅ Verified |
| **Monitor Azure OpenAI** | https://learn.microsoft.com/en-us/azure/ai-foundry/openai/how-to/monitor-openai | ✅ Verified |
| **Azure security baseline for Azure OpenAI** | https://learn.microsoft.com/en-us/security/benchmark/azure/baselines/azure-openai-security-baseline | ✅ Verified — **OBS:** Basert på MCSB v1.0 (kan inneholde utdatert veiledning). Produktet refereres nå som "Foundry Tools" i baseline-dokumentet. Siste veiledning: [Azure OpenAI docs](https://learn.microsoft.com/en-us/azure/ai-foundry/). *(Verified MCP 2026-04)* |
| **Monitor Azure OpenAI** | https://learn.microsoft.com/en-us/azure/foundry-classic/openai/how-to/monitor-openai | ✅ Verified |
| **Azure security baseline for Azure OpenAI** | https://learn.microsoft.com/en-us/security/benchmark/azure/baselines/azure-openai-security-baseline | ✅ Verified — **OBS:** Basert på MCSB v1.0 (kan inneholde utdatert veiledning). Produktet refereres nå som "Foundry Tools" i baseline-dokumentet. Siste veiledning: [Azure OpenAI docs](https://learn.microsoft.com/en-us/azure/foundry/). *(Verified MCP 2026-04)* |
| **Azure security baseline for Microsoft Foundry** | https://learn.microsoft.com/en-us/security/benchmark/azure/baselines/azure-ai-foundry-security-baseline | ✅ Verified — **OBS:** Tjenesten er omdøpt til "Microsoft Foundry" i baseline-dokumentet. Basert på MCSB v1.0. Viktige avvik: Customer Lockbox **ikke støttet** for Foundry, lokal autentisering til data plane **ikke støttet** (positivt for sikkerhet), DLP/sensitive data discovery **ikke støttet** nativt. *(Verified MCP 2026-04)* |
| **Microsoft cloud security benchmark: Logging and threat detection** | https://learn.microsoft.com/en-us/security/benchmark/azure/mcsb-logging-threat-detection | ✅ Verified |
| **Artificial Intelligence Security (AI-6: Establish monitoring and detection)** | https://learn.microsoft.com/en-us/security/benchmark/azure/mcsb-v2-artificial-intelligence-security | ✅ Verified |

6
skills/ms-ai-governance/references/monitoring-observability/sla-monitoring-ai-services.md
View file

@ -351,11 +351,11 @@ Metric Alert
### Microsoft Learn (Verified via MCP)
1. **Monitor Azure OpenAI**
https://learn.microsoft.com/en-us/azure/ai-foundry/openai/how-to/monitor-openai
https://learn.microsoft.com/en-us/azure/foundry-classic/openai/how-to/monitor-openai
*Confidence: Verified* — Detaljert guide til Azure Monitor-integrasjon for OpenAI.
2. **Azure OpenAI monitoring data reference**
https://learn.microsoft.com/en-us/azure/ai-foundry/openai/monitor-openai-reference
https://learn.microsoft.com/en-us/azure/foundry/openai/monitor-openai-reference
*Confidence: Verified* — Fullstendig liste over metrics (inkl. `ModelAvailabilityRate`).
3. **Monitoring and diagnostics guidance**
@ -363,7 +363,7 @@ Metric Alert
*Confidence: Verified* — SLA monitoring best practices (generell Azure-arkitektur). Dekker: tilgjengelighetssporing, ytelsesovervåkning, SLA-etterlevelse, sikkerhet/personvern, regulatorisk audit, trend-deteksjon. Brukes i AI-kontekst for å sikre end-to-end synlighet i distribuerte AI-systemer. *(Verified MCP 2026-04)*
4. **Azure OpenAI FAQ - SLA**
https://learn.microsoft.com/en-us/azure/ai-foundry/openai/faq#what-are-the-slas-service-level-agreements-in-azure-openai
https://learn.microsoft.com/en-us/azure/foundry-classic/openai/faq#what-are-the-slas-service-level-agreements-in-azure-openai
*Confidence: Verified* — Bekreftelse av 99.9% Availability SLA + Latency SLA for PTU.
5. **Supported metrics for Microsoft.CognitiveServices/accounts**

8
skills/ms-ai-governance/references/monitoring-observability/token-usage-tracking-attribution.md
View file

@ -568,11 +568,11 @@ Owner: <email>
## Kilder (Microsoft Learn)
1. [Monitor Azure OpenAI](https://learn.microsoft.com/en-us/azure/ai-foundry/openai/how-to/monitor-openai) — Official monitoring guide
1. [Monitor Azure OpenAI](https://learn.microsoft.com/en-us/azure/foundry-classic/openai/how-to/monitor-openai) — Official monitoring guide
2. [Implement advanced monitoring for Azure OpenAI in Foundry Models through a gateway](https://learn.microsoft.com/en-us/azure/architecture/ai-ml/guide/azure-openai-gateway-monitoring) *(Verified MCP 2026-04)* — Gateway patterns for usage tracking. Ny brukscase dokumentert: audit av model inputs/outputs for threat detection og data exfiltration detection. Merk: gateway monitoring kan bli single point of failure — vurder redundans.
3. [Plan to manage costs for Azure OpenAI](https://learn.microsoft.com/en-us/azure/ai-foundry/openai/how-to/manage-costs) — Cost management strategies
4. [Token usage estimation for Azure OpenAI On Your Data](https://learn.microsoft.com/en-us/azure/ai-foundry/openai/concepts/use-your-data#token-usage-estimation-for-azure-openai-on-your-data) — RAG-specific token calculations
5. [Understanding costs associated with PTU](https://learn.microsoft.com/en-us/azure/ai-foundry/openai/how-to/provisioned-throughput-onboarding) — PTU billing model
3. [Plan to manage costs for Azure OpenAI](https://learn.microsoft.com/en-us/azure/foundry/concepts/manage-costs) — Cost management strategies
4. [Token usage estimation for Azure OpenAI On Your Data](https://learn.microsoft.com/en-us/azure/foundry-classic/openai/concepts/use-your-data#token-usage-estimation-for-azure-openai-on-your-data) — RAG-specific token calculations
5. [Understanding costs associated with PTU](https://learn.microsoft.com/en-us/azure/foundry/openai/concepts/provisioned-throughput-billing) — PTU billing model
6. [Application design for AI workloads](https://learn.microsoft.com/en-us/azure/well-architected/ai/application-design#consider-nonfunctional-requirements) — Cost and chargeback scenarios
7. [Architecture strategies for cost data](https://learn.microsoft.com/en-us/azure/well-architected/cost-optimization/collect-review-cost-data#generate-cost-reports) — Chargeback vs. showback