open/ms-ai-architect
1
0
Fork 0
Code Issues Releases 4 Activity

docs(architect): weekly KB update — 52 files refreshed (2026-04)

Browse source 
Key content changes:
- MLOps: MLflow 3 scorers expanded (RetrievalRelevance, Fluency, multi-turn judges)
- MLflow 3 A/B eval: mirror_traffic GA confirmed, new scorer catalog
- CI/CD: OIDC auth replaces deprecated --sdk-auth (Azure ML GitHub Actions)
- Agent framework A2A: updated SDK patterns (A2ACardResolver, BearerAuth)
- AG-UI backend tool rendering: accurate TOOL_CALL_* event shapes
- Computer Use agents: US region requirement, credentials patterns
- Purview governance: bulk term edit, expire/delete workflows
- CAF AI Secure: 3-phase structure confirmed current
- Copilot Studio: Claude Sonnet 4.5/4.6 GA, new orchestration controls
- M365 manifest: v1.26 GA (April 2026), copilotAgents node
- Power Platform: agent flow capacity enforcement corrected
- Azure Monitor: Simple Log Alerts GA, AMBA for policy-based alerting
- Security Copilot: SCU capacity model (400 SCU/1000 users)
- EU Data Boundary: all EU + EFTA countries confirmed
- gateway-multi-backend: added 4th topology, subscription-level quota note

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
Kjell Tore Guttormsen 2026-04-10 11:31:11 +02:00
commit be4925a8ff
40 changed files with 398 additions and 239 deletions
Download patch file Download diff file Expand all files Collapse all files

22
skills/ms-ai-engineering/references/mlops-genaiops/model-drift-performance-degradation.md
View file

@ -1,6 +1,6 @@
# Model Drift and Performance Degradation Detection
**Last updated:** 2026-02
**Last updated:** 2026-04
**Verified:** MCP 2026-04
**Status:** GA
**Category:** MLOps & GenAIOps
@ -41,7 +41,7 @@ Azure Machine Learning støtter flere built-in signals (med GA- eller preview-st
| **Feature Attribution Drift** | Feature importance-endringer | Preview | Normalized Discounted Cumulative Gain |
| **Model Performance** | Objektiv ytelse (krever ground truth) | Preview | Accuracy, Precision, Recall (classification); MAE, MSE, RMSE (regression) |
**Verified (MCP):** Metrics og signal-typer hentet fra offisiell Microsoft Learn-dokumentasjon (2026-02).
**Verified (MCP):** Metrics og signal-typer hentet fra offisiell Microsoft Learn-dokumentasjon (2026-04).
### 2. Reference Data
@ -582,44 +582,44 @@ Email Alerts + Azure Monitor Dashboard
1. **Azure Machine Learning model monitoring (Concept)**
https://learn.microsoft.com/en-us/azure/machine-learning/concept-model-monitoring?view=azureml-api-2
*Verified: 2026-02 via microsoft_docs_fetch*
*Verified: 2026-04 via microsoft_docs_fetch*
- Monitoring signals, metrics, reference data, lookback windows
2. **Monitor the performance of models deployed to production**
https://learn.microsoft.com/en-us/azure/machine-learning/how-to-monitor-model-performance?view=azureml-api-2
*Verified: 2026-02 via microsoft_docs_fetch*
*Verified: 2026-04 via microsoft_docs_fetch*
- Setup guides (CLI, SDK, Studio), Event Grid integration, interpret results
3. **Data drift (preview) will be retired, and replaced by Model Monitor**
https://learn.microsoft.com/en-us/azure/machine-learning/how-to-monitor-datasets?view=azureml-api-1
*Verified: 2026-02 via microsoft_docs_search (3 results)*
*Verified: 2026-04 via microsoft_docs_search (3 results)*
- Legacy DataDriftDetector (v1) vs. Model Monitor (v2)
4. **Trigger applications, processes, or CI/CD workflows based on Azure Machine Learning events**
https://learn.microsoft.com/en-us/azure/machine-learning/how-to-use-event-grid?view=azureml-api-2
*Verified: 2026-02 via microsoft_docs_search*
*Verified: 2026-04 via microsoft_docs_search*
- Event Grid integration, advanced filters
5. **Machine learning operations (MLOps v2)**
https://learn.microsoft.com/en-us/azure/architecture/ai-ml/guide/machine-learning-operations-v2
*Verified: 2026-02 via microsoft_docs_search (multiple references)*
*Verified: 2026-04 via microsoft_docs_search (multiple references)*
- Data drift, prediction drift, resource monitoring
### Code Samples (MCP-verified)
1. **Model monitoring setup (Python SDK v2)**
https://learn.microsoft.com/en-us/azure/machine-learning/how-to-monitor-model-performance
*Verified: 2026-02 via microsoft_code_sample_search*
*Verified: 2026-04 via microsoft_code_sample_search*
- Out-of-box monitoring, advanced monitoring, model performance
2. **DataDriftDetector (Python SDK v1 – deprecated)**
https://learn.microsoft.com/en-us/python/api/azureml-datadrift/azureml.datadrift.datadriftdetector
*Verified: 2026-02 via microsoft_code_sample_search*
*Verified: 2026-04 via microsoft_code_sample_search*
- Legacy API for comparison
3. **Custom signal component examples**
https://github.com/Azure/azureml-examples/tree/main/cli/monitoring/components/custom_signal
*Referenced: 2026-02 in Microsoft Learn documentation*
*Referenced: 2026-04 in Microsoft Learn documentation*
### Confidence Markers
@ -635,7 +635,7 @@ Email Alerts + Azure Monitor Dashboard
### Sist oppdatert
**2026-02** – Basert på Microsoft Learn-dokumentasjon (azure-ai-ml SDK v2, API version 2).
**2026-04** – Basert på Microsoft Learn-dokumentasjon (azure-ai-ml SDK v2, API version 2).
### Azure ML Model Drift & Performance Degradation Monitoring (2026)