docs(architect): weekly KB update — 106 files refreshed (2026-04)
Updates across all 5 skills: ms-ai-advisor, ms-ai-engineering, ms-ai-governance, ms-ai-security, ms-ai-infrastructure. Key changes: - Language Services (Custom Text Classification, Text Analytics, QnA): retirement warning 2029-03-31, migration guides to Foundry/GPT-4o - Agentic Retrieval: 50M free reasoning tokens/month (Public Preview) - Computer Use: Claude Sonnet 4.5 (preview) + OpenAI CUA models - Agent Registry: Risks column (M365 E7), user-shared/org-published types - Declarative agents: schema v1.5 → v1.6, Store validation requirements - MLflow 3: 13 built-in LLM judges, production monitoring, Genie Code - AG-UI HITL: ApprovalRequiredAIFunction (C#) + @tool(approval_mode) (Python) - Entra ID Ignite 2025: Agent ID Admin/Developer RBAC roles, Conditional Access - Security Copilot: 400 SCU/month per 1000 M365 E5 licenses, auto-provisioned - Fast Transcription API: phrase lists, 14-language multi-lingual transcription - Azure Monitor Workbooks: Bicep support, RBAC specifics - Power Platform Copilot: data residency (Norway/Europe → EU DB, Bing → USA) - RAG security-rbac: 4-approach table (GA + 3 preview access control methods) - IaC MLOps: Well-Architected OE:05 principles, Bicep/Terraform patterns - Translator: image file batch translation Preview (JPEG/PNG/BMP/WebP) All 106 files: Last updated 2026-04 | Verified: MCP 2026-04 Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
This commit is contained in:
parent
0eb30fa853
commit
6645e93205
104 changed files with 1986 additions and 520 deletions
|
|
@ -1,6 +1,6 @@
|
|||
# Rate Limit Management
|
||||
|
||||
**Last updated:** 2026-02
|
||||
**Last updated:** 2026-04 | Verified: MCP 2026-04
|
||||
**Status:** GA
|
||||
**Category:** Performance & Scalability
|
||||
|
||||
|
|
@ -398,6 +398,60 @@ AzureMetrics
|
|||
"""
|
||||
```
|
||||
|
||||
|
||||
## Gateway Multi-Backend som Rate Limit-strategi (oppdatert 2026-04)
|
||||
|
||||
Microsoft dokumenterer multi-backend gateway som den anbefalte arkitekturmønsteret for rate limit management — primært via Azure API Management:
|
||||
|
||||
### Anbefalte topologier for rate limit-distribusjon
|
||||
|
||||
| Topologi | Kvote-kapasitet | Kompleksitet | Anbefalt for |
|
||||
|----------|----------------|--------------|--------------|
|
||||
| Single instance | Baseline TPM | Lav | Utvikling, lav trafikk |
|
||||
| Multi-backend, single region | 2-5x baseline | Medium | Produksjon, standard |
|
||||
| Multi-subscription | 5-20x baseline | Høy | Høy trafikk enterprise |
|
||||
| Multi-region | Nær ubegrenset | Høy | Kritisk infrastruktur |
|
||||
|
||||
### APIM-basert rate limit distribusjon
|
||||
|
||||
```xml
|
||||
<!-- APIM Policy: Distribuer rate limit på tvers av backends -->
|
||||
<policies>
|
||||
<inbound>
|
||||
<base />
|
||||
|
||||
<!-- Token-based rate limiting i APIM (avlaster Azure OpenAI) -->
|
||||
<azure-openai-token-limit
|
||||
counter-key="@(context.Request.Headers.GetValueOrDefault("x-client-id", "default"))"
|
||||
tokens-per-minute="10000"
|
||||
estimate-prompt-tokens="true"
|
||||
tokens-consumed-variable-name="consumed-tokens"
|
||||
remaining-tokens-variable-name="remaining-tokens" />
|
||||
|
||||
<!-- Velg backend basert på tilgjengelighet -->
|
||||
<set-variable name="backend-url" value="@{
|
||||
// Prioritert liste: prøv Norway East, fallback til Sweden Central
|
||||
if (context.Variables.GetValueOrDefault<int>("norway-throttle") < DateTimeOffset.UtcNow.ToUnixTimeSeconds())
|
||||
return "https://aoai-norway.openai.azure.com";
|
||||
return "https://aoai-sweden.openai.azure.com";
|
||||
}" />
|
||||
|
||||
<set-backend-service base-url="@(context.Variables.GetValueOrDefault<string>("backend-url"))" />
|
||||
</inbound>
|
||||
|
||||
<backend>
|
||||
<retry condition="@(context.Response.StatusCode == 429)" count="2" interval="0">
|
||||
<set-variable name="norway-throttle" value="@(
|
||||
DateTimeOffset.UtcNow.AddSeconds(
|
||||
double.Parse(context.Response.Headers.GetValueOrDefault("Retry-After", "10"))
|
||||
).ToUnixTimeSeconds())" />
|
||||
<set-backend-service base-url="https://aoai-sweden.openai.azure.com" />
|
||||
<forward-request />
|
||||
</retry>
|
||||
</backend>
|
||||
</policies>
|
||||
```
|
||||
|
||||
## Norsk offentlig sektor
|
||||
|
||||
- **SLA-implikasjoner**: Standard Azure OpenAI deployments har ingen latens-SLA — 429-feil er forventet atferd under høy belastning. Dokumenter dette i tjenesteavtaler med interne brukere.
|
||||
|
|
|
|||
Loading…
Add table
Add a link
Reference in a new issue