open/ms-ai-architect
1
0
Fork 0
Code Issues Pull requests Releases Activity

feat(ms-ai-architect): Spor 2b gull-rekonsiliering — 12 uenigheter løst, fasit herdet (P 84→92%, R 84→88%) [skip-docs]

Browse source 
4 gull-feil rettet (FP1/FP2/FP6/FN1) + 1 note-fiks (FP4); 8 judge-feil dokumentert som kalibreringsmål for Spor 2a/judge-prompt-v3. Hver endring live-belagt mot MS Learn. Nedre-grense-policy vedtatt. 0 uløste uenigheter. Suite 637/637. Logg: docs/ref-kb-gold-reconciliation-2026-06.md; herdet rapport: judge-bakeoff-report-v2-reconciled (frozen v2 beholdt).
This commit is contained in:
Kjell Tore Guttormsen 2026-06-30 07:20:21 +02:00
commit 4ab1138760
5 changed files with 404 additions and 12 deletions
Download patch file Download diff file Expand all files Collapse all files

18
scripts/kb-eval/data/gold-correctness-set.json
View file

@ -405,11 +405,11 @@
"stratum": "volatile",
"claim": "1900+ Foundry Models sold by Azure; 11000+ totalt; 40+ regioner",
"claim_type": "taxonomy",
"verdict": "correct",
"verdict": "wrong",
"evidence_url": "https://learn.microsoft.com/azure/foundry/what-is-foundry",
"lastmod_changed": false,
"file_last_updated": "2026-06-24",
"notes": "1900+ bekreftet, men kilden rammer det som total fler-leverandør-tilgang, ikke smalt 'sold by Azure'. 11000+/40+ uverifisert."
"notes": "RECONCILED 2026-06-30 (Spor 2b): correct->wrong. Live (what-is-foundry): \"1,900+\" rammer HELE katalogen (Microsoft+OpenAI+partnere+community), ikke \"sold by Azure\" (en delmengde). \"11000+ totalt\" og \"40+ regioner\" finnes ikke pa kilden (kilden sier kun \"most regions where Foundry Tools are available\"). Fil-fiks (Spor 0/1): omramme til \"1900+ modeller totalt i katalogen\", fjern 11000+/40+. Judge not_grounded var korrekt."
},
{
"id": "ms-ai-advisor/platforms/azure-ai-foundry.md#3",
@ -730,11 +730,11 @@
"stratum": "volatile",
"claim": "Image-to-vector queries kun med Azure Vision multimodal embeddings vectorizer",
"claim_type": "taxonomy",
"verdict": "correct",
"verdict": "wrong",
"evidence_url": "https://learn.microsoft.com/azure/search/multimodal-search-overview",
"lastmod_changed": false,
"file_last_updated": "2026-06-19",
"notes": "Bekreftet."
"notes": "RECONCILED 2026-06-30 (Spor 2b): correct->wrong. Live (multimodal-search-overview): image-to-vector ved query krever en multimodal-embedding-vectorizer, men det finnes TO veier - AML-skill ELLER Azure Vision multimodal embeddings skill. \"kun Azure Vision\" er for restriktivt (utelukker AML-veien). Fil-fiks: myk opp \"kun\" -> \"f.eks./primaert\". Judge not_grounded var korrekt pa eksklusiviteten."
},
{
"id": "ms-ai-advisor/prompt-engineering/multimodal-prompt-design.md#8",
@ -912,11 +912,11 @@
"stratum": "volatile",
"claim": "Realtime API regions: East US 2, Sweden Central (global)",
"claim_type": "region",
"verdict": "outdated",
"verdict": "correct",
"evidence_url": "https://learn.microsoft.com/azure/foundry/openai/how-to/realtime-audio",
"lastmod_changed": false,
"file_last_updated": "2026-06-24",
"notes": "Kilde: tilgjengelig for global deployments, ikke begrenset til de to. To-region-begrensning avløst."
"notes": "RECONCILED 2026-06-30 (Spor 2b): outdated->correct. Live (realtime-audio + WebRTC/SIP/WebSockets-soesken): Realtime-modellene er global deployment-type tilgjengelig i NOEYAKTIG East US 2 + Sweden Central. To-region-bildet er IKKE avloest - forrige gull-note misleste \"global deployments\" som \"tilgjengelig overalt\". Judge grounded var korrekt."
},
{
"id": "ms-ai-advisor/prompt-engineering/real-time-reasoning-performance.md#6",
@ -2060,7 +2060,7 @@
"evidence_url": "https://learn.microsoft.com/azure/foundry/foundry-models/concepts/deployment-types",
"lastmod_changed": false,
"file_last_updated": "2026-06-24",
"notes": "Alle fire data-residency-oppførsler bekreftet ordrett."
"notes": "RECONCILED 2026-06-30 (Spor 2b): verdikt correct beholdt; note korrigert. Live (deployment-types): de tre kjerne-residency-atferdene bekreftet (Standard=deployment-region, Data Zone=innen US/EU-sone, Global Standard=any region). MEN \"alle fire ordrett\" overdrev - kilden grupperer residency etter Global/DataZone/Regional, og Global Provisioned = any region (ikke single-region). \"Standard/Provisioned=region\" er rimelig kortform for kjernemodellen men utelater Global/DataZone Provisioned. Judge not_grounded var over-streng (kjernen ER grunnet)."
},
{
"id": "ms-ai-engineering/api-management/multi-region-ai-gateway-design.md#3",
@ -3603,11 +3603,11 @@
"stratum": "volatile",
"claim": "Global training (Public Preview) rimeligere, ingen datasuverenitet; bruk regional i Norway East/Sweden Central",
"claim_type": "status",
"verdict": "correct",
"verdict": "outdated",
"evidence_url": "https://learn.microsoft.com/azure/ai-foundry/openai/concepts/models",
"lastmod_changed": false,
"file_last_updated": "2026-06-24",
"notes": "Global training public preview, billigere, ingen residency; regional gir residency. Bekreftet."
"notes": "RECONCILED 2026-06-30 (Spor 2b): correct->outdated. Live (openai/concepts/models): Global training har INGEN egen \"Public Preview\"-status - tilbys for GA-modeller (gpt-4o/gpt-4.1 m.fl. = GA). \"billigere\" + \"ingen residency\" stemmer. MEN Norway East er listet som en GLOBAL trenings-region (uten residency), ikke en regional/residency-region - sa \"bruk regional i Norway East for residency\" er feil (Standard fine-tuning-regioner: North Central US/Sweden Central/East US 2). Fil-fiks: fjern \"(Public Preview)\", rett Norway-East-anbefalingen. Judge not_grounded var defensibel."
},
{
"id": "ms-ai-security/cost-optimization/gpt5-gpt41-pricing-models.md#1",