# Prompt Flow and Production Deployment **Kategori:** MLOps & GenAIOps **Dato:** 2026-02-04 **Last updated:** 2026-06-19 **Confidence:** 🟢 Høy (basert på offisiell Microsoft-dokumentasjon fra Azure AI Foundry og Azure Machine Learning) --- > **⚠️ Retirement (verifisert mot Microsoft Learn 2026-06-19):** Prompt Flow — i **både Microsoft Foundry og Azure Machine Learning** — pensjoneres **20. april 2027** og anbefales ikke for ny utvikling. Migrer eksisterende flows og deployments til **Microsoft Agent Framework (MAF)** før fristen. Web authoring-opplevelsen (Foundry + Azure ML), VS Code-utvidelsene og Prompt Flow container images (`promptflow-runtime`, `promptflow-runtime-stable`, `promptflow-python`) får ikke lenger oppdateringer, inkludert sikkerhetsoppdateringer. [Migrasjonsguide](https://learn.microsoft.com/azure/machine-learning/prompt-flow/migrate-prompt-flow-to-agent-framework?view=azureml-api-2). Innholdet under beskriver fortsatt gjeldende Prompt Flow-praksis for eksisterende løsninger frem til fristen. ## Introduksjon Prompt Flow er Microsofts rammeverk for å utvikle, teste og deploye LLM-baserte applikasjoner gjennom en visuell workflow-editor. Produksjonsdeployment av Prompt Flow handler om å ta en testet og evaluert flow fra utviklingsmiljø til skalerbar produksjon med robuste CI/CD-pipelines, overvåking og governance. Dette dokumentet dekker hele produksjonsdeployment-spekteret: fra lokal utvikling til Azure Managed Online Endpoints, CI/CD-integrering, monitoring med Application Insights, og GenAIOps-praksiser for LLM-baserte applikasjoner. **Hvorfor dette er kritisk for produksjon:** - **Lifecycle management**: Strukturert overgang fra eksperiment til produksjon med versjonshåndtering - **Skalerbarhet**: Automatisk skalering av endpoints basert på trafikk - **Observability**: Fullstendig trace, metrics og logging via Application Insights - **Governance**: Model registry, conditional registration, og audit trails - **Continuous deployment**: Automatisert testing, evaluering og deployment via GitHub Actions eller Azure DevOps --- ## Kjernekomponenter ### 1. Flow Development Lifecycle Prompt Flow følger en fire-fase livssyklus: **Initialisering** - Definer business objective og samle sample data - Bygg basic prompt structure i Prompt Flow editor (DAG-basert) - Utvikle flow med nodes (LLM, Python, prompts) og connections **Eksperimentering** - Kjør flow mot sample data i Azure AI Foundry eller VS Code extension - Test single inputs og batch runs - Iterer på prompt variants og node-konfigurasjoner **Evaluering og refinement** - Kjør batch runs mot større datasett - Bruk built-in evaluation flows (groundedness, relevance, etc.) - Sammenlign variants og hyperparameters - Register model i Azure Machine Learning Model Registry ved godkjente resultater **Produksjon** - Deploy til Azure Managed Online Endpoint eller Kubernetes - Aktiver Application Insights for tracing og metrics - Implementer A/B deployment for gradvis rollout - Monitor performance og samle user feedback ### 2. Deployment Targets **Azure Managed Online Endpoint** (anbefalt for de fleste scenarier) - Fully managed infrastruktur med autoscaling - Integrated med Azure RBAC og managed identities - Built-in support for A/B testing via traffic splitting - Krever `Microsoft.PolicyInsights` resource provider registrert **Kubernetes Online Endpoint** - For on-premises eller hybrid scenarios - Krever custom instance types og manuell infrastruktur-oppsett - Nyttig for air-gapped environments **Docker/Custom Platforms** - Flow kan eksporteres som Docker image basert på `promptflow-runtime-stable` base image - Deploy til Azure App Service, Azure Container Apps, eller on-prem - Krever custom monitoring-oppsett ### 3. Environment Configuration **Base Image** - Default: `mcr.microsoft.com/azureml/promptflow/promptflow-runtime-stable:latest` - Kan spesifiseres i `flow.dag.yaml` under `environment` section - Støtter custom images for private feeds eller spesialiserte dependencies **Requirements.txt** - Plasseres i flow root folder - Dependencies installeres automatisk ved deployment - Eksempel: ``` openai>=1.0.0 azure-identity promptflow-tools ``` **Environment Variables** - Settes i deployment YAML under `environment_variables` - Kritiske variabler: - `APPLICATIONINSIGHTS_CONNECTION_STRING`: For tracing til custom App Insights - `PROMPTFLOW_SERVING_ENGINE`: `flask` (default) eller `fastapi` (fra SDK 1.10.0+) - `PROMPTFLOW_WORKER_NUM`: Antall worker prosesser (default = CPU cores) - `PROMPTFLOW_WORKER_THREADS`: Threads per worker (default = 1, kun hvis flow er thread-safe) - `PRT_CONFIG_OVERRIDE`: Connection overrides for deployment ### 4. Deployment Process (Azure Foundry Portal) **Steg 1: Forbered Flow** 1. Test flow grundig med batch runs og evaluations 2. Verifiser at connections fungerer (Azure OpenAI, AI Search, etc.) 3. Sjekk at `requirements.txt` inneholder alle dependencies **Steg 2: Deploy fra UI** 1. Velg **Deploy** i flow editor eller run detail page 2. Konfigurer **Basic Settings**: - Endpoint name (nytt eller eksisterende) - Deployment name (unique per endpoint) - Virtual machine type (Standard_DS3_v2, Standard_F4s_v2, etc.) - Instance count (minimum 3 for high availability) - Inference data collection (enable for monitoring) 3. **Advanced Settings - Endpoint**: - Authentication type: Key-based (persistent keys) eller Token-based (rotating tokens) - Identity type: System-assigned (auto-created) eller User-assigned (pre-created) - For User-assigned: Grant `Azure Machine Learning Workspace Connection Secrets Reader` før deployment 4. **Advanced Settings - Deployment**: - Environment: Custom eller default (basert på flow.dag.yaml) - Tags for organisering - Application Insights diagnostics: Enable for tracing 5. **Advanced Settings - Outputs & Connections**: - Velg hvilke flow outputs som inkluderes i endpoint response - Override connections hvis produksjon bruker andre enn dev **Steg 3: Grant Permissions** - For System-assigned identity: Assign `Azure Machine Learning Workspace Connection Secrets Reader` role - For connections med Entra ID auth (f.eks. Azure OpenAI): Assign `Cognitive Services OpenAI User` role - For User-assigned: Grant ACR Pull + Storage Blob Data Reader på hub registry/storage **Deployment tar 15-20 minutter** (endpoint creation, model registration, deployment creation) ### 5. CI/CD Integration **GitHub Actions Workflow (GenAIOps Template)** Microsoft tilbyr [genaiops-promptflow-template](https://github.com/microsoft/genaiops-promptflow-template) med følgende process: 1. **Feature branch → Dev branch (PR)**: - Build validation pipeline kjører - Experimentation flows testes - Manual approval kreves 2. **Dev branch (merge)**: - CI pipeline kjører experimentation + evaluation flows sekvensielt - Registrerer flows i Azure ML Model Registry hvis metrics passerer threshold - CD pipeline deployer til dev environment (managed endpoint) - Integration og smoke tests kjøres 3. **Dev → Release branch (PR)**: - Samme CI/CD loop for prod environment - A/B deployment støttes via traffic splitting **Key GitHub Actions Steps**: ```yaml - name: Install promptflow CLI run: pip install promptflow promptflow-tools promptflow[azure] - name: Run flow run: pf run create --flow --data - name: Evaluate flow run: pf run create --flow --run - name: Register model run: az ml model create --name --path - name: Deploy endpoint run: az ml online-deployment create --file deployment.yml ``` **Azure DevOps Pipelines**: - Tilsvarende struktur med Azure DevOps tasks - Bruk `AzureCLI@2` task for `az ml` commands - Service principal autentisering via Azure Service Connection ### 6. Model Registry and Versioning **Conditional Registration**: - GenAIOps template registrerer kun nye versjoner hvis: - Dataset har endret seg (SHA hash comparison) - Evaluation metrics overstiger threshold - Flow definition har endret seg **Registration Format**: ```yaml name: my-flow-model version: 1 type: mlflow_model path: azureml://jobs//outputs/artifacts/paths/model properties: azureml.promptflow.source_flow_id: ``` **Registry Benefits**: - Cross-workspace sharing av models - Lineage tracking til training jobs - Role-based access control per model - Tagging for lifecycle stages (dev, staging, prod) --- ## Arkitekturmønstre ### Pattern 1: Single Environment Deployment **Bruk når:** - Enkel applikasjon uten kompleks governance - Liten team med begrenset DevOps-kapasitet - Proof-of-concept eller interne tools **Arkitektur:** ``` Developer → Azure AI Foundry Portal → Manual Deploy → Single Endpoint ``` **Fordeler:** - Rask time-to-deployment - Ingen CI/CD overhead - Enkel å forstå for ikke-DevOps-team **Ulemper:** - Ingen automated testing - Mangler audit trail - Vanskelig rollback ### Pattern 2: Multi-Stage CI/CD Pipeline **Bruk når:** - Enterprise produksjon med compliance krav - Team med DevOps/Platform engineering - Kritiske applikasjoner med SLA **Arkitektur:** ``` Feature Branch → PR → Dev CI/CD → Dev Endpoint ↓ Manual Gate ↓ Release Branch → Prod CI/CD → Prod Endpoint (Blue-Green) ``` **Fordeler:** - Automated evaluation og quality gates - Audit trail via Git history - Rollback via pipeline re-run - A/B testing support **Ulemper:** - Høyere initial setup cost - Krever CI/CD infrastruktur ### Pattern 3: A/B Deployment for Gradual Rollout **Bruk når:** - Testing ny prompt versjon i produksjon - Risikoreduksjon ved store endringer - Data-driven prompt optimization **Arkitektur:** ``` Endpoint: my-flow-endpoint ├── Deployment A (80% traffic): v1.0 (current stable) └── Deployment B (20% traffic): v2.0 (new variant) ``` **Implementation (Azure CLI)**: ```bash # Deploy new version az ml online-deployment create --name v2 --endpoint my-flow-endpoint \ --file deployment-v2.yml --traffic-percentage 20 # Gradvis øk traffic az ml online-endpoint update --name my-flow-endpoint \ --traffic "v1=50 v2=50" # Full rollout az ml online-endpoint update --name my-flow-endpoint \ --traffic "v2=100" ``` ### Pattern 4: Local-to-Cloud Development Loop **Bruk når:** - Rapid iteration på prompts - Team collaboration på flows - Hybrid dev environment (local + cloud compute) **Workflow:** ``` 1. Local Dev (VS Code + Prompt Flow extension) ↓ 2. Test locally: pf flow test --flow . ↓ 3. Submit batch run to cloud: pf run create --runtime serverless ↓ 4. View results i Azure ML Studio ↓ 5. Export flow til Git → CI/CD pipeline ``` **Fordeler:** - Fast iteration cycle - Cloud compute for batch testing - Version control via Git --- ## Beslutningsveiledning ### Når velge Managed Online Endpoint vs. Kubernetes? | Kriterium | Managed Endpoint | Kubernetes Endpoint | |-----------|------------------|---------------------| | **Infrastruktur-overhead** | Ingen (fully managed) | Høy (cluster management) | | **Skalerbarhet** | Auto-scaling built-in | Manual HPA setup | | **Kostnads-transparens** | Pay-per-instance | Cluster overhead + instances | | **Hybrid/On-prem** | Nei (Azure only) | Ja (AKS eller on-prem K8s) | | **Compliance** | Standard Azure compliance | Custom compliance setup | | **Anbefalt for** | De fleste scenarier | Hybrid cloud, air-gapped | **Anbefaling for offentlig sektor:** Managed Endpoint i utgangspunktet, Kubernetes kun hvis hybrid cloud eller on-prem er lovpålagt. ### Når bruke FastAPI vs. Flask serving engine? | Faktor | Flask (default) | FastAPI | |--------|-----------------|---------| | **Tilgjengelighet** | Alle SDK-versjoner | SDK >= 1.10.0 | | **Ytelse** | Stabil, proven | Høyere throughput (async) | | **Concurrency** | Process-based (multi-worker) | Async event loop + multi-worker | | **Thread-safety** | Mindre kritisk | Krever thread-safe flow code | **Aktivering:** ```yaml environment_variables: PROMPTFLOW_SERVING_ENGINE: fastapi ``` **Anbefaling:** Start med Flask (default), switch til FastAPI hvis latency/throughput blir bottleneck OG flow code er thread-safe. ### Concurrency Tuning **Formula:** ``` max_concurrent_requests_per_instance = worker_num × worker_threads × multiplier hvor multiplier = - 1.0 hvis request time > 200ms (CPU-bound) - 1.5-2.0 hvis request time <= 200ms (I/O-bound) ``` **Eksempel for 4-core VM med 100ms request time:** ```yaml request_settings: max_concurrent_requests_per_instance: 12 # 4 workers × 1 thread × 1.5 environment_variables: PROMPTFLOW_WORKER_NUM: 4 PROMPTFLOW_WORKER_THREADS: 1 ``` --- ## Integrasjon med Microsoft-stakken ### Azure AI Foundry Integration **Flow Development**: - Drag-and-drop DAG editor for LLM, Python, Prompt nodes - Built-in connections til Azure OpenAI, AI Search, Content Safety - Variant experimentation (side-by-side prompt comparison) **Compute Session Management**: - Serverless compute (on-demand, billed per minute) - Compute instance (dedicated, faster startup for iteration) - Automatisk pause etter inaktivitet **Deployment Lifecycle**: - Flow → Test → Batch Run → Evaluation → Model Registry → Endpoint - All steps traceable via Foundry portal UI ### Azure Machine Learning Integration **Model Registry**: - Cross-workspace sharing via Azure ML Registry (multi-region) - Lineage tracking: flow → training job → dataset - RBAC per model version **Endpoints & Deployments**: - Same infrastructure som standard ML model deployments - Supports managed identities for secure connection access - Integrated med Azure Monitor for operational metrics ### Application Insights Integration **Tracing**: - OpenTelemetry-compliant trace data - Captures: LLM calls, node execution, token consumption, latency - Transaction search for debugging individual requests **Metrics** (under `promptflow standard metrics` namespace): - `token_consumption` (counter): prompt_tokens, completion_tokens, total_tokens - `flow_latency` (histogram): end-to-end request time - `flow_request` (counter): request count per flow - `node_latency` / `node_request`: per-node breakdown - `rpc_latency` / `rpc_request`: external API call metrics - `flow_streaming_response_duration`: for streaming endpoints **Enabling:** ```yaml # I deployment.yml app_insights_enabled: true # Eller custom App Insights: environment_variables: APPLICATIONINSIGHTS_CONNECTION_STRING: "InstrumentationKey=...;IngestionEndpoint=..." ``` **Viewing Metrics**: 1. Azure Portal → Application Insights → Metrics 2. Metric Namespace: `promptflow standard metrics` 3. Metric: Velg fra dropdown (token_consumption, flow_latency, etc.) 4. Split by dimension: flow, node, response_code ### Feedback Collection API Prompt Flow serving eksponerer `/feedback` endpoint for post-inference feedback: **Request:** ```http POST https://.azureml.ms/feedback Authorization: Bearer Content-Type: application/json traceparent: 00---01 { "rating": 5, "comment": "Excellent answer", "user_id": "user@example.com" } ``` **Trace Correlation**: - `traceparent` header linker feedback til original request trace - Feedback lagres som span i Application Insights - Enables correlation analysis (latency vs. rating, etc.) ### Azure DevOps Integration **Pipeline Tasks**: - `AzureCLI@2`: For `az ml` commands - `PythonScript@0`: For `pf` CLI commands - `PublishPipelineArtifact@1`: Publish evaluation reports (CSV, HTML) **Artifact Management**: - Flow folder lagres i Azure Repos - Evaluation results publiseres som pipeline artifacts - Model versions linkes til Git commits --- ## Offentlig sektor (Norge) ### Compliance ved Deployment **Krav fra Digdir:** - **Etterprøvbarhet**: CI/CD pipeline gir audit trail (Git commits, pipeline runs, model versions) - **Versjonskontroll**: Model registry sporer alle versjoner med lineage til training data - **Tilgangskontroll**: Managed identities + Azure RBAC sikrer least privilege - **Datahåndtering**: Inference data collection kan disabled hvis personvern krever det **DPIA for Deployment**: - Vurder om inference logs inneholder persondata (aktiveres via `inference_data_collection`) - Application Insights trace data kan inneholde brukerinput → anonymiser i production - Feedback API må ha consent-mekanisme hvis brukerdata lagres ### Utredningsinstruksen: Teknologivalg **Deployment Target**: - **Managed Endpoint**: Standard valg, dokumenter kostnads-modell (instance count × VM cost) - **Kubernetes**: Kun hvis hybrid cloud er påkrevd, dokumenter driftskostnader - **Docker on-prem**: Kun hvis sky ikke er tillatt, dokumenter security patching-ansvar **Alternativer-analyse**: | Alternativ | Fordel | Ulempe | |------------|--------|--------| | Managed Endpoint | Fully managed, auto-scaling | Azure lock-in, cloud-only | | AKS | Hybrid, full kontroll | Høy driftskostnad | | On-prem Docker | Ingen sky-avhengighet | Manuell skalering, patching | **Anbefaling:** Managed Endpoint med fallback til AKS hvis hybrid cloud er lovpålagt. ### ROS-analyse: Deployment Risiko | Trussel | Sannsynlighet | Konsekvens | Tiltak | |---------|---------------|------------|--------| | Endpoint key leak | Middels | Høy | Bruk Token-based auth (roterende) + Key Vault | | Connection credentials i logs | Lav | Høy | Disable inference data collection | | Unauthorized model update | Lav | Middels | RBAC på Model Registry + approval gates | | DDoS på endpoint | Middels | Middels | Azure DDoS Protection + rate limiting | --- ## Kostnad og lisensiering ### Deployment Kostnader **Managed Online Endpoint**: ``` Kostnad = (VM cost per hour × instance count × uptime hours) + (Azure ML deployment overhead) + (Application Insights ingestion + retention) ``` **Eksempel (Standard_DS3_v2, 3 instances, 24/7):** - VM cost: ~70 NOK/time × 3 instances × 730 timer/måned = ~153 300 NOK/måned - Application Insights: ~1000-5000 NOK/måned (avhengig av trace volume) - **Total: ~155 000-160 000 NOK/måned** **Kostnadsoptimalisering**: - Bruk autoscaling (min 1 instance, max 5) for variabel trafikk - Scheduled scaling (nedskalering utenfor arbeidstid) - Reserved instances for forutsigbar last (opptil 72% rabatt) **Compute Session (Development)**: - Serverless: ~5 NOK/time, billed per minute - Compute instance: ~60-150 NOK/time avhengig av size, billed hourly - Auto-pause etter 30 min inaktivitet (konfigurerbar) ### Lisensiering **Azure AI Foundry**: - Included i Azure subscription, ingen separat lisens - Betaler kun for underliggende resources (compute, storage, AI services) **Prompt Flow**: - Open source (MIT license) + Azure-managed variant - Ingen lisenskostnad for SDK/CLI - Azure-managed deployment krever Azure ML workspace (ingen ekstra lisens) **Nødvendige Azure Services**: - Azure Machine Learning workspace (gratis, betaler kun for compute/storage) - Application Insights (pay-as-you-go) - Optional: Azure ML Registry for cross-workspace sharing (ingen ekstra kostnad) --- ## For arkitekten (Cosmo) ### Når anbefale Prompt Flow Deployment? **Sterk anbefaling når:** - Kunden allerede bruker Azure AI Foundry for LLM-utvikling - Behov for visuell DAG-editor (forenkler kommunikasjon med ikke-tekniske stakeholders) - Team mangler dyp MLOps-kompetanse (Prompt Flow abstraherer bort mye kompleksitet) - Krav om rapid iteration på prompts (variant experimentation built-in) **Vurder alternativer når:** - Kunden har eksisterende MLOps pipeline (f.eks. Kubeflow, MLflow) → integrer Prompt Flow som model format - Kompleks custom orchestration logic → Semantic Kernel eller LangChain kan være bedre fit - Pure API-basert workflow uten visuell editor-behov → Azure Functions + Azure OpenAI direkte ### Red Flags å se etter **Deployment Anti-patterns:** - Deploying direkte fra developer laptop → alltid bruk CI/CD - Hardkoding connection credentials i flow → bruk Azure Key Vault references - Ingen evaluations før deployment → alltid kjør eval flows - Single instance deployment for produksjon → minimum 3 instances for HA - Ingen Application Insights → umulig å debugge production issues **Cost Traps:** - 24/7 high-end VMs uten autoscaling → kan koste 100K+ NOK/måned unødvendig - Inference data collection enabled uten retention policy → App Insights storage kosten eksploderer - Compute sessions som ikke auto-pauserer → betaler for idle compute ### Spørsmål å stille kunden 1. **Development Process**: "Hvordan itererer teamet på prompts i dag? Lokalt eller i sky?" - *Steer til:* Local dev (VS Code) → cloud batch testing → CI/CD deployment 2. **Deployment Frequency**: "Hvor ofte oppdaterer dere prompts/flows i produksjon?" - *Hvis daglig/ukentlig:* CI/CD er kritisk - *Hvis månedlig+:* Manual deployment kan aksepteres 3. **Traffic Pattern**: "Er trafikken konstant eller variabel (dag vs. natt, virkedag vs. helg)?" - *Hvis variabel:* Autoscaling er must-have - *Hvis konstant:* Reserved instances for kostnadskutt 4. **Compliance**: "Har dere krav om on-prem eller hybrid cloud?" - *Hvis ja:* Kubernetes endpoint eller Docker export - *Hvis nei:* Managed endpoint (default) 5. **Monitoring**: "Hvordan måler dere kvalitet på LLM-output i dag?" - *Hvis ingen:* Setup evaluation flows + App Insights metrics - *Hvis eksisterende:* Integrer med /feedback API ### Decision Tree: Deployment Strategy ``` Er dette første gang kunden deployer LLM-basert app? ├─ Ja → Start med Managed Endpoint + Manual deployment (rask learning) │ Etter 1-2 måneder → Introduser CI/CD pipeline │ └─ Nei (har erfaring) → Direkte til CI/CD pipeline ├─ GitHub brukt? → GitHub Actions template └─ Azure DevOps brukt? → Azure Pipelines template ``` ### Eksempel på anbefaling (offentlig sektor use case) **Scenario:** NAV skal deploye chatbot for sykepenger-spørsmål. **Anbefalt arkitektur:** 1. **Development**: Azure AI Foundry → Prompt Flow editor (DAG-basert) 2. **CI/CD**: GitHub (NAV sin standard) + GenAIOps template - Feature branch: PR trigger → build validation - Main branch: CI trigger → evaluation → model registry → dev endpoint - Prod branch: Manual approval gate → prod endpoint 3. **Deployment**: Managed Online Endpoint - 3 instances (Standard_DS3_v2) med autoscaling 1-5 - Token-based auth (roterende credentials) - System-assigned managed identity 4. **Monitoring**: Application Insights - Token consumption metrics (budsjettsporing) - Latency metrics (SLA tracking) - Custom feedback via /feedback API (brukertilfredshet) 5. **Compliance**: - Inference data collection DISABLED (personvern) - Model registry for versjonssporing (etterprøvbarhet) - RBAC på endpoint + model registry (tilgangskontroll) **Kostnadsestimat:** - Deployment: ~160 000 NOK/måned (3 instances 24/7) - Compute sessions (dev): ~10 000 NOK/måned (5 utviklere, 4 timer/dag) - Application Insights: ~3 000 NOK/måned - **Total: ~173 000 NOK/måned** **Alternativ (kostnadsoptimalisert):** - Autoscaling 1-3 instances med scheduled scaling (08:00-16:00 virkedager) - Reserved instances (1-year commit) - **Redusert kostnad: ~80 000 NOK/måned** --- ## Kilder og verifisering **Microsoft Learn Dokumentasjon:** 1. [Deploy a flow for real-time inference (Azure AI Foundry)](https://learn.microsoft.com/en-us/azure/foundry-classic/how-to/flow-deploy?view=foundry-classic) – Offisiell guide for deployment via portal 2. [GenAIOps with Prompt Flow and GitHub](https://learn.microsoft.com/en-us/azure/machine-learning/prompt-flow/how-to-end-to-end-llmops-with-prompt-flow?view=azureml-api-2) – CI/CD pipeline patterns og lifecycle management 3. [Enable tracing and collect feedback for a flow deployment](https://learn.microsoft.com/en-us/azure/foundry-classic/how-to/develop/trace-production-sdk?view=foundry-classic) – Application Insights integration og metrics 4. [Deploy a flow to online endpoint with CLI/SDK](https://learn.microsoft.com/en-us/azure/machine-learning/prompt-flow/how-to-deploy-to-code?view=azureml-api-2) – Advanced deployment configuration (concurrency, FastAPI, etc.) 5. [Integrate Prompt Flow with DevOps](https://learn.microsoft.com/en-us/azure/machine-learning/prompt-flow/how-to-integrate-with-llm-app-devops?view=azureml-api-2) – Local-to-cloud development workflow **GitHub Resources:** - [GenAIOps Prompt Flow Template](https://github.com/microsoft/genaiops-promptflow-template) – Reference implementation for CI/CD - [Prompt Flow SDK Examples](https://github.com/Azure/azureml-examples/tree/main/cli/generative-ai/promptflow) – Code samples for deployment automation **Verifisert:** 2026-06-19 via microsoft-learn MCP server (søk + fetch på 5 offisielle docs)