Program 18 · Tech stack specialisation

SCIKIQ Certified Data and AI EngineerOpenAI + Azure Tech Stack

Microsoft’s stack is where most large enterprises will run their agents, because that is where their identity, data and compliance posture already live. The skill that matters is not calling the API — it is deploying into an estate with Entra, Purview and a security team that will ask hard questions.

  • 60 hrstaught
  • 20hands-on AI labs
  • 4assessment tests
  • +20 hrs2 E2E capstones
Multi-modelFoundry hosts OpenAI, Anthropic, Mistral, DeepSeek and MAI on one control planeMicrosoft
GAFoundry Agent Service on a Responses-API runtime with MCP and A2AMicrosoft
2026Open trust stack introduced: ACS and the ASSERT eval frameworkMicrosoft Build
1Control plane for runtime, grounding, memory, evaluation and governanceMicrosoft
01
Part 1 · The business

The value chain, the people, the trends

Part 1 is the delivery lifecycle: the sequence a SCDAI engineer works through on any engagement, and what each stage looks like specifically on the Microsoft stack.

The agent delivery lifecycle on Azure

Six stages. Select one to see what it means on this stack.

Who you work with on this stack

On Microsoft engagements the platform and security teams are stakeholders from day one. Select one to light the stages they own.

What is changing on this stack

The 2026 read on the Microsoft agent platform.

Where these numbers come from — 2 sources

Consulted when this program was written, in July 2026. Each entry names the claim on this page that it backs, so the pairing stays checkable if the copy is later edited.

  1. IndustryMicrosoft Foundry at Build 2026: from demos to production systemsMulti-model control plane; ACS and ASSERT
  2. IndustryBuild 2026 for Azure Architects: the new AI application stackFoundry Agent Service, Foundry IQ, Agent Framework
02
Part 2 · Data and meaning

The platform building blocks

Part 2 is the concrete stack: what each layer is on Azure, and where the enterprise controls bite.

The platform landscape

Six building blocks you will use on almost every engagement.

Models & routing

GPT-family, o-series and partner models with a router for cost/quality trade-offs.

Foundry Models, model router

Agent runtime

Managed agent execution on the Responses API with tool and multi-agent support.

Foundry Agent Service, Agent Framework

Retrieval

Hybrid search with semantic ranking and per-user security trimming.

Azure AI Search, Foundry IQ

Data estate

Where the enterprise content actually lives, with classification attached.

Fabric, OneLake, SharePoint, Purview

Identity & network

Managed identity, on-behalf-of flows, private endpoints and network isolation.

Entra ID, Private Link, VNet

Assurance

Evaluation, content safety, tracing and cost telemetry.

Foundry evaluations, Content Safety, Azure Monitor
03
Part 2 · The architecture

How it is actually built

The layers a deployment needs, what each one holds, and what the engineer owns there.

The reference architecture

Six layers. Click one to see the components and what the engineer owns.

What you will actually use

Models
  • GPT-family and o-series reasoning models
  • Partner models via Foundry
  • Model router for tiering
Agents
  • Foundry Agent Service
  • Microsoft Agent Framework
  • MCP tool servers
  • A2A multi-agent
Grounding
  • Azure AI Search hybrid + semantic rank
  • Foundry IQ knowledge layer
  • Security trimming
Data
  • Microsoft Fabric / OneLake
  • Microsoft Graph
  • Purview classification
Governance
  • Entra ID managed identity
  • Private Link isolation
  • Azure AI Content Safety
Operations
  • Foundry evaluations
  • Azure Monitor + OTel
  • Provisioned throughput

Constraints that shape the design

Landing zone discipline

Enterprises expect deployment inside an existing landing zone with policy, identity and networking already defined. Plan for it rather than around it.

Permission-trimmed retrieval

If the index does not respect source permissions per user, the deployment is a data-leak incident waiting to be found.

Quota and capacity

Quota is regional and finite. Request early and design for provisioned throughput where latency and cost must be predictable.

Region and residency

Model availability differs by region and residency rules may forbid the obvious one. Confirm before designing.

04
Part 3 · Getting it done

Where the business and the technology meet

Part 3 puts the lifecycle and the platform together: the patterns you will build repeatedly, then the modules, labs and capstones that prove you can.

Patterns, mapped to the lifecycle and the architecture

Filter by lifecycle stage or by earned autonomy. Selecting a use case jumps the value chain and the architecture to the stage and layer it depends on.

Value chain stage
Autonomy earned
12 use cases

The delivery playbook

How an Azure engagement actually runs.

01

Day 1 — land in the landing zone

Get the subscription, managed identity, quota and private networking sorted before writing code. These are the long-lead items.

02

Week 1 — grounding before agents

Build permission-trimmed retrieval and measure recall. Almost every quality problem later traces back to this.

03

Week 2-3 — thin slice with evals

Ship one workflow end to end with an eval set and a baseline from day one.

04

Week 4-5 — identity and safety review

Take on-behalf-of identity, content safety and network isolation to the security architect early.

05

Week 6 — cost model and handover

Model cost per task, choose the pricing mode, and hand over runbook, evals and agent inventory.

The curriculum

4 modules, 60 taught hours, 20 hands-on labs and 4 assessments — every lab provisioned and graded by the SCIKIQ Agentic AI Playground. Open a module to see its labs.

01Foundry foundations and enterprise landingThe platform, the landing zone and the model decisions that determine everything downstream.15 hrs · 5 labs
Foundry architectureModel catalogue and routingLanding zone and quotaRegions and residencyStructured outputsCost per task
01
First agentDeploy a Foundry agent inside a landing zone with managed identity.
02
Model routingRoute between tiers on measured difficulty and quantify the saving.
03
Structured outputsEnforce schema-valid outputs and handle validation failure.
04
Quota planningModel capacity for a workload and choose a pricing mode.
05
Cost baselineMeasure cost per task and establish a baseline to improve against.
Assessment 01 — Platform foundations30 items · 45 min · pass 70%
02Grounding with Azure AI SearchEnterprise retrieval done properly — hybrid, ranked and permission-trimmed.15 hrs · 5 labs
Hybrid retrievalSemantic rankingSecurity trimmingChunking strategyFreshnessRetrieval evaluation
01
Hybrid indexBuild a hybrid index and measure recall against a labelled set.
02
Security trimmingEnforce per-user permissions at query time and prove it.
03
Chunking studyCompare chunking strategies empirically rather than by preference.
04
Freshness pipelineKeep the index current and detect staleness.
05
Retrieval evalsGate builds on recall@k and citation correctness.
Assessment 02 — Retrieval & grounding30 items · 45 min · pass 70%
03Agents, tools and multi-agent orchestrationAgent Service, MCP tools, connected agents and the identity model underneath them.15 hrs · 5 labs
Agent Service runtimeMCP tool designOn-behalf-of identityMulti-agent patternsApproval gatesContainment
01
MCP tool serverExpose a line-of-business system as a typed, scoped MCP tool.
02
On-behalf-ofFlow delegated user identity through a multi-step agent.
03
Multi-agentBuild a supervisor/worker workflow with connected agents.
04
Approval gateInsert a human approval that blocks the action, not just the reply.
05
ContainmentAdd budget, loop and blast-radius limits and test them.
Assessment 03 — Agents, tools & identity30 items · 45 min · pass 70%
04Evaluation, safety and production operationsProving it works, keeping it safe and running it at a cost that survives review.15 hrs · 5 labs
Eval sets and baselinesRegression gatingContent safetyNetwork isolationOTel tracingCost management
01
Eval harnessBuild an eval set with a baseline and wire it into CI.
02
Regression gateBlock a deployment on a groundedness regression.
03
Safety layerAdd layered content safety and defeat a jailbreak attempt.
04
Private deploymentDeploy with private endpoints and prove no public egress.
05
Trace and costInstrument OTel GenAI traces and halve cost per task.
Assessment 04 — Evaluation, safety & operations35 items · 50 min · pass 70%

Two capstones — 20 hours

End-to-end agent design, development, deployment and testing, 10 hours each. Reviewed by a Senior SCDAI Engineer against a published rubric.

Capstone A — Permission-trimmed enterprise agent

Build an agent grounded on enterprise content with provable per-user permission trimming, delegated identity, an eval baseline and a measured cost per task.

Capstone B — Multi-agent workflow with regression gating

Build a connected multi-agent workflow with MCP tools, human approval on consequential actions, CI-enforced eval gating and full OTel tracing.

What you deliver, and how it is marked
  • A running agent, deployed on the program's target stack, reachable by a reviewer.
  • An architecture note: boundaries, tools, autonomy level and the trade-offs you took.
  • A versioned eval set with a baseline and your final scores.
  • A trace walkthrough of one success and one deliberate failure.
  • Cost per task, measured — not estimated.
  • A runbook and rollback path a client team could operate on Monday.
Problem fit15%Is this a decision worth automating, scoped to a defensible boundary?
Architecture20%Right pattern for the constraints; autonomy earned, not assumed.
Grounding & accuracy20%Measured groundedness against the eval set, with the failures named.
Safety & compliance20%Domain controls actually enforced, and demonstrably so.
Operability15%Traces, runbook, rollback, cost — could someone else run this?
Communication10%Can a client executive follow the reasoning in ten minutes?

One lab, start to finish

Every lab in this program follows the shape below. This is lab 02 in full — the brief you are given, the environment that is provisioned for you, the code you start from and the assertions that decide whether you passed.

Module 02 · Grounding with Azure AI Search

Permission-trimmed retrieval

Prove retrieval respects each user’s permissions at query time.

The brief

Index a corpus where three user groups have overlapping but unequal access. Build retrieval that trims at query time, then attempt to extract a restricted document as each user.

Provisioned for you
  • Azure AI Search index, 5k documents
  • 3 user identities with distinct ACLs
  • 60 labelled questions, 18 targeting restricted content
You start from this
def search(query, user_token):
    """Trim by the caller's permissions in the query filter -- not by
    filtering results after they have already been retrieved."""
    raise NotImplementedError
What the grader asserts
  1. No restricted document appears in results for an unentitled user
  2. Restricted content never reaches the model context, not merely the response
  3. Recall for entitled users is unchanged by the trimming
  4. Permission changes take effect without a reindex
  5. Traces contain no restricted content

Pass barZero leaks across all 18 probing questions for all 3 identities.

StretchAdd on-behalf-of identity so the agent inherits the calling user rather than a service principal.

05
Assessment

Assessed, not attended

Every module ends with a timed, randomised assessment delivered through the SCIKIQ Agentic AI Playground. The certificate requires a pass on all of them plus two reviewed capstones.

Assessment blueprint

What each test covers, how long it runs, and how many items are currently in the versioned bank behind it.

#Assessment & coverageItemsTimeIn bank
01Platform foundationsFoundry architectureModel selection and routingLanding zone and quotaCost per task3045 min4
02Retrieval & groundingHybrid retrievalSecurity trimmingChunkingRetrieval metrics3045 min4
03Agents, tools & identityAgent runtimeMCP tool designDelegated identityMulti-agent and containment3045 min4
04Evaluation, safety & operationsEval design and gatingContent safetyNetwork and identity securityObservability and cost3550 min4
Single best answerOne defensible option among plausible distractors drawn from real field mistakes.
Scenario judgementA client situation with constraints; you pick the action a Senior SCDAI Engineer would take.
Architecture selectionGiven non-functional requirements, choose the pattern and justify the trade-off.
Failure diagnosisA trace, an eval report or a cost curve — identify the root cause.
  • Each module ends with a timed assessment; the program certificate requires a pass on every one.
  • Items are drawn at random from a versioned bank, so no two learners sit an identical paper.
  • Pass mark is 70%. Two retakes are included, each with a fresh draw.
  • Scenario items carry double weight — they are the ones that predict field performance.
  • Capstones are reviewed against a published rubric by a Senior SCDAI Engineer, not auto-graded.

Try four questions from the bank

Real items, drawn from 16 in this program's bank — weighted toward the scenario and diagnosis types, because those are the ones that predict field performance. Instant feedback, nothing saved.

Four sample items — one attempt each, then the reasoning is shown.

Q1A client insists on the largest model for every task. What do you do?

Tier selection should be empirical. Routing easy tasks to cheaper models is usually the largest single cost lever.

Q2Enterprise retrieval must respect per-user permissions. Where is this enforced correctly?

Post-filtering means the content was retrieved and may appear in traces or influence generation. Trim at query time.

Q3Why expose systems as MCP tools rather than embedding integration in each agent?

The tool estate is the durable asset. Per-agent integration multiplies both build cost and review burden.

Q4A content safety filter blocks legitimate clinical or financial terminology. What is the fix?

Default safety settings are tuned for consumer contexts. Enterprise domains need calibration, not bypass.

06
Career & outcomes

What this makes you, and where it goes next

The same ladder whichever specialisation you enter through — what changes is the domain you go deep in. Below: how the program is delivered, the skills it moves, the roles it leads to, and the specialisations closest to this one.

Available two ways

The same labs, assessments and capstones, delivered to an enterprise cohort or to individual professionals.

B2B

Direct to enterprise

Cohorts of 20 to 2,000+ on your own tenancy, with your data patterns and your cloud. Skill-gap baselining up front, per-team mastery reporting throughout, and capstones scoped against your real backlog so the output is deployable work.

  • Private cohort on your tenancy
  • Baseline skills assessment before kick-off
  • Capstones scoped to your backlog
  • Per-team mastery dashboards for L&D
  • Optional Senior SCDAI Engineer architecture reviews
B2C

Direct to individual professionals

The same labs, assessments and capstones for individual engineers and analysts, run on shared infrastructure with a fixed cohort calendar. You leave with a graded portfolio, not a certificate of attendance.

  • Fixed-date cohorts, self-paced within them
  • Same graded labs and item bank
  • Portfolio-ready capstones you own
  • Certificate on a pass in every module
  • Community and office-hours access

Skill matrix

Find your row and aim one column right. The Playground scores you against this after every module.

SkillBeginnerIntermediateAdvanced
Azure platformCalls a model endpoint.Deploys inside a landing zone with managed identity.Designs an enterprise agent estate with policy and cost control.
Enterprise retrievalBuilds an index.Enforces security trimming and measures recall.Designs grounding for a permissioned estate at scale.
Delegated identityUses a service key.Implements on-behalf-of flows.Designs least-privilege identity across a tool estate.
Context engineeringWrites clear prompts.Structures retrieval, tools and state deliberately.Designs context strategy for reliability and cost at scale.
Retrieval & groundingBuilds basic vector search.Tunes chunking, hybrid search and reranking.Designs graph + vector grounding with measured recall.
Agent orchestrationRuns a single tool-calling agent.Builds supervised multi-step and multi-agent flows.Designs autonomy boundaries and failure containment.
Tool & system integrationCalls a documented API.Writes an MCP server over a system of record.Designs a least-privilege tool estate across systems.
EvaluationEyeballs outputs.Builds labelled eval sets and regression gates.Runs online evals with drift and judge calibration.
Observability & costReads logs.Traces runs, tracks tokens and latency.Owns cost per task and capacity planning in production.
Security & guardrailsAdds output filters.Mitigates the OWASP LLM Top 10 in a build.Threat-models an agent estate and proves controls.
Client deliveryTakes notes in a workshop.Runs discovery and scopes a thin slice.Owns the account technically, from scope to handover.

Where it takes you

The SCDAI ladder is the same whichever specialisation you enter through — what changes is the domain you go deep in.

01
Data and AI EngineerEntry
Python, LLM APIs, first RAG build, prompt and context basics.
02
Associate Data and AI EngineerPractitioner
Client-facing discovery, tool integration, agent build under supervision.
03
SCIKIQ Certified Data and AI EngineerSpecialist
Owns a deployment end to end — scoping, build, evals, handover.
04
Senior Data and AI Engineer / Domain LeadSenior
Multi-agent architecture, regulated deployments, reference patterns for the practice.
05
AI Architect / Practice LeadLeadership
Portfolio of accounts, delivery standards, hiring and capability strategy.
Terms worth knowing
Foundry
Microsoft’s platform for building, deploying, governing and monitoring agents.
Agent Service
The managed agent runtime on the Responses API with MCP and A2A support.
Security trimming
Filtering retrieval results by the calling user’s permissions at query time.
On-behalf-of
An identity flow where a service acts with a user’s delegated permissions.
Provisioned throughput
Reserved model capacity giving predictable latency and cost.
Private endpoint
A private network path to a service, keeping traffic off the public internet.
ACS
Agent Control Specification — a specification for governing agent behaviour.
Purview
Microsoft’s data governance and classification service.
SCDAI
SCIKIQ Certified Data and AI Engineer — the credential this program awards.
SCDAI engineer
An engineer embedded with the customer who turns their constraints into a working system.
Thin slice
The narrowest end-to-end path through a workflow that still produces business value.
Agentic RAG
Retrieval where the agent decides when, what and how often to retrieve.
MCP
Model Context Protocol — open standard connecting an agent to tools and data.
A2A
Agent2Agent — protocol for agent-to-agent delegation across vendors.
Eval set
A labelled, versioned set of cases an agent must pass before release.
LLM-as-judge
Using a model to score outputs, calibrated periodically against human ratings.
Guardrail
An enforced constraint on an input, output or action — not a prompt request.
Human-in-the-loop
A required human approval step before a consequential action executes.
Cost per task
Total token, tool and compute cost of one completed unit of work — the engineer's unit economic.
Golden path
The reference architecture a practice standardises on so deployments stay reviewable.
Handover
The point at which the client can operate, evaluate and change the system without the engineer.

Related programs

Skill a team, or join a cohort

B2B cohorts run on your tenancy with capstones scoped to your backlog. B2C cohorts run on a fixed calendar.

Talk to us
07
Enrolling

What you need, what you get, and what it costs

Stated plainly enough to rule yourself in or out without a sales call: the prerequisites, how the program runs, exactly what the credential is worth, and the questions everyone asks.

Before you start

Stated plainly so you can rule yourself in or out without a sales call. Nothing here is a formal qualification — it is what the first lab assumes you can already do.

Technical

You should already be able to do these

  • Comfortable in Python: functions, typing, virtual environments, reading a stack trace
  • Have called an LLM API and handled a structured response
  • Git, the command line, and reading someone else’s code without panic

Domain

What we assume, and what we teach

  • An Azure subscription you can deploy into, or your employer’s sandbox
  • Basic cloud literacy: identity, networking, resource groups

Time and access

What the program asks of your week

  • A machine that can run a browser and a terminal — labs run in the Playground, not locally
  • Roughly 8 hours a week for the taught weeks, plus 20 hours for the two capstones

How it runs

Cohort dates and pricing are confirmed on enquiry rather than printed here, because both move with the intake.

Format
Self-paced within a fixed cohort window, delivered in the SCIKIQ Agentic AI Playground
Taught hours
60 hours across 4 modules
Capstones
20 hours — two end-to-end builds, reviewed not auto-graded
Typical duration
10–12 weeks at around 8 hours a week
Level
Intermediate → Advanced
Built for
Engineers deploying agents on Microsoft Foundry and Azure
Next cohorts
— confirmed on enquiry
Pricing
— confirmed on enquiry

The credential

The credential is awarded per specialisation, so it names the domain or stack you were assessed in rather than claiming general competence. On this program the badge reads SCDAI — OpenAI + Azure Tech Stack.

How it is earned

  • A pass at 70% or above on every module assessment — not an average across them
  • Both capstones reviewed against the published rubric by a Senior SCDAI Engineer
  • All labs submitted and machine-graded green
Awarded as
A verifiable digital badge with a public credential record
Valid for
Two years from award
Recertification
One current-year assessment plus a refreshed capstone
Retakes
Two included per assessment, each with a fresh item draw
Named specialisation
The badge states the domain or stack, e.g. SCDAI — Healthcare
Verification
Third parties confirm a holder from the credential record, no login required

A certificate that cannot be checked is decoration. Every award resolves to a record showing the specialisation, the award date and the assessments passed.

The certificate you leave with

This is the credential the program awards, shown exactly as it is issued — with the specialisation named, the assessment record attached and a verification link anyone can check without an account.

SCIKIQ Data Academy Certificate of Professional Certification

This is to certify that

Your name

has been assessed and certified as

SCIKIQ Certified Data and AI Engineer

OpenAI + Azure Tech Stack

Specialisation
OpenAI + Azure Tech Stack
Assessments passed
4 of 4, each at 70% or above
Labs graded
20 of 20 machine-graded green
Capstones reviewed
2, against the published rubric
Taught hours
60 across 4 modules, plus 20 capstone hours
AwardedOn completion
Valid untilTwo years from award
Credential IDSCDAI-OPENAI-AZURE-<issued>
Senior SCDAI Engineer, Certification Board
  1. 01
    The specialisation is on the certificate

    Not “Data and AI Engineer” but the domain or stack you were actually assessed in. A general claim would be a weaker one.

  2. 02
    The assessment record travels with it

    Modules passed, labs graded and both capstones reviewed — so the credential states what was measured rather than that you attended.

  3. 03
    Anyone can verify it, without a login

    The credential ID resolves to a public record showing the specialisation, the award date and the assessments passed.

Share it on LinkedIn

Add it to your LinkedIn profile in one step. The link pre-fills the certification fields from the credential record, so the entry on your profile matches the record a reader can check.

Add to LinkedIn profile The button is live on your real certificate; here it opens LinkedIn pre-filled with this specialisation so you can see exactly what the profile entry will say.

A certificate that cannot be checked is decoration. Every award resolves to a record showing the specialisation, the award date and the assessments passed.

Questions we get asked

The objections that come up in every conversation about this program, answered without the brochure voice.

Is this a course or a certification?

Both, and the second is the point. Eight timed assessments and two reviewed capstones stand between you and the credential, so a pass means someone measured the skill rather than recorded your attendance.

How is it self-paced without falling apart?

Every lab is provisioned, graded and unblocked by the Playground rather than by an instructor. That is what lets a cohort of 2,000 cost the same faculty time as a cohort of 20 — and why you are never waiting on someone to mark your work.

What if I fail an assessment?

Two retakes are included per assessment, each drawing a fresh item set from the bank, so a retake is a genuinely new paper rather than the same questions again.

Do I need my own cloud account?

For the domain specialisations, no — labs run in provisioned sandboxes. For the four tech-stack programs you will want access to that platform, since deploying into a real subscription is much of the point.

Can we run this privately for our team?

Yes. B2B cohorts run on your own tenancy with your data patterns, a skills baseline before kick-off, per-team mastery reporting, and capstones scoped against your actual backlog so the output is deployable work rather than an exercise.

Which specialisation should I take?

Take the domain you deploy into. If you move across industries, take a tech-stack program instead and pick up domain context on the engagement. The chooser on the programs page will narrow it.

How current is the material?

The trends, platform capabilities and regulatory positions are reviewed each quarter, and every external claim on these pages links to its source so you can check the date yourself.

What do I actually leave with?

A graded portfolio: forty machine-graded labs, two reviewed end-to-end agent builds with measured evaluation and cost per task, and a verifiable credential naming your specialisation.

Still deciding?

Tell us the systems you deploy into and we will say plainly whether this specialisation is the right one — or which of the 21 is.

Talk to us