Track 05 · Agentic AI

Agentic AI

Systems where an LLM autonomously pursues a goal — reasoning, planning, calling tools and acting in loops with memory. Not a single prompt-response, but software that decides what to do next. The frontier of enterprise AI, and only as trustworthy as the governed data beneath it.

Read time ~20 min Level Intermediate → Advanced For AI Engineers, PMs, Analysts

What you'll be able to do

Learning outcomes for this track

  • Explain how agents differ from plain LLM calls and from RPA
  • Choose an architecture: ReAct, plan-and-execute, multi-agent
  • Build a tool-calling agent with memory and agentic RAG
  • Connect tools and data via the Model Context Protocol (MCP)
  • Add guardrails, human-in-the-loop, evals and observability
  • Plan a career path and self-assess against a skill matrix

01 What it is

Software that decides its own next step

Definition

Agentic AI is a system in which an LLM autonomously pursues a goal by reasoning, planning, calling tools and acting in loops with memory — rather than producing a single prompt-response.

Two contrasts make it concrete. A plain LLM call answers once; an agent decides which actions to take, observes the results, and iterates toward an objective. RPA follows brittle, hard-coded scripts; an agent reasons over unstructured inputs and adapts. Put simply, generative AI creates content on request; agentic AI acts to accomplish tasks. The defining traits are autonomy, goal-directedness, tool use, memory and planning.

02 Core concepts

The anatomy of an agent

  • LLM as reasoning enginethe model orchestrates; it decides what to do, not just what to say.
  • Tools / function callingstructured functions the agent invokes to act and fetch data.
  • Memoryshort-term (the context window) plus long-term (vector stores, databases, summaries).
  • PlanningReAct, plan-and-execute and reflection/self-critique strategies.
  • RAGretrieval-augmented generation grounds answers in fetched, trusted data.
  • Orchestration & multi-agentcoordinating steps, and multiple specialised agents collaborating.
  • Guardrails & human-in-the-loopenforced constraints and human approval at key steps.
  • Context engineeringdeliberately curating what enters the context window — the core new discipline.

03 Architectures

Patterns from simple to autonomous

Anthropic's guidance is worth internalising: prefer workflows (predefined code paths) over fully autonomous agents until autonomy demonstrably earns its keep. Start simple.

ReAct

Interleave reasoning traces with tool calls — the workhorse pattern.

Reflexion

The agent critiques its own output and retries to improve.

Plan-and-Execute

Plan the whole task up front, then run the steps in order.

Multi-agent

Supervisor / orchestrator-worker delegation, or peer-handoff swarms.

Tool-calling agent

The LLM selects and calls functions to act on the world.

Agentic RAG

The agent decides when and what to retrieve, iterating on retrieval.

04 Protocols

How agents connect in 2026

A simple rule of thumb: MCP connects an agent to tools and data; A2A connects an agent to other agents.

  • Model Context Protocol (MCP)Anthropic's open standard for connecting agents to tools and data — the "USB-C for AI". Rapidly adopted across the industry.
  • Agent2Agent (A2A)Google's protocol for cross-vendor agent-to-agent communication, donated to the Linux Foundation with 150+ organisations backing it.
  • AGNTCYan "Internet of Agents" infrastructure effort (Cisco, LangChain and others) under the Linux Foundation, interoperable with A2A and MCP.
  • Function-calling schemasJSON-schema tool definitions are the de-facto standard for how agents describe and invoke tools.

05 Key personas

Who builds agents

AE

AI Agent Engineer

Designs agent loops, tools and orchestration — the fastest-growing role.

LangGraphTools
LE

LLM / Applied AI Engineer

RAG, fine-tuning, prompt and context, integration.

RAG
ML

AI / ML Engineer

Builds and deploys the models and pipelines.

MLOps
DS

Data Scientist

Experimentation, evals and metrics.

Evals
CE

Prompt / Context Engineer

Designs context, instructions and retrieval strategy.

Context
PM

AI Product Manager

Owns use cases, scope and ROI.

ScopeROI
BA

Business Analyst

Use-case discovery, task decomposition and requirements.

Use cases
GR

AI Governance / Risk

Owns policy, safety, guardrails and compliance.

SafetyPolicy

06 Methodology

Build an enterprise agent

The guiding principle across the field: start simple; add complexity — autonomy, more agents — only when it demonstrably helps.

01

Scope the task

Define a bounded objective and clear success criteria before writing any code.

02

Choose model & tools

Pick a model; design few, tightly-scoped, well-documented tools.

03

Ground it

Add memory and RAG over governed data, a semantic layer or a knowledge graph.

04

Orchestrate

Single agent first; move to multi-agent only when the task truly needs it.

05

Guard & supervise

Add input/output validation, guardrails and human-in-the-loop for risky actions.

06

Evaluate

Build evals offline against real cases before anyone relies on it.

07

Monitor

Trace, observe cost and latency, and catch regressions in production.

08

Iterate

Feed production learnings back into tools, context and guardrails.

07 Best practices

What good looks like

Workflows before autonomyUse predefined paths until autonomy clearly earns its complexity.
Design tight toolsFew, well-scoped, well-documented tools beat a sprawling toolbox.
Invest in evals earlyObservability and tracing from day one, not after an incident.
Enforce guardrailsValidate inputs and outputs; limit content and actions.
Least-privilege accessGive tools and data the minimum permissions they need.
Humans on risky stepsKeep a person in the loop for high-impact or irreversible actions.
Control cost & latencyModel routing, caching and context trimming keep agents affordable.
Ground on governed dataPrefer context engineering over prompt hacking; ground on trusted sources.

09 In practice

From demo to business value

Agentic AI is the most hyped — and most scrutinised — category in enterprise tech. Here's where it delivers, what the analysts and platforms are actually seeing, and how SCIKIQ keeps agents grounded and safe.

Customer service agents

Resolve tickets end to end — triage, lookup, action, follow-up — deflecting volume and cutting handle time.

Coding agents

Autonomously write, test, review and fix code across a repo — a top value pool in McKinsey's analysis.

Data analyst / BI agents

Answer natural-language questions over governed data and generate queries, dashboards and narratives on demand.

Finance & ops automation

Run multi-step workflows — AP, reconciliation, procurement, claims — across systems with audit trails.

Knowledge assistants

RAG-grounded agents answer from internal docs, policies and tickets — replacing manual search.

Sales & marketing agents

Research leads, personalise outreach and update the CRM, orchestrating across tools.

What the leaders are doing

The forecasts are enormous and the cautions are blunt — the winners will be those who ground agents in trusted data and prove ROI.

DADAMAStandard · DMBOK

DMBOK2's data-management foundation — quality, metadata and governance — is the trusted ground agents must stand on to be reliable.

GGartnerAnalyst

Predicts 33% of enterprise software will include agentic AI by 2028, warns >40% of agentic projects will be cancelled by 2027, and flags "agent washing".

FForresterAnalyst

Its 2026 predictions centre on "digital teammates" — but caution that fewer than 15% of firms will truly enable agentic features next year.

MMcKinseyAdvisory

In "Seizing the agentic AI advantage" and State of AI 2025, reports 62% of firms experimenting with agents and 23% scaling somewhere.

AAccentureAdvisory

Its AI Refinery and Distiller agentic framework build and orchestrate agent networks, with 100+ industry agent solutions.

DDatabricksPlatform

Mosaic AI Agent Framework and Agent Bricks build and evaluate agents, governed by Unity Catalog with managed MCP servers.

How SCIKIQ helps

SCIKIQ's Agent Factory turns trusted, contextualised data into agents that actually act — grounded on a knowledge graph, governed by policy, and observable end to end.

  • Agents grounded on governed data and a knowledge graph, cutting hallucination.
  • Tool and MCP access to your enterprise systems, not just chat.
  • Guardrails and least-privilege access enforced by policy.
  • Evals and observability — trace and score every step.
  • Human-in-the-loop approval for high-stakes actions.

10 Developer lab

Hands-on: build a grounded agent

Engineer track

Do it
  1. Build a ReAct tool-calling agent with a search and a calculator tool.
  2. Write and wire an MCP server exposing a database or API tool.
  3. Build agentic RAG over a knowledge graph.
  4. Compose a multi-agent workflow in LangGraph or CrewAI — supervisor plus workers.
  5. Add long-term memory via a vector store and instrument evals with Langfuse.
# A minimal tool-calling loop (pseudo-Python)
while not done:
    step = llm(messages, tools=TOOLS)     # reason + choose tool
    if step.tool_call:
        result = run_tool(step.tool_call)  # act
        messages.append(observe(result))   # observe, then loop
    else:
        done = True

Skills you build

Outcome
  1. Implementing the reason-act-observe loop.
  2. Exposing tools over MCP.
  3. Grounding with agentic RAG.
  4. Coordinating a multi-agent team.
  5. Adding memory, evals and guardrails.

Reference implementation

agent · tool · guardrail
agent.pyLangGraph
# A ReAct agent with a governed tool and persistent memory
from langgraph.prebuilt import create_react_agent
from langgraph.checkpoint.memory import MemorySaver
from langchain_anthropic import ChatAnthropic

def search_orders(customer: str) -> str:
    """Look up a customer's recent orders."""
    return db.query(customer)          # your governed data

agent = create_react_agent(
    ChatAnthropic(model="claude-sonnet-5"),
    tools=[search_orders],
    checkpointer=MemorySaver(),        # remembers across turns
)

resp = agent.invoke(
    {"messages": [("user", "What did Acme order last week?")]},
    config={"configurable": {"thread_id": "acme-1"}},
)
server.pyMCP server
# Expose a governed metric as a tool over the Model Context Protocol
from mcp.server.fastmcp import FastMCP

mcp = FastMCP("sales")

@mcp.tool()
def revenue_at_risk(product_line: str) -> float:
    """Revenue exposed to a delayed product line."""
    return warehouse.scalar(
        "select sum(net_amount) from fct_sales "
        "join dim_product using (product_sk) where line = %s",
        product_line,
    )

if __name__ == "__main__":
    mcp.run()          # any MCP client can now call this tool
guardrail.pyGuardrail + eval
# Least-privilege allow-list, plus trace-and-score every run
from langfuse import observe

ALLOWED = {"search_orders", "revenue_at_risk"}

def guard(tool_call):
    if tool_call.name not in ALLOWED:      # block anything off-list
        raise PermissionError(tool_call.name)

@observe()                             # full trace in Langfuse
def answer(question):
    result = agent.invoke(question)
    score = judge(question, result)        # LLM-as-judge eval, 0..1
    return result, score

The pattern the whole track builds toward: an agent reasons and calls tools, those tools are governed and exposed over MCP, and every action is permission-checked, traced and scored before anyone trusts it in production.

11 Analyst lab

Hands-on: scope agents that pay off

Analyst track

Do it
  1. Identify and scope a high-value, bounded agent use case.
  2. Map the agent's task decomposition to required tools and data.
  3. Design human-in-the-loop checkpoints for risky steps.
  4. Define success metrics and eval criteria.
  5. Build an ROI and risk / failure-mode assessment and a guardrail policy.

Deliverables

Outcome
  1. A scoped use case with clear boundaries.
  2. A task-to-tool map.
  3. A human-oversight design.
  4. An eval plan with success metrics.
  5. An ROI, risk and guardrail brief.

12 Career path

The fastest-moving, best-paid track

Agent engineering is among the hottest specialisms in tech. Bands are indicative US figures for a fast-moving market and vary widely by company and location.

01
Data Scientist / Software EngineerEntry
Python, ML basics, first RAG and prompt work.
~$120–160k
02
AI / LLM EngineerPractitioner
RAG, prompt and context engineering, integration.
~$150–265k
03
AI Agent EngineerSpecialist
Agent orchestration, tools, MCP, evals and LLMOps.
~$200–320k total
04
Senior / Staff AI EngineerSenior
Production scale, multi-agent systems, reliability.
$300k+ total
05
AI Architect / Head of AILeadership
Org-wide AI architecture, governance and strategy.
$350k+ total

13 Skill matrix

Rate yourself, then level up

Find your current row and aim one column right.

SkillBeginnerIntermediateAdvanced
PythonWrites scripts and calls an LLM API.Builds apps with an agent framework.Production services at scale.
Prompt & context engineeringWrites clear prompts.Structures context and retrieval.Designs context strategy for reliability.
RAGBuilds basic retrieval.Agentic and graph RAG.Tunes retrieval for accuracy at scale.
Agent frameworksRuns a starter agent.Builds multi-step LangGraph/CrewAI.Designs multi-agent architectures.
Vector DBs & embeddingsStores and queries vectors.Chooses embeddings and indexes.Optimises recall, cost and freshness.
Tool / API integration (MCP)Calls a tool.Writes an MCP server.Designs a secure tool ecosystem.
Evals & observabilityEyeballs outputs.Builds eval sets and tracing.Runs continuous, automated evals.
Guardrails & governanceAdds output checks.Enforces action allow-lists.Designs agent governance and safety.

14 Glossary

Terms worth knowing

Agent
An LLM-driven system that plans and acts toward a goal via tools.
Tool calling
An LLM invoking external functions via structured schemas.
ReAct
Reasoning interleaved with actions.
RAG
Retrieval-augmented generation — grounding answers in fetched data.
Agentic RAG
An agent that decides when and what to retrieve.
MCP
Model Context Protocol — open standard connecting agents to tools and data.
A2A
Agent2Agent — a protocol for agent-to-agent communication.
Memory
Retained context — short-term window and long-term stores.
Guardrail
An enforced constraint on inputs, outputs or actions.
Orchestration
Coordinating steps or agents toward a goal.
Context engineering
Curating what enters the context window.
Human-in-the-loop
Human approval or oversight at key steps.

15 Test yourself

Check your understanding

Four quick questions — instant feedback, nothing saved, no sign-up.

Q1How does an AI agent differ from a single LLM call?

Autonomy, tool use, memory and planning define an agent. A plain call answers once; an agent runs a reason–act–observe loop.

Q2What does the Model Context Protocol (MCP) connect?

MCP = agent↔tools/data; A2A = agent↔agent. That one distinction clears up most protocol confusion.

Q3In the ReAct pattern, the agent…

Reason → act → observe → repeat. Plan-and-execute plans up front; Reflexion is the self-critique pattern.

Q4Which is a widely-shared best practice for enterprise agents?

Start simple; ground on governed data; add guardrails, evals and human-in-the-loop. Complexity should be earned, not assumed.