Agentic AI — Behavioural Assurance
🟢 Overview
Agentic AI shifts risk from what the model can do to how the system behaves in deployment.
- Behavioural failures emerge from interactions between agents, humans, governance, workflows and organisational context.
- Identical models can produce radically different risks depending on access, authority and trust.
🟢 Behavioural Failure Modes (Turing taxonomy)
- goal displacement
- policy‑invisible violation
- misreporting
- alignment‑resistant behaviour
- conversational failures
- pseudo‑corroboration
- multi‑agent emergence
- human‑agent failures
🟢 Access, Authority, Trust
- Access = operational reach
- Authority = permitted actions
- Trust = organisational influence
When agents possess all three, behavioural failures resemble insider‑risk pathways.
🟢 Behavioural Assurance Principles
- Govern agents as organisational actors: roles, identity, permissions, accountability.
- Assure deployments, not models: evaluate tools, workflows, memory, controls.
- Assure behaviour, not outputs: examine trajectories, interactions, decisions under pressure.
- Assure human‑agent systems: trust, delegation, oversight, misuse.
- Apply least‑privilege and zero‑trust: limit access, keep actions observable, ensure challengeability.
- Treat assurance as continuous: monitor behaviour, review interactions, adjust permissions.
- Build interdisciplinary capability: technical, security, governance, behavioural, organisational.
(Build interdisciplinary capability = build cross‑functional behavioural‑assurance competence. Not just team structure, as in Pre-AI days. It’s describing the minimum capability required to assure agentic behaviour.)
🔵 RACinform view
Agentic AI does not fail at capability; it fails at behaviour.
- Assurance must target sociotechnical pathways, not isolated models.
Access + authority + trust without behavioural assurance is organisational risk at machine speed.