THREAT MODELS / SECURE AI AGENTS

The prompt looks safe. What happens next?

Agent risk lives in tools, memory, permissions and handoffs. See how legitimate-looking steps can cross the boundaries of the task you authorized.

Early access. Already in paid production.

THE AUTHORIZED TASK

Prepare the vendor renewal summary.

Read contracts · Compare renewal dates
THE PROPOSED ACTION

Assume finance-admin.

Outside task scope → Hold for review
INTENT ≠ PERMISSIONILLUSTRATIVE SCENARIO

FOUR PATTERNS WORTH RECOGNIZING

Follow the action. Find the missing context.

Ackuity connects proposed execution to the task, authority and history behind it. These examples show why those connections matter.

01 / ACTION CHAINS

A valid tool call can be part of an invalid sequence.

An agent reads contracts, assumes a finance-admin role and attempts a payment. Each operation has to be judged against the original task.

Task intent + action historySee action chain exploitation

02 / SCOPE

Access is not the same as authorization.

An agent can retrieve a document, but the intended recipient may be outside the permitted scope.

Identity + data policy + recipientSee contextual scope bypass

03 / MEMORY

The risk can arrive before the action.

A changed memory or retrieved instruction can quietly redirect later work. The final call may look routine in isolation.

Memory + provenance + prior behaviorSee slow state corruption

04 / DELEGATION

Authority can get lost in the handoff.

A downstream agent treats another agent’s request as permission to act. The original user never granted that scope.

Delegation chain + original authoritySee inter-agent exploitation

Which of these patterns could occur in your environment? Start with the agents, tools and permissions you already have.

Request access

THREAT COVERAGE STARTS WITH YOUR ARCHITECTURE

Review the full attack surface.

Use the catalog to ask better questions about your agents. It covers risks across identity, tools, memory, MCP, data and policy. A listed threat is an assessment topic, not a promise of automatic prevention.

53 threats in 14 categories

Agent-to-agent threats6 topics

Risks in trust, authentication and decisions shared between agents.

  • Interagent authentication exploits
  • Agent trust exploitation
  • Collaborative decision manipulation
  • A2A collusion attacks
  • A2A misinformation cascading
  • Rogue agents
Memory poisoning4 topics

Corruption of the information an agent stores or retrieves as context.

  • System memory poisoning
  • Vector DB poisoning
  • Object DB poisoning
  • Database poisoning
Misaligned and deceptive behaviour3 topics

Behaviour that departs from intended goals or presents a misleading appearance of alignment.

  • Threat alignment
  • Alignment faking
  • Excessive agency
Privilege compromise4 topics

Misuse of permissions, roles or delegated authority.

  • Excessive permissions
  • Confused deputy
  • Overprovisioned agents
  • OAuth scope violation
Remote code execution4 topics

Generated instructions or operations that introduce executable attacks.

  • Malicious code generation
  • SQL injection
  • Malicious prompt generation
  • API attacks
Identity spoofing and impersonation4 topics

An agent or user is represented as someone other than the authenticated actor.

  • User impersonation
  • Agent impersonation
  • Behavioural mimicry
  • Weak authentication
Agent social engineering2 topics

Actions designed to influence users or conceal activity.

  • Manipulate users
  • Covert actions
Resource overload3 topics

Agent behaviour that exhausts compute, quotas or execution capacity.

  • Reflection loop trap
  • API quota depletion
  • Computational resource exhaustion
Sensitive and regulated data exposure4 topics

Disclosure of protected information through agent activity.

  • PII data exposure
  • PHI data exposure
  • Intellectual property exposure
  • Confidential data exposure
Tool misuse5 topics

Unsafe tools, compromised dependencies or harmful combinations of otherwise available operations.

  • Risky commands
  • Risky plugins
  • Tool poisoning
  • Supply chain attack
  • Risky tool chaining
Intent breaking and goal manipulation5 topics

Inputs that attempt to redirect an agent from its authorized task.

  • Direct prompt injection
  • Indirect prompt injection
  • Meta-learning vulnerability injection
  • Prompt extraction
  • XPIA
Overwhelming human review3 topics

Attacks on the effectiveness of human oversight and intervention.

  • Trust mechanism subversion
  • Cognitive overload
  • Human intervention interface manipulation
MCP threats3 topics

Risks at Model Context Protocol integrations and connected servers.

  • OAuth misconfiguration
  • Prompt poisoning
  • Server hijacking
Policy violations3 topics

Actions that cross defined access or information handling boundaries.

  • Overshared data access
  • ABAC violation
  • Reclassification of sensitive documents

ACKUITY RESEARCH

A taxonomy of threats to AI agents.

Four broad classes. 21 threat vectors.

BRING A FRAMEWORK TO YOUR SECURITY REVIEW

Make the threat model concrete.

Use our research to structure your assessment, then connect it to the tools, identities and data your agents actually touch. The expanded catalog above provides additional topics to investigate.

Read the research
See how verification works

PUT CONTEXT TO THE TEST

Would you allow, hold or block?

Try three illustrative agent-action scenarios. Find the context that changes the decision.

Take the challenge

YOUR QUESTIONS, ANSWERED

Before you take the next step.

What are the main security risks for AI agents?

AI agent risks include prompt injection, unsafe tool use, memory poisoning, privilege misuse, sensitive data exposure and compromised delegation. Assessing them requires looking at the agent’s permissions, connected systems and sequence of actions, as well as its inputs.

Why can a safe prompt still lead to an unsafe action?

A prompt can be legitimate while a later action exceeds the task’s scope. For example, preparing a finance summary does not authorize a role change or payment. The relevant checks include intent, identity, permissions and earlier actions.

Does an MCP gateway remove the need for agent security?

An MCP gateway can govern access and calls through that gateway. Agent security also requires understanding why a call is being made, what scope was delegated and how it relates to activity elsewhere. The controls needed depend on your architecture.

Does the catalog mean every threat is blocked automatically?

No. The catalog describes risks to assess, not a universal prevention guarantee. Detection and enforcement depend on available context, policy and the integrations in place. Read-only discovery surfaces findings without blocking execution.

NEXT STEP

Find the risks in your agent environment.

Start with read-only discovery. Leave with findings your engineering and security teams can act on.

Request access