Keep the right person in control
Clear permissions and review steps make an AI workflow easier to operate. Use this guide to decide who can access information, approve actions and handle exceptions.
The core controls every production AI workflow needs
Start with the information the workflow can access, the actions it can take and the person responsible for each decision. Then test the approval, correction and recovery steps.
Least privilege
Give each tool only the access needed for its task. Separate reading, drafting and changing records, and test that permission checks hold at the point of action.
Policy and allowlists
Define what the agent can access, which actions are permitted, and what content or destinations are blocked before the agent can call tools.
Evidence and review
Capture prompts, retrieved context, tool actions, confidence signals, overrides, and final outcomes so reviewers can reconstruct a decision path.
How to place approval gates without stalling operations
Pre-action review
Use before a payment, message send, policy exception, or system update. The reviewer sees the recommendation, rationale, source evidence, and intended action.
Threshold review
Use when confidence scores, retrieval quality, or classification certainty fall below the release threshold. The agent routes to manual handling instead of guessing.
Exception review
Use when the workflow encounters a novel case, policy conflict, or missing data pattern. This gate prevents silent drift from becoming a production habit.
Use security frameworks to organize the review
Use OWASP-informed control language
- Prompt and tool abuse risk belongs in pre-execution policy checks.
- Data leakage risk belongs in retrieval boundaries, redaction, and role-based access.
- Excessive agency risk belongs in approval design, action scopes, and rollback planning.
Use NIST AI RMF as an operating map
- Govern: name accountability, ownership, and risk review cadence.
- Map: document workflow boundaries, actors, and action surfaces.
- Measure: define evidence, thresholds, and monitoring signals.
- Manage: specify mitigations, approvals, and remediation steps.
What security and risk reviewers need to inspect before launch
- Workflow architecture summary with data sources, tools, identities, and operators
- Control matrix that maps risk points to gates, policies, and evidence
- Audit log examples showing input, context, action, reviewer, and final state
- Evaluation results for happy path, edge cases, and prohibited actions
- Incident and rollback procedure for failed tool calls or unsafe outputs
Common governance design questions
Need controls your security team can actually inspect?
Use the questions on this page to describe your task, review the available information and decide what a useful test should show.