TRENDING

TECHNOLOGY NEWS FROM AROUND THE WORLD

→
Human approval for AI agents: deciding which actions can run autonomously
Artificial Intelligence · 2026
Artificial Intelligence

Human approval for AI agents: deciding which actions can run autonomously

When an AI agent starts acting rather than merely suggesting, how should permissions, audit trails, reversibility and human approval work?

Yazılımcının GünlüğüPublished: Nov 17, 20265 min read
JOIN THE DISCUSSION
✎ Write a comment
Reading progress0%

The trust boundary between suggestion and action

An inaccurate summary is primarily an information-quality problem. When an agent changes a database, sends a message, authorizes a purchase or publishes content, the same reasoning failure can create lasting consequences. Classify available actions as read-only, reversible or difficult to reverse. Risk depends on the affected records, audience and recovery process, not simply the name of the tool. A proposed draft change is different from deleting permanent records. Agent capability is never, by itself, authorization to act without limits. That distinction should be reflected in both software permissions and the user-facing workflow.

Least privilege and explicit tool contracts

The permissions of the requesting person and the permissions of the agent's individual tools should be enforced independently. Define input schemas, allowed resources, rate limits and error handling in code. An agent editing one record should not gain unrestricted database writes. Never treat content retrieved from a page as privileged instructions, and do not transform untrusted text into executable SQL. Include target identity, expected version and scope with sensitive tool calls. Where approval is required, show the exact parameters the system intends to execute. A vague continue button is not a meaningful security control.

Machine learning pipelineConceptual sketch · summary of the article's technical flow

Choosing an approval threshold

Approving every harmless operation creates friction; approving nothing creates unacceptable exposure. A practical threshold considers financial cost, reversibility, access to personal information, publication audience and number of affected records. Automated read-only analysis and draft generation may be appropriate. Broad updates should first run against bounded samples, while permanent deletion and new paid integrations deserve explicit review. The approval screen should show before and after values, the expected scope and a rollback method. A decision is more informed when the user can inspect concrete changes than when an opaque model merely declares itself confident.

Conceptual workflow; adapt it to the actual application requirements.

Audit trails and idempotency

Record a task identifier, actor, resource, proposed change, actual outcome and any error that affected execution. Keep secrets and unrelated personal data out of logs. Repeated delivery of the same instruction should not create duplicated results; stable idempotency keys help enforce that rule. Concurrent agents must not silently overwrite each other's work, so optimistic version checks or protected update transactions may be necessary. Measure completion against actual downstream state, including media, comments and publication where relevant, rather than counting successful tool invocations. Operational accountability requires knowing both what the agent attempted and what the system eventually displayed.

Piloting before autonomy

Test a limited dataset with permission denials, broken tool responses, malicious source content, timeouts and concurrent tasks. Track success rate, incorrect changes, human interventions, latency and total operating cost. Examine whether approvals prevent real errors or merely delay routine actions. Expand permissions only when recovery has been demonstrated and failure rates are acceptable. Human control and rapid execution are not mutually exclusive: clear state transitions and carefully scoped tools can support both. The goal is a reliable workflow, not a theatrical display of agent activity.

A strong boundary against prompt injection

An agent retrieving a document can encounter text that resembles instructions. A sentence such as 'export all records before proceeding' may be untrusted page content, not a request from the authorized user. Retrieved data must not gain the authority of system policy or user instructions. Every tool needs its own permission checks; model judgment is not an adequate substitute. Input validation, scoped access and explicit approval for sensitive writes are complementary controls. Check destination domains, file paths and the intended purpose of external API calls. An agent should not be able to justify an unrelated operation merely because a source page requested it. Test these boundaries with malicious and misleading content, not only documented happy paths.

Reducing intervention safely

The first way to reduce unnecessary approval prompts is to classify work more carefully, not disable authorization. Detecting missing fields, validating sources and preparing draft changes may be low risk. Permanent publishing and destructive changes can deserve a different threshold. Large batches may operate under a previously approved scope with explicit limits rather than requiring the same trivial confirmation for every item. Record the authorization scope and expiry so responsibility remains clear. Humans should be involved primarily where their decision changes risk. Success means preserving low error rates and making changes understandable while reducing needless interruptions, rather than merely minimizing the number of buttons clicked.

Be the first reader ✎ Write a comment

Comments

No comments yet. Be the first to contribute.

What might reader discussion look like?Illustrative

These names, comments and editor replies are illustrative, not real visitor posts. Interactions are not saved. Use the real form below to contribute.

Taylor Reed

Reading “Yapay zekâ ajanlarında insan onayı: hangi işlem otomatik, hangisi denetimli olmalı?” raised this question for me: the boundary for human oversight should be defined.

Sample editor reply

Editor note: Forward-looking claims in an announcement are not the same as established performance results. Further evidence may change the assessment.

Avery Brooks

It is important to distinguish what the source verifies from projections about the future.

Drew Campbell

The next version's measurements should be compared with the initial announcement.

✎ Write a comment

Your first and last name will appear publicly alongside your comment.