Agent blast radius: how much can it hurt if wrong?
Goal: Estimate blast radius before granting any agent-like tool write, send, delete, or purchase rights.
Best for: Anyone about to allow tools that change the world outside the chat box.
Blast radius is how much damage a wrong or repeated action can do. Drafting in chat is low. Sending to 10,000 users is high. Match permissions to radius—not to how confident the model sounds.
Blast radius is everything a wrong click can touch. Shrink scopes, add pauses, and assume mistakes will happen.
Draw the radius on paper: which inboxes, drives, and calendars a wrong click could touch. If the circle scares you, shrink scopes before you add features.
Scene tip: Draw the blast circle before you grant the second write scope—not after the wrong invite sends.
Why beginners skip this
Opening full permissions at once feels easy—one misfire can sweep disks it should never touch. Shrink the radius before go.
Step 1 — Three questions
- If this action runs twice by mistake, what breaks?
- Who else is affected (customers, coworkers, students)?
- Can I undo it in five minutes?
If undo is hard, permission must be hard.
Step 2 — Match permission to radius
Match permission to blast radius from this table; if radius is unclear, stay read-only.
| Blast radius | Examples | Permission |
|---|---|---|
| Low | Draft in chat; rewrite your bullets | Allow freely |
| Medium | Edit a sandbox file; create a draft email you will review | Allow once / Ask |
| High | Send/post/pay/delete/share externally | Ask every time; often “human sends” |
Example
Filled prompt
Agent drafts + can create Drive docs in Shared folder.
Map 60-second blast if wrong folder. Ask-every-time on create. Kill-switch owner.
What good output looks like
- Worst cases name mass-email and Drive overwrite in concrete terms
- Mitigations: Ask-before-send, draft-only Gmail, read-mostly Drive
- Disconnect order starts with Gmail send, then Drive write
- No hand-wavy “be careful” as the only control
- Fits on one page you can act on today without a security team
Step 3 — Write it down
Add a one-line Project rule: “Never send/post/pay without my explicit OK naming the audience.”
Example
Filled prompt
Agent can: read Drive, draft Gmail, create calendar invites.
Map blast radius: what it can ruin in 60 seconds if wrong.
Write: allow-list, ask-every-time list, kill-switch owner.
Scenario: wrong invite to external partner list.
What good output looks like
- Six bullets you can finish today without a security team
- Each bullet is a revoke, Ask toggle, or draft-only switch
- Solo-friendly—no enterprise jargon required
- Ends with a one-line Project rule against silent sends
- Does not invent connectors you never mentioned
Save this card
Card: Match permission to blast radius—anything you cannot undo in five minutes stays closed at first. Keep this beside the tool; read before you start.
Before you start
Put the scrub checklist on your desk. For “Estimate impact before granting write, send, delete, or purc,” decide placeholders before the paste window opens Guide: safety-agent-blast-radius Keep the live artifact visible the whole time. If you only have a blank box, stop and fetch the real job first
How to use this week
This week draw a blast-radius map for a real agent: read / write / external each as a ring; any out-of-ring action needs human confirm.
Draw it once
Paper circle of inboxes/drives a wrong click can touch. Shrink until you can sleep.
Undo hard → permission hard
Drafting in chat is low radius. Sending to a list, paying, or deleting Drive files is high. High-radius actions stay on Ask every time—or human sends. Confidence in the reply does not shrink the radius.
Example
Filled prompt
Agent can create Shared Drive docs.
60s blast if wrong folder. Ask-every-time on create. Kill-switch owner named.
Context: real workstream this week (Asia/Shanghai). Name actual files/people.
Constraints: no invented metrics/owners/prices; label Unknowns; stop before send/delete/pay.
Done check: I can mark pass/fail in one minute on the output.
What good output looks like
- No raw PII/secrets in the paste for “Estimate impact before granting write, send, delet”
- Placeholders used; scrub checklist visible
- Disclosure matches how much AI actually did
- Pass/fail: desk card updated today
Red flag
Irreversible tools open on day one; undo > five minutes still enabled—close until gated.
Pitfalls
| Pitfall | Fix |
|---|---|
| Confidence ≠ low radius | Judge impact, not tone |
| Batch actions without dry run | Sandbox first |
| Shared agent credentials | Separate accounts; least privilege |
Example
Filled prompt
Temptation: skip the habit for safety-agent-blast-radius to save five minutes.
Job still: Estimate impact before granting write,
Smallest correct pass: Done visible · checkable artifact · Unknowns [?].
Boundaries: draft only; no silent send; no invented metrics.
Return: artifact + refuse-line said aloud.
What good output looks like
- Names the shortcut refused (specific to safety-agent-blast-radius)
- Still delivers checkable output for “Estimate impact before granting write,”
- Unknowns labeled; draft-only
- Pass/fail: refuse-line dated (safety-agent-blast-radius #4)
Practice now
Read-only hour: first hour of agent use is read-only tools only (Asia/Shanghai).
Write-gate drill: every write action gets a named human approver (Asia/Shanghai).
Blast drill: list touchable systems; add human gate beside each write action (Asia/Shanghai).
Blast-radius drill: list systems an agent could touch; cut any without a human gate (Asia/Shanghai).
Thin-spot drill: rewrite the Save card with real nouns from your work (repo, doc, inbox). Generic placeholders fail the drill.
Tonight draw a blast-radius map for a real agent: read / write / external each as a ring; any out-of-ring action needs human confirm.
Buffer line: name the artifact path you used (Asia/Shanghai).
Close the loop
Write one line: next time I open full permissions at once, I refuse go.
One sentence takeaway
Draw the blast radius first; out-of-ring actions always need human confirm.
Next
Computer use safely · HITL checkpoints · MCP least privilege · Secrets and pasting
智能体爆炸半径:错了会伤多大?
目标: 在给任何「像智能体」的工具开写入、发送、删除或购买权限之前,先估一下会伤多大。
适合: 马上要允许工具改动对话框以外世界的人。
这里的「爆炸半径」就是影响范围:一次错误或重复动作能造成多大伤害。聊天里起草,半径低;群发给一万用户,半径高。权限要匹配半径,别匹配模型听起来有多自信。
把半径画在纸上:一次误点可能碰到哪些收件箱、网盘和日历。如果这个圆圈吓到你,先缩范围,再加功能。
为什么新手跳过
权限一次开满像省事;一次误触就能扫到不该碰的盘。先缩半径再放行。
步骤 1——三个问题
- 如果这动作误跑两次,会坏什么?
- 还会伤到谁(客户、同事、学生)?
- 我能在五分钟内撤销吗?
越难撤销,权限就要越严。
步骤 2——权限匹配半径
按下表把权限配到爆炸半径;半径估不清就先只读。
| 爆炸半径 | 例子 | 权限 |
|---|---|---|
| 低 | 聊天里起草;重排你的要点 | 可较自由 |
| 中 | 改沙箱文件;创建你将审阅的邮件草稿 | 允许一次 / 每次询问 |
| 高 | 外发 / 发帖 / 付款 / 删除 / 外部分享 | 每次询问;常常改成「人来点发送」 |
实例
填好的提示词
为具备网盘写入 + Gmail 发送能力的智能体画影响范围图:最坏情况、缓解办法、先断什么。
五分钟撤不回的标高爆;先只读,再点名写入。
边界:不编造;未知标 [?];发送前停下。
完成检查:一分钟内能判过/不过。
像样的输出大概长这样
- 最坏情况具体点名群发邮件与 Drive 覆盖
- 缓解:发送前询问、Gmail 仅草稿、Drive 偏只读
- 断开顺序先 Gmail 发送,再 Drive 写入
- 不只用一句「小心点」当控制
- 一页纸今天就能照着做
步骤 3——写下来
在 Project 说明里加一行硬规则:「未经我明确 OK(并写明受众),绝不发送、发帖或付款。」
实例
填好的提示词
为上周接了太多权限的个人用户,写 6 条「今天就缩小影响范围」的计划。
每条必须是:撤销 / 改每次询问 / 改仅草稿。禁止空话「以后注意」。
边界:不编造;未知标 [?];发送前停下。
完成检查:一分钟内能判过/不过。
像样的输出大概长这样
- 六条今天就能做完,不靠安全团队
- 每条是撤销、改询问,或改仅草稿
- 适合个人:不用企业黑话
- 结尾有一行禁止静默发送的 Project 规则
- 不编造你没提过的连接器
- 跑两次会砸什么写在每条旁边,不只写「注意」
保存这张卡
记下:今天收回的权限 / 打码习惯 / 披露句其中一项。标上日期。
开始前
先定义「安全完成」:撤销范围、粘贴打码,或加披露。选一件可衡量的动作。
本周怎么用
本周给一个真 agent 画爆炸半径图:可读/可写/可外发各一圈;超圈动作一律人工确认。
画一次
在纸上画错误点击能碰到的收件箱/网盘圆圈。缩到你能睡着。
现实核对
把这篇指南放在真实任务旁边。说不出任务,就先挑一件再往下读。
难撤销 → 权限要硬
对话里起草半径低。群发、付款、删网盘文件半径高。高半径动作保持每次询问:或由人来点发送。回复再自信,也缩小不了半径。
红旗
权限一次开满,一次误触就能扫到不该碰的盘;先缩半径再放行。
常见坑
| 坑 | 改法 |
|---|---|
| 按模型自信程度给权限 | 按影响范围给权限 |
| 只想「能做什么」 | 先问「误跑两次坏什么」 |
| 撤销路径没测过 | 接上写入前先演练断开 |
现在就练一次
今晚就练:给一个真 agent 画爆炸半径图:可读/可写/可外发各一圈;超圈动作一律人工确认。
闭环
写下一行:下次权限一次开满,我拒绝放行。
一句话带走
先画爆炸半径;超圈动作一律人工确认。
下一步
← Back to home · Learn · Tools · Compare · Start