What ChatGPT, Claude, and Grok can (and cannot) do
Goal: Know when to trust the answer, when to double-check, and when to stop using the chat.
Best for: Your first week with any AI chat. No tech background needed.
LLMs predict useful next words. They are not a truth database. Learn the safe jobs, the risky jobs, and the 60-second check before you trust an answer.
Why beginners skip this
Overrating live truth and actions while underrating drafts burns trust. Keep a can/cannot card and hand off what needs tools or humans. Mid-week cost shows up as rework, not as a missing bookmark.
Step 1 — Plain words: what is an LLM?
LLM means Large Language Model — the engine behind ChatGPT, Claude, and Grok. Think of it as a very strong autocomplete: it predicts useful next sentences from patterns in text it was trained on. It does not “look up a secret truth database” unless you turn on web search or attach a file.
- Good at: drafting, rewriting, outlining, explaining, brainstorming, summarizing text you give it.
- Risky at: fresh news, exact quotes, prices, medical/legal/finance decisions, anything you would bet money or reputation on.
- Bad at: knowing your private calendar or inbox unless you connect those tools on purpose.
Step 2 — A 60-second test before you trust an answer
After any important answer, paste this follow-up (copy as-is, then fill the brackets):
Mark each claim in your last answer as:
A) Supported by text I already gave you
B) General knowledge that could be outdated
C) Guess / unsure
List claims under A / B / C. For every B or C, tell me what I should open to verify.
Example
Filled prompt
Mark each claim in your last answer as A / B / C.
Last topic: “Does Linear replace Jira for a 12-person SaaS eng team?”
For every B or C, tell me what page to open to verify.
What good output looks like
- You see a short A/B/C list, not another essay
- B/C items come with “open this docs page / ask your admin”
- If almost everything is C, you treat the answer as a draft only
- Pass/fail dated (Asia/Shanghai) sits next to the artifact
Step 3 — What to click in the product (no jargon trap)
| If you need… | Look for a button/toggle like… | Why |
|---|---|---|
| Today’s news or prices | Search / Browse / Web / Research | Without it, the model may invent outdated facts |
| Answer from your PDF | Attach / Upload / + file | Then say “only use the file” |
| Safer long project | Projects (ChatGPT or Claude) | Keeps files + standing instructions in one place |
If you cannot find Search or Upload, check your plan’s help page — free plans sometimes hide these. You can still paste short text into the chat.
Step 4 — Practice: one safe task, one unsafe task
Do this step with a real artifact open—not from memory.
Task A (safe): Rewrite this paragraph for a busy manager in 5 bullets. Keep my meaning.
[paste paragraph]
Task B (unsafe alone): “What is our company’s exact refund policy?”
→ Instead attach the policy PDF, or say you will open the wiki yourself.
Example
Filled prompt
Rewrite for a busy manager in 5 bullets. Keep my meaning.
Paragraph: We will migrate checkout to the new payments API in November. Marketing needs a one-week freeze on promo codes during cutover. Support must use the new refund form after Nov 15.
What good output looks like
- Five short bullets, no new promises invented
- Dates and team names preserved
- You would feel fine pasting this into Slack after a glance
Cannot = still useful
Knowing limits makes better asks—not cynicism.
Example
Filled prompt
Asks: (1) brainstorm subject lines (2) today's USD/HKD mid-market (3) medical dosage.
Label trust / check / stop. For check: what primary. For stop: refuse line.
What good output looks like
- Labels trust/check/stop correctly for “Know when to trust the answer, when to double-chec”
- Does not treat the model as a database or authority
- Context pack stays ≤ one screen when asked
- Pass/fail: you can explain the limit in one line
Red flag
Asking for live inventory with no tool; “just send the email” with no connector—correct the ask.
Save this card
Card: Trust drafts; check facts; stop on high-stakes and secrets—check it once this week, or it stays a bookmark. Keep this beside the tool; read before you start.
1. What I shipped: ___ 2. What I refused: ___ 3. What I will never-do again: ___ (date: Asia/Shanghai)
- [ ] Tools/writes paused
- [ ] Refuse-line dated
- [ ] Artifact path saved
- [ ] Next link chosen (or stop)
Before you start
Sit with three real asks from this week. You will label trust/check/stop for “What ChatGPT, Claude, and Grok can”—bring the asks, not slogans. Guide: foundations-what-an-llm-can-and-cannot-do. If you only have a blank practice box, stop and fetch the real job first.
- Goal in one line: ___
- Allowed tools: ___
- Forbidden: ___
- Human approve needed for: ___
How to use this week
This week: sort three real asks into trust / check / stop—drafts can feel right, facts need verify, high-risk or secrets stop cold. Ship the artifact out of chat (doc/PR/note) so the week leaves a file, not only a thread—date it Asia/Shanghai.
Calendar block (foundations-what-an-llm-can-and-cannot-do, optional): 25 minutes once this week—open the guide, run Practice once, date the refuse-line, then stop. No binge-reading counts as practice.
Pitfalls
| Pitfall | Fix |
|---|---|
| Confident tone = true | Ask for A/B/C labels |
| Asking “what is our policy?” with no file | Upload the policy or open it yourself |
| Using AI for medical/legal final calls | Use it to prepare questions for a professional |
Example
Filled prompt
Job: Know when to trust the answer, when to double-chec
Prior fail: [what missed the check]
Repair: keep the same Done; add one constraint + one concrete example from my notes.
Boundaries: draft only; label Unknowns [?]; no silent send.
Return: fixed output + the one-minute pass/fail I will mark.
What good output looks like
- Names the prior fail without inventing a new job
- Adds one constraint tied to “Know when to trust the answer, when to double-chec”
- Still draft-only / Unknowns labeled
- Pass/fail: you mark green on the same checklist (foundations-what-an-llm-can-and-cannot-do #4)
Practice now
Live card: one can / one cannot with a work example—not a meme (Asia/Shanghai).
Today: rewrite one overreaching ask into something the model can do, and mark what stays human. Date the rewrite (Asia/Shanghai).
Today card (copy) — foundations-what-an-llm-can-and-cannot-do: 1. Artifact I will produce: ___ 2. Pass/fail check: ___ 3. Refuse-line if tempted to skip verify/send: ___ (date: Asia/Shanghai) 4. One never-do from this guide: ___
- [ ] Artifact path written
- [ ] Refuse example would say "yes"
- [ ] Dated Asia/Shanghai
One sentence takeaway
Trust drafts; check facts; stop on high-stakes and secrets—check it once this week, or it stays a bookmark
- You can point to a dated refuse-line
- You have one artifact path from tonight
- You can teach the red flag in one sentence
Next
Context & memory · Choose a model · Beginner mistakes · When AI sounds sure · Free vs paid
Pair with today: open the first Next link (foundations-context-windows-and-memory) only after you dated a refuse-line for this guide (Asia/Shanghai).
ChatGPT、Claude、Grok 能做什么、不能做什么
目标: 知道什么时候可以信答案、什么时候要核对、什么时候别再用聊天框硬扛。
适合: 刚开始用任何 AI 聊天工具的第一周。不需要技术背景。
LLM 预测的是有用的下一句,不是真理库。先分清安全任务、高风险任务,以及信任答案前的 60 秒检查。
为什么新手跳过
把聊天当数据库或律师图方便,直到自信错答让你付出代价。分清 可信/须核/停止。
步骤 1——用白话说:什么是大模型?
LLM(Large Language Model,大语言模型)就是 ChatGPT、Claude、Grok 背后的引擎。可以把它想成超强的「自动续写」:根据学过的文字规律,猜接下来什么话有用。它并不会自动去查一本「绝对真相百科」——除非你打开联网搜索,或自己上传文件。
- 擅长:起草、改写、列提纲、解释、头脑风暴、总结你给它的文字。
- 有风险:新鲜新闻、精确引文、价格、医疗/法律/金融决策,以及任何拿名誉或钱去赌的事。
- 做不到:除非你主动连接工具,否则它看不到你的私人日历或邮箱。
步骤 2——信之前,先做 60 秒自检
重要答案出来后,用下面这句追问(整段复制,再填中括号):
把你上一条回答里的每个主张标成:
A) 有我已经给你的原文支撑
B) 常识,但可能过时
C) 猜测 / 不确定
按 A / B / C 列出。凡是 B 或 C,告诉我该打开什么去核对。
实例
填好的提示词
把你上一条回答里的每个主张标成 A / B / C。
刚才主题:「12 人 SaaS 工程团队,Linear 能不能取代 Jira?」
凡是 B 或 C,告诉我该打开哪一页核对。
像样的输出大概长这样
- 看到的是短短的 A/B/C 列表,不是又一篇长文
- B/C 项会写「打开某某文档 / 问管理员」
- 如果几乎全是 C,你只把答案当草稿
步骤 3——产品里点哪里(别被术语绕晕)
| 如果你需要… | 在界面里找类似… | 为什么 |
|---|---|---|
| 今天的新闻或价格 | Search / Browse / 联网 / 研究 | 不开的话,模型可能编过时事实 |
| 答案必须来自你的 PDF | 附件 / 上传 / + 文件 | 然后写「只用这个文件」 |
| 长期项目更稳 | Projects(ChatGPT 或 Claude) | 文件和固定说明放在同一处 |
如果找不到搜索或上传,先看你套餐的帮助页——免费版有时会隐藏。你仍然可以把一小段文字直接粘贴进对话框。
步骤 4——练习:一个安全任务,一个不安全任务
用真实材料做这一步——不要凭记忆。
任务 A(安全):把这段话改成忙经理能扫的 5 条要点,意思不变。
[粘贴段落]
任务 B(单独做不安全):「我们公司退款政策原文是什么?」
→ 应改成:附上政策 PDF,或你自己打开 wiki 核对。
实例
填好的提示词
改成忙经理能扫的 5 条要点,意思不变。
原文:我们 11 月把结账迁到新支付接口。切换期间市场部促销码要停一周。11 月 15 日后客服必须用新的退款表单。
像样的输出大概长这样
- 五条很短,没有多编承诺
- 日期和团队名还在
- 扫一眼就敢贴进 Slack
- 贴合填例场景——不是空泛打气
- 相关则拒绝编造事实或静默发送
不能 = 仍然有用
知道极限会让提问更好——不是愤世嫉俗。
红旗
要求未连接工具却查实时库存;让模型「直接发信」。越界当功能——纠正。卡上写不清就不继续——先补检查项再跑。
保存这张卡
卡面:能 / 不能 / 需人工。派活前看卡;越界请求改写;缺项就停,不硬开。
1. 我交出了:___ 2. 我拒绝了:___ 3. 我永不再做:___(日期:Asia/Shanghai)
- [ ] 工具/写入已暂停
- [ ] 拒做句已标注日期
- [ ] 成品路径已存
- [ ] 已选下一步(或停)
开始前
打开你真正会用的账号/项目。准备好与「ChatGPT、Claude、Grok 能做什么、不能做什么」相关的真实材料(不要空白练习框)。
默认姿态:在人确认发送/写入之前只出草稿。授予新工具前,先写一条带日期的拒做句(Asia/Shanghai)。
- 一句话目标:___
- 允许的工具:___
- 禁止:___
- 需要人批准:___
本周怎么用
本周贴一张能/不能清单:草稿✓ 实时事实? 未授权行动✗,并用一次真任务对照。把过/不过写进笔记并注明日期(Asia/Shanghai)。
日历块(foundations-what-an-llm-can-and-cannot-do,可选):本周一次 25 分钟——打开本篇、练一次、写上拒做句日期,然后停。贪多读完不算练过。
常见坑
| 坑 | 改法 |
|---|---|
| 语气很自信 = 一定对 | 要求标 A/B/C |
| 没文件却问「我们政策是什么」 | 上传政策,或自己打开原文 |
| 拿 AI 做医疗/法律最终决定 | 只用它整理问题,去问专业人士 |
实例
填好的提示词
任务:Know when to trust the answer, when to double-chec
上次失败:[哪条检查未过]
修复:保持同一 Done;加一条约束 + 一条你笔记里的具体例子。
边界:仅草稿;未知标 [?];禁止悄悄发送。
返回:修好的输出 + 我将打勾的一分钟过/不过。
像样的输出大概长这样
- 点名上次失败,不另起炉灶
- 约束贴着「ChatGPT、Claude、Grok 能做什么、不能做什么」
- 仍是草稿 / 未知已标注
- 过/不过:同一张检查表能打绿(foundations-what-an-llm-can-and-cannot-do #4)
实例
填好的提示词
任务:Know when to trust the answer, when
场景要点:三张真实请求便签在手;练习编号 4/4。
边界:仅草稿;未知 [?];禁止悄悄发送;禁止编造指标。
返回:可检查产出 + 过/不过理由一行。
像样的输出大概长这样
- 约束贴着「ChatGPT、Claude、Grok 能做什么、不能做什么」与 foundations-what-an-llm-can-and-cannot-do
- 未知标 [?];不编造负责人/数字
- 不可逆动作前停下
- 一分钟内能打过/不过(foundations-what-an-llm-can-and-cannot-do #4)
现在就练一次
实卡:一条能/一条不能+工作例子——不要梗图(Asia/Shanghai)。
今天标出一次「越界请求」并改成模型能做的形式。过/不过与永不做注明日期(Asia/Shanghai)。只收藏标题算失败。
今日卡片(可复制)— foundations-what-an-llm-can-and-cannot-do: 1. 我要产出的成品:___ 2. 通过/失败标准:___ 3. 若想跳过核验/发送的拒做句:___(日期:Asia/Shanghai) 4. 本篇一条永不做:___
- [ ] 成品路径已写
- [ ] 拒做例句会说「可以」
- [ ] 已标注 Asia/Shanghai 日期
一句话带走
草稿可以先信手感;硬事实必须核对;高风险动作与秘密内容则直接停手,不拿模型当最终权威。本周给三个请求贴上标签。本周做一次可检查练习,否则只是收藏。本周留下可核对的过/不过记录并注明日期(Asia/Shanghai)。
- 能指出一条带日期的拒做句
- 今晚有一条成品路径
- 能用一句话说清红旗
下一步
上下文与记忆 · 如何选模型 · 新手十大错 · 说得笃定却错 · 免费 vs 付费
今日搭配:先为本篇写上拒做句日期(Asia/Shanghai),再打开下一步里的第一篇(foundations-context-windows-and-memory)。
← Back to home · Learn · Tools · Compare · Start