侠Liangshen AIailiangshen.com
AI Implementation Course · Mobile lessons · Lesson 4

Sourcing Information on Your Phone Without Getting Fooled: Verification and Sources

Verification and Sources: You Are the Gatekeeper

Freeabout 20 minNo experience neededWeb lesson + slides + video

In previous lessons, we learned how to ask, how to take photos, and how to provide context. This lesson focuses on: when the AI responds with convincing detail, how do you confirm it isn't deceiving you? On your phone, how do you search, verify, and spot fake news in the office?

What this lesson covers

  • Introduction
  • Step-by-Step
  • Practice and Pitfalls
  • Quiz and Takeaways

Video version: about 8 min

Narration is AI-generated. The video plays on YouTube; the chapter buttons above jump to the matching places. You can skip the video and scroll down to read.
01

Introduction

About 2 minutes

Let's look at a scenario firstFictional example; numbers are illustrative

Store Manager · Manager Fang

Manager Fang wants to know: Are there any regulations regarding the advertising copy for the store's nighttime promotion?

The Dragon Warrior provided a detailed answer, citing specific articles from a certain regulation. She almost printed that sentence on the poster.

She remembered: such responses might be hearsay. She checked the source, but the link didn't work, and the clause numbers didn't match.

Money, contracts, public statements, dates, and figures always require someone to guard the final checkpoint. That person is you.
02

Step-by-Step

About 8 minutes

Three Actions for Sourcing Information

Request the SourceAsk it to specify the publishing organization and date. If you're unsure, state that directly.
→
Open and ReviewCheck who published it, when, and whether it discusses the same issue.
→
Spot-Check Key SentencesCompare word-for-word with what it paraphrased. For important conclusions, find a second independent source.
These three actions take less than two minutes and can block most hearsay.
Tip

Exercise: Ask for the source, then have it critique its own answer.

Suggested time Approx. 3 minutes

Send the first prompt, then send the second after receiving the answer.

Request the Source
Please answer [your question]. Specify the publishing organization and date for your basis. If you are unsure, write 'unsure'—do not guess.
Have it critique its own answer (it cannot replace your verification, but it helps narrow the scope)
Review your previous answer. List the three points most likely to be wrong, explain why they might be incorrect, and indicate where you should verify them.
In the response you receive, every number and date should have a source explanation or be marked for verification.
How to check: what a good result looks like
  • Every number and date has a source explanation or is marked for verification.
  • For the three points it critiques, you can identify where to verify each.

Click the link and verify four things

Who published it?

Check the publishing organization. Is the URL domain familiar? Many fake websites mimic similar names.

When was it published?

Check the publication and update dates. Prices and policies change; outdated information is unusable.

Is it talking about the same thing?

A correct title doesn’t guarantee correct content. Find the key sentence and compare it word-for-word.

Is there a second independent source?

Two websites reprinting the same article do not count as two sources.

Practice spotting errors in your area of expertise

1
Choose your area of expertiseYou know it best, making it easiest to spot errors on the spot.
2
Ask five factual questions, and mark them as correct, incorrect, or uncertain yourselfIts confidence is not evidence.
3
Have it critique its own answer, then click one link to verifyLook at the points it flagged as potentially wrong, and choose one to check yourself.
4
Record the resultsCheck a few items, note how many are correct and how many are incorrect, and save this to your memo.
03

Practice and Pitfalls

About 6 minutes

When it keeps admitting mistakes but fails to fix them: a three-step approach

1
First, set the rulesIf it doesn't know, say so. Do not guess. Check the official manual first if necessary, and paste the original text.
2
Ask the reverse questionFirst ask: Based on this material, can you draw this conclusion? What evidence is missing?
3
Verify the original text and images yourselfFor actions involving money, settings changes, or external communications, do not proceed if you cannot find supporting evidence.
Tip

Exercise: Set rules and verify 'completed' claims

Suggested time Approx. 3 minutes

Send the two steps sequentially. The second step requires it to list the steps, and you choose one step to calculate or check yourself.

Set rules first, then ask the reverse question
Set a rule first: If it doesn't know, say so directly. Do not guess. Check the official manual first if necessary, and paste the original text. Do not provide a conclusion yet. Please answer: Based on the material I provided, can you determine [the conclusion]? If you are unsure, what evidence is missing?
Verify 'completed' claims
You stated that [calculation is complete / materials have been checked]. Please list your calculation process or the basis for your findings step by step, so I can spot-check one step.
When it says 'I have verified,' it lacks verification capability if not connected to the internet, and may still misread information when connected. Treat such claims as subject to spot-checks.
How to check: what a good result looks like
  • Its response contains no ungrounded 'verified' claims.
  • The step you spot-checked aligns with the original text or your own calculations.

Fake news in the office: three rules

1
Do not confirm financial matters in chatIf someone impersonating a leader requests a transfer, hang up immediately and call back using the number saved in your own contacts.
2
Do not directly click on linksFake invoices and notices often contain links. Do not click them; instead, open the official app to check.
3
The more urgent, the more you must verify'Immediately' or 'must be done today' are common tactics. If someone is rushing you, pause and verify.
For uncertain content, you can ask it to break down the issues, but you make the judgment and verify through your own stored channels.

Three most common types of fabrication

Fabricated experiences

It mentions that a certain company did this before, but cannot name the company.

Fabricated qualifications and figures

It states 'according to statistics,' but provides no source.

Performance promises

It states 'sales will definitely increase,' but provides no conditions.

Mark them as pending verification when encountered; if they cannot be verified, delete them. Do not leave them in external materials.
04

Quiz and Takeaways

About 4 minutes

Five traps on mobile phones

1
Links that prompt for account details upon clickingThe full URL is not visible on a small screen. Long-press the link to preview the URL; specifics depend on your current version.
2
Focusing only on the title, ignoring the dateDates are often in inconspicuous places; you need to scroll down.
3
Using thumbnails as evidenceA short summary in search results is not the original text; click through to read the full content.
4
Forwarding equals spreadingDo not forward unverified messages to employee groups.
5
GatekeepingDates, amounts, clause numbers, and names must be verified by a person before entering external materials.

Five minutes every night: Pending verification checklist

1
Note down during the dayOne item per line: which sentence, from which conversation, what needs to be checked.
2
Verify each item one by one in the eveningCheck off verified items; write down the correct answer for incorrect ones.
3
Commit to this for two weeks: draw your map.See where it makes mistakes most often; this is your personal map of urban legends.

Three quick questions to check yourself

Question 1: It provided a source link. Which of the following actions counts as verification?

Answer B.A link doesn't equal evidence; you must open it. Ask if it's sure, and it will likely say yes.

Question 2: A colleague sent a WeChat message: 'The boss asked me to transfer funds. Urgent. Advance it for now.' What should you do?

Answer B.Verify using your own saved channels, not the ones provided by the sender.

Take away three actions and one gatekeeper rule from this lesson.

  1. Require sources: Note the publishing organization and time. If unsure, say so.
  2. Open and check: Who published it, when, and compare the key sentence word for word.
  3. Spot-check key sentences: For important conclusions, find a second independent source.
  4. For money, links, and urgent messages, verify using your own saved channels.
Show the full transcript (video narration)
Sourcing Information on Your Phone Without Getting Fooled

Welcome to Lesson 4 of the mobile version. In previous lessons, we learned how to ask, how to take photos, and how to provide context. This lesson focuses on: when the AI responds with convincing detail, how do you confirm it isn't deceiving you? On your phone, how do you search, verify, and spot fake news in the office?

Let's look at a scenario first

Let's look at a scenario first. It is fictional, and the numbers are illustrative. Manager Fang wants to know if there are any regulations regarding the advertising copy for the store's nighttime promotion. The Dragon Warrior provided a detailed answer, citing specific articles from a certain regulation. She almost printed that sentence on the poster. Fortunately, she remembered that such responses might be hearsay; the more realistic it sounds, the more you must verify. She checked the source, but the link didn't work, and the clause numbers didn't match. Money, contracts, public statements, dates, and figures always require someone to guard the final checkpoint. That person is you.

Three Actions for Sourcing Information

Checking information on your phone takes just three steps. First, ask for the source. When you pose a question, add a note asking for the publishing organization and the date. If it’s unsure, it should say so. Second, click the link. A link doesn’t equal evidence; you must click through to verify. Third, spot-check key sentences. Compare its paraphrasing word-for-word with the original text. For major conclusions, find at least two independent sources that don’t just copy each other. These three steps take less than two minutes but can filter out most rumors.

Exercise: Ask for the source, then have it critique its own answer.

Exercise: Ask for the source, then have it critique its own answer. The first prompt asks it to answer your question, specifying the publishing organization and date, and stating 'unsure' if it lacks confidence. The second prompt asks it to review its answer, listing the three most likely errors and where to verify them. It cannot replace your verification, but it helps narrow the scope. Verification standard: In the response you receive, every number and date has a source explanation or is marked for verification.

Click the link and verify four things

Click the link and verify four things. First, who published it? Check the publishing organization at the top or bottom of the page, and verify if the URL domain is familiar. Many fake websites mimic similar names. Second, when was it published? Prices and policies change; outdated information is unusable. Third, is it talking about the same thing? A correct title doesn’t guarantee correct content; find the key sentence and compare it word-for-word. Fourth, is there a second independent source? Two websites reprinting the same article do not count as two.

Practice spotting errors in your area of expertise

Practice catching errors in your area of expertise. Choose a field you know well, ask it five factual questions, and mark each as correct, incorrect, or uncertain yourself. Its claim of being 'confident' is not evidence. Ask it to identify potential errors, click on one, and verify it. Record the results in your memo: how many were checked, how many were correct, and how many were incorrect. If you find an error, don't just say it's wrong; paste its original statement along with the source text, and ask it to correct it based on the comparison.

When it keeps admitting mistakes but fails to fix them: a three-step approach

If it keeps apologizing but the answer remains inaccurate, stop urging it and use the three-step method instead. Step 1: Set the rules. If it doesn't know, say so directly. Do not guess. Check the official manual first if necessary, and paste the original text. Step 2: Ask the reverse question. Based on this material, can you draw this conclusion? What evidence is missing? Step 3: Verify the original text and images yourself. For actions involving money, settings changes, or external communications, do not proceed if you cannot find supporting evidence.

Exercise: Set rules and verify 'completed' claims

Exercise: Set rules and verify 'completed' claims. First, set the rules, then ask the reverse question. Second, require it to list the steps, and you choose one step to calculate or check yourself. Its statement 'I have verified' does not mean it actually verified it. Without internet access, it lacks verification capability; with internet access, it may still misread. Treat such claims as subject to spot-checks.

Fake news in the office: three rules

There is another type of matter in the office: a colleague or leader suddenly sends a message that is urgent, involving a transfer, or sharing an invoice link. Follow these three rules. First, if money is involved, do not confirm in the chat; call back using the number stored in your own contacts. Second, if a link is involved, do not click it directly; open the official app yourself to check. Third, the more urgent it seems, the more you must verify; phrases like 'immediately' or 'must be done today' are common tactics. For uncertain content, you can ask it to break down suspicious points, but you make the judgment and verify through your own stored channels.

Three most common types of fabrication

The three most common types of fabrication, check against these. First, fabricated experiences: it mentions that a certain company did this before, but cannot name the company. Second, fabricated qualifications and figures: it states 'according to statistics,' but provides no source. Third, performance promises: it states 'sales will definitely increase,' but provides no conditions. For these three types of sentences, mark them all as pending verification; if they cannot be verified, delete them. Do not leave them in external materials.

Five traps on mobile phones

There are five traps on mobile phones. First, links that prompt for account details upon clicking: the full URL is not visible on a small screen; long-press the link to preview the URL, specifics depend on your current version. Second, focusing only on the title and ignoring the date: dates are often in very inconspicuous places; you need to scroll down. Third, using thumbnails as evidence: a short summary in search results is not the original text; click through to read the full content. Fourth, forwarding equals spreading: do not forward unverified messages to employee groups. Fifth, gatekeeping: dates, amounts, clause numbers, and names must be verified by a person before entering external materials.

Five minutes every night: Pending verification checklist

Build a habit: spend five minutes each night reviewing a checklist. For items you can't verify during the day, jot them down one by one: the quote, the conversation it came from, and what needs checking. At home, open each source to verify. Check off verified items, and write down the correct answer for any errors. After two weeks, you'll see where it makes mistakes most often. This is your personal map of urban legends.

Quiz Question 1

Question 1. It provided a source link. Which of the following actions counts as verification? A: Relax because there's a link. B: Open the link, check the publishing organization and time, and compare it with the key sentence. C: Ask it again: Are you sure? The answer is B. A link doesn't equal evidence; you must open it. Ask if it's sure, and it will likely say yes.

Quiz Question 2

Question 2. A colleague sent a WeChat message: 'The boss asked me to transfer funds. Urgent. Advance it for now.' What should you do? A: Transfer immediately to avoid delays. B: Contact the boss directly using the number you saved to confirm. C: Reply 'Okay' and deal with it later. The answer is B. Verify using your own saved channels, not the ones provided by the sender.

Take away three actions and one gatekeeper rule from this lesson.

Final review: Take away three actions and one gatekeeper rule from this lesson. Require sources: Note the publishing organization and time. Open and check: Who published it, when, and compare the key sentence word for word. Spot-check key sentences: For important conclusions, find a second independent source. The gatekeeper rule: For money, links, and urgent messages, always verify using your own saved channels. In the next lesson, we will save common instructions as templates.