侠Liangshen AIailiangshen.com
AI Implementation Course · Mobile lessons · Lesson 2

Ask it using voice and photos

State the context clearly first, take clear photos, then verify

Freeabout 20 minNo experience neededWeb lesson + slides + video

In the previous lesson, we invited the Dragon Warrior into our phones. In this lesson, we will learn two ways to make your phone more useful than a computer: using voice to clearly state the context in one go, and using photos to bring whiteboards, spreadsheets, and equipment into the conversation.

What this lesson covers

  • Opening
  • Step-by-step
  • Practice and Pitfalls
  • Quiz and Key Takeaways

Video version: about 9 min

Narration is AI-generated. The video plays on YouTube; the chapter buttons above jump to the matching places. You can skip the video and scroll down to read.
01

Opening

About 2 minutes

Let's look at a scenarioFictional example; numbers are illustrative

Yuanfan Technology · Field Engineer Zhao

Engineer Zhao spends most of his day in client server rooms and factories.

He often has three things in hand: a whiteboard full of notes from meetings, a paper checklist handed over by the client, and a device with constantly blinking indicator lights.

Previously, he relied on handwritten notes, organizing them back in the office, which often led to omissions.

He wants to transfer them directly into his phone, but the whiteboard contains client names, the forms contain identity information, and the nameplates have serial numbers.

Four steps for photo-based questions: Speak first, cover first, then photograph, then verify

Speak firstClearly state the context in one breath: Who you are, what you are doing, and what result you want
→
Cover firstBefore photographing, cover names, numbers, serial numbers, and client identifiers
→
PhotographKeep the phone parallel, ensure good lighting, make text readable, and focus on one item at a time
→
VerifyCheck the transcribed text, marked uncertainties, and organized to-do items against the original documents one by one
Taking photos saves the time spent recording, but it doesn't save the time spent verifying.
02

Step-by-step

About 8 minutes

Step 1: Learn to speak. Use voice to state the background in one continuous sentence.

1
Who am I?For example: I am a field engineer.
2
What task needs to be done?For example: I just finished an equipment inspection meeting and need to compile the conclusions into a to-do list.
3
What kind of result is expected?For example: Each item must have an assigned person and a deadline.
Speak numbers and proper nouns slowly. Before sending, check the transcribed text and correct any misrecognized characters.

Before taking a photo: Three checks, three covers.

1
Check for people.Cover names, mobile phone numbers, ID card numbers, and employee IDs if present.
2
Check for accounts.Cover account names, passwords, QR codes, and barcodes if present.
3
Check for customer and confidential content.Cover customer names, company logos, unpublished prices, and drawings if present.
4
Additional rule for the tech industry.Cover equipment serial numbers, network addresses, screen configurations, and source code. If you cannot cover them, do not take the photo.
The most reliable method is to physically cover these items with white paper or sticky notes before taking the photo. A semi-transparent color overlay is not enough; you must confirm that the original text is no longer legible.

Three field scenarios.

Taking a photo of a whiteboard.

Stand directly in front of the whiteboard to avoid glare, ensuring the whiteboard fills the frame. If there is a lot of text, take two photos, one for the left half and one for the right half.

Taking a photo of a paper form.

Lay the form flat on the table. Keep the phone parallel to the paper; do not take the photo at an angle. Handwritten text may be misrecognized, so verify each cell against the original after transcription.

Taking a photo of on-site equipment

Start with a wide shot, then take separate photos of the indicator lights, error screen, and wiring. For each shot, specify the equipment type and describe the issue. Blur the serial number.

It provides possible causes and inspection steps, not definitive conclusions. For any actions involving power disconnection or wiring, strictly follow the manual and company procedures.

Four tips for clear photos

Lighting

Natural light from a window is best. Avoid glare from overhead lights.

Distance and Angle

Get close enough to read the text clearly, and keep the phone parallel to the paper. Take multiple photos rather than one large image.

Stability

Hold the phone with both hands, rest your elbows on the table edge, and hold your breath at the moment of pressing the shutter.

Description

Photos only show what the AI sees; use one or two sentences to clearly state what you want.

Exercise: Use a list without sensitive information

Record these three numbers. You can use the same image to test again later if you switch apps or versions.
03

Practice and Pitfalls

About 6 minutes
Tip

Exercise: Three on-site prompts to copy

Suggested time Approx. 4 minutes

Send the photo along with the prompt, replacing the brackets with your own content.

Whiteboard Organization
This is a photo of a meeting whiteboard. Please transcribe the text line by line, marking unclear parts with [Unclear]. Then organize it into a to-do table with columns for Task, Responsible Person, and Deadline. Mark 'To be confirmed' for missing responsible persons or deadlines; do not guess.
Paper Form Verification
This is a photo of a paper [Checklist Name]. Please transcribe it into a text table, then list: which cells are empty and which readings may be incorrect. Do not add any content I did not write.
Equipment Troubleshooting
I am a field engineer. This is a photo of [Equipment Type], with the symptom described as [One-sentence description]. Please list the three most likely causes, provide one safe inspection step for each cause, and specify which situations require stopping and contacting the manufacturer.
Each instruction includes constraints like 'mark anything unclear' and 'do not guess missing information,' which are key to preventing the AI from hallucinating.
How to check: what a good result looks like
  • It marked the unclear areas.
  • Items in the to-do list missing an owner or deadline were marked as 'to be confirmed.'
Common mistakes and fixes
It added content not present in the original text.Fix: Response: Use only what is visible in the photo; do not fill in missing information.
Equipment troubleshooting jumped to conclusions.Fix: Response: Please list only possibilities and explain the safety boundaries for each step.

Five traps on your phone

1
If the photo is unclear, the answer will be inaccurate.Glare, camera shake, and angled shots are the three main causes. After taking the photo, zoom in first to check if the text is readable.
2
One image consumes many tokens.Images consume more resources than text. Do not upload more than a dozen at once; select two or three of the most critical ones.
3
Transcription errors in voice-to-textHomophones, numbers, and model names are most prone to errors. Scan amounts and dates before sending.
4
Background informationDocuments behind the whiteboard, business cards on the table, or chat windows on the screen may all be captured in the photo.
5
Do not grant excessive permissionsFor the camera and microphone, select 'Allow while using the app.' For the photo album, select 'Specific photos,' not 'Allow all the time.'
Do not take photos while walking on-site, nor reach out to photograph parts of operating equipment.
04

Quiz and Key Takeaways

About 4 minutes

After taking the photo, perform a three-step check.

1
Step one: Compare the text line by line with the original.Compare the transcribed text with the original document line by line.
2
Step two: Manually fill in anything unclear.Manually check the original document to fill in areas marked as unclear by the AI.
3
Step three: Review each to-do itemVerify whether the responsible person and deadline are correct, and check if any items were added by the system itself.
Before entering numbers and dates into official records, cross-check them item by item against the original documents.

Three quick questions to check yourself

Question 1: Engineer Zhao needs to photograph a whiteboard containing a client's name and contact number. What is the best course of action?

Answer B.Handle sensitive information before uploading; do not rely on fixing it afterward.

Question 2: The system misread a number from a paper form. What is the most likely cause, and what should be done?

Answer B.Handwriting recognition can be error-prone, so include the instruction 'flag unclear items' in your prompt, then verify each cell yourself.

This lesson concludes with five key phrases.

  1. Cover first, then photograph: Mask sensitive information before taking a picture.
  2. Capture clearly before uploading: Ensure good lighting and legible text; select only the most critical images.
  3. One task per photo: One image, one specific action.
  4. Don’t guess missing info: Flag any unclear content or missing responsible parties.
  5. Verify numbers independently: Cross-check amounts, dates, and model numbers against the original document before recording them.
Show the full transcript (video narration)
Ask it using voice and photos

Welcome to Lesson 2 on mobile. In the previous lesson, we invited the Dragon Warrior into our phones. In this lesson, we will learn two ways to make your phone more useful than a computer: using voice to clearly state the context in one go, and using photos to bring whiteboards, spreadsheets, and equipment into the conversation. At the same time, we will learn how to take clear photos and how to do so safely.

Let's look at a scenario

Let's look at a scenario, which is fictional, and the numbers are merely illustrative. Zhao, a field engineer at Yuanfan Technology, spends most of his day in client server rooms and factories. He often has three things in hand: a whiteboard full of notes from meetings, a paper checklist handed over by the client, and a device with constantly blinking indicator lights. Previously, he relied on handwritten notes, organizing them back in the office, which often led to omissions. Now he wants to transfer them directly into the conversation on his phone. However, the whiteboard contains client names, the forms contain identity information, and the nameplates have serial numbers. The focus of this lesson is how to take clear photos and how to do so safely.

Four steps for photo-based questions: Speak first, cover first, then photograph, then verify

When using photos to ask questions, follow these four steps. First, speak: clearly state the background in one breath. Second, cover: hide names, ID numbers, serial numbers, and customer identifiers. Third, take the photo: keep the phone parallel to the subject, ensure good lighting, and make sure the text is legible. Finally, verify: cross-check every item against the original document, including the transcribed text, any flagged uncertainties, and the extracted action items. Remember this: taking photos saves your recording time, but not your verification time. Keep this in mind.

Step 1: Learn to speak. Use voice to state the background in one continuous sentence.

Step 1: Learn to speak. Voice input is suitable for stating the background in one continuous sentence, and the background is precisely the most important part. Before speaking, clarify three things: Who am I? What task needs to be done? What kind of result is expected? After speaking, review the text transcribed on the screen. Numbers, names, and equipment model numbers are prone to recognition errors; if you spot a mistake, click directly into the text to edit it, then send. If continuous voice dialogue is available, avoid using it in noisy environments, as it may pick up conversations from bystanders.

Before taking a photo: Three checks, three covers.

Before taking a photo, perform three checks and three covers. Check for names, mobile phone numbers, ID card numbers, and employee IDs; cover them if present. Check for account names, passwords, QR codes, and barcodes; cover them if present. Check for customer names, company logos, and unpublished prices or drawings; cover them if present. For the tech industry, add one more check: equipment serial numbers, network addresses, screen configurations, and source code. If you cannot cover them, do not take the photo. The most reliable method is to physically cover these items with white paper or sticky notes before taking the photo. A semi-transparent color overlay is not enough; you must confirm that the original text is no longer legible.

Three field scenarios.

Three on-site scenarios. First, photograph the whiteboard. Stand directly in front of it to avoid glare, ensuring the board fills the frame. If there is too much text, take two photos, one for each half. Second, photograph paper forms. Lay them flat on a table and keep the phone parallel to the paper; do not angle the shot, or the grid lines will not align. Third, photograph on-site equipment. Start with a wide shot, then take separate photos of the indicator lights, error screen, and wiring. For each shot, specify the equipment type and describe the issue. It provides possible causes and inspection steps, not definitive conclusions. For any actions involving power disconnection or wiring, strictly follow the equipment manual and company procedures.

Four tips for clear photos

Four tips for clear photos. First, lighting: natural light from a window is best. Avoid glare from overhead lights. Second, distance and angle: get close enough to read the text clearly, keep the phone parallel to the paper, and take multiple photos rather than one large image. Third, stability: hold the phone with both hands, rest your elbows on the table edge, and hold your breath at the moment of pressing the shutter. Fourth, description: photos only show what the AI sees, not what you want. Therefore, always include one or two sentences of context outside the photo.

Exercise: Use a list without sensitive information

Try it out. Use an item without any sensitive information, such as your own handwritten shopping list. When photographing, keep the phone parallel to the paper and use side lighting. After uploading, use voice command: 'Please transcribe this list into text, group by category, and mark anything that is unclear.' Finally, compare with the original document and count how many items were read correctly, missed, or fabricated. These three numbers represent your baseline for image reading ability. If items are fabricated (i.e., things not in the original document), add this instruction to your prompt: 'Do not add anything that is not there.'

Exercise: Three on-site prompts to copy

Use these three on-site prompts as written. For whiteboard cleanup, have it transcribe line by line, mark anything unclear, and then organize into a to-do list. For table verification, have it transcribe the text first, then list any blanks or potential misreadings, without adding anything you didn't write. For equipment troubleshooting, have it list the three most likely causes, provide one safety-check step for each, and explain when you must stop and contact the manufacturer. Each instruction includes constraints like 'mark anything unclear' and 'do not guess missing information,' which are key to preventing the AI from hallucinating.

Five traps on your phone

There are five traps on your phone. First, if the photo is unclear, the answer will be inaccurate. Glare, camera shake, and angled shots are the three main causes; zoom in after taking the photo to check. Second, one image consumes many tokens; do not upload more than a dozen at once, but select two or three of the most critical ones. Third, there are transcription errors in voice-to-text, with homophones, numbers, and model names being most prone to errors. Fourth, there is background information; documents behind the whiteboard or business cards on the table may all be captured in the photo. Fifth, do not grant excessive permissions; for the camera and microphone, select 'Allow while using the app,' not 'Allow all the time.' Also, pay attention to safety on-site and do not take photos while walking.

After taking the photo, perform a three-step check.

After taking the photo, perform a three-step check. First, compare the transcribed text line by line with the original document. Second, personally review the original document for any parts marked as illegible to fill in the gaps. Third, go through each action item and ask yourself: Is the responsible person correct? Is the deadline correct? Was any item added by the system itself? This applies equally to whiteboards, spreadsheets, and equipment. Before entering numbers and dates into official records, cross-check them item by item against the original documents.

Quiz Question 1

Question 1. Engineer Zhao needs to photograph a whiteboard containing a client's name and contact number. What is the best course of action? A) Take the photo directly; the system won't remember it. B) Cover the client's name and phone number with a piece of paper before taking the photo, then verify that the original text is still legible afterward. C) Send the photo to a colleague and let them decide what to do. The answer is B. Handle sensitive information before uploading; do not rely on fixing it afterward.

Quiz Question 2

Question 2: The AI misread a number from a paper form. What is the most likely cause, and how should you handle it? A. It’s doing this on purpose. Switch to a different app. B. Handwriting or camera angle caused inaccurate recognition; check each cell individually and ask it to flag uncertain entries. C. Ignore it. It’s close enough anyway. Answer: B. Since handwriting recognition can be error-prone, include the instruction 'flag unclear items' in your prompt, then verify each cell yourself.

This lesson concludes with five key phrases.

Final review: Here are the five key phrases from this lesson. Cover first, then photograph: Mask sensitive information before taking a picture. Capture clearly before uploading: Ensure good lighting and legible text; select only the most critical images. One task per photo: One image, one specific action. Don’t guess missing info: Flag any unclear content or missing responsible parties. Verify numbers independently: Cross-check amounts, dates, and model numbers against the original document before recording them. Save these to your notes for quick access anytime.