Video version: about 9 min
Opening
About 2 minutesLet's look at a scenarioFictional example; numbers are illustrative
Engineer Zhao spends most of his day in client server rooms and factories.
He often has three things in hand: a whiteboard full of notes from meetings, a paper checklist handed over by the client, and a device with constantly blinking indicator lights.
Previously, he relied on handwritten notes, organizing them back in the office, which often led to omissions.
Four steps for photo-based questions: Speak first, cover first, then photograph, then verify
Step-by-step
About 8 minutesStep 1: Learn to speak. Use voice to state the background in one continuous sentence.
Before taking a photo: Three checks, three covers.
Three field scenarios.
Taking a photo of a whiteboard.
Stand directly in front of the whiteboard to avoid glare, ensuring the whiteboard fills the frame. If there is a lot of text, take two photos, one for the left half and one for the right half.
Taking a photo of a paper form.
Lay the form flat on the table. Keep the phone parallel to the paper; do not take the photo at an angle. Handwritten text may be misrecognized, so verify each cell against the original after transcription.
Taking a photo of on-site equipment
Start with a wide shot, then take separate photos of the indicator lights, error screen, and wiring. For each shot, specify the equipment type and describe the issue. Blur the serial number.
Four tips for clear photos
Lighting
Natural light from a window is best. Avoid glare from overhead lights.
Distance and Angle
Get close enough to read the text clearly, and keep the phone parallel to the paper. Take multiple photos rather than one large image.
Stability
Hold the phone with both hands, rest your elbows on the table edge, and hold your breath at the moment of pressing the shutter.
Description
Photos only show what the AI sees; use one or two sentences to clearly state what you want.
Exercise: Use a list without sensitive information
Practice and Pitfalls
About 6 minutesExercise: Three on-site prompts to copy
Suggested time Approx. 4 minutesSend the photo along with the prompt, replacing the brackets with your own content.
This is a photo of a meeting whiteboard. Please transcribe the text line by line, marking unclear parts with [Unclear]. Then organize it into a to-do table with columns for Task, Responsible Person, and Deadline. Mark 'To be confirmed' for missing responsible persons or deadlines; do not guess.
This is a photo of a paper [Checklist Name]. Please transcribe it into a text table, then list: which cells are empty and which readings may be incorrect. Do not add any content I did not write.
I am a field engineer. This is a photo of [Equipment Type], with the symptom described as [One-sentence description]. Please list the three most likely causes, provide one safe inspection step for each cause, and specify which situations require stopping and contacting the manufacturer.
How to check: what a good result looks like
- It marked the unclear areas.
- Items in the to-do list missing an owner or deadline were marked as 'to be confirmed.'
Common mistakes and fixes
Five traps on your phone
Quiz and Key Takeaways
About 4 minutesAfter taking the photo, perform a three-step check.
Three quick questions to check yourself
Question 1: Engineer Zhao needs to photograph a whiteboard containing a client's name and contact number. What is the best course of action?
Question 2: The system misread a number from a paper form. What is the most likely cause, and what should be done?
This lesson concludes with five key phrases.
- Cover first, then photograph: Mask sensitive information before taking a picture.
- Capture clearly before uploading: Ensure good lighting and legible text; select only the most critical images.
- One task per photo: One image, one specific action.
- Don’t guess missing info: Flag any unclear content or missing responsible parties.
- Verify numbers independently: Cross-check amounts, dates, and model numbers against the original document before recording them.
Show the full transcript (video narration)
Ask it using voice and photos
Welcome to Lesson 2 on mobile. In the previous lesson, we invited the Dragon Warrior into our phones. In this lesson, we will learn two ways to make your phone more useful than a computer: using voice to clearly state the context in one go, and using photos to bring whiteboards, spreadsheets, and equipment into the conversation. At the same time, we will learn how to take clear photos and how to do so safely.
Let's look at a scenario
Let's look at a scenario, which is fictional, and the numbers are merely illustrative. Zhao, a field engineer at Yuanfan Technology, spends most of his day in client server rooms and factories. He often has three things in hand: a whiteboard full of notes from meetings, a paper checklist handed over by the client, and a device with constantly blinking indicator lights. Previously, he relied on handwritten notes, organizing them back in the office, which often led to omissions. Now he wants to transfer them directly into the conversation on his phone. However, the whiteboard contains client names, the forms contain identity information, and the nameplates have serial numbers. The focus of this lesson is how to take clear photos and how to do so safely.
Four steps for photo-based questions: Speak first, cover first, then photograph, then verify
When using photos to ask questions, follow these four steps. First, speak: clearly state the background in one breath. Second, cover: hide names, ID numbers, serial numbers, and customer identifiers. Third, take the photo: keep the phone parallel to the subject, ensure good lighting, and make sure the text is legible. Finally, verify: cross-check every item against the original document, including the transcribed text, any flagged uncertainties, and the extracted action items. Remember this: taking photos saves your recording time, but not your verification time. Keep this in mind.
Step 1: Learn to speak. Use voice to state the background in one continuous sentence.
Step 1: Learn to speak. Voice input is suitable for stating the background in one continuous sentence, and the background is precisely the most important part. Before speaking, clarify three things: Who am I? What task needs to be done? What kind of result is expected? After speaking, review the text transcribed on the screen. Numbers, names, and equipment model numbers are prone to recognition errors; if you spot a mistake, click directly into the text to edit it, then send. If continuous voice dialogue is available, avoid using it in noisy environments, as it may pick up conversations from bystanders.
Before taking a photo: Three checks, three covers.
Before taking a photo, perform three checks and three covers. Check for names, mobile phone numbers, ID card numbers, and employee IDs; cover them if present. Check for account names, passwords, QR codes, and barcodes; cover them if present. Check for customer names, company logos, and unpublished prices or drawings; cover them if present. For the tech industry, add one more check: equipment serial numbers, network addresses, screen configurations, and source code. If you cannot cover them, do not take the photo. The most reliable method is to physically cover these items with white paper or sticky notes before taking the photo. A semi-transparent color overlay is not enough; you must confirm that the original text is no longer legible.
Three field scenarios.
Three on-site scenarios. First, photograph the whiteboard. Stand directly in front of it to avoid glare, ensuring the board fills the frame. If there is too much text, take two photos, one for each half. Second, photograph paper forms. Lay them flat on a table and keep the phone parallel to the paper; do not angle the shot, or the grid lines will not align. Third, photograph on-site equipment. Start with a wide shot, then take separate photos of the indicator lights, error screen, and wiring. For each shot, specify the equipment type and describe the issue. It provides possible causes and inspection steps, not definitive conclusions. For any actions involving power disconnection or wiring, strictly follow the equipment manual and company procedures.
Four tips for clear photos
Four tips for clear photos. First, lighting: natural light from a window is best. Avoid glare from overhead lights. Second, distance and angle: get close enough to read the text clearly, keep the phone parallel to the paper, and take multiple photos rather than one large image. Third, stability: hold the phone with both hands, rest your elbows on the table edge, and hold your breath at the moment of pressing the shutter. Fourth, description: photos only show what the AI sees, not what you want. Therefore, always include one or two sentences of context outside the photo.
Exercise: Use a list without sensitive information
Try it out. Use an item without any sensitive information, such as your own handwritten shopping list. When photographing, keep the phone parallel to the paper and use side lighting. After uploading, use voice command: 'Please transcribe this list into text, group by category, and mark anything that is unclear.' Finally, compare with the original document and count how many items were read correctly, missed, or fabricated. These three numbers represent your baseline for image reading ability. If items are fabricated (i.e., things not in the original document), add this instruction to your prompt: 'Do not add anything that is not there.'
Exercise: Three on-site prompts to copy
Use these three on-site prompts as written. For whiteboard cleanup, have it transcribe line by line, mark anything unclear, and then organize into a to-do list. For table verification, have it transcribe the text first, then list any blanks or potential misreadings, without adding anything you didn't write. For equipment troubleshooting, have it list the three most likely causes, provide one safety-check step for each, and explain when you must stop and contact the manufacturer. Each instruction includes constraints like 'mark anything unclear' and 'do not guess missing information,' which are key to preventing the AI from hallucinating.
Five traps on your phone
There are five traps on your phone. First, if the photo is unclear, the answer will be inaccurate. Glare, camera shake, and angled shots are the three main causes; zoom in after taking the photo to check. Second, one image consumes many tokens; do not upload more than a dozen at once, but select two or three of the most critical ones. Third, there are transcription errors in voice-to-text, with homophones, numbers, and model names being most prone to errors. Fourth, there is background information; documents behind the whiteboard or business cards on the table may all be captured in the photo. Fifth, do not grant excessive permissions; for the camera and microphone, select 'Allow while using the app,' not 'Allow all the time.' Also, pay attention to safety on-site and do not take photos while walking.
After taking the photo, perform a three-step check.
After taking the photo, perform a three-step check. First, compare the transcribed text line by line with the original document. Second, personally review the original document for any parts marked as illegible to fill in the gaps. Third, go through each action item and ask yourself: Is the responsible person correct? Is the deadline correct? Was any item added by the system itself? This applies equally to whiteboards, spreadsheets, and equipment. Before entering numbers and dates into official records, cross-check them item by item against the original documents.
Quiz Question 1
Question 1. Engineer Zhao needs to photograph a whiteboard containing a client's name and contact number. What is the best course of action? A) Take the photo directly; the system won't remember it. B) Cover the client's name and phone number with a piece of paper before taking the photo, then verify that the original text is still legible afterward. C) Send the photo to a colleague and let them decide what to do. The answer is B. Handle sensitive information before uploading; do not rely on fixing it afterward.
Quiz Question 2
Question 2: The AI misread a number from a paper form. What is the most likely cause, and how should you handle it? A. It’s doing this on purpose. Switch to a different app. B. Handwriting or camera angle caused inaccurate recognition; check each cell individually and ask it to flag uncertain entries. C. Ignore it. It’s close enough anyway. Answer: B. Since handwriting recognition can be error-prone, include the instruction 'flag unclear items' in your prompt, then verify each cell yourself.
This lesson concludes with five key phrases.
Final review: Here are the five key phrases from this lesson. Cover first, then photograph: Mask sensitive information before taking a picture. Capture clearly before uploading: Ensure good lighting and legible text; select only the most critical images. One task per photo: One image, one specific action. Don’t guess missing info: Flag any unclear content or missing responsible parties. Verify numbers independently: Cross-check amounts, dates, and model numbers against the original document before recording them. Save these to your notes for quick access anytime.