Lesson 13 of 25
The Search for Absolute Truth (Fact-Checking)
Treat a confident answer as a draft, not a result. Go back and ask for the specific claim to be sourced, checked against a second independent source, or withdrawn - and say explicitly that "I could not verify this" is an acceptable answer. Most false statements survive because nobody asked the follow-up question.
Ask for the source and the claim separately: have it restate the exact claim, then say what it rests on, then rate its own confidence. Make sure browsing is actually on before you ask for citations - without it you are asking a model to recall references, which is precisely how fabricated ones appear. Then take the citation and open it yourself.
- Confirm browsing is on before asking for any citation.
- Never pass on a reference you have not opened yourself.
- Ask it to restate the claim, then source it separately.
- Say plainly that 'unverified' is an acceptable answer.
- Ask which part of its own answer is weakest.
Instead of
What are the primary health benefits of a turmeric-based diet, specifically referencing the role of curcumin?
Perplexity version
Before you answer: use web search for this, and confirm at the top of your reply that you did. If you cannot search, say so and stop - I do not want references recalled from memory, because that is how invented ones appear. You summarised the health effects of a turmeric-based diet and curcumin's anti-inflammatory properties. Now source it. For each distinct claim you made: 1. **Restate the claim** in one sentence, exactly as you made it. 2. **Give the evidence** - at least two peer-reviewed studies or reviews, with authors, year, journal, and a link I can open. Prefer systematic reviews and meta-analyses over single trials. 3. **Describe what the study actually tested** - in vitro, animal, or human? Sample size? Dose? Was the dose anything like what a person eating turmeric in food would get? This is the question that matters most with curcumin and the one usually skipped. 4. **Rate your confidence**: well established / mixed evidence / preliminary / could not verify. Then three more things: - **Curcumin bioavailability.** It is poorly absorbed, and most positive results use formulations or piperine combinations rather than dietary turmeric. Say what the literature finds, with sources, and be clear about whether the studies you cited above apply to food at all. - **The contrary evidence.** Which claims about curcumin have failed replication or been walked back in reviews? Cite it. If my summary above overstated something, say which sentence. - **Safety.** Any documented interactions or cautions - anticoagulants, gallbladder conditions, supplement dosing, and the reported cases of liver injury from high-dose supplements. Cite it. If you cannot find a real source for a claim, write "unverified - I should not have stated this" against it. That is a better answer than a reference that looks right. This is health information and I may act on it, so flag anything I should take to a doctor rather than to a search engine.
Instead of
I read somewhere that Hyderabad produces more pearls than any other city in the world. Is this still true today?
Perplexity version
Search the web for this and tell me at the top whether you were able to. If you cannot search, say so rather than answering from memory - a confident answer about current production rankings without live data is worthless. The claim to check: Hyderabad is the world's largest producer of pearls. I think this conflates two different things and I want them separated: 1. **The historical claim.** Hyderabad is called the 'City of Pearls'. What is that actually based on - trade, processing, drilling, the Nizams' patronage, or production? Source it. My suspicion is that it was always a trading and processing centre rather than a producing one, and if so the original claim is not just outdated but category-wrong. 2. **Production today.** Who actually produces the world's pearls now - cultured freshwater and saltwater, by country? Give me current figures with the source and the year of the data. Name the country and region for each major category. 3. **India's position.** What does India actually produce in pearls, and what does it import, process and re-export? Cite trade data if you can find it - commerce ministry, UN Comtrade, or industry reporting. 4. **Hyderabad specifically.** What is documented about the pearl trade in Hyderabad today? Is it still a significant processing or retail centre, and on what evidence? Use at least two independent sources for the production figures - not two articles both citing the same industry body. Say explicitly where your sources agree and where they do not. Finish with a one-line verdict in this form: "The claim is [true / false / was true until approximately when / is a category error], on the evidence of [source]". Then a separate line: anything you could not establish, named as unestablished. Do not give me a number without a source and a date attached. An unsourced production figure is exactly the kind of thing that gets repeated for twenty years.
Instead of
Give me a brief history of the famous Paradise Food Court in Hyderabad." (Imagine the AI responds with, "Founded in 1948 by Irani Chai merchants, it quickly became famous after Jawaharlal Nehru visited and praised its biryani in 1953.")
Perplexity version
Stop - I need to check something you just told me, and web search must be on for this. Confirm at the top that you searched. You stated that Jawaharlal Nehru visited Paradise in Hyderabad and praised its biryani in 1953. That is a very specific claim: a named person, a named place, a year, and an action. Specific claims like this are the ones most likely to be confabulated, because the detail itself makes them feel verified. Verify it. Specifically: 1. Search for a credible source that corroborates this exact event and date - a newspaper archive, a published biography of Nehru, a documented account of his Hyderabad visits, or an official history from the restaurant. Give me the source and a link. 2. Is there any documented record of Nehru visiting Hyderabad in or around 1953, independent of the restaurant claim? That is the checkable half of the story. 3. What is actually documented about Paradise's own history - founding date, founders, how it became well known? Cite what you find, and distinguish the restaurant's own marketing from independent sources, because a restaurant's website is not a historical record. Rules for your answer: - If you cannot find a source, say "this claim is unverified" and say so plainly. Do not offer a weaker version of the same story to save face. - If you find that you invented or misremembered the detail, say that directly. I would much rather know. - Separate "I found a source confirming this" from "I found a source repeating this". A listicle repeating the anecdote is not corroboration, and this particular kind of restaurant-and-famous-visitor story spreads through exactly that route. - Then go back over your earlier answer about Paradise and flag every other specific detail - any date, name or figure - at the same level of scrutiny. If the Nehru detail was unsupported, others probably are too. I should say: for a question like this, Perplexity is the better tool, because every answer there arrives with its sources attached and you can see immediately whether the citation is a newspaper archive or a food blog.