MegaMaester

Critical Thinking · Lesson 1

Evaluating Sources and Expertise

beginner16 min · 13 cards
Start here

Evaluating Sources and Expertise

How to judge whether a source deserves trust: relevant expertise versus borrowed authority, primary sources, conflicts of interest, and lateral reading.

Concept 1 of 10

Why this matters

Almost nothing you believe about the wider world comes from direct observation. You inherit it from sources — reporters, researchers, officials, strangers online — and the quality of your beliefs is capped by the quality of the sources you trust. The modern problem is not a shortage of information but a flood of it, much of it wearing the costume of authority: a confident tone, an impressive title, an official-looking page. Telling earned trust from borrowed or manufactured trust has become a basic survival skill, because the people most eager to persuade you are often the least entitled to. A repeatable procedure for checking a source protects you far better than a gut feeling about who sounds credible.

Concept 2 of 10

Core concepts

Expertise versus authority and confidence

Genuine expertise is narrow, tested, and earned inside a specific field. Authority is a position or title; confidence is only a manner of speaking. The three often travel together but come apart constantly — a decorated professional can be wrong the moment they leave their training, and a fluent speaker can be confidently mistaken. Ask what a person actually knows about this exact question, not how impressive or self-assured they sound.

Relevant versus borrowed credibility

Credibility does not transfer across fields. A Nobel laureate in physics holds no special standing on nutrition, and a celebrated surgeon is not thereby an economist. When experts speak outside their domain, their credentials become borrowed scenery rather than evidence. Much persuasive misinformation comes from real experts talking past the edge of their competence, where the audience still hears the credential but no longer notices the mismatch.

Sources, incentives, and consensus

A primary source is the original — the study, the dataset, the transcript. A secondary source reports on it, and detail drifts at every retelling. Ask who benefits if you believe a claim: a conflict of interest does not prove anyone wrong, but it tells you where to look harder. Finally, weigh consensus against the lone maverick. Broad agreement among independent experts is not proof, but it is far stronger evidence than a single contrarian voice, however bold. Sometimes the maverick turns out to be right — yet betting on that by default is a losing strategy.

Concept 3 of 10

Worked example

A viral post promotes a supplement, quoting "Dr. Lee, Harvard-trained physician." Before sharing, you run the checks. Is Dr. Lee trained in nutrition or in an unrelated specialty? Does the claim rest on a published primary study, or on a book and product line Dr. Lee sells — a plain conflict of interest? Do independent researchers who study this agree, or is Lee the lone voice? Within a few minutes the confident quote resolves into what it is: an authority figure, borrowed credibility, and a financial incentive, with no corroboration behind it.

Concept 4 of 10

Counterexample

Credentials are neither necessary nor sufficient. Dismissing a source purely because it lacks a prestigious title can be its own mistake. A frontline nurse describing what they personally witnessed on a ward is a primary witness offering direct evidence, degree or no degree. The point is not to worship credentials but to match the source to the claim: for what actually happened in that room, the eyewitness outranks a distant professor with a longer title.

Concept 5 of 10

Case study: lateral reading and professional fact-checkers

Researchers at the Stanford History Education Group, including Sam Wineburg, compared how professional fact-checkers, academic historians, and university students judged unfamiliar websites. The fact-checkers were both faster and more accurate, and the reason was their method. Rather than staying on a page and studying it closely, they quickly left it and opened new tabs to see what other, independent sources said about the organization behind it — a habit Wineburg's team called lateral reading. The historians and students tended to read vertically instead, scrolling down the page and judging it by its own design and claims, which is exactly what a manipulative page is built to survive. The reported lesson is blunt: the page you are evaluating is rarely the best place to evaluate it from.

Concept 6 of 10

Common misconceptions

  • "If they're an expert, they're reliable on this." — Only within their field; outside it, a credential is borrowed scenery, not evidence.
  • "Reading the page closely is the best way to judge it." — Professional fact-checkers do the opposite, leaving the page to check it against independent sources.
  • "A conflict of interest means the claim is false." — It means scrutinize harder and seek corroboration, not automatically dismiss.
  • "The lone dissenter is usually the brave truth-teller." — Occasionally, but independent consensus is the stronger bet by far.
Concept 7 of 10

Interactive challenge — Vet the Source

You are shown a confident online claim and its author's bio, then asked to decide, using lateral reading, whether the credential is relevant, borrowed, or beside the point — and where you would check next.

Think Like a Maester: The page in front of you is rarely the best place to judge the page in front of you. Open a new tab and read laterally.

Concept 8 of 10

Knowledge check

  1. What is the difference between relevant expertise and borrowed credibility?
  2. Why does a confident, authoritative tone not establish that a source is reliable?
  3. What is lateral reading, and why did fact-checkers outperform historians and students using it?
  4. Does a conflict of interest prove a claim is false? What should it prompt instead?
  5. When is broad expert consensus stronger evidence than a lone maverick, and when might the maverick matter?
Concept 9 of 10

Lesson summary

Trusting a source well is a procedure, not a feeling. Match the claim to genuinely relevant expertise, discount credentials borrowed from another field, get as close to the primary source as you can, and note who benefits before you believe. Above all, read laterally: leave the page and see what independent sources say about it. Confidence and prestige are easy to manufacture; corroboration from outside is not, which is why it remains the most reliable signal you have.

Quick check

A Nobel laureate in physics publishes strong claims about human nutrition. How should you weigh this?