Study guide & lexicon

The Epistemic Theater

How science knows what it knows, and what counts as science: a companion to the narrated program.
48:59 running time14 chapters134 lexicon terms148 references

Each chapter lists the key positions and who holds them, the predation case files the chapter uses (anchored on Wilmers et al. 2025), formulas where they matter, every numbered lexicon term from the video with the time it appears, and practice prompts. For each prompt, separate what was observed, what was inferred, and what can be claimed. Timestamps match the video and the interactive player.

I

Aims of Science

Explain, predict, understand, or intervene?
video 1:37–5:37
1:44 Case file: the Northern Range elk · 2:44 What is an explanation? · 3:36 True, or merely useful? · 4:31 Observe, infer, claim

Key positions

IdeaWhoIn one line
Deductive-nomological modelHempel & Oppenheim 1948Explanation is deduction from laws plus conditions; explanation and prediction share one form.
Explanatory asymmetryBromberger 1966The flagpole’s shadow lets you deduce its height but does not explain it.
Causal-mechanical explanationSalmon 1984To explain is to show the causal processes and mechanisms that produced the event.
UnificationKitcher 1989To explain is to fit many phenomena under few argument patterns.
No-miracles argumentPutnam 1975Realism is the only view that does not make the success of science a miracle.
Pessimistic meta-inductionLaudan 1981Many successful theories were false, so success is weak evidence of truth.
Constructive empiricismvan Fraassen 1980Science aims at empirical adequacy, truth about observables.
Structural realismWorrall 1989What survives theory change is mathematical structure.
Toulmin modelToulmin 1958Data support a claim through a warrant with backing, a qualifier, and possible rebuttals.

Predation case files

StudySystemWhat it shows
White et al. 2024Northern Range elk>19,000 just before 1995; 3,915 in 2013; 7,000–9,000 now.
Clark & Hebblewhite 202152 predator-removal experimentsRemovals often raised juvenile recruitment but rarely adult survival or abundance.
Vucetich et al. 2005Northern Range elk, 1961–2004First post-reintroduction decade driven mainly by hunting and drought.

Lexicon

No. 0012:31
Aims of science
Goals that inquiry pursues: description, explanation, prediction, understanding, and intervention. They can conflict.
No. 0022:45
Deductive-nomological model
Hempel and Oppenheim’s account: an explanation is a valid deduction of the event from laws of nature plus initial conditions.
No. 0033:17
Causal-mechanical explanation
Salmon’s account: to explain is to describe the causal processes and mechanisms that produced the phenomenon.
No. 0043:17
Unification
Kitcher’s account: explanation fits many phenomena under a small number of argument patterns.
No. 0053:37
Scientific realism
The view that successful theories are approximately true, including their claims about unobservable entities.
No. 0063:37
No-miracles argument
Realism best explains the predictive success of science; otherwise that success would be a miracle (Putnam).
No. 0073:48
Pessimistic meta-induction
Many successful past theories were false, so success is weak evidence of truth for current ones (Laudan).
No. 0084:01
Constructive empiricism
Van Fraassen’s view that science aims only at empirical adequacy: truth about observables.
No. 0094:32
Observation
A record produced by senses or instruments; the data a claim rests on. Never wholly free of theory (Chapter VI).
No. 0104:32
Inference
Reasoning from observations to conclusions through models and assumptions.
No. 0114:32
Knowledge claim
A statement offered as knowledge, with explicit scope and confidence, open to scrutiny.
No. 0124:50
Warrant (Toulmin)
The general rule licensing the step from data to claim, supported by backing and limited by qualifiers and rebuttals.

Exam prompts

  1. Distinguish explanation from prediction. Give an ecological model that predicts without explaining, and one that explains but predicts poorly.
  2. State the no-miracles argument and the pessimistic meta-induction. Which position do you hold about “predation risk” or “carrying capacity”?
  3. Lay out the claim “wolves caused the Northern Range elk decline” as a Toulmin argument, including a qualifier and a rebuttal.
II

Knowing Nature

What is knowledge, and how do we seek it?
video 5:37–9:55
5:45 Knowledge and justification · 6:50 Four questions · 7:37 Positivism and postpositivism · 8:32 Interpretivism · 9:23 One herd, two lenses

Key positions

IdeaWhoIn one line
Justified true beliefClassical analysisKnowledge as belief that is true and held for good reasons.
Gettier problemGettier 1963Justified true beliefs that are true by luck are not knowledge.
Foundationalism vs coherentism—Justification rests on basic beliefs, or on mutual support among beliefs.
Problem of inductionHume 1748Past experience cannot logically guarantee the future.
FallibilismPeirce 1877Any belief may be wrong; inquiry stays open to correction.
Naturalized epistemologyQuine 1969Epistemology is continuous with science: the study of how knowers actually learn.
Research paradigmGuba & Lincoln 1994, 2005Answers to ontology, epistemology, methodology, and axiology.
Positivism; verification principleComte; Vienna Circle; Ayer 1936Knowledge from observation; meaningful only if verifiable or analytic. Self-undermining.
Postpositivism; critical realismBhaskar 1975A real world, imperfectly known through fallible, probabilistic inquiry.
Interpretivism; VerstehenDilthey 1883; Weber 1922; Taylor 1971Human action is understood through meanings, not only explained by causes.
Social constructionBerger & Luckmann 1966Many social categories and institutions are created and sustained by people.

Predation case files

StudySystemWhat it shows
Haggerty & Travis 2006Elk on private land outside YellowstoneTolerance of elk on irrigated fields shaped herd distribution: meanings shape management.
Wilmers et al. 2025Social carrying capacityThe number of carnivores people tolerate is often below ecological carrying capacity.

Lexicon

No. 0135:46
Epistemology
The study of knowledge: its nature, sources, justification, and limits.
No. 0145:46
Justified true belief
The classical analysis of knowledge: a belief that is true and held for good reasons.
No. 0155:58
Gettier problem
Cases of justified true belief that are true by luck, showing the classical analysis is incomplete.
No. 0166:15
Foundationalism vs coherentism
Justification rests on basic, self-justifying beliefs, or on the mutual support of a whole system of beliefs.
No. 0176:33
Fallibilism
Any belief, however well supported, might be mistaken and remains open to revision (Peirce).
No. 0186:51
Ontology
Assumptions about what exists and what kind of reality is being studied.
No. 0196:51
Methodology
The logic of how inquiry should proceed, as distinct from particular methods or techniques.
No. 0206:51
Axiology
The values and ethical commitments of a research tradition, including what researchers owe to others.
No. 0217:07
Research paradigm
A tradition’s combined answers to questions of ontology, epistemology, methodology, and axiology (Guba and Lincoln).
No. 0227:38
Positivism
Comte’s doctrine that genuine knowledge comes from observation and the laws summarizing it, not metaphysics.
No. 0237:38
Verification principle
Logical positivism’s criterion: a statement is meaningful only if empirically verifiable or true by definition.
No. 0248:12
Postpositivism
The fallibilist successor to positivism: a real world, known imperfectly, approached through design, statistics, and replication.
No. 0258:12
Critical realism
The view that a mind-independent reality exists and can be known, though only partially and through fallible theory.
No. 0268:33
Interpretivism
The tradition holding that social life must be understood through the meanings people give it, not only explained by causes.
No. 0278:33
Verstehen
Interpretive understanding of action from the actor’s point of view (Dilthey, Weber); contrasted with causal explanation, Erklären.
No. 0288:49
Social construction
The process by which categories and institutions are created and sustained by people (Berger and Luckmann).
No. 0299:06
Social carrying capacity
The population size of a species that people will tolerate, often below ecological carrying capacity.

Exam prompts

  1. Construct an ecological Gettier case of your own and say what it shows about justification.
  2. Compare postpositivism and interpretivism on ontology, epistemology, methodology, and axiology.
  3. Why did the verification principle fail, and what replaced it in practice?
III

Inference

Which inferences preserve truth, and which expand knowledge?
video 9:55–12:44
10:02 Case file: the Kaibab deer · 10:47 Three kinds of inference · 11:49 Strong inference

Key positions

IdeaWhoIn one line
Deduction—Truth-preserving, not ampliative. Valid if the conclusion must follow; sound if valid with true premises.
InductionHume 1748Ampliative and fallible; cannot be justified without assuming nature is uniform.
Abduction / IBEPeirce 1878; Lipton 2004Infer the hypothesis that would best explain a surprising fact; “loveliest” is not always “likeliest”.
Hypothetico-deductive method—Deduce observable consequences of a hypothesis and test them.
Multiple working hypothesesChamberlin 1890Hold rivals simultaneously to avoid attachment to one.
Strong inferencePlatt 1964Devise rival hypotheses and crucial experiments that exclude some; iterate.

Predation case files

StudySystemWhat it shows
Leopold 1949Kaibab Plateau deerDeer irruption and range collapse attributed to predator removal.
Hairston, Smith & Slobodkin 1960Green world hypothesisThe world is green because predators hold herbivores in check.
Caughley 1970Kaibab recordsData “unreliable and inconsistent”; cattle removal an untested rival.
Ford & Goheen 2015Trophic-cascade researchCall for strong inference and mechanism.

Lexicon

No. 03010:18
Green world hypothesis
Hairston, Smith and Slobodkin (1960): the world is green because predators hold herbivores below levels that would strip vegetation.
No. 03110:18
Trophic cascade
Indirect effects of predators that propagate down a food chain, for example to plants by suppressing herbivores.
No. 03210:48
Deduction
Inference in which true premises guarantee a true conclusion; truth-preserving but not ampliative.
No. 03310:48
Validity and soundness
An argument is valid if its conclusion must follow from its premises, and sound if it is valid and its premises are true.
No. 03411:05
Induction
Ampliative inference from observed cases to general conclusions or unobserved cases; fallible.
No. 03511:05
Problem of induction
Hume’s argument that induction cannot be justified without circularly assuming that nature is uniform.
No. 03611:25
Abduction
Inference from a surprising observation to the hypothesis that would best explain it (Peirce); inference to the best explanation (Lipton).
No. 03711:50
Hypothetico-deductive method
Propose a hypothesis, deduce observable consequences, and test them; failure counts against the hypothesis.
No. 03812:21
Multiple working hypotheses
Chamberlin’s method of holding several rival explanations at once to avoid premature attachment to one.
No. 03912:21
Strong inference
Platt’s procedure: devise alternative hypotheses, design crucial experiments that exclude some, and iterate.

Exam prompts

  1. Classify each step of the Kaibab story as deduction, induction, or abduction, and identify the untested rival.
  2. Derive opposing predictions for fear-mediated versus density-mediated aspen recovery.
  3. What does Platt’s strong inference add to the hypothetico-deductive method?
IV

Falsification

Can a single failed prediction refute a theory?
video 12:44–15:45
12:50 Popper’s asymmetry · 13:31 Case file: does fear lower pregnancy? · 14:23 Duhem, Quine, and the protective belt

Key positions

IdeaWhoIn one line
Logical asymmetryPopper 1959No number of confirmations proves a universal claim; one counterinstance refutes it.
CorroborationPopper 1963Survival of severe tests; not proof or probability.
Falsifiability as demarcationPopper 1963Science makes risky predictions; theories that explain anything explain nothing.
Duhem–Quine thesisDuhem 1906; Quine 1951Hypotheses are tested with auxiliaries, so a failure does not say what is false.
Research programmesLakatos 1970Hard core, protective belt; progressive if adjustments predict novel facts.
NHST is not falsificationJohnson 1999; Anderson et al. 2000Rejecting a null of no effect is not a risky test of a research hypothesis.

Predation case files

StudySystemWhat it shows
Creel et al. 2007Elk progesterone vs elk:wolf ratioReported lower progesterone where wolves were relatively more numerous.
White et al. 2011; Proffitt et al. 2014Direct pregnancy measurementsPregnancy uniformly high regardless of wolf risk.
Middleton et al. 2013GPS-collared elk and wolvesEncounters too infrequent to disrupt foraging.
Kauffman et al. 2010; Beschta & Ripple 2013Risk and aspen browsingNo risk effect found; reply: elk sense risk where they meet wolves, not where wolves kill.

Lexicon

No. 04012:51
Logical asymmetry
No finite set of confirming instances proves a universal claim, but one genuine counterinstance refutes it.
No. 04113:03
Corroboration
Popper’s term for a theory’s record of surviving severe attempts at refutation; not proof or probability.
No. 04213:21
Falsifiability
The property of a theory that some possible observation would contradict it; Popper’s mark of science.
No. 04313:32
Nonconsumptive effects
Effects of predators on prey through fear: changes in behavior or physiology that may reduce fitness without killing.
No. 04414:04
Auxiliary hypothesis
An assumption, such as how an instrument or index works, needed alongside the main hypothesis to derive a prediction.
No. 04514:24
Duhem–Quine thesis
Hypotheses are tested only in conjunction with auxiliary assumptions, so a failed prediction cannot by itself identify what is false.
No. 04614:56
Research program
Lakatos: a hard core of central commitments, shielded by a protective belt of revisable auxiliary hypotheses.
No. 04714:56
Progressive vs degenerating
A program is progressive when its adjustments predict novel facts that are confirmed, degenerating when they only accommodate failures.
No. 04815:29
Null hypothesis significance testing
Testing whether data are improbable under a null model, usually of no effect; rejecting it does not test a substantive hypothesis severely.

Exam prompts

  1. Is the hypothesis that fear lowers elk pregnancy falsified? Identify the auxiliaries and say what Lakatos would ask.
  2. Explain why Neptune and Vulcan illustrate the Duhem–Quine problem.
  3. Why is rejecting a null hypothesis not a Popperian test? What would a severe test of a cascade look like?
V

Paradigms

How does science change its mind?
video 15:45–18:27
15:51 Normal science and revolution · 16:39 Case file: from vermin to keystone · 17:44 Choosing between theories

Key positions

IdeaWhoIn one line
Normal science; puzzle-solvingKuhn 1962Research within a shared paradigm; anomalies set aside until crisis.
Disciplinary matrix; exemplarKuhn 1970The two senses of paradigm: shared commitments, and model solutions students imitate.
Incommensurability; gestalt switchKuhn 1962Rival paradigms lack a common measure; change resembles seeing the duck–rabbit flip.
Theory-choice valuesKuhn 1977Accuracy, consistency, scope, simplicity, fruitfulness, weighed differently.
Epistemological anarchismFeyerabend 1975“Anything goes”: no method survives the history of science intact.
Research traditionsLaudan 1977Traditions judged by problem-solving success.
Balance of nature to patch dynamicsWu & Loucks 1995A candidate paradigm shift in ecology.

Predation case files

StudySystemWhat it shows
Leopold 1949“Thinking Like a Mountain”A conversion from predator control to predator appreciation.
Estes et al. 1998; Terborgh et al. 2001; Crooks & Soulé 1999Exemplars of top-down controlOtters–kelp; predator-free islands; mesopredator release and songbirds.
Ripple & Beschta 2003, 2006, 2012Yellowstone cascadeNormal science extending the pattern to cottonwood, willow, and aspen.

Lexicon

No. 04916:03
Paradigm (Kuhn)
A community’s shared disciplinary matrix of theory, methods, and values, anchored by exemplary problem solutions.
No. 05016:03
Exemplar
A concrete, model problem solution that students learn to imitate and that defines a paradigm in practice.
No. 05116:03
Normal science
Puzzle-solving research within an accepted paradigm, which sets aside anomalies rather than testing the paradigm itself.
No. 05216:21
Gestalt switch
Kuhn’s image for a paradigm change: the same data seen as a different whole, like the duck–rabbit figure.
No. 05316:21
Incommensurability
Rival paradigms lack a common measure: they differ in problems, standards, and meanings, so no neutral test decides.
No. 05417:09
Mesopredator release
An increase in mid-sized predators after apex predators decline, through reduced predation or competition.
No. 05517:45
Theory-choice values
Kuhn’s shared criteria of accuracy, consistency, scope, simplicity, and fruitfulness, weighed differently by different scientists.
No. 05618:02
Epistemological anarchism
Feyerabend’s thesis that no fixed methodological rule holds across the history of science: “anything goes.”

Exam prompts

  1. Is the move from predator control to trophic cascades a Kuhnian revolution? Use exemplars and anomalies in your answer.
  2. Distinguish Kuhn’s paradigm from a research paradigm in Guba and Lincoln’s sense.
  3. How can theory choice be rational if paradigms are incommensurable?
VI

Observation

Is there such a thing as a pure observation?
video 18:27–21:48
18:33 Seeing as · 19:11 Case file: the five tallest stems · 20:16 Instruments and definitions · 21:22 Laden, not determined

Key positions

IdeaWhoIn one line
Theory-ladenness; seeing-asHanson 1958What is observed depends on concepts brought to it (Tycho and Kepler at dawn).
Data vs phenomenaBogen & Woodward 1988Theories explain stable phenomena inferred from data, not the data themselves.
TriangulationHacking 1983Agreement among independent methods built on different theories.
Imperfect detectionMacKenzie et al. 2002Counts confound abundance with detection; non-detection ≠ absence.
ReflexivityInterpretive researchDeclaring the researcher’s position because it shapes what is noticed.

Formulas

Expected count
E[C] = N · p  (abundance × detection probability)
Occupancy, one site
P(detected at least once in K surveys) = ψ[1 − (1 − p)K]

Predation case files

StudySystemWhat it shows
Ripple & Beschta 2007Five tallest aspen per standDesigned to detect early recovery among the leading stems.
Painter et al. 2015Random plots and the five tallest stems, 2012Up to 65% of stands had a sapling above 200 cm; the range-wide inference rested largely on the random samples.
Kauffman et al. 2010All young aspen in random plotsNo difference with predation risk.
Brice et al. 2022, 2024Both designs on the same standsBoth detect a cascade; tallest stems show whether, random samples show how strong.
Hobbs et al. 2024Willow samplingStudies at well-watered sites overstated recovery.
Kohl et al. 2018, 2019GPS on elk, wolves, pumasDiel landscape of fear invisible to sparse VHF data.

Lexicon

No. 05718:51
Theory-ladenness
The dependence of what is observed, described, and recorded on the observer’s concepts, expectations, and instruments (Hanson).
No. 05818:51
Data vs phenomena
Data are particular records; phenomena are stable features inferred from them. Theories explain phenomena (Bogen and Woodward).
No. 05919:49
Sampling design
The rule for choosing which units to measure. It determines which population, and which question, the data can answer.
No. 06020:03
Sampling bias
Systematic difference between the sampled units and the population of interest, which distorts estimates.
No. 06120:34
Landscape of fear
The spatial and temporal pattern of predation risk perceived by prey, which can shape where and when they forage.
No. 06220:51
Operational definition
A definition of a concept in terms of the procedure used to measure it, such as “risk” as distance to a kill site.
No. 06321:06
Imperfect detection
Animals present may go unrecorded, so counts confound abundance with detection probability (MacKenzie et al.).
No. 06421:23
Triangulation
Agreement among independent methods with different assumptions, which reduces the chance a result is an artifact (Hacking).
No. 06521:39
Reflexivity
Critical attention to how the researcher’s position, values, and presence shape the research.

Exam prompts

  1. Explain how the tallest-stem and random-plot designs each embody a question, and which question each can answer.
  2. Give three operational definitions of “predation risk” and the theory each carries.
  3. Does theory-ladenness mean anything goes? Answer with Hacking’s triangulation.
VII

Models

How can a false model teach us something true?
video 21:48–24:25
21:54 The map and the territory · 22:49 Case file: the three-box cascade · 23:40 Models that act

Key positions

IdeaWhoIn one line
All models are wrongBox 1976Models are useful because they omit; the question is whether they are wrong in ways that matter.
Three kinds of idealizationWeisberg 2007Galilean (tractability), minimalist (difference-makers), multiple-models.
Models as mediatorsMorgan & Morrison 1999Partly independent of theory and world, so they can teach about both.
Generality, realism, precisionLevins 1966No model maximizes all three; robustness analysis across models.
Estimand vs estimate—The quantity of interest versus the model output; the link is an assumption.

Predation case files

StudySystemWhat it shows
Metz et al. 2020Pumas vs wolves, 1998–2004Pumas killed a larger share of Northern Range elk than wolves in most years.
Barber-Meyer et al. 2008Elk calvesBears were the main predators of calves.
Ripple et al. 2025 vs a critique cited in Wilmers et al. 2025Willow crown volume+1,500% estimate vs concern that the volume model was calibrated on lightly browsed plants.
Messier 1994; National Research Council 1997Predator pitLittle support for alternative stable states in wolf–moose systems.

Lexicon

No. 06622:08
Idealization
Deliberate distortion or omission in a model to make it tractable or to isolate the factors that matter (Weisberg).
No. 06722:08
Models as mediators
Models are partly independent of both theory and data, so they can be used to learn about each (Morgan and Morrison).
No. 06822:27
Generality–realism–precision
Levins’s tradeoff: a model can maximize at most two of generality, realism, and precision.
No. 06922:27
Robustness analysis
Checking whether a result holds across models with different simplifying assumptions.
No. 07023:19
Extrapolation
Applying a model outside the range of conditions used to build or calibrate it.
No. 07123:19
Estimand vs estimate
The estimand is the quantity a study aims to know; the estimate is what a model and data produce. The link between them is an assumption.
No. 07223:41
Predator pit
A hypothesized low-density prey equilibrium maintained by predation, separated from a high-density equilibrium.
No. 07323:58
Alternative stable states
Different self-reinforcing states a system can occupy under the same conditions; shifting between them requires a large perturbation.

Exam prompts

  1. What is wrong, and what is right, about the three-box wolf–elk–aspen cascade?
  2. Explain extrapolation using the willow crown-volume dispute.
  3. How did the predator-pit model act in the world, and what did tests find?
VIII

Causality

What would have happened otherwise?
video 24:25–28:55
24:32 Association is not explanation · 25:31 Would that elk have died anyway? · 26:38 Drawing the causes · 27:37 Designs that break the symmetry

Key positions

IdeaWhoIn one line
Confounding; reverse causation; collider bias—Three non-causal sources of association.
Simpson’s paradox—Subgroup trends reverse when pooled; resolving it needs a causal model.
Regularity, counterfactual, interventionistHume 1748; Lewis 1973; Woodward 2003Three accounts of what a cause is.
Potential outcomesRubin 1974; Holland 1986Each unit has outcomes with and without treatment; only one is observed.
DAGs; back-door criterion; ladderPearl 2009; Pearl & Mackenzie 2018Block non-causal paths; association, intervention, counterfactuals.
Randomization; factorial designsFisher 1935Balance confounders in expectation; reveal interactions.
BACI; Hill’s viewpointsStewart-Oaten et al. 1986; Hill 1965Weighing observational evidence when experiments are impossible.

Formulas

Individual causal effect
τi = Yi(1) − Yi(0)  (never observed directly)
Average causal effect
ATE = E[Y(1)] − E[Y(0)], identified by randomization
Back-door adjustment
P(y | do(x)) = Σz P(y | x, z) P(z)

Predation case files

StudySystemWhat it shows
Brodie et al. 201345 elk populationsHigher survival with both pumas and wolves, most likely because hunting quotas were cut; harvest dominated.
MacNulty et al. 2020Ages of killed cow elkWolf kills modally ~16 years old; hunter kills ~4: compensatory vs additive.
Ford & Goheen 2015; Wilmers et al. 2025Three causal links of a cascadeHerbivory–plants established by exclosures; predators–herbivores least certain; net effect mixed.
Bilyeu et al. 2008; Hobbs et al. 2024Dams × exclosuresTogether, willows passed browse height in ~5 years; controls never did.
Hurley et al. 2011; Bishop et al. 2009Mule deerPredator removal barely changed growth; winter feeding raised it 13% per year.
Wilmers et al. 2006Isle Royale parvovirusWolf crash as a natural experiment; moose grew faster and higher.

Lexicon

No. 07424:33
Confounding
A common cause of exposure and outcome that creates or distorts an association between them.
No. 07524:33
Collider bias
A spurious association created by conditioning or selecting on a variable caused by both exposure and outcome.
No. 07625:18
Simpson’s paradox
An association within every subgroup that reverses when the subgroups are combined.
No. 07725:32
Counterfactual
A claim about what would have happened had some condition been different; the basis of Lewis’s analysis of causation.
No. 07825:32
Interventionist causation
C causes E if an intervention changing C, holding other things fixed, would change E (Woodward).
No. 07925:50
Fundamental problem of causal inference
Each unit reveals only one of its potential outcomes, so individual causal effects are never directly observed (Holland).
No. 08026:05
Additive vs compensatory mortality
Additive deaths raise total mortality; compensatory deaths replace deaths that would have occurred from other causes.
No. 08126:39
Directed acyclic graph
A diagram of causal assumptions in which arrows point from causes to effects and no path loops back on itself.
No. 08226:57
Back-door criterion
Pearl’s rule for which variables to adjust for: block every non-causal path that enters the exposure through an arrow pointing into it.
No. 08326:57
Ladder of causation
Pearl’s three levels of causal questions: association (seeing), intervention (doing), and counterfactuals (imagining).
No. 08427:38
Randomization
Assigning treatments by chance so that confounders are balanced across groups in expectation (Fisher).
No. 08527:38
Interaction
When the effect of one factor depends on the level of another, revealed by factorial designs.
No. 08628:21
Natural experiment
A comparison created by events outside the researcher’s control that approximates random assignment.
No. 08728:38
BACI design
Before-after-control-impact: compares change at impact sites with change at control sites over the same period.

Exam prompts

  1. Draw a DAG for the Northern Range and identify a back-door path between wolves and elk survival.
  2. Why is compensatory mortality a counterfactual claim? What evidence bears on it?
  3. Design a study that separates top-down from bottom-up limitation of a deer population.
IX

Underdetermination

What if the evidence fits more than one theory?
video 28:55–31:49
29:02 One body of evidence, many theories · 29:50 Case file: one decline, many causes · 31:01 Breaking the tie

Key positions

IdeaWhoIn one line
UnderdeterminationDuhem 1906; Quine 1951Evidence may not fix which theory is true.
Transient vs strong—Resolvable by further evidence, or empirically equivalent forever.
EquifinalityBeven & Freer 2001Many parameter sets fit the same record.
Pattern–process problemLevin 1992Different processes generate the same pattern.
Multimodel inferenceBurnham & Anderson 2002Rank and average candidate models by information criteria.
Scale dependencePrugh & Sivy 2020; Sivy et al. 2017Positive associations locally, negative across landscapes.

Formulas

AIC
AIC = −2 ln L + 2k;   Δi = AICi − AICmin
Akaike weight
wi = exp(−Δi/2) / Σj exp(−Δj/2)

Predation case files

StudySystemWhat it shows
Vucetich et al. 2005Elk decline, first decadeHunting and drought; no comparable apportionment since.
MacNulty et al. 2020Winter range outside the park (20% → 80%)Demographic, not behavioural: survival was higher outside.
Brice et al. 2024Aspen recruitmentRisk effects 8–28 times weaker than density effects.
Hobbs et al. 2024 vs Ripple et al. 2025WillowStalled system (possible alternative stable state) vs slow recovery, from the same data.

Lexicon

No. 08829:03
Underdetermination
The evidence available is insufficient to determine which of several rival theories is true.
No. 08929:19
Transient vs strong underdetermination
Transient: resolvable by further evidence. Strong: rivals are empirically equivalent, so no possible evidence decides.
No. 09029:35
Equifinality
Many different model structures or parameter sets reproduce the same observations equally well (Beven).
No. 09129:35
Pattern–process problem
Different processes can generate the same pattern, so patterns alone rarely identify their cause (Levin).
No. 09231:02
Theoretical virtues
Non-empirical criteria such as simplicity, scope, fruitfulness, and coherence used to choose among theories that fit the data.
No. 09331:13
Multimodel inference
Ranking and averaging a set of candidate models by information criteria such as AIC, rather than selecting one (Burnham and Anderson).
No. 09431:30
Scale dependence
The direction or strength of an ecological relationship changes with the spatial or temporal scale of study (Wiens; Levin).

Exam prompts

  1. Which parts of the Northern Range story show transient underdetermination that has been resolved, and which remain open?
  2. Explain how scale can make two contradictory carnivore studies both correct.
  3. What does multimodel inference do that a single best model does not?
X

Bayesian Evidence

How much should evidence change belief?
video 31:49–35:15
31:56 Degrees of belief · 32:43 The strength of evidence · 33:34 Case file: updating on the cascade · 34:45 Priors and their critics

Key positions

IdeaWhoIn one line
Credence; Dutch bookRamsey 1926Degrees of belief should obey probability, or a set of bets loses for sure.
Conditionalization; confirmation—Update to P(H | E); evidence confirms by raising probability.
Likelihood ratioRoyall 1997The strength of evidence; Royall’s three questions: evidence, belief, action.
Base-rate fallacy—Ignoring how rare the hypothesis is.
Washing out of priors—Different reasonable priors converge with enough shared data.
Severe testingMayo 2018Support only when a claim passed a test it would likely have failed if false.

Formulas

Bayes’ theorem
P(H | E) = P(E | H) P(H) / P(E)
Odds form
posterior odds = likelihood ratio × prior odds;   LR = P(E | H1) / P(E | H2)
Camera-trap example (illustrative)
P(wolf | flag) = (0.95 × 0.001) / (0.95 × 0.001 + 0.01 × 0.999) ≈ 0.087
Flat-prior reading of a CI (illustrative)
SE ≈ (0.05 + 0.41)/3.92 ≈ 0.117;   P(effect < 0) ≈ Φ(0.18/0.117) ≈ 0.94

Predation case files

StudySystemWhat it shows
McLaren & Peterson 1994Isle Royale tree ringsFir growth tracked wolves and moose: a prior for cascades.
Kauffman 2010 → Hobbs 2024Yellowstone studies in sequenceBelief in some aspen cascade survived; belief that fear drives it fell.
Wilmers et al. 202516 large carnivore–mesocarnivore pairsMean correlation −0.18 (95% CI −0.41 to 0.05; p = 0.11).

Lexicon

No. 09531:57
Credence
A degree of belief, represented as a probability between zero and one.
No. 09631:57
Dutch book argument
Credences that violate the probability axioms expose you to a set of bets that loses in every outcome (Ramsey).
No. 09732:16
Bayes’ theorem
P(H | E) = P(E | H) P(H) / P(E): the posterior is proportional to the prior times the likelihood.
No. 09832:30
Conditionalization
Updating by adopting, as the new credence in H, the old conditional probability of H given the evidence.
No. 09932:44
Likelihood ratio
P(E | H1) / P(E | H2): how much more probable the evidence is under one hypothesis than another; the measure of evidential strength.
No. 10032:58
Base-rate fallacy
Judging a hypothesis by the accuracy of a test while ignoring how rare the condition is to begin with.
No. 10134:46
Washing out of priors
With enough shared evidence, posteriors from different reasonable priors converge.
No. 10235:00
Severe testing
Mayo’s error-statistical criterion: data support a claim only if the claim passed a test it would probably have failed were it false.

Exam prompts

  1. Work the camera-trap base-rate example and explain why most flagged “wolves” are coyotes.
  2. What does a non-significant result with interval −0.41 to 0.05 not show? Answer in Bayesian and in error-statistical terms.
  3. How should a prior for the strength of the Yellowstone cascade change across the studies in this chapter?
XI

Replication

Would it happen again, and elsewhere?
video 35:15–38:47
35:23 Four ways to hold up · 35:56 The replication crisis · 36:56 Case file: thirty kilometers apart · 38:13 Remedies and other standards

Key positions

IdeaWhoIn one line
Reproducibility; replicabilityNational Academies 2019Same data and code vs new data; plus generalizability and robustness.
Many analystsSilberzahn et al. 201829 teams, one data set, estimates from slightly negative to strongly positive.
Replication crisisIoannidis 2005; Open Science Collaboration 201597% of originals significant; 36% of replications.
P-hacking; HARKing; forking pathsKerr 1998; Gelman & Loken 2014Flexible analysis inflates false positives.
PseudoreplicationHurlbert 1984Non-independent measurements treated as replicates.
Preregistration; transferabilityNosek et al. 2018; Yates et al. 2018Fix plans before data; test models in new places.
Trustworthiness criteriaLincoln & Guba 1985Credibility, transferability, dependability, confirmability.

Predation case files

StudySystemWhat it shows
Garrott et al. 2008Madison Headwaters elkCow survival down 5–15%; numbers down 5- to 10-fold.
Klein 1995; Roffler et al. 2023Coronation and Pleasant islandsWolves nearly eliminated deer.
Griffin et al. 201111 elk populations, neonatesOnly grizzly predation additive.
Brodie et al. 201345 populations, adult femalesHuman harvest dominated.
Prugh & Sivy 2020; Wilmers et al. 2025Where studies are vs where carnivores live~70% of interaction studies in protected areas; 15% of range protected, 4% strictly.

Lexicon

No. 10335:24
Reproducibility
Obtaining consistent results from the same data using the same methods and code.
No. 10435:24
Replicability
Obtaining consistent results across studies that address the same question with new data.
No. 10535:38
Generalizability
The extent to which results apply in contexts, places, or populations beyond those studied.
No. 10635:38
Robustness
Whether a result survives reasonable alternative analyses of the same data.
No. 10736:18
Publication bias
Selective publication of positive or significant results, which inflates effects in the literature.
No. 10836:18
P-hacking
Trying analyses, subsets, or stopping rules until a result crosses a significance threshold.
No. 10936:18
HARKing
Hypothesizing after the results are known and presenting the hypothesis as if it had been made in advance (Kerr).
No. 11036:18
Garden of forking paths
Data-dependent analytic choices that inflate false positives even without deliberate fishing (Gelman and Loken).
No. 11136:40
Pseudoreplication
Treating non-independent measurements, such as repeated samples of one experimental unit, as independent replicates (Hurlbert).
No. 11237:44
External validity
Whether a result holds beyond the conditions, sites, or populations in which it was obtained.
No. 11337:59
Scope conditions
The circumstances under which a generalization is expected to hold.
No. 11437:59
Apparent competition
Two prey share a predator; one prey sustains more predators, which then depress the other (Holt).
No. 11538:14
Preregistration
Recording hypotheses, design, and analysis plan before data are collected or examined.
No. 11638:33
Trustworthiness criteria
Lincoln and Guba’s standards for interpretive research: credibility, transferability, dependability, and confirmability.

Exam prompts

  1. Distinguish reproducibility, replicability, generalizability, and robustness with one ecological example each.
  2. Why did wolves limit elk in the Madison Headwaters but not clearly on the Northern Range? State the scope conditions.
  3. What does the mismatch between where carnivore studies occur and where carnivores live imply for external validity?
XII

Values

Can science be value-free, and should it be?
video 38:47–42:18
38:53 The argument from inductive risk · 39:41 Case file: whose costs? · 40:38 Whose baseline? · 41:16 Objectivity as a social achievement

Key positions

IdeaWhoIn one line
Value-free ideal; discovery vs justificationReichenbach 1938Values may guide questions and uses, not the weighing of evidence.
Argument from inductive riskRudner 1953; Douglas 2000, 2009How much evidence is enough depends on the cost of error.
Epistemic vs non-epistemic valuesDouglas 2009Non-epistemic values may set thresholds but never substitute for evidence.
CUDOS normsMerton 1942Communalism, universalism, disinterestedness, organized skepticism.
Transformative criticismLongino 1990Objectivity as a property of critical communities.
Strong objectivityHarding 1991Starting from marginalized standpoints exposes hidden assumptions.
Crisis disciplineSoulé 1985Conservation must act before evidence is complete; its goals are values.

Predation case files

StudySystemWhat it shows
Lamb et al. 2024; Serrouya et al. 2021Mountain caribou−51% (1991–2023); 15 of 41 subpopulations functionally extirpated; apparent competition.
Raynor et al. 2021Wolves in WisconsinDeer–vehicle collisions −24%; benefits ≈ 63× livestock losses.
Gilbert et al. 2017Puma recovery, eastern USProjected 155 human deaths averted over 30 years.
Wilmers et al. 2025BaselinesDisagreement over recovery partly reflects pre-European vs pre-Indigenous baselines.

Lexicon

No. 11738:54
Value-free ideal
The view that non-epistemic values should play no role in the internal reasoning of science, only in choosing problems and applying results.
No. 11838:54
Discovery vs justification
Reichenbach’s distinction between how hypotheses arise and how they are evaluated against evidence.
No. 11939:08
Inductive risk
The chance of error in accepting or rejecting a hypothesis; weighing its consequences requires values (Rudner, Douglas).
No. 12039:23
Epistemic vs non-epistemic values
Values bearing on truth, such as accuracy and simplicity, versus values bearing on consequences, such as safety or livelihoods.
No. 12140:02
Type I and Type II errors
Rejecting a true null (a false alarm) versus failing to reject a false one (a miss); in management, each carries different costs.
No. 12240:39
Ecological baseline
The reference condition against which change or recovery is measured; choosing one is partly a value judgment.
No. 12340:58
Crisis discipline
Soulé’s description of conservation biology: a value-driven science that must act before evidence is complete.
No. 12441:17
CUDOS norms
Merton’s norms of science: communalism, universalism, disinterestedness, and organized skepticism.
No. 12541:17
Transformative criticism
Longino’s account of objectivity as a property of communities with venues for criticism, uptake, shared standards, and equality of authority.
No. 12641:36
Strong objectivity
Harding’s view that starting inquiry from marginalized standpoints exposes assumptions and so increases objectivity.

Exam prompts

  1. Apply the argument from inductive risk to a decision to cull wolves for caribou.
  2. Which values enter when choosing an ecological baseline for “recovery”?
  3. Explain how the Yellowstone debate illustrates objectivity as a social achievement.
XIII

Demarcation

What counts as science, and who decides?
video 42:18–46:05
42:26 Why the line matters · 43:05 A century of criteria · 44:21 The answer depends on the criterion · 45:15 Case file: the Kaibab story, revisited

Key positions

IdeaWhoIn one line
Verifiability; falsifiabilityAyer 1936; Popper 1959Early criteria; each fails as necessary and sufficient.
Puzzle-solving; progressKuhn 1962; Lakatos 1970Criteria based on traditions and programmes.
Stagnation testThagard 1978Pseudoscience stagnates while rivals progress, and its practitioners ignore that.
Methodological naturalismMcLean 1982; Kitzmiller 2005The working rule courts applied to creationism and intelligent design.
Daubert standardDaubert 1993Testability, peer review, error rates, standards, general acceptance.
Demise of demarcationLaudan 1983No necessary and sufficient conditions survive.
Cluster concept; systematicityPigliucci & Boudry 2013; Hoyningen-Huene 2013Looser revivals; science as more systematic knowledge.
Wissenschaft—German for all systematic knowledge, humanities included.

Predation case files

StudySystemWhat it shows
Leopold 1949 → Caughley 1970The Kaibab story, revisitedA weakly tested account lived in textbooks until criticism corrected it: demarcation concerns practices.

Lexicon

No. 12742:27
Demarcation problem
The problem of distinguishing science from non-science and pseudoscience, and of saying on what grounds.
No. 12842:46
Daubert standard
The US test for admitting expert scientific testimony: testability, peer review, error rate, standards, and general acceptance.
No. 12943:06
Pseudoscience
A practice presented as science that fails its standards, for example by stagnating while ignoring progressive rivals (Thagard).
No. 13043:29
Methodological naturalism
The working rule that scientific explanations appeal only to natural causes, whatever one believes beyond them.
No. 13144:00
Cluster concept
A concept defined by a family of overlapping features, none necessary or sufficient on its own (Pigliucci).
No. 13244:00
Systematicity
Hoyningen-Huene’s thesis that scientific knowledge differs from everyday knowledge chiefly by being more systematic.
No. 13344:00
Wissenschaft
German for organized, systematic knowledge of any kind, including the humanities; broader than English “science”.

Exam prompts

  1. Apply three demarcation criteria to postpositivist ecology, interpretive human-dimensions research, and astrology. Where do the answers differ?
  2. Is the label “science” a definitional choice? What follows from choosing a narrow or a broad definition?
  3. Why does the Kaibab story matter for demarcation?
XIV

Synthesis

How do you audit a knowledge claim?
video 46:05–48:59
46:13 Auditing a famous claim · 47:38 Seven questions for any claim · 48:19 Exam rehearsal

Seven-question claim audit

  1. What was observed, and how?
  2. What was inferred, under which assumptions?
  3. Which alternatives remain?
  4. How strong is the evidence, and what would change your mind?
  5. Has it been replicated, and where does it generalize?
  6. Which values and stakes shape the claim?
  7. What would another tradition of inquiry ask that this one did not?

Lexicon

No. 13447:39
Claim audit
Seven questions: what was observed and how; what was inferred and how; alternatives; strength of evidence; replication and scope; values; other traditions.

Rehearsal answers

What separates induction from abduction, and where does strong inference fit?

Induction generalizes from observed cases to unobserved ones; abduction infers the hypothesis that would best explain a surprising fact. Strong inference disciplines abduction by generating rival explanations and designing tests that exclude some, so the loveliest story must also survive elimination.

Why does the Duhem–Quine thesis complicate falsification?

A prediction follows from a hypothesis plus auxiliary assumptions, so a failed prediction refutes only the conjunction. Logic cannot say whether the hypothesis or an auxiliary (an index, an instrument, a measure of risk) is at fault; Lakatos asks whether rescuing adjustments predict novel facts.

What did Kuhn mean by incommensurability?

Rival paradigms differ in problems, standards, and meanings of terms, so there is no neutral measure by which a single test decides between them; choice relies on shared values weighed by judgment.

Why is compensatory mortality a counterfactual claim?

It asserts that animals killed by a predator would have died anyway from other causes: a claim about an unobserved outcome. Evidence such as the age and condition of killed animals (wolf-killed cow elk ~16 years, hunter-killed ~4) bears on it indirectly.

What is the argument from inductive risk?

Because evidence never makes a hypothesis certain, accepting it requires judging the evidence sufficient, and sufficiency depends on the costs of false acceptance and false rejection. Non-epistemic values therefore legitimately set evidential thresholds (Rudner; Douglas), though they must not replace evidence.

How does the answer to “what counts as science?” change with the criterion?

Under falsifiability even astrology qualifies; under institutional norms and progress interpretive research qualifies and astrology does not; under cluster, systematicity, or Wissenschaft accounts both research traditions qualify. The practices do not change; the label does.

References

Predation casebook

Philosophy, methods, and statistics

Legal cases