When the Central Limit Theorem Breaks
The Central Limit Theorem requires finite variance and independent (or weakly dependent) summands; heavy tails push variance to infinity, and correlations let individual shocks persist across the average.
A complete interactive classroom, not just a preview.
Start when you are ready to enter this Stage's 9 scenes and explore, respond, and learn as you go.
Why does the Central Limit Theorem fail when the underlying steps have heavy tails or are correlated?
A theorem most students treat as universal actually relies on quiet assumptions about variance and independence — assumptions that real markets and physics routinely violate.
If the CLT is so general, why do simulations of heavy-tailed or correlated processes keep producing curves that refuse to look like a bell?
Side-by-side histograms and animated simulations comparing Gaussian convergence against heavy-tailed and correlated-step ensembles, plus a transfer case using financial returns.
The CLT fails when a single observation can dominate the sum — heavy tails inflate variance to infinity, and correlations let one shock propagate through the average instead of canceling out.
Averages should still look bell-shaped because many independent things are being added, no matter how extreme individual values are.
- Formal proof of the classical CLT
- Stable distributions and Lévy alpha-stable families beyond a brief mention
- Non-asymptotic concentration inequalities
- 01A theorem everyone trustsslideQuestion
Frame the CLT as the workhorse behind bell-curve statistics, then surface the two assumptions that quietly do all the work.
- CLT: sums of many small independent draws tend to a Gaussian
- Hidden assumption 1: finite variance of the summands
- Hidden assumption 2: independence (or very weak dependence)
- 02Predict the sum distributioninteractivePrediction
Let the learner pick a distribution type and see the running histogram of partial sums, then commit to whether the result will look Gaussian.
- Choose Gaussian, exponential, or Cauchy tails
- Watch the histogram update with sample size n
- Commit: will this sum look bell-shaped at large n?
- 03Commit to one mechanismquizPrediction
Ask the learner to identify which assumption of the CLT is most directly violated by a Cauchy-distributed step, before the evidence scene reveals the answer.
- One focused prediction about variance vs independence
- 04What the histograms actually showslideEvidence
Display three animated histograms side by side: Gaussian steps converge to a bell, heavy-tailed (Pareto) steps collapse into a few giant spikes, and correlated steps drift without concentrating.
- Gaussian i.i.d.: clean bell emerges by n ≈ 100
- Pareto i.i.d. with tail exponent ≤ 2: histograms never stabilize into a bell
- AR(1) correlated steps: width shrinks too slowly and shape leaks the dependence
- 05Why each failure happensslideExplanation
Walk through the mechanism: heavy tails make variance (and higher moments) infinite, so the √n normalization in the CLT denominator diverges; correlations break independence so the variance of the average no longer shrinks like 1/n.
- Cauchy / alpha-stable: variance is undefined, so no Gaussian limit exists
- Pareto with α ≤ 2: the largest single term dominates the sum, not the average
- Correlated steps: Var(X̄) shrinks slower than 1/n, and the limit shape carries the dependence
- 06Stress-test the variance scalinginteractiveEvidence
Let the learner change the tail exponent and the autocorrelation coefficient, and watch the empirical variance of the mean plotted against sample size on a log-log axis.
- Slope of −1 means healthy 1/n CLT scaling
- Slopes flatter than −1 indicate dependence or infinite variance
- Curves for α < 2 never develop a stable slope
- 07Where the CLT still holdsslideBoundary
Clarify the exact boundaries: Pareto with α > 2 still works, weakly dependent sequences under mixing conditions still work, and truncated heavy tails are fine.
- Tail exponent α > 2 restores finite variance and recovers the CLT
- Mixing / weak dependence allows a generalized CLT
- Truncating extremes removes the heavy-tail pathology
- 08Apply it to financial returnsinteractiveTransfer
Transfer the explanation to daily equity returns: a learner adjusts tail exponent and autocorrelation on synthetic return data and watches VaR estimates compared to Gaussian assumptions.
- Equity returns empirically have heavy tails and volatility clustering
- Gaussian VaR systematically underestimates true tail risk
- Identifying the failure mode tells you which model family to use
- 09The CLT fails when one term can dominate the sumslideResolution
Resolve the driving question by naming both failure modes in one sentence, then summarize the practical diagnostic: check variance finiteness and check independence.
- Heavy tails → infinite variance → √n normalization collapses
- Correlated steps → dependence → variance of mean no longer scales as 1/n
- Diagnostic: estimate tail exponent and autocorrelation before trusting a Gaussian limit
Discussion threads for a Stage aren't available yet.