How Convolution Erases Edges into a Bell Curve
Convolution of independent distributions is equivalent to summing their random variables, and the Central Limit Theorem guarantees that many such convolutions smooth every feature into a Gaussian.
A complete interactive classroom, not just a preview.
Start when you are ready to enter this Stage's 9 scenes and explore, respond, and learn as you go.
How does convolving independent distributions repeatedly erase sharp edges and produce a Gaussian?
Sharp triangles and rectangles, when added to themselves repeatedly, secretly turn into a perfectly smooth bell curve.
It seems impossible that a pointed shape and a blocky shape could ever produce a rounded, gentle Gaussian through simple addition.
Watch the shape morph from angular to smooth as more independent variables are summed, with a live histogram that fills in with each added variable.
Summing independent random variables is exactly convolution, and repeated convolution is the hidden engine that turns any reasonable distribution into a Gaussian.
A common first guess is that the result of convolution will look like some messy blend of the original shapes, or that you would need an infinite number of convolutions to get a Gaussian.
- Fourier-domain proofs of the Central Limit Theorem
- Non-identically-distributed summands beyond a brief mention
- Stable distributions and Lévy's theorem
- Detailed measure theory or characteristic function machinery
- 01The Curious Case of a Disappearing PointslideQuestion
Open with a single sharp triangular distribution and ask why convolving it with copies of itself turns its sharp tip into a smooth, rounded bell curve.
- A triangle has a sharp peak and sharp corners
- Convolution with an identical triangle changes the shape
- The puzzle: where does the sharpness go?
- 02What Will the Convolved Triangle Look Like?quizPrediction
Let the learner commit to one guess about the shape after convolving a triangle with itself once before any explanation is revealed.
- Make one independent prediction
- Compare against the observed result later
- 03Live Convolution LaboratoryinteractiveEvidence
A simulation where the learner picks a starting shape (triangle, rectangle, or exponential), chooses the number of self-convolutions from 1 to 20, and watches the density morph from angular to smooth bell-shaped.
- Pick triangle, rectangle, or exponential as the seed
- Adjust the number of self-convolutions n from 1 to 20
- Overlay the matching Gaussian for comparison
- Watch the sharp features flatten step by step
- 04Histogram Evidence: 1 Die vs. 20 DiceslideEvidence
Show side-by-side bar histograms: one die produces a flat uniform block, two dice show a triangle, three dice show a smooth hump, and twenty dice look indistinguishable from a Gaussian bell curve.
- 1 die: flat block (uniform)
- 2 dice: triangle with a single peak
- 3 dice: rounded mound
- 20 dice: indistinguishable from a Gaussian
- 05Convolution Is Just Adding Independent VariablesslideExplanation
Explain that the density of X + Y, where X and Y are independent, is the convolution of their densities. Each convolution therefore adds one more independent copy, and the convolution operation is associative.
- f_{X+Y}(z) equals the convolution of f_X and f_Y
- Independence is what licenses this combination rule
- n-fold convolution equals the density of the sum of n independent copies
- Convolution is associative: order of adding does not matter
- 06Why Sharpness Disappears: The Averaging ArgumentslideExplanation
Walk through the intuition: each new independent variable averages with the running sum, so a single extreme value gets diluted by the typical values around it. Sharp corners correspond to rare extreme configurations, and many independent additions make those rare configurations vanish in the limit.
- Adding an independent variable averages the outcome
- Sharp peaks arise from a single extreme event; many variables suppress extremes
- The distribution's variance grows by sigma-squared each step
- Relative spread shrinks, so fine features smooth out
- 07A Pathological Starting ShapeinteractiveTransfer
Test the rule on a deliberately nasty seed: a density with a single sharp spike and a long flat tail. Let the learner apply repeated convolution and confirm that even this pathological shape still converges to the same Gaussian family, only with different mean and variance.
- Start with a spiky-plus-flat density
- Apply many self-convolutions
- Confirm convergence to a Gaussian
- Note that mean and variance depend on the seed
- 08Where the Rule Breaks: Heavy Tails and DependenceslideBoundary
Mark the limits: convolving Cauchy or other heavy-tailed distributions never settles into a Gaussian because they have no finite variance, and convolving dependent variables breaks the averaging argument.
- Cauchy distribution: self-convolution stays Cauchy, not Gaussian
- Infinite variance prevents the standard CLT from applying
- Strong dependence between summands blocks the averaging
- Finite mean and variance plus independence is the safe regime
- 09The Answer: Smoothing by Many Independent AdditionsslideResolution
Close the loop: convolution of independent distributions is summing independent variables; after enough such additions the Central Limit Theorem forces any finite-variance seed toward a Gaussian, erasing sharp edges.
- Convolution = sum of independent random variables
- Repeated convolution = many independent additions
- CLT guarantees convergence to a Gaussian
- Sharp edges vanish because extremes are averaged away
Discussion threads for a Stage aren't available yet.