Quick Context
The normal (or Gaussian) distribution is the familiar bell curve: symmetric, single-peaked, thin-tailed. It is completely specified by just two numbers — the mean μ sets where it sits, and the standard deviation σ sets how wide it is.
f(x) = (1 / σ√(2π)) · e^(−(x−μ)² / 2σ²)
Two Knobs, Nothing Else
- μ slides the curve left and right without changing its shape.
- σ stretches or squeezes it. Watch the peak drop as you widen it — the total area must always equal 1, so a wider curve has to be shorter.
That fixed unit area is what makes it a probability density: area under a stretch of the curve is the probability of landing in that range.
The 68–95–99.7 Rule
±1σ → 68.3% of the data
±2σ → 95.4%
±3σ → 99.7%
These percentages hold for every normal distribution, whatever μ and σ are. Cycle the region selector and watch the shaded area match — the app integrates the curve numerically rather than quoting the constants.
The practical use is spotting anomalies: beyond 3σ you are in the outermost 0.3% of outcomes, which is why quality control and anomaly detection use it as a threshold.
Z-scores Put Everything on One Scale
z = (x − μ) / σ
A z-score restates a value as "how many standard deviations from the mean". It makes incomparable quantities comparable — a height and an exam score both become pure position. Setting μ = 0 and σ = 1 gives the standard normal, which is what every statistical table refers to, and what feature standardisation converts your data into.
Why It Appears Everywhere
The central limit theorem: when you add up many small independent random effects, their total tends toward a normal distribution regardless of how the individual effects were distributed. Height is the sum of many genetic and environmental nudges; measurement error is the sum of many tiny disturbances. Hence bells everywhere.
Press Sample 500 a few times and watch the histogram converge onto the curve. In machine learning this shows up as weight initialisation (drawn from a normal), Gaussian noise in diffusion models, and the assumption behind least-squares regression.
When Not to Assume It
Normal tails are extremely thin — a 5σ event should essentially never happen. Financial returns, city sizes and word frequencies have far fatter tails, so assuming normality there badly underestimates extreme events. The 2008 financial crisis is the textbook example of trusting a bell curve where none existed.
Interactive Exploration Guide
- Slide μ. The curve translates; its shape never changes.
- Slide σ wider and watch the peak fall to compensate — fixed area in action.
- Cycle ±1σ, ±2σ, ±3σ and confirm 68 / 95 / 99.7 for any μ and σ you choose.
- Sample 20. The histogram looks nothing like a bell — small samples are deceptive. Now sample 500 repeatedly and watch it lock on.
- Set a custom range beyond 3σ and read how vanishingly small the probability becomes.
Key Takeaway
Two parameters describe the entire curve, area equals probability, and 68/95/99.7 holds universally. The central limit theorem is why the shape is so common — but its thin tails mean it is the wrong model whenever extreme events actually matter.