Skip to article frontmatterSkip to article content
Site not loading correctly?

This may be due to an incorrect BASE_URL configuration. See the MyST Documentation for reference.

Generalized Central Limit Theorem

Statement

The ordinary central limit theorem uses finite variance and normalizes sums by n\sqrt{n}. The substantive generalized central limit theorem is a classification theorem: a nondegenerate distribution can occur as a weak limit of centered and normalized iid sums if and only if it is stable. In other words, if there are constants an>0a_n>0 and bnb_n such that

X1++XnbnanZ,\frac{X_1+\cdots+X_n-b_n}{a_n} \Rightarrow Z,

for a nondegenerate limit ZZ, then ZZ must be stable; conversely, stable laws arise as such limits for suitable iid summands. The Gaussian law is the stable case α=2\alpha=2. The heavy-tailed stable cases have index 0<α<20<\alpha<2.

For a two-sided regularly varying sufficient condition, assume

P(X>x)=xαL(x),0<α<2,\mathbb P(|X|>x)=x^{-\alpha}L(x),\qquad 0<\alpha<2,

where LL is slowly varying at infinity, with tail balance

P(X>x)P(X>x)p,P(X<x)P(X>x)q,p+q=1.\frac{\mathbb P(X>x)}{\mathbb P(|X|>x)}\to p,\qquad \frac{\mathbb P(X<-x)}{\mathbb P(|X|>x)}\to q,\qquad p+q=1.

Choose ana_n so that nP(X>an)1n\mathbb P(|X|>a_n)\to1. Then, with suitable centering constants bnb_n,

X1++XnbnanZα,\frac{X_1+\cdots+X_n-b_n}{a_n} \Rightarrow Z_\alpha,

where ZαZ_\alpha is an α\alpha-stable law whose skewness is determined by pqp-q. For nonnegative Pareto-type examples this reduces to a strongly right-skewed stable limit, and the scaling is of order n1/αn^{1/\alpha} up to a slowly varying factor. When 1<α<21<\alpha<2, the mean exists but the variance is infinite, so a common centering choice is bn=nE[X]b_n=n\mathbb E[X].

A common centering summary is

bn={0,0<α<1in the usual nonnegative case,nE[X1{Xan}],α=1as a standard choice,nE[X],1<α<2.b_n= \begin{cases} 0, & 0<\alpha<1\quad\text{in the usual nonnegative case},\\ n\mathbb E[X\mathbf 1_{\{|X|\le a_n\}}], & \alpha=1\quad\text{as a standard choice},\\ n\mathbb E[X], & 1<\alpha<2. \end{cases}

Here Sn=i=1nXiS_n=\sum_{i=1}^n X_i is the sum, Mn=max1inXiM_n=\max_{1\le i\le n}X_i is the maximum, E\mathbb E is expectation, and \Rightarrow denotes convergence in distribution. The tail exponent α\alpha, norming constants ana_n, centering constants bnb_n, tail-balance weights p,qp,q, and stable limit ZαZ_\alpha are defined above. Shared notation is planned.

We record the stable-limit contrast needed by the site’s heavy-tail pages. We do not classify every possible domain of attraction or every parameterization of stable laws.

The classification and sufficient tail condition above are cited from Feller 1971, 2nd ed., Wiley and Resnick 2007; the local argument below addresses only exact Pareto maximum scaling.

Why n\sqrt{n} fails

The normal law is not the only possible attractor for sums. It is the finite-variance attractor. For the regularly varying tails with 0<α<20<\alpha<2 considered here, the largest observations remain visible at the scale of the centered sum, and n\sqrt{n} is no longer the right normalization.

For a Pareto-type tail with exponent α<2\alpha<2, the natural scale of the maximum is about n1/αn^{1/\alpha}. Stable normalization puts the centered sum on that same order. This is why infinite-variance sums can keep producing large jumps instead of smoothing into Gaussian-looking noise.

Scaling argument

The full generalized central limit theorem is a stable-law classification result, so we cite it rather than reproduce the proof. What we prove directly is the exact Pareto maximum scaling calculation, which shows why the usual n\sqrt n scale is too small when α<2\alpha<2.

For a Pareto Type I variable with survival Fˉ(x)=(xm/x)α\bar F(x)=(x_m/x)^\alpha, choose an=xmn1/αa_n=x_m n^{1/\alpha}. Then for y>0y>0 and sufficiently large nn such that anyxma_n y\ge x_m,

P(Mn/any)=(11nyα)neyα.\mathbb P(M_n/a_n\le y) = \left(1-\frac{1}{ny^\alpha}\right)^n \to e^{-y^{-\alpha}}.

The maximum remains of order ana_n. Since ana_n grows faster than n\sqrt{n} when α<2\alpha<2, the Gaussian finite-variance scaling is not the right asymptotic scale for such tails. This maximum calculation identifies the right order of extreme observations; it is a scaling heuristic, not a proof of stable convergence for sums.

Pareto scaling comparison

Take exact Pareto Type I with xm=1x_m=1 and α=1.5\alpha=1.5. Its mean is 3 and its variance is infinite. With Sn=i=1nXiS_n=\sum_{i=1}^n X_i, compare

Tn=Sn3nn2/3,Gn=Sn3nn=n1/6Tn.T_n=\frac{S_n-3n}{n^{2/3}}, \qquad G_n=\frac{S_n-3n}{\sqrt n}=n^{1/6}T_n.

The identity holds for every sample. Consequently, whenever its interquartile range is nonzero, the spread of GnG_n is exactly n1/6n^{1/6} times that of TnT_n. Here are the normalization factors, rounded to three decimals:

Sample size nnStable scale n2/3n^{2/3}Gaussian scale n\sqrt nRatio n1/6n^{1/6}
10021.544102.154
100010031.6233.162
10000464.1591004.642

The cited stable-limit theorem implies convergence of the central quantiles of TnT_n to those of a nondegenerate continuous stable law. Thus the central spread of GnG_n grows on the n1/6n^{1/6} scale. The table evaluates the normalizations; it is neither simulated evidence nor a proof of stable convergence.

Caveats

References

Source and adaptation

Adapted from incerto-wiki, content/concepts/theorems/generalized-central-limit-theorem.md, revision 9717c9c (2026-09-13 import). Copyright (c) 2023 xshi19. Licensed under MIT. Links and notation were adapted for this site; executable figures and simulations were replaced with static calculations. No upstream execution or formal-proof verification is claimed for this adaptation.

MIT permission notice

MIT License

Copyright (c) 2023 xshi19

Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files (the “Software”), to deal in the Software without restriction, including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the Software, and to permit persons to whom the Software is furnished to do so, subject to the following conditions:

The above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software.

THE SOFTWARE IS PROVIDED “AS IS”, WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.

References
  1. Resnick, S. I. (2007). Heavy-Tail Phenomena: Probabilistic and Statistical Modeling. In Springer Series in Operations Research and Financial Engineering. Springer New York. 10.1007/978-0-387-45024-7