Skip to article frontmatterSkip to article content
Site not loading correctly?

This may be due to an incorrect BASE_URL configuration. See the MyST Documentation for reference.

Regular Variation

Overview

An exact Pareto tail has the same probability ratio whenever we multiply a threshold by a fixed amount. Regular variation asks for this behavior only in the limit as the threshold grows. It allows slow corrections to a power law while retaining a limiting tail exponent.

Read the Pareto survival example first for a concrete example. This page uses limits and positive measurable functions; the proof below establishes the power-times-slowly-varying characterization directly from the definition.

Definition and characterization

A positive measurable function ff is regularly varying at infinity with index ρ\rho, written f∈RVρf\in RV_\rho, if, for every fixed t>0t>0,

lim⁡x→∞f(tx)f(x)=tρ.\lim_{x\to\infty}\frac{f(tx)}{f(x)}=t^\rho.

The case ρ=0\rho=0 is called slow variation: a positive measurable function LL is slowly varying when L(tx)/L(x)→1L(tx)/L(x)\to1 for every fixed t>0t>0. Equivalently, regularly varying functions can be written as

f(x)=xρL(x)f(x)=x^\rho L(x)

with LL slowly varying. A survival function Fˉ\bar F has a regularly varying right tail with exponent α>0\alpha>0, written Fˉ∈RV−α\bar F\in RV_{-\alpha}, when

lim⁡x→∞Fˉ(tx)Fˉ(x)=t−α,t>0.\lim_{x\to\infty}\frac{\bar F(tx)}{\bar F(x)}=t^{-\alpha}, \qquad t>0.

Here Fˉ(x)=P(X>x)\bar F(x)=\mathbb P(X>x), LL is the slowly varying factor, α\alpha is the positive tail exponent, and tt is a fixed multiplier.

What the ratio means

Regular variation is the mathematical version of Pareto-style scale invariance. At high thresholds, multiplying the threshold by tt has an asymptotically stable effect on exceedance probabilities. The slowly varying factor LL allows departures from an exact Pareto law while preserving the same tail exponent.

The ratio statement is stronger than saying that large observations are more frequent than under a Gaussian baseline. It says that the relative penalty for raising a large threshold settles to a power t−αt^{-\alpha}.

Examples and non-examples

Proof of the characterization

We prove the algebraic characterization used throughout these notes: a regularly varying function is a power times a slowly varying function. The proof is only an unwinding of the ratio definition. The Karamata note develops the related integral asymptotics and their moment consequences.

If f(x)=xρL(x)f(x)=x^\rho L(x) with LL slowly varying, then for fixed t>0t>0,

f(tx)f(x)=tρL(tx)L(x)→tρ.\frac{f(tx)}{f(x)} = t^\rho\frac{L(tx)}{L(x)} \to t^\rho.

Conversely, if f∈RVρf\in RV_\rho, define L(x)=x−ρf(x)L(x)=x^{-\rho}f(x). Then

L(tx)L(x)=t−ρf(tx)f(x)→1,\frac{L(tx)}{L(x)} = t^{-\rho}\frac{f(tx)}{f(x)} \to 1,

so LL is slowly varying and f(x)=xρL(x)f(x)=x^\rho L(x).

For survival tails, set ρ=−α\rho=-\alpha in the same equivalence: Fˉ(x)=x−αL(x)\bar F(x)=x^{-\alpha}L(x), with L(x)=xαFˉ(x)L(x)=x^\alpha\bar F(x) slowly varying. No separate survival-tail argument is needed.

For the Pareto distribution with lower cutoff xmx_m,

Fˉ(x)=xmαx−α,\bar F(x)=x_m^\alpha x^{-\alpha},

so L(x)=xmαL(x)=x_m^\alpha is constant and therefore slowly varying.

What the representation theorem adds

The elementary equivalence above defines LL; it does not prove Karamata’s representation theorem. For positive measurable slowly varying LL, that theorem gives, eventually,

L(x)=c(x)exp⁡{∫axε(v)v dv},c(x)→c∈(0,∞),ε(x)→0,L(x)=c(x)\exp\left\{\int_a^x\frac{\varepsilon(v)}v\,dv\right\}, \qquad c(x)\to c\in(0,\infty),\quad \varepsilon(x)\to0,

with measurable cc and locally integrable ε(v)/v\varepsilon(v)/v. We cite the existence of this representation: Bingham et al. (1987), Theorem 1.3.1, p. 12. This is a different result from the integral theorem.

Its sufficiency follows directly. For fixed t>0t>0, the logarithm of L(tx)/L(x)L(tx)/L(x) is log⁡[c(tx)/c(x)]+∫xtxε(v) dv/v\log[c(tx)/c(x)]+\int_x^{tx}\varepsilon(v)\,dv/v. The integral’s absolute value is at most ∣log⁡t∣|\log t| times the supremum of ∣ε∣|\varepsilon| between xx and txtx, which tends to zero. Also log⁡L(x)/log⁡x→0\log L(x)/\log x\to0: split the integral at a fixed point beyond which ∣ε∣<δ|\varepsilon|<\delta, divide by log⁡x\log x, and then let δ↓0\delta\downarrow0. Hence a regularly varying survival satisfies log⁡Fˉ(x)/log⁡x→−α\log\bar F(x)/\log x\to-\alpha. This is a ratio of logarithms; convergence of a derivative of a log-log plot needs extra smoothness.

Positive powers of a tail variable

We prove the transformation rule used in SCoFT v4 §5.2.3, p. 100 Taleb, 2025, without differentiating a density. Let X≥0X\ge0 have Fˉ(x)=x−αL(x)\bar F(x)=x^{-\alpha}L(x) eventually and let r>0r>0. Then

P(Xr>y)=Fˉ(y1/r)=y−α/rL(y1/r).P(X^r>y)=\bar F(y^{1/r})=y^{-\alpha/r}L(y^{1/r}).

For fixed t>0t>0, the ratio of the last slowly varying factors has arguments t1/ry1/rt^{1/r}y^{1/r} and y1/ry^{1/r}, so it tends to one. Thus XrX^r has survival exponent α/r\alpha/r. Units may be fixed first by applying this argument to X/xmX/x_m. Negative powers concern the behavior near zero and are outside this right-tail rule. The exact Pareto payoff case is already derived in asymmetric payoffs.

Ratio diagnostics

The fixed-multiplier ratio can be compared algebraically for an exact Pareto tail and a power law with a slowly varying logarithmic correction.

For an exact Pareto tail and a logarithmically corrected tail, respectively,

Fˉ(2x)Fˉ(x)=2−α,(2x)−α(log⁡(2x))βx−α(log⁡x)β=2−α(1+log⁡2log⁡x)β.\frac{\bar F(2x)}{\bar F(x)}=2^{-\alpha}, \qquad \frac{(2x)^{-\alpha}(\log(2x))^\beta} {x^{-\alpha}(\log x)^\beta} =2^{-\alpha}\left(1+\frac{\log 2}{\log x}\right)^\beta.

For α=1.5\alpha=1.5 and β=1\beta=1, the correction multiplier is 2 at x=2x=2, 3/23/2 at x=4x=4, and 5/45/4 at x=16x=16. The second expression is used only sufficiently far into the tail, where it is decreasing and at most one before taking the ratio; a full distribution also needs a body below that range.

The exact Pareto ratio is constant at 2−α2^{-\alpha}; the log-corrected ratio approaches the same target slowly. A finite diagnostic curve can suggest regular variation, but the definition is about the asymptotic limit.

The doubling ratio of a logarithmically corrected power tail decreases slowly toward the constant one-quarter ratio of an exact Pareto tail on a logarithmic threshold axis.

Figure 1:This reused chapter-2 figure uses Fˉ(u)=u−2(1+log⁡u)\bar F(u)=u^{-2}(1+\log u) for u≥1u\ge1, extended by one below 1. It has exponent 2 and slowly varying factor 1+log⁡u1+\log u, differing from the preceding exponent-1.5 example with factor log⁡u\log u. Its doubling ratio is 14[1+log⁡2/(1+log⁡u)]\tfrac14[1+\log 2/(1+\log u)], which approaches 1/41/4. All values are population evaluations; the threshold axis is logarithmic.

Use regular_variation_ratio to evaluate the law used in the figure:

import numpy as np
from xmath.incerto.tail_diagnostics import regular_variation_ratio

survival = lambda u: u**-2 * (1 + np.log(u))
result = regular_variation_ratio(survival, [1, 10, 100, 10000])
for u, ratio in zip(result["threshold"], result["ratio"]):
    print(f"u={u:.4g}: ratio={ratio:.4g}, limit=0.25")

Output

u=1: ratio=0.4233, limit=0.25
u=10: ratio=0.3025, limit=0.25
u=100: ratio=0.2809, limit=0.25
u=1e+04: ratio=0.267, limit=0.25

The existing producer is uv run python demos/incerto/glossary_worked_cases.py.

The chapter 5 demo compares multiplier ratios for Student and shifted double-Pareto tails. Their finite threshold differences are explained by the matching calculation.

Caveats

References

References
  1. Bingham, N. H., Goldie, C. M., & Teugels, J. L. (1987). Regular Variation. Cambridge University Press. 10.1017/CBO9780511721434
  2. Taleb, N. N. (2025). Statistical Consequences of Fat Tails (3rd ed.). https://arxiv.org/abs/2001.10488v4
  3. Foss, S., Korshunov, D., & Zachary, S. (2013). An Introduction to Heavy-Tailed and Subexponential Distributions (2nd ed.). Springer. 10.1007/978-1-4614-7101-1
  4. Embrechts, P., Klüppelberg, C., & Mikosch, T. (1997). Modelling Extremal Events. Springer. 10.1007/978-3-642-33483-2
  5. Resnick, S. I. (2007). Heavy-Tail Phenomena: Probabilistic and Statistical Modeling. Springer. 10.1007/978-0-387-45024-7