Skip to article frontmatterSkip to article content
Site not loading correctly?

This may be due to an incorrect BASE_URL configuration. See the MyST Documentation for reference.

Chapter 2 — Glossary, definitions, and notations

Reading a glossary through examples

A probability, a conditional mean, and a contribution to an expectation can all refer to observations above the same threshold. They answer different questions. This guide uses that distinction to connect the glossary to counting exceedances, the Pareto law, the extreme-value index, and the tail class catalog.

The source is Taleb (2025), Statistical Consequences of Fat Tails, third edition, arXiv:2001.10488v4, chapter 2, printed pp. 7–21. The tables give reading locations, not transcriptions of the glossary. Our examples and arguments are developed independently. The shared notation controls the symbols used here; source-specific conventions need translation.

Notation at the point of use

Source term or symbol / locatorOur notation and meaningReading route
Probability, expectation, variance; §2.1, p. 7PP, E\mathbb E, Var⁡\operatorname{Var}; an expectation may be infinite or undefinedPareto moment existence
Density; §2.1, p. 7pθ(x)p_\theta(x) for a parameterized density; local ff for a fixed Lebesgue densityPareto definition
CDF and survival, FF, Fˉ\bar F, SS; §2.1, p. 7F(u)=P(X≤u)F(u)=P(X\le u) and Fˉ(u)=P(X>u)\bar F(u)=P(X>u)CDF and atoms
Sample size and sum; §2.1, pp. 7–8nn, Sn=∑iXiS_n=\sum_iX_i, Xˉn=Sn/n\bar X_n=S_n/n; a hatted S^n(u)\widehat S_n(u) is instead a local empirical survivalCounting exceedances
Moment order pp; §2.1, p. 7p>0p>0 in E[Xp]\mathbb E[X^p] for nonnegative XX; use a separate local qq for a probability levelMoment thresholds
Tail and stable indices; §2.1, p. 8α>0\alpha>0 is the survival power exponent, ξ\xi the EVI; a stable-law index must be identified separatelyExact Pareto EVI proof
Threshold KK, lower endpoint xmin⁡x_{\min}; §§2.2.1, 2.2.4, pp. 9–11uu is a threshold; xm>0x_m>0 is a Pareto minimum; e(u)=E[X−u∣X>u]e(u)=\mathbb E[X-u\mid X>u]Conditional Pareto quantities
Gaussian scale and lognormal parameters; §2.1, p. 8Write N(μ,σ2)N(\mu,\sigma^2) with variance σ2\sigma^2; specify log⁡X∼N(μ,σ2)\log X\sim N(\mu,\sigma^2) for a lognormalLognormal moments
Mean absolute deviation and normalized pp expression; §2.1, pp. 7–8State the center and normalization explicitly; $(n^{-1}\sum_ix_i
Characteristic function, delta, step and special functions; §2.1, pp. 8–9Keep these local to the calculation; our θ\theta remains a model parameter when used that wayStable-limit characteristic functions; special-function identities need their own references

For a lognormal, μ\mu is a log-location, not its ordinary mean. The catalog derivation gives EX=exp⁡(μ+σ2/2)\mathbb E X=\exp(\mu+\sigma^2/2), so a prescribed mean m>0m>0 requires μ=log⁡m−σ2/2\mu=\log m-\sigma^2/2. Likewise, the stable-law index is restricted to (0,2](0,2], whereas a Pareto exponent can exceed 2; neither is silently interchangeable with the EVI.

Map of the glossary concepts

The core route is probability → tail size → tail class → normalized extremes. Other glossary entries point ahead to later chapters. A link below identifies a relevant existing note, not a claim that all of that topic is proved here.

Term / source locatorOur page or local interpretation
Power-law class; §2.2.1, p. 9Regular variation: Fˉ(x)=x−αL(x)\bar F(x)=x^{-\alpha}L(x) has variation index −α-\alpha
Weak LLN and CLT; §§2.2.2–3, p. 10The convergence statements below; preasymptotic averages distinguishes a limit from its finite-sample accuracy
Expected excess; §2.2.4, pp. 10–11Mean excess is e(u)e(u); conditional tail mean is u+e(u)u+e(u)
Medium numbers, preasymptotics; §§2.2.5, 2.2.17, pp. 11, 15Finite-sample averages; no universal convergence rate is supplied by naming the regime
Kappa; §2.2.6, pp. 11–12Planned chapter-8 treatment of dispersion scaling; a mean-centered formula needs an existing mean and finite, nonzero dispersion terms
Elliptical laws and independence; §§2.2.7–8, p. 12Mixtures supply examples; independence means a product joint law, and scatter need not be a finite covariance matrix
Stable and multivariate stable laws; §§2.2.9–10, pp. 12–13Generalized CLT; normalized sums and normalized maxima are different limit problems
Karamata point; §2.2.11, p. 13Counterexample to a constant tail factor; no finite transition point follows from slow variation
Subexponentiality; §2.2.12, pp. 13–14Subexponential tails; fix the number of iid nonnegative summands while the threshold tends to infinity
Student-t proxy; §2.2.13, p. 14Survival ratios; label degrees of freedom locally and distinguish this model from an exact Pareto
Stochasticizing, metaprobability; §§2.2.18, 2.2.31, pp. 15–16, 20Random-scale examples; a distribution over a parameter defines a mixture, with dependence specified separately
VaR and conditional VaR; §2.2.19, p. 16For a nonnegative loss XX, define a local quantile Q(q)=inf⁡{x:F(x)≥q}Q(q)=\inf\{x:F(x)\ge q\}; see the quantile and tail-mean distinction below
MS plot; §2.2.21, pp. 16–17Max-to-sum ratio; for moment order pp compare max⁡iXip\max_i X_i^p with ∑iXip\sum_i X_i^p, not with (∑iXi)p(\sum_iX_i)^p
Maximum domain of attraction; §2.2.22, p. 17EVI definition and Pareto proof; a nondegenerate normalized maximum limit is essential
Tail payoff integrals; §§2.2.23–24, pp. 17–18Tail contribution identity; uFˉ(u)u\bar F(u) omits the contribution above uu
Empirical distribution; §2.2.27, p. 19Strict counts; bounded indicator averages do not establish unbounded-moment convergence
Hidden tail and shadow moment; §§2.2.28–29, p. 20Plug-in estimation; the model assigns mass beyond the sample maximum, while a sample alone does not identify that mass
Tail dependence; §2.2.30, p. 20A limiting conditional exceedance probability at marginal quantiles, when the limit exists; dedicated multivariate treatment is planned
Dynamic hedging; §2.2.32, p. 21Planned Dynamic Hedging sequence; no replication theorem follows from the glossary alone
Citation ring, rent seeking, pseudo-empiricism, skin in the game, Wittgenstein’s ruler, Black Swans; §§2.2.14–16, 2.2.20, 2.2.25–26, pp. 14–19Interpretive source vocabulary, outside this chunk’s mathematical claims; no distributional theorem or empirical finding is inferred from these labels

The normalized expression in the first table fails the triangle inequality when 0<p<10<p<1: for (1,0)(1,0) and (0,1)(0,1) it gives 1 for their sum but 21−1/p<12^{1-1/p}<1 for the sum of their values. Independence can always be expressed by P(X∈A,Y∈B)=P(X∈A)P(Y∈B)P(X\in A,Y\in B)=P(X\in A)P(Y\in B) for measurable sets. A density ratio can express it only where the denominator is positive and the densities exist. An elliptical scatter matrix is a model parameter; identifying it with a covariance additionally requires second moments and the appropriate scalar normalization.

Which limit is being taken?

For random variables Yn,YY_n,Y, convergence in probability means P(∣Yn−Y∣>ε)→0P(|Y_n-Y|>\varepsilon)\to0 for every ε>0\varepsilon>0. Almost-sure convergence means P(lim⁡nYn=Y)=1P(\lim_nY_n=Y)=1. Convergence in distribution means convergence of the CDFs at continuity points of the limiting CDF. These are the conventions behind the arrows in §2.1, p. 8.

For iid XiX_i with E∣X1∣<∞\mathbb E|X_1|<\infty, the weak LLN gives Xˉn→Pμ\bar X_n\xrightarrow{P}\mu, where μ=EX1\mu=\mathbb E X_1. With the stronger assumption 0<σ2=Var⁡(X1)<∞0<\sigma^2=\operatorname{Var}(X_1)<\infty, the classical CLT gives

n(Xˉn−μ)σ→dN(0,1).\frac{\sqrt n(\bar X_n-\mu)}{\sigma}\xrightarrow{d}N(0,1).

These two general theorems are cited, not proved here (SCoFT v4 §§2.2.2–3, p. 10). Neither statement gives a universal finite-sample error bound. The exceedance note does prove a pointwise probability bound for its bounded indicators.

By contrast, the subexponential relation compares P(Sn>x)P(S_n>x) and P(Mn>x)P(M_n>x) as x→∞x\to\infty with nn fixed. It does not say that Mn/SnM_n/S_n tends to one as nn grows. The Pareto sums section keeps the growing-sample regimes and moment orders separate.

A probability does not specify the tail payoff

For Pareto (α=3/2,xm=1)(\alpha=3/2,x_m=1), threshold u=4u=4 is the quantile Q(7/8)Q(7/8). The exceedance probability is 1/81/8, but the conditional mean above that threshold is 12. The Pareto derivation gives mean excess 8 and tail contribution 3/23/2. All four numbers describe the same distribution and threshold.

For an integrable nonnegative loss, define expected shortfall at level 0<q<10<q<1 by (1−q)−1∫q1Q(v) dv(1-q)^{-1}\int_q^1Q(v)\,dv. When there is no atom at the quantile, this agrees with the conditional tail mean. At an atom, conditioning on X>Q(q)X>Q(q) generally selects a different probability mass. For the empirical law of (1,2,2,4)(1,2,2,4) and q=1/2q=1/2, the upper half consists of equal masses at 2 and 4, so the quantile integral gives 3. Strict conditioning on X>2X>2 instead gives 4. This calculation explains why the probability level, sign convention, and treatment of ties must accompany the terms VaR and expected shortfall.

Even uniform CDF accuracy does not control a mean without additional tail conditions. To prove this, let PjP_j put mass 1−1/j1-1/j at zero and 1/j1/j at j2j^2, for integers j≥2j\ge2. Its CDF differs from that of a point mass at zero by at most 1/j1/j, yet its mean is jj. This deterministic sequence of laws is a counterexample to such an implication; it is not a simulation of an iid empirical process. It isolates the probability-versus-moment issue behind §§2.2.27–28, pp. 19–20, without importing a uniform convergence theorem.

Reproduce the worked cases

Use empirical_survival_function, pareto_tail_quantities.

Code
from xmath.incerto.stats import empirical_survival_function
from xmath.incerto.glossary import pareto_tail_quantities

support, survival = empirical_survival_function([1, 2, 2, 4])
print("Support: [" + ", ".join(f"{v:.4g}" for v in support) + "]")
print("Strict survival: [" + ", ".join(f"{v:.4g}" for v in survival) + "]")
for alpha in (0.8, 1, 1.5, 3):
    result = pareto_tail_quantities(alpha, x_m=1, threshold=4)
    print(f"alpha={alpha:.4g}")
    for name, value in result.items():
        print(f"  {name}: {value:.4g}")

Output

Support: [1, 2, 4]
Strict survival: [0.75, 0.25, 0]
alpha=0.8
  log_survival: -1.109
  mean_excess: inf
  conditional_mean: inf
  tail_first_moment: inf
alpha=1
  log_survival: -1.386
  mean_excess: inf
  conditional_mean: inf
  tail_first_moment: inf
alpha=1.5
  log_survival: -2.079
  mean_excess: 8
  conditional_mean: 12
  tail_first_moment: 1.5
alpha=3
  log_survival: -4.159
  mean_excess: 2
  conditional_mean: 6
  tail_first_moment: 0.09375

Figure regeneration: uv run python demos/incerto/exceedances.py; uv run python demos/incerto/glossary_worked_cases.py.

The second script uses the fixed list (1,2,2,4)(1,2,2,4) and exact population formulas. It prints conditional Pareto quantities at u=1,4,16u=1,4,16 for α=0.8,1,1.5,3\alpha=0.8,1,1.5,3, the uniform-CDF counterexample for j=10,100,1000j=10,100,1000, and multiplier ratios for the catalog’s logarithmic correction. It evaluates four Pareto maximum CDFs with α=1.5\alpha=1.5 on 301 points from 0.25 to 4, and a 161-point multiplier grid from 1 to 104. Units are dimensionless. There is no RNG, external data, model fitting, or distribution truncation; the finite grids bound the work to a few seconds and two figure exports.

Strict empirical survival jumps down at tied values; normalized Pareto maximum CDFs approach the Frechet CDF as sample size increases.

Left: the empirical law assigns half its mass to 2; closed circles mark the value after each downward jump. Right: exact iid Pareto maximum CDFs and their proved Fréchet limit. The finite curves illustrate the formulas; they are not estimates or evidence for an unknown population model.

The multiplier ratio of a logarithmically corrected power tail approaches one quarter while remaining above the exact Pareto ratio on the plotted range.

Both tails have exponent 2. The corrected law has L(u)=1+log⁡uL(u)=1+\log u, which grows without bound even as its multiplier ratio approaches the Pareto value. The catalog proves the limiting claim and validates the law.

Unexpected non-finite arithmetic raises an error. CDF values may round to zero or one at floating-point limits; this does not assert finite support. Tests compare finite formulas with independent integration and distribution calculations. The probability bounds, conditional identities, maximum limit, and counterexamples are proved in the notes, not by the tests.

References and next reading

References
  1. Taleb, N. N. (2025). Statistical Consequences of Fat Tails (3rd ed.). https://arxiv.org/abs/2001.10488v4