Skip to article frontmatterSkip to article content
Site not loading correctly?

This may be due to an incorrect BASE_URL configuration. See the MyST Documentation for reference.

Generalized Pareto Distribution

Statement

The generalized Pareto distribution is the standard limit family for threshold excesses. With location zero, an excess variable Y≥0Y\ge0 has shape ξ\xi and scale β>0\beta>0 when

Gξ,β(y)=1−(1+ξyβ)−1/ξ,ξ≠0,G_{\xi,\beta}(y) = 1-\left(1+\frac{\xi y}{\beta}\right)^{-1/\xi}, \qquad \xi\ne0,

for y≥0y\ge0 with 1+ξy/β>01+\xi y/\beta>0. For y<0y<0 the CDF is zero; for ξ<0\xi<0 it is one at and above −β/ξ-\beta/\xi, by continuity. The boundary case is

G0,β(y)=1−e−y/β.G_{0,\beta}(y)=1-e^{-y/\beta}.

For ξ≥0\xi\ge0, the support is y≥0y\ge0. For ξ<0\xi<0, the support is 0≤y≤−β/ξ0\le y\le -\beta/\xi, so the tail has a finite endpoint. The survival function for ξ≠0\xi\ne0 is

Gˉξ,β(y)=(1+ξyβ)−1/ξ.\bar G_{\xi,\beta}(y) = \left(1+\frac{\xi y}{\beta}\right)^{-1/\xi}.

The mean exists only for ξ<1\xi<1 and equals β/(1−ξ)\beta/(1-\xi). The variance exists only for ξ<1/2\xi<1/2 and equals

β2(1−ξ)2(1−2ξ).\frac{\beta^2}{(1-\xi)^2(1-2\xi)}.

Shape and endpoint intuition

The generalized Pareto distribution is the peaks-over-threshold counterpart of the generalized extreme-value distribution for block maxima. Once a threshold is high enough, the distribution of the excess over that threshold is modeled with one shape parameter ξ\xi and one scale parameter β\beta.

The sign and size of ξ\xi carry the tail story. Positive ξ\xi gives a Pareto-type heavy tail. Zero gives the exponential boundary. Negative ξ\xi gives a finite endpoint. In the fat-tail examples, the most important boundary values are ξ=1/2\xi=1/2 for variance and ξ=1\xi=1 for the mean.

For β=1\beta=1, the three examples from the survival formula are:

Shape ξ\xiSurvival Gˉ(y)\bar G(y)Upper endpoint
-0.4(1−0.4y)2.5(1-0.4y)^{2.5} for 0≤y≤2.50\le y\le2.52.5
0e−ye^{-y} for y≥0y\ge0Infinite
0.4(1+0.4y)−2.5(1+0.4y)^{-2.5} for y≥0y\ge0Infinite

What to notice. Positive ξ\xi gives the slowest-decaying curve, ξ=0\xi=0 is the exponential boundary, and negative ξ\xi ends at the finite endpoint −β/ξ-\beta/\xi.

Stacked density, CDF and log-log survival panels compare negative, zero and positive GPD shape. The negative-shape tail ends at 2.5.

Figure 1:Exact GPD laws with β=1\beta=1 and ξ=−0.4,0,0.4\xi=-0.4,0,0.4. All start at zero; the negative-shape law ends at −β/ξ=2.5-\beta/\xi=2.5, marked by a matching dotted line. Its CDF stays at one beyond that point. Zero survival is omitted on logarithmic axes; it is never replaced by a small positive probability. The survival viewport starts at 10-8.

Use generalized_pareto. The endpoint calculation is visible in the returned CDF and survival:

from xmath.incerto.distributions import generalized_pareto

law = generalized_pareto(-0.4, beta=1)
for y in (0, 1, 2.5, 3):
    print(f"y={y:.4g}: pdf={law.pdf(y):.4g}, cdf={law.cdf(y):.4g}, sf={law.sf(y):.4g}")

Output

y=0: pdf=1, cdf=0, sf=1
y=1: pdf=0.4648, cdf=0.7211, sf=0.2789
y=2.5: pdf=0, cdf=1, sf=0
y=3: pdf=0, cdf=1, sf=0

Regenerate the card with uv run python demos/incerto/distribution_cards.py.

Threshold-excess stability and Pareto special case

A GPD is stable under raising the threshold. If YY has parameters ξ,β\xi,\beta and u≥0u\ge0 satisfies β+ξu>0\beta+\xi u>0, then, for admissible y≥0y\ge0 and ξ≠0\xi\ne0,

Gˉξ,β(u+y)Gˉξ,β(u)=(1+ξyβ+ξu)−1/ξ.\frac{\bar G_{\xi,\beta}(u+y)}{\bar G_{\xi,\beta}(u)} =\left(1+\frac{\xi y}{\beta+\xi u}\right)^{-1/\xi}.

For ξ=0\xi=0, the ratio is e−y/βe^{-y/\beta}. Thus excesses have the same shape and updated scale β+ξu\beta+\xi u. Combining this with the GPD mean gives the mean-excess formula.

The Pareto Type I distribution is an exact generalized Pareto excess model. If XX has Pareto tail exponent α\alpha and threshold u≥xmu\ge x_m, then

P(X−u>y∣X>u)=(1+yu)−α.\mathbb P(X-u>y\mid X>u) = \left(1+\frac{y}{u}\right)^{-\alpha}.

This is the generalized Pareto survival function with

ξ=1α,β(u)=uα.\xi=\frac1\alpha, \qquad \beta(u)=\frac{u}{\alpha}.

The Pickands-Balkema-de Haan theorem explains why the same family appears asymptotically for a much larger class of threshold exceedances.

Formula check

A concrete choice of shape and scale illustrates both the survival and moments.

For ξ=0.4\xi=0.4 and β=2\beta=2, direct substitution gives

Gˉ(y)=(1+0.2y)−2.5,E[Y]=103,Var⁡(Y)=5009.\bar G(y)=(1+0.2y)^{-2.5},\qquad \mathbb E[Y]=\frac{10}{3},\qquad \operatorname{Var}(Y)=\frac{500}{9}.

Thus Gˉ(0)=1\bar G(0)=1, Gˉ(1)=1.2−2.5\bar G(1)=1.2^{-2.5}, Gˉ(5)=2−2.5\bar G(5)=2^{-2.5}, and Gˉ(10)=3−2.5\bar G(10)=3^{-2.5}. These are formula evaluations, with no numerical fitting or simulation.

Caveats

References

References
  1. Balkema, A. A., & de Haan, L. (1974). Residual Life Time at Great Age. The Annals of Probability, 2(5), 792–804. 10.1214/aop/1176996548
  2. Pickands, J. (1975). Statistical Inference Using Extreme Order Statistics. The Annals of Statistics, 3(1), 119–131. 10.1214/aos/1176343003
  3. Davison, A. C., & Smith, R. L. (1990). Models for Exceedances over High Thresholds. Journal of the Royal Statistical Society: Series B (Methodological), 52(3), 393–442. 10.1111/j.2517-6161.1990.tb01796.x
  4. Coles, S. (2001). An Introduction to Statistical Modeling of Extreme Values. Springer. 10.1007/978-1-4471-3675-0
  5. Embrechts, P., Klüppelberg, C., & Mikosch, T. (1997). Modelling Extremal Events. Springer. 10.1007/978-3-642-33483-2