Skip to article frontmatterSkip to article content
Site not loading correctly?

This may be due to an incorrect BASE_URL configuration. See the MyST Documentation for reference.

Cramér Exponential-Moment Condition

Statement

A random variable XX satisfies a right-tail Cramér condition when there is some θ>0\theta>0 such that

E[eθX]<∞.\mathbb E[e^{\theta X}]<\infty.

For two-sided large-deviation statements, one usually asks for the moment generating function M(θ)=E[eθX]M(\theta)=\mathbb E[e^{\theta X}] to be finite in an open neighborhood of 0. Equivalently, the cumulant generating function Λ(θ)=log⁡E[eθX]\Lambda(\theta)=\log \mathbb E[e^{\theta X}] is finite near zero, and the Cramér rate function is

I(x)=sup⁡θ{θx−Λ(θ)}.I(x)=\sup_\theta\{\theta x-\Lambda(\theta)\}.

We use the one-sided version when the question is upper-tail concentration; the classical two-sided Cramér large-deviation theorem requires stronger mgf control.

The condition gives the elementary Chernoff bound

P(X>x)≤e−θxE[eθX],\mathbb P(X>x)\le e^{-\theta x}\mathbb E[e^{\theta X}],

so the upper-tail probability is bounded above by an exponentially decaying function. Equivalently, Fˉ(x)=O(e−θx)\bar F(x)=O(e^{-\theta x}) for that value of θ\theta.

Here Fˉ(x)=P(X>x)\bar F(x)=\mathbb P(X>x) is the survival function, E\mathbb E is expectation, and θ\theta is the exponential-tilting parameter. All symbols needed here are defined locally; see also Shared notation.

Thin-tail intuition

The Cramér condition is a thin-tail gate. If exponential moments exist, then exponential tilting, Chernoff bounds, and classical large-deviation rates have room to operate. If no positive exponential moment exists, those tools may give a false sense of security.

This is the clean contrast with Pareto-type fat tails. A regularly varying tail can have many finite ordinary moments, but multiplying by eθXe^{\theta X} eventually overwhelms every power-law decay. Failure of the Cramér condition does not require infinite variance: it can also occur when both the mean and variance are finite.

Chernoff bound and examples

We prove the displayed Chernoff bound from Markov’s inequality. The right-tail and two-sided Cramér conditions are definitions or standard large-deviation hypotheses; the larger Cramér theorem is cited rather than proved here. The normal, exponential, and Pareto cases below are direct checks of the condition.

The Chernoff bound follows from Markov’s inequality applied to the nonnegative random variable eθXe^{\theta X}:

P(X>x)=P(eθX>eθx)≤e−θxE[eθX].\mathbb P(X>x) = \mathbb P(e^{\theta X}>e^{\theta x}) \le e^{-\theta x}\mathbb E[e^{\theta X}].

A standard normal random variable satisfies the two-sided version because E[eθX]=eθ2/2\mathbb E[e^{\theta X}]=e^{\theta^2/2} for all real θ\theta. An exponential random variable with rate λ>0\lambda>0 has mgf λ/(λ−θ)\lambda/(\lambda-\theta) for θ<λ\theta<\lambda, so it also satisfies the two-sided neighborhood condition. Its positive exponential moments exist exactly for 0<θ<λ0<\theta<\lambda.

For a Pareto Type I random variable,

E[eθX]=∫xm∞eθxαxmαx−(α+1) dx.\mathbb E[e^{\theta X}] = \int_{x_m}^{\infty} e^{\theta x}\alpha x_m^\alpha x^{-(\alpha+1)}\,dx.

For every θ>0\theta>0, the exponential factor dominates the polynomial decay, so the integral diverges. Thus Pareto tails fail the right-tail Cramér condition for every positive θ\theta.

Truncated exponential moment check

For an exponential variable of rate λ\lambda and c≥0c\ge0,

E[eθX1{X≤c}]=λλ−θ(1−e−(λ−θ)c),0<θ<λ.\mathbb E[e^{\theta X}\mathbf 1_{\{X\le c\}}] =\frac{\lambda}{\lambda-\theta} \left(1-e^{-(\lambda-\theta)c}\right), \qquad 0<\theta<\lambda.

For example, λ=1\lambda=1 and θ=0.12\theta=0.12 give a finite limit 1/0.88≈1.136361/0.88\approx1.13636 as c→∞c\to\infty.

For Pareto Type I with α>0\alpha>0, every θ>0\theta>0 instead gives a lower bound that diverges. For c≥2xmc\ge2x_m, retain only the interval (c/2,c](c/2,c]:

E[eθX1{X≤c}]≥eθc/2P(c/2<X≤c)=(2α−1)(xmc)αeθc/2⟶∞.\begin{aligned} \mathbb E[e^{\theta X}\mathbf 1_{\{X\le c\}}] &\ge e^{\theta c/2}\mathbb P(c/2<X\le c)\\ &=(2^\alpha-1)\left(\frac{x_m}{c}\right)^\alpha e^{\theta c/2}\longrightarrow\infty. \end{aligned}

These are population calculations, independent of simulation. Even a Pareto law with α=2.5\alpha=2.5, finite mean, and finite variance has no positive exponential moment.

Caveats

References

References
  1. Embrechts, P., Klüppelberg, C., & Mikosch, T. (1997). Modelling Extremal Events. Springer. 10.1007/978-3-642-33483-2