Skip to article frontmatterSkip to article content
Site not loading correctly?

This may be due to an incorrect BASE_URL configuration. See the MyST Documentation for reference.

Variance mixtures and uncertain scale

A Gaussian conditional model need not give a Gaussian marginal law. Let Z∼N(0,1)Z\sim N(0,1) and let Y>0Y>0 be independent of ZZ. We study

X=YZ,X∣Y=y∼N(0,y).X=\sqrt Y Z,\qquad X\mid Y=y\sim N(0,y).

Here YY is variance, so Y\sqrt Y is conditional standard deviation. This is the centered scalar case of the Normix normal-mixture construction. We use its shared mixing symbol YY and the notation canon. A one-observation mixture specifies no temporal dependence: volatility clustering requires a model for a sequence of mixing variables.

Which moments does mixing preserve?

For every real q>0q>0, the absolute moment factors, including infinite values:

E∣X∣q=cqE[Yq/2],cq=2q/2Γ((q+1)/2)π.\mathbb E|X|^q=c_q\mathbb E[Y^{q/2}],\qquad c_q=\frac{2^{q/2}\Gamma((q+1)/2)}{\sqrt\pi}.

We prove this identity by independence and Tonelli’s theorem applied to the nonnegative product Yq/2∣Z∣qY^{q/2}|Z|^q. In the normal integral for cqc_q, the substitution t=z2/2t=z^2/2 gives the displayed gamma integral. Thus the moment exists exactly when the mixing moment exists. Symmetry alone does not make an odd signed moment exist; absolute integrability is still required.

If 0<EY<∞0<\mathbb EY<\infty, then E∣X∣<∞\mathbb E|X|<\infty, EX=0\mathbb EX=0 and Var⁡(X)=EY\operatorname{Var}(X)=\mathbb EY. If also EY2<∞\mathbb EY^2<\infty, its Pearson kurtosis is

EX4(EX2)2=3EY2(EY)2=3(1+Var⁡(Y)(EY)2).\frac{\mathbb EX^4}{(\mathbb EX^2)^2} =3\frac{\mathbb EY^2}{(\mathbb EY)^2} =3\left(1+\frac{\operatorname{Var}(Y)}{(\mathbb EY)^2}\right).

The Gaussian reference is 3. For fixed mean variance, nonconstant YY raises kurtosis. This comparison is specific to centered normal variance mixtures; it is not an ordering of arbitrary distributions by tail risk.

Two states, finite moments

Choose equal probabilities for Y=1−aY=1-a and Y=1+aY=1+a, with 0≤a<10\le a<1. Conditioning gives variance 1 and fourth moment 3(1+a2)3(1+a^2). At a=0.6a=0.6 these are 1 and 4.08. The density is the average of two Gaussian densities. Its moment generating function (MGF) and characteristic function are

MX(t)=12e(1−a)t2/2+12e(1+a)t2/2,φX(t)=12e−(1−a)t2/2+12e−(1+a)t2/2.M_X(t)=\tfrac12e^{(1-a)t^2/2}+\tfrac12e^{(1+a)t^2/2},\qquad \varphi_X(t)=\tfrac12e^{-(1-a)t^2/2}+\tfrac12e^{-(1+a)t^2/2}.

They follow from the two conditional Gaussian transforms. They are different functions, even though the mean is zero. For a>0a>0, division by the unit-normal density ϕ(x)\phi(x) gives

fa(x)ϕ(x)∼121+aexp⁡(ax22(1+a)),∣x∣→∞.\frac{f_a(x)}{\phi(x)} \sim \frac{1}{2\sqrt{1+a}} \exp\left(\frac{ax^2}{2(1+a)}\right),\qquad |x|\to\infty.

The narrower component’s ratio tends to zero; the wider component’s ratio increases without bound. Nevertheless MX(t)M_X(t) is finite for every real tt. The mixture has more far-tail density than the unit normal and still satisfies the Cramér condition. It is not a power law. At a=1a=1 the lower state is an atom at zero and the full law no longer has a Lebesgue density.

Unequal probabilities remove the equal-weight example’s kurtosis ceiling. For a different worked case, take

P(Y=0.5)=0.99,P(Y=50.5)=0.01.P(Y=0.5)=0.99,\qquad P(Y=50.5)=0.01.

Then EY=1\mathbb EY=1, EY2=25.75\mathbb EY^2=25.75 and kurtosis is 77.25. All moments and the MGF remain finite. More generally, fixing 0<c<10<c<1 and putting probability 0<p<10<p<1 on b=[1−(1−p)c]/pb=[1-(1-p)c]/p and 1−p1-p on cc preserves EY=1\mathbb EY=1, while EY2\mathbb EY^2 diverges as p↓0p\downarrow0. Each fixed p>0p>0 still gives a finite Gaussian mixture. A rare state can make a finite moment hard to estimate without making it infinite.

Two vertically stacked plots compare unit-variance Gaussian mixtures: central densities above and two-sided log survival below.

Exact mixture densities and two-sided probabilities. All three laws have variance 1. The rare wide component is visible in the survival plot even where its contribution to central density is small. No samples or data fits are used.

Variance and precision give different laws

Three explicit constructions show why the distribution of the mixing variable matters. All parameters below are local to this section.

Gamma variance. Let YY have gamma shape k>0k>0 and scale 1/k1/k, so EY=1\mathbb EY=1. Integrating its density gives

EYr=k−rΓ(k+r)Γ(k),r>−k,MX(t)=(1−t22k)−k,∣t∣<2k.\mathbb EY^r=k^{-r}\frac{\Gamma(k+r)}{\Gamma(k)},\quad r>-k, \qquad M_X(t)=\left(1-\frac{t^2}{2k}\right)^{-k},\quad |t|<\sqrt{2k}.

For the MGF, condition on YY and integrate et2Y/2e^{t^2Y/2} against the gamma density. The integral diverges at and beyond the endpoints. All positive power moments exist, and kurtosis is 3(1+1/k)3(1+1/k). At k=1k=1, the MGF is that of a centered Laplace law with scale 1/21/\sqrt2; this law has exponential tails. The density calculation below gives the general gamma-mixture decay.

Lognormal variance. Let Y=exp⁡(τU−τ2/2)Y=\exp(\tau U-\tau^2/2), where UU is standard normal, independent of ZZ, and τ>0\tau>0. Completing the square gives

EYr=e(r2−r)τ2/2,E∣X∣q=cqeq(q−2)τ2/8.\mathbb EY^r=e^{(r^2-r)\tau^2/2},\qquad \mathbb E|X|^q=c_q e^{q(q-2)\tau^2/8}.

Every positive power moment exists, yet MX(t)=Eet2Y/2=∞M_X(t)=\mathbb E e^{t^2Y/2}=\infty for every t≠0t\ne0. To see divergence, write the expectation as an integral over uu; its exponent contains a positive multiple of eτue^{\tau u} minus u2/2u^2/2, and is eventually positive on an infinite half-line. Finite moments of every order therefore do not imply a finite MGF. Nor does this construction have a finite power-tail exponent: a regularly varying survival with finite positive exponent would force sufficiently high moments to diverge.

Gamma precision. Let Q=1/YQ=1/Y have gamma shape ν/2\nu/2 and rate ν/2\nu/2, with ν>0\nu>0. Integrating the conditional density gives

fX(x)=Γ((ν+1)/2)νπΓ(ν/2)(1+x2ν)−(ν+1)/2.f_X(x)=\frac{\Gamma((\nu+1)/2)}{\sqrt{\nu\pi}\Gamma(\nu/2)} \left(1+\frac{x^2}{\nu}\right)^{-(\nu+1)/2}.

Indeed the integrand is proportional to q(ν+1)/2−1e−(ν+x2)q/2q^{(\nu+1)/2-1}e^{-(\nu+x^2)q/2}, a gamma integral. This is Student’s tt law at unit scale. Its density is asymptotic to a positive constant times ∣x∣−ν−1|x|^{-\nu-1}; integrating that comparison gives a survival exponent α=ν\alpha=\nu. The moment identity above reduces to an integral of q(ν−q0)/2−1q^{(\nu-q_0)/2-1} near zero for moment order q0>0q_0>0, so E∣X∣q0<∞\mathbb E|X|^{q_0}<\infty exactly when q0<νq_0<\nu. For ν>2\nu>2 its variance is ν/(ν−2)\nu/(\nu-2), not 1.

These are proved model calculations. SCoFT v4 §4.2, pp. 74–75 supplies the variance-versus-precision question; it is not a claim that every stochastic volatility model produces a power law. Recursive uncertainty belongs to a later treatment and requires a specified limiting construction.

Reproduce the worked cases

Use normal_mixture_absolute_moment, normal_mixture_log_abs_survival.

import numpy as np
from xmath.incerto.finite_moments import (
    normal_mixture_absolute_moment, normal_mixture_log_abs_survival,
)

for variances, weights in (([1], [1]), ([0.5, 50.5], [0.99, 0.01])):
    m2 = normal_mixture_absolute_moment(2, variances, weights)
    m4 = normal_mixture_absolute_moment(4, variances, weights)
    tail = np.exp(normal_mixture_log_abs_survival(4, variances, weights))
    print(f"Variance / kurtosis / P(|X|>4): {m2:.4g} {m4 / m2**2:.4g} {tail:.4g}")

Output

Variance / kurtosis / P(|X|>4): 1 3 6.334e-05
Variance / kurtosis / P(|X|>4): 1 77.25 0.005735

All moments of these two finite Gaussian mixtures exist.

Figure regeneration: uv run python demos/incerto/finite_moments.py. The mixture curves use 801 central-density and 241 tail-threshold points, with the parameters above. The script also checks moment formulas and reports a bounded, seeded estimation experiment described in moment estimation. Body and shoulder geometry explains which parts of a density gain or lose under a small variance perturbation.

Variance–mean gamma calculation

The following extension permits a moving conditional mean.

For a gamma mixture, let Y∼Gamma⁡(λ,ϑ)Y\sim\operatorname{Gamma}(\lambda,\vartheta) (shape and scale) and X=γY+YZX=\gamma Y+\sqrt{Y}Z. The local parameters satisfy A>∣γ∣A>|\gamma|, λ>0\lambda>0, and ϑ=2/(A2−γ2)\vartheta=2/(A^2-\gamma^2). The helper univariate_variance_gamma(alpha, beta, lam) uses alpha for AA, beta for γ\gamma, and lam for λ\lambda; its alpha is not the Pareto exponent. Conditioning and the gamma MGF give

MX(t)=(1−ϑγt−12ϑt2)−λ,−A−γ<t<A−γ,M_X(t)=\left(1-\vartheta\gamma t-\tfrac12\vartheta t^2\right)^{-\lambda}, \qquad -A-\gamma<t<A-\gamma,
E[X]=γλϑ,Var⁡(X)=λϑ(1+γ2ϑ).\mathbb E[X]=\gamma\lambda\vartheta,\qquad \operatorname{Var}(X)=\lambda\vartheta(1+\gamma^2\vartheta).

The interval follows by solving the positive-quadratic-base inequality. The variance follows from conditional variance plus the variance of the conditional mean. For x≠0x\ne0, integrating the conditional Gaussian density against the gamma density gives

f(x)=(A2−γ2)λ∣x∣λ−1/2Kλ−1/2(A∣x∣)π Γ(λ)(2A)λ−1/2eγx.f(x)=\frac{(A^2-\gamma^2)^\lambda |x|^{\lambda-1/2} K_{\lambda-1/2}(A|x|)}{\sqrt\pi\,\Gamma(\lambda)(2A)^{\lambda-1/2}} e^{\gamma x}.

To obtain this expression, substitute ν=λ−1/2\nu=\lambda-1/2, a=x2/2a=x^2/2, b=A2/2b=A^2/2 in the Bessel integral ∫0∞yν−1e−a/y−by dy=2(a/b)ν/2Kν(2ab)\int_0^\infty y^{\nu-1}e^{-a/y-by}\,dy =2(a/b)^{\nu/2}K_\nu(2\sqrt{ab}) for a,b>0a,b>0. The standard Bessel asymptotic Kν(z)∼π/(2z)e−zK_\nu(z)\sim\sqrt{\pi/(2z)}e^{-z} then gives right and left density decay rates A−γA-\gamma and A+γA+\gamma, each with a power factor ∣x∣λ−1|x|^{\lambda-1}. These are exponential tails, not regularly varying ones. The integral representation and special-function asymptotics are used as standard identities, not proved here DLMF 10.32.10 and DLMF 10.40.2.

At the origin, the same density integral is a gamma integral when λ>1/2\lambda>1/2, giving

f(0)=(A2−γ2)λΓ(λ−1/2)2π Γ(λ)A2λ−1.f(0)=\frac{(A^2-\gamma^2)^\lambda\Gamma(\lambda-1/2)} {2\sqrt\pi\,\Gamma(\lambda)A^{2\lambda-1}}.

For smaller shapes it diverges: the Bessel limits give a logarithmic singularity at λ=1/2\lambda=1/2 and an integrable power singularity below it. Here the small-argument Bessel limits are cited from DLMF 10.30.2–3. The symmetric case γ=0\gamma=0, λ=1\lambda=1 reduces to the Laplace density (A/2)e−A∣x∣(A/2)e^{-A|x|}. The general family relationships remain in the Normix family tour.

References

References
  1. Taleb, N. N. (2025). Statistical Consequences of Fat Tails (3rd ed.). https://arxiv.org/abs/2001.10488v4