Jump to content

Multidimensional Chebyshev's inequality

From Wikipedia, the free encyclopedia

In probability theory, the multidimensional Chebyshev's inequality[1] is a generalization of Chebyshev's inequality, which puts a bound on the probability of the event that a random variable differs from its expected value by more than a specified amount.

Let be an -dimensional random vector with expected value and covariance matrix

If is a positive-definite matrix, for any real number :

Proof

[edit]

Since is positive-definite, so is . Define the random variable

Since is positive, Markov's inequality holds:

Finally,

[1][2]

Infinite dimensions

[edit]

There is a straightforward extension of the vector version of Chebyshev's inequality to infinite dimensional settings[more refs. needed].[3] Let X be a random variable which takes values in a Fréchet space (equipped with seminorms || ⋅ ||α). This includes most common settings of vector-valued random variables, e.g., when is a Banach space (equipped with a single norm), a Hilbert space, or the finite-dimensional setting as described above.

Suppose that X is of "strong order two", meaning that

for every seminorm || ⋅ ||α. This is a generalization of the requirement that X have finite variance, and is necessary for this strong form of Chebyshev's inequality in infinite dimensions. The terminology "strong order two" is due to Vakhania.[4]

Let be the Pettis integral of X (i.e., the vector generalization of the mean), and let

be the standard deviation with respect to the seminorm || ⋅ ||α. In this setting we can state the following:

General version of Chebyshev's inequality.

Proof. The proof is straightforward, and essentially the same as the finitary version[source needed]. If σα = 0, then X is constant (and equal to μ) almost surely, so the inequality is trivial.

If

then ||Xμ||α > 0, so we may safely divide by ||Xμ||α. The crucial trick in Chebyshev's inequality is to recognize that .

The following calculations complete the proof:

References

[edit]
  1. ^ a b Marshall, Albert W.; Olkin, Ingram (December 1960). "Multivariate Chebyshev Inequalities". The Annals of Mathematical Statistics. 31 (4): 1001–1014. doi:10.1214/aoms/1177705673. ISSN 0003-4851.
  2. ^ Navarro, Jorge (2013-05-24). "A simple proof for the multivariate Chebyshev inequality". arXiv:1305.5646 [math.ST].
  3. ^ Altomare, Francesco; Campiti, Michele (1994). De Gruyter (ed.). Korovkin-type Approximation Theory and Its Applications. p. 313. doi:10.1515/9783110884586.
  4. ^ Vakhania, Nikolai Nikolaevich. Probability distributions on linear spaces. New York: North Holland, 1981.