Sampling Distributions
Chebyshev's inequalities give a significant information about the bounds of a random variable with respect to its mean. They play an important role in the proof of the weak law of large numbers or law of averages. They are named after the famous Russian mathematician Pafnuty Chebyshev (1821--1894). div id="theorem1" class="theorem"> Theorem (Chebyshev): : Let X be a random variable with a finite mean μ and standard deviation σ. Then for any positive number a,
\[ \Pr \left[ | X- \mu | \ge a \right] \le \frac{\sigma^2}{a^2} . \]
When a = kσ, the inequality can be written in the equivalent form:
\[ \Pr \left[ | X- \mu | \ge k\sigma \right] \le \frac{1}{k^2} . \]
   ▣
When we need to distinguish the above inequality and a host of othehr similar ones, it is common to call it the Chebyshev--Bienaymé inequality because the French mathematician Irénée-Jules Bienaymé (1796--1878) was the first to circulate this result, but he was publically acknowledged by P. Chebyshev prior to the publication. div id="theorem2" class="theorem"> Theorem (One-sided Chebyshev's inequality): : Let X be a random variable with a finite mean μ and standard deviation σ. Then for any positive constant ε,
\[ \Pr \left[ X \ge \mu + \varepsilon \right] \le \frac{\sigma^2}{\sigma^2 + \varepsilon^2} , \qquad \Pr \left[ X \le \mu - \varepsilon \right] \le \frac{\sigma^2}{\sigma^2 + \varepsilon^2} . \]
   ▣

 

  1. Kotiah, T.C.T., Chebyshev's inequality and the law of large numbers, International Journal of Mathematical Education in Science and Technology, 1994, Vol. 25, No. 3, pp. 389--398; http://doi.org/10.1080/0020739940250310