Search
STATLECT > Asymptotic theory

Relations between modes of convergence

In the previous lectures, we have introduced several notions of convergence of a sequence of random variables (also called modes of convergence). There are several relations between the various modes of convergence, which are discussed below and are summarized by the following diagram (an arrow denotes implication in the arrow's direction):[eq1].

Almost sure convergence implies convergence in probability

If a sequence of random variables [eq2] converges almost surely to a random variable X, then [eq2] also converges in probability to X.

nav_button Proof

See e.g.: Resnick, S.I. (1999) "A Probability Path", Birkhauser.

Convergence in probability implies convergence in distribution

If a sequence of random variables [eq2] converges in probability to a random variable X, then [eq2] also converges in distribution to X.

nav_button Proof

See, for example, Resnick, S.I. (1999) "A Probability Path", Birkhauser.

Almost sure convergence implies convergence in distribution

If a sequence of random variables [eq2] converges almost surely to a random variable X, then [eq2] also converges in distribution to X.

nav_button Proof

This is obtained putting together the previous relations (almost sure convergence implies convergence in probability, which in turn implies convergence in distribution).

Mean square convergence implies convergence in probability

If a sequence of random variables [eq2] converges in mean square to a random variable X, then [eq2] also converges in probability to X.

nav_button Proof

We can apply Markov inequality to a generic term of the sequence [eq10]:[eq11]for any strictly positive real number $c$. Taking the square root of both sides of the left-hand inequality, we obtain:[eq12]Taking limits on both sides, we get:[eq13]where we have used the fact that, by the very definition of convergence in mean square:[eq14]Since, by the very definition of probability, it must be that:[eq15]then it must be that also:[eq16]Note that this holds for any arbitrarily small $c$. By the definition of convergence in probability, this means that X_n converges in probability to X (if you are wondering about strict and weak inequalities here and in the definition of convergence in probability, note that [eq17] implies [eq18] for any strictly positive $ arepsilon <c$).

Mean square convergence implies convergence in distribution

If a sequence of random variables [eq2] converges in mean square to a random variable X, then [eq2] also converges in distribution to X.

nav_button Proof

This is obtained putting together the previous relations (mean square convergence implies convergence in probability, which in turn implies convergence in distribution).

by
About | Contacts | Privacy and terms of use | Sitemap