Search for probability and statistics terms on Statlect
StatLect

Alternative hypothesis

by , PhD

In a statistical test, observed data is used to decide whether or not to reject a restriction on the data-generating probability distribution.

The assumption that the restriction is true is called null hypothesis, while the statement that the restriction is not true is called alternative hypothesis.

A correct specification of the alternative hypothesis is essential to decide between one-tailed and two-tailed tests.

Table of Contents

Notation

Usually, the null hypothesis is denoted by $H_{0}$, while the alternative hypothesis is denoted by $H_{1}$.

Mathematical setting

In order to fully understand the concept of alternative hypothesis, we need to remember the essential elements of a statistical inference problem:

A couple of simple examples follow.

Example If we assume that the data are drawn from a normal distribution, then the statistical model $Phi $ is the set of all normal distributions.

Example Suppose that the data are extracted from a distribution with unit variance. Then $Phi $ is the set of all probability distributions that have unit variance.

Definition

When we conduct a statistical test, we formulate a null hypothesis as a restriction on the statistical model.

Denote by F the true data-generating distribution.

The null hypothesis can be expressed as[eq1]where $Phi _{R}$ is a subset of $Phi $.

The alternative hypothesis is

[eq2]where[eq3]is the complement of $Phi _{R}$, that is, the subset of $Phi $ that comprises all the distributions not belonging to $Phi _{R}$.

The set of all possible data-generating distributions is partitioned into three sets: the null, the alternative and a residual set.

Example

Let the statistical model $Phi $ be the set of all normal distributions.

The null hypothesis is that the mean mu of the data-generating distribution is positive.

Then $Phi _{R}$ is the set of all normal distributions with positive mean.

For simplicity, we write the null hypothesis as[eq4]

It follows that $Phi _{R}^{c}$ is the set of all normal distributions with strictly negative mean.

We write the alternative hypothesis as[eq5]

The set of all possible data-generating distributions is partitioned into three sets: normal distributions with weakly positive mean, normal distributions with strictly negative mean, and non-normal distributions.

Choice between one-tailed and two-tailed tests

The alternative hypothesis is used to decide whether a test should be one-tailed or two-tailed.

The critical region

The null hypothesis is rejected if the test statistic falls within a critical region that has been chosen by the statistician.

The critical region is a set of values that may comprise:

The choice of the critical region depends on the alternative hypothesis. Let us see why.

The interpretation of the rejection

Usually, when the test statistic falls within the critical region, the rejection of the null hypothesis is clearly interpreted as evidence that the data-generating distribution F comes from a set of distributions $Phi _{I} $ that is disjoint from $Phi _{R}$ (remember that [eq6]). The subscript I stands for interpretation.

The interpretation is different depending on the tail of the distribution in which the test statistic falls.

Example Consider a test of hypothesis for the mean of a normal distribution, where we test $H_{0}:mu =0$. The test statistic is the z-statistic[eq7]where $widehat{mu }$ is the sample mean, sigma^2 is the variance of the distribution and n is the sample size. If we run a two-tailed test with critical value $z>0$, the critical region $C$ is the union of the right and left tails of the distribution of $Z_{n}$:[eq8]The test statistic falls in the right tail (i.e., $Z_{n}>z$) when the sample mean $widehat{mu }$ is much larger than zero. In this case, the rejection of the null hypothesis is interpreted as evidence that, most likely, $mu >0$; the set of distributions $Phi _{I}$ is the set of all normal distributions with strictly positive mean.

The interpretation must be coherent with the alternative hypothesis

The choice between a one-tailed or a two-tailed test needs to be done in such a way that the interpretation of a rejection is always coherent with the alternative hypothesis.

In other words, we must ensure that[eq9]

Example As in the previous example, consider a test about the mean of a normal distribution, where we test $H_{0}:mu =0$. Suppose that we exclude a priori that mu can be negative. In other words, the statistical model $Phi $ includes all the normal distributions with mean $mu geq 0$. It follows that $Phi _{R}^{c}$ includes all the normal distributions with $mu >0$ and the alternative hypothesis is $H_{1}:mu >0$. Can we use a two-tailed z-test? No because if the sample mean is much lower than zero and the test statistic falls within the left tail, then the interpretation is that, most likely, $mu <0$. But this was excluded a priori in the formulation of the statistical model. Thus, the interpretation would be incoherent with the alternative hypothesis: $Phi _{I}$ would not be included in $Phi _{R}^{c}$. As a consequence, we need to perform a one-tailed test, in which the critical region includes only the right tail.

Power function

When we deal with the power function of a test, the term "alternative hypothesis" has a special meaning.

Suppose that we are conducting a test about a parameter mu, in which the null hypothesis is [eq10]

The power function [eq11] is a function that gives, for any mu, the probability of rejecting $H_{0}$ when the true parameter is equal to mu.

The argument mu is often called alternative hypothesis and [eq12] is called power against the alternative mu.

Accepting the alternative

We conclude with a caveat about the interpretation of the outcome of a test of hypothesis.

The interpretation of a rejection of the null is controversial.

According to some statisticians, rejecting the null is equivalent to accepting the alternative.

However, others deem that rejecting the null does not necessarily imply accepting the alternative. In fact, it is possible to think of situations in which both hypotheses can be rejected. Let us see why.

According to the conceptual framework illustrated by the images above, there are three possibilities:

  1. the null is true;

  2. the alternative is true;

  3. neither the null nor the alternative is true because the true data-generating distribution has been excluded from the statistical model (we say that the model is mis-specified).

If we are in case 3, accepting the alternative after a rejection of the null is an incorrect decision. Moreover, a second test in which the alternative becomes the new null may lead us to another rejection.

There are three cases, including one case in which it is incorrect to accept the alternative hypothesis after a rejection of the null.

More details

You can find more details about the alternative hypothesis in the lecture on Hypothesis testing.

Keep reading the glossary

Previous entry: Almost sure

Next entry: Binomial coefficient

How to cite

Please cite as:

Taboga, Marco (2021). "Alternative hypothesis", Lectures on probability theory and mathematical statistics. Kindle Direct Publishing. Online appendix. https://www.statlect.com/glossary/alternative-hypothesis.

The books

Most of the learning materials found on this website are now available in a traditional textbook format.