Search for probability and statistics terms on Statlect
StatLect

Critical value

by , PhD

In a test of hypothesis, a critical value is a number that separates two regions:

  1. the critical region, that is, the set of values of the test statistic that lead to a rejection of the null hypothesis;

  2. the acceptance region, that is, the set of values for which the null is not rejected.

Table of Contents

Notation

In what follows we are going to use the following notation:

Thus, the null hypothesis is rejected if[eq1]and it is not rejected if[eq2]

Definition

Here is a formal definition.

Definition A critical value is a boundary of the acceptance region $C^{c}$.

Let us make an example.

Example If the acceptance region is the interval[eq3]then the critical region is[eq4]The critical values are the two boundaries[eq5]If, for example, the value of the test statistic is $t=0.9$, then $t$ belongs to the acceptance region and the null hypothesis is not rejected.

One-tailed tests

A test is called one-tailed if there is only one critical value $z$.

There are two cases:

  1. left-tailed test: the null is rejected only if[eq6]

  2. right-tailed test: the null is rejected only if [eq7]

The following table summarizes the two cases by using the symbols introduced above.[eq8]

How is the critical value determined in left-tailed tests?

Typically, $z$ is chosen so as to a achieve a desired size of the test.

Remember that the size is the probability of rejecting the null hypothesis when it is true. Denote it by $lpha $.

For a left-tailed test, we have[eq9]

In the majority of practical cases, the test statistic is a continuous random variable. As a consequence, the probability that it takes any specific value is equal to zero. In particular, [eq10]

Thus, we can write[eq11]where $Fleft( z
ight) $ is the cumulative distribution function (cdf) of the test statistic.

All we need to do in order to determine the critical value is to find a $z$ that solves the equation[eq12]

We explain below how to solve it.

How is the critical value determined in right-tailed tests?

Things are similar for right-tailed tests. In these tests, we have[eq13]

Thus, we need to solve the equation[eq14]

How are the equations solved?

For the most common distributions such as the normal distribution and the t distribution, the equations[eq15]and[eq16] have no analytical solution.

The reason is that the inverse of the cdf F is not known in closed form.

So, for example, we cannot compute analytically the solution of the first equation as[eq17]

However, virtually any calculator or statistical software has pre-built functions that allow us to easily solve these equations numerically.

The (old-fashioned) alternative is to look up the critical value in special tables called statistical tables. See this lecture if you want to know more about these alternatives.

Example

Let us make an example of a left-tailed test.

Suppose that the size of the test is $lpha =5%$, which means that we are happy with a 5% probability of incorrectly rejecting the null when it is true.

Suppose that our test statistic $t$ has a standard normal distribution.

Then, we need to find[eq18]where F is the cumulative distribution function of a standard normal distribution.

We are going to use a free web app called Wolfram Alpha to find $z$.

How to use the Wolfram Alpha search box to find a critical value.

Here is the result.

The critical value returned by Wolfram Alpha.

Thus, the critical value is $z=-1.64485$.

We are going to reject the null hypothesis if $t$ is less than $-1.64485$.

Two-tailed tests

A test is called two-tailed if there are two critical values $z_{1}$ and $z_{2}$ and the null hypothesis is rejected only if[eq19]

We assume without loss of generality that $z_{1}<z_{2}$.

Thus, we can add a new line to the table shown in the previous section:[eq20]

How do you find the two critical values?

As in the case of a one-tailed test (see above), also in the two-tailed case the critical values are chosen so as to achieve a pre-defined size of the test.

The size can be computed as follows:[eq21]

By making again the assumption that the test statistic is a continuous random variable, we obtain[eq22]where $Fleft( z
ight) $ is the distribution function of $t_{n}$.

How is the equation solved?

Our problem is to solve one equation in two unknowns ($z_{1}$ and $z_{2}$).

There are potentially infinite solutions to the problem because one can choose one of the two critical values at will and choose the remaining one so as to solve the equation.

There is no general rule for choosing one specific solution.

Some possibilities are to:

We do not discuss these possibilities here, but we refer the reader to Berger and Casella (2002).

We instead discuss the case in which the test statistic has a symmetric distribution. This is the most relevant case in practice because in many tests $t$ has a normal or a Student's t distribution and both of these distributions are symmetric.

Solution for symmetric distributions (practically relevant)

A distribution is symmetric (around zero) when[eq24]for any number $z$.

We can exploit this fact by making the additional assumption that the two critical values are opposite:[eq25]

Without loss of generality, we can assume[eq26]with $zgeq 0$.

It follows that the size of the test can be written as[eq27]and the equation to solve becomes[eq28]

This is an equation in one unknown ($z$) that can be solved using the methods (numeric inversion, tables, etc.) discussed in the previous section on one-tailed tests.

Summary

Everything we have said thus far is summarized by the following table.[eq29]

More details

If you want to read a more detailed exposition of the concept of critical value and of related concepts, go to the lecture entitled Hypothesis testing.

References

Berger, R. L. and G. Casella (2002) "Statistical inference", Duxbury Advanced Series.

Keep reading the glossary

Previous entry: Covariance stationary

Next entry: Cross-covariance matrix

How to cite

Please cite as:

Taboga, Marco (2021). "Critical value", Lectures on probability theory and mathematical statistics. Kindle Direct Publishing. Online appendix. https://www.statlect.com/glossary/critical-value.

The books

Most of the learning materials found on this website are now available in a traditional textbook format.