The precision matrix of a random vector is the inverse of its covariance matrix.

The precision matrix is sometimes called **concentration
matrix**.

The following is a precise definition.

Definition Let be a random vector. Let be its covariance matrix:If is invertible, then the precision matrix of is the matrix defined as

When is a random variable (), then the precision matrix becomes a scalar and it is equal to the reciprocal of the variance of . In this case, it is often denoted by the lowercase letter :and it is simply called the precision of .

Thus, in the univariate case precision is inversely proportional to variance: when variance tends to infinity, we have zero precision; on the contrary, when variance tends to zero, we have infinite precision.

The joint probability density function of a multivariate normal random vector is often written in terms of its precision matrix.

If has a multivariate normal distribution with mean and covariance matrix , then its joint probability density function is

By using the precision matrix, this can be written asbecause, by elementary properties of the determinant, we have that

In the univariate case, when is a normal random variable with mean and variance , the densitybecomes

Parametrizing a normal density in terms of its precision matrix often has significant advantages. For example, it can simplify the algebra of calculations involving normal densities. Or, when the values of a multivariate normal density need to be computed several times by numerical methods, employing the precision matrix can spare the computationally burdensome task of performing several matrix inversions to calculate .

You can read more details about covariance matrices in the lecture entitled Covariance matrix.

Previous entry: Power function

Next entry: Prior probability

The book

Most learning materials found on this website are now available in a traditional textbook format.

Featured pages

- Bayes rule
- Binomial distribution
- Maximum likelihood
- Mean square convergence
- Moment generating function
- Wishart distribution

Explore

Main sections

- Mathematical tools
- Fundamentals of probability
- Probability distributions
- Asymptotic theory
- Fundamentals of statistics
- Glossary

About

Glossary entries

- Binomial coefficient
- Continuous random variable
- Discrete random variable
- Factorial
- Estimator
- Alternative hypothesis

Share