 StatLect

# Factorization of joint probability density functions

This lecture discusses how to factorize the joint probability density function of two absolutely continuous random variables (or random vectors) and into two factors:

1. the conditional probability density function of given ;

2. the marginal probability density function of . Table of contents

## The factorization

The factorization, which has already been discussed in the lecture entitled Conditional probability distributions, is formally stated in the following proposition.

Proposition (factorization) Let be an absolutely continuous random vector with support and joint probability density function . Denote by the conditional probability density function of given and by the marginal probability density function of . Then, for any and .

## A factorization method

When we know the joint probability density function and we need to factorize it into the conditional probability density function and the marginal probability density function , we usually proceed in two steps:

1. marginalize by integrating it with respect to and obtain the marginal probability density function ;

2. divide by and obtain the conditional probability density function (of course this step makes sense only when ).

In some cases, the first step (marginalization) can be difficult to perform. In these cases, it is possible to avoid the marginalization step, by making a guess about the factorization of and verifying whether the guess is correct with the help of the following proposition.

Proposition (factorization method) Suppose there are two functions and such that

1. for any and , the following holds: 2. for any fixed , , considered as a function of , is a probability density function

Then, Proof

The proof covers the case in which and are random variables. The proof for the case in which they are random vectors is a straightforward generalization of this proof. The marginal probability density of satisfies therefore, by property 1 above: where the last equality follows from the fact that, for any fixed , , considered as a function of , is a probability density function and the integral of a probability density function over equals . Therefore, which, in turn, implies Thus, whenever we are given a formula for the joint density function and we want to find the marginal and the conditional functions, we have to manipulate the formula and express it as the product of:

1. a function of and that is a probability density function in for all values of ;

2. a function of that does not depend on .

Example Let the joint density function of and be The joint density can be factorized as follows: where and Note that is a probability density function in for any fixed (it is the probability density function of an exponential random variable with parameter ). Therefore, The book

Most of the learning materials found on this website are now available in a traditional textbook format.

Glossary entries
Share