Discrete probability distribution

From Includipedia, the inclusionist encyclopedia

The probability mass function of a discrete probability distribution. The probabilities of the singletons {1}, {3}, and {7} are respectively 0.2, 0.5, 0.3. A set not containing any of these points has probability zero.

Image:Discrete probability distribution illustration.png

From top to bottom, the cumulative distribution function of a discrete probability distribution, continuous probability distribution, and a distribution which has both a continuous part and a discrete part.

In probability theory, a probability distribution is called discrete if it is characterized by a probability mass function. Thus, the distribution of a random variable X is discrete, and X is then called a discrete random variable, if

as u runs through the set of all possible values of X.

If a random variable is discrete, then the set of all values that it can assume with non-zero probability is finite or countably infinite, because the sum of uncountably many positive real numbers (which is the smallest upper bound of the set of all finite partial sums) always diverges to infinity.

Typically, this set of possible values is a topologically discrete set in the sense that all its points are isolated points. But, there are discrete random variables for which this countable set is dense on the real line.

The Poisson distribution, the Bernoulli distribution, the binomial distribution, the geometric distribution, and the negative binomial distribution are among the most well-known discrete probability distributions.

[edit] Alternative description

Equivalently to the above, a discrete random variable can be defined as a random variable whose cumulative distribution function (cdf) increases only by jump discontinuities — that is, its cdf increases only where it "jumps" to a higher value, and is constant between those jumps. The points where jumps occur are precisely the values which the random variable may take. The number of such jumps may be finite or countably infinite. The set of locations of such jumps need not be topologically discrete; for example, the cdf might jump at each rational number.

[edit] Representation in terms of indicator functions

For a discrete random variable X, let u₀, u₁, ... be the values it can assume with non-zero probability. Denote

<math>\Omega_i=\{\omega: X(\omega)=u_i\},\, i=0, 1, 2, \dots</math>

These are disjoint sets, and by formula (1)

<math>\Pr\left(\bigcup_i \Omega_i\right)=\sum_i \Pr(\Omega_i)=\sum_i\Pr(X=u_i)=1.</math>

It follows that the probability that X assumes any value except for u₀, u₁, ... is zero, and thus one can write X as

<math>X=\sum_i \alpha_i 1_{\Omega_i}</math>

except on a set of probability zero, where <math>\alpha_i=\Pr(X=u_i)</math> and <math>1_A</math> is the indicator function of A. This may serve as an alternative definition of discrete random variables.