Probability MT22, Expectations


Flashcards

Discrete random variables

@Define the expectation $\mathbb{E}[X]$ of a discrete random variable $X$.

\[\sum _ {x \in \mathrm{Im} X} x\mathbb{P}(X = x)\]

How can you think about the formula

\[\mathbb{E}[X] = \sum _ {x \in \mathrm{Im} X} x\mathbb{P}(X = x)\]

?

Weighting the possible values of $x$ by their probability.

What’s a trick for finding $\mathbb{E}[X^2]$ if you know $\mathbb{E}[X]$ and $\mathrm{var}(X)$?

\[\mathbb{E}[X^2] = \mathrm{var}(X) + \mathbb{E}[X]^2\]

@State the formula for $\mathbb{E}[Y]$ where $Y := h(X)$, $h : \mathbb{R} \to \mathbb{R}$, and $X$ is a discrete random variable.

\[\sum _ {x \in \mathrm{Im} X} h(x)\mathbb{P}(X = x)\]

Suppose $h : \mathbb R \to \mathbb R$ and $X$ is a discrete random variable. @Prove that (∆expectation-of-function-of-rv)

\[\mathbb E[h(X)] = \sum _ {x \in \mathrm{Im} X} h(x) \mathbb{P}(X = x)\]

@todo (probability, page 19).

@important~

@Define the conditional expectation $\mathbb{E}[X \vert B]$ of a discrete random variable $X$ given an event $B$.

\[\sum _ {x \in \mathrm{Im} X} x\mathbb{P}(X = x \vert B)\]

@State the formula for $\mathbb{E}[h(X, Y)]$ for discrete random variables $X, Y$ with joint p.m.f. $p _ {X,Y}$.

\[\sum _ {x \in \mathrm{Im} X}\sum _ {y \in \mathrm{Im} Y} h(x, y) p _ {X,Y}(x, y)\]

How can you rewrite $\mathbb{E}[aX + bY]$?

\[a \mathbb{E}[X] + b\mathbb{E}[Y]\]

How can you prove the linearity of expectation $\mathbb{E}[\alpha X + \beta Y] = \alpha\mathbb{E}[X] + \beta\mathbb{E}[Y]$?

Take $h(x, y) = \alpha x + \beta y$ in ∆expectation-of-function-of-two-rvs.

@Prove that if $X$ is a discrete random variable and $\mathbb E[X]$ exists, then

  • If $X$ non-negative, then $\mathbb E[X] \ge 0$
  • If $a, b \in \mathbb R$ then $\mathbb E[aX + b] = a\mathbb E[X] + b$

@todo (probability, page 20).

@Prove the partition theorem for expectations (∆partition-theorem-for-expectations): suppose $B _ 1, B _ 2, \ldots$ is a partition of $\Omega$ such that $\mathbb P(B _ i) > 0$ for all $i \ge 1$. Then for a discrete random variable $X$,

\[\mathbb E[X] = \sum _ {i \ge 1} \mathbb E[X \vert B _ i] \mathbb P(B _ i)\]

@todo (probability, page 21).

@important~

Suppose $X$ and $Y$ are discrete random variables and $a, b \in \mathbb R$ are constants. @Prove that (∆linearity-of-expectation)

\[\mathbb E[aX + bY] = a \mathbb E[X] + b \mathbb E[Y]\]

@todo (probability, page 24).

@important~

@Prove that if $X$ and $Y$ are independent discrete random variables whose expectations exist, then (∆independent-product-expectation)

\[\mathbb E[XY] = \mathbb E[X] \mathbb E[Y]\]

@todo (probability, page 25).

@important~

Continuous random variables

@Define the expectation $\mathbb{E}[X]$ of a continuous random variable $X$ with density function $f _ X$.

\[\mathbb{E}[X] = \int^\infty _ {-\infty} xf _ X(x)\, \mathrm{d}x\]

@State the formula for $\mathbb{E}[h(X)]$ for a continuous random variable $X$ with PDF $f _ X$ and $h:\mathbb{R} \to \mathbb{R}$ (provided the absolute version converges).

\[\int^\infty _ {-\infty} h(x) f _ X(x)\, \mathrm{d}x\]

For a continuous random variable $X$ with PDF $f _ X$, and $h:\mathbb{R} \to \mathbb{R}$, what condition is there for $\mathbb{E}[h(X)]$ to exist?

\[\int^\infty _ {-\infty} \vert h(x) \vert f _ X(x)\, \mathrm{d}x \text{ converges}\]

If $X \ge 0$ and $X$ is a continuous random variable, then what is an equivalent definition of the expectation $\mathbb{E}[X]$ using $\mathbb P(X > x)$?

\[\int^\infty _ 0 \mathbb P(X > x)\, \mathrm{d}x\]

@Prove that for a non-negative continuous random variable $Z$ (∆continuous-tail-sum-expectation),

\[\mathbb{E}[Z] = \int _ 0^\infty \mathbb P(Z \ge z)\, \mathrm{d}z\]

@todo.

Suppose that $X$ is a continuous random variable with p.d.f. $f _ X$. @Prove that if $a, b \in \mathbb R$, $\mathbb E[aX + b] = a\mathbb E[X] + b$ and $\mathrm{var}(aX + b) = a^2 \mathrm{var}(X)$.

@todo (probability, page 54).