Independent Random Variables and Linear Combinations

Independent Random Variables and Linear Combinations

Junior College 2

Independent random variables

Discrete random variables \(X\) and \(Y\) are independent if the value taken by one does not affect the value taken by the other.

Joint probability

\[P(X=x\text{ and}\hspace{0.5em}Y=y)=P(X=x)P(Y=y)\]

Conditional form

\[P(X=x\mid Y=y)=P(X=x),\qquad P(Y=y\mid X=x)=P(Y=y)\]

Linear combinations

For independent \(X,Y\) and real constants \(a,b\),

Two independent variables

\[E(aX\pm bY)=aE(X)\pm bE(Y)\]\[\operatorname{Var}(aX\pm bY)=a^2\operatorname{Var}(X)+b^2\operatorname{Var}(Y)\]

If \(X_1,X_2,\ldots,X_n\) are \(n\) independent observations of \(X\), then

Sum of independent observations

\[E(X_1+\cdots+X_n)=\sum_{i=1}^{n}E(X_i)=nE(X)\]\[\operatorname{Var}(X_1+\cdots+X_n)=\sum_{i=1}^{n}\operatorname{Var}(X_i)=n\operatorname{Var}(X)\]

Scaling versus summing

The multiple \(aX\) scales the values of \(X\) by \(a\), so the data scale changes. The sum \(X_1+\cdots+X_n\) combines \(n\) independent observations of \(X\); the scale of each observation is unchanged.

Similar questions are unavailable for this question.

Need help? Join our JC Math tuition classes.

Learn more