Chapter 4
Chapter 4
CONDITIONAL PROBABILITY
AND INDEPENDENCE
Outline
2.1 Conditional Probability
3
Conditional probability …
➢ Definition
➢ The probability that B occurs given that A occurs is called the conditional
probability of B given A and is written
P( B | A)
➢ The conditional probability of B given A is the probability that an event, B,
will occur given that another event, A, has occurred
P( A B )
P( B | A) = , if P(A) 0
P ( A)
➢ Example: A fair coin is tossed two times. What is the probability that the
second coin is a head if you know that at least one head appears.
Conditional
outcome, new
sample space
(reduced)
Example: A family has two children. What is the conditional
probability that both are boys given that at least one of them is a boy?
Assume that the sample space S is given by S = {(b, b), (b, g), (g, b),
(g, g)}, and all outcomes are equally likely. (b, g) means, for
instance, that the older child is a boy and the younger child is a girl.
Solution :
• Let A be both are boys and
• B be at least one of them is a boy
P( A B )
1
1
P( A | B) = = 4=
P (B ) 3 3
4
Exercise: Let A and B are two events such that P(A Ս B) = 3/4,
P(A Ո B) = 1/4 and P(A′) = 2/3, then find P(A′/B)? Ans = 5/8.
5
The addition Rules for Probability
1. If two events A and B are mutually exclusive, then the
probability that A or B will occur is
Example: Toss a fair a coin and die together, what is the probability
of getting head on the coin if the die shows an even number.
Exercise: A box contains four black and six white balls. What is the
probability of getting two black balls in drawing one after the other
under the following conditions?
a) The first ball drawn is not replaced?
b) The first ball drawn is replaced?
9
Independent events
➢Example: A box contains four black and six white balls. Two balls are drawn
one after the other. What is the probability that the second ball drawn is black
under the following conditions?
a) The first ball drawn is not replaced.
5
9
6
10
4
9
4
10
6
9
3
4 9
b) The first ball drawn is replaced. 10
The second ball drawn is black with probability
10
Bayes' Theorem and The Total Probability Theorem
• The law of total probability: Suppose 𝐵1 , 𝐵2 , … , 𝐵𝑚 are
disjoint events such that 𝐵1 ∪ 𝐵2 ∪ … ∪ 𝐵𝑚 = 𝑆. The probability
of an arbitrary event A can be expressed as:
𝑃(𝐴) = 𝑃 𝐵1 𝑥 𝑃 𝐴/𝐵1 + 𝑃 𝐵2 𝑥 𝑃 𝐴/𝐵2 + ⋯ + 𝑃 𝐵𝑚 𝑥 𝑃 𝐴/𝐵𝑚 .
Bayes' Rule
Suppose the events 𝐵1 , 𝐵2 , … , 𝐵𝑚 are disjoint and 𝐵1 ∪ 𝐵2 ∪ … ∪ 𝐵𝑚 = 𝑆.
The conditional probability of Bi given an arbitrary event A, can be
expressed as:
𝑃 𝐵𝑖 ∩ 𝐴 𝑃 𝐵𝑖 𝑥 𝑃 𝐴/𝐵𝑖
𝑃 𝐵𝑖 /𝐴 = =
𝑃𝐴 𝑃 𝐵1 𝑥 𝑃 𝐴/𝐵1 + 𝑃 𝐵2 𝑥 𝑃 𝐴/𝐵2 + ⋯ + 𝑃 𝐵𝑚 𝑥 𝑃 𝐴/𝐵𝑚
Example 1: Box 1 contains 2 red balls and one blue ball. Box 2
contains 3 blue balls and one red ball. A coin is tossed. If it falls
heads up, Box 1 is selected and a ball is drawn. If it falls tails up, Box
2 is selected and a ball is drawn. Then find the probability of
selecting a red ball.
Example 2: A shipment of two boxes, each containing 6 telephones,
is received by a store. Box1 contains one defective phone and box 2
contains 2 defective phones. After the boxes are unpacked, a phone is
selected and found to be defective. Then find the probability that it
came from box 2