Statistics Chapter 2 (1)
Statistics Chapter 2 (1)
2. Elementary probability
2.1 Introduction
✓ Probability (p): Is a numerical description of chance occurrence of a given phenomenon under a
certain condition. It is used to measure the degree of certainty.
2.2 Definition of some probability terms
Random (Probability) Experiment: It is an experiment that can be repeated any number of times under
similar conditions and it is possible to enumerate the total number of outcomes without predicting an
individual outcome.
✓ Example 1: If a fair die is rolled once it is possible to list all the possible outcomes i.e.
1, 2, 3, 4, 5, 6 but it is not possible to predict which outcome will occur.
✓ Example 2: Tossing a coin two times and observing the no of heads appearing on the top.
An outcome: is the result of a single trial of a random experiment.
✓ Example: when a coin is tossed once, there are two possible outcomes i.e. head (H) & tail (T).
Sample space (S): is a set of all possible outcomes of a random experiment.
▪ Example 1: Rolling a die: 𝑆 = {1, 2, 3, … ,6},
▪ Example 2: Tossing a coin once: 𝑆 = {𝐻, 𝑇}.
▪ Example 3: Tossing a coin twice: 𝑆 = {𝐻𝐻, 𝐻𝑇, 𝑇𝐻, 𝑇𝑇}.
Ingeneral, 𝑆 = (𝒏𝒐 𝒐𝒇 𝒐𝒖𝒕𝒄𝒐𝒎𝒆)𝒏 , 𝑤ℎ𝑒𝑟𝑒 𝑛 𝑖𝑠 number of trials.
Event : Is a subset of sample space. It is a statement of one or more outcomes of a random experiment.
They are denoted by capital letters.
✓ Example: Getting an odd numbers in rolling a die.
Solution: Let 𝐴 − is an event of getting odd numbers. Then 𝐴 = {1, 3, 5}.
Complement of an event: The complement of an event A means non- occurrence of A and is denoted
by 𝐴′ which contains those points of the sample space which don’t belong to A.
Example: a) Find the complement of an event of getting odd numbers in rolling a die.
b) If tossing two coins and getting all heads.
Solution: a) Let 𝐴 − is an event of getting odd numbers in rolling a die.
→≫ 𝐴 = {1, 3, 5} ; 𝑡ℎ𝑒𝑛 𝐴′ = {2,4,6}, 𝑵𝒐𝒕𝒆: 𝐴 ∪ 𝐴′ = 𝑆.
b) Let 𝐵 − be an event of getting all heads in tossing two coins.
𝐵 = {𝐻𝐻} ; 𝑡ℎ𝑒𝑛 𝐵 ′ = {𝐻𝑇, 𝑇𝐻, 𝑇𝑇}, 𝑁𝑜𝑡𝑒: 𝐵 ∪ 𝐵 ′ = 𝑆.
Mutually exclusive events: Two events which cannot happen at the same time.
Equally likely events: Events that have the same probability of occurring.
✓ Example: when a single die is rolled, each outcome has the same probability of occurrence 1/6.
Example 2: The digits 0, 1, 2, 3 𝑎𝑛𝑑 4 are to be used in a 4 − 𝑑𝑖𝑔𝑖𝑡 𝐼𝐷 𝑐𝑎𝑟𝑑. How many different
cards are possible if
(a) Repetitions are permitted? b) Repetitions are not permitted?
Solution: 1st digit 2nd digit 3rd digit 4th digit
𝒏! = 𝒏 ∗ (𝒏 − 𝟏) ∗ (𝒏 − 𝟐) ∗, … , 𝟑 ∗ 𝟐 ∗ 𝟏. 𝑁𝑜𝑡𝑒: 1! = 1 𝑎𝑛𝑑 0! = 1.
3. The number of permutations of n objects in which 𝒌𝟏 are alike (the same), 𝒌𝟐 are alike, ... etc, then the
total number of arrangements is
𝒏!
𝑇𝑜𝑡𝑎𝑙 𝑛𝑢𝑚𝑏𝑒𝑟 𝑜𝑓 𝑎𝑟𝑟𝑎𝑛𝑔𝑒𝑚𝑒𝑛𝑡𝑠 = ; 𝑤ℎ𝑒𝑟𝑒: 𝑘1 + 𝑘2 + 𝑘3 + ⋯ + 𝑘𝑝 = 𝑛.
𝒌𝟏 ! ∗ 𝒌𝟐 ∗ 𝒌𝟑 ∗ … ∗ 𝒌𝒑
Example 1: In how many ways can the letters 𝐴, 𝐵 𝑎𝑛𝑑 𝐶 be arranged taken two at a time.
3! 3×2×1
𝑛 = 3, 𝑟 = 2; =≫ 𝑛𝑃𝑟 = 3𝑃2 = (3−2)! = = 6. i. e. AB, AC, BA, BC, CA, CB.
1!
Exercise: If 3 books are picked at random from a shelf containing 5 novels, 3 books of poems, and a
dictionary, then what is the probability that
a. The dictionary is selected? b. 2 novels and 1 book of poems are selected?
2. The Frequents Approach (Empirical Probability):
S A' S
S
A B
A B A
AUBA
A∪B A∩B
Example 3: A card is drawn from an ordinary deck and its number noted. Then it is not replaced. A second
card is drawn and its number noted, then find the probability of:
a) Getting two Jacks (J). b) Getting an ace ( A) and a king (K) in order.
c) Getting a flower and a spade. d) Getting a red and a black in order.
4 3 12
Solution: a) 𝑃(𝐽𝑎𝑐𝑘 𝑎𝑛𝑑 𝐽𝑎𝑐𝑘) = 𝑃(𝐽𝑎𝑐𝑘 ∩ 𝐽𝑎𝑐𝑘) = 𝑃(𝐽𝑎𝑐𝑘) 𝑥 𝑃(𝐽𝑎𝑐𝑘/𝐽𝑎𝑐𝑘) = 52 𝑥 51 = 2802 .
4 4 16
b) 𝑃(𝑎𝑐𝑒 𝑎𝑛𝑑 𝑘𝑖𝑛𝑔) = 𝑝(𝑎𝑐𝑒 ∩ 𝑘𝑖𝑛𝑔) = 𝑃(𝑎𝑐𝑒) 𝑥 𝑃(𝐾𝑖𝑛𝑔/𝐴𝑐𝑒) = 52 𝑥 51 = 2802.
13 13 169
c. 𝑃(𝑓𝑙𝑜𝑤𝑒𝑟 𝑎𝑛𝑑 𝑠𝑝𝑎𝑑𝑒) = 𝑃(𝑓𝑙𝑜𝑤𝑒𝑟 ∩ 𝑠𝑝𝑎𝑑𝑒) = 𝑃(𝑓𝑙𝑜𝑤𝑒𝑟) 𝑥 𝑃(𝑆𝑝𝑎𝑑𝑒/𝑓𝑙𝑜𝑤𝑒𝑟) = 52 𝑥 51 = 2802.
Lecture Notes Compiled By Belete M (As. Prof.) Page 8
INU Stat Dept Statistics for Land Administration Chapter - 2
26 26 676
d) 𝑃(𝑟𝑒𝑑 𝑎𝑛𝑑 𝑏𝑙𝑎𝑐𝑘) = 𝑃(𝑟𝑒𝑑 ∩ 𝑏𝑙𝑎𝑐𝑘) = 𝑃(𝑟𝑒𝑑) 𝑥 𝑃(𝑏𝑙𝑎𝑐𝑘/𝑟𝑒𝑑) = 52 𝑥 51 = 2802 .
Exercise : If the probabilities are 0.75, 0.7 and 0.525 that a student A, B, or both can solve the problems in a
text book respectively. What is the probability that:
a) Student A can only solve the problem selected at random from the book?
b) Student B can only solve the problem selected at random from the book?
Solution:
a) A B 𝐴 ∩ 𝐵′ b) A𝐴′ ∩BB 𝑨′ ∩ 𝑩
▪ The conditional probability of event A occurring, given that event B has already occurred, can be
found by:
𝑃(𝐴∩𝐵)
✓ 𝑃(𝐴/𝐵) = , 𝑖𝑓 𝑃(𝐵) ≠ 0.
𝑃(𝐵)
𝐵1 𝐵2
b1 A vBd
𝐴 ∩ 𝐵1 𝐴 ∩ 𝐵2
𝐴 ∩ 𝐵5 𝐴 ∩ 𝐵3
B3 𝐵3
𝐴 ∩ 𝐵4
𝐴𝐴 ∩ 𝐵1 ∩ 𝐵1 S=B
𝐵5 𝐵4 S
𝐴 ∩ 𝐵1
Bayes' Rule: Suppose the events 𝐵1 , 𝐵2 , … , 𝐵𝑚 are disjoint and 𝐵1 ∪ 𝐵2 ∪ … ∪ 𝐵𝑚 = 𝑆. The conditional
probability of 𝐵𝑖 , given an arbitrary event A, can be expressed as:
𝑃(𝐵𝑖 ∩ 𝐴) 𝑃(𝐵𝑖 ) 𝑥 𝑃(𝐴/𝐵𝑖 )
𝑃(𝐵𝑖 /𝐴) = 𝐴 ∩=
𝐵1
𝑃(𝐴) 𝑃(𝐵1 ) 𝑥 𝑃(𝐴/𝐵1 ) + 𝑃(𝐵2 ) 𝑥 𝑃(𝐴/𝐵2 ) + ⋯ + 𝑃(𝐵𝑚 ) 𝑥 𝑃(𝐴/𝐵𝑚 )
Example 1: Box 1 contains 2 red balls and one blue ball. Box 2 contains 3 blue balls and one red ball. A coin
𝐴 ∩ 𝐵1
is tossed. If it falls heads up, Box 1 is selected and a ball is drawn. If it falls tails up, Box 2 is selected and a
ball is drawn. Then find the probability of selecting a red ball.
𝐴 ∩ 𝐵1
Solution: Let; 𝐵1 − be the event that box 1 is selected.
𝐵2 − be the event that box 2 is selected.
𝑅 − be the event that a red ball is selected.
𝐵 − be the event that a blue ball is selected
𝑃(𝑅/𝐵1 ) = 2/3 R
𝑃(𝐵1 ) = 1/2 𝐵1
𝑃(𝐵/𝐵1 ) = 1/3 B
R
𝑃(𝐵1 ) = 1/2 𝐵2 𝑃(𝑅/𝐵2 ) = 1/4
𝑃(𝐵/𝐵2 ) = 3/4 B
✓ R is selected, if and only if, 𝐵1 is selected and R is selected or 𝐵2 is selected and R is selected.
→≫ 𝑅 = (𝐵1 𝑎𝑛𝑑 𝑅)𝑜𝑟 (𝐵2 𝑎𝑛𝑑 𝑅) = (𝐵1 ∩ 𝑅) ∪ (𝐵2 ∩ 𝑅).
𝑃(𝑅) = 𝑃{(𝐵1 ∩ 𝑅) ∪ (𝐵2 ∩ 𝑅)} = 𝑃(𝐵1 ∩ 𝑅) + 𝑃(𝐵2 ∩ 𝑅) = 𝑃(𝐵1 ) 𝑥 𝑃(𝑅/𝐵1 ) + 𝑃(𝐵2 ) 𝑥 𝑃(𝑅/𝐵2 )
𝑃(𝐷/𝐵1 ) = 1/6 D
𝑃(𝑁𝐷/𝐵2 ) = 4/6 ND
𝑷(𝑩𝟐 /𝑫) =?
𝑃(𝐵2 ∩ 𝐷) 𝑃(𝐵2 ) 𝑥 𝑃(𝐷/𝐵2 ) 𝑃(𝐵2 ) 𝑥 𝑃(𝐷/𝐵2 )
𝑃(𝐵2 /𝐷) = = = .
𝑃(𝐷) 𝑃{(𝐵1 ∩ 𝐷) ∪ (𝐵2 ∩ 𝐷)} 𝑃(𝐵1 ∩ 𝐷) + 𝑃(𝐵2 ∩ 𝐷)
Since, 𝑫 is selected, iff, 𝐵1 is selected and 𝐷 is selected or 𝐵2 is selected and 𝐷 is selected.
✓
𝑃(𝐷) = 𝑃{(𝐵1 ∩ 𝐷) ∪ (𝐵2 ∩ 𝐷)} = 𝑃(𝐵1 ∩ 𝐷) + 𝑃(𝐵2 ∩ 𝐷) = 𝑃(𝐵1 ) 𝑥 𝑃(𝐷/𝐵1 ) + 𝑃(𝐵2 ) 𝑥 𝑃(𝐷/𝐵2 ).
1 1 1 2 1 2 3 1
= 2 𝑥 6 + 2 𝑥 6 = 12 + 12 = 12 = 4. 𝑇ℎ𝑒𝑛
𝑃(𝐵2 ∩ 𝐷) 𝑃(𝐵2 ) 𝑥 𝑃(𝐷/𝐵2 ) 1/2 𝑥 2/6 1/6 1 4 2
𝑃(𝐵2 /𝐷) = = = = = 𝑥 = .
𝑃(𝐷) 𝑃(𝐷) 1/4 1/4 6 1 3