Notes On Probability
Notes On Probability
Intersection: “and”
For example:
1) X = {3, 10, 8, 17}
Y = {3, 20, 18, 17}
X ꓵ Y = {3, 17}
2) A = {11, 4, 12, 7}
B = {13, 4, 12, 10, 3}
A ꓵ B = {??}
UNION = “OR”
For example:
1) X = {3, 12, 5, 13}
Y = {14, 15, 6, 3}
X U Y = {3, 12, 5, 13, 14, 15, 6}
For example:
• Tossing of a ‘fair’, ‘unbiased’, ‘symmetrical’ coin at random.
• Throwing a fair dice.
• Guessing a MCQ (Multiple Choice Questions).
Empirical probability:
For example:
1. Suppose we toss a coin 100 times and get a head 58 times.
Now, we toss a coin at random. What is the probability of
getting a head?
Solution:
Total number of trials = 100.
Number of times head appeared = 58.
Number of times head appeared
Probability of getting a head =
Total number of trials
P (H) = 58/100
Solution: ???
3. Polled 5o people = ‘what is your favorite sport?
football 29
Basketball 11
baseball 6
soccer 3
Tennis 1
Subjective probability:
Subjective probability is an individual person's measure of belief that an
event will occur. With this view of probability, it makes perfectly good
sense intuitively to talk about the probability that the Dow Jones average
will go up tomorrow.
It is based on educated guess and an estimate.
Since it is subjective, one person's probability (e.g., that the Dow Jones
will go up tomorrow) may differ from another's. This is disturbing to
many people. Still, it models the reality that often people do differ in their
judgments of probability.
Conditional Probability:
It is denoted by P(X/Y).
For example
A bag contains red and blue marbles. Two marbles are drawn without
replacement. The probability of selecting a red marble and then a blue
marble is 0.28. The probability of selecting a red marble on the first draw
is 0.5. What is the probability of selecting a blue marble on the second
draw, given that the first marble drawn was red?
Solution:
Let A be the event of passing second test and B be the event of passing
first test
The event of passing both test i.e A and B = 0.6
P(A/B) = P(A and B) / P(B)
= 0.6/0.8 = 0.75
Axiomatic probability:
It is another way to study probabilities with axioms (rules).
S be the sample space of an experiment, the possible outcomes are x, y, z.
Before calculating probability, it should satisfy some conditions
1. P(X) >_=0
2. P(S) = 1
3. 0<_ P(X) <_ 1
4. Probability of any event is equally likely.
Types of Events:
1. Independent events
For example:
= 91/100 ∙ 95/100
= 8645/10000
= 0.8645
2. Dependent events:
5. Complementary Event:
In case of throwing a die, ‘even face’ and ‘odd face’ are complementary
to each other. “Multiple of 3” ant “Not multiple of 3” are complementary
events of each other.
In other words,
If E and F are two events for an experiment such that every favorable
outcome for the event E is not a favorable outcome for the event F.
7. Impossible Event:
An event which cannot occur at any performance of the experiment is
called an possible event.
Following are such examples ----
(i) ‘Seven’ in case of throwing a die.
(ii) ‘Sum-13’ in case of throwing a pair of dice.
• Turning left and turning right are Mutually Exclusive (you can't do
both at the same time)
• Turning left and scratching your head can happen at the same time
P (A ∪ B) = P (A) + P (B) – P (A ∩ B)
1. Mutually exhaustive. Consider the example of finding the
probability of selecting a black card or a 6 from a deck of 52.
2. We need to find out P(B or 6)
3. Probability of selecting a black card = 26/52
4. Probability of selecting a 6 = 4/52
5. Probability of selecting both a black card and a 6 = 2/52
6. P(B or 6) = P(B) + P(6) – P(B and 6)
7. = 26/52 + 4/52 – 2/52
8. = 28/52
9. = 7/13.
10. Consider another example where a pack contains 4 blue, 2 red and 3 black pens. If a pen is
drawn at random from the pack, replaced and the process repeated 2 more times, what is the
probability of drawing 2 blue pens and 1 black pen? Independent event
Probability of drawing 2 blue pens and 1 black pen = 4/9 * 4/9 * 3/9 = 48/729 = 16/243
A pack contains 4 blue, 2 red and 3 black pens. If 2 pens are drawn at random from the
pack, NOT replaced and then another pen is drawn. What is the probability of drawing 2 blue pens
and 1 black pen?
Solution:
Probability of drawing 1 blue pen = 4/9
Probability of drawing another blue pen = 3/8
Probability of drawing 1 black pen = 3/7
Probability of drawing 2 blue pens and 1 black pen = 4/9 * 3/8 * 3/7 = 1/14
In a class, 40% of the students study math and science. 60% of the students
study math. What is the probability of a student studying science given
he/she is already studying math?
Solution
P(M and S) = 0.40
P(M) = 0.60
P(S|M) = P(M and S)/P(S) = 0.40/0.60 = 2/3 = 0.67
Mutually exhaustive What is the probability of the occurrence of a number
that is odd or less than 5 when a fair die is rolled.
Solution
Let the event of the occurrence of a number that is odd be ‘A’ and the event
of the occurrence of a number that is less than 5 be ‘B’. We need to find P(A
or B).
P(A) = 3/6 (odd numbers = 1,3 and 5)
P(B) = 4/6 (numbers less than 5 = 1,2,3 and 4)
P(A and B) = 2/6 (numbers that are both odd and less than 5 = 1 and 3)
Now, P(A or B) = P(A) + P(B) – P(A or B)
= 3/6 + 4/6 – 2/6
P(A or B) = 5/6.
A box contains 4 chocobars and 4 ice creams. Tom eats 3 of them one after
another. What is the probability of sequentially choosing 2 chocobars and 1
icecream?
Solution
Probability of choosing 1 chocobar = 4/8 = 1/2
After taking out 1 chocobar, the total number is 7.
Probability of choosing 2nd chocobar = 3/7
Probability of choosing 1 icecream out of a total of 6 = 4/6 = 2/3
So the final probability of choosing 2 chocobars and 1 icecream = 1/2 * 3/7
* 2/3 = 1/7
When two dice are rolled, find the probability of getting a greater number
on the first die than the one on the second, given that the sum should equal
8.
Solution
Let the event of getting a greater number on the first die be G.
There are 5 ways to get a sum of 8 when two dice are rolled =
{(2,6),(3,5),(4,4), (5,3),(6,2)}.
And there are two ways where the number on the first die is greater than
the one on the second given that the sum should equal 8, G = {(5,3), (6,2)}.
Therefore, P(Sum equals 8) = 5/36 and P(G) = 2/36.
Now, P(G|sum equals 8) = P(G and sum equals 8)/P(sum equals 8)
= (2/36)/(5/36)
= 2/5
A bag contains blue and red balls. Two balls are drawn randomly without
replacement. The probability of selecting a blue and then a red ball is 0.2.
The probability of selecting a blue ball in the first draw is 0.5. What is the
probability of drawing a red ball, given that the first ball drawn was blue?
a)0.4
b)0.2
c)0.1
d) 0.5
2. The probability of getting a spade card from a well shuffled deck of 52
cards is
Binomial distribution:
Let’s get back to cricket. Suppose that you won the toss today and this
indicates a successful event. You toss again but you lost this time. If you
win a toss today, this does not necessitate that you will win the toss
tomorrow. Let’s assign a random variable, say X, to the number of times
you won the toss. What can be the possible value of X? It can be any
number depending on the number of times you tossed a coin.
There are only two possible outcomes. Head denoting success and tail
denoting failure. Therefore, probability of getting a head = 0.5 and the
probability of failure can be easily computed as: q = 1- p = 0.5.
A distribution where only two outcomes are possible, such as success or
failure, gain or loss, win or lose and where the probability of success and
failure is same for all the trials is called a Binomial Distribution.
The probabilities of success and failure need not be equally likely, like
the result of a fight between me and Undertaker. He is pretty much
certain to win. So in this case probability of my success is 0.15 while
my failure is 0.85
Each trial is independent since the outcome of the previous toss doesn’t
determine or affect the outcome of the current toss. An experiment with
only two possible outcomes repeated n number of times is called
binomial. The parameters of a binomial distribution are n and p where n
is the total number of trials and p is the probability of success in each trial.
1. Each trial is independent.
2. There are only two possible outcomes in a trial- either a success or
a failure.
3. A total number of n identical trials are conducted.
4. The probability of success and failure is same for all trials. (Trials
are identical.)
Normal distribution represents the behavior of most of the situations in
the universe (That is why it’s called a “normal” distribution. I guess!). The
large sum of (small) random variables often turns out to be normally
distributed, contributing to its widespread application. Any distribution is
known as Normal distribution if it has the following characteristics:
1. The mean, median and mode of the distribution coincide.
2. The curve of the distribution is bell-shaped and symmetrical about
the line x=μ.
3. The total area under the curve is 1.
4. Exactly half of the values are to the left of the center and the other
half to the right.
A normal distribution is highly different from Binomial Distribution.
However, if the number of trials approaches infinity then the shapes will
be quite similar.
Poisson distribution
Suppose you work at a call center, approximately how many calls do you
get in a day? It can be any number. Now, the entire number of calls at a
call center in a day is modeled by Poisson distribution. Some more
examples are
1. The number of emergency calls recorded at a hospital in a day.
2. The number of thefts reported in an area on a day.
3. The number of customers arriving at a salon in an hour.
4. The number of suicides reported in a particular city.
5. The number of printing errors at each page of the book.
The Poisson distribution is the discrete probability distribution of the
number of events occurring in a given time period, given the average
number of times the event occurs over that time period. A certain fast-
food restaurant gets an average of 3 visitors to the drive-through per
minute.
You can now think of many examples following the same course. Poisson
Distribution is applicable in situations where events occur at random
points of time and space wherein our interest lies only in the number of
occurrences of the event.
Exponential Distribution
Let’s consider the call center example one more time. What about the
interval of time between the calls ? Here, exponential distribution comes
to our rescue. Exponential distribution models the interval of time
between the calls.
Other examples are:
1. Length of time between metro arrivals,
2. Length of time between arrivals at a gas station
3. The life of an Air Conditioner
Exponential distribution is widely used for survival analysis. From the
expected life of a machine to the expected life of a human, exponential
distribution successfully delivers the result.
In probability theory and statistics, the exponential distribution is
the probability distribution of the time between events in a Poisson point
process, i.e., a process in which events occur continuously and
independently at a constant average rate