welcome to b asic c oncept o f p robability d epartment of s tatistics d r. m d. m esbahul a lam, a...
TRANSCRIPT
![Page 1: Welcome To B ASIC C ONCEPT O F P ROBABILITY D EPARTMENT OF S TATISTICS D R. M D. M ESBAHUL A LAM, A SSOCIATE P ROFESSOR E-mail: mesbahru@gmail.com Tel:](https://reader030.vdocuments.net/reader030/viewer/2022032802/56649e025503460f94aec4b7/html5/thumbnails/1.jpg)
Welcome To
BASIC CONCEPT OF PROBABILITY
DEPARTMENT OF
STATISTICSDR. MD. MESBAHUL ALAM, ASSOCIATE
PROFESSOR
E-mail: [email protected] Tel: +88-0721-750041/4122
Probability– Models for random phenomena
![Page 2: Welcome To B ASIC C ONCEPT O F P ROBABILITY D EPARTMENT OF S TATISTICS D R. M D. M ESBAHUL A LAM, A SSOCIATE P ROFESSOR E-mail: mesbahru@gmail.com Tel:](https://reader030.vdocuments.net/reader030/viewer/2022032802/56649e025503460f94aec4b7/html5/thumbnails/2.jpg)
Phenomena
DeterministicA mathematical model exists that allows perfect prediction of the phenomena’s outcome.
Non-deterministicNo mathematical model exists that allows perfect prediction of the phenomena’s outcome.
Haphazard
Unpredictable outcomes, but in the long-run the outcomes exhibit no statistical regularity.
Random
Unable to predict the outcomes, but in the long-run, the outcomes exhibit statistical regularity.
2
©MD.
MESBAHUL
ALAM
2011
![Page 3: Welcome To B ASIC C ONCEPT O F P ROBABILITY D EPARTMENT OF S TATISTICS D R. M D. M ESBAHUL A LAM, A SSOCIATE P ROFESSOR E-mail: mesbahru@gmail.com Tel:](https://reader030.vdocuments.net/reader030/viewer/2022032802/56649e025503460f94aec4b7/html5/thumbnails/3.jpg)
Random phenomena– Unable to predict the outcomes, but in the long-
run, the outcomes exhibit statistical regularity.
Examples
1. Tossing a coin – outcomes S ={Head, Tail}
Unable to predict on each toss whether is Head or Tail.
In the long run we can predict that approx 50% of the time heads will occur and approx 50% of the time tails will occur.
3
©MD.
MESBAHUL
ALAM
2011
![Page 4: Welcome To B ASIC C ONCEPT O F P ROBABILITY D EPARTMENT OF S TATISTICS D R. M D. M ESBAHUL A LAM, A SSOCIATE P ROFESSOR E-mail: mesbahru@gmail.com Tel:](https://reader030.vdocuments.net/reader030/viewer/2022032802/56649e025503460f94aec4b7/html5/thumbnails/4.jpg)
2. Rolling a die – outcomes
S ={ , , , , , }
Unable to predict outcome but in the long run one can determine that each outcome will occur 1/6 of the time.
Use symmetry. Each side is the same. One side should not occur more frequently than another side in the long run. If the die is not balanced this may not be true.
4
©MD.
MESBAHUL
ALAM
2011
![Page 5: Welcome To B ASIC C ONCEPT O F P ROBABILITY D EPARTMENT OF S TATISTICS D R. M D. M ESBAHUL A LAM, A SSOCIATE P ROFESSOR E-mail: mesbahru@gmail.com Tel:](https://reader030.vdocuments.net/reader030/viewer/2022032802/56649e025503460f94aec4b7/html5/thumbnails/5.jpg)
3. Rolling a two balanced dice – 36 outcomes 5
©MD.
MESBAHUL
ALAM
2011
![Page 6: Welcome To B ASIC C ONCEPT O F P ROBABILITY D EPARTMENT OF S TATISTICS D R. M D. M ESBAHUL A LAM, A SSOCIATE P ROFESSOR E-mail: mesbahru@gmail.com Tel:](https://reader030.vdocuments.net/reader030/viewer/2022032802/56649e025503460f94aec4b7/html5/thumbnails/6.jpg)
6
Introduction
• Probability is the study of randomness and uncertainty.
• In the early days, probability was associated with games of chance (gambling).
©MD.
MESBAHUL
ALAM
2011
![Page 7: Welcome To B ASIC C ONCEPT O F P ROBABILITY D EPARTMENT OF S TATISTICS D R. M D. M ESBAHUL A LAM, A SSOCIATE P ROFESSOR E-mail: mesbahru@gmail.com Tel:](https://reader030.vdocuments.net/reader030/viewer/2022032802/56649e025503460f94aec4b7/html5/thumbnails/7.jpg)
History
• Games of chance: 300 BC• 1565: first formalizations• 1654: Fermat & Pascal, conditional probability• Reverend Bayes: 1750’s• 1950: Kolmogorov: axiomatic approach• Objectivists vs subjectivists
– (frequentists vs Bayesians)
• Frequentist build one model• Bayesians use all possible models, with priors
7
©MD.
MESBAHUL
ALAM
2011
![Page 8: Welcome To B ASIC C ONCEPT O F P ROBABILITY D EPARTMENT OF S TATISTICS D R. M D. M ESBAHUL A LAM, A SSOCIATE P ROFESSOR E-mail: mesbahru@gmail.com Tel:](https://reader030.vdocuments.net/reader030/viewer/2022032802/56649e025503460f94aec4b7/html5/thumbnails/8.jpg)
Concerns
• Future: what is the likelihood that a student will get a CS job given his grades?
• Current: what is the likelihood that a person has cancer given his symptoms?
• Past: what is the likelihood that Monte committed suicide?
• Combining evidence.
• Always: Representation & Inference
8
©MD.
MESBAHUL
ALAM
2011
![Page 9: Welcome To B ASIC C ONCEPT O F P ROBABILITY D EPARTMENT OF S TATISTICS D R. M D. M ESBAHUL A LAM, A SSOCIATE P ROFESSOR E-mail: mesbahru@gmail.com Tel:](https://reader030.vdocuments.net/reader030/viewer/2022032802/56649e025503460f94aec4b7/html5/thumbnails/9.jpg)
Probability versus Statistics Probability is the field of study that makes
statements about what will occur when a sample is drawn from a known population.
Statistics is the field of study that describes how samples are to be obtained and how inferences are to be made about unknown populations.
9
©MD.
MESBAHUL
ALAM
2011
![Page 10: Welcome To B ASIC C ONCEPT O F P ROBABILITY D EPARTMENT OF S TATISTICS D R. M D. M ESBAHUL A LAM, A SSOCIATE P ROFESSOR E-mail: mesbahru@gmail.com Tel:](https://reader030.vdocuments.net/reader030/viewer/2022032802/56649e025503460f94aec4b7/html5/thumbnails/10.jpg)
10
Simple Games Involving Probability
Game: A fair die is rolled. If the result is 2, 3, or 4, you win Tk. 100; if it is 5, you win Tk. 200; but if it is 1 or 6, you lose Tk. 300.
Should you play this game?
©MD.
MESBAHUL
ALAM
2011
![Page 11: Welcome To B ASIC C ONCEPT O F P ROBABILITY D EPARTMENT OF S TATISTICS D R. M D. M ESBAHUL A LAM, A SSOCIATE P ROFESSOR E-mail: mesbahru@gmail.com Tel:](https://reader030.vdocuments.net/reader030/viewer/2022032802/56649e025503460f94aec4b7/html5/thumbnails/11.jpg)
11
Random Experiment
• a random experiment is a process whose outcome is uncertain.
Examples:
• Tossing a coin once or several times
• Picking a card or cards from a deck
• Measuring temperature of patients
• ...
©MD.
MESBAHUL
ALAM
2011
![Page 12: Welcome To B ASIC C ONCEPT O F P ROBABILITY D EPARTMENT OF S TATISTICS D R. M D. M ESBAHUL A LAM, A SSOCIATE P ROFESSOR E-mail: mesbahru@gmail.com Tel:](https://reader030.vdocuments.net/reader030/viewer/2022032802/56649e025503460f94aec4b7/html5/thumbnails/12.jpg)
Assessing Probability (Classical Approach)
Theoretical/Classical probability—based on theory
(a priori understanding of a phenomena)
For example:
• theoretical probability of rolling a 2 on a standard die is 1/6.
• theoretical probability of choosing an ace from a standard deck is 4/52.
• theoretical probability of getting heads on a regular coin is ½.
12
©MD.
MESBAHUL
ALAM
2011
![Page 13: Welcome To B ASIC C ONCEPT O F P ROBABILITY D EPARTMENT OF S TATISTICS D R. M D. M ESBAHUL A LAM, A SSOCIATE P ROFESSOR E-mail: mesbahru@gmail.com Tel:](https://reader030.vdocuments.net/reader030/viewer/2022032802/56649e025503460f94aec4b7/html5/thumbnails/13.jpg)
The sample Space, S or The sample space, S, for a random phenomena is the set of all possible outcomes.The sample space S may contain
1. A finite number of outcomes.2. A countably infinite number of outcomes, or3. An uncountably infinite number of
outcomes.
13
Note. For cases 1 and 2 we can assign probability to every subset of the sample space. But for case 3 we can not do this. This situation will be discussed in the later workshops.
©MD.
MESBAHUL
ALAM
2011
![Page 14: Welcome To B ASIC C ONCEPT O F P ROBABILITY D EPARTMENT OF S TATISTICS D R. M D. M ESBAHUL A LAM, A SSOCIATE P ROFESSOR E-mail: mesbahru@gmail.com Tel:](https://reader030.vdocuments.net/reader030/viewer/2022032802/56649e025503460f94aec4b7/html5/thumbnails/14.jpg)
A countably infinite number of outcomes means that the outcomes are in a one-one correspondence with the positive integers
{1, 2, 3, 4, 5, …}
This means that the outcomes can be labeled with the positive integers.
S = {O1, O2, O3, O4, O5, …}
14
©MD.
MESBAHUL
ALAM
2011
![Page 15: Welcome To B ASIC C ONCEPT O F P ROBABILITY D EPARTMENT OF S TATISTICS D R. M D. M ESBAHUL A LAM, A SSOCIATE P ROFESSOR E-mail: mesbahru@gmail.com Tel:](https://reader030.vdocuments.net/reader030/viewer/2022032802/56649e025503460f94aec4b7/html5/thumbnails/15.jpg)
A uncountably infinite number of outcomes means that the outcomes can not be put in a one-one correspondence with the positive integers.
Example: A spinner on a circular disc is spun and points at a value x on a circular disc whose circumference is 1.
0.00.1
0.2
0.3
0.40.5
0.6
0.7
0.8
0.9x S = {x | 0 ≤ x <1} = [0,1)
0.0 1.0
[ )S
15
©MD.
MESBAHUL
ALAM
2011
![Page 16: Welcome To B ASIC C ONCEPT O F P ROBABILITY D EPARTMENT OF S TATISTICS D R. M D. M ESBAHUL A LAM, A SSOCIATE P ROFESSOR E-mail: mesbahru@gmail.com Tel:](https://reader030.vdocuments.net/reader030/viewer/2022032802/56649e025503460f94aec4b7/html5/thumbnails/16.jpg)
Examples: Sample Space
1. Tossing a coin – outcomes S ={Head, Tail}
2. Rolling a die – outcomes
S ={ , , , , , }
={1, 2, 3, 4, 5, 6}
16
©MD.
MESBAHUL
ALAM
2011
![Page 17: Welcome To B ASIC C ONCEPT O F P ROBABILITY D EPARTMENT OF S TATISTICS D R. M D. M ESBAHUL A LAM, A SSOCIATE P ROFESSOR E-mail: mesbahru@gmail.com Tel:](https://reader030.vdocuments.net/reader030/viewer/2022032802/56649e025503460f94aec4b7/html5/thumbnails/17.jpg)
S ={ (1, 1), (1, 2), (1, 3), (1, 4), (1, 5), (1, 6),
(2, 1), (2, 2), (2, 3), (2, 4), (2, 5), (2, 6),
(3, 1), (3, 2), (3, 3), (3, 4), (3, 5), (3, 6),
(4, 1), (4, 2), (4, 3), (4, 4), (4, 5), (4, 6),
(5, 1), (5, 2), (5, 3), (5, 4), (5, 5), (5, 6),
(6, 1), (6, 2), (6, 3), (6, 4), (6, 5), (6, 6)}
outcome (x, y),
x = value showing on die 1
y = value showing on die 2
17
3. Rolling a two balanced dice – 36 outcomes
©MD.
MESBAHUL
ALAM
2011
![Page 18: Welcome To B ASIC C ONCEPT O F P ROBABILITY D EPARTMENT OF S TATISTICS D R. M D. M ESBAHUL A LAM, A SSOCIATE P ROFESSOR E-mail: mesbahru@gmail.com Tel:](https://reader030.vdocuments.net/reader030/viewer/2022032802/56649e025503460f94aec4b7/html5/thumbnails/18.jpg)
An Event , E
The event, E, is any subset of the sample space, S. i.e. any set of outcomes (not necessarily all outcomes) of the random phenomena.
S
E
18
©MD.
MESBAHUL
ALAM
2011
![Page 19: Welcome To B ASIC C ONCEPT O F P ROBABILITY D EPARTMENT OF S TATISTICS D R. M D. M ESBAHUL A LAM, A SSOCIATE P ROFESSOR E-mail: mesbahru@gmail.com Tel:](https://reader030.vdocuments.net/reader030/viewer/2022032802/56649e025503460f94aec4b7/html5/thumbnails/19.jpg)
Examples: Event
1. Rolling a die – outcomes
S ={ , , , , , }
={1, 2, 3, 4, 5, 6}
E = the event that an even number is rolled
= {2, 4, 6}
={ , , }
19
©MD.
MESBAHUL
ALAM
2011
![Page 20: Welcome To B ASIC C ONCEPT O F P ROBABILITY D EPARTMENT OF S TATISTICS D R. M D. M ESBAHUL A LAM, A SSOCIATE P ROFESSOR E-mail: mesbahru@gmail.com Tel:](https://reader030.vdocuments.net/reader030/viewer/2022032802/56649e025503460f94aec4b7/html5/thumbnails/20.jpg)
E = the event that “sum of rolled point is 7” ={ (6, 1), (5, 2), (4, 3), (3, 4), (3, 5), (1, 6)}
202. Rolling a two balanced dice.
©MD.
MESBAHUL
ALAM
2011
![Page 21: Welcome To B ASIC C ONCEPT O F P ROBABILITY D EPARTMENT OF S TATISTICS D R. M D. M ESBAHUL A LAM, A SSOCIATE P ROFESSOR E-mail: mesbahru@gmail.com Tel:](https://reader030.vdocuments.net/reader030/viewer/2022032802/56649e025503460f94aec4b7/html5/thumbnails/21.jpg)
21
Sample SpaceThe sample space is the set of all possible outcomes.
Simple EventsThe individual outcomes are called simple events.
EventAn event is any collectionof one or more simple events
Events & Sample Spaces
©MD.
MESBAHUL
ALAM
2011
![Page 22: Welcome To B ASIC C ONCEPT O F P ROBABILITY D EPARTMENT OF S TATISTICS D R. M D. M ESBAHUL A LAM, A SSOCIATE P ROFESSOR E-mail: mesbahru@gmail.com Tel:](https://reader030.vdocuments.net/reader030/viewer/2022032802/56649e025503460f94aec4b7/html5/thumbnails/22.jpg)
Special Events
The Null Event, The empty event -
= { } = the event that contains no outcomes
The Entire Event, The Sample Space - S
S = the event that contains all outcomes
The empty event, , never occurs.
The entire event, S, always occurs.
22
©MD.
MESBAHUL
ALAM
2011
![Page 23: Welcome To B ASIC C ONCEPT O F P ROBABILITY D EPARTMENT OF S TATISTICS D R. M D. M ESBAHUL A LAM, A SSOCIATE P ROFESSOR E-mail: mesbahru@gmail.com Tel:](https://reader030.vdocuments.net/reader030/viewer/2022032802/56649e025503460f94aec4b7/html5/thumbnails/23.jpg)
Set operations on EventsUnion
AB
A B
BA
23
or A B e e A e B
©MD.
MESBAHUL
ALAM
2011
![Page 24: Welcome To B ASIC C ONCEPT O F P ROBABILITY D EPARTMENT OF S TATISTICS D R. M D. M ESBAHUL A LAM, A SSOCIATE P ROFESSOR E-mail: mesbahru@gmail.com Tel:](https://reader030.vdocuments.net/reader030/viewer/2022032802/56649e025503460f94aec4b7/html5/thumbnails/24.jpg)
• {a,b,c}{2,3} = {a,b,c,2,3}
• {2,3,5}{3,5,7} = {2,3,5,3,5,7} ={2,3,5,7}
Union Examples
24
©MD.
MESBAHUL
ALAM
2011
![Page 25: Welcome To B ASIC C ONCEPT O F P ROBABILITY D EPARTMENT OF S TATISTICS D R. M D. M ESBAHUL A LAM, A SSOCIATE P ROFESSOR E-mail: mesbahru@gmail.com Tel:](https://reader030.vdocuments.net/reader030/viewer/2022032802/56649e025503460f94aec4b7/html5/thumbnails/25.jpg)
Intersection
AB
A B
BA
25
and A B e e A e B ©MD.
MESBAHUL
ALAM
2011
![Page 26: Welcome To B ASIC C ONCEPT O F P ROBABILITY D EPARTMENT OF S TATISTICS D R. M D. M ESBAHUL A LAM, A SSOCIATE P ROFESSOR E-mail: mesbahru@gmail.com Tel:](https://reader030.vdocuments.net/reader030/viewer/2022032802/56649e025503460f94aec4b7/html5/thumbnails/26.jpg)
• {a,b,c}{2,3} = ___
• {2,4,6}{3,4,5} = ______
Intersection Examples
{4}
26
©MD.
MESBAHUL
ALAM
2011
![Page 27: Welcome To B ASIC C ONCEPT O F P ROBABILITY D EPARTMENT OF S TATISTICS D R. M D. M ESBAHUL A LAM, A SSOCIATE P ROFESSOR E-mail: mesbahru@gmail.com Tel:](https://reader030.vdocuments.net/reader030/viewer/2022032802/56649e025503460f94aec4b7/html5/thumbnails/27.jpg)
Complement
Let A be any event, then the complement of A (denoted by ) defined by:A
A
A
27
A e e A
The event occurs if the event A does not occurA
©MD.
MESBAHUL
ALAM
2011
![Page 28: Welcome To B ASIC C ONCEPT O F P ROBABILITY D EPARTMENT OF S TATISTICS D R. M D. M ESBAHUL A LAM, A SSOCIATE P ROFESSOR E-mail: mesbahru@gmail.com Tel:](https://reader030.vdocuments.net/reader030/viewer/2022032802/56649e025503460f94aec4b7/html5/thumbnails/28.jpg)
In problems you will recognize that you are working with:
1. Union if you see the word or,
2. Intersection if you see the word and,
3. Complement if you see the word not.
28
Set operations on Events
©MD.
MESBAHUL
ALAM
2011
![Page 29: Welcome To B ASIC C ONCEPT O F P ROBABILITY D EPARTMENT OF S TATISTICS D R. M D. M ESBAHUL A LAM, A SSOCIATE P ROFESSOR E-mail: mesbahru@gmail.com Tel:](https://reader030.vdocuments.net/reader030/viewer/2022032802/56649e025503460f94aec4b7/html5/thumbnails/29.jpg)
Rules from Set Theory• Commutative Laws:
A B = B A, A B = B A• Associative Laws:
(A B) C = A (B C )
(A B) C = A (B C) .• Distributive Laws:
(A B) C = (A C) (B C)
(A B) C = (A C) (B C)
29
©MD.
MESBAHUL
ALAM
2011
![Page 30: Welcome To B ASIC C ONCEPT O F P ROBABILITY D EPARTMENT OF S TATISTICS D R. M D. M ESBAHUL A LAM, A SSOCIATE P ROFESSOR E-mail: mesbahru@gmail.com Tel:](https://reader030.vdocuments.net/reader030/viewer/2022032802/56649e025503460f94aec4b7/html5/thumbnails/30.jpg)
1. A B A B
2. A B A B
DeMoivre’s laws
=
=
30
©MD.
MESBAHUL
ALAM
2011
![Page 31: Welcome To B ASIC C ONCEPT O F P ROBABILITY D EPARTMENT OF S TATISTICS D R. M D. M ESBAHUL A LAM, A SSOCIATE P ROFESSOR E-mail: mesbahru@gmail.com Tel:](https://reader030.vdocuments.net/reader030/viewer/2022032802/56649e025503460f94aec4b7/html5/thumbnails/31.jpg)
1. A B A B
2. A B A B
DeMoivre’s laws (in words)
The event A or B does not occur if the event A does not occur andthe event B does not occur
The event A and B does not occur if the event A does not occur orthe event B does not occur
31
©MD.
MESBAHUL
ALAM
2011
![Page 32: Welcome To B ASIC C ONCEPT O F P ROBABILITY D EPARTMENT OF S TATISTICS D R. M D. M ESBAHUL A LAM, A SSOCIATE P ROFESSOR E-mail: mesbahru@gmail.com Tel:](https://reader030.vdocuments.net/reader030/viewer/2022032802/56649e025503460f94aec4b7/html5/thumbnails/32.jpg)
A A B A B
Another useful rule
=
In wordsThe event A occurs if A occurs and B occurs or A occurs and B doesn’t occur.
32
©MD.
MESBAHUL
ALAM
2011
![Page 33: Welcome To B ASIC C ONCEPT O F P ROBABILITY D EPARTMENT OF S TATISTICS D R. M D. M ESBAHUL A LAM, A SSOCIATE P ROFESSOR E-mail: mesbahru@gmail.com Tel:](https://reader030.vdocuments.net/reader030/viewer/2022032802/56649e025503460f94aec4b7/html5/thumbnails/33.jpg)
1. A A
Rules involving the empty set, , and the entire event, S.
2. A 3. A S S
4. A S A
33
©MD.
MESBAHUL
ALAM
2011
![Page 34: Welcome To B ASIC C ONCEPT O F P ROBABILITY D EPARTMENT OF S TATISTICS D R. M D. M ESBAHUL A LAM, A SSOCIATE P ROFESSOR E-mail: mesbahru@gmail.com Tel:](https://reader030.vdocuments.net/reader030/viewer/2022032802/56649e025503460f94aec4b7/html5/thumbnails/34.jpg)
Definition: mutually exclusive
Two events A and B are called mutually exclusive if:
A B
A B
34
Help, I’vebeen
disjointed!
©MD.
MESBAHUL
ALAM
2011
![Page 35: Welcome To B ASIC C ONCEPT O F P ROBABILITY D EPARTMENT OF S TATISTICS D R. M D. M ESBAHUL A LAM, A SSOCIATE P ROFESSOR E-mail: mesbahru@gmail.com Tel:](https://reader030.vdocuments.net/reader030/viewer/2022032802/56649e025503460f94aec4b7/html5/thumbnails/35.jpg)
If two events A and B are mutually exclusive then:
A B
1. They have no outcomes in common.They can’t occur at the same time. The outcome of the random experiment can not belong to both A and B.
35
©MD.
MESBAHUL
ALAM
2011
![Page 36: Welcome To B ASIC C ONCEPT O F P ROBABILITY D EPARTMENT OF S TATISTICS D R. M D. M ESBAHUL A LAM, A SSOCIATE P ROFESSOR E-mail: mesbahru@gmail.com Tel:](https://reader030.vdocuments.net/reader030/viewer/2022032802/56649e025503460f94aec4b7/html5/thumbnails/36.jpg)
We will use the notation (or )A B B A
to mean that A is a subset B. (B is a superset of A.)
. . if then .e A e B i e
BA
36
Definition: Subset/ Superset
©MD.
MESBAHUL
ALAM
2011
![Page 37: Welcome To B ASIC C ONCEPT O F P ROBABILITY D EPARTMENT OF S TATISTICS D R. M D. M ESBAHUL A LAM, A SSOCIATE P ROFESSOR E-mail: mesbahru@gmail.com Tel:](https://reader030.vdocuments.net/reader030/viewer/2022032802/56649e025503460f94aec4b7/html5/thumbnails/37.jpg)
Union: 1 2 31
k
i ki
E E E E E
E1
E2
E3
1 2 31
ii
E E E E
37
©MD.
MESBAHUL
ALAM
2011
![Page 38: Welcome To B ASIC C ONCEPT O F P ROBABILITY D EPARTMENT OF S TATISTICS D R. M D. M ESBAHUL A LAM, A SSOCIATE P ROFESSOR E-mail: mesbahru@gmail.com Tel:](https://reader030.vdocuments.net/reader030/viewer/2022032802/56649e025503460f94aec4b7/html5/thumbnails/38.jpg)
Intersection: 1 2 31
k
i ki
E E E E E
E1
E2
E3
1 2 31
ii
E E E E
38
©MD.
MESBAHUL
ALAM
2011
![Page 39: Welcome To B ASIC C ONCEPT O F P ROBABILITY D EPARTMENT OF S TATISTICS D R. M D. M ESBAHUL A LAM, A SSOCIATE P ROFESSOR E-mail: mesbahru@gmail.com Tel:](https://reader030.vdocuments.net/reader030/viewer/2022032802/56649e025503460f94aec4b7/html5/thumbnails/39.jpg)
1. i ii i
E E
DeMorgan’s laws
2. i ii i
E E
39
©MD.
MESBAHUL
ALAM
2011
![Page 40: Welcome To B ASIC C ONCEPT O F P ROBABILITY D EPARTMENT OF S TATISTICS D R. M D. M ESBAHUL A LAM, A SSOCIATE P ROFESSOR E-mail: mesbahru@gmail.com Tel:](https://reader030.vdocuments.net/reader030/viewer/2022032802/56649e025503460f94aec4b7/html5/thumbnails/40.jpg)
Example: Finite uniform probability spaceIn many examples the sample space S = {o1, o2,
o3, … oN} has a finite number, N, of oucomes.
Also each of the outcomes is equally likely (because of symmetry).
Then P[{oi}] = 1/N and for any event E
no. of outcomes in =
total no. of outcomes
n E n E EP E
n S N
: = no. of elements of n A ANote
40
Probability: Classical Approach
©MD.
MESBAHUL
ALAM
2011
![Page 41: Welcome To B ASIC C ONCEPT O F P ROBABILITY D EPARTMENT OF S TATISTICS D R. M D. M ESBAHUL A LAM, A SSOCIATE P ROFESSOR E-mail: mesbahru@gmail.com Tel:](https://reader030.vdocuments.net/reader030/viewer/2022032802/56649e025503460f94aec4b7/html5/thumbnails/41.jpg)
Note: with this definition of P[E], i.e.
no. of outcomes in =
total no. of outcomes
n E n E EP E
n S N
41
©MD.
MESBAHUL
ALAM
2011
![Page 42: Welcome To B ASIC C ONCEPT O F P ROBABILITY D EPARTMENT OF S TATISTICS D R. M D. M ESBAHUL A LAM, A SSOCIATE P ROFESSOR E-mail: mesbahru@gmail.com Tel:](https://reader030.vdocuments.net/reader030/viewer/2022032802/56649e025503460f94aec4b7/html5/thumbnails/42.jpg)
Another Example:We are shooting at an archery target with radius R. The bullseye has radius R/4. There are three other rings with width R/4. We shoot at the target until it is hit
R
S = set of all points in the target
= {(x,y)| x2 + y2 ≤ R2}
E, any event is a sub region (subset) of S.
42
©MD.
MESBAHUL
ALAM
2011
![Page 43: Welcome To B ASIC C ONCEPT O F P ROBABILITY D EPARTMENT OF S TATISTICS D R. M D. M ESBAHUL A LAM, A SSOCIATE P ROFESSOR E-mail: mesbahru@gmail.com Tel:](https://reader030.vdocuments.net/reader030/viewer/2022032802/56649e025503460f94aec4b7/html5/thumbnails/43.jpg)
E, any event is a sub region (subset) of S.
E
2
: =Area E Area E
P EArea S R
Define
43
©MD.
MESBAHUL
ALAM
2011
![Page 44: Welcome To B ASIC C ONCEPT O F P ROBABILITY D EPARTMENT OF S TATISTICS D R. M D. M ESBAHUL A LAM, A SSOCIATE P ROFESSOR E-mail: mesbahru@gmail.com Tel:](https://reader030.vdocuments.net/reader030/viewer/2022032802/56649e025503460f94aec4b7/html5/thumbnails/44.jpg)
2
2
1416
R
P BullseyeR
2 2
2
3 29 4 54 4
16 16
R RP White ring
R
44
©MD.
MESBAHUL
ALAM
2011
![Page 45: Welcome To B ASIC C ONCEPT O F P ROBABILITY D EPARTMENT OF S TATISTICS D R. M D. M ESBAHUL A LAM, A SSOCIATE P ROFESSOR E-mail: mesbahru@gmail.com Tel:](https://reader030.vdocuments.net/reader030/viewer/2022032802/56649e025503460f94aec4b7/html5/thumbnails/45.jpg)
Thus this definition of P[E], i.e.
satisfies the properties:
2
=Area E Area E
P EArea S R
45
©MD.
MESBAHUL
ALAM
2011
![Page 46: Welcome To B ASIC C ONCEPT O F P ROBABILITY D EPARTMENT OF S TATISTICS D R. M D. M ESBAHUL A LAM, A SSOCIATE P ROFESSOR E-mail: mesbahru@gmail.com Tel:](https://reader030.vdocuments.net/reader030/viewer/2022032802/56649e025503460f94aec4b7/html5/thumbnails/46.jpg)
Finite uniform probability space
Many examples fall into this category
1. Finite number of outcomes
2. All outcomes are equally likely
3.
no. of outcomes in =
total no. of outcomes
n E n E EP E
n S N
: = no. of elements of n A ANote
To handle problems in case we have to be able to count. Count n(E) and n(S).
46
©MD.
MESBAHUL
ALAM
2011
![Page 47: Welcome To B ASIC C ONCEPT O F P ROBABILITY D EPARTMENT OF S TATISTICS D R. M D. M ESBAHUL A LAM, A SSOCIATE P ROFESSOR E-mail: mesbahru@gmail.com Tel:](https://reader030.vdocuments.net/reader030/viewer/2022032802/56649e025503460f94aec4b7/html5/thumbnails/47.jpg)
Properties of Probability1. For the null event , P() = 0.
2. For any event A, 0 P(A) 1.
3. For any event A, P(Ac) = 1 - P(A).
4. If A B, then P(A) P(B).
5. For any two events A and B,
P(A B) = P(A) + P(B) - P(A B).
For three events, A, B, and C,
P(ABC) = P(A) + P(B) + P(C) – P(AB) 3. – P(AC) – P(BC) + P(AB C).
47
©MD.
MESBAHUL
ALAM
2011
![Page 48: Welcome To B ASIC C ONCEPT O F P ROBABILITY D EPARTMENT OF S TATISTICS D R. M D. M ESBAHUL A LAM, A SSOCIATE P ROFESSOR E-mail: mesbahru@gmail.com Tel:](https://reader030.vdocuments.net/reader030/viewer/2022032802/56649e025503460f94aec4b7/html5/thumbnails/48.jpg)
Independent Events
Intuitively, we define independence as:
Two events A and B are independent if the occurrence or non-occurrence of one of the events has no influence on the occurrence or non-occurrence of the other event.
Mathematically, we write define independence as:
Two events A and B are independent if Pr(A B) = Pr(A)Pr(B).
48
©MD.
MESBAHUL
ALAM
2011
![Page 49: Welcome To B ASIC C ONCEPT O F P ROBABILITY D EPARTMENT OF S TATISTICS D R. M D. M ESBAHUL A LAM, A SSOCIATE P ROFESSOR E-mail: mesbahru@gmail.com Tel:](https://reader030.vdocuments.net/reader030/viewer/2022032802/56649e025503460f94aec4b7/html5/thumbnails/49.jpg)
Example of Independence
Are party ID and vote choice independent in presidential elections?
Suppose Pr(Rep. ID) = .4, Pr(Rep. Vote) = .5, and Pr(Rep. ID Rep. Vote) = .35
To test for independence, we ask whether:
Pr(Rep. ID) * Pr(Rep. Vote) = .35 ?
Substituting into the equations, we find that:
Pr(Rep. ID) * Pr(Rep. Vote) = .4*.5 = .2 .35,
so the events are not independent.
49
©MD.
MESBAHUL
ALAM
2011
![Page 50: Welcome To B ASIC C ONCEPT O F P ROBABILITY D EPARTMENT OF S TATISTICS D R. M D. M ESBAHUL A LAM, A SSOCIATE P ROFESSOR E-mail: mesbahru@gmail.com Tel:](https://reader030.vdocuments.net/reader030/viewer/2022032802/56649e025503460f94aec4b7/html5/thumbnails/50.jpg)
Independence of Several Events
The events A1, …, An are independent if:
Pr(A1 A2 … An) = Pr(A1)Pr(A2)…Pr(An)
And, this identity must hold for any subset of events.
50
©MD.
MESBAHUL
ALAM
2011
![Page 51: Welcome To B ASIC C ONCEPT O F P ROBABILITY D EPARTMENT OF S TATISTICS D R. M D. M ESBAHUL A LAM, A SSOCIATE P ROFESSOR E-mail: mesbahru@gmail.com Tel:](https://reader030.vdocuments.net/reader030/viewer/2022032802/56649e025503460f94aec4b7/html5/thumbnails/51.jpg)
Independent Mutually exclusive
• Events A and ~A are mutually exclusive, but they are NOT independent.
• P(A&~A)= 0• P(A)*P(~A) 0
Conceptually, once A has happened, ~A is impossible; thus, they are completely dependent.
51
©MD.
MESBAHUL
ALAM
2011
![Page 52: Welcome To B ASIC C ONCEPT O F P ROBABILITY D EPARTMENT OF S TATISTICS D R. M D. M ESBAHUL A LAM, A SSOCIATE P ROFESSOR E-mail: mesbahru@gmail.com Tel:](https://reader030.vdocuments.net/reader030/viewer/2022032802/56649e025503460f94aec4b7/html5/thumbnails/52.jpg)
Conditional ProbabilityConditional probabilities allow us to understand how the probability of an
event A changes after it has been learned that some other event B has occurred.
The key concept for thinking about conditional probabilities is that the occurrence of B reshapes the sample space for subsequent events. - That is, we begin with a sample space S- A and B S- The conditional probability of A given that B looks just at the subset of the sample space for B.
S
A
B
Pr(A | B)The conditional probability of A given B is denoted Pr(A | B).
- Importantly, according to Bayesian orthodoxy, all probability distributions are implicitly or explicitly conditioned on the model.
52
©MD.
MESBAHUL
ALAM
2011
![Page 53: Welcome To B ASIC C ONCEPT O F P ROBABILITY D EPARTMENT OF S TATISTICS D R. M D. M ESBAHUL A LAM, A SSOCIATE P ROFESSOR E-mail: mesbahru@gmail.com Tel:](https://reader030.vdocuments.net/reader030/viewer/2022032802/56649e025503460f94aec4b7/html5/thumbnails/53.jpg)
Conditional Probability Cont.
By definition: If A and B are two events such that Pr(B) > 0, then:
S
A
B
Pr(A | B)
Pr(B)
B) Pr(A B) |Pr(A
Example: What is the Pr(Republican Vote | Republican Identifier)?
Pr(Rep. Vote Rep. Id) = .35 and Pr(Rep ID) = .4
Thus, Pr(Republican Vote | Republican Identifier) = .35 / .4 = .875
53
©MD.
MESBAHUL
ALAM
2011
![Page 54: Welcome To B ASIC C ONCEPT O F P ROBABILITY D EPARTMENT OF S TATISTICS D R. M D. M ESBAHUL A LAM, A SSOCIATE P ROFESSOR E-mail: mesbahru@gmail.com Tel:](https://reader030.vdocuments.net/reader030/viewer/2022032802/56649e025503460f94aec4b7/html5/thumbnails/54.jpg)
There are four possible outcomes:Red, RedRed, BlueBlue, RedBlue, Blue
We can find the probabilities of the outcomes by using the multiplication rule for dependent events.
• Suppose there are five balls in an urn. Three are red and two are blue. We will select a ball, note the color, and, without replacing the first ball, select a second ball.
Urn Example54
©MD.
MESBAHUL
ALAM
2011
![Page 55: Welcome To B ASIC C ONCEPT O F P ROBABILITY D EPARTMENT OF S TATISTICS D R. M D. M ESBAHUL A LAM, A SSOCIATE P ROFESSOR E-mail: mesbahru@gmail.com Tel:](https://reader030.vdocuments.net/reader030/viewer/2022032802/56649e025503460f94aec4b7/html5/thumbnails/55.jpg)
Factorials
• For counting numbers 1, 2, 3, …
• ! is read “factorial”– So for example, 5! is read “five factorial”
• n! = n * (n-1) * (n-2) * … * 3 * 2 * 1– So for example, 5! = 5 * 4 * 3 * 2 * 1 = 120
• 1! = 1
• 0! = 1
55
©MD.
MESBAHUL
ALAM
2011
![Page 56: Welcome To B ASIC C ONCEPT O F P ROBABILITY D EPARTMENT OF S TATISTICS D R. M D. M ESBAHUL A LAM, A SSOCIATE P ROFESSOR E-mail: mesbahru@gmail.com Tel:](https://reader030.vdocuments.net/reader030/viewer/2022032802/56649e025503460f94aec4b7/html5/thumbnails/56.jpg)
Permutations
• Permutation: ordered grouping of objects.
• Counting Rule for Permutations
56
©MD.
MESBAHUL
ALAM
2011
![Page 57: Welcome To B ASIC C ONCEPT O F P ROBABILITY D EPARTMENT OF S TATISTICS D R. M D. M ESBAHUL A LAM, A SSOCIATE P ROFESSOR E-mail: mesbahru@gmail.com Tel:](https://reader030.vdocuments.net/reader030/viewer/2022032802/56649e025503460f94aec4b7/html5/thumbnails/57.jpg)
Combinations
• A combination is a grouping that pays no attention to order.
• Counting Rule for Combinations
57
©MD.
MESBAHUL
ALAM
2011
![Page 58: Welcome To B ASIC C ONCEPT O F P ROBABILITY D EPARTMENT OF S TATISTICS D R. M D. M ESBAHUL A LAM, A SSOCIATE P ROFESSOR E-mail: mesbahru@gmail.com Tel:](https://reader030.vdocuments.net/reader030/viewer/2022032802/56649e025503460f94aec4b7/html5/thumbnails/58.jpg)
Useful Properties of Conditional Probabilities
Property 1. The Conditional Probability for Independent EventsIf A and B are independent events, then:
Pr(A)Pr(B)
Pr(B)Pr(A)Pr(B)
B) Pr(A B) |Pr(A
Property 2. The Multiplication Rule for Conditional Probabilities
In an experiment involving two non-independent events A and B, the probability that both A and B occurs can be found in the following two ways:
)A|BPr( Pr(A) B) Pr(A
or
)B|Pr(A Pr(B) B) Pr(A
58
©MD.
MESBAHUL
ALAM
2011
![Page 59: Welcome To B ASIC C ONCEPT O F P ROBABILITY D EPARTMENT OF S TATISTICS D R. M D. M ESBAHUL A LAM, A SSOCIATE P ROFESSOR E-mail: mesbahru@gmail.com Tel:](https://reader030.vdocuments.net/reader030/viewer/2022032802/56649e025503460f94aec4b7/html5/thumbnails/59.jpg)
Which Drug is Better ?
59
©MD.
MESBAHUL
ALAM
2011
![Page 60: Welcome To B ASIC C ONCEPT O F P ROBABILITY D EPARTMENT OF S TATISTICS D R. M D. M ESBAHUL A LAM, A SSOCIATE P ROFESSOR E-mail: mesbahru@gmail.com Tel:](https://reader030.vdocuments.net/reader030/viewer/2022032802/56649e025503460f94aec4b7/html5/thumbnails/60.jpg)
Simpson’s Paradox: View I
Drug I Drug II
Success 219 1010
Failure 1801 1190
A = {Using Drug I}
B = {Using Drug II}
C = {Drug succeeds}
Pr(C|A) ~ 10%
Pr(C|B) ~ 50%
Drug II is better than Drug I
60
©MD.
MESBAHUL
ALAM
2011
![Page 61: Welcome To B ASIC C ONCEPT O F P ROBABILITY D EPARTMENT OF S TATISTICS D R. M D. M ESBAHUL A LAM, A SSOCIATE P ROFESSOR E-mail: mesbahru@gmail.com Tel:](https://reader030.vdocuments.net/reader030/viewer/2022032802/56649e025503460f94aec4b7/html5/thumbnails/61.jpg)
Simpson’s Paradox: View II
Female Patient
A = {Using Drug I}
B = {Using Drug II}
C = {Drug succeeds}
Pr(C|A) ~ 20%
Pr(C|B) ~ 5%
61
©MD.
MESBAHUL
ALAM
2011
![Page 62: Welcome To B ASIC C ONCEPT O F P ROBABILITY D EPARTMENT OF S TATISTICS D R. M D. M ESBAHUL A LAM, A SSOCIATE P ROFESSOR E-mail: mesbahru@gmail.com Tel:](https://reader030.vdocuments.net/reader030/viewer/2022032802/56649e025503460f94aec4b7/html5/thumbnails/62.jpg)
Simpson’s Paradox: View II
Female Patient
A = {Using Drug I}
B = {Using Drug II}
C = {Drug succeeds}
Pr(C|A) ~ 20%
Pr(C|B) ~ 5%
Male Patient
A = {Using Drug I}
B = {Using Drug II}
C = {Drug succeeds}
Pr(C|A) ~ 100%
Pr(C|B) ~ 50%
62
©MD.
MESBAHUL
ALAM
2011
![Page 63: Welcome To B ASIC C ONCEPT O F P ROBABILITY D EPARTMENT OF S TATISTICS D R. M D. M ESBAHUL A LAM, A SSOCIATE P ROFESSOR E-mail: mesbahru@gmail.com Tel:](https://reader030.vdocuments.net/reader030/viewer/2022032802/56649e025503460f94aec4b7/html5/thumbnails/63.jpg)
Simpson’s Paradox: View II
Female Patient
A = {Using Drug I}
B = {Using Drug II}
C = {Drug succeeds}
Pr(C|A) ~ 20%
Pr(C|B) ~ 5%
Male Patient
A = {Using Drug I}
B = {Using Drug II}
C = {Drug succeeds}
Pr(C|A) ~ 100%
Pr(C|B) ~ 50%
Drug I is better than Drug II
63
©MD.
MESBAHUL
ALAM
2011
![Page 64: Welcome To B ASIC C ONCEPT O F P ROBABILITY D EPARTMENT OF S TATISTICS D R. M D. M ESBAHUL A LAM, A SSOCIATE P ROFESSOR E-mail: mesbahru@gmail.com Tel:](https://reader030.vdocuments.net/reader030/viewer/2022032802/56649e025503460f94aec4b7/html5/thumbnails/64.jpg)
Conditional Independence Event A and B are conditionally independent given
C in case
Pr(AB|C)=Pr(A|C)Pr(B|C) A set of events {Ai} is conditionally independent
given C in case
A and B are independent A and B are conditionally independent
Pr( | ) Pr( | )i iiiA C A C
64
©MD.
MESBAHUL
ALAM
2011
![Page 65: Welcome To B ASIC C ONCEPT O F P ROBABILITY D EPARTMENT OF S TATISTICS D R. M D. M ESBAHUL A LAM, A SSOCIATE P ROFESSOR E-mail: mesbahru@gmail.com Tel:](https://reader030.vdocuments.net/reader030/viewer/2022032802/56649e025503460f94aec4b7/html5/thumbnails/65.jpg)
Conditional Probability and Partitions of a Sample Space
The set of events A1,…,Ak form a partition of a sample space S if: i=1 to k Ai = S.
If the events A1,…,Ak partition S and if B is any other event in S (note that it is impossible for Ai B = for some i), then the events A1 B, A2 B,…,Ak B will form a partition of B.
Thus, B = (A1 B) (A2 B) … (Ak B)
Pr( B ) = i=1 to k Pr( Ai B )
Finally, if Pr( Ai ) > 0 for all i, then:
Pr( B ) = i=1 to k Pr( B | Ai ) Pr( Ai )
65
©MD.
MESBAHUL
ALAM
2011
![Page 66: Welcome To B ASIC C ONCEPT O F P ROBABILITY D EPARTMENT OF S TATISTICS D R. M D. M ESBAHUL A LAM, A SSOCIATE P ROFESSOR E-mail: mesbahru@gmail.com Tel:](https://reader030.vdocuments.net/reader030/viewer/2022032802/56649e025503460f94aec4b7/html5/thumbnails/66.jpg)
Example of conditional probability and partitions of a sample space
Pr( B ) = i=1 to k Pr( B | Ai ) Pr( Ai )
Example. What is the Probability of a Republican Vote?
Pr( Rep. Vote ) = Pr( Rep. Vote | Rep. ID ) Pr( Rep. ID )
+ Pr( Rep. Vote | Ind. ID ) Pr( Ind. ID )
+ Pr( Rep. Vote | Dem. ID ) Pr( Dem. ID )
Note: the definition for Pr(B) defined above provides the denominator for Bayes’ Theorem.
66
©MD.
MESBAHUL
ALAM
2011
![Page 67: Welcome To B ASIC C ONCEPT O F P ROBABILITY D EPARTMENT OF S TATISTICS D R. M D. M ESBAHUL A LAM, A SSOCIATE P ROFESSOR E-mail: mesbahru@gmail.com Tel:](https://reader030.vdocuments.net/reader030/viewer/2022032802/56649e025503460f94aec4b7/html5/thumbnails/67.jpg)
Given two events A and B and suppose that Pr(A) > 0. Then
Example:
Bayes’ Rule
Pr(W|R) R R
W 0.7 0.4
W 0.3 0.6
R: It is a rainy day
W: The grass is wet
Pr(R|W) = ?
Pr(R) = 0.8
)Pr(
)Pr()|Pr(
)Pr(
)Pr()|Pr(
A
BBA
A
ABAB
67
©MD.
MESBAHUL
ALAM
2011
![Page 68: Welcome To B ASIC C ONCEPT O F P ROBABILITY D EPARTMENT OF S TATISTICS D R. M D. M ESBAHUL A LAM, A SSOCIATE P ROFESSOR E-mail: mesbahru@gmail.com Tel:](https://reader030.vdocuments.net/reader030/viewer/2022032802/56649e025503460f94aec4b7/html5/thumbnails/68.jpg)
Bayes’ RuleR R
W 0.7 0.4
W 0.3 0.6
R: It rains
W: The grass is wet
R W
Information
Pr(W|R)
Inference
Pr(R|W)
68
©MD.
MESBAHUL
ALAM
2011
![Page 69: Welcome To B ASIC C ONCEPT O F P ROBABILITY D EPARTMENT OF S TATISTICS D R. M D. M ESBAHUL A LAM, A SSOCIATE P ROFESSOR E-mail: mesbahru@gmail.com Tel:](https://reader030.vdocuments.net/reader030/viewer/2022032802/56649e025503460f94aec4b7/html5/thumbnails/69.jpg)
Pr( | ) Pr( )Pr( | )
Pr( )
E H HH E
E
Bayes’ RuleR R
W 0.7 0.4
W 0.3 0.6
R: It rains
W: The grass is wet
Hypothesis H Evidence EInformation: Pr(E|H)
Inference: Pr(H|E) PriorLikelihoodPosterior
69
©MD.
MESBAHUL
ALAM
2011
![Page 70: Welcome To B ASIC C ONCEPT O F P ROBABILITY D EPARTMENT OF S TATISTICS D R. M D. M ESBAHUL A LAM, A SSOCIATE P ROFESSOR E-mail: mesbahru@gmail.com Tel:](https://reader030.vdocuments.net/reader030/viewer/2022032802/56649e025503460f94aec4b7/html5/thumbnails/70.jpg)
Bayes’ Rule: More Complicated Suppose that B1, B2, … Bk form a partition of S:
Suppose that Pr(Bi) > 0 and Pr(A) > 0. Then
; i j iiB B B S
1
1
Pr( | ) Pr( )Pr( | )
Pr( )
Pr( | ) Pr( )
Pr( )
Pr( | ) Pr( )
Pr( ) Pr( | )
i ii
i ik
jj
i ik
j jj
A B BB A
A
A B B
AB
A B B
B A B
70
©MD.
MESBAHUL
ALAM
2011
![Page 71: Welcome To B ASIC C ONCEPT O F P ROBABILITY D EPARTMENT OF S TATISTICS D R. M D. M ESBAHUL A LAM, A SSOCIATE P ROFESSOR E-mail: mesbahru@gmail.com Tel:](https://reader030.vdocuments.net/reader030/viewer/2022032802/56649e025503460f94aec4b7/html5/thumbnails/71.jpg)
Bayes’ Rule: More Complicated Suppose that B1, B2, … Bk form a partition of S:
Suppose that Pr(Bi) > 0 and Pr(A) > 0. Then
; i j iiB B B S
1
1
Pr( | ) Pr( )Pr( | )
Pr( )
Pr( | ) Pr( )
Pr( )
Pr( | ) Pr( )
Pr( ) Pr( | )
i ii
i ik
jj
i ik
j jj
A B BB A
A
A B B
AB
A B B
B A B
71
©MD.
MESBAHUL
ALAM
2011
![Page 72: Welcome To B ASIC C ONCEPT O F P ROBABILITY D EPARTMENT OF S TATISTICS D R. M D. M ESBAHUL A LAM, A SSOCIATE P ROFESSOR E-mail: mesbahru@gmail.com Tel:](https://reader030.vdocuments.net/reader030/viewer/2022032802/56649e025503460f94aec4b7/html5/thumbnails/72.jpg)
Bayes’ Rule: More Complicated Suppose that B1, B2, … Bk form a partition of S:
Suppose that Pr(Bi) > 0 and Pr(A) > 0. Then
; i j iiB B B S
1
1
Pr( | ) Pr( )Pr( | )
Pr( )
Pr( | ) Pr( )
Pr( )
Pr( | ) Pr( )
Pr( ) Pr( | )
i ii
i ik
jj
i ik
j jj
A B BB A
A
A B B
AB
A B B
B A B
72
©MD.
MESBAHUL
ALAM
2011
![Page 73: Welcome To B ASIC C ONCEPT O F P ROBABILITY D EPARTMENT OF S TATISTICS D R. M D. M ESBAHUL A LAM, A SSOCIATE P ROFESSOR E-mail: mesbahru@gmail.com Tel:](https://reader030.vdocuments.net/reader030/viewer/2022032802/56649e025503460f94aec4b7/html5/thumbnails/73.jpg)
A More Complicated ExampleR It rains
W The grass is wet
U People bring umbrella
Pr(UW|R)=Pr(U|R)Pr(W|R)
Pr(UW| R)=Pr(U| R)Pr(W| R)
R
W U
Pr(W|R) R R
W 0.7 0.4
W 0.3 0.6
Pr(U|R) R R
U 0.9 0.2
U 0.1 0.8
Pr(U|W) = ?
Pr(R) = 0.8
73
©MD.
MESBAHUL
ALAM
2011
![Page 74: Welcome To B ASIC C ONCEPT O F P ROBABILITY D EPARTMENT OF S TATISTICS D R. M D. M ESBAHUL A LAM, A SSOCIATE P ROFESSOR E-mail: mesbahru@gmail.com Tel:](https://reader030.vdocuments.net/reader030/viewer/2022032802/56649e025503460f94aec4b7/html5/thumbnails/74.jpg)
A More Complicated ExampleR It rains
W The grass is wet
U People bring umbrella
Pr(UW|R)=Pr(U|R)Pr(W|R)
Pr(UW| R)=Pr(U| R)Pr(W| R)
R
W U
Pr(W|R) R R
W 0.7 0.4
W 0.3 0.6
Pr(U|R) R R
U 0.9 0.2
U 0.1 0.8
Pr(U|W) = ?
Pr(R) = 0.8
74
©MD.
MESBAHUL
ALAM
2011
![Page 75: Welcome To B ASIC C ONCEPT O F P ROBABILITY D EPARTMENT OF S TATISTICS D R. M D. M ESBAHUL A LAM, A SSOCIATE P ROFESSOR E-mail: mesbahru@gmail.com Tel:](https://reader030.vdocuments.net/reader030/viewer/2022032802/56649e025503460f94aec4b7/html5/thumbnails/75.jpg)
A More Complicated ExampleR It rains
W The grass is wet
U People bring umbrella
Pr(UW|R)=Pr(U|R)Pr(W|R)
Pr(UW| R)=Pr(U| R)Pr(W| R)
R
W U
Pr(W|R) R R
W 0.7 0.4
W 0.3 0.6
Pr(U|R) R R
U 0.9 0.2
U 0.1 0.8
Pr(U|W) = ?
Pr(R) = 0.8
75
©MD.
MESBAHUL
ALAM
2011
![Page 76: Welcome To B ASIC C ONCEPT O F P ROBABILITY D EPARTMENT OF S TATISTICS D R. M D. M ESBAHUL A LAM, A SSOCIATE P ROFESSOR E-mail: mesbahru@gmail.com Tel:](https://reader030.vdocuments.net/reader030/viewer/2022032802/56649e025503460f94aec4b7/html5/thumbnails/76.jpg)
Assessing Probability (Frequency Approach)
76
Empirical probability—based on empirical data
For example:
• Toss an irregular die (probabilities unknown) 100 times
and find that you get a 2 twenty-five times; empirical
probability of rolling a 2 is 1/4.
• The empirical probability of an Earthquake in Bay Area
by 2032 is 0.62 (based on historical data)
• The empirical probability of a lifetime smoker developing
lung cancer is 15 percent (based on empirical data).
©MD.
MESBAHUL
ALAM
2011
![Page 77: Welcome To B ASIC C ONCEPT O F P ROBABILITY D EPARTMENT OF S TATISTICS D R. M D. M ESBAHUL A LAM, A SSOCIATE P ROFESSOR E-mail: mesbahru@gmail.com Tel:](https://reader030.vdocuments.net/reader030/viewer/2022032802/56649e025503460f94aec4b7/html5/thumbnails/77.jpg)
Relative Frequency Probability:
If some process is repeated a large number of times, n, and if some resulting event E occurs m times, the relative frequency of occurrence of E, m/n will be approximately equal to the probability of E.P(E) = m/N.
77
©MD.
MESBAHUL
ALAM
2011
![Page 78: Welcome To B ASIC C ONCEPT O F P ROBABILITY D EPARTMENT OF S TATISTICS D R. M D. M ESBAHUL A LAM, A SSOCIATE P ROFESSOR E-mail: mesbahru@gmail.com Tel:](https://reader030.vdocuments.net/reader030/viewer/2022032802/56649e025503460f94aec4b7/html5/thumbnails/78.jpg)
Interpret this result
78
©MD.
MESBAHUL
ALAM
2011
![Page 79: Welcome To B ASIC C ONCEPT O F P ROBABILITY D EPARTMENT OF S TATISTICS D R. M D. M ESBAHUL A LAM, A SSOCIATE P ROFESSOR E-mail: mesbahru@gmail.com Tel:](https://reader030.vdocuments.net/reader030/viewer/2022032802/56649e025503460f94aec4b7/html5/thumbnails/79.jpg)
79
Example:
In a certain population, 10% of the people are rich, 5% are famous, and 3% are both rich and famous. A person is randomly selected from this population. What is the chance that the person is
• not rich?
• rich but not famous?
• either rich or famous?
Subjective Probability
Probability measures the confidence that a particular individual has in the truth of a particular proposition.
©MD.
MESBAHUL
ALAM
2011
![Page 80: Welcome To B ASIC C ONCEPT O F P ROBABILITY D EPARTMENT OF S TATISTICS D R. M D. M ESBAHUL A LAM, A SSOCIATE P ROFESSOR E-mail: mesbahru@gmail.com Tel:](https://reader030.vdocuments.net/reader030/viewer/2022032802/56649e025503460f94aec4b7/html5/thumbnails/80.jpg)
80
Intuitive Development
©MD.
MESBAHUL
ALAM
2011
![Page 81: Welcome To B ASIC C ONCEPT O F P ROBABILITY D EPARTMENT OF S TATISTICS D R. M D. M ESBAHUL A LAM, A SSOCIATE P ROFESSOR E-mail: mesbahru@gmail.com Tel:](https://reader030.vdocuments.net/reader030/viewer/2022032802/56649e025503460f94aec4b7/html5/thumbnails/81.jpg)
81
Why Axiomatic Approach?
Rectangle
ConceptReal World
Circle
Probability
©MD.
MESBAHUL
ALAM
2011
![Page 82: Welcome To B ASIC C ONCEPT O F P ROBABILITY D EPARTMENT OF S TATISTICS D R. M D. M ESBAHUL A LAM, A SSOCIATE P ROFESSOR E-mail: mesbahru@gmail.com Tel:](https://reader030.vdocuments.net/reader030/viewer/2022032802/56649e025503460f94aec4b7/html5/thumbnails/82.jpg)
82
What will be the Appropriate Axioms ?
©MD.
MESBAHUL
ALAM
2011
![Page 83: Welcome To B ASIC C ONCEPT O F P ROBABILITY D EPARTMENT OF S TATISTICS D R. M D. M ESBAHUL A LAM, A SSOCIATE P ROFESSOR E-mail: mesbahru@gmail.com Tel:](https://reader030.vdocuments.net/reader030/viewer/2022032802/56649e025503460f94aec4b7/html5/thumbnails/83.jpg)
The Axiomatic “Definition” of Probability
83
©MD.
MESBAHUL
ALAM
2011
![Page 84: Welcome To B ASIC C ONCEPT O F P ROBABILITY D EPARTMENT OF S TATISTICS D R. M D. M ESBAHUL A LAM, A SSOCIATE P ROFESSOR E-mail: mesbahru@gmail.com Tel:](https://reader030.vdocuments.net/reader030/viewer/2022032802/56649e025503460f94aec4b7/html5/thumbnails/84.jpg)
Anomaly in Uncountable Set
• Previous plan is OK when S is finite or countably infinite (discrete)
• For uncountably infinite S additivity makes nonsense– Union of infinite events with probability 0 can make
event of probability one; This makes analysis tough– E.g., for [0,1] as S
• Each singletons is of probability 0• Uncountable union of singletons constitute S which is of
probability 1
84
©MD.
MESBAHUL
ALAM
2011