Chapter 13 · Statistics and Probability

13.2 Probability and Bayes' Theorem

Probability measures how likely an event is. From sample spaces and events we build the addition theorem, conditional probability and the multiplication theorem, independent events, the theorem of total probability and Bayes' theorem — the rule for reasoning backwards from evidence to its causes.

A screening test for a disease detects $95\%$ of people who have it, and wrongly flags $10\%$ of people who do not. One person in a hundred in the population has the disease. Your test comes back positive. How worried should you be? Most people — including, in published surveys, many doctors — answer "about $95\%$". The correct answer is under $9\%$. Picture $1000$ people: about $10$ have the disease and about $9.5$ of them test positive, but $10\%$ of the $990$ healthy people, about $99$, test positive too. Of roughly $108.5$ positives, only $9.5$ are ill: $\tfrac{9.5}{108.5}\approx8.8\%$.

The mistake is to confuse "the probability of a positive test given disease" with "the probability of disease given a positive test". Keeping the two apart is the business of conditional probability, and turning one into the other is Bayes' theorem. In this section we build the whole toolkit from the beginning: sample spaces and events, the probability of an event, the addition theorem, conditional probability and the multiplication theorem, independent events, the theorem of total probability and Bayes' theorem. JEE Main sets two or three probability questions in most papers; counting from Chapter 4 does much of the work in many of them.

Sample Spaces, Events and the Probability of an Event

📘 Definition 13.7 — Random experiment, sample space and events

A random experiment has more than one possible outcome, all known in advance, but which one occurs cannot be predicted. The set $S$ of all its outcomes is the sample space; an event is a subset of $S$. An event with one outcome is elementary; $S$ itself is the sure event and $\phi$ the impossible event. The event "$A$ does not occur" is the complement $A'=S-A$; "$A$ or $B$" is $A\cup B$; "$A$ and $B$" is $A\cap B$.

Events $A$ and $B$ are mutually exclusive if $A\cap B=\phi$ (they cannot occur together). Events $E_1,\dots,E_n$ are exhaustive if $E_1\cup\dots\cup E_n=S$ (at least one must occur).

For two coins, $S=\{HH,HT,TH,TT\}$; for two dice, $S$ is the $36$ ordered pairs $(a,b)$. The set language of Section 1.1 is exactly what we need: De Morgan's law, for example, says "not ($A$ or $B$)" is "not $A$ and not $B$", $(A\cup B)'=A'\cap B'$.

📘 Definition 13.8 — Probability of an event

Classical definition. If $S$ is finite and all its outcomes are equally likely, then $P(A)=\dfrac{n(A)}{n(S)}$ — favourable outcomes over all outcomes.

Axiomatic definition. In general a probability is a rule $P$ that gives each event $A$ a number with (i) $P(A)\ge0$, (ii) $P(S)=1$, and (iii) $P(A\cup B)=P(A)+P(B)$ whenever $A$ and $B$ are mutually exclusive. The classical rule satisfies all three.

The odds in favour of $A$ are $P(A):P(A')$; odds of $a:b$ in favour mean $P(A)=\tfrac{a}{a+b}$.

📐 Theorem 13.6 — First properties

For all events $A$, $B$: $\ P(\phi)=0$; $\ P(A')=1-P(A)$; $\ 0\le P(A)\le1$; and if $A\subseteq B$ then $P(A)\le P(B)$. Also $P(A\cap B')=P(A)-P(A\cap B)$.

Proof. $A$ and $A'$ are mutually exclusive with union $S$, so $P(A)+P(A')=P(S)=1$; with $A=S$ this gives $P(\phi)=0$, and $P(A')\ge0$ gives $P(A)\le1$. If $A\subseteq B$ then $B$ is the disjoint union of $A$ and $B\cap A'$, so $P(B)=P(A)+P(B\cap A')\ge P(A)$. Finally $A$ is the disjoint union of $A\cap B$ and $A\cap B'$. $\blacksquare$ The complement rule is the most useful line in this section: "at least one" is almost always easier as $1-P(\text{none})$.

✏️ Example 1 — Counting outcomes
(a) Two fair dice are thrown. Find the probability that the sum is $8$, and that the sum is a prime number. (b) Three cards are drawn from a well-shuffled pack of $52$. Find the probability that all three are hearts, and that exactly one is an ace. (c) A committee of $4$ is chosen at random from $6$ men and $4$ women. Find the probability that it has at least two women.
(a) $n(S)=36$. Sum $8$: $(2,6),(3,5),(4,4),(5,3),(6,2)$, so $P=\tfrac5{36}$. Prime sums $2,3,5,7,11$ occur in $1+2+4+6+2=15$ ways: $P=\tfrac{15}{36}=\tfrac5{12}$.
(b) $n(S)={}^{52}C_3=22100$. All hearts: $\tfrac{{}^{13}C_3}{22100}=\tfrac{286}{22100}=\tfrac{11}{850}$. Exactly one ace: choose the ace and two non-aces, $\tfrac{4\cdot{}^{48}C_2}{22100}=\tfrac{4512}{22100}=\tfrac{1128}{5525}$.
(c) $n(S)={}^{10}C_4=210$. Two, three or four women: ${}^4C_2\,{}^6C_2+{}^4C_3\,{}^6C_1+{}^4C_4=90+24+1=115$. $P=\tfrac{115}{210}=\tfrac{23}{42}$.
Check (c) by the complement: no woman ${}^6C_4=15$, one woman $4\cdot{}^6C_3=80$; $1-\tfrac{95}{210}=\tfrac{115}{210}$ ✓.

Two fair coins are tossed. A student says: "There are three outcomes — two heads, two tails, one of each — so $P(\text{one head and one tail})=\tfrac13$." What is wrong?

The Addition Theorem

Axiom (iii) handles "or" for mutually exclusive events. When $A$ and $B$ can occur together, adding $P(A)$ and $P(B)$ counts the overlap twice — exactly the problem we solved for counting in Section 1.1.

📐 Theorem 13.7 — Addition theorem of probability

For any events $A$, $B$, $C$:

$$P(A\cup B)=P(A)+P(B)-P(A\cap B),$$ $$\begin{aligned}P(A\cup B\cup C)&=P(A)+P(B)+P(C)-P(A\cap B)\\&\quad-P(B\cap C)-P(C\cap A)+P(A\cap B\cap C).\end{aligned}$$

Also $P(\text{exactly one of }A,B)=P(A)+P(B)-2P(A\cap B)$ and $P(\text{neither})=1-P(A\cup B)$.

Proof. $A\cup B$ is the disjoint union of $A$ and $B\cap A'$, and $P(B\cap A')=P(B)-P(A\cap B)$ by Theorem 13.6; add. The three-event form follows by applying the two-event form to $A\cup B$ and $C$ and then using the distributive law $(A\cup B)\cap C=(A\cap C)\cup(B\cap C)$. "Exactly one" is $A\cup B$ without $A\cap B$. $\blacksquare$ Because $P(A\cup B)\le1$, the theorem also gives the bounds

$$P(A)+P(B)-1\le P(A\cap B)\le\min\{P(A),P(B)\}.$$
✏️ Example 2 — Using the addition theorem
(a) $P(A)=0.5$, $P(B)=0.4$ and $P(A\cap B)=0.2$. Find $P(A\cup B)$, $P(A'\cap B')$, $P(A\cap B')$ and the probability that exactly one of $A$, $B$ occurs. (b) A number is chosen at random from $1, 2, \dots, 100$. Find the probability that it is divisible by $2$, $3$ or $5$.
(a) $P(A\cup B)=0.5+0.4-0.2=0.7$. By De Morgan, $P(A'\cap B')=1-P(A\cup B)=0.3$. $P(A\cap B')=0.5-0.2=0.3$. Exactly one: $0.5+0.4-2(0.2)=0.5$.
(b) Counts Multiples of $2$: $50$; of $3$: $33$; of $5$: $20$; of $6$: $16$; of $10$: $10$; of $15$: $6$; of $30$: $3$.
(b) $50+33+20-16-10-6+3=74$, so $P=\tfrac{74}{100}=0.74$.
Check (a): only $A$ ($0.3$) + only $B$ ($0.2$) + both ($0.2$) + neither ($0.3$) $=1$ ✓.

$P(A)=0.7$ and $P(B)=0.6$. The least possible value of $P(A\cap B)$ is

Conditional Probability, the Multiplication Theorem and Independence

Knowing that one event has happened changes the chances of another. If a die shows an even number, the chance that it is a $6$ rises from $\tfrac16$ to $\tfrac13$: the sample space has shrunk to $\{2,4,6\}$.

📘 Definition 13.9 — Conditional probability

For events $A$, $B$ with $P(B)\gt0$, the probability of $A$ given $B$ is

$$P(A\,|\,B)=\frac{P(A\cap B)}{P(B)}.$$

For equally likely outcomes this is $\tfrac{n(A\cap B)}{n(B)}$: count inside the new, smaller sample space $B$. For fixed $B$, $P(\,\cdot\,|\,B)$ obeys all the rules of probability; for example $P(A'|B)=1-P(A|B)$.

📐 Theorem 13.8 — Multiplication theorem of probability
$$P(A\cap B)=P(A)\,P(B\,|\,A)=P(B)\,P(A\,|\,B),$$ $$P(A\cap B\cap C)=P(A)\,P(B\,|\,A)\,P(C\,|\,A\cap B),$$

whenever the conditioning events have positive probability.

Proof. The first line is Definition 13.9 multiplied out. For three events apply it twice: $P(A\cap B\cap C)=P(A\cap B)\,P(C|A\cap B)$ and $P(A\cap B)=P(A)P(B|A)$. $\blacksquare$ This is the rule for probability trees: along a path, multiply the branch probabilities (each one conditional on the path so far); for an event made of several paths, add the paths.

📘 Definition 13.10 — Independent events

$A$ and $B$ are independent if $P(A\cap B)=P(A)\,P(B)$; equivalently (when $P(B)\gt0$) $P(A|B)=P(A)$ — knowing $B$ does not change the chance of $A$. Three events $A$, $B$, $C$ are mutually independent if they are pairwise independent and $P(A\cap B\cap C)=P(A)P(B)P(C)$.

📐 Theorem 13.9 — Complements of independent events; "at least one"

If $A$ and $B$ are independent, so are $A$ and $B'$, $A'$ and $B$, and $A'$ and $B'$. Hence, for mutually independent $A_1,\dots,A_n$,

$$P(\text{at least one } A_i)=1-P(A_1')\,P(A_2')\cdots P(A_n').$$

Proof. $P(A\cap B')=P(A)-P(A\cap B)$ $=P(A)-P(A)P(B)$ $=P(A)\,P(B')$. Applying this twice gives the other pairs. "At least one" is the complement of "none", and $P(\text{none})=P(A_1'\cap\dots\cap A_n')=\prod P(A_i')$. $\blacksquare$ Do not confuse independent with mutually exclusive: if $P(A),P(B)\gt0$ and $A\cap B=\phi$, then $P(A\cap B)=0\ne P(A)P(B)$, so mutually exclusive events of positive probability are never independent — if one happens, the other certainly does not.

✏️ Example 3 — Conditioning by counting, and drawing without replacement
(a) A family has two children; each child is equally likely to be a boy or a girl, independently. Find the probability that both are boys given that (i) at least one is a boy, (ii) the elder is a boy. (b) An urn holds $5$ red and $3$ black balls. Two are drawn one after the other without replacement. Find the probability that both are red, and that the second is red.
(a)(i) $S=\{BB,BG,GB,GG\}$ (elder first). Given "at least one boy" $=\{BB,BG,GB\}$, the chance of $BB$ is $\tfrac13$.
(a)(ii) Given "elder is a boy" $=\{BB,BG\}$, the chance of $BB$ is $\tfrac12$. Different conditions, different answers — read the condition carefully.
(b) $P(R_1\cap R_2)=P(R_1)P(R_2|R_1)=\tfrac58\cdot\tfrac47=\tfrac5{14}$. For the second ball, add the two paths: $P(R_2)=\tfrac58\cdot\tfrac47+\tfrac38\cdot\tfrac57=\tfrac{20+15}{56}=\tfrac58$.
Check $P(R_2)=\tfrac58=P(R_1)$: before you look at the first ball, the second is just as likely to be red as the first. This symmetry is a fast check for "draw without replacement" questions.

$P(A)=0.3$, $P(B\,|\,A)=0.8$ and $P(B\,|\,A')=0.2$. Event $B$ has occurred. What is $P(A\,|\,B)$, approximately?

Set $P(A)=0.30$, $P(B|A)=0.80$, $P(B|A')=0.20$ and highlight A given B. The tree's leaves read $P(A\cap B)=0.24$ and $P(A'\cap B)=0.14$, so $P(B)=0.38$ and $P(A|B)=\tfrac{0.24}{0.38}\approx0.6316$. In the square, $A|B$ is the share of the B-area (both shaded strips) that lies in the $A$ column. $0.8$ is $P(B|A)$ — the "inverted" conditional; $0.3$ is the prior $P(A)$, which the evidence $B$ has raised; $0.24$ is $P(A\cap B)$, not yet divided by $P(B)$.
Interactive 1 — Tree and Area Lab: Conditional Probability

Set $P(A)$ and the two conditional probabilities of $B$. The tree (left) multiplies along each path (Theorem 13.8); the unit square (right) shows the same four probabilities as areas: the $A$ column has width $P(A)$ and its shaded part has height $P(B|A)$. Choose an event to highlight. Press Play: $P(B|A')$ sweeps from $0$ to $1$ — watch for the moment the two shaded strips have equal height, which is exactly when $A$ and $B$ are independent.

0.300.800.20
$P(A\cap B)$—
$P(B)$—
$P(A|B)$—
$P(A\cup B)$—
independent?—
✏️ Example 4 — Independent trials: who wins, and who solves it?
(a) $A$ and $B$ throw a fair die alternately, $A$ first. The first to throw a six wins. Find the probability that $A$ wins. (b) Three students attempt a problem independently; their probabilities of solving it are $\tfrac12$, $\tfrac13$ and $\tfrac14$. Find the probability that the problem is solved, and that exactly one of them solves it.
Find the probability that $A$ wins in (a):
(a) Paths $A$ wins on his 1st throw ($\tfrac16$), or both miss once and $A$ then wins ($\left(\tfrac56\right)^2\tfrac16$), or both miss twice … — independent throws, so multiply along each path.
(a) Sum $P(A)=\tfrac16\left[1+\tfrac{25}{36}+\left(\tfrac{25}{36}\right)^2+\dots\right]=\dfrac{1/6}{1-25/36}=\dfrac{6}{11}\approx0.545$ (an infinite G.P., Section 6.1). Then $P(B)=\tfrac5{11}$.
(b) Solved $P(\text{nobody})=\tfrac12\cdot\tfrac23\cdot\tfrac34=\tfrac14$, so $P(\text{solved})=1-\tfrac14=\tfrac34$ (Theorem 13.9).
(b) Exactly one $\tfrac12\cdot\tfrac23\cdot\tfrac34+\tfrac12\cdot\tfrac13\cdot\tfrac34+\tfrac12\cdot\tfrac23\cdot\tfrac14=\tfrac{6+3+2}{24}=\tfrac{11}{24}$.
⏱ Shortcut In (a), the first player's advantage is $\tfrac{1}{1+q}$ with $q=\tfrac56$: $\tfrac{1}{11/6}=\tfrac6{11}$ ✓.

$A$ and $B$ are events with $P(A)=0.4$, $P(B)=0.5$ and $P(A\cap B)=0.2$. Which statement is true?

Total Probability and Bayes' Theorem

Many experiments happen in two stages: a factory chooses a machine, then the machine makes a good or a faulty item; a person is ill or well, then the test is positive or negative. The first stage splits the sample space into exhaustive, non-overlapping cases $E_1,\dots,E_n$ (mutually exclusive and exhaustive events with positive probabilities). The theorem of total probability runs the experiment forwards; Bayes' theorem runs it backwards.

📐 Theorem 13.10 — Theorem of total probability

If $E_1,\dots,E_n$ are mutually exclusive and exhaustive events with $P(E_i)\gt0$, then for any event $A$

$$P(A)=\sum_{i=1}^{n}P(E_i)\,P(A\,|\,E_i).$$
📐 Theorem 13.11 — Bayes' theorem

Under the same hypotheses, and if $P(A)\gt0$, for each $k=1,\dots,n$

$$P(E_k\,|\,A)=\frac{P(E_k)\,P(A\,|\,E_k)}{\sum_{i=1}^{n}P(E_i)\,P(A\,|\,E_i)}.$$

$P(E_k)$ is the prior probability of the cause $E_k$ and $P(E_k|A)$ its posterior probability after $A$ has been observed.

Proof. Since the $E_i$ are exhaustive and mutually exclusive, $A$ is the disjoint union of the events $A\cap E_i$, so $P(A)=\sum P(A\cap E_i)=\sum P(E_i)P(A|E_i)$ by the multiplication theorem. Then $P(E_k|A)=\tfrac{P(E_k\cap A)}{P(A)}=\tfrac{P(E_k)P(A|E_k)}{P(A)}$. $\blacksquare$ On a tree, Bayes' theorem says: the posterior probability of a cause is the probability of its path to $A$, divided by the total probability of all paths to $A$. In the screening test, the cause "ill" has a strong link to "positive" but a tiny prior, and the cause "well" has a weak link but a huge prior, so the healthy path can easily carry more probability.

✏️ Example 5 — Which machine made the faulty item?
Machines $M_1$, $M_2$, $M_3$ make $50\%$, $30\%$ and $20\%$ of a factory's bolts, and $2\%$, $3\%$ and $4\%$ of their bolts respectively are defective. A bolt is chosen at random. (a) Find the probability that it is defective. (b) It is defective: find the probability that it was made by $M_3$, and by $M_1$.
Find $P(M_3\,|\,\text{defective})$ to 3 decimal places:
Paths $P(M_1\cap D)=0.5\times0.02=0.010$, $\ P(M_2\cap D)=0.3\times0.03=0.009$, $\ P(M_3\cap D)=0.2\times0.04=0.008$.
(a) Total probability: $P(D)=0.010+0.009+0.008=0.027$.
(b) Bayes: $P(M_3|D)=\tfrac{0.008}{0.027}=\tfrac8{27}\approx0.296$ and $P(M_1|D)=\tfrac{10}{27}\approx0.370$ (and $P(M_2|D)=\tfrac9{27}$).
Check The three posteriors $\tfrac{10+9+8}{27}$ add to $1$ ✓. $M_3$'s share rose from $20\%$ to about $30\%$ because it is the least reliable machine.
✏️ Example 6 — Hard example: an unreliable report, and a transferred ball
(a) A man tells the truth $3$ times out of $4$. He throws a fair die and reports that it shows a six. Find the probability that it actually is a six. (b) Bag I contains $4$ white and $3$ black balls; bag II contains $2$ white and $5$ black balls. One ball is transferred at random from bag I to bag II, and then a ball is drawn at random from bag II. It is white. Find the probability that the transferred ball was white.
Find the answer to (b):
(a) Causes $E_1$: a six is thrown, $P=\tfrac16$; $E_2$: no six, $P=\tfrac56$. The evidence $A$ = "he reports a six": $P(A|E_1)=\tfrac34$ (he tells the truth), $P(A|E_2)=\tfrac14$ (he lies — taking a lie about a non-six to mean "reports six").
(a) Bayes $P(E_1|A)=\dfrac{\tfrac16\cdot\tfrac34}{\tfrac16\cdot\tfrac34+\tfrac56\cdot\tfrac14}=\dfrac{3}{3+5}=\dfrac38.$
(b) Causes White transferred: $P=\tfrac47$, then bag II has $3$ white of $8$; black transferred: $P=\tfrac37$, then $2$ white of $8$.
(b) Bayes $P(W)=\tfrac47\cdot\tfrac38+\tfrac37\cdot\tfrac28=\tfrac{12+6}{56}=\tfrac9{28}$, and $P(\text{white transferred}\,|\,W)=\dfrac{12/56}{18/56}=\dfrac23.$
⏱ Shortcut With equal denominators, Bayes is just "my path's numerator over the sum of numerators": $\tfrac{12}{12+6}$ in (b), $\tfrac{3}{3+5}$ in (a).

A disease affects $1\%$ of people. A test has sensitivity $95\%$ ($P(+\,|\,\text{ill})=0.95$) and specificity $90\%$ ($P(-\,|\,\text{well})=0.90$). A randomly chosen person tests positive. The probability that they are ill is about

Choose base rate 1%, sensitivity 95 and specificity 90 (the starting values). The lab reads $P(+)=0.1085$ and $P(\text{ill}\,|\,+)\approx0.0876$, i.e. $8.76\%$: per $10\,000$ people, $95$ true positives against $990$ false positives. $95\%$ is the sensitivity $P(+|\text{ill})$ — the inverted conditional. Now press test again: the posterior $0.0876$ becomes the new prior and a second positive test raises the probability to about $47.7\%$. Raise the base rate to $20\%$ and a single positive already gives about $70\%$.
Interactive 2 — Bayes Lab: Test Accuracy versus Base Rate

Each square is one person in a town of $1000$ (counts rounded). Red: ill and positive; pale red: ill but missed; amber: well but flagged positive; grey: well and negative. Among all the positive squares (red + amber), the red share is $P(\text{ill}\,|\,+)$. The curve (right) shows how that share depends on the base rate for the chosen test. Test again uses the posterior as the new prior (a second, independent test). Press Play to sweep the base rate.

9590
prior $P(\text{ill})$—
$P(+)$—
$P(\text{ill}\,|\,+)$—
$P(\text{well}\,|\,-)$—
⚠️ JEE Main traps

1. $P(A|B)$ is not $P(B|A)$. The test's accuracy $P(+|\text{ill})$ and the patient's worry $P(\text{ill}|+)$ can be wildly different. Bayes' theorem is the only bridge between them, and it needs the prior.

2. Independent is not mutually exclusive. Independence is $P(A\cap B)=P(A)P(B)$; mutual exclusion is $P(A\cap B)=0$. For events of positive probability they can never both hold.

3. Three events. Pairwise independence does not imply mutual independence; you also need $P(A\cap B\cap C)=P(A)P(B)P(C)$ (Exercise III.8).

4. With or without replacement. Without replacement the second draw is conditional on the first ($\tfrac47$, not $\tfrac58$); with replacement the draws are independent. Read the question.

5. "At least one" and alternating games. Use $1-P(\text{none})$, not a sum of cases; and for "first to succeed wins" games, sum the geometric series $\tfrac{p}{1-q^k}$ for the player who goes first among $k$ players.

Urn I has $1$ red and $1$ white ball; urn II has $3$ red and $1$ white. An urn is chosen at random and a ball drawn from it is red. The probability that urn II was chosen is

Exercises

Dice and coins are fair and cards come from a well-shuffled pack of $52$ unless stated otherwise. Give answers as fractions in lowest terms or as decimals.

I
Sample spaces and the probability of an event.
  • 1 A coin is tossed three times. Find the probability of at least two heads.
  • 2 Two dice are thrown. Find the probability that the sum is at least $10$.
  • 3 Two dice are thrown. Find the probability that the product of the numbers is odd.
  • 4 A card is drawn. Find the probability that it is a face card (jack, queen or king).
  • 5 The letters of EQUATION are arranged at random. Find the probability that the five vowels are together.
  • 6 Four bulbs are chosen at random from $10$, of which $3$ are defective. Find the probability that none is defective.
  • 7 The odds in favour of an event are $3:5$. Find its probability and the odds against it.
  • 8 Two different numbers are chosen at random from $1, 2, \dots, 20$. Find the probability that their sum is even.
1 $8$ outcomes; $HHT, HTH, THH, HHH$: $\tfrac48=\tfrac12$.
2 Sums $10, 11, 12$ occur in $3+2+1=6$ ways: $\tfrac6{36}=\tfrac16$.
3 Both numbers odd: $3\times3=9$ ways: $\tfrac9{36}=\tfrac14$.
4 $12$ face cards: $\tfrac{12}{52}=\tfrac3{13}$.
5 Treat the vowels E, U, A, I, O as one block: $4!$ arrangements of the block and Q, T, N, times $5!$ inside the block. $P=\tfrac{4!\,5!}{8!}=\tfrac{2880}{40320}=\tfrac1{14}$.
6 $\tfrac{{}^7C_4}{{}^{10}C_4}=\tfrac{35}{210}=\tfrac16$.
7 $P=\tfrac3{3+5}=\tfrac38$; odds against $5:3$.
8 Even sum: both even or both odd: $\tfrac{{}^{10}C_2+{}^{10}C_2}{{}^{20}C_2}=\tfrac{90}{190}=\tfrac9{19}\approx0.474$.
II
The addition theorem.
  • 1 $P(A)=0.42$, $P(B)=0.48$, $P(A\cap B)=0.16$. Find $P(A\cup B)$, $P(A'\cap B')$ and $P(A\cap B')$.
  • 2 A card is drawn. Find the probability that it is a king or a heart.
  • 3 Two dice are thrown. Find the probability of a doublet or a sum of $4$.
  • 4 $P(A\cup B)=0.8$, $P(A)=0.5$, $P(B)=0.6$. Find $P(A\cap B)$ and the probability that exactly one of $A$, $B$ occurs.
  • 5 A number is chosen at random from $1, \dots, 200$. Find the probability that it is divisible by $6$ or by $8$.
  • 6 $P(A)=P(B)=P(C)=0.4$, each pair has $P(\text{both})=0.15$ and $P(A\cap B\cap C)=0.05$. Find the probability that at least one of the three occurs.
  • 7 If $P(A)=0.7$ and $P(B)=0.6$, find the least and greatest possible values of $P(A\cap B)$.
1 $P(A\cup B)=0.42+0.48-0.16=0.74$; $P(A'\cap B')=1-0.74=0.26$; $P(A\cap B')=0.42-0.16=0.26$.
2 $\tfrac4{52}+\tfrac{13}{52}-\tfrac1{52}=\tfrac{16}{52}=\tfrac4{13}$ (the king of hearts is counted once).
3 Doublets $6$, sum $4$: $(1,3),(2,2),(3,1)$; $(2,2)$ is both: $\tfrac{6+3-1}{36}=\tfrac29$.
4 $P(A\cap B)=0.5+0.6-0.8=0.3$; exactly one $=0.8-0.3=0.5$.
5 Multiples of $6$: $33$; of $8$: $25$; of $\text{lcm}(6,8)=24$: $8$. $\tfrac{33+25-8}{200}=\tfrac{50}{200}=\tfrac14$.
6 $1.2-0.45+0.05=0.8$.
7 Least $0.7+0.6-1=0.3$ (when $A\cup B=S$); greatest $\min\{0.7,0.6\}=0.6$ (when $B\subseteq A$).
III
Conditional probability, multiplication and independence.
  • 1 $P(A)=0.6$, $P(B)=0.5$, $P(A\cap B)=0.3$. Find $P(A|B)$ and $P(B|A)$. Are $A$ and $B$ independent?
  • 2 A die shows an even number. Find the probability that it is greater than $3$.
  • 3 Two cards are drawn without replacement. Find the probability that both are aces.
  • 4 $A$ and $B$ are independent with $P(A)=0.3$, $P(B)=0.4$. Find $P(A\cup B)$ and $P(A'\cap B')$.
  • 5 Prove that if $A$ and $B$ are independent, so are $A'$ and $B'$.
  • 6 Three marksmen hit a target with probabilities $0.5$, $0.6$, $0.8$, independently. Find the probability that the target is hit, and that exactly two of them hit it.
  • 7 How many times must a fair coin be tossed so that the probability of at least one head is at least $0.99$?
  • 8 Two coins are tossed. $A$: first coin head; $B$: second coin head; $C$: exactly one head. Show that $A$, $B$, $C$ are pairwise independent but not mutually independent.
  • 9 $A$ and $B$ take turns throwing two dice, $A$ first; the first to throw a total of $9$ wins. Find the probability that $A$ wins.
1 $P(A|B)=\tfrac{0.3}{0.5}=0.6$, $P(B|A)=\tfrac{0.3}{0.6}=0.5$. Yes: $P(A)P(B)=0.3=P(A\cap B)$ (equivalently $P(A|B)=P(A)$).
2 Given $\{2,4,6\}$, favourable $\{4,6\}$: $\tfrac23$.
3 $\tfrac4{52}\cdot\tfrac3{51}=\tfrac1{221}\approx0.00452$.
4 $P(A\cup B)=0.3+0.4-0.12=0.58$; $P(A'\cap B')=0.7\times0.6=0.42=1-0.58$ ✓.
5 $P(A'\cap B')=1-P(A\cup B)=1-P(A)-P(B)+P(A)P(B)=(1-P(A))(1-P(B))=P(A')P(B')$. $\blacksquare$
6 Hit: $1-0.5\times0.4\times0.2=0.96$. Exactly two: $0.5(0.6)(0.2)+0.5(0.4)(0.8)+0.5(0.6)(0.8)=0.06+0.16+0.24=0.46$.
7 $1-\left(\tfrac12\right)^n\ge0.99\iff2^n\ge100$; $2^6=64$, $2^7=128$: $n=7$.
8 $A=\{HH,HT\}$, $B=\{HH,TH\}$, $C=\{HT,TH\}$, each of probability $\tfrac12$. $A\cap B=\{HH\}$, $A\cap C=\{HT\}$, $B\cap C=\{TH\}$, each $\tfrac14=\tfrac12\cdot\tfrac12$: pairwise independent. But $A\cap B\cap C=\phi$, so $P=0\ne\tfrac18$.
9 $P(9)=\tfrac4{36}=\tfrac19$, $q=\tfrac89$. $P(A)=\dfrac{1/9}{1-64/81}=\dfrac{1/9}{17/81}=\dfrac9{17}\approx0.529$.
IV
Total probability and Bayes' theorem.
  • 1 Bag I has $3$ red and $4$ black balls; bag II has $5$ red and $6$ black. A bag is chosen at random and a ball drawn from it. Find the probability that the ball is red.
  • 2 In part 1, the ball is red. Find the probability that it came from bag I.
  • 3 An insurer covers $2000$ scooter riders, $4000$ car drivers and $6000$ truck drivers, whose accident probabilities are $0.01$, $0.03$ and $0.15$. An insured person has an accident. Find the probability that they ride a scooter.
  • 4 Plant A makes $60\%$ of the phones, $1\%$ of them faulty; plant B makes the rest, $2\%$ faulty. Find the probability that a phone is faulty, and that a faulty phone came from B.
  • 5 In a four-option MCQ test a student knows the answer with probability $\tfrac34$ and otherwise guesses. Given that the answer is correct, find the probability that the student knew it.
  • 6 A disease affects $0.5\%$ of a population. A test detects it with probability $0.99$ and gives a false positive with probability $0.02$. Find the probability that a person who tests positive has the disease.
  • 7 A box has three coins: one two-headed, one fair, and one that shows heads with probability $0.75$. A coin is chosen at random and tossed; it shows heads. Find the probability that it is the two-headed coin.
  • 8 Modelling. $40\%$ of the emails reaching an inbox are spam. The word "offer" appears in $25\%$ of spam and in $2\%$ of genuine emails. An email contains "offer". Find the probability that it is spam.
1 $\tfrac12\cdot\tfrac37+\tfrac12\cdot\tfrac5{11}=\tfrac12\cdot\tfrac{33+35}{77}=\tfrac{34}{77}\approx0.442$.
2 $\dfrac{\tfrac12\cdot\tfrac37}{34/77}=\dfrac{3/14}{34/77}=\dfrac{33}{68}\approx0.485$.
3 Expected accidents: $20$, $120$, $900$ (out of $12000$ people). $P(\text{scooter}\,|\,\text{accident})=\tfrac{20}{1040}=\tfrac1{52}\approx0.0192$.
4 $P(F)=0.6(0.01)+0.4(0.02)=0.014$; $P(B|F)=\tfrac{0.008}{0.014}=\tfrac47\approx0.571$.
5 $\dfrac{\tfrac34\cdot1}{\tfrac34\cdot1+\tfrac14\cdot\tfrac14}=\dfrac{3/4}{13/16}=\dfrac{12}{13}\approx0.923$.
6 $\dfrac{0.005(0.99)}{0.005(0.99)+0.995(0.02)}=\dfrac{0.00495}{0.02485}\approx0.199$ — only about one positive in five is a real case.
7 $\dfrac{\tfrac13\cdot1}{\tfrac13(1+0.5+0.75)}=\dfrac1{2.25}=\dfrac49\approx0.444$.
8 $\dfrac{0.4(0.25)}{0.4(0.25)+0.6(0.02)}=\dfrac{0.1}{0.112}=\dfrac{25}{28}\approx0.893$. A spam filter based on many such words multiplies this kind of evidence together.
🎯 Exam corner JEE Main · MCQJEE Main · Numerical

E1. JEE Main · MCQ $A$ and $B$ are independent events with $P(A)=0.5$ and $P(A\cup B)=0.8$. Then $P(B)$ is (A) $0.3$ (B) $0.5$ (C) $0.6$ (D) $0.4$

Equation $0.8=0.5+p-0.5p$, so $0.5p=0.3$.
Answer (C) $p=0.6$.
⏱ Shortcut $P(A'\cap B')=0.2=P(A')P(B')=0.5\,P(B')$, so $P(B')=0.4$. (A) is what you get for mutually exclusive events.

E2. JEE Main · Numerical Two different numbers are chosen at random from $\{1,2,\dots,10\}$. If $p$ is the probability that their product is even, find $45p$. Give the answer to the nearest integer.

Complement The product is odd only if both are odd: $\tfrac{{}^5C_2}{{}^{10}C_2}=\tfrac{10}{45}$.
Even $p=1-\tfrac{10}{45}=\tfrac{35}{45}$.
Answer $45p=35$.

E3. JEE Main · MCQ Bag A has $2$ white and $3$ red balls; bag B has $4$ white and $1$ red ball. A die is thrown: if it shows $1$ or $2$, a ball is drawn from bag A, otherwise from bag B. The ball is red. The probability that it came from bag A is (A) $\tfrac25$ (B) $\tfrac35$ (C) $\tfrac13$ (D) $\tfrac34$

Paths $P(A\cap R)=\tfrac13\cdot\tfrac35=\tfrac15$; $\ P(B\cap R)=\tfrac23\cdot\tfrac15=\tfrac2{15}$.
Bayes $\dfrac{1/5}{1/5+2/15}=\dfrac{3/15}{5/15}$.
Answer (B) $\tfrac35$.
⏱ Shortcut Write both paths over $15$: $3$ and $2$, so the answer is $\tfrac{3}{3+2}$. (C) is the prior $\tfrac13$.

E4. JEE Main · Numerical $A$, $B$ and $C$, in that order, throw a fair die in turn, round after round; the first to throw a six wins. If the probability that $C$ wins is $\tfrac mn$ in lowest terms, find $m+n$. Give the answer to the nearest integer.

First round $C$ wins in round 1 with probability $\left(\tfrac56\right)^2\tfrac16=\tfrac{25}{216}$; a whole round with no six has probability $\left(\tfrac56\right)^3=\tfrac{125}{216}$.
Sum $P(C)=\dfrac{25/216}{1-125/216}=\dfrac{25}{91}$ (and $P(A)=\tfrac{36}{91}$, $P(B)=\tfrac{30}{91}$).
Answer $m+n=25+91=116$.
Check $36+30+25=91$ ✓, and the ratio $36:30:25$ is $1:\tfrac56:\tfrac{25}{36}$.

E5. JEE Main · MCQ For events $A$ and $B$, $P(A)=\tfrac14$, $P(B\,|\,A)=\tfrac12$ and $P(A\,|\,B)=\tfrac14$. Which statement is true? (A) $A$ and $B$ are mutually exclusive (B) $P(A'\,|\,B)=\tfrac12$ (C) $P(B)=\tfrac14$ (D) $A$ and $B$ are independent

Find $P(B)$ $P(A\cap B)=P(A)P(B|A)=\tfrac18$, and $P(B)=\tfrac{P(A\cap B)}{P(A|B)}=\tfrac{1/8}{1/4}=\tfrac12$.
Test $P(A)P(B)=\tfrac18=P(A\cap B)$: independent. (A) fails since $P(A\cap B)\ne0$; (B) gives $1-\tfrac14=\tfrac34$; (C) is false.
Answer (D).
⏱ Shortcut $P(A|B)=\tfrac14=P(A)$ already says that $B$ does not change the chance of $A$ — independence in one line.

E6. JEE Main · Numerical A box contains $5$ coins: one is two-headed and four are fair. A coin is chosen at random and tossed three times, showing heads every time. If $p$ is the probability that the coin is two-headed, find $100p$. Give the answer to the nearest integer.

Paths Two-headed: $\tfrac15\cdot1=\tfrac15$. Fair: $\tfrac45\cdot\left(\tfrac12\right)^3=\tfrac1{10}$ (the three tosses are independent).
Bayes $p=\dfrac{1/5}{1/5+1/10}=\dfrac23$.
Answer $100p=66.67\ldots$, which rounds to $67$.
🔬 Research–Teaching NexusResearch-tutored · optional, about 45 minutes

Research question. When a population is screened for a rare condition, how many of the positive results are false alarms — and what is the most effective way to reduce them: a better test, or a second test?

Why it matters. Screening programmes — newborn screening, cancer screening, airport security, fraud detection in banking — all face the base-rate problem of Interactive 2. Each false positive costs money and anxiety and may lead to unnecessary procedures; each false negative misses a real case. Health agencies decide whom to screen and how to confirm results using exactly the calculation of Theorem 13.11.

What to do.

  1. Choose a real screening setting and look up (from a public health agency's website) a typical prevalence and the sensitivity and specificity of the test. If you cannot find figures, use prevalence $0.5\%$, sensitivity $90\%$, specificity $95\%$.
  2. Compute $P(\text{ill}\,|\,+)$ with Bayes' theorem and check it in Interactive 2. Express it as "out of every $100$ positives, about … are real".
  3. Option 1: improve the specificity to $99\%$. Option 2: keep the test but retest every positive with an independent second test of the same quality. Compute $P(\text{ill}\,|\,{+}{+})$ for option 2.
  4. For each option estimate, per $100\,000$ people screened, the number of false positives and the number of tests used.

Tools: Interactive 2, a calculator or spreadsheet; optionally a short simulation in Python.

Hand in: A one-page memo to a health officer recommending one option, with your calculations and one sentence on what the "independent second test" assumption means in practice.

Going further. Screening only a high-risk group raises the base rate. Recompute $P(\text{ill}|+)$ when the prevalence in the screened group is $10$ times higher. Which lever — test quality or targeting — has the bigger effect?

Instructor note: with the default figures, $P(\text{ill}|+)\approx8.3\%$; a second independent positive raises it to about $62\%$, and specificity $99\%$ alone gives about $31\%$. Discuss why two tests on the same person are rarely fully independent (the same biological cause can fool both), so real gains are smaller than the formula suggests.

🧪 Self-check quiz

0/5 correct

Q1. $A$ and $B$ are mutually exclusive with $P(A)=0.3$ and $P(B)=0.5$. Then $P(A\cup B)$ is

Q2. $A$ and $B$ are mutually exclusive and both have positive probability. Then $A$ and $B$ are

Q3. $P(A\cap B)=0.1$ and $P(B)=0.4$. Then $P(A\,|\,B)$ is

Q4. Machine X makes $70\%$ of the items with $1\%$ faulty, machine Y makes $30\%$ with $3\%$ faulty. A faulty item is found. The probability that Y made it is

Q5. A fair die is thrown three times. The probability of at least one six is