Chapter 8 · Sample Surveys and Design of Experiments

8.1 Simple Random, Stratified and Systematic Sampling

How to estimate a population mean, total or proportion from a probability sample: simple random sampling with and without replacement and the finite population correction, stratification and the allocation of the sample to strata, and systematic sampling with its strengths (trends) and its weaknesses (periodicity).

A statistical office that wants the average monthly expenditure of the households of a state cannot visit them all. It chooses a few thousand households by a random mechanism, measures them, and publishes an estimate with a standard error. Two features make this different from the iid sampling of Chapter 4. The population is finite and completely specified: there are $N$ households with fixed (unknown) values $Y_1,\dots,Y_N$, and the only randomness is the one we introduce when we draw the sample. And the statistician designs that randomness: she can sample without replacement, split the population into strata and sample each separately, or take every $k$-th household from a list. Each choice changes the variance of the estimator, sometimes dramatically, and the whole subject consists of computing these variances exactly and choosing the design that makes them small for a given cost.

This section covers the three basic designs. Simple random sampling gives the finite population correction $1-n/N$ and the formulae for sample size. Stratified sampling gives the allocation problem, solved by Neyman's allocation and its cost version, together with an exact account of when stratification helps. Systematic sampling is the cheapest design in the field. It is excellent for populations with a trend and disastrous for periodic ones, and the reason is one variance identity. CSIR NET asks for these variance formulae in Part B, and in Part C it asks which statements about unbiasedness, allocation and efficiency are true. The traps are listed in the ⚠️ box.

Finite Populations and Simple Random Sampling

Throughout, the population is a finite set of labelled units $U=\{1,2,\dots,N\}$, and the characteristic of interest takes the fixed value $Y_i$ on unit $i$. Following the standard convention of survey sampling, population quantities are written in capitals and sample quantities in lower case ($\bar y$, $s^2$, $y_1,\dots,y_n$), even though the sample quantities are random variables. The only randomness comes from the selection of the sample.

📘 Definition 8.1 — Population parameters, sampling designs, SRSWOR and SRSWR

The population total, mean and the two population variances are

$$Y=\sum_{i=1}^NY_i,\qquad \bar Y=\frac YN,$$ $$\sigma^2=\frac1N\sum_{i=1}^N(Y_i-\bar Y)^2,\qquad S^2=\frac1{N-1}\sum_{i=1}^N(Y_i-\bar Y)^2=\frac{N}{N-1}\sigma^2 .$$

A sampling design is a probability distribution $p(\cdot)$ on a collection of possible samples (ordered sequences or unordered subsets of $U$). The sampling frame is the list of units from which the sample is drawn. With $n$ the sample size and $f=n/N$ the sampling fraction:

  • Simple random sampling without replacement (SRSWOR): each of the $\binom Nn$ subsets of size $n$ has probability $1/\binom Nn$. Equivalently, draw units one at a time, each time choosing with equal probability among the units not yet drawn.
  • Simple random sampling with replacement (SRSWR): $n$ independent draws, each choosing every unit with probability $1/N$; each of the $N^n$ ordered sequences has probability $N^{-n}$.

From the sample values $y_1,\dots,y_n$ we form the sample mean $\bar y=\frac1n\sum_{j=1}^ny_j$ and the sample variance $s^2=\frac1{n-1}\sum_{j=1}^n(y_j-\bar y)^2$. The inclusion probability of unit $i$ is $\pi_i=P(i\in s)$, and $\pi_{ij}=P(i\in s,\ j\in s)$ for $i\ne j$.

The divisor $N-1$ in $S^2$ is not a matter of taste. We will see that $S^2$, not $\sigma^2$, is the quantity that $s^2$ estimates without bias under SRSWOR, and the formulae for variances come out cleanest in terms of $S^2$.

📐 Theorem 8.1 — Inclusion indicators under SRSWOR

Under SRSWOR of size $n$ ($1\le n\le N$, $N\ge2$) let $Z_i=1$ if unit $i$ is in the sample and $Z_i=0$ otherwise. Then $\sum_{i=1}^NZ_i=n$ and, for $i\ne j$,

$$\pi_i=E[Z_i]=\frac nN=f,\qquad \pi_{ij}=E[Z_iZ_j]=\frac{n(n-1)}{N(N-1)},$$ $$\operatorname{Var}(Z_i)=f(1-f),\qquad \operatorname{Cov}(Z_i,Z_j)=-\frac{f(1-f)}{N-1}.$$

Proof. The samples containing unit $i$ are obtained by choosing the other $n-1$ members from the remaining $N-1$ units, so $\pi_i=\binom{N-1}{n-1}\big/\binom Nn=\frac nN$. Similarly the samples containing both $i$ and $j$ number $\binom{N-2}{n-2}$, and $\binom{N-2}{n-2}\big/\binom Nn=\frac{n(n-1)}{N(N-1)}$. Since $Z_i^2=Z_i$, $\operatorname{Var}(Z_i)=f-f^2$. Finally

$$\operatorname{Cov}(Z_i,Z_j)=\frac{n(n-1)}{N(N-1)}-\frac{n^2}{N^2}=\frac nN\cdot\frac{N(n-1)-n(N-1)}{N(N-1)}=-\frac nN\cdot\frac{N-n}{N(N-1)},$$

which is $-f(1-f)/(N-1)$. ∎

The negative covariance has a plain meaning: if unit $i$ takes one of the $n$ places, fewer places are left for unit $j$. It is this negative dependence that makes sampling without replacement more precise than sampling with replacement.

📐 Theorem 8.2 — The sample mean under SRSWOR

Under SRSWOR of size $n$ with $2\le n\le N$,

  1. $\bar y$ is unbiased for $\bar Y$, and $\hat Y=N\bar y$ is unbiased for the total $Y$;
  2. the variance of the sample mean carries the finite population correction (fpc) $1-f$: $$\operatorname{Var}(\bar y)=\frac{(1-f)\,S^2}{n}=\Big(\frac1n-\frac1N\Big)S^2,\qquad \operatorname{Var}(N\bar y)=\frac{N^2(1-f)S^2}{n};$$
  3. $E[s^2]=S^2$, so $v(\bar y)=\dfrac{(1-f)\,s^2}{n}$ is an unbiased estimator of $\operatorname{Var}(\bar y)$.

Proof. Write $\bar y=\frac1n\sum_{i=1}^NZ_iY_i$, a sum over the whole population in which only the sampled units count. (1) $E[\bar y]=\frac1n\sum_i\frac nNY_i=\bar Y$.

(2) Put $D_i=Y_i-\bar Y$, so that $\sum_iD_i=0$. Because $\sum_iZ_i=n$, we have $\bar y-\bar Y=\frac1n\sum_iZ_iD_i$. By Theorem 8.1,

$$n^2\operatorname{Var}(\bar y)=f(1-f)\sum_iD_i^2-\frac{f(1-f)}{N-1}\sum_{i\ne j}D_iD_j .$$

Since $0=\left(\sum_iD_i\right)^2=\sum_iD_i^2+\sum_{i\ne j}D_iD_j$, the cross sum equals $-\sum_iD_i^2$. Hence $n^2\operatorname{Var}(\bar y)=f(1-f)\frac{N}{N-1}\sum_iD_i^2=f(1-f)NS^2$, and dividing by $n^2$ (with $fN=n$) gives $\operatorname{Var}(\bar y)=(1-f)S^2/n$.

(3) Expanding about $\bar Y$ gives the identity $(n-1)s^2=\sum_iZ_iD_i^2-n(\bar y-\bar Y)^2$. Taking expectations, $E\sum_iZ_iD_i^2=\frac nN(N-1)S^2$ and $nE(\bar y-\bar Y)^2=(1-f)S^2=\frac{N-n}{N}S^2$, so

$$(n-1)E[s^2]=\frac{n(N-1)-(N-n)}{N}S^2=\frac{(n-1)N}{N}S^2=(n-1)S^2 .\ ∎$$
📐 Theorem 8.3 — The sample mean under SRSWR, and the gain from not replacing

Under SRSWR of size $n\ge2$ the draws $y_1,\dots,y_n$ are iid, each uniform on $\{Y_1,\dots,Y_N\}$. Hence $E[\bar y]=\bar Y$, $E[s^2]=\sigma^2$ and

$$\operatorname{Var}_{\mathrm{WR}}(\bar y)=\frac{\sigma^2}{n}=\frac{N-1}{N}\cdot\frac{S^2}{n}.$$

For the same $n$, $\dfrac{\operatorname{Var}_{\mathrm{WOR}}(\bar y)}{\operatorname{Var}_{\mathrm{WR}}(\bar y)}=\dfrac{N-n}{N-1}\le1$, with equality only when $n=1$.

Proof. A single draw takes the value $Y_i$ with probability $1/N$, so it has mean $\bar Y$ and variance $\frac1N\sum(Y_i-\bar Y)^2=\sigma^2$. The draws are independent, so the moments of the mean of an iid sample (§4.1) give $E\bar y=\bar Y$, $\operatorname{Var}\bar y=\sigma^2/n$ and $Es^2=\sigma^2$. The ratio is $\frac{(1-f)S^2/n}{(N-1)S^2/(Nn)}=\frac{N-n}{N-1}$. ∎

So the fpc matters only when the sampling fraction is appreciable. For $N=10^6$ and $n=1000$ it is $0.999$. The precision of $\bar y$ then depends on $n$ and on $S^2$, almost not at all on $N$. A sample of $1000$ is about as informative about a country as about a city with the same variability. This surprises almost everyone the first time.

Confidence intervals. For large $n$ and $N-n$, a finite-population central limit theorem (due to Erdős–Rényi and Hájek; we quote it) makes $(\bar y-\bar Y)/\sqrt{\operatorname{Var}(\bar y)}$ approximately $N(0,1)$, provided no small group of units dominates $S^2$. With $s^2$ in place of $S^2$, the approximate $100(1-\alpha)\%$ interval is

$$\bar y\pm z_{\alpha/2}\,s\sqrt{\frac{1-f}{n}}.$$

Here $z_{\alpha/2}=\Phi^{-1}(1-\alpha/2)$, so $z_{0.025}=1.960$.

📐 Theorem 8.4 — Estimating a proportion

Suppose $Y_i\in\{0,1\}$, so that $\bar Y=P$ is the proportion of units with the attribute; put $Q=1-P$, and let $p=\bar y$ be the sample proportion and $q=1-p$. Under SRSWOR with $2\le n\le N$:

$$S^2=\frac{NPQ}{N-1},\qquad E[p]=P,\qquad \operatorname{Var}(p)=\frac{N-n}{N-1}\cdot\frac{PQ}{n},$$

and $v(p)=\dfrac{(1-f)\,pq}{n-1}$ is unbiased for $\operatorname{Var}(p)$. The number $np$ of sampled units with the attribute is hypergeometric (§2.1).

Proof. With $0/1$ values $\sum Y_i^2=\sum Y_i=NP$, so $(N-1)S^2=NP-NP^2=NPQ$. Theorem 8.2(2) gives $\operatorname{Var}(p)=\frac{N-n}{Nn}\cdot\frac{NPQ}{N-1}$. In the same way $(n-1)s^2=np-np^2=npq$, so $v(p)=(1-f)s^2/n=(1-f)pq/(n-1)$, which is unbiased by Theorem 8.2(3). The count $np$ is the number of "successes" in $n$ draws without replacement from $NP$ successes and $NQ$ failures. ∎

📐 Theorem 8.5 — Sample size for a prescribed margin of error

Under SRSWOR with the normal approximation, $P(|\bar y-\bar Y|\le d)\approx1-\alpha$ holds exactly when $z_{\alpha/2}^2\left(\frac1n-\frac1N\right)S^2=d^2$, that is, when

$$n=\frac{n_0}{1+n_0/N},\qquad n_0=\Big(\frac{z_{\alpha/2}\,S}{d}\Big)^2 .$$

Here $n_0$ is the size needed if $N$ were infinite (or with replacement). For a proportion, with $S^2=NPQ/(N-1)$, the solution is

$$n=\frac{n_0}{1+(n_0-1)/N},\qquad n_0=\frac{z_{\alpha/2}^2\,PQ}{d^2}.$$

Since $PQ\le\frac14$, the choice $P=\frac12$ gives a size that works whatever $P$ is. For a relative margin $|\bar y-\bar Y|\le r\bar Y$, replace $S/d$ by $C/r$, where $C=S/\bar Y$ is the coefficient of variation.

Proof. Solving $\frac1n=\frac1N+\frac{d^2}{z^2S^2}=\frac1N+\frac1{n_0}$ gives $n=\frac{Nn_0}{N+n_0}$. For a proportion, $\frac1n=\frac1N+\frac{d^2(N-1)}{z^2NPQ}=\frac1N+\frac{N-1}{Nn_0}=\frac{n_0+N-1}{Nn_0}$. In both cases $n$ increases with $S$ (or with $PQ$), which proves the worst-case remark. The relative version is the same equation with $d=r\bar Y$. ∎

In practice $S$ is unknown at the planning stage. It is taken from a pilot survey, a previous round of the same survey, or a rough guess such as "range$/4$". Then $n$ is rounded up.

✏️ Example 1 — The whole sampling distribution for a tiny population
A population has $N=5$ units with values $2,4,5,7,12$. A sample of $n=2$ is drawn by SRSWOR. List all possible samples with $\bar y$ and $s^2$, and verify Theorem 8.2. Compare with SRSWR.
Population $\bar Y=30/5=6$; deviations $-4,-2,-1,1,6$; $\sum D_i^2=58$, so $S^2=58/4=14.5$ and $\sigma^2=58/5=11.6$.
All 10 samples $(\bar y,s^2)$ for $\{2,4\},\{2,5\},\{2,7\},\{2,12\},\{4,5\}$: $(3,2)$, $(3.5,4.5)$, $(4.5,12.5)$, $(7,50)$, $(4.5,0.5)$. For $\{4,7\},\{4,12\},\{5,7\},\{5,12\},\{7,12\}$: $(5.5,4.5)$, $(8,32)$, $(6,2)$, $(8.5,24.5)$, $(9.5,12.5)$.
Check The ten means average $60/10=6=\bar Y$. Their variance is $\frac1{10}\sum(\bar y-6)^2=\frac{43.5}{10}=4.35$, and the formula gives $(1-\frac25)\frac{14.5}{2}=0.6\times7.25=4.35$. The $s^2$ values sum to $145$, so $E[s^2]=14.5=S^2$.
SRSWR $\operatorname{Var}(\bar y)=\sigma^2/n=5.8$ (enumerating all $25$ ordered pairs confirms it), and there $E[s^2]=11.6=\sigma^2$. The ratio $4.35/5.8=0.75=\frac{N-n}{N-1}$, as Theorem 8.3 says.
✏️ Example 2 — How many households to interview?
A district has $N=4000$ households. A survey must estimate the proportion $P$ that use clean cooking fuel to within $\pm0.05$ with $95\%$ confidence. Find $n$ (a) with no prior knowledge of $P$; (b) if an earlier survey suggests $P\approx0.3$. (c) How large must $n$ be in (a) if the district had $4$ million households?
(a) Worst case $PQ=\frac14$: $n_0=\frac{1.96^2\times0.25}{0.05^2}=384.16$. Then $n=\frac{384.16}{1+383.16/4000}=350.58$, so we interview $\mathbf{351}$ households.
(b) $PQ=0.21$: $n_0=\frac{3.8416\times0.21}{0.0025}=322.69$ and $n=\frac{322.69}{1+321.69/4000}=298.67$, so $\mathbf{299}$.
(c) With $N=4\times10^6$ the correction is negligible: $n=384.16/(1+383.16/4\times10^6)=384.12$, i.e. $385$. A thousandfold larger population needs only $10\%$ more interviews.
Check In (a), $\operatorname{Var}(p)=\frac{N-n}{N-1}\frac{PQ}{n}$ at $n=351$, $P=\frac12$ is $\frac{3649}{3999}\cdot\frac{0.25}{351}=6.50\times10^{-4}$; $1.96\sqrt{6.50\times10^{-4}}=0.0500$ ✓.
✏️ Example 3 — Prove or disprove: with and without replacement
Decide each statement. (a) For every population and every $n\ge2$, SRSWOR gives a mean with variance no larger than SRSWR. (b) Under SRSWR, $s^2$ is unbiased for $S^2$. (c) Under SRSWR, let $\nu$ be the number of distinct units drawn and $\bar y_\nu$ the mean of their values. Then $\bar y_\nu$ is unbiased for $\bar Y$ and $\operatorname{Var}(\bar y_\nu)\le\operatorname{Var}(\bar y)$.
(a) True By Theorem 8.3, the ratio of the variances is $\frac{N-n}{N-1}\le1$ for every population.
(b) False $E[s^2]=\sigma^2=\frac{N-1}NS^2\ne S^2$ whenever $S^2\gt0$. In Example 1 the average of $s^2$ over the $25$ ordered pairs is $11.6$, not $14.5$.
(c) True Let $D$ be the set of distinct units drawn. Given $D$, the arrangement of the $n$ draws is symmetric in the units of $D$, so each unit of $D$ has conditional expected multiplicity $n/\nu$. Hence $$E[\bar y\mid D]=\frac1n\sum_{i\in D}\frac n\nu Y_i=\bar y_\nu .$$ Given $\nu=m$, every $m$-subset is equally likely to be $D$, so $\bar y_\nu$ is the mean of an SRSWOR of size $m$ and $E[\bar y_\nu\mid\nu]=\bar Y$; the tower property gives $E\bar y_\nu=\bar Y$. Finally $\operatorname{Var}(\bar y)=\operatorname{Var}(E[\bar y\mid D])+E\operatorname{Var}(\bar y\mid D)\ge\operatorname{Var}(\bar y_\nu)$. This is the Rao–Blackwell theorem (§4.2) in a finite population, because $D$ is sufficient.

Stratified Random Sampling and Allocation

If the population splits naturally into groups that are internally alike — urban and rural blocks, small and large farms, age bands — we can sample each group separately. The variability between groups then never enters the error, and we may also spend more of the sample where the variability is larger or the interviews are cheaper.

📘 Definition 8.2 — Stratified random sampling

The population is partitioned into $L$ strata $U_1,\dots,U_L$ of sizes $N_1,\dots,N_L$ ($\sum N_h=N$), with stratum weights $W_h=N_h/N$, stratum means $\bar Y_h$ and stratum variances $S_h^2=\frac1{N_h-1}\sum_{i\in U_h}(Y_i-\bar Y_h)^2$. In stratified random sampling an SRSWOR of size $n_h$ is drawn from each stratum, independently across strata, with $n=\sum n_h$. With $\bar y_h$ and $s_h^2$ the sample mean and variance in stratum $h$ and $f_h=n_h/N_h$, the stratified mean is

$$\bar y_{\mathrm{st}}=\sum_{h=1}^LW_h\,\bar y_h .$$
📐 Theorem 8.6 — Mean and variance of the stratified estimator

Under stratified random sampling, $\bar y_{\mathrm{st}}$ is unbiased for $\bar Y$ and

$$\operatorname{Var}(\bar y_{\mathrm{st}})=\sum_{h=1}^LW_h^2\,\frac{(1-f_h)S_h^2}{n_h}=\sum_hW_h^2\frac{S_h^2}{n_h}-\frac1N\sum_hW_hS_h^2 .$$

If every $n_h\ge2$, then $v(\bar y_{\mathrm{st}})=\sum_hW_h^2(1-f_h)s_h^2/n_h$ is unbiased for this variance. The total is estimated by $N\bar y_{\mathrm{st}}=\sum_hN_h\bar y_h$.

Proof. By Theorem 8.2 applied inside stratum $h$, $E\bar y_h=\bar Y_h$, $\operatorname{Var}\bar y_h=(1-f_h)S_h^2/n_h$ and $Es_h^2=S_h^2$. Hence $E\bar y_{\mathrm{st}}=\sum W_h\bar Y_h=\frac1N\sum_h N_h\bar Y_h=\bar Y$. The $\bar y_h$ are independent, so the variance of the weighted sum is $\sum W_h^2\operatorname{Var}\bar y_h$. The second form uses $W_h^2/N_h=W_h/N$. ∎

Note that $\bar y_{\mathrm{st}}$ weights each stratum mean by the population share $W_h$. It is not, in general, the plain average of all $n$ sampled values.

📘 Definition 8.3 — Allocations

Let the cost of the survey be $C=c_0+\sum_hc_hn_h$, where $c_h$ is the cost of observing one unit in stratum $h$. An allocation is a choice of $(n_1,\dots,n_L)$. The standard ones are

  • proportional allocation: $n_h=nW_h$, i.e. $f_h=f$ for every $h$;
  • Neyman allocation: $n_h=n\,\dfrac{N_hS_h}{\sum_kN_kS_k}$;
  • optimum allocation (with costs): $n_h\propto\dfrac{N_hS_h}{\sqrt{c_h}}$.
📐 Theorem 8.7 — Optimum allocation (Tschuprow–Neyman)

Treat the $n_h$ as positive real numbers and ignore the constraints $n_h\le N_h$.

  1. For a fixed budget $C$, $\operatorname{Var}(\bar y_{\mathrm{st}})$ is minimised exactly when $n_h\propto W_hS_h/\sqrt{c_h}$, that is, when $$n_h=(C-c_0)\,\frac{N_hS_h/\sqrt{c_h}}{\sum_kN_kS_k\sqrt{c_k}} .$$
  2. For a fixed variance $V$, the cost is minimised by the same allocation, and the total sample size is $$n=\frac{\left(\sum_hW_hS_h\sqrt{c_h}\right)\left(\sum_hW_hS_h/\sqrt{c_h}\right)}{V+\frac1N\sum_hW_hS_h^2}.$$
  3. If all $c_h$ are equal (or $n$ is fixed), the optimum is Neyman allocation, with $$V_{\mathrm{Ney}}=\frac{\left(\sum_hW_hS_h\right)^2}{n}-\frac1N\sum_hW_hS_h^2 .$$

Proof. Write $V'=\operatorname{Var}(\bar y_{\mathrm{st}})+\frac1N\sum W_hS_h^2=\sum_hW_h^2S_h^2/n_h$, which differs from the variance by a constant, and $C'=C-c_0=\sum c_hn_h$. By the Cauchy–Schwarz inequality, applied to $a_h=\sqrt{c_hn_h}$ and $b_h=W_hS_h/\sqrt{n_h}$,

$$V'C'=\Big(\sum_h b_h^2\Big)\Big(\sum_h a_h^2\Big)\ge\Big(\sum_ha_hb_h\Big)^2=\Big(\sum_hW_hS_h\sqrt{c_h}\Big)^2 .$$

The right side does not depend on the allocation, and equality holds if and only if $b_h/a_h=W_hS_h/(n_h\sqrt{c_h})$ is the same for all $h$, i.e. $n_h\propto W_hS_h/\sqrt{c_h}$. So for fixed $C'$ the product, hence $V'$, is smallest exactly at this allocation; for fixed $V'$ the same argument minimises $C'$. This proves the optimality claims in (1) and (2). The constant of proportionality in (1) comes from $\sum c_hn_h=C'$. In (2), if $n_h=KW_hS_h/\sqrt{c_h}$, then $V'=\sum W_hS_h\sqrt{c_h}/K$. This fixes $K$, and $n=K\sum W_hS_h/\sqrt{c_h}$. For (3) put $c_h\equiv1$, so $n_h=nW_hS_h/\sum W_kS_k$, and $\sum W_h^2S_h^2/n_h=(\sum W_hS_h)^2/n$. ∎

The rule is easy to remember: sample more in a stratum that is larger, more variable, or cheaper to observe — in proportion to size, in proportion to the standard deviation, and inversely to the square root of the unit cost.

📐 Theorem 8.8 — Gain in precision from stratification

Let $V_{\mathrm{ran}}=(1-f)S^2/n$ (SRSWOR of size $n$), $V_{\mathrm{prop}}$ the variance under proportional allocation, and $V_{\mathrm{Ney}}$ that under Neyman allocation, all with the same $n$. Then

$$V_{\mathrm{prop}}=\frac{1-f}{n}\sum_hW_hS_h^2,\qquad V_{\mathrm{prop}}-V_{\mathrm{Ney}}=\frac1n\sum_hW_h\big(S_h-\bar S\big)^2\ge0,$$

where $\bar S=\sum_hW_hS_h$. Moreover

$$V_{\mathrm{ran}}-V_{\mathrm{prop}}=\frac{1-f}{n(N-1)}\Big[\sum_hN_h(\bar Y_h-\bar Y)^2-\frac1N\sum_h(N-N_h)S_h^2\Big].$$

This can be negative. If every $N_h$ is large, so that terms of order $1/N_h$ are negligible, it is approximately $\frac{1-f}{n}\sum_hW_h(\bar Y_h-\bar Y)^2\ge0$. Then $V_{\mathrm{ran}}\ge V_{\mathrm{prop}}\ge V_{\mathrm{Ney}}$.

Proof. With $n_h=nW_h$ we have $f_h=f$ and $W_h^2/n_h=W_h/n$, which gives $V_{\mathrm{prop}}$. Subtracting the formula of Theorem 8.7(3),

$$V_{\mathrm{prop}}-V_{\mathrm{Ney}}=\frac1n\Big[\sum_hW_hS_h^2-\Big(\sum_hW_hS_h\Big)^2\Big]=\frac1n\sum_hW_h(S_h-\bar S)^2,$$

which is a "variance of the $S_h$" and is therefore non-negative. For the comparison with SRS we use the analysis-of-variance identity for the population (§6.2):

$$(N-1)S^2=\sum_h(N_h-1)S_h^2+\sum_hN_h(\bar Y_h-\bar Y)^2 .$$

It gives

$$(N-1)\Big[S^2-\sum_h W_hS_h^2\Big]=\sum_h N_h(\bar Y_h-\bar Y)^2+\sum_hd_hS_h^2,$$

with $d_h=N_h-1-\frac{(N-1)N_h}N=-\frac{N-N_h}{N}$. Multiplying by $(1-f)/(n(N-1))$ gives the stated difference. For large $N_h$ the term $\frac1N\sum(N-N_h)S_h^2$ is of smaller order than $\sum N_h(\bar Y_h-\bar Y)^2$ unless the stratum means are (nearly) equal, and $\frac{N_h}{N-1}\approx W_h$. ∎

So stratification gains through two channels. Proportional allocation removes the between-strata variation $\sum W_h(\bar Y_h-\bar Y)^2$. Neyman allocation adds a further gain when the $S_h$ differ. A stratification is worth making when the strata means differ, or when the strata variances differ.

🧭 Problem-solving strategy — Planning a stratified survey
  1. Tabulate $N_h$, $W_h$, a guess of $S_h$ (pilot or past survey) and, if relevant, $c_h$.
  2. Compute the allocation: $W_h$ (proportional), $N_hS_h$ (Neyman) or $N_hS_h/\sqrt{c_h}$ (cost). Normalise to the total $n$ or to the budget $C-c_0$.
  3. If some $n_h\gt N_h$, take a census of that stratum ($n_h=N_h$, contributing zero variance) and re-allocate the rest of the sample among the other strata by the same rule.
  4. Round to integers keeping $\sum n_h=n$, and make sure that $n_h\ge2$ wherever a variance estimate is needed.
  5. Evaluate $\operatorname{Var}(\bar y_{\mathrm{st}})=\sum W_h^2(1-f_h)S_h^2/n_h$ and compare with $(1-f)S^2/n$ to report the gain.
✏️ Example 4 — Three allocations for a farm survey
A district has $N=1000$ farms in three size classes:
stratum $h$smallmediumlarge
$N_h$600300100
$\bar Y_h$ (quintals)2040100
$S_h$51040
$c_h$ (cost units)1416
(a) For $n=100$ find the proportional and Neyman allocations and the variances of $\bar y_{\mathrm{st}}$, and compare with SRSWOR. (b) With a field budget $C-c_0=1000$, find the optimum allocation and its variance.
Allocations $W_h=0.6,0.3,0.1$, so proportional allocation gives $(60,30,10)$. For Neyman, $N_hS_h=3000,3000,4000$ with sum $10000$, giving $(30,30,40)$.
Variances $\sum W_hS_h^2=15+30+160=205$, so $V_{\mathrm{prop}}=(0.01-0.001)\times205=1.845$. Next $\sum W_hS_h=3+3+4=10$, so $V_{\mathrm{Ney}}=10^2/100-205/1000=0.795$. Check with Theorem 8.8: $\frac1{100}\sum W_h(S_h-10)^2=\frac{15+0+90}{100}=1.05=1.845-0.795$ ✓.
SRS $\bar Y=12+12+10=34$. By the ANOVA identity, $(N-1)S^2=\sum(N_h-1)S_h^2+\sum N_h(\bar Y_h-\bar Y)^2=203275+564000=767275$, so $S^2=767275/999=768.04$. Then $V_{\mathrm{ran}}=0.009\times768.04=6.912$. Stratification with Neyman allocation is $6.912/0.795\approx8.7$ times as efficient: the large farms are few, very different and very variable.
(b) Costs $N_hS_h/\sqrt{c_h}=3000,1500,1000$ and $\sum N_hS_h\sqrt{c_h}=3000+6000+16000=25000$. So $n_h=1000\times(3000,1500,1000)/25000=(120,60,40)$, $n=220$, and the cost is $120+240+640=1000$ ✓. The variance is $\frac{0.36\cdot25}{120}+\frac{0.09\cdot100}{60}+\frac{0.01\cdot1600}{40}-0.205=0.420$.
Compare With the same budget, proportional allocation can afford $n=1000/\sum W_hc_h=1000/3.4=294$ farms, with variance $0.492$, and Neyman allocation $n=126.6$, with variance $0.585$. The cost-optimum $0.420$ beats both, as Theorem 8.7 promises.
✏️ Example 5 — Prove or disprove: "proportional stratification never hurts"
Show by an exact example that proportional allocation can give a larger variance than SRSWOR of the same size, and explain why this does not contradict the usual statement $V_{\mathrm{prop}}\le V_{\mathrm{ran}}$.
Population Take $N=8$ units in two strata of $4$, each stratum with values $1,2,3,4$, and $n=4$. Proportional allocation takes $n_1=n_2=2$.
Variances Each $S_h^2=5/3$, so $V_{\mathrm{prop}}=(\frac14-\frac18)\cdot\frac53=0.2083$. The whole population $\{1,2,3,4,1,2,3,4\}$ has $S^2=10/7$, so $V_{\mathrm{ran}}=\frac18\cdot\frac{10}7=0.1786\lt0.2083$. Enumerating all $36$ stratified samples and all $70$ simple random samples confirms both numbers.
Why The stratum means are equal, so the between-strata term in Theorem 8.8 vanishes. What is left is $-\frac1N\sum(N-N_h)S_h^2\lt0$: $\frac{1-f}{n(N-1)}\cdot(-\frac53)=-0.0298=0.1786-0.2083$ ✓. The statement $V_{\mathrm{prop}}\le V_{\mathrm{ran}}$ is the large-$N_h$ approximation. It fails only when the strata are useless, and then only by a term of order $1/N$.
Interactive 1 — Stratify or Not? Three Designs Sampled Side by Side

A fixed population of $N=120$ units in three strata ($N_h=60,40,20$ with $S_h=2,6,12$). Each step draws a sample of $n=30$ in three ways: SRSWOR, proportional allocation $(15,10,5)$ and Neyman allocation $(6,12,12)$. The estimates pile up in the three histograms. The left panel shows the population and the current Neyman sample. Move the slider to pull the stratum means apart. Proportional allocation gains only from that separation, while Neyman allocation also gains from the unequal $S_h$.

6
samples drawn—
SRS: SE exact / observed—
proportional: SE exact / observed—
Neyman: SE exact / observed—

Systematic Sampling

In the field the easiest way to pick $40$ houses out of $400$ on a list is to start at a random house among the first ten and then take every tenth. This is systematic sampling. It needs a single random number, it is easy to supervise, and it spreads the sample evenly over the list. Its precision depends entirely on how the list is ordered.

📘 Definition 8.4 — Linear and circular systematic sampling

Let $N=nk$ with integers $n,k\ge2$, and let the units be in a fixed order $1,\dots,N$. A (linear) systematic sample with sampling interval $k$ chooses a random start $r$ uniformly from $\{1,\dots,k\}$ and takes the units $r,\ r+k,\ r+2k,\ \dots,\ r+(n-1)k$. Write $y_{rj}=Y_{r+(j-1)k}$ ($j=1,\dots,n$) for the values of the $r$-th possible sample and $\bar y_r$ for its mean. Then $\bar y_{\mathrm{sys}}=\bar y_r$ with probability $1/k$ each. Define the within-sample variance

$$S^2_{\mathrm{wsy}}=\frac1{k(n-1)}\sum_{r=1}^k\sum_{j=1}^n(y_{rj}-\bar y_r)^2 .$$

Define also the intraclass correlation between pairs of units in the same systematic sample:

$$\rho_w=\frac{\sum_{r=1}^k\sum_{j\ne j'}(y_{rj}-\bar Y)(y_{rj'}-\bar Y)}{N(n-1)\,\sigma^2}.$$

If $N$ is not a multiple of $n$, circular systematic sampling takes $k$ to be the integer nearest to $N/n$ and a random start $r\in\{1,\dots,N\}$. It then takes the units $r+jk$ reduced modulo $N$ to $\{1,\dots,N\}$, for $j=0,\dots,n-1$; these are distinct when $(n-1)k\lt N$.

The $k$ possible samples are the clusters of a partition of the population, and systematic sampling selects exactly one cluster at random. Every unit has $\pi_i=1/k=n/N$, as in SRSWOR. Most pairs, however, have $\pi_{ij}=0$: two units in different clusters are never sampled together.

📐 Theorem 8.9 — Variance of the systematic sample mean

For linear systematic sampling with $N=nk$, $\bar y_{\mathrm{sys}}$ is unbiased for $\bar Y$ and

$$\operatorname{Var}(\bar y_{\mathrm{sys}})=\frac1k\sum_{r=1}^k(\bar y_r-\bar Y)^2,$$ $$\operatorname{Var}(\bar y_{\mathrm{sys}})=\frac{N-1}{N}S^2-\frac{k(n-1)}{N}S^2_{\mathrm{wsy}},$$ $$\operatorname{Var}(\bar y_{\mathrm{sys}})=\frac{\sigma^2}{n}\big[1+(n-1)\rho_w\big].$$

Proof. $E\bar y_{\mathrm{sys}}=\frac1k\sum_r\bar y_r=\frac1{nk}\sum_r\sum_jy_{rj}=\bar Y$, since the $k$ samples together contain every unit once. The first formula is then the definition of the variance of a variable taking the values $\bar y_r$ with equal probabilities. For the second, decompose the total sum of squares over the $k$ clusters as in one-way analysis of variance:

$$\sum_{r,j}(y_{rj}-\bar Y)^2=n\sum_r(\bar y_r-\bar Y)^2+\sum_{r,j}(y_{rj}-\bar y_r)^2 .$$

The left side is $(N-1)S^2$, and the two terms on the right are $nk\operatorname{Var}(\bar y_{\mathrm{sys}})$ and $k(n-1)S^2_{\mathrm{wsy}}$; divide by $N=nk$. For the third, square $n(\bar y_r-\bar Y)=\sum_j(y_{rj}-\bar Y)$:

$$n^2(\bar y_r-\bar Y)^2=\sum_j(y_{rj}-\bar Y)^2+\sum_{j\ne j'}(y_{rj}-\bar Y)(y_{rj'}-\bar Y).$$

Summed over $r$, the first part gives $N\sigma^2$ and the second gives $N(n-1)\rho_w\sigma^2$. Dividing by $kn^2$ and using $N/k=n$ gives $\frac{\sigma^2}{n}[1+(n-1)\rho_w]$. ∎

📐 Theorem 8.10 — Systematic versus simple random sampling

With $N=nk$ and $V_{\mathrm{ran}}=(1-f)S^2/n$ the variance of the SRSWOR mean of the same size,

$$\operatorname{Var}(\bar y_{\mathrm{sys}})-V_{\mathrm{ran}}=\frac{k(n-1)}{N}\big(S^2-S^2_{\mathrm{wsy}}\big).$$

Hence systematic sampling is more precise than SRSWOR if and only if $S^2_{\mathrm{wsy}}\gt S^2$, equivalently if and only if $\rho_w\lt-\frac1{N-1}$. In words, it is better exactly when the units within a systematic sample are more heterogeneous than the population as a whole.

Proof. Here $1-f=\frac{k-1}{k}$, so $V_{\mathrm{ran}}=\frac{(k-1)S^2}{nk}=\frac{(k-1)S^2}{N}$. Subtract this from the second form in Theorem 8.9 and use $N-1-(k-1)=N-k=k(n-1)$. For the $\rho_w$ form, substitute $\sigma^2=\frac{N-1}NS^2$ into the condition

$$\frac{\sigma^2}n\big[1+(n-1)\rho_w\big]\lt\frac{N-n}{Nn}S^2 .$$

It becomes

$$(N-1)(n-1)\rho_w\lt(N-n)-(N-1)=-(n-1),$$

i.e. $\rho_w\lt-\frac1{N-1}$. ∎

📐 Theorem 8.11 — Populations with a linear trend

Let $Y_i=a+bi$ for $i=1,\dots,N$ with $N=nk$. Let $V_{\mathrm{st}}$ be the variance of the stratified mean when the population is cut into $n$ strata of $k$ consecutive units and one unit is drawn from each. Then

$$V_{\mathrm{ran}}=\frac{b^2(k-1)(N+1)}{12},\qquad V_{\mathrm{sys}}=\frac{b^2(k^2-1)}{12},\qquad V_{\mathrm{st}}=\frac{b^2(k^2-1)}{12\,n}.$$

So $V_{\mathrm{st}}\le V_{\mathrm{sys}}\le V_{\mathrm{ran}}$, with $V_{\mathrm{sys}}/V_{\mathrm{ran}}=\frac{k+1}{N+1}\approx\frac1n$.

Proof. The values $a+bi$, $i=1,\dots,m$, have variance (divisor $m-1$) $b^2\frac{m(m+1)}{12}$, because $\sum_{i=1}^m(i-\frac{m+1}2)^2=\frac{m(m^2-1)}{12}$. With $m=N$ this gives $S^2=b^2N(N+1)/12$ and $V_{\mathrm{ran}}=\frac{(k-1)S^2}{N}$, the first formula. The $r$-th systematic sample has mean $\bar y_r=a+b\left(r+\frac{(n-1)k}{2}\right)$, which runs over an arithmetic progression with step $b$ as $r=1,\dots,k$. So $V_{\mathrm{sys}}=b^2\cdot\frac1k\sum_r(r-\frac{k+1}2)^2=b^2\frac{k^2-1}{12}$. Each stratum of $k$ consecutive values has $S_h^2=b^2\frac{k(k+1)}{12}$, $W_h=\frac1n$, $n_h=1$, $f_h=\frac1k$. Theorem 8.6 gives $V_{\mathrm{st}}=n\cdot\frac1{n^2}(1-\frac1k)\,b^2\frac{k(k+1)}{12}=\frac{b^2(k^2-1)}{12n}$. Finally $\frac{V_{\mathrm{sys}}}{V_{\mathrm{ran}}}=\frac{k+1}{N+1}\le1$ because $k\le N$. ∎

Under a trend, a systematic sample is in effect a stratified sample with one unit per stratum. But it always takes the units at the same relative position in every stratum. If $r$ is small, every unit sits low in its stratum, and these errors add up. Yates' end corrections remove this error exactly for a linear trend. One gives the first and the last sampled units the weights $\frac1n\pm\frac{2r-k-1}{2(n-1)k}$ instead of $\frac1n$ (Exercise III.7).

✏️ Example 6 — A ledger with a trend
The balances of $N=20$ accounts, listed by opening date, are $Y_i=50+2i$ (in thousands of rupees). An auditor takes $n=4$ accounts, so $k=5$. Compute the variances of the sample mean under SRSWOR, systematic sampling, and stratified sampling with one account from each block of five, and find $S^2_{\mathrm{wsy}}$ and $\rho_w$.
Systematic Start $r$ gives the accounts $r,r+5,r+10,r+15$ with mean $\bar y_r=50+2(r+7.5)=65+2r$, i.e. $67,69,71,73,75$. Their mean is $71=\bar Y$, and $V_{\mathrm{sys}}=\frac{16+4+0+4+16}5=8$, which agrees with $b^2(k^2-1)/12=4\cdot24/12=8$ ✓.
SRS $S^2=4\cdot\frac{20\cdot21}{12}=140$ and $V_{\mathrm{ran}}=(\frac14-\frac1{20})\cdot140=28$. This agrees with $b^2(k-1)(N+1)/12=4\cdot4\cdot21/12=28$ ✓.
Stratified $V_{\mathrm{st}}=8/4=2$. The ranking is $2\lt8\lt28$.
Within-sample spread Each systematic sample is $\{c,c+10,c+20,c+30\}$, with variance $\frac{15^2+5^2+5^2+15^2}{3}=166.67\gt140=S^2$. So Theorem 8.10 predicts a gain, and indeed $V_{\mathrm{sys}}-V_{\mathrm{ran}}=\frac{5\cdot3}{20}(140-166.67)=-20=8-28$ ✓. Also $\sigma^2=133$, and $8=\frac{133}4[1+3\rho_w]$ gives $\rho_w=-0.2531\lt-\frac1{19}$.
✏️ Example 7 — Prove or disprove: "systematic sampling is never worse than SRS"
Passengers at a station are counted in $N=24$ consecutive quarter-hours. Trains arrive hourly, so the counts repeat the pattern $10,20,30,20$. Compare systematic sampling with SRSWOR for (a) $k=4$, (b) $k=2$, and decide the statement in the title.
Population $\bar Y=20$. The deviations $-10,0,10,0$ repeat six times, so $\sum D_i^2=1200$ and $S^2=1200/23=52.17$.
(a) $k=4$ (the period) Each systematic sample hits the same phase every time: the four samples are all $10$s, all $20$s, all $30$s, all $20$s. So $V_{\mathrm{sys}}=\frac{100+0+100+0}{4}=50$, whereas $V_{\mathrm{ran}}=\frac{(k-1)S^2}N=\frac{3\cdot52.17}{24}=6.52$. Systematic sampling is almost eight times worse. Here $S^2_{\mathrm{wsy}}=0$.
(b) $k=2$ (half the period) Start $1$ gives $10,30,10,30,\dots$ and start $2$ gives $20,20,\dots$. Both means equal $20$, so $V_{\mathrm{sys}}=0\lt V_{\mathrm{ran}}=\frac{52.17}{24}=2.17$.
Verdict False. In a periodic population, systematic sampling ranges from perfect to disastrous depending on how $k$ relates to the period. A sampling interval equal to the period, or to a multiple of it, is the worst possible choice.
Interactive 2 — Every k-th Unit: When Does Systematic Sampling Pay?

The bars are the $N=60$ population values in list order. The highlighted bars form the systematic sample with the current random start $r$. Press Play to cycle through all $k$ starts. The lower strip shows all $k$ possible sample means $\bar y_r$ (the current one is ringed), the true mean $\bar Y$ (vertical line) and the band $\bar Y\pm2\sqrt{V_{\mathrm{ran}}}$ of SRSWOR of the same size. Try a linear trend, a population in random order, and a cycle of period $6$ with $k=6$, $k=3$ and $k=4$.

n = N/k; start r—
V_sys—
V_ran (SRSWOR)—
V_st (one per block)—
S²_wsy vs S²—
⚠️ Counterexamples and pitfalls
  • $s^2$ estimates different things under the two SRS schemes. It is unbiased for $S^2$ under SRSWOR, but for $\sigma^2=\frac{N-1}{N}S^2$ under SRSWR (Example 3(b)).
  • $s$ is biased for $S$. For the population $\{0,0,3\}$ with $n=2$, $E[s]=\sqrt2\approx1.414$ but $S=\sqrt3\approx1.732$. Jensen's inequality gives $E[s]\le\sqrt{E[s^2]}=S$, with equality only when $s$ is constant.
  • Proportional stratification can lose (slightly). With equal stratum means, $V_{\mathrm{prop}}\gt V_{\mathrm{ran}}$ (Example 5). The inequality $V_{\mathrm{prop}}\le V_{\mathrm{ran}}$ holds only up to terms of order $1/N_h$.
  • The plain sample mean is biased under disproportionate allocation. With Neyman allocation in Example 4, the average of all $100$ farms gives the large farms weight $0.4$ instead of $W_3=0.1$; its expectation is $0.3\cdot20+0.3\cdot40+0.4\cdot100=58\ne34$. Only proportional allocation is self-weighting.
  • Neyman allocation can ask for more units than a stratum has. With $N_h=(50,950)$, $S_h=(100,2)$ and $n=100$, the rule gives $n_1=72.5\gt50$. Take a census of stratum 1 and give the remaining $50$ units to stratum 2.
  • "Optimum" allocation computed with wrong $S_h$ can be worse than proportional. If in truth all $S_h$ are equal, proportional allocation is the Neyman allocation. Any allocation based on unequal guessed $S_h$ is then strictly worse, by the equality case in Theorem 8.7.
  • Systematic sampling has no unbiased variance estimator. Units in different clusters have $\pi_{ij}=0$, and a single cluster gives no information about the spread of the $\bar y_r$ (Exercise IV.2). Treating the sample as SRS overstates the variance under a trend and badly understates it under periodicity.
  • Linear systematic sampling is biased when $N\ne nk$. For $N=7$, $k=3$ and values $1,1,1,1,1,1,8$, the samples $\{1,4,7\},\{2,5\},\{3,6\}$ have means $\frac{10}3,1,1$, which average to $1.78\ne\bar Y=2$. Circular systematic sampling repairs this.
  • Systematic is not "SRS in disguise". Each unit has the same $\pi_i=n/N$ as in SRS, but the pairwise probabilities differ completely. Two designs with the same $\pi_i$ can have very different variances (Example 7).

Exercises

I
Simple random sampling.
  • 1 A population has values $3,5,8,12$. List all SRSWOR samples of size $2$, and verify $E\bar y=\bar Y$ and $\operatorname{Var}(\bar y)=(1-f)S^2/n$ by enumeration.
  • 2 For the population of I.1, find $\operatorname{Var}(\bar y)$ under SRSWR with $n=2$ and check the ratio of Theorem 8.3.
  • 3 Using Theorem 8.1, show directly that $\operatorname{Var}\left(\sum_{i=1}^NZ_i\right)=0$. Why must this be so?
  • 4 A sample of $n=60$ from $N=1200$ shops gives mean daily sales $\bar y=48.5$ and $s=15.2$ (thousand rupees). Estimate the total daily sales of all shops and give an approximate $95\%$ confidence interval.
  • 5 In an SRSWOR of $200$ households out of $2000$, $46$ own a two-wheeler. Estimate the proportion with its estimated standard error and a $95\%$ interval.
  • 6 How large an SRSWOR from $N=3000$ is needed to estimate a mean to within $\pm2$ units with $95\%$ confidence if $S\approx15$?
  • 7 The coefficient of variation of household income in a town of $N=10000$ households is about $0.8$. What sample size estimates the mean income within $5\%$ of its true value with $95\%$ confidence?
  • 8 Prove Theorem 8.4 directly from the hypergeometric distribution of $a=np$, without using Theorem 8.2.
  • 9 Under SRSWR with $n$ draws, show that the number $\nu$ of distinct units has $E[\nu]=N\left[1-(1-\frac1N)^n\right]$. Evaluate it for $N=10$, $n=5$.
1 The six means are $4,5.5,7.5,6.5,8.5,10$, with average $7=\bar Y$. Their variance is $\frac{9+2.25+0.25+0.25+2.25+9}{6}=\frac{23}{6}=3.833$. Formula: $S^2=46/3$, so $(1-\frac12)\frac{46/3}{2}=\frac{46}{12}=3.833$ ✓.
2 $\sigma^2=46/4=11.5$, so $\operatorname{Var}_{\mathrm{WR}}=5.75$. The ratio $3.833/5.75=\frac23=\frac{N-n}{N-1}$ ✓.
3 $\operatorname{Var}\sum Z_i=Nf(1-f)-N(N-1)\frac{f(1-f)}{N-1}=0$. This must hold because $\sum Z_i=n$ is not random.
4 $\hat Y=1200\times48.5=58200$. $\widehat{\operatorname{SE}}=Ns\sqrt{(1-f)/n}=1200\times15.2\times\sqrt{0.95/60}=2295$. The interval is $58200\pm1.96\times2295$, i.e. about $(53\,700,\ 62\,700)$ thousand rupees per day.
5 $p=0.23$ and $v(p)=\frac{(1-0.1)\cdot0.23\cdot0.77}{199}=8.01\times10^{-4}$, so $\widehat{\operatorname{SE}}=0.0283$. The interval is $0.23\pm0.055$, i.e. $(0.175,\,0.285)$.
6 $n_0=(1.96\cdot15/2)^2=216.09$ and $n=216.09/(1+216.09/3000)=201.6$, so take $\mathbf{202}$.
7 $n_0=(1.96\cdot0.8/0.05)^2=983.4$ and $n=983.4/(1+0.09834)=895.4$, so take $\mathbf{896}$.
8 $a$ is hypergeometric with population $N$, $NP$ successes and $n$ draws, so $E a=nP$ and $\operatorname{Var}a=nPQ\frac{N-n}{N-1}$ (§2.1). Dividing by $n$ and $n^2$ gives $E p$ and $\operatorname{Var}p$. For $v(p)$, compute $E[pq]=E p-E p^2=P-\operatorname{Var}p-P^2=PQ\big(1-\frac{N-n}{n(N-1)}\big)=PQ\frac{N(n-1)}{n(N-1)}$. Then $E\,v(p)=\frac{1-f}{n-1}\cdot PQ\frac{N(n-1)}{n(N-1)}=\frac{N-n}{N-1}\frac{PQ}{n}$ ✓.
9 $\nu=\sum_i\mathbf 1\{i\text{ drawn at least once}\}$, and each indicator has expectation $1-(1-\frac1N)^n$. For $N=10$, $n=5$: $10(1-0.9^5)=4.095$, which a full enumeration of the $10^5$ sequences confirms.
II
Stratified sampling and allocation.
  • 1 Stratum 1 ($N_1=300$) gave the sample $12,15,9,14,10,18$ and stratum 2 ($N_2=200$) gave $40,52,47,37$. Compute $\bar y_{\mathrm{st}}$, $v(\bar y_{\mathrm{st}})$ and the estimated standard error.
  • 2 Strata of sizes $1500,900,600$. Find the proportional allocation of $n=60$.
  • 3 For the strata of II.2 with $S_h=8,20,40$, find the Neyman allocation of $n=54$.
  • 4 In II.3 compute $V_{\mathrm{prop}}$ and $V_{\mathrm{Ney}}$ for $n=54$, and check that their difference is $\frac1n\sum W_h(S_h-\bar S)^2$.
  • 5 In II.3 the unit costs are $c_h=4,9,16$. Find the cheapest allocation achieving $\operatorname{Var}(\bar y_{\mathrm{st}})\le4$ and its cost.
  • 6 Two strata have $N_h=(50,950)$ and $S_h=(100,2)$, and $n=100$. Show that the Neyman rule is infeasible and find the optimal feasible allocation.
  • 7 Prove that $V_{\mathrm{prop}}-V_{\mathrm{Ney}}=\frac1n\sum W_h(S_h-\bar S)^2$ and decide when it is zero.
  • 8 Prove: if the stratum means are all equal and all $S_h$ are equal, then $V_{\mathrm{prop}}\ge V_{\mathrm{ran}}$, with equality only if $L=1$ or $f=1$.
  • 9 (Applied.) A household expenditure survey has an urban stratum ($W=0.3$, mean $15000$, $S=4000$) and a rural one ($W=0.7$, mean $8000$, $S=2000$). Ignoring the fpc, with $n=500$, compute the variances under SRS, proportional and Neyman allocation, the two design effects, and the Neyman allocation.
1 $\bar y_1=13$, $s_1^2=56/5=11.2$; $\bar y_2=44$, $s_2^2=138/3=46$; $W=(0.6,0.4)$. So $\bar y_{\mathrm{st}}=7.8+17.6=25.4$, and $v=0.36\cdot0.98\cdot\frac{11.2}6+0.16\cdot0.98\cdot\frac{46}4=0.6586+1.8032=2.462$, giving $\widehat{\operatorname{SE}}=1.569$.
2 $W_h=0.5,0.3,0.2$, so the allocation is $(30,18,12)$.
3 $N_hS_h=12000,18000,24000$ with sum $54000$, so the allocation is $(12,18,24)$.
4 $\sum W_hS_h^2=32+120+320=472$, so $V_{\mathrm{prop}}=(\frac1{54}-\frac1{3000})\cdot472=8.583$. Next $\bar S=\sum W_hS_h=18$, so $V_{\mathrm{Ney}}=\frac{324}{54}-\frac{472}{3000}=5.843$. The difference is $2.741$, and $\frac1{54}(0.5\cdot100+0.3\cdot4+0.2\cdot484)=\frac{148}{54}=2.741$ ✓.
5 $\sum W_hS_h\sqrt{c_h}=8+18+32=58$ and $\sum W_hS_h/\sqrt{c_h}=2+2+2=6$. By Theorem 8.7(2), $n=\frac{58\cdot6}{4+0.1573}=83.7$, with $n_h\propto(2,2,2)$, i.e. $27.9$ each. Take $28$ per stratum ($n=84$): the variance is $3.986\le4$ and the cost $28(4+9+16)=812$.
6 $N_hS_h=(5000,1900)$, so $n_1=100\cdot5000/6900=72.5\gt N_1=50$. The variance is decreasing in $n_1$, so set $n_1=50$ (a census: zero variance) and $n_2=50$. This is optimal, because once $n_1=N_1$ the remaining problem has a single stratum.
7 This is Theorem 8.8: $\sum W_hS_h^2-\bar S^2=\sum W_h(S_h-\bar S)^2$ is the variance of $S_h$ under the weights $W_h$. It is zero iff all $S_h$ are equal, in which case Neyman allocation is proportional.
8 In Theorem 8.8 the between-means term vanishes, and $V_{\mathrm{ran}}-V_{\mathrm{prop}}=-\frac{1-f}{n(N-1)}\cdot\frac{S_1^2}{N}\sum_h(N-N_h)$. Since $\sum(N-N_h)=(L-1)N$, this equals $-\frac{(1-f)(L-1)S_1^2}{n(N-1)}\le0$, with equality iff $L=1$ or $f=1$ (or $S_1=0$).
9 $\bar Y=10100$, $\sum W_hS_h^2=7.6\times10^6$ and $\sum W_h(\bar Y_h-\bar Y)^2=10.29\times10^6$, so $S^2\approx17.89\times10^6$. This gives $V_{\mathrm{ran}}=35780$, $V_{\mathrm{prop}}=15200$ and $V_{\mathrm{Ney}}=(1200+1400)^2/500=13520$. The design effects are $V_{\mathrm{ran}}/V_{\mathrm{prop}}=2.35$ and $V_{\mathrm{ran}}/V_{\mathrm{Ney}}=2.65$. The Neyman allocation is $n_h=500\cdot(1200,1400)/2600=(231,269)$.
III
Systematic sampling.
  • 1 $N=12$ values in list order: $4,7,9,6,8,11,13,10,12,15,17,14$, with $n=3$ ($k=4$). List the four systematic samples, compute $V_{\mathrm{sys}}$, $V_{\mathrm{ran}}$ and $S^2_{\mathrm{wsy}}$, and check Theorem 8.10.
  • 2 For $Y_i=i$, $N=15$, $n=3$, compute $V_{\mathrm{ran}}$, $V_{\mathrm{sys}}$ and $V_{\mathrm{st}}$ from Theorem 8.11.
  • 3 Show that $V_{\mathrm{sys}}\lt V_{\mathrm{ran}}$ is equivalent to $\rho_w\lt-1/(N-1)$, and interpret the sign of $\rho_w$.
  • 4 Circular systematic sampling with $N=11$, $n=3$, $k=4$: list the sample for $r=9$ and show that every unit has inclusion probability $3/11$.
  • 5 Show that linear systematic sampling with $N=7$, $k=3$ gives a biased sample mean for the values $1,1,1,1,1,1,8$. Is it biased for $Y_i=i$?
  • 6 A population of $N=36$ repeats the pattern $1,3,5,5,3,1$. Find $V_{\mathrm{sys}}$ and $V_{\mathrm{ran}}$ for $k=6$, $k=3$ and $k=4$.
  • 7 Show that for $Y_i=a+bi$, Yates' corrected estimator $\bar y_r+\frac{2r-k-1}{2(n-1)k}\left(y_{r1}-y_{rn}\right)$ equals $\bar Y$ for every start $r$.
  • 8 Suppose the list order is a uniformly random permutation of the population (independent of the start). Show that the systematic sample is then an SRSWOR, and deduce that $V_{\mathrm{sys}}$, averaged over all orderings, equals $V_{\mathrm{ran}}$.
1 The samples are $\{4,8,12\}$, $\{7,11,15\}$, $\{9,13,17\}$, $\{6,10,14\}$, with means $8,11,13,10$ and $\bar Y=10.5$. So $V_{\mathrm{sys}}=\frac{6.25+0.25+6.25+0.25}{4}=3.25$. Next $S^2=167/11=15.18$, so $V_{\mathrm{ran}}=(\frac13-\frac1{12})S^2=3.795$, and $S^2_{\mathrm{wsy}}=16\gt S^2$. Check: $\frac{k(n-1)}N(S^2-S^2_{\mathrm{wsy}})=\frac8{12}(15.18-16)=-0.545=3.25-3.795$ ✓.
2 $k=5$, $b=1$: $V_{\mathrm{ran}}=\frac{4\cdot16}{12}=5.333$, $V_{\mathrm{sys}}=\frac{24}{12}=2$ and $V_{\mathrm{st}}=\frac{24}{36}=0.667$.
3 This was shown in the proof of Theorem 8.10. Negative $\rho_w$ means that units in the same sample tend to lie on opposite sides of $\bar Y$, so they cancel each other. A trend produces exactly this, because each sample contains both early (low) and late (high) units.
4 $r=9$ gives the units $9,13\equiv2,17\equiv6$, i.e. $\{9,2,6\}$. Unit $u$ is in the sample iff $r\equiv u,\,u-4,\,u-8\pmod{11}$, three distinct starts out of $11$, so $\pi_u=3/11$. Hence $\bar y$ is unbiased.
5 The means are $10/3,1,1$, averaging $1.778\ne2$. For $Y_i=i$ the means are $4,3.5,4.5$, which average $4=\bar Y$. That is a coincidence, not unbiasedness. Unit $i$ enters $E\bar y_{\mathrm{sys}}$ with weight $\frac13\cdot\frac1{n(s_i)}$, where $n(s_i)$ is the size of its sample: $\frac19$ for units $1,4,7$ and $\frac16$ for the others, instead of $\frac17$. For $Y_i=i$ the two errors cancel, since $\frac{1+4+7}{9}+\frac{2+3+5+6}{6}=4$.
6 $\bar Y=3$, $\sigma^2=16/6=2.667$ and $S^2=96/35=2.743$. For $k=6$ ($n=6$) every sample is constant, the means are $1,3,5,5,3,1$, and $V_{\mathrm{sys}}=2.667$ against $V_{\mathrm{ran}}=0.381$. For $k=3$ ($n=12$) and $k=4$ ($n=9$) every sample contains each phase value equally often, so all means equal $3$ and $V_{\mathrm{sys}}=0$, against $V_{\mathrm{ran}}=0.152$ and $0.229$.
7 $\bar y_r=a+b\big(r+\frac{(n-1)k}{2}\big)$ and $y_{r1}-y_{rn}=-b(n-1)k$. The correction is $-b\frac{2r-k-1}{2}$, and the sum is $a+b\frac{nk+1}{2}=a+b\frac{N+1}{2}=\bar Y$. (A numerical check with $N=20$, $k=5$ gives $\bar Y$ for all five starts.)
8 The positions $r,r+k,\dots$ form a fixed set of $n$ positions once $r$ is fixed. Under a uniformly random permutation, the values in any fixed set of $n$ positions are a uniformly random $n$-subset of the population, so the sample is an SRSWOR. Hence $E[(\bar y_{\mathrm{sys}}-\bar Y)^2]=V_{\mathrm{ran}}$, where the expectation is over both the ordering and $r$. Conditioning on the ordering shows that this is the average of $V_{\mathrm{sys}}$ over orderings. A brute-force check over all $720$ orderings of a six-unit population confirms it.
IV
Proofs and deeper questions.
  • 1 Prove that under SRSWOR $s^2=\frac1{n(n-1)}\sum_{j\ne j'}\frac{(y_j-y_{j'})^2}{2}$ and $S^2=\frac1{N(N-1)}\sum_{i\ne i'}\frac{(Y_i-Y_{i'})^2}{2}$, and deduce $E s^2=S^2$ from Theorem 8.1.
  • 2 Prove that in linear systematic sampling no estimator $v$ (a function of the sample) can be unbiased for $\operatorname{Var}(\bar y_{\mathrm{sys}})$ for every population $(Y_1,\dots,Y_N)$, when $n\ge2$ and $k\ge2$.
  • 3 Under SRSWOR of pairs $(y_i,x_i)$, prove $\operatorname{Cov}(\bar y,\bar x)=\frac{(1-f)S_{xy}}{n}$, where $S_{xy}=\frac1{N-1}\sum(Y_i-\bar Y)(X_i-\bar X)$. (This is used in §8.2.)
  • 4 Post-stratification. An SRSWOR of size $n$ is drawn and afterwards classified into strata with known $W_h$. Show that, conditional on the realised stratum counts $(n_1,\dots,n_L)$ with all $n_h\ge1$, the estimator $\sum W_h\bar y_h$ is unbiased and its conditional variance is $\sum W_h^2(1-n_h/N_h)S_h^2/n_h$.
  • 5 Give an example of a population, a stratification and an allocation for which $V(\bar y_{\mathrm{st}})\gt V_{\mathrm{ran}}$ by a large factor (not only by a term of order $1/N$).
  • 6 Research-flavoured. For cost $C=c_0+c_1\sqrt{n}$ (travel between sampled units grows like $\sqrt n$), find the $n$ that minimises $\operatorname{Var}(\bar y)+\lambda C$ under SRS with negligible fpc, and discuss how it differs from the linear-cost answer.
1 In general $\sum_{j\ne j'}(a_j-a_{j'})^2=2m\sum_j a_j^2-2(\sum_ja_j)^2=2m(m-1)\cdot\frac{1}{m-1}\sum(a_j-\bar a)^2$, which gives both identities. Now $s^2=\frac1{n(n-1)}\sum_{i\ne i'}Z_iZ_{i'}\frac{(Y_i-Y_{i'})^2}{2}$, and $E[Z_iZ_{i'}]=\frac{n(n-1)}{N(N-1)}$, so $Es^2=\frac{1}{N(N-1)}\sum_{i\ne i'}\frac{(Y_i-Y_{i'})^2}{2}=S^2$.
2 When the start is $r$, the estimator sees only the values $c_r$ of cluster $r$, so $v=g_r(c_r)$ for some functions $g_r$. Unbiasedness for every population means $\frac1k\sum_rg_r(c_r)=\frac1k\sum_r(m_r-\bar m)^2$, where $m_r$ is the mean of $c_r$ and $\bar m=\frac1k\sum m_r$. The right side equals $\frac1k\big[(1-\frac1k)\sum_rm_r^2-\frac2k\sum_{r\lt s}m_rm_s\big]$. Set all clusters except $1$ and $2$ equal to $0$, and write $F(a,b)$ for both sides as functions of $c_1=a$, $c_2=b$. The left side is $g_1(a)+g_2(b)+\text{const}$, so its mixed difference $F(a,b)-F(a,0)-F(0,b)+F(0,0)$ is $0$. The right side has mixed difference $-\frac2{k^2}m(a)m(b)\ne0$ whenever $a$ and $b$ have nonzero means. This is a contradiction. (The general principle: $\pi_{ij}=0$ for units in different clusters, and a quadratic form $\sum a_{ij}Y_iY_j$ can be estimated without bias only if $\pi_{ij}\gt0$ whenever $a_{ij}\ne0$.)
3 Apply Theorem 8.2(2) to $Y+X$ and to $Y-X$, and use $\operatorname{Cov}(\bar y,\bar x)=\frac14[\operatorname{Var}(\bar y+\bar x)-\operatorname{Var}(\bar y-\bar x)]$, together with $S^2_{y+x}-S^2_{y-x}=4S_{xy}$. Alternatively, repeat the indicator proof with $D_iE_i$ products.
4 Given the stratum counts, the $n_h$ units falling in stratum $h$ are a simple random sample of size $n_h$ from $U_h$, independently across strata: every set of the given composition has the same probability under SRSWOR. Theorem 8.6 then applies conditionally. Averaging over the random $n_h$ gives Cochran's approximation $\frac{1-f}{n}\sum W_hS_h^2+\frac{1}{n^2}\sum(1-W_h)S_h^2$ for the unconditional variance, which is proportional allocation plus a term of order $1/n^2$.
5 Take two strata of size $500$, stratum 1 constant ($S_1=0$) and stratum 2 with $S_2=10$, equal means, and the perverse allocation $n_1=99$, $n_2=1$ (total $100$). Then $V_{\mathrm{st}}=0.25\cdot(1-\frac1{500})\cdot100=24.95$. The whole population has $S^2=\frac{499\cdot100}{999}=49.95$, so $V_{\mathrm{ran}}=0.009\cdot49.95=0.450$. The ratio is about $55$: a bad allocation can ruin a good stratification.
6 Minimise $\frac{S^2}{n}+\lambda c_1\sqrt n$. The derivative $-\frac{S^2}{n^2}+\frac{\lambda c_1}{2\sqrt n}=0$ gives $n=\left(\frac{2S^2}{\lambda c_1}\right)^{2/3}$. With linear cost $\lambda c_1n$ instead, $n=S/\sqrt{\lambda c_1}$. Under the concave cost the optimum grows like $S^{4/3}$ instead of $S$: the marginal cost of a unit falls as $n$ grows, so a more variable population justifies a proportionally larger sample. Falling marginal travel cost is also the reason surveys cluster their samples geographically.
🎯 Exam corner CSIR Part BCSIR Part CGATE ST

E1. CSIR Part B GATE ST An SRSWOR of size $10$ is drawn from a population of $50$ units with $S^2=\frac1{49}\sum(Y_i-\bar Y)^2=40$. The variance of the sample mean is (A) $4.00$; (B) $3.92$; (C) $3.20$; (D) $0.80$.

Idea $\operatorname{Var}(\bar y)=(1-f)S^2/n$ with $f=0.2$.
Options (A) omits the fpc. (B) is $\sigma^2/n=39.2/10$, the SRSWR value. (C) is $0.8\cdot40/10=3.2$. (D) is $S^2/N$.
Answer (C).

E2. CSIR Part B A population has two strata with $N_1=400$, $S_1=5$ and $N_2=100$, $S_2=30$. A stratified sample of total size $50$ is to be allocated by Neyman allocation. Then $(n_1,n_2)$ is (A) $(40,10)$; (B) $(25,25)$; (C) $(20,30)$; (D) $(10,40)$.

Idea $n_h\propto N_hS_h=2000,3000$.
Compute $n_1=50\cdot\frac{2000}{5000}=20$ and $n_2=30$. (A) is proportional allocation; (B) and (D) follow no rule.
Answer (C).

E3. CSIR Part B GATE ST The population values are $Y_i=i$, $i=1,\dots,30$. A linear systematic sample of size $5$ is drawn. The variance of the sample mean is (A) $35/60$; (B) $35/12$; (C) $3$; (D) $155/12$.

Idea $k=6$ and $V_{\mathrm{sys}}=(k^2-1)/12$ for unit slope (Theorem 8.11).
Options (B) $=35/12$. (A) is $V_{\mathrm{st}}=35/(12\cdot5)$, (D) is $V_{\mathrm{ran}}=5\cdot31/12$, and (C) is a rounding of (B) that is not exact.
Answer (B).

E4. CSIR Part C Under SRSWOR of size $n$ ($2\le n\lt N$) from a population with $S^2\gt0$, which of the following are true? (One or more options may be correct.) (A) $(1-f)s^2/n$ is unbiased for $\operatorname{Var}(\bar y)$. (B) The sample standard deviation $s$ is unbiased for $S$. (C) $\operatorname{Var}(\bar y)$ is no larger than under SRSWR with the same $n$. (D) The probability that two given units are both in the sample is $n^2/N^2$.

(A) True Theorem 8.2(3).
(B) False Take the population $\{0,0,3\}$ with $n=2$: $E s=\frac{0+2.121+2.121}{3}=1.414$, while $S=\sqrt3$. In general $Es\lt S$ by Jensen's inequality.
(C) True The ratio is $\frac{N-n}{N-1}\le1$ (Theorem 8.3).
(D) False $\pi_{ij}=\frac{n(n-1)}{N(N-1)}$, which is smaller than $\frac{n^2}{N^2}$ when $n\lt N$.
Answer (A) and (C).

E5. CSIR Part C In stratified random sampling with fixed total size $n$, which of the following are true? (A) Under proportional allocation, $\bar y_{\mathrm{st}}$ equals the mean of all $n$ sampled values. (B) For every population and every stratification, proportional allocation gives a variance no larger than SRSWOR of size $n$. (C) Whenever the Neyman sizes satisfy $n_h\le N_h$ (treated as real numbers), Neyman allocation gives a variance no larger than proportional allocation. (D) If all $S_h$ are equal, Neyman allocation coincides with proportional allocation.

(A) True $\sum W_h\bar y_h=\sum\frac{n_h}{n}\bar y_h=\frac1n\sum_h\sum_jy_{hj}$ when $n_h=nW_h$.
(B) False Example 5: two identical strata give $V_{\mathrm{prop}}=0.208\gt0.179=V_{\mathrm{ran}}$.
(C) True $V_{\mathrm{prop}}-V_{\mathrm{Ney}}=\frac1n\sum W_h(S_h-\bar S)^2\ge0$ exactly (Theorem 8.8).
(D) True $N_hS_h\propto N_h$ when $S_h$ is constant.
Answer (A), (C) and (D).

E6. CSIR Part C Let $N=nk$ with $n,k\ge2$, and consider linear systematic sampling with interval $k$. Which of the following are true? (A) $\bar y_{\mathrm{sys}}$ is unbiased for $\bar Y$. (B) If the units are listed in a uniformly random order, then the average of $\operatorname{Var}(\bar y_{\mathrm{sys}})$ over all orderings equals the SRSWOR variance $(1-f)S^2/n$. (C) There is an estimator, computed from the single systematic sample, that is unbiased for $\operatorname{Var}(\bar y_{\mathrm{sys}})$ for every population. (D) If the population is periodic with period exactly $k$ and not constant, then $\operatorname{Var}(\bar y_{\mathrm{sys}})\gt(1-f)S^2/n$.

(A) True Each unit is in exactly one of the $k$ equally likely samples (Theorem 8.9).
(B) True Under a random ordering, the systematic sample is an SRSWOR (Exercise III.8).
(C) False Units in different clusters have $\pi_{ij}=0$, so no estimator is unbiased for all populations (Exercise IV.2).
(D) True Every sample is then constant, $\bar y_r=Y_r$, so $V_{\mathrm{sys}}=\sigma^2=\frac{N-1}NS^2$. This exceeds $V_{\mathrm{ran}}=\frac{k-1}NS^2$ because $N-1\gt k-1$ when $n\ge2$.
Answer (A), (B) and (D).
🧑‍🏫 For the teacher

Suggested plan — 3 lectures × 60 min.

  1. Simple random sampling. The finite-population viewpoint (fixed $Y_i$, random selection). Theorem 8.1 by counting, then the indicator proof of Theorem 8.2 in full. Do Example 1 on the board (students compute two or three of the ten samples each). Theorem 8.3 and the "a sample of 1000 suffices for a country" discussion, proportions, and the sample-size formula with Example 2.
  2. Stratification. Definition 8.2 and Theorem 8.6. Derive the optimum allocation by Cauchy–Schwarz (Theorem 8.7), then Example 4 with the class filling in the table. Theorem 8.8 and Example 5 as the "surprise". Project Interactive 1: first $\delta=0$ (proportional ≈ SRS, Neyman still better), then $\delta=12$.
  3. Systematic sampling. Definition 8.4. Theorem 8.9 via the ANOVA decomposition, and Theorems 8.10 and 8.11. Examples 6 and 7. Project Interactive 2 with the period-6 population at $k=6$, $3$ and $4$, then the trend. Finish with the ⚠️ box and E4–E6.

Discussion questions. (1) Why does the precision of a national opinion poll hardly depend on the size of the country? When does it start to matter? (2) A colleague proposes stratifying by an outcome recorded last year. Is that allowed, and what does Theorem 8.8 say about the gain? (3) You must estimate the average waiting time at a clinic from a list of appointments, sorted by time of day. Systematic or simple random sampling, and why?

Misconceptions to watch for. Using $\sigma^2/n$ under SRSWOR; thinking the fpc is about the size of $N$ instead of $f=n/N$; averaging all stratified observations equally under Neyman allocation; believing stratification can never hurt; computing a "variance" from a single systematic sample as if it were SRS; choosing $k$ equal to a known period (weekly sales sampled every 7th day).

Suggested homework. I(1, 4, 5, 6, 9), II(1, 3, 4, 5, 9), III(1, 2, 6, 8), IV(1, 3); Exam corner E2, E4, E6.

🔬 Research–Teaching NexusResearch-tutored · optional, about 60 minutes

Research question. An air-quality agency can afford only a few laboratory analyses per month. Should it sample the hourly PM2.5 record systematically (every $k$-th hour) or at random? For which intervals $k$ does systematic sampling become dangerous?

Why it matters. Pollution, electricity demand, hospital admissions and road traffic all have daily and weekly cycles. Monitoring networks in Delhi, Beijing, London and Mexico City sample filters on fixed schedules. A schedule in phase with a cycle can bias a monthly average by more than the regulatory margin, while a well-chosen interval can beat random sampling.

What to do.

  1. Build an hourly series for $30$ days ($N=720$). Either download one month of hourly PM2.5 for a city of your choice from an open air-quality portal, or simulate $Y_t=60+25\cos(2\pi t/24)+10\cos(4\pi t/24)+0.02t+\varepsilon_t$ with $\varepsilon_t\sim N(0,8^2)$ from a fixed seed.
  2. For every divisor $k$ of $720$ with $2\le k\le 72$, compute $V_{\mathrm{sys}}$ exactly from the $k$ possible samples (Theorem 8.9) and $V_{\mathrm{ran}}=(k-1)S^2/N$. Plot the ratio $V_{\mathrm{sys}}/V_{\mathrm{ran}}$ against $k$.
  3. Explain the spikes using Theorem 8.10: what happens to $S^2_{\mathrm{wsy}}$ when $k$ is a multiple of $24$? Of $12$?
  4. Propose a design with the same number of analyses that is safe against unknown cycles, for example stratified sampling with one random hour per day, and compare its variance.

Tools: Python with numpy (or a spreadsheet); an open air-quality data portal if you use real data.

Hand in: The ratio plot, a two-paragraph explanation of the spikes, and your recommended sampling schedule with its variance.

Going further. Read about Cochran's "autocorrelated populations" model, under which the expected $V_{\mathrm{sys}}$ can be compared with stratified and random sampling when the correlogram is convex. Relate it to the sign of $\rho_w$.

Instructor note: with the simulated series, the ratio is far above $1$ for $k=24,48,72$ (each sample sees one phase of the daily cycle), clearly above $1$ for $k=12,36,60$ (the 12-hour component is not cancelled), and below $1$ for most other $k$, because the trend and the 24-hour cycle cancel within samples that visit many phases. Stratified sampling with one random hour per day is safe for every cycle and is usually within a small factor of the best systematic interval.

🧪 Self-check quiz

0/5 correct

Q1. Under SRSWOR of size $n$ from $N$ units, $\operatorname{Var}(\bar y)$ equals

Q2. Under SRSWR, the sample variance $s^2$ (divisor $n-1$) is unbiased for

Q3. With equal unit costs and fixed $n$, the stratified variance is minimised by

Q4. For a population with an exact linear trend ($N=nk$), the variances of the mean satisfy

Q5. Systematic sampling is more precise than SRSWOR of the same size exactly when