Uniformly Most Powerful Test

The uniformly most powerful (UMP) test maximizes the power of the test for all values of the alternative hypothesis, given a fixed significance level. We start by defining the most powerful (MP) test for a simple alternative hypothesis ${\Theta }_1=\{{\theta }_1\}$. The MP test solves the following Constrained Optimization problem:

$$\begin{array}{rl}\underset{A}{\sup }& P_{{\theta }_1}(A(X)=1)\\ \text{s.t. }& \underset{{\theta }_0\in {\Theta }_0}{\sup }{P}_{{\theta }_0}(A(X)=1)\le \alpha .\end{array}$$

For a composite alternative hypothesis ${\Theta }_1$, we say a test is UMP, if it’s MP for all ${\theta }_1\in {\Theta }_1$. Formally, we consider the space of all randomized test $A:\mathcal{X}\to [0,1]$. Then, $A^{(\mathrm{UMP})}$ is UMP of size $\alpha$ if

$$\begin{array}{rlrl}{\mathbb{E}}_{{\theta }_1}[A^{(\mathrm{UMP})}(X)]=\underset{A:\mathcal{X}\to [0,1]}{\sup }& {\mathbb{E}}_{{\theta }_1}[A(X)]& & \text{(maximize power)}\\ \text{s.t. }& \underset{{\theta }_0\in {\Theta }_0}{\sup }{\mathbb{E}}_{{\theta }_0}[A(X)]\le \alpha & & \text{(size constraint)}\\ \forall {\theta }_1\in {\Theta }_1.& & & \text{(uniformity)}\end{array}$$

Neyman-Pearson

For a simple-simple HT, the Neyman-Pearson lemma states that the (U)MP test is a Likelihood Ratio Test given by

$$A^{(\mathrm{MP})}=A^{(\mathrm{NP})}(X)=1\left\{f_1(X)/f_0(X)>\lambda \right\},$$

where

$$P_{{\theta }_0}(f_1(X)/f_0(X)>\lambda )=\alpha .$$

Therefore, the (U)MP test for a simple-simple HT is also called the Neyman-Pearson optimal test.

• ❗️ In general, if $A^{(\mathrm{MP})}=A^{(\mathrm{NP})}$ depends on ${\theta }_1$, it is not uniformly most powerful.

Monotone Likelihood Ratio

For certain Statistical Models, the NP optimal test evaluated at the boundary of ${\Theta }_0$ and ${\Theta }_1$ is UMP. We say a model ${\mathcal{P}}_{\Theta }$ has a monotone likelihood ratio if there exists a statistic $T(X)\in \mathbb{R}$ such that for any ${\theta }_0<{\theta }_1$, $P_{{\theta }_0}$ and $P_{{\theta }_1}$ are distinct and

$$\frac{f_{{\theta }_1}(X)}{f_{{\theta }_0}(X)}=\frac{g_1(T(X))}{g_0(T(X))},\text{for some }{g}_0,g_1\text{ with }{g}_1/g_0\text{ non-decreasing}.$$

For a statistical model with monotone likelihood ratio and a composite HT ${\Theta }_0=(-\infty ,{\theta }_0]$, ${\Theta }_1=({\theta }_0,\infty )$, we have the following results:

1. An UMP test exists and has the form

$$A^{(\mathrm{UMP})}(x)=\{\begin{array}{ll}1,& T(x)>c;\\ \gamma ,& T(x)=c;\\ 0,& T(x)<c,\end{array}$$

where $\gamma\in[0,1]$, and $c$, $\gamma$ are **uniquely** determined by the significance level constraint $\alpha$.

2. The power function $\beta (\theta )={\mathbb{E}}_{\theta }A(X)$ is strictly increasing on $\{\theta :\beta (\theta )\in (0,1)\}$. 3. Among all size-$\alpha$ tests, $A^{(\mathrm{UMP})}$ minimizes ${\mathbb{E}}_{\theta }A(X)$ for $\theta \in (-\infty ,{\theta }_0)$. 4. For any ${\theta }^{\prime }$, $A^{(\mathrm{UMP})}$ determines a test that is UMP for ${\Theta }_0^{\prime }=(-\infty ,{\theta }^{\prime }]$, ${\Theta }_1^{\prime }=({\theta }^{\prime },\infty )$ at level ${\alpha }^{\prime }=\beta ({\theta }^{\prime })$.

• ❗️ We note that $A^{(\mathrm{UMP})}$ is independent of ${\theta }_1$.

Exponential Family

An important class of models with monotone likelihood ratio is the Exponential Family, which includes many common distributions such as the Normal Distribution, Poisson Distribution, and Exponential Distribution. Recall that a one-parameter exponential family has the form

$$f(x;\theta )=c(\theta )h(x)e^{t(x)q(\theta )}$$

Link to original As a corollary of the above results, if $q(\theta)$ is strictly monotone, then this model admits an UMP test for $\Theta_{0}=(-\infty,\theta_{0}]$, $\Theta_{1}=(\theta_{0},\infty)$. Specifically, if $q$ is monotonically increasing, then the UMP test has the same form as $A^{(\mathrm{UMP})}$; if $q$ is monotonically decreasing, then the UMP test has the form of $A^{(\mathrm{UMP})}$ with reversed inequalities.

Existence of UMP implies exponential family

We state that an UMP exists for exponential family models. Surprisingly, the other direction is also generally true. Under weak conditions, the exists of UMP for one-sided composite HT of level $\alpha$ and all sample sizes implies an exponential family model.

Gaussian