Extension of the one-sample Kolmogorov-Smirnov test

Abstract

We propose here a new goodness-of-fit test, named the one-sample OVL-$q$ test ($q=1,2,\ldots$), which can be considered an extension of the one-sample Kolmogorov-Smirnov test (equivalent to the one-sample OVL-1 test). We have analyzed the asymptotic properties of the one-sample OVL-2 test statistic and enabled the calculation of asymptotic p-values for the test statistic. We further conducted numerical experiments and demonstrated that the one-sample OVL-2 test can sometimes exceed the detection power of conventional goodness-of-fit tests.

MSC2020 subject classifications: Primary 62G10; Secondary 62G20, 62-04.

Keywords and phrases: Nonparametric statistics, Kolmogorov-Smirnov test, One-sample testing.

1 Introduction

The Kolmogorov-Smirnov (KS) test is a nonparametric method used to determine whether a sample originates from a specific probability distribution (one-sample KS test) or to assess whether two samples come from the same distribution (two-sample KS test). In our previous study, we devised an extended version of the two-sample KS test, named the (two-sample) OVL-$q$ test ($q=1,2,\ldots$), and demonstrated its utility particularly for the two-sample OVL-2 test [6].

In this study, we extended the one-sample KS test using a similar approach to our previous work [6], and named it the one-sample OVL-$q$ test ($q=1,2,\ldots$). We analyze the asymptotic properties of the one-sample OVL-2 test statistic and calculate its asymptotic p-values. Furthermore, we assess the detection power of the one-sample OVL-2 test relative to conventional goodness-of-fit tests by conducting numerical experiments.

In this paper, we describe the analytical framework in Section 2. Experimental results are shown in Section 3. Conclusion follows in Section 4. The proofs of Theorems 2.3, 2.4 and 2.5 are given in Section 5. The source code for the experiments in Section 3 is provided in the Supplementary Material.

General notation

We denote by $\mathbb{Z}$, $\mathbb{N}$, $\mathbb{N}_{+}$, $\mathbb{Q}$, and $\mathbb{R}$ the sets of integers, nonnegative integers, positive integers, rational numbers, and real numbers, respectively. If $-\infty\leq a\leq b\leq\infty$ and if there is no confusion, we write $[a,b]\coloneq\{x:a\leq x\leq b\}$, $[a,b)\coloneq\{x:a\leq x<b\}$, $(a,b]\coloneq\{x:a<x\leq b\}$, and $(a,b)\coloneq\{x:a<x<b\}$ as (extended) real intervals. For $n\in\mathbb{N}_{+}$, let $\mathbb{R}^{n}$ be the Euclidean $n$-dimensional space and $\mathbb{R}_{\leq}^{n}\coloneq\{(v_{1},\ldots,v_{n})\in\mathbb{R}^{n}:v_{1}\leq\cdots\leq v_{n}\}$. For a topological space $A$, we denote by $\mathcal{B}(A)$ the $\sigma$-algebra of Borel sets in $A$. For a set $A$, $\#A$ denotes the cardinality of $A$. For a real function $f$ on a set $A$ and $x,y\in A$, we write $f|_{x}^{y}=f(y)-f(x)$. We denote by $\mathbbm{1}_{A}$ the indicator function of a set $A$. For a random variable $X$, $\mathbb{E}[X]$ denotes its expectation.

2 Analytical framework

Let $\mathcal{F}$ be the set of distribution functions on $\mathbb{R}$, where each $F\in\mathcal{F}$ is nondecreasing, is continuous from the right, and satisfies $F(-\infty)\coloneq\lim_{x\to-\infty}F(x)=0$ and $F(\infty)\coloneq\lim_{x\to\infty}F(x)=1$. For $F,G\in\mathcal{F}$ and $q\in\mathbb{N}_{+}$,

$$D_{q}(F,G)\coloneq 1-\inf_{\boldsymbol{v}\in\mathbb{R}_{\leq}^{q}}r_{F,G}(\boldsymbol{v}),$$ (1)

where

$$r_{F,G}(\boldsymbol{v})\coloneq\sum_{i=0}^{q}\min\bigl{\{}F|_{v_{i}}^{v_{i+1}},G|_{v_{i}}^{v_{i+1}}\bigr{\}}$$ (2)

for $\boldsymbol{v}=(v_{1},\ldots,v_{q})\in\mathbb{R}_{\leq}^{q}$, $v_{0}=-\infty$, and $v_{q+1}=\infty$. Note that $r_{F,G}(\boldsymbol{v})\in[0,1]$ for all $\boldsymbol{v}\in\mathbb{R}_{\leq}^{q}$, so that $D_{q}(F,G)\in[0,1]$.

Theorem 2.1.

(See [7] for reference.) The KS metric on $\mathcal{F}$ equals $D_{1}$, that is,

$$\sup_{v\in\mathbb{R}}\lvert F(v)-G(v)\rvert=D_{1}(F,G)\qquad(F,G\in\mathcal{F}).$$

Theorem 2.2.

For each $q\in\mathbb{N}_{+}$, $(\mathcal{F},D_{q})$ is a complete metric space.

Theorem 2.1 can be proved similarly as in the proof of [6, Proposition 2.7]. Theorem 2.2 will be proved in Section 5.1. By these theorems, we can see that $D_{q}$ are extension of the KS metric. Furthermore, by Theorem 5.11, any $D_{q}$ and $D_{1}$ generate the same topology on $\mathcal{F}$.

2.1 One-sample KS test and its extension

As a null hypothesis $H_{0}$, we assume that $X_{1},\ldots,X_{n}$ are independent and identically distributed (i.i.d.) random variables on a probability space $(\Omega,\mathcal{A},P)$ with a given distribution function $F\in\mathcal{F}$. Let $F_{n}$ be the corresponding empirical distribution function, i.e.,

$$F_{n}(x)\coloneq\frac{1}{n}\sum_{i=1}^{n}\mathbbm{1}_{(-\infty,x]}(X_{i})\qquad(x\in\mathbb{R}).$$ (3)

Here we propose $D_{q}(F_{n},F)\colon\Omega\to\mathbb{R}$ ($q\in\mathbb{N}_{+}$) as an extension of the one-sample KS test statistic, which equals $D_{1}(F_{n},F)$ by Theorem 2.1. The p-value (function) of the extended test is given by

$$p_{q,n}(x)\coloneq P(x\leq D_{q}(F_{n},F))\qquad(x\in\mathbb{R}),$$ (4)

and the upper limit of a $100(1-\alpha)$% confidence interval ($0<\alpha<1$) of $D_{q}(F_{n},F)$ is

$$u_{q,n}(\alpha)\coloneq\inf\{x\in\mathbb{R}:p_{q,n}(x)<\alpha\}.$$ (5)

This can be regarded as the one-sample OVL-$q$ test since the (two-sample) OVL-$q$ test statistic $\rho_{q,m,n}$ in [6, Definition 2.2] equals $1-D_{q}(F_{0,m},F_{1,n})$ (see [6, Definition 2.1]), whose p-value is equal to that of $D_{q}(F_{0,m},F_{1,n})$ as described in [6, Section 2.3].

Theorem 2.3.

For each $q\in\mathbb{N}_{+}$, $D_{q}(F_{n},F)$ converges completely to $0$ as $n\to\infty$, i.e.,

$$\sum_{n=1}^{\infty}P(D_{q}(F_{n},F)>\epsilon)<\infty$$

for any $\epsilon>0$.

Note that complete convergence implies almost sure convergence, as described in [5, Remark 4.4].

Theorem 2.4.

For each $q\in\mathbb{N}_{+}$, the distribution of $D_{q}(F_{n},F)$ is the same for all continuous $F\in\mathcal{F}$.

Theorem 2.5.

If $F\in\mathcal{F}$ is continuous on $\mathbb{R}$,

$$\lim_{n\to\infty}P\biggl{(}D_{2}(F_{n},F)\geq\frac{a}{\sqrt{n}}\biggr{)}=2\sum_{i=1}^{\infty}(4i^{2}a^{2}-1)\exp(-2i^{2}a^{2})$$ (6)

for any $a>0$.

Note that $P(D_{2}(F_{n},F)\geq a/\sqrt{n})$ in 6 is independent of any continuous $F\in\mathcal{F}$ by Theorem 2.4. By this theorem, we have the asymptotic distribution function of $\sqrt{n}D_{2}(F_{n},F)$:

$$\lim_{n\to\infty}P(\sqrt{n}D_{2}(F_{n},F)\leq a)=1-2\sum_{i=1}^{\infty}(4i^{2}a^{2}-1)\exp(-2i^{2}a^{2}).$$ (7)

See Sections 5.2, 5.3 and 5.4 for the proofs of Theorems 2.3, 2.4 and 2.5, respectively.

3 Numerical experiments

We conducted a computer-based experiment to compare the statistical power of the one-sample OVL-2 test with that of conventional statistical tests, including the one-sample KS test.

Beforehand, we computed $p_{2,n}$, as defined in 4, using the Monte Carlo method for $n=2^{3},2^{4},\ldots,2^{12}$, because exact p-values for the one-sample OVL-2 test could not be computed. More specifically, instead of $p_{2,n}$, we used the empirical distribution function of $D_{2}(U_{n},U)$ computed from 100,000 samples of size $n$ drawn from the standard uniform distribution, whose distribution function is defined as

$$U(x)=\max\{0,\min\{x,1\}\}\qquad(x\in\mathbb{R}).$$ (8)

Here, $U_{n}$ represents $F_{n}$ in the case $F=U$. The empirical distribution functions for $n=2^{3},2^{5},2^{7},2^{9}$ are shown in Fig. 1 together with the theoretical asymptotic distribution function given in 7.

Figure 1: For each $n=8,32,128,512$, we generated 100,000 samples of size $n$ following the standard uniform distribution, and computed $D_{2}(U_{n},U)$ for each sample. The empirical distribution function based on the 100,000 values of $\sqrt{n}D_{2}(U_{n},U)$ is plotted in the graph, along with the right hand side of 7, which represents the asymptotic distribution function where $n\to\infty$.

The probability density functions used in the experiments are defined as follows:

$$\operatorname{Normal}(\mu,\sigma)(x) =\frac{1}{\sqrt{2\pi}\sigma}\exp(-\frac{(x-\mu)^{2}}{2\sigma^{2}}) \mu\in\mathbb{R} \sigma>0 x\in\mathbb{R}$$ (, , ),

$$\operatorname{Trapezoidal}(x) =\begin{cases}(x+2)/2&\text{if $-2\leq x\leq-\sqrt{2}$,}\\ (2-\sqrt{2})/2&\text{if $-\sqrt{2}<x\leq\sqrt{2}$,}\\ (-x+2)/2&\text{if $\sqrt{2}<x\leq 2$,}\\ 0&\text{if $x<-2$ or $2<x$,}\end{cases} x\in\mathbb{R}$$ (),

$$\operatorname{Mixture} =\frac{\operatorname{Normal}(-0.8,0.6)+\operatorname{Normal}(0.8,0.6)}{2},$$

and they are illustrated in Fig. 2.

Figure 2: The probability density functions used in the experiments.

First, we chose two different distributions as the sampling distribution and the reference distribution. Then we repeated the following trial 100,000 times for each sample size $n=2^{3},2^{4},\ldots,2^{12}$: a random sample of size $n$ was drawn from the sampling distribution, and tested under the null hypothesis that it were drawn from the reference distribution. We performed the one-sample OVL-2 test, the one-sample KS test, and the Cramér-von Mises test for each sample, and counted the number of times that the null hypothesis was rejected at 0.05 level of significance. The rate of rejection out of 100,000 trials was assumed to represent the statistical power of the test. The entire source code for the experiment, written in Python 3.11.8, is provided as the Supplementary Material on pages Supplementary Material–Supplementary Material.

The result is shown in Fig. 3. When the sampling distribution was $\operatorname{Normal}(0.2,1)$ and the reference distribution was $\operatorname{Normal}(0,1)$, the powers of the Cramér-von mises test and the one-sample KS test were respectively the first and second highest of the three, while the power of the one-sample OVL-2 test was lower. When the sampling distribution was $\operatorname{Normal}(0,1.1)$, $\operatorname{Trapezoidal}$, or $\operatorname{Mixture}$ and the reference distribution was $\operatorname{Normal}(0,1)$, the power of the one-sample OVL-2 test was the highest among the three, and the powers of the other two were almost equally lower. When the sampling distribution was $\operatorname{Trapezoidal}$ and the reference distribution was $\operatorname{Mixture}$, or vice versa, the power of the one-sample OVL-2 test was the highest, followed by that of the one-sample KS test, and that of the Cramér-von Mises test.

4 Conclusion

In this study, we have developed the one-sample OVL-$q$ test ($q=1,2,\ldots$) as a new goodness-of-fit test, which can also be considered an extended version of the one-sample KS test (because the one-sample KS test is equivalent to the one-sample OVL-1 test). We analyzed the asymptotic properties of the one-sample OVL-2 test statistic and enabled the calculation of its asymptotic p-values.

We conducted numerical experiments to compare the detection power of the one-sample OVL-2 test with conventional goodness-of-fit tests, including the one-sample KS test. In several instances, the one-sample OVL-2 test demonstrated superior performance, suggesting its potential utility.

The limitations of this study are as follows:

• We have not presented a calculation method for the one-sample OVL-$q$ test when $q>2$.

• We calculated asymptotic p-values for the one-sample OVL-2 test statistic, but these are not applicable when the sample size is small.

• We have not proposed a method for calculating p-values when the sample size is small, particularly exact methods.

To make the one-sample OVL-2 test practical, these issues need to be addressed in future research.

Figure 3: The statistical power of the one-sample OVL-2 test to detect the samples from the sampling distribution not following the reference distribution, compared to the statistical powers of the one-sample KS test and the Cramér-von Mises test. The horizontal and vertical axes of every graph represent the sample size and the statistical power, respectively.

5 Proofs

5.1 Proof of Theorem 2.2

Let us denote by $\mathcal{F}^{\prime}$ the set of bounded right-continuous real functions on $\mathbb{R}$, and by $\lVert{\,\cdot\,}\rVert$ the supremum norm on $\mathcal{F}^{\prime}$, i.e.,

$$\lVert\xi\rVert\coloneq\sup_{x\in\mathbb{R}}\lvert\xi(x)\rvert<\infty\qquad(\xi\in\mathcal{F}^{\prime}).$$ (9)

Remark 5.1.

We can easily see that $\mathcal{F}^{\prime}$ is a normed linear space with norm $\lVert{\,\cdot\,}\rVert$, and that $\mathcal{F}$ is a convex subset of $\mathcal{F}^{\prime}$.

Theorem 5.2.

$\mathcal{F}^{\prime}$ is a Banach space with norm $\lVert{\,\cdot\,}\rVert$.

Proof.

Suppose $\{\xi_{n}\}$ is a Cauchy sequence in $\mathcal{F}^{\prime}$. For each $x\in\mathbb{R}$, $\lvert\xi_{m}(x)-\xi_{n}(x)\rvert\leq\lVert\xi_{m}-\xi_{n}\rVert$ implies that $\{\xi_{n}(x)\}$ is a Cauchy sequence, so that there exists $\xi(x)\coloneq\lim_{n\to\infty}\xi_{n}(x)\in\mathbb{R}$ by the completeness of the real line.

For any $\epsilon>0$, there exists $N\in\mathbb{N}_{+}$ such that $m,n\geq N$ implies $\lVert\xi_{m}-\xi_{n}\rVert<\epsilon$, so that $\lvert\xi(x)-\xi_{n}(x)\rvert=\lim_{m\to\infty}\lvert\xi_{m}(x)-\xi_{n}(x)\rvert\leq\epsilon$ for all $x\in\mathbb{R}$, i.e., $\lVert\xi-\xi_{n}\rVert\leq\epsilon$, which also implies that $\lVert\xi\rVert\leq\lVert\xi_{n}\rVert+\epsilon<\infty$.

For any $\epsilon>0$, there exists $n\in\mathbb{N}_{+}$ with $\lVert\xi-\xi_{n}\rVert\leq\epsilon$ by the argument above. For each $x\in\mathbb{R}$, there exists $\delta>0$ such that $\lvert\xi_{n}(x)-\xi_{n}(y)\rvert<\epsilon$ for all $y\in(x,x+\delta)$ since $\xi_{n}$ is right-continuous, so that

$$\lvert\xi(x)-\xi(y)\rvert =\lvert\xi(x)-\xi_{n}(x)+\xi_{n}(x)-\xi_{n}(y)+\xi_{n}(y)-\xi(y)\rvert$$

$$\leq\lvert\xi(x)-\xi_{n}(x)\rvert+\lvert\xi_{n}(x)-\xi_{n}(y)\rvert+\lvert\xi_{n}(y)-\xi(y)\rvert$$

$$<3\epsilon$$

for all $y\in(x,x+\delta)$. Hence $\xi$ is right-continuous.

Now we see that $\xi\in\mathcal{F}^{\prime}$ and $\lim_{n\to\infty}\lVert\xi-\xi_{n}\rVert=0$, and the proof is complete. ∎

Lemma 5.3.

$\mathcal{F}$ is a closed subspace of $(\mathcal{F}^{\prime},\lVert{\,\cdot\,}\rVert)$.

Proof.

Let $\{\xi_{n}\}$ be a convergent sequence in $\mathcal{F}\subset\mathcal{F}^{\prime}$ and $\xi\coloneq\lim_{n\to\infty}\xi_{n}\in\mathcal{F}^{\prime}$.

For each $x\in\mathbb{R}$, $\lvert\xi_{n}(x)-\xi(x)\rvert\leq\lVert\xi_{n}-\xi\rVert\to 0$ ($n\to\infty$) implies that $\xi(x)=\lim_{n\to\infty}\xi_{n}(x)$. Hence $\xi(x)\leq\xi(y)$ for any $x<y$, since $\xi_{n}(x)\leq\xi_{n}(y)$ for all $n$. This means that $\xi$ is nondecreasing.

For any $\epsilon>0$, there exists $n\in\mathbb{N}_{+}$ with $\lVert\xi_{n}-\xi\rVert<\epsilon$. Since $\lim_{x\to-\infty}\xi_{n}(x)=0$, there exists $M\in\mathbb{R}$ such that $\lvert\xi_{n}(x)\rvert<\epsilon$ for all $x<M$. Hence $\lvert\xi(x)\rvert=\lvert\xi(x)-\xi_{n}(x)+\xi_{n}(x)\rvert\leq\lvert\xi(x)-\xi_{n}(x)\rvert+\lvert\xi_{n}(x)\rvert<\lVert\xi-\xi_{n}\rVert+\epsilon<2\epsilon$ for all $x<M$. Therefore, $\lim_{x\to-\infty}\xi(x)=0$. The proof for $\lim_{x\to\infty}\xi(x)=1$ is similar.

Taken together, we have shown that $\xi\in\mathcal{F}$. ∎

The following theorem follows immediately from Theorems 2.1, 5.2 and 5.3.

Theorem 5.4.

$(\mathcal{F},D_{1})$ is a complete metric space.

Remark 5.5.

We can see that $(\mathcal{F},D_{1})$ is not separable. For example, the collection of open subsets

$$\{F\in\mathcal{F}:D_{1}(F,\mathbbm{1}_{[a,\infty)})<1/2\}\qquad(a\in\mathbb{R})$$

is pairwise disjoint and uncountable. Here note that $D_{1}(\mathbbm{1}_{[a,\infty)},\mathbbm{1}_{[b,\infty)})=1$ if $a\neq b$.

Lemma 5.6.

For any $a,b,c\in\mathbb{R}$, $\min\{a,b\}+\min\{b,c\}\leq\min\{a,c\}+b$.

Proof.

We can assume that $a\leq c$ without loss of generality. If $a\leq b$, then $\min\{a,b\}+\min\{b,c\}=\min\{a,c\}+\min\{b,c\}\leq\min\{a,c\}+b$. If $a\geq b$, then $\min\{a,b\}+\min\{b,c\}=b+\min\{b,c\}\leq b+\min\{a,c\}$. ∎

Theorem 5.7.

For each $q\in\mathbb{N}_{+}$, $(\mathcal{F},D_{q})$ is a metric space.

Proof.

We have to show that, for all $F,G,H\in\mathcal{F}$,

1. $0\leq D_{q}(F,G)<\infty$.

2. $D_{q}(F,G)=0$ if and only if $F=G$.

3. $D_{q}(F,G)=D_{q}(G,F)$.

4. $D_{q}(F,G)\leq D_{q}(F,H)+D_{q}(H,G)$.

(a) and (c) follows from definition.

Let us start with (b). If $F=G$, then $r_{F,G}(\boldsymbol{v})=1$ for any $\boldsymbol{v}\in\mathbb{R}_{\leq}^{q}$, so that $D_{q}(F,G)=0$, by definition. If $D_{q}(F,G)=0$, then $\inf_{\boldsymbol{v}\in\mathbb{R}_{\leq}^{q}}r_{F,G}(\boldsymbol{v})=1$, so that $r_{F,G}(\boldsymbol{v})=1$ for all $\boldsymbol{v}\in\mathbb{R}_{\leq}^{q}$, which implies $F=G$ by the following arguments. If $F(x)<G(x)$ for some $x\in\mathbb{R}$, then for $\boldsymbol{v}=(x,\ldots,x)\in\mathbb{R}_{\leq}^{q}$, we have

$$r_{F,G}(\boldsymbol{v}) =\min\bigl{\{}F|_{-\infty}^{x},G|_{-\infty}^{x}\bigr{\}}+\min\bigl{\{}F|_{x}^{\infty},G|_{x}^{\infty}\bigr{\}}$$

$$=\min\{F(x),G(x)\}+\min\{1-F(x),1-G(x)\}$$

$$=F(x)-G(x)+1$$

$$<1.$$

Hence $F\geq G$ if $D_{q}(F,G)=0$. Similarly, $F\leq G$ if $D_{q}(F,G)=0$, proving (b).

As for (d), we have

$$\inf_{\boldsymbol{v}\in\mathbb{R}_{\leq}^{q}}r_{F,H}(\boldsymbol{v})+\inf_{\boldsymbol{v}\in\mathbb{R}_{\leq}^{q}}r_{H,G}(\boldsymbol{v})$$

$$=\inf_{\boldsymbol{v}\in\mathbb{R}_{\leq}^{q}}\sum_{i=0}^{q}\min\bigl{\{}F|_{v_{i}}^{v_{i+1}},H|_{v_{i}}^{v_{i+1}}\bigr{\}}+\inf_{\boldsymbol{v}\in\mathbb{R}_{\leq}^{q}}\sum_{i=0}^{q}\min\bigl{\{}H|_{v_{i}}^{v_{i+1}},G|_{v_{i}}^{v_{i+1}}\bigr{\}}$$

$$\leq\inf_{\boldsymbol{v}\in\mathbb{R}_{\leq}^{q}}\sum_{i=0}^{q}\bigl{(}\min\bigl{\{}F|_{v_{i}}^{v_{i+1}},H|_{v_{i}}^{v_{i+1}}\bigr{\}}+\min\bigl{\{}H|_{v_{i}}^{v_{i+1}},G|_{v_{i}}^{v_{i+1}}\bigr{\}}\bigr{)}$$

$$\leq\inf_{\boldsymbol{v}\in\mathbb{R}_{\leq}^{q}}\sum_{i=0}^{q}\bigl{(}\min\bigl{\{}F|_{v_{i}}^{v_{i+1}},G|_{v_{i}}^{v_{i+1}}\bigr{\}}+H|_{v_{i}}^{v_{i+1}}\bigr{)}$$

$$=\inf_{\boldsymbol{v}\in\mathbb{R}_{\leq}^{q}}r_{F,G}(\boldsymbol{v})+1$$

by 2 and 5.6, so that $D_{q}(F,G)\leq D_{q}(F,H)+D_{q}(H,G)$. This completes the proof. ∎

Lemma 5.8.

For any $F,G\in\mathcal{F}$, $D_{q}(F,G)\leq D_{q^{\prime}}(F,G)$ if $q<q^{\prime}$.

Proof.

Since $\inf_{\boldsymbol{v}\in\mathbb{R}_{\leq}^{q^{\prime}}}r_{F,G}(\boldsymbol{v})\leq\inf_{\boldsymbol{v}\in\mathbb{R}_{\leq}^{q}}r_{F,G}(\boldsymbol{v})$ by definition, $D_{q}(F,G)\leq D_{q^{\prime}}(F,G)$ holds. ∎

Lemma 5.9.

For each $q\in\mathbb{N}_{+}$, $D_{q}(F,G)\leq qD_{1}(F,G)$ for all $F,G\in\mathcal{F}$.

Proof.

It follows from definition that

$$D_{q}(F,G) =1-\inf_{\boldsymbol{v}\in\mathbb{R}_{\leq}^{q}}\sum_{i=0}^{q}\min\bigl{\{}F|_{v_{i}}^{v_{i+1}},G|_{v_{i}}^{v_{i+1}}\bigr{\}}$$

$$=1-\inf_{\boldsymbol{v}\in\mathbb{R}_{\leq}^{q}}\sum_{i=0}^{q}\frac{1}{2}\bigl{(}F|_{v_{i}}^{v_{i+1}}+G|_{v_{i}}^{v_{i+1}}-\bigl{\lvert}F|_{v_{i}}^{v_{i+1}}-G|_{v_{i}}^{v_{i+1}}\bigr{\rvert}\bigr{)}$$

$$=1-\inf_{\boldsymbol{v}\in\mathbb{R}_{\leq}^{q}}\biggl{(}1-\sum_{i=0}^{q}\frac{1}{2}\bigl{\lvert}F|_{v_{i}}^{v_{i+1}}-G|_{v_{i}}^{v_{i+1}}\bigr{\rvert}\biggr{)}$$

$$=\sup_{\boldsymbol{v}\in\mathbb{R}_{\leq}^{q}}\sum_{i=0}^{q}\frac{1}{2}\bigl{\lvert}F|_{v_{i}}^{v_{i+1}}-G|_{v_{i}}^{v_{i+1}}\bigr{\rvert}$$

$$\leq\sup_{\boldsymbol{v}\in\mathbb{R}_{\leq}^{q}}\sum_{i=1}^{q}\lvert F(v_{i})-G(v_{i})\rvert$$

$$\leq q\sup_{x\in\mathbb{R}}\lvert F(x)-G(x)\rvert$$

$$=qD_{1}(F,G),$$

and the proof is complete. ∎

Remark 5.10.

As shown in the proof above, we obtain the equation

$$D_{q}(F,G)=\frac{1}{2}\sup_{\boldsymbol{v}\in\mathbb{R}_{\leq}^{q}}\sum_{i=0}^{q}\bigl{\lvert}F|_{v_{i}}^{v_{i+1}}-G|_{v_{i}}^{v_{i+1}}\bigr{\rvert}\qquad(F,G\in\mathcal{F}).$$

The following theorem follows immediately from Lemmas 5.8 and 5.9.

Theorem 5.11.

For each $q\in\mathbb{N}_{+}$, $D_{1}(F,G)\leq D_{q}(F,G)\leq qD_{1}(F,G)$ for all $F,G\in\mathcal{F}$.

Now Theorem 2.2 follows from Theorems 5.4, 5.7 and 5.11.

5.2 Proof of Theorem 2.3

Theorem 5.12.

(The Glivenko-Cantelli theorem. See the proof of [8, Theorem A, Section 2.1.4].) $\sup_{x\in\mathbb{R}}\lvert F_{n}(x)-F(x)\rvert$ converges completely to 0 as $n\to\infty$, i.e.,

$$\sum_{n=1}^{\infty}P\biggl{(}\sup_{x\in\mathbb{R}}\lvert F_{n}(x)-F(x)\rvert>\epsilon\biggr{)}<\infty$$

for any $\epsilon>0$.

It follows from Lemmas 5.9 and 5.12 that

$$\sum_{n=1}^{\infty}P(D_{q}(F_{n},F)>\epsilon) \leq\sum_{n=1}^{\infty}P\biggl{(}q\sup_{x\in\mathbb{R}}\lvert F_{n}(x)-F(x)\rvert>\epsilon\biggr{)}$$

$$=\sum_{n=1}^{\infty}P\biggl{(}\sup_{x\in\mathbb{R}}\lvert F_{n}(x)-F(x)\rvert>\epsilon/q\biggr{)}$$

$$<\infty$$

for any $\epsilon>0$. This proves Theorem 2.3.

5.3 Proof of Theorem 2.4

Let us denote by $F^{-}$ the quantile function of $F\in\mathcal{F}$, i.e.,

$$F^{-}(y)\coloneq\inf\{x\in\mathbb{R}:F(x)\geq y\}\qquad(y\in[0,1])$$ (10)

with the convention that $\inf\emptyset\coloneq\infty$ and $\inf\mathbb{R}\coloneq-\infty$. Let $U$ be the standard uniform distribution function defined in 8.

Theorem 5.13.

(See [3, Proposition 1.1] or [4, Propositions 1 and 2] for reference.)

1. For any $y\in(0,1)$, $F^{-}(y)$ is a finite real number.

2. For any $y\in(0,1)$, $F(F^{-}(y))\geq y$.

3. For any $x\in\mathbb{R}$ and $y\in(0,1)$, $F(x)\geq y$ if and only if $x\geq F^{-}(y)$.

4. If the distribution function of $Z$ is $U$, then the distribution function of $F^{-}(Z)$ is $F$.

Let $W_{1},\ldots,W_{n}$ be i.i.d. random variables on a probability space $(\Omega^{\prime},\mathcal{A}^{\prime},P^{\prime})$ with $U$, $X_{i}^{\prime}\coloneq F^{-}(W_{i})$ for $i=1,\ldots,n$, and

$$U_{n}(x) \coloneq\frac{1}{n}\sum_{i=1}^{n}\mathbbm{1}_{(-\infty,x]}(W_{i})\qquad(x\in\mathbb{R}),$$

$$F_{n}^{\prime}(x) \coloneq\frac{1}{n}\sum_{i=1}^{n}\mathbbm{1}_{(-\infty,x]}(X_{i}^{\prime})\qquad(x\in\mathbb{R}).$$

As described in Section 2.1, $X_{1},\ldots,X_{n}$ are i.i.d. random variables on $(\Omega,\mathcal{A},P)$ with $F$ and

$$F_{n}(x)\coloneq\frac{1}{n}\sum_{i=1}^{n}\mathbbm{1}_{(-\infty,x]}(X_{i})\qquad(x\in\mathbb{R}).$$

The following colloraries are immediate consequences of Theorem 5.13.

Corollary 5.14.

The random variables $X_{1}^{\prime},\ldots,X_{n}^{\prime}$ are i.i.d. with the same distribution function $F$. The probability measure on $\mathcal{B}(\mathbb{R}^{n})$ induced by $(X_{1}^{\prime},\ldots,X_{n}^{\prime})$ and that by $(X_{1},\ldots,X_{n})$ are the same, i.e.,

$$P^{\prime}((X_{1}^{\prime},\ldots,X_{n}^{\prime})\in A)=P((X_{1},\ldots,X_{n})\in A)\qquad(A\in\mathcal{B}(\mathbb{R}^{n})).$$

Corollary 5.15.

It holds almost surely that $F_{n}^{\prime}=U_{n}\circ F$.

Note that $F=U\circ F$ holds obviously.

Theorem 5.16.

For each $q\in\mathbb{N}_{+}$, $D_{q}(F_{n}^{\prime},F)\leq D_{q}(U_{n},U)$ almost surely. If $F$ is continuous on $\mathbb{R}$, $D_{q}(F_{n}^{\prime},F)=D_{q}(U_{n},U)$ almost surely.

Proof.

For $\boldsymbol{v}=(v_{1},\ldots,v_{q})\in\mathbb{R}_{\leq}^{q}$, it follows from 2 and 5.15 that

$$r_{F_{n}^{\prime},F}(\boldsymbol{v}) =\sum_{i=0}^{q}\min\bigl{\{}F_{n}^{\prime}|_{v_{i}}^{v_{i+1}},F|_{v_{i}}^{v_{i+1}}\bigr{\}}$$

$$=\sum_{i=0}^{q}\min\bigl{\{}U_{n}\circ F|_{v_{i}}^{v_{i+1}},U\circ F|_{v_{i}}^{v_{i+1}}\bigr{\}}$$

$$=\sum_{i=0}^{q}\min\Bigl{\{}U_{n}|_{F(v_{i})}^{F(v_{i+1})},U|_{F(v_{i})}^{F(v_{i+1})}\Bigr{\}},$$

where $F(v_{0})=F(-\infty)=0$ and $F(v_{q+1})=F(\infty)=1$. Since $U_{n}(0)=0=U_{n}(-\infty)$ and $U_{n}(1)=1=U_{n}(\infty)$ with probability 1, we have

$$r_{F_{n}^{\prime},F}(\boldsymbol{v})=r_{U_{n},U}(F(\boldsymbol{v})),\qquad F(\boldsymbol{v})\coloneq(F(v_{1}),\ldots,F(v_{n}))\in\mathbb{R}_{\leq}^{q}$$

almost surely. Hence

$$\inf_{\boldsymbol{v}\in\mathbb{R}_{\leq}^{q}}r_{F_{n}^{\prime},F}(\boldsymbol{v})=\inf_{\boldsymbol{v}\in\mathbb{R}_{\leq}^{q}}r_{U_{n},U}(F(\boldsymbol{v}))\geq\inf_{\boldsymbol{v}\in\mathbb{R}_{\leq}^{q}}r_{U_{n},U}(\boldsymbol{v})$$

and $D_{q}(F_{n}^{\prime},F)\leq D_{q}(U_{n},U)$ almost surely. If $F$ is continuous on $\mathbb{R}$, we have $F(\mathbb{R})\supset(0,1)$, so that

$$\inf_{\boldsymbol{v}\in\mathbb{R}_{\leq}^{q}}r_{U_{n},U}(F(\boldsymbol{v}))=\inf_{\boldsymbol{v}\in\mathbb{R}_{\leq}^{q}}r_{U_{n},U}(\boldsymbol{v})$$

and $D_{q}(F_{n}^{\prime},F)=D_{q}(U_{n},U)$ almost surely. ∎

Let us define, for each $(t_{1},\ldots,t_{n})\in\mathbb{R}^{n}$,

$$\Phi_{(t_{1},\ldots,t_{n})}(x)\coloneq\frac{1}{n}\sum_{i=1}^{n}\mathbbm{1}_{(-\infty,x]}(t_{i})\qquad(x\in\mathbb{R}).$$

We also define, for each $q\in\mathbb{N}_{+}$ and $\xi\in\mathcal{F}$,

$$\widetilde{D}_{q,\xi}(\boldsymbol{t})\coloneq D_{q}(\Phi_{\boldsymbol{t}},\xi)\qquad(\boldsymbol{t}\in\mathbb{R}^{n}).$$

Remark 5.17.

We see that $D_{q}(U_{n},U)=\widetilde{D}_{q,U}\circ(W_{1},\ldots,W_{n})$ and $D_{q}(F_{n}^{\prime},F)=\widetilde{D}_{q,F}\circ(X_{1}^{\prime},\ldots,X_{n}^{\prime})$ on $(\Omega^{\prime},\mathcal{A}^{\prime},P^{\prime})$, and $D_{q}(F_{n},F)=\widetilde{D}_{q,F}\circ(X_{1},\ldots,X_{n})$ on $(\Omega,\mathcal{A},P)$.

Theorem 5.18.

For each $q\in\mathbb{N}_{+}$ and $\xi\in\mathcal{F}$, $\widetilde{D}_{q,\xi}$ is a Borel measurable function on $\mathbb{R}^{n}$.

Proof.

Let us put $\mathbb{Q}_{\leq}^{q}\coloneq\mathbb{R}_{\leq}^{q}\cap\mathbb{Q}^{q}$. It is obvious that

$$\inf_{\boldsymbol{v}\in\mathbb{R}_{\leq}^{q}}r_{\Phi_{\boldsymbol{t}},\xi}(\boldsymbol{v})\leq\inf_{\boldsymbol{v}\in\mathbb{Q}_{\leq}^{q}}r_{\Phi_{\boldsymbol{t}},\xi}(\boldsymbol{v})\qquad(\boldsymbol{t}\in\mathbb{R}^{n}).$$ (11)

For any $\epsilon>0$, there exists $\boldsymbol{x}\coloneq(x_{1},\ldots,x_{q})\in\mathbb{R}_{\leq}^{q}$ such that $r_{\Phi_{\boldsymbol{t}},\xi}(\boldsymbol{x})<\inf_{\boldsymbol{v}\in\mathbb{R}_{\leq}^{q}}r_{\Phi_{\boldsymbol{t}},\xi}(\boldsymbol{v})+\epsilon$. Let $\{\boldsymbol{a}_{i}\coloneq(a_{i,1},\ldots,a_{i,q})\}$ be a sequence in $\mathbb{Q}_{\leq}^{q}$ such that for each $j\in\{1,\ldots,q\}$, $a_{i,j}$ converges to $x_{j}$ from the right as $i\to\infty$. Since $\Phi_{\boldsymbol{t}}$ and $\xi$ are right-continuous on $\mathbb{R}$, $\lim_{i\to\infty}r_{\Phi_{\boldsymbol{t}},\xi}(\boldsymbol{a}_{i})=r_{\Phi_{\boldsymbol{t}},\xi}(\boldsymbol{x})$. Hence $r_{\Phi_{\boldsymbol{t}},\xi}(\boldsymbol{b})<\inf_{\boldsymbol{v}\in\mathbb{R}_{\leq}^{q}}r_{\Phi_{\boldsymbol{t}},\xi}(\boldsymbol{v})+\epsilon$ for some $\boldsymbol{b}\in\mathbb{Q}_{\leq}^{q}$. With 11, we have

$$\inf_{\boldsymbol{v}\in\mathbb{R}_{\leq}^{q}}r_{\Phi_{\boldsymbol{t}},\xi}(\boldsymbol{v})=\inf_{\boldsymbol{v}\in\mathbb{Q}_{\leq}^{q}}r_{\Phi_{\boldsymbol{t}},\xi}(\boldsymbol{v})\qquad(\boldsymbol{t}\in\mathbb{R}^{n}),$$ (12)

so that

$$\widetilde{D}_{q,\xi}(\boldsymbol{t})=1-\inf_{\boldsymbol{v}\in\mathbb{Q}_{\leq}^{q}}r_{\Phi_{\boldsymbol{t}},\xi}(\boldsymbol{v})\qquad(\boldsymbol{t}\in\mathbb{R}^{n}).$$ (13)

by definition.

It is immediate from definition that $\Phi_{\bullet}(x)\colon\mathbb{R}^{n}\to\mathbb{R}$ and $r_{\Phi_{\bullet},\xi}(\boldsymbol{v})\colon\mathbb{R}^{n}\to\mathbb{R}$ are Borel measurable for each $x\in\mathbb{R}$ and $\boldsymbol{v}\in\mathbb{R}_{\leq}^{q}$, respectively. Hence $\widetilde{D}_{q,\xi}\colon\mathbb{R}^{n}\to\mathbb{R}$ can be described by the countable infimum of Borel measurable functions by 13. This implies the claim. ∎

The next corollary follows from Remarks 5.17 and 5.18.

Corollary 5.19.

$D_{q}(U_{n},U)$ and $D_{q}(F_{n}^{\prime},F)$ are random variables on $(\Omega^{\prime},\mathcal{A}^{\prime},P^{\prime})$, and $D_{q}(F_{n},F)$ is a random variable on $(\Omega,\mathcal{A},P)$.

Theorem 5.20.

For each $q\in\mathbb{N}_{+}$, the probability measure on $\mathcal{B}(\mathbb{R})$ induced by $D_{q}(U_{n},U)$ and that by $D_{q}(F_{n},F)$ are the same if $F$ is continuous on $\mathbb{R}$.

Proof.

For any $A\in\mathcal{B}(\mathbb{R})$, we have

$$P^{\prime}\bigl{(}D_{q}(U_{n},U)^{-1}(A)\bigr{)} =P^{\prime}\bigl{(}D_{q}(F_{n}^{\prime},F)^{-1}(A)\bigr{)}$$

$$=\bigl{(}P^{\prime}\circ(X_{1}^{\prime},\ldots,X_{n}^{\prime})^{-1}\bigr{)}\Bigl{(}\widetilde{D}_{q,F}^{-1}(A)\Bigr{)}$$

$$=\bigl{(}P\circ(X_{1},\ldots,X_{n})^{-1}\bigr{)}\Bigl{(}\widetilde{D}_{q,F}^{-1}(A)\Bigr{)}$$

$$=P\bigl{(}D_{q}(F_{n},F)^{-1}(A)\bigr{)}$$

by Corollaries 5.14, 5.17, 5.16, 5.18 and 5.19. ∎

This theorem implies Theorem 2.4.

5.4 Proof of Theorem 2.5

Definition 5.21.

For $F,G\in\mathcal{F}$, $x\in\mathbb{R}$, and $\boldsymbol{v}=(v_{1},v_{2})\in\mathbb{R}_{\leq}^{2}$, define

$$\delta_{F,G}(x) \coloneq F(x)-G(x),$$

$$d_{F,G}(\boldsymbol{v}) \coloneq\lvert\delta_{F,G}(v_{1})\rvert+\lvert\delta_{F,G}(v_{2})-\delta_{F,G}(v_{1})\rvert+\lvert\delta_{F,G}(v_{2})\rvert.$$

We also put $\overline{\delta}_{F,G}\coloneq\sup_{x\in\mathbb{R}}\delta_{F,G}(x)$ and $\underline{\delta}_{F,G}\coloneq\inf_{x\in\mathbb{R}}\delta_{F,G}(x)$. Note that $\underline{\delta}_{F,G}\leq 0\leq\overline{\delta}_{F,G}$ since $\lim_{x\to\pm\infty}\delta_{F,G}(x)=0$.

Lemma 5.22 (cf. [6, Lemma 7.4]).

For any $F,G\in\mathcal{F}$, $\sup_{\boldsymbol{v}\in\mathbb{R}_{\leq}^{2}}d_{F,G}(\boldsymbol{v})=2(\overline{\delta}_{F,G}-\underline{\delta}_{F,G})$.

Proof.

Given $\boldsymbol{w}=(w_{1},w_{2})\in\mathbb{R}_{\leq}^{2}$, we have

$$\max\{\delta_{F,G}(w_{1}),\delta_{F,G}(w_{2})\}+\min\{\delta_{F,G}(w_{1}),\delta_{F,G}(w_{2})\} =\delta_{F,G}(w_{1})+\delta_{F,G}(w_{2}),$$

$$\max\{\delta_{F,G}(w_{1}),\delta_{F,G}(w_{2})\}-\min\{\delta_{F,G}(w_{1}),\delta_{F,G}(w_{2})\} =\lvert\delta_{F,G}(w_{1})-\delta_{F,G}(w_{2})\rvert.$$

If $\delta_{F,G}(w_{1})>0$ and $\delta_{F,G}(w_{2})>0$, then

$$d_{F,G}(\boldsymbol{w}) =\delta_{F,G}(w_{1})+\delta_{F,G}(w_{2})+\lvert\delta(w_{2})-\delta(w_{1})\rvert$$

$$=2\max\{\delta_{F,G}(w_{1}),\delta_{F,G}(w_{2})\}$$

$$\leq 2\overline{\delta}_{F,G}$$

$$\leq 2(\overline{\delta}_{F,G}-\underline{\delta}_{F,G}).$$

If $\delta_{F,G}(w_{1})<0$ and $\delta_{F,G}(w_{2})<0$, then

$$d_{F,G}(\boldsymbol{w}) =-(\delta_{F,G}(w_{1})+\delta_{F,G}(w_{2}))+\lvert\delta(w_{2})-\delta(w_{1})\rvert$$

$$=-2\min\{\delta_{F,G}(w_{1}),\delta_{F,G}(w_{2})\}$$

$$\leq-2\underline{\delta}_{F,G}$$

$$\leq 2(\overline{\delta}_{F,G}-\underline{\delta}_{F,G}).$$

If $\delta_{F,G}(w_{1})\delta_{F,G}(w_{2})\leq 0$, then $\lvert\delta_{F,G}(w_{1})\rvert+\lvert\delta_{F,G}(w_{2})\rvert=\lvert\delta_{F,G}(w_{1})-\delta_{F,G}(w_{2})\rvert$, hence

$$d_{F,G}(\boldsymbol{w}) =2\lvert\delta_{F,G}(w_{1})-\delta_{F,G}(w_{2})\rvert$$

$$\leq 2(\overline{\delta}_{F,G}-\underline{\delta}_{F,G}).$$

Taken together, $d_{F,G}(\boldsymbol{w})\leq 2(\overline{\delta}_{F,G}-\underline{\delta}_{F,G})$ holds in general. Since $\boldsymbol{w}$ was arbitrary, we obtain $\sup_{\boldsymbol{v}\in\mathbb{R}_{\leq}^{2}}d_{F,G}(\boldsymbol{v})\leq 2(\overline{\delta}_{F,G}-\underline{\delta}_{F,G})$.

On the other hand, for any $\epsilon>0$, there exist $w_{1}^{\prime},w_{2}^{\prime}\in\mathbb{R}$ such that $\overline{\delta}_{F,G}-\epsilon/4<\delta_{F,G}(w_{1}^{\prime})$ and $\underline{\delta}_{F,G}+\epsilon/4>\delta_{F,G}(w_{2}^{\prime})$. Putting $w_{1}=\min\{w_{1}^{\prime},w_{2}^{\prime}\}$, $w_{2}=\max\{w_{1}^{\prime},w_{2}^{\prime}\}$, and $\boldsymbol{w}=(w_{1},w_{2})\in\mathbb{R}_{\leq}^{2}$, we have

$$2(\overline{\delta}_{F,G}-\underline{\delta}_{F,G}) <2(\delta_{F,G}(w_{1}^{\prime})-\delta_{F,G}(w_{2}^{\prime}))+\epsilon$$

$$\leq 2\lvert\delta_{F,G}(w_{2})-\delta_{F,G}(w_{1})\rvert+\epsilon$$

$$\leq d_{F,G}(\boldsymbol{w})+\epsilon.$$

Since $\epsilon$ was arbitrary, we obtain $2(\overline{\delta}_{F,G}-\underline{\delta}_{F,G})\leq\sup_{\boldsymbol{v}\in\mathbb{R}_{\leq}^{2}}d_{F,G}(\boldsymbol{v})$. ∎

Lemma 5.23.

For any $F,G\in\mathcal{F}$, $D_{2}(F,G)=\overline{\delta}_{F,G}-\underline{\delta}_{F,G}$.

Proof.

We have

$$D_{2}(F,G) =\frac{1}{2}\sup_{\boldsymbol{v}\in\mathbb{R}_{\leq}^{2}}\sum_{i=0}^{2}\bigl{\lvert}F|_{v_{i}}^{v_{i+1}}-G|_{v_{i}}^{v_{i+1}}\bigr{\rvert}$$

$$=\frac{1}{2}\sup_{\boldsymbol{v}\in\mathbb{R}_{\leq}^{2}}d_{F,G}(\boldsymbol{v})$$

$$=\overline{\delta}_{F,G}-\underline{\delta}_{F,G}$$

by Remarks 5.10 and 5.22. ∎

Definition 5.24.

(See [2, pages 353 and 443] for reference.) Let $T$ be a set and $(\Omega,\mathcal{A},P)$ a probability space. A mapping $Y\colon T\times\Omega\to\mathbb{R}$ is called a stochastic process if $Y_{t}\coloneq Y(t,{\,\cdot\,})\colon\Omega\to\mathbb{R}$ is measurable for each $t\in T$. We say that $Y$ is Gaussian if $(Y_{t_{1}},\ldots,Y_{t_{m}})\colon\Omega\to\mathbb{R}^{m}$ is Gaussian for any $t_{1},\ldots,t_{m}\in T$.

Definition 5.25.

(See [2, page 445] for reference.) Let $Y\colon T\times\Omega\to\mathbb{R}$ be a Gaussian stochastic process with $T=[0,1]$. If the following conditions hold:

• $\mathbb{E}[Y_{t}]=0$ for any $t\in T$,

• $\mathbb{E}[Y_{s}Y_{t}]=s(1-t)$ for any $s,t\in T$ with $s\leq t$,

• $Y$ is sample continuous, i.e., $Y({\,\cdot\,},\omega)\colon T\to\mathbb{R}$ is continuous for any $\omega\in\Omega$,

then $Y$ is called a Brownian bridge.

Theorem 5.26.

[2, Proposition 12.3.4]. For a Brownian bridge $Y$ and any $a>0$,

$$P\biggl{(}\sup_{t\in[0,1]}\lvert Y_{t}\rvert\geq a\biggr{)}=2\sum_{i=1}^{\infty}(-1)^{i-1}\exp(-2i^{2}a^{2}).$$

Theorem 5.27.

[2, Proposition 12.3.6]. For a Brownian bridge $Y$ and any $a>0$,

$$P\biggl{(}\sup_{t\in[0,1]}Y_{t}-\inf_{t\in[0,1]}Y_{t}\geq a\biggr{)}=2\sum_{i=1}^{\infty}(4i^{2}a^{2}-1)\exp(-2i^{2}a^{2}).$$

Definition 5.28.

(See [1, Section 12] for reference.) Let $D[0,1]$ be the space of real functions on $[0,1]$ that are right-continuous and have left-hand limits (such functions are called càdlàg functions). Let $\Lambda$ be the set of strictly increasing, continuous mappings of $[0,1]$ onto itself. For $g,h\in D[0,1]$, define

$$\lVert g\rVert \coloneq\sup_{t\in[0,1]}\lvert g(t)\rvert<\infty,$$

$$d(g,h) \coloneq\inf_{\lambda\in\Lambda}\max\{\lVert\lambda-I\rVert,\lVert g-h\circ\lambda\rVert\}<\infty,$$

where $I$ denotes the identity map on $[0,1]$. The function $d$ is a metric on $D[0,1]$, which defines the Skorohod topology.

Lemma 5.29.

(See [1, page 124] for reference.) For an element $g$ and a sequence $\{g_{n}\}$ in $D[0,1]$, $\lim_{n\to\infty}g_{n}=g$ if and only if $\lim_{n\to\infty}\lVert\lambda_{n}-I\rVert=0$ and $\lim_{n\to\infty}\lVert g-g_{n}\circ\lambda_{n}\rVert=0$ for some sequence $\{\lambda_{n}\}$ in $\Lambda$.

Proof.

If $\lim_{n\to\infty}g_{n}=g$, then $\lim_{n\to\infty}d(g,g_{n})=\lim_{n\to\infty}\inf_{\lambda\in\Lambda}\max\{\lVert\lambda-I\rVert,\lVert g-g_{n}\circ\lambda\rVert\}=0$. Since there exists $\lambda_{n}\in\Lambda$ for each $n\in\mathbb{N}_{+}$ such that

$$\inf_{\lambda\in\Lambda}\max\{\lVert\lambda-I\rVert,\lVert g-g_{n}\circ\lambda\rVert\} \leq\max\{\lVert\lambda_{n}-I\rVert,\lVert g-g_{n}\circ\lambda_{n}\rVert\}$$

$$<\inf_{\lambda\in\Lambda}\max\{\lVert\lambda-I\rVert,\lVert g-g_{n}\circ\lambda\rVert\}+\frac{1}{n},$$

$\lim_{n\to\infty}\lVert\lambda_{n}-I\rVert=0$ and $\lim_{n\to\infty}\lVert g-g_{n}\circ\lambda_{n}\rVert=0$ hold.

On the other hand, suppose $\lim_{n\to\infty}\lVert\lambda_{n}-I\rVert=0$ and $\lim_{n\to\infty}\lVert g-g_{n}\circ\lambda_{n}\rVert=0$ for some sequence $\{\lambda_{n}\}$ in $\Lambda$. Then for any $\epsilon>0$, there exists $N\in\mathbb{N}$ such that $n>N$ implies $\lVert\lambda_{n}-I\rVert<\epsilon$ and $\lVert g-g_{n}\circ\lambda_{n}\rVert<\epsilon$, so that $\inf_{\lambda\in\Lambda}\max\{\lVert\lambda-I\rVert,\lVert g-g_{n}\circ\lambda\rVert\}<\epsilon$. Hence $\lim_{n\to\infty}g_{n}=g$. ∎

Lemma 5.30.

For $g,h\in D[0,1]$, the following inequalities hold:

$$\biggl{\lvert}\sup_{t\in[0,1]}g(t)-\sup_{t\in[0,1]}h(t)\biggr{\rvert}\leq\lVert g-h\rVert,\qquad\biggl{\lvert}\inf_{t\in[0,1]}g(t)-\inf_{t\in[0,1]}h(t)\biggr{\rvert}\leq\lVert g-h\rVert.$$

Proof.

For any $\epsilon>0$, there exists $t^{\prime}\in[0,1]$ such that $\sup g(t)-\epsilon<g(t^{\prime})\leq\sup g(t)$. Then $\sup g(t)-\sup h(t)<g(t^{\prime})-\sup h(t)+\epsilon\leq g(t^{\prime})-h(t^{\prime})+\epsilon\leq\lVert g-h\rVert+\epsilon$. Since $\epsilon$ was arbitrary, $\sup g(t)-\sup h(t)\leq\lVert g-h\rVert$ holds. Similarly, $\sup h(t)-\sup g(t)\leq\lVert g-h\rVert$ holds, and the first inequality is proved. The second one can be proved in a similar way. ∎

Theorem 5.31.

The function $\varphi\colon D[0,1]\to\mathbb{R}$ defined by $\varphi(g)\coloneq\sup_{t\in[0,1]}g(t)-\inf_{t\in[0,1]}g(t)$ is continuous.

Proof.

For a given $g\in D[0,1]$, let $\{g_{n}\}$ be a sequence in $D[0,1]$ such that $\lim_{n\to\infty}g_{n}=g$. It suffices to prove that $\lim_{n\to\infty}\varphi(g_{n})=\varphi(g)$. By Lemma 5.29, there exists a sequence $\{\lambda_{n}\}$ in $\Lambda$ such that $\lim_{n\to\infty}\lVert\lambda_{n}-I\rVert=0$ and $\lim_{n\to\infty}\lVert g-g_{n}\circ\lambda_{n}\rVert=0$. By Lemma 5.30, we have

$$\lvert\varphi(g_{n})-\varphi(g)\rvert =\lvert\sup g_{n}(t)-\inf g_{n}(t)-\sup g(t)+\inf g(t)\rvert$$

$$\leq\lvert\sup g_{n}(t)-\sup g(t)\rvert+\lvert\inf g_{n}(t)-\inf g(t)\rvert$$

$$=\lvert\sup g_{n}(\lambda_{n}(t))-\sup g(t)\rvert+\lvert\inf g_{n}(\lambda_{n}(t))-\inf g(t)\rvert$$

$$\leq 2\lVert g_{n}\circ\lambda_{n}-g\rVert.$$

Hence $\lim_{n\to\infty}\lvert\varphi(g_{n})-\varphi(g)\rvert\leq 2\lim_{n\to\infty}\lVert g_{n}\circ\lambda_{n}-g\rVert=0$. ∎

Definition 5.32.

(See [1, pages 7 and 15–16] for reference.) Suppose $P$ is a Borel probability measure and $\{P_{n}\}$ a sequence of Borel probability measures on a metric space $S$. We say that $P_{n}$ converges weakly to $P$ (denoted by $P_{n}\Rightarrow P$) if $\lim_{n\to\infty}P_{n}g=Pg$ for all bounded continuous functions $g\colon S\to\mathbb{R}$, where $Pg\coloneq\int_{S}g\>\mathrm{d}P$. A set $A\subset S$ whose boundary $\partial A$ satisfies $P(\partial A)=0$ is called a $P$-continuity set.

Theorem 5.33.

[1, Theorem 2.1]. Suppose $P$ is a Borel probability measure and $\{P_{n}\}$ a sequence of Borel probability measures on a metric space $S$. Then these five conditions are equivalent:

1. $P_{n}\Rightarrow P$.

2. $\lim_{n\to\infty}P_{n}g=Pg$ for all bounded, uniformly continuous functions $g\colon S\to\mathbb{R}$.

3. $\limsup_{n\to\infty}P_{n}(K)\leq P(K)$ for any closed set $K\subset S$.

4. $\liminf_{n\to\infty}P_{n}(V)\geq P(V)$ for any open set $V\subset S$.

5. $\lim_{n\to\infty}P_{n}(A)=P(A)$ for any $P$-continuity set $A\subset S$.

Definition 5.34.

(See [1, pages 24–26] for reference.) We call a map from a probability space $(\Omega,\mathcal{A},P)$ to a metric space $S$ a random element if it is Borel measurable. (As is customary, we call it a random variable if, in addition, $S=\mathbb{R}$.) Suppose $Z$ is a random element and $\{Z_{n}\}$ a sequence of random elements from $(\Omega,\mathcal{A},P)$ to $S$. The law of $Z$ is the Borel probability measure $L_{Z}\coloneq P\circ Z^{-1}$ on $S$. We say that $Z_{n}$ converges in distribution to $Z$ (denoted by $Z_{n}\Rightarrow Z$) if $L_{Z_{n}}\Rightarrow L_{Z}$. A set $A\subset S$ with $P(Z^{-1}(\partial A))=0$ is called a $Z$-continuity set.

Theorem 5.35.

[1, page 26]. Suppose $Z$ is a random element and $\{Z_{n}\}$ a sequence of random elements from a probability space $(\Omega,\mathcal{A},P)$ to a metric space $S$. Then these five conditions are equivalent:

1. $Z_{n}\Rightarrow Z$.

2. $\lim_{n\to\infty}\mathbb{E}[g(Z_{n})]=\mathbb{E}[g(Z)]$ for all bounded, uniformly continuous functions $g\colon S\to\mathbb{R}$.

3. $\limsup_{n\to\infty}P(Z_{n}\in K)\leq P(Z\in K)$ for any closed set $K\subset S$.

4. $\liminf_{n\to\infty}P(Z_{n}\in V)\geq P(Z\in V)$ for any open set $V\subset S$.

5. $\lim_{n\to\infty}P(Z_{n}\in A)=P(Z\in A)$ for any $Z$-continuity set $A\subset S$.

Theorem 5.36.

[1, page 20]. Suppose $P$ is a Borel probability measure and $\{P_{n}\}$ a sequence of Borel probability measures on a metric space $S$. Let $S^{\prime}$ be another metric space and $h\colon S\to S^{\prime}$ a continuous map. If $P_{n}\Rightarrow P$, then $P_{n}\circ h^{-1}\Rightarrow P\circ h^{-1}$.

Remark 5.37 (See [1, page 135] for reference).

Note that $Y\colon(\Omega,\mathcal{A},P)\to D[0,1]$ is a random element if and only if $Y_{\bullet}\colon[0,1]\times\Omega\to\mathbb{R}$ is a stochastic process (i.e., $Y_{t}\colon\Omega\to\mathbb{R}$ is a random variable for all $t\in[0,1]$).

Theorem 5.38.

Suppose $X_{1},\ldots,X_{n}$ are i.i.d. random variables on a probability space $(\Omega,\mathcal{A},P)$ with a continuous distribution function $F\in\mathcal{F}$, and $F_{n}(t)=\sum_{i=1}^{n}\mathbbm{1}_{(-\infty,t]}(X_{i})/n$ for $t\in\mathbb{R}$. Then

$$\lim_{n\to\infty}P\biggl{(}D_{2}(F_{n},F)\geq\frac{a}{\sqrt{n}}\biggr{)}=2\sum_{i=1}^{\infty}(4i^{2}a^{2}-1)\exp(-2i^{2}a^{2})$$ (14)

for any $a>0$.

Proof.

Let $U_{n}$ be defined as in Section 5.3 on $(\Omega,\mathcal{A},P)$, $Y_{t}^{n}=\sqrt{n}(U_{n}(t)-U(t))$ for $t\in[0,1]$, and $Y\colon[0,1]\times\Omega\to\mathbb{R}$ a Brownian bridge. Then $Y^{n}$ and $Y$ are random elements on $(\Omega,\mathcal{A},P)$ to $D[0,1]$, and $Y^{n}\Rightarrow Y$ (which means $L_{Y^{n}}\Rightarrow L_{Y}$) by [1, Theorem 14.3]. Since

$$L_{Y^{n}}\circ\varphi^{-1}([a,\infty))=P\biggl{(}\sup_{t\in[0,1]}Y_{t}^{n}-\inf_{t\in[0,1]}Y_{t}^{n}\geq a\biggr{)},$$

$$L_{Y}\circ\varphi^{-1}([a,\infty)) =P\biggl{(}\sup_{t\in[0,1]}Y_{t}-\inf_{t\in[0,1]}Y_{t}\geq a\biggr{)}$$

$$=2\sum_{i=1}^{\infty}(4i^{2}a^{2}-1)\exp(-2i^{2}a^{2})$$

for any $a>0$ by Theorem 5.27, and $\lim_{n\to\infty}(L_{Y^{n}}\circ\varphi^{-1})([a,\infty))=(L_{Y}\circ\varphi^{-1})([a,\infty))$ by Theorems 5.31, 5.36 and 5.33, we obtain

$$\lim_{n\to\infty}P\biggl{(}\sup_{t\in[0,1]}Y_{t}^{n}-\inf_{t\in[0,1]}Y_{t}^{n}\geq a\biggr{)}=2\sum_{i=1}^{\infty}(4i^{2}a^{2}-1)\exp(-2i^{2}a^{2})\qquad(a>0).$$ (15)

Note that $[a,\infty)$ is an $L_{Y}\circ\varphi^{-1}$-continuity set. It holds almost surely that $\sup_{t\in[0,1]}Y_{t}^{n}=\sup_{t\in(0,1)}Y_{t}^{n}$, $\inf_{t\in[0,1]}Y_{t}^{n}=\inf_{t\in(0,1)}Y_{t}^{n}$. The continuity of $F$ implies that $(0,1)\subset F(\mathbb{R})\subset[0,1]$. Therefore, we have

$$P\biggl{(}\sup_{t\in[0,1]}Y_{t}^{n}-\inf_{t\in[0,1]}Y_{t}^{n}\geq a\biggr{)}$$

$$=P\biggl{(}\sup_{x\in\mathbb{R}}Y_{F(x)}^{n}-\inf_{x\in\mathbb{R}}Y_{F(x)}^{n}\geq a\biggr{)}$$

$$=P\biggl{(}\sup_{x\in\mathbb{R}}(U_{n}(F(x))-U(F(x)))-\inf_{x\in\mathbb{R}}(U_{n}(F(x))-U(F(x)))\geq\frac{a}{\sqrt{n}}\biggr{)}$$

$$=P\biggl{(}\sup_{x\in\mathbb{R}}(F_{n}(x)-F(x))-\inf_{x\in\mathbb{R}}(F_{n}(x)-F(x))\geq\frac{a}{\sqrt{n}}\biggr{)}$$

$$=P\biggl{(}D_{2}(F_{n},F)\geq\frac{a}{\sqrt{n}}\biggr{)}$$

by Corollaries 5.14, 5.15 and 5.23. With 15, we obtain 14. ∎

This theorem is equivalent to Theorem 2.5.

Funding

This study was partially supported by JSPS KAKENHI Grant Numbers JP21K15762, JP20K03509, and JP24K06686.

Supplementary Material

The source code of the experiment in Section 3. The following packages are required:

• numpy==1.26.4

• pandas==2.2.2

• scipy==1.13.0

• matplotlib==3.8.4

This work © 2024 by Atsushi Komaba is licensed under Creative Commons Attribution 4.0 International. To view a copy of this license, visit https://creativecommons.org/licenses/by/4.0/

⬇

# Copyright (c) 2024 Atsushi Komaba

import math

import numpy as np

import pandas as pd

from scipy import stats

from matplotlib import pyplot as plt

# The number of d2 values computed to obtain its empirical distribution

num_d2s_under_h0 = 100000

# Repetition time for the experiments

num_repeat = 100000

# Sample sizes used in the experiments

sample_sizes = [2**i for i in range(3, 13)]

# Distributions used in the experiments

class Mixture:

def rvs(self, size, random_state):

ret = 1.0 * random_state.integers(2, size=size)

i = ret == 0

ret[i] = stats.norm.rvs(

-4 / 5,

3 / 5,

ret[i].size,

random_state=random_state,

)

ret[~i] = stats.norm.rvs(

4 / 5,

3 / 5,

ret[~i].size,

random_state=random_state,

)

return ret

def cdf(self, xs):

return (

stats.norm.cdf(xs, -4 / 5, 3 / 5) + stats.norm.cdf(xs, 4 / 5, 3 / 5)

) / 2

def pdf(self, xs):

return (

stats.norm.pdf(xs, -4 / 5, 3 / 5) + stats.norm.pdf(xs, 4 / 5, 3 / 5)

) / 2

dists = {

"Normal(0,␣1)": stats.norm(),

"Normal(0.2,␣1)": stats.norm(0.2, 1),

"Normal(0,␣1.1)": stats.norm(0, 1.1),

"Trapezoidal": stats.trapezoid(

(2 - math.sqrt(2)) / 4,

(2 + math.sqrt(2)) / 4,

-2,

4,

),

"Mixture": Mixture(),

}

dist_pairs = [

["Normal(0.2,␣1)", "Normal(0,␣1)"],

["Normal(0,␣1.1)", "Normal(0,␣1)"],

["Trapezoidal", "Normal(0,␣1)"],

["Mixture", "Normal(0,␣1)"],

["Trapezoidal", "Mixture"],

["Mixture", "Trapezoidal"],

]

# Significance level

significance_level = 0.05

# Random generator with fixed seed

rng = np.random.default_rng(seed=0)

# Computes the D2 statistic between ‘cdf‘

# and the empirical distribution function based on ‘xs‘.

def d2(xs, cdf, axis=0):

ys = np.repeat(cdf(np.sort(xs, axis)), 2, axis)

zs = np.repeat(np.linspace(0, 1, xs.shape[axis] + 1), 2)

ds = ys - zs[(slice(1, -1),) + (None,) * (xs.ndim - axis - 1)]

return np.max(ds, axis) - np.min(ds, axis)

# Precomputation of D2 values under the null hypothesis H0.

# Compares samples from the standard uniform distribution U with U itself

uniform = stats.uniform()

d2s_under_h0 = {}

print(f"#␣Precomputation␣of␣D2␣under␣H0␣({num_d2s_under_h0:,}␣each)")

for sample_size in sample_sizes:

print(

f"Sample␣size:␣{sample_size:,}␣...␣",

end="",

flush=True,

)

xs = uniform.rvs((sample_size, num_d2s_under_h0), random_state=rng)

d2s_under_h0[sample_size] = np.sort(d2(xs, uniform.cdf))

print("Done")

# Draws the graphs of the empirical distribution functions obtained above.

def draw_d2_under_h0():

sample_sizes = [2**i for i in range(9, 2, -2)]

num_sample_sizes = len(sample_sizes)

fig = plt.figure(figsize=(8, 3))

ax = fig.subplots()

ax.set_xlim(0.5, 2.5)

# Computes the theoretical asymptotic distribution function.

# Relative errors <= 1e-10.

a = np.linspace(0.5, 2.5, 1000)

i = np.arange(1, 10)

sq = np.outer(a, i) ** 2

asymp_cdf = 1 - 2 * np.sum((4 * sq - 1) * np.exp(-2 * sq), axis=1)

asymp_cdf[a < 0.4] = 0

ax.plot(

a,

asymp_cdf,

color=str(1 - 1 / (num_sample_sizes + 1)),

label=r"$n␣\rightarrow␣\infty$␣(asymptotic)",

)

# Expirical distribution function of D2 under H0.

for i, sample_size in enumerate(sample_sizes):

ax.ecdf(

d2s_under_h0[sample_size] * math.sqrt(sample_size),

label=f"$n␣=␣{sample_size}$␣(empirical)",

color=str((num_sample_sizes - i - 1) / (num_sample_sizes + 1)),

linestyle=(0, (num_sample_sizes - i, 1)),

)

handles, labels = ax.get_legend_handles_labels()

ax.legend(handles[::-1], labels[::-1])

ax.set_xlabel(r"$\sqrt{n}D_2(U_n,␣U)$")

fig.tight_layout()

fig.savefig("d2_under_h0.pdf")

draw_d2_under_h0()

# PDFs

fig = plt.figure(figsize=(6.4, 3.2))

def dists_pdf(ax, dists_name):

for name, linestyle in zip(dists_name, ["-", "--", ":"]):

xs = np.arange(-4, 4, 0.01)

ax.plot(

xs,

dists[name].pdf(xs),

label=name,

color="black",

linestyle=linestyle,

)

ax.legend()

dists_pdf(

fig.add_subplot(211),

["Normal(0,␣1)", "Normal(0.2,␣1)", "Normal(0,␣1.1)"],

)

dists_pdf(

fig.add_subplot(212),

["Normal(0,␣1)", "Trapezoidal", "Mixture"],

)

fig.tight_layout()

fig.savefig("dists_pdf.pdf")

print(f"#␣The␣experiment␣({num_repeat:,}␣trial␣each)")

fig = plt.figure(figsize=(2 * 6.4, 2 * 4.8))

for idx, [dist_name, ref_name] in enumerate(dist_pairs):

print(f"Sampling␣distribution:␣{dist_name},␣reference␣distribution:␣{ref_name}")

dist = dists[dist_name]

ref = dists[ref_name].cdf

ax = fig.add_subplot(3, 2, idx + 1, xscale="log")

statistical_powers = pd.DataFrame()

for sample_size in sample_sizes:

print(f"␣␣Sample␣size:␣{sample_size:,}")

xs = dist.rvs((sample_size, num_repeat), random_state=rng)

print(

"␣␣␣␣Kolmogorov-Smirnov␣test:␣",

end="",

flush=True,

)

pvalue = stats.ks_1samp(xs, ref).pvalue

num_rejected = np.count_nonzero(pvalue < significance_level)

statistical_powers.loc[sample_size, "Kolmogorov-Smirnov"] = (

num_rejected / num_repeat

)

print(f"rejected␣{num_rejected:,}␣out␣of␣{num_repeat:,}")

print(

"␣␣␣␣Cram\xe9r-von␣Mises␣test:␣",

end="",

flush=True,

)

pvalue = stats.cramervonmises(xs, ref).pvalue

num_rejected = np.count_nonzero(pvalue < significance_level)

statistical_powers.loc[sample_size, "Cram\xe9r-von␣Mises"] = (

num_rejected / num_repeat

)

print(f"rejected␣{num_rejected:,}␣out␣of␣{num_repeat:,}")

print("␣␣␣␣OVL-2:␣", end="", flush=True)

pvalue = (

1

- np.searchsorted(d2s_under_h0[sample_size], d2(xs, ref)) / num_d2s_under_h0

)

num_rejected = np.count_nonzero(pvalue < significance_level)

statistical_powers.loc[sample_size, "OVL-2"] = num_rejected / num_repeat

print(f"rejected␣{num_rejected:,}␣out␣of␣{num_repeat:,}")

ax.set_title(

f"Sampling␣distribution:␣{dist_name},␣reference␣distribution:␣{ref_name}"

)

ax.set_ylim(-0.05, 1.05)

statistical_powers.plot(ax=ax, style=[".-k", "x--k", "+:k"])

ax.legend()

fig.tight_layout()

fig.savefig("result.pdf")