Lemma

Suppose that \(z_1\ldots,z_n\) are i.i.d random variables, \(\theta_0\in\Theta\), where \(\Theta\) is compact.

Suppose also that \(a(z_i,\theta)\) is continuous at each \(\theta\in \Theta\) w.p.1,

and there is \(d(z)\) with \(||a(z,\theta)||\le d(z)\) for all \(\theta\in \Theta\) where \(E(d(z))<\infty\).

Then,

  1. \(E(a(Z,\theta))\) is continuous,
  2. \(\sup_{\theta\in\Theta} ||n^{-1} \sum_{i=1}^n a(z_i,\theta)-E(a(Z,\theta))||\stackrel{P}\rightarrow 0\).




back