Optimal Stopping for Interval Estimation in Bernoulli Trials

Tony Yaacoub, George V. Moustakides, Yajun Mei

Research output: Contribution to journalArticlepeer-review

Abstract

We propose an optimal sequential methodology for obtaining confidence intervals for a binomial proportion \theta. Assuming that an independent and identically distributed sequence of Bernoulli ( \theta ) trials is observed sequentially, we are interested in designing: 1) a stopping time T that will decide the best time to stop sampling the process and 2) an optimum estimator \hat{{\theta}}-{{T}} that will provide the optimum center of the interval estimate of \theta. We follow a semi-Bayesian approach, where we assume that there exists a prior distribution for \theta , and our goal is to minimize the average number of samples while we guarantee a minimal specified coverage probability level. The solution is obtained by applying standard optimal stopping theory and computing the optimum pair (T,\hat{{\theta }}-{{T}}) numerically. Regarding the optimum stopping time component T , we demonstrate that it enjoys certain very interesting characteristics not commonly encountered in solutions of other classical optimal stopping problems. In particular, we prove that, for a particular prior (beta density), the optimum stopping time is always bounded from above and below; it needs to first accumulate a sufficient amount of information before deciding whether or not to stop, and it will always terminate before some finite deterministic time. We also conjecture that these properties are present with any prior. Finally, we compare our method with the optimum fixed-sample-size procedure as well as with existing alternative sequential schemes.

Original languageEnglish (US)
Article number8565954
Pages (from-to)3022-3033
Number of pages12
JournalIEEE Transactions on Information Theory
Volume65
Issue number5
DOIs
StatePublished - May 2019

Keywords

  • binomial proportion
  • confidence intervals
  • optimal stopping
  • sequential analysis
  • Sequential estimation

ASJC Scopus subject areas

  • Information Systems
  • Computer Science Applications
  • Library and Information Sciences

Fingerprint

Dive into the research topics of 'Optimal Stopping for Interval Estimation in Bernoulli Trials'. Together they form a unique fingerprint.

Cite this