A multivariate Bayesian scan statistic for early event detection and characterization

Daniel B. Neill, Gregory F. Cooper

Research output: Contribution to journalArticlepeer-review

Abstract

We present the multivariate Bayesian scan statistic (MBSS), a general framework for event detection and characterization in multivariate spatial time series data. MBSS integrates prior information and observations from multiple data streams in a principled Bayesian framework, computing the posterior probability of each type of event in each space-time region. MBSS learns a multivariate Gamma-Poisson model from historical data, and models the effects of each event type on each stream using expert knowledge or labeled training examples. We evaluate MBSS on various disease surveillance tasks, detecting and characterizing outbreaks injected into three streams of Pennsylvania medication sales data. We demonstrate that MBSS can be used both as a "general" event detector, with high detection power across a variety of event types, and a "specific" detector that incorporates prior knowledge of an event's effects to achieve much higher detection power. MBSS has many other advantages over previous event detection approaches, including faster computation and easy interpretation and visualization of results, and allows faster and more accurate event detection by integrating information from the multiple streams. Most importantly, MBSS can model and differentiate between multiple event types, thus distinguishing between events requiring urgent responses and other, less relevant patterns in the data.

Original languageEnglish (US)
Pages (from-to)261-282
Number of pages22
JournalMachine Learning
Volume79
Issue number3
DOIs
StatePublished - Jun 2010

Keywords

  • Biosurveillance
  • Event characterization
  • Event detection
  • Scan statistics

ASJC Scopus subject areas

  • Software
  • Artificial Intelligence

Fingerprint Dive into the research topics of 'A multivariate Bayesian scan statistic for early event detection and characterization'. Together they form a unique fingerprint.

Cite this