Filtering algorithms and implementation for very fast Publish/Subscribe systems

Françoise Fabret, H. Arno Jacobsen, François Llirbat, Joao Pereira, Kenneth A. Ross, Dennis Shasha

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Publish/Subscribe is the paradigm in which users express long-term interests ("subscriptions") and some agent "publishes" events (e.g., offers). The job of Publish/Subscribe software is to send events to the owners of subscriptions satisfied by those events. For example, a user subscription may consist of an interest in an airplane of a certain type, not to exceed a certain price. A published event may consist of an offer of an airplane with certain properties including price. Each subscription consists of a conjunction of (attribute, comparison operator, value) predicates. A subscription closely resembles a trigger in that it is a longlived conditional query associated with an action (usually, informing the subscriber). However, it is less general than a trigger so novel data structures and implementations may enable the creation of more scalable, high performance publish/subscribe systems. This paper describes an attempt at the construction of such algorithms and its implementation. Using a combination of data structures, application-specific caching policies, and application-specific query processing our system can handle 600 events per second for a typical workload containing 6 million subscriptions.

Original languageEnglish (US)
Title of host publicationProceedings of the ACM SIGMOD International Conference on Management of Data
EditorsT. Sellis, S. Mehrotra
Pages115-126
Number of pages12
StatePublished - 2001
Event2001 ACM SIGMOD International Conference on Management of Data - Santa Barbara, CA, United States
Duration: May 21 2001May 24 2001

Other

Other2001 ACM SIGMOD International Conference on Management of Data
CountryUnited States
CitySanta Barbara, CA
Period5/21/015/24/01

ASJC Scopus subject areas

  • Computer Science(all)

Fingerprint Dive into the research topics of 'Filtering algorithms and implementation for very fast Publish/Subscribe systems'. Together they form a unique fingerprint.

Cite this