Using graphics processors for high-performance IR query processing

Shuai Ding, Jinru He, Hao Yan, Torsten Suel

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Abstract

    Web search engines are facing formidable performance challenges as they need to process thousands of queries per second over billions of documents. To deal with this heavy workload, current engines use massively parallel architectures of thousands of machines that require large hardware investments. We investigate new ways to build such high-performance IR systems based on Graphical Processing Units (GPUs). GPUs were originally designed to accelerate computer graphics applications through massive on-chip parallelism. Recently a number of researchers have studied how to use GPUs for other problem domains including databases and scientific computing [2, 3, 5], but we are not aware of previous attempts to use GPUs for large-scale web search. Our contribution here is to design a basic system architecture for GPU-based high-performance IR, and to describe how to perform highly efficient query processing within such an architecture. Preliminary experimental results based on a prototype implementation suggest that significant gains in query processing performance might be obtainable with such an approach.

    Original languageEnglish (US)
    Title of host publicationProceeding of the 17th International Conference on World Wide Web 2008, WWW'08
    Pages1213-1214
    Number of pages2
    DOIs
    StatePublished - 2008
    Event17th International Conference on World Wide Web 2008, WWW'08 - Beijing, China
    Duration: Apr 21 2008Apr 25 2008

    Publication series

    NameProceeding of the 17th International Conference on World Wide Web 2008, WWW'08

    Other

    Other17th International Conference on World Wide Web 2008, WWW'08
    CountryChina
    CityBeijing
    Period4/21/084/25/08

    Keywords

    • GPU
    • Query processing
    • Web search

    ASJC Scopus subject areas

    • Computer Networks and Communications

    Fingerprint Dive into the research topics of 'Using graphics processors for high-performance IR query processing'. Together they form a unique fingerprint.

    Cite this