Efficient term proximity search with term-pair indexes

Hao Yan, Shuming Shi, Fan Zhang, Torsten Suel, Ji Rong Wen

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Abstract

    There has been a large amount of research on early termination techniques in web search and information retrieval. Such techniques return the top-k documents without scanning and evaluating the full inverted lists of the query terms. Thus, they can greatly improve query processing efficiency. However, only a limited amount of efficient top-k processing work considers the impact of term proximity, i.e., the distance between term occurrences in a document, which has recently been integrated into a number of retrieval models to improve effectiveness. In this paper, we propose new early termination techniques for efficient query processing for the case where term proximity is integrated into the retrieval model. We propose new index structures based on a term-pair index, and study new document retrieval strategies on the resulting indexes. We perform a detailed experimental evaluation on our new techniques and compare them with the existing approaches. Experimental results on large-scale data sets show that our techniques can significantly improve the efficiency of query processing.

    Original languageEnglish (US)
    Title of host publicationCIKM'10 - Proceedings of the 19th International Conference on Information and Knowledge Management and Co-located Workshops
    Pages1229-1238
    Number of pages10
    DOIs
    StatePublished - 2010
    Event19th International Conference on Information and Knowledge Management and Co-located Workshops, CIKM'10 - Toronto, ON, Canada
    Duration: Oct 26 2010Oct 30 2010

    Publication series

    NameInternational Conference on Information and Knowledge Management, Proceedings

    Other

    Other19th International Conference on Information and Knowledge Management and Co-located Workshops, CIKM'10
    CountryCanada
    CityToronto, ON
    Period10/26/1010/30/10

    Keywords

    • Document structure
    • Term proximity
    • Term-pair index
    • Top-k

    ASJC Scopus subject areas

    • Decision Sciences(all)
    • Business, Management and Accounting(all)

    Fingerprint Dive into the research topics of 'Efficient term proximity search with term-pair indexes'. Together they form a unique fingerprint.

    Cite this