Interactive wrapper generation with minimal user effort

Utku Irmak, Torsten Suel

    Research output: Chapter in Book/Report/Conference proceedingConference contribution


    While much of the data on the web is unstructured in nature, there is also a significant amount of embedded structured data, such as product information on e-commerce sites or stock data on financial sites. A large amount of research has focused on the problem of generating wrappers, i.e., software tools that allow easy and robust extraction of structured data from text and HTML sources. In many applications, such as comparison shopping, data has to be extracted from many different sources, making manual coding of a wrapper for each source impractical. On the other hand, fully automatic approaches are often not reliable enough, resulting in low quality of the extracted data.We describe a complete system for semi-automatic wrapper generation that can be trained on different data sources in a simple interactive manner. Our goal is to minimize the amount of user effort for training reliable wrappers through design of a suitable training interface that is implemented based on a powerful underlying extraction language and a set of training and ranking algorithms. Our experiments show that our system achieves reliable extraction with a very small amount of user effort.

    Original languageEnglish (US)
    Title of host publicationProceedings of the 15th International Conference on World Wide Web
    Number of pages11
    StatePublished - 2006
    Event15th International Conference on World Wide Web - Edinburgh, Scotland, United Kingdom
    Duration: May 23 2006May 26 2006

    Publication series

    NameProceedings of the 15th International Conference on World Wide Web


    Other15th International Conference on World Wide Web
    Country/TerritoryUnited Kingdom
    CityEdinburgh, Scotland


    • Active learning
    • Data extraction
    • Wrapper generation

    ASJC Scopus subject areas

    • Computer Networks and Communications
    • Software


    Dive into the research topics of 'Interactive wrapper generation with minimal user effort'. Together they form a unique fingerprint.

    Cite this