Pick-a-crowd: Tell me what you like, and I'll tell you what to do: A crowdsourcing platform for personalized human intelligence task assignment based on social networks

Djellel Eddine Difallah, Gianluca Demartini, Philippe Cudré-Mauroux

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Crowdsourcing allows to build hybrid online platforms that combine scalable information systems with the power of human intelligence to complete tasks that are difficult to tackle for current algorithms. Examples include hybrid database systems that use the crowd to fill missing values or to sort items according to subjective dimensions such as picture attractiveness. Current approaches to Crowdsourcing adopt a pull methodology where tasks are published on specialized Web platforms where workers can pick their preferred tasks on a first-come-first-served basis. While this approach has many advantages, such as simplicity and short completion times, it does not guarantee that the task is performed by the most suitable worker. In this paper, we propose and extensively evaluate a different Crowdsourcing approach based on a push methodology. Our proposed system carefully selects which workers should perform a given task based on worker profiles extracted from social networks. Workers and tasks are automatically matched using an underlying categorization structure that exploits entities extracted from the task descriptions on one hand, and categories liked by the user on social platforms on the other hand. We experimentally evaluate our approach on tasks of varying complexity and show that our push methodology consistently yield better results than usual pull strategies. Copyright is held by the International World Wide Web Conference Committee (IW3C2).

Original languageEnglish (US)
Title of host publicationWWW 2013 - Proceedings of the 22nd International Conference on World Wide Web
Pages367-377
Number of pages11
StatePublished - 2013
Event22nd International Conference on World Wide Web, WWW 2013 - Rio de Janeiro, Brazil
Duration: May 13 2013May 17 2013

Publication series

NameWWW 2013 - Proceedings of the 22nd International Conference on World Wide Web

Other

Other22nd International Conference on World Wide Web, WWW 2013
CountryBrazil
CityRio de Janeiro
Period5/13/135/17/13

Keywords

  • Crowdsourcing
  • Expert profiling
  • Social network

ASJC Scopus subject areas

  • Computer Networks and Communications

Fingerprint Dive into the research topics of 'Pick-a-crowd: Tell me what you like, and I'll tell you what to do: A crowdsourcing platform for personalized human intelligence task assignment based on social networks'. Together they form a unique fingerprint.

  • Cite this

    Difallah, D. E., Demartini, G., & Cudré-Mauroux, P. (2013). Pick-a-crowd: Tell me what you like, and I'll tell you what to do: A crowdsourcing platform for personalized human intelligence task assignment based on social networks. In WWW 2013 - Proceedings of the 22nd International Conference on World Wide Web (pp. 367-377). (WWW 2013 - Proceedings of the 22nd International Conference on World Wide Web).