DiCeS: Detecting communities in network streams over the cloud

Panagiotis Liakos, Katia Papakonstantinopoulou, Alexandros Ntoulas, Alex Delis

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

We consider the problem of uncovering communities in complex real-world networks whose nodes and their respective associations originate in streams of data. Although community detection has received much attention in centralized settings, the prevalence of online social networks has resulted in unprecedented volumes of data whose handling calls for novel streaming approaches. Moreover, bursty production of network interactions necessitates cloud-enabled techniques that can both deal with diverse data rates and deploy more computing resources on the fly for improved performance yields. We propose a distributed streaming community detection approach termed DiCeS, and implement it as a cloud application. While seeking communities, the novelty of our approach is at balancing the incoming load to a cluster of computing nodes and adjusting the cluster processing capacity in an elastic manner. We also provide fault tolerance by ensuring that temporarily suspended or failed nodes are restored and all edges of the network stream ultimately received their due processing. Lastly, DiCeS is interactive regarding i) updating the target communities, and ii) obtaining results on demand. Our experimental results demonstrate that DiCeS does handle the edges of real-world network streams at impressive rates, allows for near-linear scaling, and outperforms previous non-distributed approaches. While using ground-truth communities for a wide range of large real-word networks, we also show that DiCeS attains improved accuracy if compared to earlier centralized algorithms.

Original languageEnglish (US)
Title of host publicationProceedings - 2019 IEEE International Conference on Cloud Computing, CLOUD 2019 - Part of the 2019 IEEE World Congress on Services
EditorsElisa Bertino, Carl K. Chang, Peter Chen, Ernesto Damiani, Michael Goul, Katsunori Oyama
PublisherIEEE Computer Society
Pages301-310
Number of pages10
ISBN (Electronic)9781728127057
DOIs
StatePublished - Jul 2019
Event12th IEEE International Conference on Cloud Computing, CLOUD 2019 - Milan, Italy
Duration: Jul 8 2019Jul 13 2019

Publication series

NameIEEE International Conference on Cloud Computing, CLOUD
Volume2019-July
ISSN (Print)2159-6182
ISSN (Electronic)2159-6190

Conference

Conference12th IEEE International Conference on Cloud Computing, CLOUD 2019
CountryItaly
CityMilan
Period7/8/197/13/19

Keywords

  • Cloud
  • Community detection
  • Graph streams

ASJC Scopus subject areas

  • Artificial Intelligence
  • Information Systems
  • Software

Fingerprint Dive into the research topics of 'DiCeS: Detecting communities in network streams over the cloud'. Together they form a unique fingerprint.

Cite this