Can far memory improve job throughput?

Emmanuel Amaro, Christopher Branner-Augmon, Zhihong Luo, Amy Ousterhout, Marcos K. Aguilera, Aurojit Panda, Sylvia Ratnasamy, Scott Shenker

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

As memory requirements grow, and advances in memory technology slow, the availability of sufficient main memory is increasingly the bottleneck in large compute clusters. One solution to this is memory disaggregation, where jobs can remotely access memory on other servers, or far memory. This paper first presents faster swapping mechanisms and a far memory-Aware cluster scheduler that make it possible to support far memory at rack scale. Then, it examines the conditions under which this use of far memory can increase job throughput. We find that while far memory is not a panacea, for memory-intensive workloads it can provide performance improvements on the order of 10% or more even without changing the total amount of memory available.

Original languageEnglish (US)
Title of host publicationProceedings of the 15th European Conference on Computer Systems, EuroSys 2020
PublisherAssociation for Computing Machinery, Inc
ISBN (Electronic)9781450368827
DOIs
StatePublished - Apr 15 2020
Event15th European Conference on Computer Systems, EuroSys 2020 - Heraklion, Greece
Duration: Apr 27 2020Apr 30 2020

Publication series

NameProceedings of the 15th European Conference on Computer Systems, EuroSys 2020

Conference

Conference15th European Conference on Computer Systems, EuroSys 2020
CountryGreece
CityHeraklion
Period4/27/204/30/20

ASJC Scopus subject areas

  • Information Systems
  • Computer Networks and Communications
  • Hardware and Architecture
  • Software
  • Control and Systems Engineering

Fingerprint Dive into the research topics of 'Can far memory improve job throughput?'. Together they form a unique fingerprint.

  • Cite this

    Amaro, E., Branner-Augmon, C., Luo, Z., Ousterhout, A., Aguilera, M. K., Panda, A., Ratnasamy, S., & Shenker, S. (2020). Can far memory improve job throughput? In Proceedings of the 15th European Conference on Computer Systems, EuroSys 2020 (Proceedings of the 15th European Conference on Computer Systems, EuroSys 2020). Association for Computing Machinery, Inc. https://doi.org/10.1145/3342195.3387522