TY - JOUR
T1 - Toward data-driven architectural support in improving the performance of future HPC architectures
AU - Matheou, George
AU - Soteriou, Vassos
AU - Evripidou, Paraskevas
N1 - Funding Information:
This work was partially funded by the Cyprus State Scholarship Foundation (IKΥK) through a scholarship awarded to George Matheou, and by the University of Cyprus through the XProcessor project.
Publisher Copyright:
© 2019 Elsevier B.V.
Copyright:
Copyright 2019 Elsevier B.V., All rights reserved.
PY - 2019/8
Y1 - 2019/8
N2 - We propose architectures based on Data-Driven Multithreading (DDM), a hybrid control-flow/data-flow model, to address the concurrency challenges faced by future High-Performance Computing (HPC)systems. We focus on the design and implementation of an optimized hardware Thread Scheduling Unit (TSU)and its integration into a multi-core system dubbed MiDAS. The TSU is the core of the DDM model and it orchestrates the execution of multiple threads on sequential processors based on data availability. MiDAS was prototyped on a Xilinx Virtex-6 FPGA and extensively evaluated using several micro-benchmarks, showing that it achieves linearly-growing performance as the processing core count increases even when running benchmarks comprising very small problem sizes. Under the largest problem size tested and with all 8 available cores being utilized, MiDAS achieves an average speedup of 7.91×, exhibiting 98.8% utilization efficiency. Further, several results pertaining to the proposed hardware TSU are provided, including FPGA real estate requirements, where it is found that MiDAS's TSU demands relatively small overheads and reduced power consumption, while various TSU operations adhere to low latency responses. To back said claims, the proposed DDM-based TSU is compared with the Task Superscalar architecture that implements the StarSs programming framework in hardware. As such, comparison results show that the proposed TSU requires much less of both hardware investment and energy consumption to operate. Specifically, Task Superscalar is found to be 4.94 × larger than the DDM-supporting TSU in terms of slice register requirements and 11.34 × larger with respect to the slice look-up table count. Last, the hardware TSU is compared with a software TSU implementation offering identical functionalities, with both being run on an FPGA fabric under a synthetic application, where a detailed performance evaluation shows that MiDAS's hardware-implemented TSU significantly outperforms its software-based TSU counterpart.
AB - We propose architectures based on Data-Driven Multithreading (DDM), a hybrid control-flow/data-flow model, to address the concurrency challenges faced by future High-Performance Computing (HPC)systems. We focus on the design and implementation of an optimized hardware Thread Scheduling Unit (TSU)and its integration into a multi-core system dubbed MiDAS. The TSU is the core of the DDM model and it orchestrates the execution of multiple threads on sequential processors based on data availability. MiDAS was prototyped on a Xilinx Virtex-6 FPGA and extensively evaluated using several micro-benchmarks, showing that it achieves linearly-growing performance as the processing core count increases even when running benchmarks comprising very small problem sizes. Under the largest problem size tested and with all 8 available cores being utilized, MiDAS achieves an average speedup of 7.91×, exhibiting 98.8% utilization efficiency. Further, several results pertaining to the proposed hardware TSU are provided, including FPGA real estate requirements, where it is found that MiDAS's TSU demands relatively small overheads and reduced power consumption, while various TSU operations adhere to low latency responses. To back said claims, the proposed DDM-based TSU is compared with the Task Superscalar architecture that implements the StarSs programming framework in hardware. As such, comparison results show that the proposed TSU requires much less of both hardware investment and energy consumption to operate. Specifically, Task Superscalar is found to be 4.94 × larger than the DDM-supporting TSU in terms of slice register requirements and 11.34 × larger with respect to the slice look-up table count. Last, the hardware TSU is compared with a software TSU implementation offering identical functionalities, with both being run on an FPGA fabric under a synthetic application, where a detailed performance evaluation shows that MiDAS's hardware-implemented TSU significantly outperforms its software-based TSU counterpart.
KW - Data-driven multithreading
KW - Data-flow execution
KW - FPGA
KW - HPC
KW - Hardware thread scheduler
KW - Multi-core architecture
UR - http://www.scopus.com/inward/record.url?scp=85067951572&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85067951572&partnerID=8YFLogxK
U2 - 10.1016/j.parco.2019.04.011
DO - 10.1016/j.parco.2019.04.011
M3 - Article
AN - SCOPUS:85067951572
SN - 0167-8191
VL - 86
SP - 82
EP - 106
JO - Parallel Computing
JF - Parallel Computing
ER -