TY - GEN
T1 - Deep Learning and Classical Machine Learning for code mapping in Heterogeneous Platforms
AU - Hakimi, Yacine
AU - Baghdadi, Riyad
AU - Challal, Yacine
N1 - Publisher Copyright:
© 2021 IEEE.
PY - 2021
Y1 - 2021
N2 - Programming modern heterogeneous systems is becoming more and more challenging due to their complexity. To simplify software development for such architectures, more advanced compilers are being designed. Such compilers automatically optimize code and hide the complexity of the target heterogeneous architecture from the developer. An example of problems that these compilers need to solve is to decide whether to map (run) a piece of code on CPU or GPU (Graphics Processing Unit). State-of-the-art compilers use accurate optimization heuristics to solve such problems and decide about how to optimize a code automatically. Traditional machine learning and Deep Learning approaches have both been used to build such heuristics. While traditional machine learning is well suited for training on small datasets, it is not well suited for extracting a set of high-quality features, on the other hand, deep learning can automatically extract features, but it needs a large amount of data to get satisfactory results.In this paper, we propose a new machine-learning-based model that allows a compiler to automatically decide whether to map a piece of code to CPU or GPU. Our model uses traditional machine learning and deep learning by exploiting the advantages of each of them. We show that our proposed model, which requires a small amount of data and training time, matches and outperforms state-of-the-art pre-trained deep learning models that require large amounts of data.
AB - Programming modern heterogeneous systems is becoming more and more challenging due to their complexity. To simplify software development for such architectures, more advanced compilers are being designed. Such compilers automatically optimize code and hide the complexity of the target heterogeneous architecture from the developer. An example of problems that these compilers need to solve is to decide whether to map (run) a piece of code on CPU or GPU (Graphics Processing Unit). State-of-the-art compilers use accurate optimization heuristics to solve such problems and decide about how to optimize a code automatically. Traditional machine learning and Deep Learning approaches have both been used to build such heuristics. While traditional machine learning is well suited for training on small datasets, it is not well suited for extracting a set of high-quality features, on the other hand, deep learning can automatically extract features, but it needs a large amount of data to get satisfactory results.In this paper, we propose a new machine-learning-based model that allows a compiler to automatically decide whether to map a piece of code to CPU or GPU. Our model uses traditional machine learning and deep learning by exploiting the advantages of each of them. We show that our proposed model, which requires a small amount of data and training time, matches and outperforms state-of-the-art pre-trained deep learning models that require large amounts of data.
KW - Code Optimizations
KW - Deep Learning
KW - Heterogeneous Platforms
KW - LLVM-IR
KW - Machine Learning
UR - http://www.scopus.com/inward/record.url?scp=85124039380&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85124039380&partnerID=8YFLogxK
U2 - 10.1109/ICNAS53565.2021.9628950
DO - 10.1109/ICNAS53565.2021.9628950
M3 - Conference contribution
AN - SCOPUS:85124039380
T3 - 5th International Conference on Networking and Advanced Systems, ICNAS 2021
BT - 5th International Conference on Networking and Advanced Systems, ICNAS 2021
A2 - Korba, Abdelaziz Amara
A2 - Nafaa, Mehdi
A2 - Ahmim, Marwa
A2 - Bendjedou, Amira
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 5th IEEE International Conference on Networking and Advanced Systems, ICNAS 2021
Y2 - 27 October 2021 through 28 October 2021
ER -