GPU Accelerated Matrix Factorization for Recommender Systems

Doruk Kilitcioglu, Nicholas Greenquist, Mohamed Zahran, Anasse Bari

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Matrix Factorization (MF) is a popular algorithm used to power many recommender systems. Efficient and scalable MF algorithms are essential in order to train on the massive datasets that large scale recommender systems utilize. Graphics Processing Unit (GPU) technology has become very popular in recent years and has become widely used in machine learning. The massive parallelism GPUs offer creates an opportunity to develop an accelerated MF algorithm. This paper presents cu2rec, a matrix factorization algorithm written in CUDA. cu2rec implements a parallel version of Stochastic Gradient Descent (SGD) to solve large scale MF problems. cu2rec utilizes multiple advanced techniques to harness better performance from a GPU. These include aggressive use of constant memory for hyper-parameters and registers for heavily reused values, a sparse matrix data structure, a reduction sum total loss kernel, a novel approach to parallel lock-free updating of feature weights with minimized global memory writes, and fairness across weight updates using user index striding. With a single NVIDIA GPU, cu2rec can be l0x faster than state of the art sequential algorithms while reaching similar error metrics.

Original languageEnglish (US)
Title of host publication2021 IEEE 6th International Conference on Big Data Analytics, ICBDA 2021
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages272-281
Number of pages10
ISBN (Electronic)9780738131672
DOIs
StatePublished - Mar 5 2021
Event6th IEEE International Conference on Big Data Analytics, ICBDA 2021 - Xiamen, China
Duration: Mar 5 2021Mar 8 2021

Publication series

Name2021 IEEE 6th International Conference on Big Data Analytics, ICBDA 2021

Conference

Conference6th IEEE International Conference on Big Data Analytics, ICBDA 2021
CountryChina
CityXiamen
Period3/5/213/8/21

Keywords

  • CUDA
  • GPU
  • SGD
  • matrix factorization
  • recommender system

ASJC Scopus subject areas

  • Information Systems
  • Information Systems and Management
  • Artificial Intelligence
  • Computer Science Applications

Fingerprint Dive into the research topics of 'GPU Accelerated Matrix Factorization for Recommender Systems'. Together they form a unique fingerprint.

Cite this