Navigation-based candidate expansion and pretrained language models for citation recommendation

Rodrigo Nogueira, Zhiying Jiang, Kyunghyun Cho, Jimmy Lin

Research output: Contribution to journalArticlepeer-review

Abstract

Citation recommendation systems for the scientific literature, to help authors find papers that should be cited, have the potential to speed up discoveries and uncover new routes for scientific exploration. We treat this task as a ranking problem, which we tackle with a two-stage approach: candidate generation followed by reranking. Within this framework, we adapt to the scientific domain a proven combination based on “bag of words” retrieval followed by rescoring with a BERT model. We experimentally show the effects of domain adaptation, both in terms of pretraining on in-domain data and exploiting in-domain vocabulary. In addition, we introduce a novel navigation-based document expansion strategy to enrich the candidate documents fed into our neural models. On three benchmark datasets, our methods achieve or rival the state of the art in the citation recommendation task.

Original languageEnglish (US)
Pages (from-to)3001-3016
Number of pages16
JournalScientometrics
Volume125
Issue number3
DOIs
StatePublished - Dec 2020

Keywords

  • Citation graph
  • Domain adaptation
  • Transformers

ASJC Scopus subject areas

  • Social Sciences(all)
  • Computer Science Applications
  • Library and Information Sciences

Fingerprint Dive into the research topics of 'Navigation-based candidate expansion and pretrained language models for citation recommendation'. Together they form a unique fingerprint.

Cite this