Think globally, fit locally under the manifold setup: Asymptotic analysis of locally linear embedding

Hau Tieng Wu, Nan Wu

Research output: Contribution to journalArticlepeer-review

Abstract

Since its introduction in 2000, Locally Linear Embedding (LLE) has been widely applied in data science. We provide an asymptotical analysis of LLE under the manifold setup. We show that for a general manifold, asymptotically we may not obtain the Laplace–Beltrami operator, and the result may depend on nonuniform sampling unless a correct regularization is chosen. We also derive the corresponding kernel function, which indicates that LLE is not a Markov process. A comparison with other commonly applied nonlinear algorithms, particularly a diffusion map, is provided and its relationship with locally linear regression is also discussed.

Original languageEnglish (US)
Pages (from-to)3805-3837
Number of pages33
JournalAnnals of Statistics
Volume46
Issue number6B
DOIs
StatePublished - 2018

Keywords

  • Diffusion maps
  • Dimension reduction
  • Locally linear embedding
  • Locally linear regression
  • Measurement error

ASJC Scopus subject areas

  • Statistics and Probability
  • Statistics, Probability and Uncertainty

Fingerprint

Dive into the research topics of 'Think globally, fit locally under the manifold setup: Asymptotic analysis of locally linear embedding'. Together they form a unique fingerprint.

Cite this