Abstract
Since its introduction in 2000, Locally Linear Embedding (LLE) has been widely applied in data science. We provide an asymptotical analysis of LLE under the manifold setup. We show that for a general manifold, asymptotically we may not obtain the Laplace–Beltrami operator, and the result may depend on nonuniform sampling unless a correct regularization is chosen. We also derive the corresponding kernel function, which indicates that LLE is not a Markov process. A comparison with other commonly applied nonlinear algorithms, particularly a diffusion map, is provided and its relationship with locally linear regression is also discussed.
Original language | English (US) |
---|---|
Pages (from-to) | 3805-3837 |
Number of pages | 33 |
Journal | Annals of Statistics |
Volume | 46 |
Issue number | 6B |
DOIs | |
State | Published - 2018 |
Keywords
- Diffusion maps
- Dimension reduction
- Locally linear embedding
- Locally linear regression
- Measurement error
ASJC Scopus subject areas
- Statistics and Probability
- Statistics, Probability and Uncertainty