Abstract
This paper is concerned with the problem of fuzzy aggregation of a network with nonnegative weights on its edges into a small number of clusters. Specifically, we want to optimally define a probability of affiliation of each of the n nodes of the network to each of m « n clusters or aggregates. In contrast to statistics-based approaches to this problem, we take a purely dynamical perspective by analyzing the discrete-time Markov chain associated with the network and mapping it onto a Markov chain describing transitions between the clusters. We show that every such aggregated Markov chain and affiliation function can be lifted again onto the full network to define the so-called lifted transition matrix between the nodes of the network. The optimal aggregated Markov chain and affiliation function can then be determined by minimizing some appropriately defined distance between the lifted transition matrix and the transition matrix of the original chain. In general, the resulting constrained nonlinear minimization problem comes out having continuous level sets of minimizers. We exploit this fact to devise an algorithm for identification of the optimal cluster number by choosing specific minimizers from the level sets. Numerical minimization is performed by some appropriately adapted version of restricted line search using projected gradient descent. The resulting algorithmic scheme is shown to perform well on several test examples.
Original language | English (US) |
---|---|
Pages (from-to) | 1535-1561 |
Number of pages | 27 |
Journal | Multiscale Modeling and Simulation |
Volume | 8 |
Issue number | 4 |
DOIs | |
State | Published - 2010 |
Keywords
- Affiliation function
- Clustering
- Constrained nonlinear minimization problem
- Fuzzy aggregation
- Markov chain
- Network
- Numerical minimization
- Partitioning
- Random walk
- Restricted line search
ASJC Scopus subject areas
- General Chemistry
- Modeling and Simulation
- Ecological Modeling
- General Physics and Astronomy
- Computer Science Applications