Separability and geometry of object manifolds in deep neural networks

Uri Cohen, Sue Yeon Chung, Daniel D. Lee, Haim Sompolinsky

Research output: Contribution to journalArticlepeer-review

Abstract

Stimuli are represented in the brain by the collective population responses of sensory neurons, and an object presented under varying conditions gives rise to a collection of neural population responses called an ‘object manifold’. Changes in the object representation along a hierarchical sensory system are associated with changes in the geometry of those manifolds, and recent theoretical progress connects this geometry with ‘classification capacity’, a quantitative measure of the ability to support object classification. Deep neural networks trained on object classification tasks are a natural testbed for the applicability of this relation. We show how classification capacity improves along the hierarchies of deep neural networks with different architectures. We demonstrate that changes in the geometry of the associated object manifolds underlie this improved capacity, and shed light on the functional roles different levels in the hierarchy play to achieve it, through orchestrated reduction of manifolds’ radius, dimensionality and inter-manifold correlations.

Original languageEnglish (US)
Article number746
JournalNature communications
Volume11
Issue number1
DOIs
StatePublished - Dec 1 2020

ASJC Scopus subject areas

  • Chemistry(all)
  • Biochemistry, Genetics and Molecular Biology(all)
  • Physics and Astronomy(all)

Fingerprint

Dive into the research topics of 'Separability and geometry of object manifolds in deep neural networks'. Together they form a unique fingerprint.

Cite this