Instance segmentation of indoor scenes using a coverage loss

Nathan Silberman, David Sontag, Rob Fergus

Research output: Chapter in Book/Report/Conference proceedingConference contribution


A major limitation of existing models for semantic segmentation is the inability to identify individual instances of the same class: when labeling pixels with only semantic classes, a set of pixels with the same label could represent a single object or ten. In this work, we introduce a model to perform both semantic and instance segmentation simultaneously. We introduce a new higher-order loss function that directly minimizes the coverage metric and evaluate a variety of region features, including those from a convolutional network. We apply our model to the NYU Depth V2 dataset, obtaining state of the art results.

Original languageEnglish (US)
Title of host publicationComputer Vision, ECCV 2014 - 13th European Conference, Proceedings
PublisherSpringer Verlag
Number of pages16
EditionPART 1
ISBN (Print)9783319105895
StatePublished - 2014
Event13th European Conference on Computer Vision, ECCV 2014 - Zurich, Switzerland
Duration: Sep 6 2014Sep 12 2014

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
NumberPART 1
Volume8689 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349


Other13th European Conference on Computer Vision, ECCV 2014


  • Deep Learning
  • Semantic Segmentation

ASJC Scopus subject areas

  • Theoretical Computer Science
  • General Computer Science


Dive into the research topics of 'Instance segmentation of indoor scenes using a coverage loss'. Together they form a unique fingerprint.

Cite this