NeuFlow: A runtime reconfigurable dataflow processor for vision

Clément Farabet, Berin Martini, Benoit Corda, Polina Akselrod, Eugenio Culurciello, Yann Lecun

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

In this paper we present a scalable dataflow hardware architecture optimized for the computation of general-purpose vision algorithms neuFlow and a dataflow compiler luaFlow that transforms high-level flow-graph representations of these algorithms into machine code for neuFlow. This system was designed with the goal of providing real-time detection, categorization and localization of objects in complex scenes, while consuming 10 Watts when implemented on a Xilinx Virtex 6 FPGA platform, or about ten times less than a laptop computer, and producing speedups of up to 100 times in real-world applications. We present an application of the system on street scene analysis, segmenting 20 categories on 500 × 375 frames at 12 frames per second on our custom hardware neuFlow.

Original languageEnglish (US)
Title of host publication2011 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2011
PublisherIEEE Computer Society
Pages109-116
Number of pages8
ISBN (Print)9781457705298
DOIs
StatePublished - 2011
Event2011 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2011 - Colorado Springs, CO, United States
Duration: Jun 20 2011Jun 25 2011

Publication series

NameIEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops
ISSN (Print)2160-7508
ISSN (Electronic)2160-7516

Other

Other2011 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2011
Country/TerritoryUnited States
CityColorado Springs, CO
Period6/20/116/25/11

ASJC Scopus subject areas

  • Computer Vision and Pattern Recognition
  • Electrical and Electronic Engineering

Fingerprint

Dive into the research topics of 'NeuFlow: A runtime reconfigurable dataflow processor for vision'. Together they form a unique fingerprint.

Cite this