Facial expression transfer with input-output Temporal Restricted Boltzmann Machines

Matthew D. Zeiler; Graham W. Taylor; Leonid Sigal; Iain Matthews; Rob Fergus

Facial expression transfer with input-output Temporal Restricted Boltzmann Machines

Matthew D. Zeiler, Graham W. Taylor, Leonid Sigal, Iain Matthews, Rob Fergus

Computer Science

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

We present a type of Temporal Restricted Boltzmann Machine that defines a probability distribution over an output sequence conditional on an input sequence. It shares the desirable properties of RBMs: efficient exact inference, an exponentially more expressive latent state than HMMs, and the ability to model nonlinear structure and dynamics. We apply our model to a challenging real-world graphics problem: facial expression transfer. Our results demonstrate improved performance over several baselines modeling high-dimensional 2D and 3D data.

Original language	English (US)
Title of host publication	Advances in Neural Information Processing Systems 24
Subtitle of host publication	25th Annual Conference on Neural Information Processing Systems 2011, NIPS 2011
Publisher	Neural Information Processing Systems
ISBN (Print)	9781618395993
State	Published - 2011
Event	25th Annual Conference on Neural Information Processing Systems 2011, NIPS 2011 - Granada, Spain Duration: Dec 12 2011 → Dec 14 2011

Publication series

Name	Advances in Neural Information Processing Systems 24: 25th Annual Conference on Neural Information Processing Systems 2011, NIPS 2011

Other

Other	25th Annual Conference on Neural Information Processing Systems 2011, NIPS 2011
Country/Territory	Spain
City	Granada
Period	12/12/11 → 12/14/11

ASJC Scopus subject areas

Information Systems

Cite this

Zeiler, M. D., Taylor, G. W., Sigal, L., Matthews, I., & Fergus, R. (2011). Facial expression transfer with input-output Temporal Restricted Boltzmann Machines. In Advances in Neural Information Processing Systems 24: 25th Annual Conference on Neural Information Processing Systems 2011, NIPS 2011 (Advances in Neural Information Processing Systems 24: 25th Annual Conference on Neural Information Processing Systems 2011, NIPS 2011). Neural Information Processing Systems.

Facial expression transfer with input-output Temporal Restricted Boltzmann Machines. / Zeiler, Matthew D.; Taylor, Graham W.; Sigal, Leonid et al.
Advances in Neural Information Processing Systems 24: 25th Annual Conference on Neural Information Processing Systems 2011, NIPS 2011. Neural Information Processing Systems, 2011. (Advances in Neural Information Processing Systems 24: 25th Annual Conference on Neural Information Processing Systems 2011, NIPS 2011).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Zeiler, MD, Taylor, GW, Sigal, L, Matthews, I & Fergus, R 2011, Facial expression transfer with input-output Temporal Restricted Boltzmann Machines. in Advances in Neural Information Processing Systems 24: 25th Annual Conference on Neural Information Processing Systems 2011, NIPS 2011. Advances in Neural Information Processing Systems 24: 25th Annual Conference on Neural Information Processing Systems 2011, NIPS 2011, Neural Information Processing Systems, 25th Annual Conference on Neural Information Processing Systems 2011, NIPS 2011, Granada, Spain, 12/12/11.

Zeiler MD, Taylor GW, Sigal L, Matthews I, Fergus R. Facial expression transfer with input-output Temporal Restricted Boltzmann Machines. In Advances in Neural Information Processing Systems 24: 25th Annual Conference on Neural Information Processing Systems 2011, NIPS 2011. Neural Information Processing Systems. 2011. (Advances in Neural Information Processing Systems 24: 25th Annual Conference on Neural Information Processing Systems 2011, NIPS 2011).

Zeiler, Matthew D. ; Taylor, Graham W. ; Sigal, Leonid et al. / Facial expression transfer with input-output Temporal Restricted Boltzmann Machines. Advances in Neural Information Processing Systems 24: 25th Annual Conference on Neural Information Processing Systems 2011, NIPS 2011. Neural Information Processing Systems, 2011. (Advances in Neural Information Processing Systems 24: 25th Annual Conference on Neural Information Processing Systems 2011, NIPS 2011).

@inproceedings{1b2508529c6843f684fd42b15f3d7399,

title = "Facial expression transfer with input-output Temporal Restricted Boltzmann Machines",

abstract = "We present a type of Temporal Restricted Boltzmann Machine that defines a probability distribution over an output sequence conditional on an input sequence. It shares the desirable properties of RBMs: efficient exact inference, an exponentially more expressive latent state than HMMs, and the ability to model nonlinear structure and dynamics. We apply our model to a challenging real-world graphics problem: facial expression transfer. Our results demonstrate improved performance over several baselines modeling high-dimensional 2D and 3D data.",

author = "Zeiler, {Matthew D.} and Taylor, {Graham W.} and Leonid Sigal and Iain Matthews and Rob Fergus",

year = "2011",

language = "English (US)",

isbn = "9781618395993",

series = "Advances in Neural Information Processing Systems 24: 25th Annual Conference on Neural Information Processing Systems 2011, NIPS 2011",

publisher = "Neural Information Processing Systems",

booktitle = "Advances in Neural Information Processing Systems 24",

note = "25th Annual Conference on Neural Information Processing Systems 2011, NIPS 2011 ; Conference date: 12-12-2011 Through 14-12-2011",

}

TY - GEN

T1 - Facial expression transfer with input-output Temporal Restricted Boltzmann Machines

AU - Zeiler, Matthew D.

AU - Taylor, Graham W.

AU - Sigal, Leonid

AU - Matthews, Iain

AU - Fergus, Rob

PY - 2011

Y1 - 2011

N2 - We present a type of Temporal Restricted Boltzmann Machine that defines a probability distribution over an output sequence conditional on an input sequence. It shares the desirable properties of RBMs: efficient exact inference, an exponentially more expressive latent state than HMMs, and the ability to model nonlinear structure and dynamics. We apply our model to a challenging real-world graphics problem: facial expression transfer. Our results demonstrate improved performance over several baselines modeling high-dimensional 2D and 3D data.

AB - We present a type of Temporal Restricted Boltzmann Machine that defines a probability distribution over an output sequence conditional on an input sequence. It shares the desirable properties of RBMs: efficient exact inference, an exponentially more expressive latent state than HMMs, and the ability to model nonlinear structure and dynamics. We apply our model to a challenging real-world graphics problem: facial expression transfer. Our results demonstrate improved performance over several baselines modeling high-dimensional 2D and 3D data.

UR - http://www.scopus.com/inward/record.url?scp=85162551426&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85162551426&partnerID=8YFLogxK

M3 - Conference contribution

AN - SCOPUS:85162551426

SN - 9781618395993

T3 - Advances in Neural Information Processing Systems 24: 25th Annual Conference on Neural Information Processing Systems 2011, NIPS 2011

BT - Advances in Neural Information Processing Systems 24

PB - Neural Information Processing Systems

T2 - 25th Annual Conference on Neural Information Processing Systems 2011, NIPS 2011

Y2 - 12 December 2011 through 14 December 2011

ER -

Facial expression transfer with input-output Temporal Restricted Boltzmann Machines

Abstract

Publication series

Other

ASJC Scopus subject areas

Other files and links

Fingerprint

Cite this