An efficient algorithm for learning invariances in adaptive classifiers

P. Simard; Y. Le Cun; J. Denker; B. Victorri

doi:10.1109/ICPR.1992.201861

An efficient algorithm for learning invariances in adaptive classifiers

P. Simard, Y. Le Cun, J. Denker, B. Victorri

Computer Science

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

In many machine learning applications, one has not only training data but also some high-level information about certain invariances that the system should exhibit. In character recognition, for example, the answer should be invariant with respect to small spatial distortions in the input images (translations, rotations, scale changes, etcetera). We have implemented a scheme that minimizes the derivative of the classifier outputs with respect to distortion operators of our choosing. This not only produces tremendous speed advantages, but also provides a powerful language for specifying what generalizations we wish the network to perform.

Original language	English (US)
Title of host publication	Conference B
Subtitle of host publication	Pattern Recognition Methodology and Systems
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	651-655
Number of pages	5
ISBN (Print)	0818629150
DOIs	https://doi.org/10.1109/ICPR.1992.201861
State	Published - 1992
Event	11th IAPR International Conference on Pattern Recognition, IAPR 1992 - The Hague, Netherlands Duration: Aug 30 1992 → Sep 3 1992

Publication series

Name	Proceedings - International Conference on Pattern Recognition
Volume	2
ISSN (Print)	1051-4651

Other

Other	11th IAPR International Conference on Pattern Recognition, IAPR 1992
Country/Territory	Netherlands
City	The Hague
Period	8/30/92 → 9/3/92

ASJC Scopus subject areas

Computer Vision and Pattern Recognition

Access to Document

10.1109/ICPR.1992.201861

Cite this

Simard, P., Le Cun, Y., Denker, J., & Victorri, B. (1992). An efficient algorithm for learning invariances in adaptive classifiers. In Conference B: Pattern Recognition Methodology and Systems (pp. 651-655). Article 201861 (Proceedings - International Conference on Pattern Recognition; Vol. 2). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ICPR.1992.201861

An efficient algorithm for learning invariances in adaptive classifiers. / Simard, P.; Le Cun, Y.; Denker, J. et al.
Conference B: Pattern Recognition Methodology and Systems. Institute of Electrical and Electronics Engineers Inc., 1992. p. 651-655 201861 (Proceedings - International Conference on Pattern Recognition; Vol. 2).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Simard, P, Le Cun, Y, Denker, J & Victorri, B 1992, An efficient algorithm for learning invariances in adaptive classifiers. in Conference B: Pattern Recognition Methodology and Systems., 201861, Proceedings - International Conference on Pattern Recognition, vol. 2, Institute of Electrical and Electronics Engineers Inc., pp. 651-655, 11th IAPR International Conference on Pattern Recognition, IAPR 1992, The Hague, Netherlands, 8/30/92. https://doi.org/10.1109/ICPR.1992.201861

@inproceedings{1e274f49d36247f18ac890aa3b8c94fe,

title = "An efficient algorithm for learning invariances in adaptive classifiers",

abstract = "In many machine learning applications, one has not only training data but also some high-level information about certain invariances that the system should exhibit. In character recognition, for example, the answer should be invariant with respect to small spatial distortions in the input images (translations, rotations, scale changes, etcetera). We have implemented a scheme that minimizes the derivative of the classifier outputs with respect to distortion operators of our choosing. This not only produces tremendous speed advantages, but also provides a powerful language for specifying what generalizations we wish the network to perform.",

author = "P. Simard and {Le Cun}, Y. and J. Denker and B. Victorri",

note = "Publisher Copyright: {\textcopyright} 1992 Institute of Electrical and Electronics Engineers Inc. All rights reserved.; 11th IAPR International Conference on Pattern Recognition, IAPR 1992 ; Conference date: 30-08-1992 Through 03-09-1992",

year = "1992",

doi = "10.1109/ICPR.1992.201861",

language = "English (US)",

isbn = "0818629150",

series = "Proceedings - International Conference on Pattern Recognition",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

pages = "651--655",

booktitle = "Conference B",

}

TY - GEN

T1 - An efficient algorithm for learning invariances in adaptive classifiers

AU - Simard, P.

AU - Le Cun, Y.

AU - Denker, J.

AU - Victorri, B.

PY - 1992

Y1 - 1992

N2 - In many machine learning applications, one has not only training data but also some high-level information about certain invariances that the system should exhibit. In character recognition, for example, the answer should be invariant with respect to small spatial distortions in the input images (translations, rotations, scale changes, etcetera). We have implemented a scheme that minimizes the derivative of the classifier outputs with respect to distortion operators of our choosing. This not only produces tremendous speed advantages, but also provides a powerful language for specifying what generalizations we wish the network to perform.

AB - In many machine learning applications, one has not only training data but also some high-level information about certain invariances that the system should exhibit. In character recognition, for example, the answer should be invariant with respect to small spatial distortions in the input images (translations, rotations, scale changes, etcetera). We have implemented a scheme that minimizes the derivative of the classifier outputs with respect to distortion operators of our choosing. This not only produces tremendous speed advantages, but also provides a powerful language for specifying what generalizations we wish the network to perform.

UR - http://www.scopus.com/inward/record.url?scp=77953494628&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=77953494628&partnerID=8YFLogxK

U2 - 10.1109/ICPR.1992.201861

DO - 10.1109/ICPR.1992.201861

M3 - Conference contribution

AN - SCOPUS:77953494628

SN - 0818629150

T3 - Proceedings - International Conference on Pattern Recognition

SP - 651

EP - 655

BT - Conference B

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 11th IAPR International Conference on Pattern Recognition, IAPR 1992

Y2 - 30 August 1992 through 3 September 1992

ER -

An efficient algorithm for learning invariances in adaptive classifiers

Abstract

Publication series

Other

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this