TY - JOUR
T1 - Learning about an exponential amount of conditional distributions
AU - Belghazi, Mohamed Ishmael
AU - Oquab, Maxime
AU - Lecun, Yann
AU - Lopez-Paz, David
N1 - Publisher Copyright:
© 2019 Neural information processing systems foundation. All rights reserved.
PY - 2019
Y1 - 2019
N2 - We introduce the Neural Conditioner (NC), a self-supervised machine able to learn about all the conditional distributions of a random vector X. The NC is a function NC(x · a, a, r) that leverages adversarial training to match each conditional distribution P (Xr|Xa = xa). After training, the NC generalizes to sample conditional distributions never seen, including the joint distribution. The NC is also able to auto-encode examples, providing data representations useful for downstream classification tasks. In sum, the NC integrates different self-supervised tasks (each being the estimation of a conditional distribution) and levels of supervision (partially observed data) seamlessly into a single learning experience.
AB - We introduce the Neural Conditioner (NC), a self-supervised machine able to learn about all the conditional distributions of a random vector X. The NC is a function NC(x · a, a, r) that leverages adversarial training to match each conditional distribution P (Xr|Xa = xa). After training, the NC generalizes to sample conditional distributions never seen, including the joint distribution. The NC is also able to auto-encode examples, providing data representations useful for downstream classification tasks. In sum, the NC integrates different self-supervised tasks (each being the estimation of a conditional distribution) and levels of supervision (partially observed data) seamlessly into a single learning experience.
UR - http://www.scopus.com/inward/record.url?scp=85090173210&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85090173210&partnerID=8YFLogxK
M3 - Conference article
AN - SCOPUS:85090173210
SN - 1049-5258
VL - 32
JO - Advances in Neural Information Processing Systems
JF - Advances in Neural Information Processing Systems
T2 - 33rd Annual Conference on Neural Information Processing Systems, NeurIPS 2019
Y2 - 8 December 2019 through 14 December 2019
ER -