Max-margin learning with the Bayes factor

Rahul G. Krishnan, Arjun Khandelwal, Rajesh Ranganath, David Sontag

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

We propose a new way to answer probabil tic queries that span multiple datapoints. W formalize reasoning about the similarity of d ferent datapoints as the evaluation of the Bay Factor within a hierarchical deep generati model that enforces a separation between th latent variables used for representation learnin and those used for reasoning. Under this mod we derive an intuitive estimator for the Bay Factor that represents similarity as the amou of overlap in representation space shared by d ferent points. The estimator we derive relies o a query-conditional latent reasoning networ that parameterizes a distribution over the latent space of the deep generative model. The latent reasoning network is trained to amortize the posterior-predictive distribution under a hierarchical model using supervised data and a max-margin learning algorithm. We explore how the model may be used to focus the data variations captured in the latent space of the deep generative model and how this may be used to build new algorithms for few-shot learning.

Original languageEnglish (US)
Title of host publication34th Conference on Uncertainty in Artificial Intelligence 2018, UAI 2018
EditorsRicardo Silva, Amir Globerson, Amir Globerson
PublisherAssociation For Uncertainty in Artificial Intelligence (AUAI)
Pages896-905
Number of pages10
ISBN (Electronic)9781510871601
StatePublished - 2018
Event34th Conference on Uncertainty in Artificial Intelligence 2018, UAI 2018 - Monterey, United States
Duration: Aug 6 2018Aug 10 2018

Publication series

Name34th Conference on Uncertainty in Artificial Intelligence 2018, UAI 2018
Volume2

Other

Other34th Conference on Uncertainty in Artificial Intelligence 2018, UAI 2018
CountryUnited States
CityMonterey
Period8/6/188/10/18

ASJC Scopus subject areas

  • Artificial Intelligence

Fingerprint Dive into the research topics of 'Max-margin learning with the Bayes factor'. Together they form a unique fingerprint.

  • Cite this

    Krishnan, R. G., Khandelwal, A., Ranganath, R., & Sontag, D. (2018). Max-margin learning with the Bayes factor. In R. Silva, A. Globerson, & A. Globerson (Eds.), 34th Conference on Uncertainty in Artificial Intelligence 2018, UAI 2018 (pp. 896-905). (34th Conference on Uncertainty in Artificial Intelligence 2018, UAI 2018; Vol. 2). Association For Uncertainty in Artificial Intelligence (AUAI).