Contra: Contrarian statistics for controlled variable selection

Mukund Sudarshan, Aahlad Puli, Lakshmi Subramanian, Sriram Sankararaman, Rajesh Ranganath

Research output: Contribution to journalConference articlepeer-review


The holdout randomization test (hrt) discovers a set of covariates most predictive of a response. Given the covariate distribution, hrts can explicitly control the false discovery rate (fdr). However, if this distribution is unknown and must be estimated from data, hrts can inflate the fdr. To alleviate the inflation of fdr, we propose the contrarian randomization test (contra), which is designed explicitly for scenarios where the covariate distribution must be estimated from data and may even be misspecified. Our key insight is to use an equal mixture of two “contrarian” probabilistic models in determining the importance of a covariate. One model is fit with the real data, while the other is fit using the same data, but with the covariate being tested replaced with samples from an estimate of the covariate distribution. Contra is flexible enough to achieve a power of 1 asymptotically, can reduce the fdr compared to state-of-the-art cvs methods when the covariate distribution is misspecified, and is computationally efficient in high dimensions and large sample sizes. We further demonstrate the effectiveness of contra on numerous synthetic benchmarks, and highlight its capabilities on a genetic dataset.

Original languageEnglish (US)
Pages (from-to)1900-1908
Number of pages9
JournalProceedings of Machine Learning Research
StatePublished - 2021
Event24th International Conference on Artificial Intelligence and Statistics, AISTATS 2021 - Virtual, Online, United States
Duration: Apr 13 2021Apr 15 2021

ASJC Scopus subject areas

  • Artificial Intelligence
  • Software
  • Control and Systems Engineering
  • Statistics and Probability


Dive into the research topics of 'Contra: Contrarian statistics for controlled variable selection'. Together they form a unique fingerprint.

Cite this