A formal proof of PAC learnability for decision stumps

Joseph Tassarotti, Koundinya Vajjha, Anindya Banerjee, Jean Baptiste Tristan

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

We present a formal proof in Lean of probably approximately correct (PAC) learnability of the concept class of decision stumps. This classic result in machine learning theory derives a bound on error probabilities for a simple type of classifier. Though such a proof appears simple on paper, analytic and measure-theoretic subtleties arise when carrying it out fully formally. Our proof is structured so as to separate reasoning about deterministic properties of a learning function from proofs of measurability and analysis of probabilities.

Original languageEnglish (US)
Title of host publicationCPP 2021 - Proceedings of the 10th ACM SIGPLAN International Conference on Certified Programs and Proofs, co-located with POPL 2021
EditorsCatalin Hritcu, Andrei Popescu
PublisherAssociation for Computing Machinery, Inc
Pages5-17
Number of pages13
ISBN (Electronic)9781450382991
DOIs
StatePublished - Jan 17 2021
Event10th ACM SIGPLAN International Conference on Certified Programs and Proofs, CPP 2021, co-located with POPL 2021 - Virtual, Online, Denmark
Duration: Jan 17 2021Jan 19 2021

Publication series

NameCPP 2021 - Proceedings of the 10th ACM SIGPLAN International Conference on Certified Programs and Proofs, co-located with POPL 2021

Conference

Conference10th ACM SIGPLAN International Conference on Certified Programs and Proofs, CPP 2021, co-located with POPL 2021
Country/TerritoryDenmark
CityVirtual, Online
Period1/17/211/19/21

Keywords

  • decision stumps
  • interactive theorem proving
  • probably approximately correct

ASJC Scopus subject areas

  • Artificial Intelligence
  • Computational Theory and Mathematics
  • Hardware and Architecture
  • Software
  • Information Systems and Management
  • Safety, Risk, Reliability and Quality
  • Logic
  • Education

Fingerprint

Dive into the research topics of 'A formal proof of PAC learnability for decision stumps'. Together they form a unique fingerprint.

Cite this