Counterfactual explanations for data-driven decisions

Carlos Fernandez, Foster Provost, Xintian Han

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Users' lack of understanding of systems that use predictive models to make automated decisions is one of the main barriers for their adoption. We adopt the increasingly accepted view of a counterfactual explanation for a system decision: a set of the system inputs that is causal (meaning that removing them changes the decision) and irreducible (meaning that removing any subset of the inputs in the explanation does not change the decision). We generalize previous work on counterfactual explanations in three ways: we explain system decisions rather than model predictions; we do not enforce any specific method for removing inputs, and our explanations can incorporate inputs with arbitrary data structures. We also show how model-agnostic algorithms can be tweaked to find the most useful explanations depending on the context. Finally, we showcase our approach using a real data set to illustrate its advantages over other explanation methods when the goal is to understand system decisions better.

Original languageEnglish (US)
Title of host publication40th International Conference on Information Systems, ICIS 2019
PublisherAssociation for Information Systems
ISBN (Electronic)9780996683197
StatePublished - 2020
Event40th International Conference on Information Systems, ICIS 2019 - Munich, Germany
Duration: Dec 15 2019Dec 18 2019

Publication series

Name40th International Conference on Information Systems, ICIS 2019

Conference

Conference40th International Conference on Information Systems, ICIS 2019
CountryGermany
CityMunich
Period12/15/1912/18/19

Keywords

  • Explanations
  • Predictive models
  • System decisions

ASJC Scopus subject areas

  • Computer Science Applications
  • Information Systems

Fingerprint Dive into the research topics of 'Counterfactual explanations for data-driven decisions'. Together they form a unique fingerprint.

Cite this