Abstract
From an analysis of actual cases, three categories of bias in computer systems have been developed: preexisting, technical, and emergent. Preexisting bias has its roots in social institutions, practices, and attitudes. Technical bias arises from technical constraints or considerations. Emergent bias arises in a context of use. Although others have pointed to bias in particular computer systems and have noted the general problem, we know of no comparable work that examines this phenomenon comprehensively and which offers a framework for understanding and remedying it. We conclude by suggesting that freedom from bias should be counted among the select set of criteria - including reliability, accuracy, and efficiency -according to which the quality of systems in use in society should be judged.
| Original language | English (US) |
|---|---|
| Pages (from-to) | 330-347 |
| Number of pages | 18 |
| Journal | ACM Transactions on Information Systems |
| Volume | 14 |
| Issue number | 3 |
| DOIs | |
| State | Published - Jul 1996 |
Keywords
- Bias
- Computer ethics
- Computers and society
- D.2.0 [Software]: Software Engineering
- Design
- Design methods
- Ethics
- H.1.2 [Information Systems]: User/Machine Systems
- Human Factors
- Human values
- K.4.0 [Computers and Society]: General
- Standards
ASJC Scopus subject areas
- Information Systems
- General Business, Management and Accounting
- Computer Science Applications