Automatic evaluation of metadata quality in digital repositories

Xavier Ochoa, Erik Duval

Research output: Contribution to journalArticlepeer-review

Abstract

Owing to the recent developments in automatic metadata generation and interoperability between digital repositories, the production of metadata is now vastly surpassing manual quality control capabilities. Abandoning quality control altogether is problematic, because low-quality metadata compromise the effectiveness of services that repositories provide to their users. To address this problem, we present a set of scalable quality metrics for metadata based on the Bruce & Hillman framework for metadata quality control. We perform three experiments to evaluate our metrics: (1) the degree of correlation between the metrics and manual quality reviews, (2) the discriminatory power between metadata sets and (3) the usefulness of the metrics as low-quality filters. Through statistical analysis, we found that several metrics, especially Text Information Content, correlate well with human evaluation and that the average of all the metrics are roughly as effective as people to flag low-quality instances. The implications of this finding are discussed. Finally, we propose possible applications of the metrics to improve tools for the administration of digital repositories.

Original languageEnglish (US)
Pages (from-to)67-91
Number of pages25
JournalInternational Journal on Digital Libraries
Volume10
Issue number2
DOIs
StatePublished - Dec 2009

Keywords

  • Digital libraries
  • Learning object repositories
  • Metadata quality
  • Metrics
  • Text information content

ASJC Scopus subject areas

  • Library and Information Sciences

Fingerprint Dive into the research topics of 'Automatic evaluation of metadata quality in digital repositories'. Together they form a unique fingerprint.

Cite this