Explaining Semi-Supervised Text Alignment Through Visualization

Christofer Meinecke, David Joseph Wrisley, Stefan Janicke

Research output: Contribution to journalArticlepeer-review

Abstract

The analysis of variance in complex text traditions is an arduous task when carried out manually. Text alignment algorithms provide domain experts with a robust alternative to such repetitive tasks. Existing white-box approaches allow the digital humanities to establish syntax-based metrics taking into account the spelling, morphology and order of words. However, they produce limited results, as semantic meanings are typically not taken into account. Our interdisciplinary collaboration between visualization and digital humanities combined a semi-supervised text alignment approach based on word embeddings that take not only syntactic but also semantic text features into account, thereby improving the overall quality of the alignment. In our collaboration, we developed different visual interfaces that communicate the word distribution in high-dimensional vector space generated by the underlying neural network for increased transparency, assessment of the tool's reliability and overall improved hypothesis generation. We further offer visual means to enable the expert reader to feed domain knowledge into the system at multiple levels with the aim of improving both the product and the process of text alignment. This ultimately illustrates how visualization can engage with and augment complex modes of reading in the humanities.

Original languageEnglish (US)
Pages (from-to)4797-4809
Number of pages13
JournalIEEE Transactions on Visualization and Computer Graphics
Volume28
Issue number12
DOIs
StatePublished - Dec 1 2022

Keywords

  • Text alignment
  • human-in-the-loop
  • professional reading
  • visualization in the humanities
  • word embeddings

ASJC Scopus subject areas

  • Software
  • Signal Processing
  • Computer Vision and Pattern Recognition
  • Computer Graphics and Computer-Aided Design

Fingerprint

Dive into the research topics of 'Explaining Semi-Supervised Text Alignment Through Visualization'. Together they form a unique fingerprint.

Cite this