Establishing Trustworthiness Through Algorithmic Approaches to Qualitative Research

Ha Nguyen; June Ahn; Ashley Belgrave; Jiwon Lee; Lora Cawelti; Ha Eun Kim; Yenda Prado; Rossella Santagata; Adriana Villavicencio

doi:10.1007/978-3-030-67788-6_4

Establishing Trustworthiness Through Algorithmic Approaches to Qualitative Research

Ha Nguyen, June Ahn, Ashley Belgrave, Jiwon Lee, Lora Cawelti, Ha Eun Kim, Yenda Prado, Rossella Santagata, Adriana Villavicencio

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

Establishing trustworthiness is a fundamental component of qualitative research. In the following paper, we document how combining natural language processing (NLP), with human analysis by researchers, can help analysts develop insights from qualitative data and establish trustworthiness for the analysis process. We document the affordances of such an approach to strengthen three specific aspects of trustworthiness in qualitative research: credibility, dependability, and confirmability. We illustrate this workflow and shed light on its implications for trustworthiness from our own, recent research study of educators’ experiences with the 2020 COVID-19 pandemic; a context that compelled our research team to analyze our data efficiently to best aid the community, but also establish rigor and trustworthiness of our process.

Original language	English (US)
Title of host publication	Advances in Quantitative Ethnography - Second International Conference, ICQE 2020, Proceedings
Editors	Andrew R. Ruis, Seung B. Lee
Publisher	Springer Science and Business Media Deutschland GmbH
Pages	47-61
Number of pages	15
ISBN (Print)	9783030677879
DOIs	https://doi.org/10.1007/978-3-030-67788-6_4
State	Published - 2021
Event	2nd International Conference on Quantitative Ethnography, ICQE 2020 - Malibu, United States Duration: Feb 1 2021 → Feb 3 2021

Publication series

Name	Communications in Computer and Information Science
Volume	1312
ISSN (Print)	1865-0929
ISSN (Electronic)	1865-0937

Conference

Conference	2nd International Conference on Quantitative Ethnography, ICQE 2020
Country/Territory	United States
City	Malibu
Period	2/1/21 → 2/3/21

Keywords

Natural language processing
Qualitative research
Trustworthiness

ASJC Scopus subject areas

General Computer Science
General Mathematics

Access to Document

10.1007/978-3-030-67788-6_4

Cite this

Nguyen, H., Ahn, J., Belgrave, A., Lee, J., Cawelti, L., Kim, H. E., Prado, Y., Santagata, R., & Villavicencio, A. (2021). Establishing Trustworthiness Through Algorithmic Approaches to Qualitative Research. In A. R. Ruis, & S. B. Lee (Eds.), Advances in Quantitative Ethnography - Second International Conference, ICQE 2020, Proceedings (pp. 47-61). (Communications in Computer and Information Science; Vol. 1312). Springer Science and Business Media Deutschland GmbH. https://doi.org/10.1007/978-3-030-67788-6_4

Establishing Trustworthiness Through Algorithmic Approaches to Qualitative Research. / Nguyen, Ha; Ahn, June; Belgrave, Ashley et al.
Advances in Quantitative Ethnography - Second International Conference, ICQE 2020, Proceedings. ed. / Andrew R. Ruis; Seung B. Lee. Springer Science and Business Media Deutschland GmbH, 2021. p. 47-61 (Communications in Computer and Information Science; Vol. 1312).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Nguyen, H, Ahn, J, Belgrave, A, Lee, J, Cawelti, L, Kim, HE, Prado, Y, Santagata, R & Villavicencio, A 2021, Establishing Trustworthiness Through Algorithmic Approaches to Qualitative Research. in AR Ruis & SB Lee (eds), Advances in Quantitative Ethnography - Second International Conference, ICQE 2020, Proceedings. Communications in Computer and Information Science, vol. 1312, Springer Science and Business Media Deutschland GmbH, pp. 47-61, 2nd International Conference on Quantitative Ethnography, ICQE 2020, Malibu, United States, 2/1/21. https://doi.org/10.1007/978-3-030-67788-6_4

Nguyen H, Ahn J, Belgrave A, Lee J, Cawelti L, Kim HE et al. Establishing Trustworthiness Through Algorithmic Approaches to Qualitative Research. In Ruis AR, Lee SB, editors, Advances in Quantitative Ethnography - Second International Conference, ICQE 2020, Proceedings. Springer Science and Business Media Deutschland GmbH. 2021. p. 47-61. (Communications in Computer and Information Science). doi: 10.1007/978-3-030-67788-6_4

Nguyen, Ha ; Ahn, June ; Belgrave, Ashley et al. / Establishing Trustworthiness Through Algorithmic Approaches to Qualitative Research. Advances in Quantitative Ethnography - Second International Conference, ICQE 2020, Proceedings. editor / Andrew R. Ruis ; Seung B. Lee. Springer Science and Business Media Deutschland GmbH, 2021. pp. 47-61 (Communications in Computer and Information Science).

@inproceedings{526facf84e3c4bea8cb20538b395533b,

title = "Establishing Trustworthiness Through Algorithmic Approaches to Qualitative Research",

abstract = "Establishing trustworthiness is a fundamental component of qualitative research. In the following paper, we document how combining natural language processing (NLP), with human analysis by researchers, can help analysts develop insights from qualitative data and establish trustworthiness for the analysis process. We document the affordances of such an approach to strengthen three specific aspects of trustworthiness in qualitative research: credibility, dependability, and confirmability. We illustrate this workflow and shed light on its implications for trustworthiness from our own, recent research study of educators{\textquoteright} experiences with the 2020 COVID-19 pandemic; a context that compelled our research team to analyze our data efficiently to best aid the community, but also establish rigor and trustworthiness of our process.",

keywords = "Natural language processing, Qualitative research, Trustworthiness",

author = "Ha Nguyen and June Ahn and Ashley Belgrave and Jiwon Lee and Lora Cawelti and Kim, {Ha Eun} and Yenda Prado and Rossella Santagata and Adriana Villavicencio",

note = "Publisher Copyright: {\textcopyright} 2021, Springer Nature Switzerland AG.; 2nd International Conference on Quantitative Ethnography, ICQE 2020 ; Conference date: 01-02-2021 Through 03-02-2021",

year = "2021",

doi = "10.1007/978-3-030-67788-6_4",

language = "English (US)",

isbn = "9783030677879",

series = "Communications in Computer and Information Science",

publisher = "Springer Science and Business Media Deutschland GmbH",

pages = "47--61",

editor = "Ruis, {Andrew R.} and Lee, {Seung B.}",

booktitle = "Advances in Quantitative Ethnography - Second International Conference, ICQE 2020, Proceedings",

address = "Germany",

}

TY - GEN

T1 - Establishing Trustworthiness Through Algorithmic Approaches to Qualitative Research

AU - Nguyen, Ha

AU - Ahn, June

AU - Belgrave, Ashley

AU - Lee, Jiwon

AU - Cawelti, Lora

AU - Kim, Ha Eun

AU - Prado, Yenda

AU - Santagata, Rossella

AU - Villavicencio, Adriana

PY - 2021

Y1 - 2021

N2 - Establishing trustworthiness is a fundamental component of qualitative research. In the following paper, we document how combining natural language processing (NLP), with human analysis by researchers, can help analysts develop insights from qualitative data and establish trustworthiness for the analysis process. We document the affordances of such an approach to strengthen three specific aspects of trustworthiness in qualitative research: credibility, dependability, and confirmability. We illustrate this workflow and shed light on its implications for trustworthiness from our own, recent research study of educators’ experiences with the 2020 COVID-19 pandemic; a context that compelled our research team to analyze our data efficiently to best aid the community, but also establish rigor and trustworthiness of our process.

AB - Establishing trustworthiness is a fundamental component of qualitative research. In the following paper, we document how combining natural language processing (NLP), with human analysis by researchers, can help analysts develop insights from qualitative data and establish trustworthiness for the analysis process. We document the affordances of such an approach to strengthen three specific aspects of trustworthiness in qualitative research: credibility, dependability, and confirmability. We illustrate this workflow and shed light on its implications for trustworthiness from our own, recent research study of educators’ experiences with the 2020 COVID-19 pandemic; a context that compelled our research team to analyze our data efficiently to best aid the community, but also establish rigor and trustworthiness of our process.

KW - Natural language processing

KW - Qualitative research

KW - Trustworthiness

UR - http://www.scopus.com/inward/record.url?scp=85101309997&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85101309997&partnerID=8YFLogxK

U2 - 10.1007/978-3-030-67788-6_4

DO - 10.1007/978-3-030-67788-6_4

M3 - Conference contribution

AN - SCOPUS:85101309997

SN - 9783030677879

T3 - Communications in Computer and Information Science

SP - 47

EP - 61

BT - Advances in Quantitative Ethnography - Second International Conference, ICQE 2020, Proceedings

A2 - Ruis, Andrew R.

A2 - Lee, Seung B.

PB - Springer Science and Business Media Deutschland GmbH

T2 - 2nd International Conference on Quantitative Ethnography, ICQE 2020

Y2 - 1 February 2021 through 3 February 2021

ER -

Establishing Trustworthiness Through Algorithmic Approaches to Qualitative Research

Abstract

Publication series

Conference

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this