A Demonstration of Human-Robot Communication Based on Multiskilled Language-Image Analysis

Ziming Liu; Parker N. Collier; Charles Wang; Eun Jin Paek; Si On Yoon; Devin Casenhiser; Xiaopeng Zhao

doi:10.1109/CHASE52844.2021.00028

A Demonstration of Human-Robot Communication Based on Multiskilled Language-Image Analysis

Ziming Liu, Parker N. Collier, Charles Wang, Eun Jin Paek, Si On Yoon, Devin Casenhiser, Xiaopeng Zhao

Communicative Sciences and Disorders

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

Successful human-robot communication relies on strong machine-learning capabilities of natural language processing with contextual constraints. This paper developed and tested a communication platform using a social robot to investigate the applications of multiskilled language-image analysis. Three users tested the system to successfully complete a protocol based on referential communication tasks. The system may have broad applications in various scenarios involving human robot interaction.

Original language	English (US)
Title of host publication	Proceedings - 2021 IEEE/ACM Conference on Connected Health
Subtitle of host publication	Applications, Systems and Engineering Technologies, CHASE 2021
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	126-127
Number of pages	2
ISBN (Electronic)	9781665439657
DOIs	https://doi.org/10.1109/CHASE52844.2021.00028
State	Published - 2021
Event	6th IEEE/ACM International Conference on Connected Health: Applications, Systems and Engineering Technologies, CHASE 2021 - Washington, United States Duration: Dec 16 2021 → Dec 18 2021

Publication series

Name	Proceedings - 2021 IEEE/ACM Conference on Connected Health: Applications, Systems and Engineering Technologies, CHASE 2021

Conference

Conference	6th IEEE/ACM International Conference on Connected Health: Applications, Systems and Engineering Technologies, CHASE 2021
Country/Territory	United States
City	Washington
Period	12/16/21 → 12/18/21

Keywords

Human robot Interaction
Multiskilled AI

ASJC Scopus subject areas

Artificial Intelligence
Computer Science Applications
Information Systems and Management
Medicine (miscellaneous)
Health Informatics
Health(social science)

Access to Document

10.1109/CHASE52844.2021.00028

Cite this

Liu, Z., Collier, P. N., Wang, C., Paek, E. J., Yoon, S. O., Casenhiser, D., & Zhao, X. (2021). A Demonstration of Human-Robot Communication Based on Multiskilled Language-Image Analysis. In Proceedings - 2021 IEEE/ACM Conference on Connected Health: Applications, Systems and Engineering Technologies, CHASE 2021 (pp. 126-127). (Proceedings - 2021 IEEE/ACM Conference on Connected Health: Applications, Systems and Engineering Technologies, CHASE 2021). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/CHASE52844.2021.00028

A Demonstration of Human-Robot Communication Based on Multiskilled Language-Image Analysis. / Liu, Ziming; Collier, Parker N.; Wang, Charles et al.
Proceedings - 2021 IEEE/ACM Conference on Connected Health: Applications, Systems and Engineering Technologies, CHASE 2021. Institute of Electrical and Electronics Engineers Inc., 2021. p. 126-127 (Proceedings - 2021 IEEE/ACM Conference on Connected Health: Applications, Systems and Engineering Technologies, CHASE 2021).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Liu, Z, Collier, PN, Wang, C, Paek, EJ, Yoon, SO, Casenhiser, D & Zhao, X 2021, A Demonstration of Human-Robot Communication Based on Multiskilled Language-Image Analysis. in Proceedings - 2021 IEEE/ACM Conference on Connected Health: Applications, Systems and Engineering Technologies, CHASE 2021. Proceedings - 2021 IEEE/ACM Conference on Connected Health: Applications, Systems and Engineering Technologies, CHASE 2021, Institute of Electrical and Electronics Engineers Inc., pp. 126-127, 6th IEEE/ACM International Conference on Connected Health: Applications, Systems and Engineering Technologies, CHASE 2021, Washington, United States, 12/16/21. https://doi.org/10.1109/CHASE52844.2021.00028

Liu Z, Collier PN, Wang C, Paek EJ, Yoon SO, Casenhiser D et al. A Demonstration of Human-Robot Communication Based on Multiskilled Language-Image Analysis. In Proceedings - 2021 IEEE/ACM Conference on Connected Health: Applications, Systems and Engineering Technologies, CHASE 2021. Institute of Electrical and Electronics Engineers Inc. 2021. p. 126-127. (Proceedings - 2021 IEEE/ACM Conference on Connected Health: Applications, Systems and Engineering Technologies, CHASE 2021). doi: 10.1109/CHASE52844.2021.00028

Liu, Ziming ; Collier, Parker N. ; Wang, Charles et al. / A Demonstration of Human-Robot Communication Based on Multiskilled Language-Image Analysis. Proceedings - 2021 IEEE/ACM Conference on Connected Health: Applications, Systems and Engineering Technologies, CHASE 2021. Institute of Electrical and Electronics Engineers Inc., 2021. pp. 126-127 (Proceedings - 2021 IEEE/ACM Conference on Connected Health: Applications, Systems and Engineering Technologies, CHASE 2021).

@inproceedings{3c33ed42250747558d09ba148d5c1ebe,

title = "A Demonstration of Human-Robot Communication Based on Multiskilled Language-Image Analysis",

abstract = "Successful human-robot communication relies on strong machine-learning capabilities of natural language processing with contextual constraints. This paper developed and tested a communication platform using a social robot to investigate the applications of multiskilled language-image analysis. Three users tested the system to successfully complete a protocol based on referential communication tasks. The system may have broad applications in various scenarios involving human robot interaction.",

keywords = "Human robot Interaction, Multiskilled AI",

author = "Ziming Liu and Collier, {Parker N.} and Charles Wang and Paek, {Eun Jin} and Yoon, {Si On} and Devin Casenhiser and Xiaopeng Zhao",

note = "Publisher Copyright: {\textcopyright} 2021 IEEE.; 6th IEEE/ACM International Conference on Connected Health: Applications, Systems and Engineering Technologies, CHASE 2021 ; Conference date: 16-12-2021 Through 18-12-2021",

year = "2021",

doi = "10.1109/CHASE52844.2021.00028",

language = "English (US)",

series = "Proceedings - 2021 IEEE/ACM Conference on Connected Health: Applications, Systems and Engineering Technologies, CHASE 2021",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

pages = "126--127",

booktitle = "Proceedings - 2021 IEEE/ACM Conference on Connected Health",

}

TY - GEN

T1 - A Demonstration of Human-Robot Communication Based on Multiskilled Language-Image Analysis

AU - Liu, Ziming

AU - Collier, Parker N.

AU - Wang, Charles

AU - Paek, Eun Jin

AU - Yoon, Si On

AU - Casenhiser, Devin

AU - Zhao, Xiaopeng

PY - 2021

Y1 - 2021

N2 - Successful human-robot communication relies on strong machine-learning capabilities of natural language processing with contextual constraints. This paper developed and tested a communication platform using a social robot to investigate the applications of multiskilled language-image analysis. Three users tested the system to successfully complete a protocol based on referential communication tasks. The system may have broad applications in various scenarios involving human robot interaction.

AB - Successful human-robot communication relies on strong machine-learning capabilities of natural language processing with contextual constraints. This paper developed and tested a communication platform using a social robot to investigate the applications of multiskilled language-image analysis. Three users tested the system to successfully complete a protocol based on referential communication tasks. The system may have broad applications in various scenarios involving human robot interaction.

KW - Human robot Interaction

KW - Multiskilled AI

UR - http://www.scopus.com/inward/record.url?scp=85126475314&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85126475314&partnerID=8YFLogxK

U2 - 10.1109/CHASE52844.2021.00028

DO - 10.1109/CHASE52844.2021.00028

M3 - Conference contribution

AN - SCOPUS:85126475314

T3 - Proceedings - 2021 IEEE/ACM Conference on Connected Health: Applications, Systems and Engineering Technologies, CHASE 2021

SP - 126

EP - 127

BT - Proceedings - 2021 IEEE/ACM Conference on Connected Health

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 6th IEEE/ACM International Conference on Connected Health: Applications, Systems and Engineering Technologies, CHASE 2021

Y2 - 16 December 2021 through 18 December 2021

ER -

A Demonstration of Human-Robot Communication Based on Multiskilled Language-Image Analysis

Abstract

Publication series

Conference

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this