AutoViDev

A Computer-Vision Framework to Enhance and Accelerate Research in Human Development

Ori Ossmy, Rick O. Gilmore, Karen Adolph

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Interdisciplinary exchange of ideas and tools can accelerate scientific progress. For example, findings from developmental and vision science have spurred recent advances in artificial intelligence and computer vision. However, relatively little attention has been paid to how artificial intelligence and computer vision can facilitate research in developmental science. The current study presents AutoViDev—an automatic video-analysis tool that uses machine learning and computer vision to support video-based developmental research. AutoViDev identifies full body position estimations in real-time video streams using convolutional pose machine-learning algorithms. AutoViDev provides valuable information about a variety of behaviors, including gaze direction, facial expressions, posture, locomotion, manual actions, and interactions with objects. We present a high-level architecture of the framework and describe two projects that demonstrate its usability. We discuss the benefits of applying AutoViDev to large-scale, shared video datasets and highlight how machine learning and computer vision can enhance and accelerate research in developmental science.

Original languageEnglish (US)
Title of host publicationAdvances in Computer Vision - Proceedings of the 2019 Computer Vision Conference CVC
EditorsKohei Arai, Supriya Kapoor
PublisherSpringer-Verlag
Pages147-156
Number of pages10
ISBN (Print)9783030177973
DOIs
StatePublished - Jan 1 2020
EventComputer Vision Conference, CVC 2019 - Las Vegas, United States
Duration: Apr 25 2019Apr 26 2019

Publication series

NameAdvances in Intelligent Systems and Computing
Volume944
ISSN (Print)2194-5357

Conference

ConferenceComputer Vision Conference, CVC 2019
CountryUnited States
CityLas Vegas
Period4/25/194/26/19

Fingerprint

Computer vision
Learning systems
Artificial intelligence
Learning algorithms

Keywords

  • Behavioral science
  • Body recognition
  • Computer vision
  • Convolutional pose machines
  • Human development

ASJC Scopus subject areas

  • Control and Systems Engineering
  • Computer Science(all)

Cite this

Ossmy, O., Gilmore, R. O., & Adolph, K. (2020). AutoViDev: A Computer-Vision Framework to Enhance and Accelerate Research in Human Development. In K. Arai, & S. Kapoor (Eds.), Advances in Computer Vision - Proceedings of the 2019 Computer Vision Conference CVC (pp. 147-156). (Advances in Intelligent Systems and Computing; Vol. 944). Springer-Verlag. https://doi.org/10.1007/978-3-030-17798-0_14

AutoViDev : A Computer-Vision Framework to Enhance and Accelerate Research in Human Development. / Ossmy, Ori; Gilmore, Rick O.; Adolph, Karen.

Advances in Computer Vision - Proceedings of the 2019 Computer Vision Conference CVC. ed. / Kohei Arai; Supriya Kapoor. Springer-Verlag, 2020. p. 147-156 (Advances in Intelligent Systems and Computing; Vol. 944).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Ossmy, O, Gilmore, RO & Adolph, K 2020, AutoViDev: A Computer-Vision Framework to Enhance and Accelerate Research in Human Development. in K Arai & S Kapoor (eds), Advances in Computer Vision - Proceedings of the 2019 Computer Vision Conference CVC. Advances in Intelligent Systems and Computing, vol. 944, Springer-Verlag, pp. 147-156, Computer Vision Conference, CVC 2019, Las Vegas, United States, 4/25/19. https://doi.org/10.1007/978-3-030-17798-0_14
Ossmy O, Gilmore RO, Adolph K. AutoViDev: A Computer-Vision Framework to Enhance and Accelerate Research in Human Development. In Arai K, Kapoor S, editors, Advances in Computer Vision - Proceedings of the 2019 Computer Vision Conference CVC. Springer-Verlag. 2020. p. 147-156. (Advances in Intelligent Systems and Computing). https://doi.org/10.1007/978-3-030-17798-0_14
Ossmy, Ori ; Gilmore, Rick O. ; Adolph, Karen. / AutoViDev : A Computer-Vision Framework to Enhance and Accelerate Research in Human Development. Advances in Computer Vision - Proceedings of the 2019 Computer Vision Conference CVC. editor / Kohei Arai ; Supriya Kapoor. Springer-Verlag, 2020. pp. 147-156 (Advances in Intelligent Systems and Computing).
@inproceedings{4e2e474b73e74d8a9a08116785d5c881,
title = "AutoViDev: A Computer-Vision Framework to Enhance and Accelerate Research in Human Development",
abstract = "Interdisciplinary exchange of ideas and tools can accelerate scientific progress. For example, findings from developmental and vision science have spurred recent advances in artificial intelligence and computer vision. However, relatively little attention has been paid to how artificial intelligence and computer vision can facilitate research in developmental science. The current study presents AutoViDev—an automatic video-analysis tool that uses machine learning and computer vision to support video-based developmental research. AutoViDev identifies full body position estimations in real-time video streams using convolutional pose machine-learning algorithms. AutoViDev provides valuable information about a variety of behaviors, including gaze direction, facial expressions, posture, locomotion, manual actions, and interactions with objects. We present a high-level architecture of the framework and describe two projects that demonstrate its usability. We discuss the benefits of applying AutoViDev to large-scale, shared video datasets and highlight how machine learning and computer vision can enhance and accelerate research in developmental science.",
keywords = "Behavioral science, Body recognition, Computer vision, Convolutional pose machines, Human development",
author = "Ori Ossmy and Gilmore, {Rick O.} and Karen Adolph",
year = "2020",
month = "1",
day = "1",
doi = "10.1007/978-3-030-17798-0_14",
language = "English (US)",
isbn = "9783030177973",
series = "Advances in Intelligent Systems and Computing",
publisher = "Springer-Verlag",
pages = "147--156",
editor = "Kohei Arai and Supriya Kapoor",
booktitle = "Advances in Computer Vision - Proceedings of the 2019 Computer Vision Conference CVC",

}

TY - GEN

T1 - AutoViDev

T2 - A Computer-Vision Framework to Enhance and Accelerate Research in Human Development

AU - Ossmy, Ori

AU - Gilmore, Rick O.

AU - Adolph, Karen

PY - 2020/1/1

Y1 - 2020/1/1

N2 - Interdisciplinary exchange of ideas and tools can accelerate scientific progress. For example, findings from developmental and vision science have spurred recent advances in artificial intelligence and computer vision. However, relatively little attention has been paid to how artificial intelligence and computer vision can facilitate research in developmental science. The current study presents AutoViDev—an automatic video-analysis tool that uses machine learning and computer vision to support video-based developmental research. AutoViDev identifies full body position estimations in real-time video streams using convolutional pose machine-learning algorithms. AutoViDev provides valuable information about a variety of behaviors, including gaze direction, facial expressions, posture, locomotion, manual actions, and interactions with objects. We present a high-level architecture of the framework and describe two projects that demonstrate its usability. We discuss the benefits of applying AutoViDev to large-scale, shared video datasets and highlight how machine learning and computer vision can enhance and accelerate research in developmental science.

AB - Interdisciplinary exchange of ideas and tools can accelerate scientific progress. For example, findings from developmental and vision science have spurred recent advances in artificial intelligence and computer vision. However, relatively little attention has been paid to how artificial intelligence and computer vision can facilitate research in developmental science. The current study presents AutoViDev—an automatic video-analysis tool that uses machine learning and computer vision to support video-based developmental research. AutoViDev identifies full body position estimations in real-time video streams using convolutional pose machine-learning algorithms. AutoViDev provides valuable information about a variety of behaviors, including gaze direction, facial expressions, posture, locomotion, manual actions, and interactions with objects. We present a high-level architecture of the framework and describe two projects that demonstrate its usability. We discuss the benefits of applying AutoViDev to large-scale, shared video datasets and highlight how machine learning and computer vision can enhance and accelerate research in developmental science.

KW - Behavioral science

KW - Body recognition

KW - Computer vision

KW - Convolutional pose machines

KW - Human development

UR - http://www.scopus.com/inward/record.url?scp=85065468506&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85065468506&partnerID=8YFLogxK

U2 - 10.1007/978-3-030-17798-0_14

DO - 10.1007/978-3-030-17798-0_14

M3 - Conference contribution

SN - 9783030177973

T3 - Advances in Intelligent Systems and Computing

SP - 147

EP - 156

BT - Advances in Computer Vision - Proceedings of the 2019 Computer Vision Conference CVC

A2 - Arai, Kohei

A2 - Kapoor, Supriya

PB - Springer-Verlag

ER -