Attention Assessment in Children with Autism Using Head Pose and Motion Parameters from Real Videos

Elizabeth B. Varghese, Marwa Qaraqe, Dena Al Thani, Hazim Kemal Ekenel

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

In children with autism spectrum disorders (ASD), attention assessment plays a crucial role in understanding their behavioral and cognitive functioning. Difficulties with attention are a common feature of children with autism and have a significant impact on their ability to learn and socialize. In this paper, we propose a non-invasive and objective method to assess attention in children with autism from real videos by utilizing the head poses and motion parameters. The proposed approach is an ensemble of a deep learning model that extracts head pose parameters, an optical flow approach that extracts motion parameters from consecutive frames, temporal head pose parameters extraction and an autoencoder for attention assessment. The experimental study was conducted on 39 children (ASD = 19, neurotypical children = 20) by giving different attention tasks and capturing their video using an attached webcam. Results are analyzed for participant and task differences, which demonstrate that our approach is successful in measuring a child's attention control and inattention. In particular, the assessment of the head poses and motion parameters will enable the development of real-time attention recognition systems that can be used for both learning and targeted intervention.

Original languageEnglish (US)
Title of host publicationGLOBECOM 2023 - 2023 IEEE Global Communications Conference
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages6462-6468
Number of pages7
ISBN (Electronic)9798350310900
DOIs
StatePublished - 2023
Event2023 IEEE Global Communications Conference, GLOBECOM 2023 - Kuala Lumpur, Malaysia
Duration: Dec 4 2023Dec 8 2023

Publication series

NameProceedings - IEEE Global Communications Conference, GLOBECOM
ISSN (Print)2334-0983
ISSN (Electronic)2576-6813

Conference

Conference2023 IEEE Global Communications Conference, GLOBECOM 2023
Country/TerritoryMalaysia
CityKuala Lumpur
Period12/4/2312/8/23

Keywords

  • Attention Assessment
  • Autism spectrum disorder (ASD)
  • Deep Learning
  • Head Pose Estimation
  • Optical Flow

ASJC Scopus subject areas

  • Artificial Intelligence
  • Computer Networks and Communications
  • Hardware and Architecture
  • Signal Processing

Fingerprint

Dive into the research topics of 'Attention Assessment in Children with Autism Using Head Pose and Motion Parameters from Real Videos'. Together they form a unique fingerprint.

Cite this