TY - JOUR
T1 - Causal inference during closed-loop navigation
T2 - Parsing of self- and object-motion
AU - Noel, Jean Paul
AU - Bill, Johannes
AU - Ding, Haoran
AU - Vastola, John
AU - Deangelis, Gregory C.
AU - Angelaki, Dora E.
AU - Drugowitsch, Jan
N1 - Publisher Copyright:
© 2023 The Author(s).
PY - 2023/9/25
Y1 - 2023/9/25
N2 - A key computation in building adaptive internal models of the external world is to ascribe sensory signals to their likely cause(s), a process of causal inference (CI). CI is well studied within the framework of two-alternative forced-choice tasks, but less well understood within the cadre of naturalistic action-perception loops. Here, we examine the process of disambiguating retinal motion caused by self- and/or object-motion during closed-loop navigation. First, we derive a normative account specifying how observers ought to intercept hidden and moving targets given their belief about (i) whether retinal motion was caused by the target moving, and (ii) if so, with what velocity. Next, in line with the modelling results, we show that humans report targets as stationary and steer towards their initial rather than final position more often when they are themselves moving, suggesting a putative misattribution of object-motion to the self. Further, we predict that observers should misattribute retinal motion more often: (i) during passive rather than active self-motion (given the lack of an efference copy informing self-motion estimates in the former), and (ii) when targets are presented eccentrically rather than centrally (given that lateral self-motion flow vectors are larger at eccentric locations during forward self-motion). Results support both of these predictions. Lastly, analysis of eye movements show that, while initial saccades toward targets were largely accurate regardless of the self-motion condition, subsequent gaze pursuit was modulated by target velocity during object-only motion, but not during concurrent object- and self-motion. These results demonstrate CI within action-perception loops, and suggest a protracted temporal unfolding of the computations characterizing CI. This article is part of the theme issue 'Decision and control processes in multisensory perception'.
AB - A key computation in building adaptive internal models of the external world is to ascribe sensory signals to their likely cause(s), a process of causal inference (CI). CI is well studied within the framework of two-alternative forced-choice tasks, but less well understood within the cadre of naturalistic action-perception loops. Here, we examine the process of disambiguating retinal motion caused by self- and/or object-motion during closed-loop navigation. First, we derive a normative account specifying how observers ought to intercept hidden and moving targets given their belief about (i) whether retinal motion was caused by the target moving, and (ii) if so, with what velocity. Next, in line with the modelling results, we show that humans report targets as stationary and steer towards their initial rather than final position more often when they are themselves moving, suggesting a putative misattribution of object-motion to the self. Further, we predict that observers should misattribute retinal motion more often: (i) during passive rather than active self-motion (given the lack of an efference copy informing self-motion estimates in the former), and (ii) when targets are presented eccentrically rather than centrally (given that lateral self-motion flow vectors are larger at eccentric locations during forward self-motion). Results support both of these predictions. Lastly, analysis of eye movements show that, while initial saccades toward targets were largely accurate regardless of the self-motion condition, subsequent gaze pursuit was modulated by target velocity during object-only motion, but not during concurrent object- and self-motion. These results demonstrate CI within action-perception loops, and suggest a protracted temporal unfolding of the computations characterizing CI. This article is part of the theme issue 'Decision and control processes in multisensory perception'.
KW - active sensing
KW - eye movements
KW - naturalistic
KW - saccades
KW - self-motion
UR - http://www.scopus.com/inward/record.url?scp=85166755220&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85166755220&partnerID=8YFLogxK
U2 - 10.1098/rstb.2022.0344
DO - 10.1098/rstb.2022.0344
M3 - Article
C2 - 37545300
AN - SCOPUS:85166755220
SN - 0962-8436
VL - 378
JO - Philosophical Transactions of the Royal Society B: Biological Sciences
JF - Philosophical Transactions of the Royal Society B: Biological Sciences
IS - 1886
M1 - 20220344
ER -