Visual, haptic and crossmodal recognition of scenes

Fiona N. Newell, Andrew T. Woods, Marion Mernagh, Heinrich H. Bülthoff

Research output: Contribution to journalArticlepeer-review

Abstract

Real-world scene perception can often involve more than one sensory modality. Here we investigated the visual, haptic and crossmodal recognition of scenes of familiar objects. In three experiments participants first learned a scene of objects arranged in random positions on a platform. After learning, the experimenter swapped the position of two objects in the scene and the task for the participant was to identify the two swapped objects. In experiment 1, we found a cost in scene recognition performance when there was a change in sensory modality and scene orientation between learning and test. The cost in crossmodal performance was not due to the participants verbally encoding the objects (experiment 2) or by differences between serial and parallel encoding of the objects during haptic and visual learning, respectively (experiment 3). Instead, our findings suggest that differences between visual and haptic representations of space may affect the recognition of scenes of objects across these modalities.

Original languageEnglish (US)
Pages (from-to)233-242
Number of pages10
JournalExperimental Brain Research
Volume161
Issue number2
DOIs
StatePublished - Feb 2005

Keywords

  • Crossmodal recognition
  • Haptics
  • Orientation dependency
  • Scene perception
  • Vision

ASJC Scopus subject areas

  • General Neuroscience

Fingerprint

Dive into the research topics of 'Visual, haptic and crossmodal recognition of scenes'. Together they form a unique fingerprint.

Cite this