Probabilistic Surface Friction Estimation Based on Visual and Haptic Measurements

Tran Nguyen Le, Francesco Verdoja, Fares J. Abu-Dakka, Ville Kyrki

Research output: Contribution to journalArticlepeer-review


Accurately modeling local surface properties of objects is crucial to many robotic applications, from grasping to material recognition. Surface properties like friction are however difficult to estimate, as visual observation of the object does not convey enough information over these properties. In contrast, haptic exploration is time consuming as it only provides information relevant to the explored parts of the object. In this letter, we propose a joint visuo-haptic object model that enables the estimation of surface friction coefficient over an entire object by exploiting the correlation of visual and haptic information, together with a limited haptic exploration by a robotic arm. We demonstrate the validity of the proposed method by showing its ability to estimate varying friction coefficients on a range of real multi-material objects. Furthermore, we illustrate how the estimated friction coefficients can improve grasping success rate by guiding a grasp planner toward high friction areas.

Original languageEnglish (US)
Article number9364673
Pages (from-to)2838-2845
Number of pages8
JournalIEEE Robotics and Automation Letters
Issue number2
StatePublished - Apr 2021


  • Perception for grasping and manipulation
  • probabilistic inference
  • sensor fusion

ASJC Scopus subject areas

  • Control and Systems Engineering
  • Biomedical Engineering
  • Human-Computer Interaction
  • Mechanical Engineering
  • Computer Vision and Pattern Recognition
  • Computer Science Applications
  • Control and Optimization
  • Artificial Intelligence


Dive into the research topics of 'Probabilistic Surface Friction Estimation Based on Visual and Haptic Measurements'. Together they form a unique fingerprint.

Cite this