A Mobile Food Recognition System for Dietary Assessment

Şeymanur Aktı, Marwa Qaraqe, Hazım Kemal Ekenel

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Food recognition is an important task for a variety of applications, including managing health conditions and assisting visually impaired people. Several food recognition studies have focused on generic types of food or specific cuisines, however, food recognition with respect to Middle Eastern cuisines has remained unexplored. Therefore, in this paper we focus on developing a mobile friendly, Middle Eastern cuisine focused food recognition application for assisted living purposes. In order to enable a low-latency, high-accuracy food classification system, we opted to utilize the Mobilenet-v2 deep learning model. As some of the foods are more popular than the others, the number of samples per class in the used Middle Eastern food dataset is relatively imbalanced. To compensate for this problem, data augmentation methods are applied on the underrepresented classes. Experimental results show that using Mobilenet-v2 architecture for this task is beneficial in terms of both accuracy and the memory usage. With the model achieving 94% accuracy on 23 food classes, the developed mobile application has potential to serve the visually impaired in automatic food recognition via images.

Original languageEnglish (US)
Title of host publicationImage Analysis and Processing. ICIAP 2022 Workshops - ICIAP International Workshops, Revised Selected Papers
EditorsPier Luigi Mazzeo, Cosimo Distante, Emanuele Frontoni, Stan Sclaroff
PublisherSpringer Science and Business Media Deutschland GmbH
Pages71-81
Number of pages11
ISBN (Print)9783031133206
DOIs
StatePublished - 2022
Event21st International Conference on Image Analysis and Processing , ICIAP 2022 - Lecce, Italy
Duration: May 23 2022May 27 2022

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume13373 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference21st International Conference on Image Analysis and Processing , ICIAP 2022
Country/TerritoryItaly
CityLecce
Period5/23/225/27/22

Keywords

  • Assistive technology
  • Computer vision
  • Food recognition

ASJC Scopus subject areas

  • Theoretical Computer Science
  • General Computer Science

Fingerprint

Dive into the research topics of 'A Mobile Food Recognition System for Dietary Assessment'. Together they form a unique fingerprint.

Cite this