Robust deep-learning based refrigerator food recognition

Automatic food identification utilizing artificial intelligence (AI) technology in smart refrigerators presents an innovative solution. However, existing studies exhibit significant limitations. Achieving consistent high performance in recognition across varying camera distances and diverse real-wor...

Full description

Saved in:
Bibliographic Details
Main Author: Xiaoyan Dai
Format: Article
Language:English
Published: Frontiers Media S.A. 2024-12-01
Series:Frontiers in Artificial Intelligence
Subjects:
Online Access:https://www.frontiersin.org/articles/10.3389/frai.2024.1442948/full
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1846141499363819520
author Xiaoyan Dai
author_facet Xiaoyan Dai
author_sort Xiaoyan Dai
collection DOAJ
description Automatic food identification utilizing artificial intelligence (AI) technology in smart refrigerators presents an innovative solution. However, existing studies exhibit significant limitations. Achieving consistent high performance in recognition across varying camera distances and diverse real-world conditions remain a formidable challenge. Current approaches often struggle to accurately recognize items in scenarios involving occlusions, variable distortions, and complex backgrounds, thereby limiting their practical applicability in household environments. This study addresses these deficiencies by enhancing the Feature Pyramid Network (FPN) of YOLACT with an additional layer designed to capture nuanced information. Furthermore, we propose a two-stage data augmentation method that simulates diverse conditions including distortion and occlusion, to generate images that reflect various backgrounds and handheld scenarios. Comparative analyses with previous research and evaluations on our original dataset demonstrate that our approach significantly improves recognition rates for both typical and challenging real-world images. These enhancements contribute to more effective food waste management in households and indicate broader applications for automatic identification systems.
format Article
id doaj-art-1e718c4f970f4b2a99a4e1a0a04ff72f
institution Kabale University
issn 2624-8212
language English
publishDate 2024-12-01
publisher Frontiers Media S.A.
record_format Article
series Frontiers in Artificial Intelligence
spelling doaj-art-1e718c4f970f4b2a99a4e1a0a04ff72f2024-12-04T06:46:20ZengFrontiers Media S.A.Frontiers in Artificial Intelligence2624-82122024-12-01710.3389/frai.2024.14429481442948Robust deep-learning based refrigerator food recognitionXiaoyan DaiAutomatic food identification utilizing artificial intelligence (AI) technology in smart refrigerators presents an innovative solution. However, existing studies exhibit significant limitations. Achieving consistent high performance in recognition across varying camera distances and diverse real-world conditions remain a formidable challenge. Current approaches often struggle to accurately recognize items in scenarios involving occlusions, variable distortions, and complex backgrounds, thereby limiting their practical applicability in household environments. This study addresses these deficiencies by enhancing the Feature Pyramid Network (FPN) of YOLACT with an additional layer designed to capture nuanced information. Furthermore, we propose a two-stage data augmentation method that simulates diverse conditions including distortion and occlusion, to generate images that reflect various backgrounds and handheld scenarios. Comparative analyses with previous research and evaluations on our original dataset demonstrate that our approach significantly improves recognition rates for both typical and challenging real-world images. These enhancements contribute to more effective food waste management in households and indicate broader applications for automatic identification systems.https://www.frontiersin.org/articles/10.3389/frai.2024.1442948/fullfood recognitiondeep learningdata augmentationfeature pyramid networkinternet of Thingsfood management
spellingShingle Xiaoyan Dai
Robust deep-learning based refrigerator food recognition
Frontiers in Artificial Intelligence
food recognition
deep learning
data augmentation
feature pyramid network
internet of Things
food management
title Robust deep-learning based refrigerator food recognition
title_full Robust deep-learning based refrigerator food recognition
title_fullStr Robust deep-learning based refrigerator food recognition
title_full_unstemmed Robust deep-learning based refrigerator food recognition
title_short Robust deep-learning based refrigerator food recognition
title_sort robust deep learning based refrigerator food recognition
topic food recognition
deep learning
data augmentation
feature pyramid network
internet of Things
food management
url https://www.frontiersin.org/articles/10.3389/frai.2024.1442948/full
work_keys_str_mv AT xiaoyandai robustdeeplearningbasedrefrigeratorfoodrecognition