Mobile Food Image Classification with Allergen Information using EfficientNetB0
DOI:
https://doi.org/10.24191/jcrinn.v11i2.612Keywords:
Deep Learning, EfficientNetB0, Mobile Application, Food Image, Allergen Info, Image RecognitionAbstract
Food allergens represent a significant public health concern because they can trigger severe and potentially life-threatening reactions in sensitive individuals. Seven allergens focus on this study, which consist of tree nuts, shellfish, milk, peanuts, soybeans, eggs, and wheat. However, restaurant menus in Malaysia and many other regions often lack explicit warnings about allergenic ingredients. This study addresses this critical gap by developing a comprehensive mobile application for real-time food image classification that integrates EfficientNetB0 with personalized allergen information and safety alerts. The model was trained on 7,556 food images across eight food categories based on Kaggle/recipe datasets and achieved 96% test accuracy. The native mobile app integrates camera capture and gallery upload, provides instant classification, and confidence-scored predictions using a 70% threshold, and displays user-specific allergen symptom warnings through food-allergen mapping based on clinical sources and classification history. Experimental evaluation demonstrated promising classification performance and functional reliability of the mobile application. This mobile-deployed solution offers a practical approach for supporting safer food choices and improving public health awareness, while aligning with UN Sustainable Development Goal 3
Downloads
References
AdminBarakah. (2023, March 1). Food allergen. Al Barakah Training Solution. https://al-barakah.com.my/food-allergen/.
Anvari, S., Miller, J., Yeh, C. Y., & Davis, C. M. (2019). IgE-mediated food allergy. Clinical reviews in allergy and immunology, 57(2), 244–260. https://doi.org/10.1007/s12016-018-8710-3.
Chaitanya, A., Shetty, J., & Chiplunkar, P. (2022). Food image classification and data extraction using convolutional neural network and web crawlers. Procedia Computer Science, 218, 143–152. https://doi.org/10.1016/j.procs.2022.12.410.
GeeksforGeeks. (2024, June 3). EfficientNet architecture. https://www.geeksforgeeks.org/computer-vision/efficientnet-architecture/.
Iweala, O. I., Choudhary, S. K., & Commins, S. P. (2018). Food allergy. In Current Gastroenterology Reports (Vol. 20, Number 5). Current Medicine Group LLC 1. https://doi.org/10.1007/s11894-018-0624-y.
Jiang, S., Min, W., Liu, L., & Luo, Z. (2020). Multi-scale multi-view deep feature aggregation for food recognition. IEEE Transactions on Image Processing, 29, 265–276. https://doi.org/10.1109/TIP.2019.2929447.
Khor, P. L., Jee, W., & Raymond, K. (2022, December 28). Food allergen detection in Malaysian food using convolutional neural networks. AIJR Proceedings, 103-108. https://doi.org/10.21467/proceedings.141.
Kumar, S., Verma, A. K., Das, M., & Dwivedi, P. D. (2012). Molecular mechanisms of IgE mediated food allergy. International Immunopharmacology, 13(4), 432–439. https://doi.org/10.1016/j.intimp.2012.05.018.
Lam, H. K., & Perera, K. M. P. (2024). Detecting Korean food using image using hierarchical model. http://arxiv.org/abs/2409.02448.
Leba, E., Faigao, J. A., Magante, M. V., Joseph, V., Tamba, Y., Nelson, I., & Bingcang, E. (2024). Allertify: Android-based mobile application for food allergens identification using barcode scanning and image recognition. In 11th International Scholars Conference (Vol. 11, No. 5, pp. 1542-1557).
Masilamani, M., Commins, S., & Shreffler, W. (2012). Determinants of food allergy. Immunology and Allergy Clinics of North America, 32(1), 11–33. https://doi.org/10.1016/j.iac.2011.12.003.
Tan, A. L., Trupp, A., & Tan, J. X. (2023). Dining out safely with food allergies: A comparative perspective from restaurant managers and servers in Malaysia. International Food Research Journal, 30(3), 750–763. https://doi.org/10.47836/ifrj.30.3.17.
Tran, Q. L., Lam, G. H., Le, Q. N., Tran, T. H., & Do, T. H. (2021). A comparison of several approaches for image recognition used in food recommendation system. In 10th IEEE International Conference on Communication, Networks and Satellite (pp. 284–289). https://doi.org/10.1109/COMNETSAT53002.2021.9530793.
Vishal A. A., Aakash, G., Sanchay Kumar, S., & Preethiya, T. (2024). DeepAllergy: A deep learning approach for accurate and rapid food allergen detection. In 10th International Conference on Advanced Computing and Communication Systems, ICACCS 2024 (pp. 2225–2230). https://doi.org/10.1109/ICACCS60874.2024.10717042.
West, H., Northrop, A., MPH, RD, & LMT. (2024, March 7). The 9 most common food allergies. Healthline. https://www.healthline.com/nutrition/common-food-allergies.
Yudeepanao, K., Sakkato, K., Tosaman, P., Songmuang, P., & Kongkachandra, R. (2024). Detecting food items with possible allergens using deep neural network. In International Conference on Cybernetics and Innovations, ICCI 2024 (pp. 1–6). IEEE. https://doi.org/10.1109/ICCI60780.2024.10532449.
Downloads
Published
Issue
Section
License
Copyright (c) 2026 Intan Nur Syahamah Tajul Ariffin, Hana Fakhira Almarzuki, Khyrina Airin Fariza Abu Samah, Tajul Rosli Razak, Nur Aina khadijah Adnan, Hafizatul Hanin Hamzah (Author)
This work is licensed under a Creative Commons Attribution 4.0 International License.
