The development of food image detection and recognition model of Korean food for mobile dietary management
0
조회
0
다운로드
1
인용
0
참고문헌
키워드
초록
BACKGROUND/OBJECTIVES: The aim of this study was to develop Korean food image detection and recognition model for use in mobile devices for accurate estimation of dietary intake. MATERIALS/METHODS: We collected food images by taking pictures or by searching web images and built an image dataset for use in training a complex recognition model for Korean food. Augmentation techniques were performed in order to increase the dataset size. The dataset for training contained more than 92,000 images categorized into 23 groups of Korean food. All images were down-sampled to a fixed resolution of 150 × 150 and then randomly divided into training and testing groups at a ratio of 3:1, resulting in 69,000 training images and 23,000 test images. We used a Deep Convolutional Neural Network (DCNN) for the complex recognition model and compared the results with those of other networks: AlexNet, GoogLeNet, Very Deep Convolutional Neural Network, VGG and ResNet, for large-scale image recognition. RESULTS: Our complex food recognition model, K-foodNet, had higher test accuracy (91.3%) and faster recognition time (0.4 ms) than those of the other networks. CONCLUSION: The results showed that K-foodNet achieved better performance in detecting and recognizing Korean food compared to other state-of-the-art models.
Abstract
BACKGROUND/OBJECTIVES: The aim of this study was to develop Korean food image detection and recognition model for use in mobile devices for accurate estimation of dietary intake. MATERIALS/METHODS: We collected food images by taking pictures or by searching web images and built an image dataset for use in training a complex recognition model for Korean food. Augmentation techniques were performed in order to increase the dataset size. The dataset for training contained more than 92,000 images categorized into 23 groups of Korean food. All images were down-sampled to a fixed resolution of 150 × 150 and then randomly divided into training and testing groups at a ratio of 3:1, resulting in 69,000 training images and 23,000 test images. We used a Deep Convolutional Neural Network (DCNN) for the complex recognition model and compared the results with those of other networks: AlexNet, GoogLeNet, Very Deep Convolutional Neural Network, VGG and ResNet, for large-scale image recognition. RESULTS: Our complex food recognition model, K-foodNet, had higher test accuracy (91.3%) and faster recognition time (0.4 ms) than those of the other networks. CONCLUSION: The results showed that K-foodNet achieved better performance in detecting and recognizing Korean food compared to other state-of-the-art models.
참고문헌 (32)
- De Keyzer W, "Cross-continental comparison of national food consumption survey methods--a narrative review", Nutrients, 7, pp.3587~3620 (2015)
- Johnson RK, "Literacy and body fatness are associated with underreporting of energy intake in US low-income women using the multiple-pass 24-hour recall: a doubly labeled water study", J Am Diet Assoc, 98, pp.1136~1140 (1998)
- Stumbo PJ, "New technology in dietary assessment: a review of digital methods in improving food record accuracy", Proc Nutr Soc, 72, pp.70~76 (2013)
- Martin CK, "Quantification of food intake using food image analysis", Conf Proc IEEE Eng Med Biol Soc, 2009, pp.6869~6872 (2009)
- Lazarte CE, "Validation of digital photographs, as a tool in 24-h recall, for the improvement of dietary assessment among rural populations in developing countries", Nutr J, 11, pp.61~ (2012)
- Kikunaga S, "The application of a handheld personal digital assistant with camera and mobile phone card (Wellnavi) to the general population in a dietary survey", J Nutr Sci Vitaminol (Tokyo), 53, pp.109~116 (2007)
- Wang DH, "Validity and reliability of a dietary assessment method: the application of a digital camera with a mobile phone card attachment", J Nutr Sci Vitaminol (Tokyo), 48, pp.498~504 (2002)
- Khanna N, "An overview of the technology assisted dietary assessment project at Purdue University", ISM, pp.290~295 (2010)
- Martin CK, "Validity of the remote food photography method (RFPM) for estimating energy and nutrient intake in near real-time", Obesity (Silver Spring), 20, pp.891~899 (2012)
- Beltran A, "Dietary assessment with a wearable camera among children: feasibility and intercoder reliability", J Acad Nutr Diet, 118, pp.2144~2153 (2018)
- Wang DH, "Development of a new instrument for evaluating individuals' dietary intakes", J Am Diet Assoc, 106, pp.1588~1593 (2006)
- He H, "DietCam: multiview food recognition using a multikernel SVM", IEEE J Biomed Health Inform, 20, pp.848~855 (2016)
- Zhang XJ, "Multi-task learning for food identification and analysis with deep convolutional neural networks", J Comput Sci Technol, 31, pp.489~500 (2016)
- Mezgec S, "NutriNet: a deep learning food and drink image recognition system for dietary assessment", Nutrients, 9, pp.9~ (2017)
- 장은재, "카메라폰을 이용한 식이섭취 조사방법에 대한 연구", 대한지역사회영양학회지, 12(2), pp.198~205 (2007), 대한지역사회영양학회
- 손혜린, "사진촬영을 이용한 1회 섭취 분량 추정의 타당도 연구", 한국식생활문화학회지, 32(2), pp.162~173 (2017), 한국식생활문화학회[DOI]
- 정현혜, "디지털 사진을 이용한 점심급식의 영양소 섭취량 분석: 예비조사", 대한영양사협회 학술지, 15(3), pp.278~285 (2009), 대한영양사협회
- Matsuda Y, "Multiple-food recognition considering co-occurrence employing manifold ranking", Proceedings of the 21st International Conference on Pattern Recognition, pp.2017~2020 (2013), IEEE
- Zhu F, "The use of mobile devices in aiding dietary assessment and evaluation", IEEE J Sel Top Signal Process, 4, pp.756~766 (2010)
- Daugherty BL, "Novel technologies for assessing dietary intake: evaluating the usability of a mobile telephone food record among adults and adolescents", J Med Internet Res, 14, pp.e58~ (2012)
- Kong F, "DietCam: automatic dietary assessment with mobile camera phones", Pervasive Mob Comput, 8, pp.147~163 (2012)
- Kawano Y, "Real-time mobile food recognition system", 2013 IEEE Conference on Computer Vision and Pattern Recognition Workshops, pp.1~7 (2013), IEEE
- Jia W, "Automatic food detection in egocentric images using artificial intelligence technology", Public Health Nutr, 22, pp.1168~1179 (2019)
- Kagaya H, "Food detection and recognition using convolutional neural network", Proceedings of the 22nd ACM International Conference on Multimedia, pp.1085~1088 (2014), ACM
- Kingma DP, "Adam: a method for stochastic optimization", Conference Paper at the 3rd International Conference for Learning Representations, pp.1~15 (2017), ICLR
- "Rethinking softmax cross-entropy loss for adversarial robustness" (2019)[URL]
- Farooq M, "Validation of sensor-based food intake detection by multicamera video observation in an unconstrained environment", Nutrients, 11, pp.E609~ (2019)
- Liu C, "DeepFood:deep learning-based food image recognition for computer-aided dietary assessment", ICOST 2016 Proceedings of the 14th International Conference on Inclusive Smart Cities and Digital Health, pp.37~48 (2016), Springer International Publishing
- Hassannejad H, "Food image recognition using very deep convolutional networks", Proceedings of the 2nd International Workshop on Multimedia Assisted Dietary Management, pp.41~49 (2016), ACM
- Christodoulidis S, "Food recognition for dietary assessment using deep convolutional neural networks", New Trends in Image Analysis and Processing -- ICIAP 2015 Workshops, pp.458~465 (2015), Springer International Publishing
- "Food image recognition by using convolutional neural networks (CNNs)" (2019)[URL]
- Pandey P, "FoodNet: recognizing food using ensemble of deep networks", IEEE Signal Process Lett, 24, pp.1758~1762 (2017)