Logo image
AI-Assisted Food Intake Activity Recognition Using 3D mmWave Radars
Conference paper

AI-Assisted Food Intake Activity Recognition Using 3D mmWave Radars

Yi-Hung Wu, Yuanjie Chen, Shervin Shirmohammadi and Cheng-Hsin Hsu
MADiMa 2022 - Proceedings of the 7th International Workshop on Multimedia Assisted Dietary Management, pp.81-89
10/2022

Abstract

human activity recognition mmwave radar point cloud Endocrinology Diabetes and Metabolism Computer Graphics and Computer-Aided Design Computer Vision and Pattern Recognition Human-Computer Interaction
The automatic recognition of when and for how long a person is eating a certain food or drinking has applications in telecare, smarthome data monetization, and diet control. Existing food recognition systems either recognize the type of the food, but not when and for how long the person was eating and drinking, or use invasive sensors or privacy-intruding cameras which users are hesitant to install in their homes. In this paper, we propose a non-invasive system, using Artificial Intelligence to process 3D point cloud data collected from a 3D mmWave radar, that can distinguish a person's eating and drinking activities from other daily activities. This is challenging because eating and drinking activities are much more fine-grained than activities that existing systems can detect, such as sitting, running, walking, etc. Performance evaluations show that our proposed system significantly outperforms a representative state-of-the-art activity recognition system, RadHAR, by at least 27% and can reach 96.56% and 96.73% accuracy for two different training/testing split setups.

Metrics

1 Record Views

Details

Logo image