Nutritional assessment system integrating semantic segmentation and point cloud modeling techniques

Balanced nutrition plays a vital role in preventing chronic diseases. We propose a home-based monitoring system that integrates an Nvidia Jetson AGX Xavier embedded device with an Intel RealSense D435 depth camera mounted vertically above the dining table. The system collects data every minute during meals, capturing point clouds with RGB information. Deep-learning object detection models identify and track multiple food items, ensuring each item is recognized independently. Point clouds are aligned using Random Sample Consensus (RANSAC) and Iterative Closest Point (ICP), while Density-Based Spatial Clustering of Applications with Noise (DBSCAN) distinguishes the table, plate, and food. The system records temporal changes in meal portions and reconstructs food point clouds to estimate volume. Each estimate is linked to the corresponding food category predicted by the semantic segmentation model and combined with nutritional values. All data are uploaded to the cloud, enabling user analysis along with preliminary assessments of total nutrient intake and eating speed. By integrating these components, the system provides accurate records of meal volume and composition, supporting comprehensive evaluations of home-based nutrition over a three-month period.

• Publication year

  2025

• Venue

  Scientific Reports

• Publication date

  2025-11-10

• Fields of study

  Agricultural and Food Sciences, Medicine, Computer Science

• Identifiers
  DOI 10.1038/s41598-025-23096-7PMID 41214149PMCID 12603017
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar, PubMed

• No claims are published for this paper.

• No concepts are published for this paper.

• In-depth Analysis on Machine Learning Approaches

  2025cited by this paper
• A Comprehensive Part-of-Speech Tagging to Standardize Central-Kurdish Language: A Research Guide for Kurdish Natural Language Processing Tasks

  2025cited by this paper
• Preliminary results on food weight estimation with RGB-D images

  2024cited by this paper
• Measuring food volume from RGB-Depth image with point cloud conversion method using geometrical approach and robust ellipsoid fitting algorithm

  2023cited by this paper
• Fall Recognition Based on an IMU Wearable Device and Fall Verification through a Smart Speaker and the IoT

  2023cited by this paper
• A Review of Image-Based Food Recognition and Volume Estimation Artificial Intelligence Systems

  2023cited by this paper
• Home health care system for the Elderly based on IMU wearable device

  2023cited by this paper
• An Automated Image-Based Dietary Assessment System for Mediterranean Foods

  2023cited by this paper
• A Novel Poisoned Water Detection Method Using Smartphone Embedded Wi-Fi Technology and Machine Learning Algorithms

  2023cited by this paper
• mid-DeepLabv3+: A Novel Approach for Image Semantic Segmentation Applied to African Food Dietary Assessments

  2023cited by this paper
• Healthy dietary patterns and the risk of individual chronic diseases in community-dwelling adults

  2023cited by this paper
• Healthy Aging-Nutrition Matters: Start Early and Screen Often.

  2021cited by this paper
• 3D Reconstruction and Volume Estimation of Food using Stereo Vision Techniques

  2021cited by this paper
• An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale

  2020cited by this paper
• Point2Volume: A Vision-Based Dietary Assessment Approach Using View Synthesis

  2020cited by this paper
• Image-Based Food Classification and Volume Estimation for Dietary Assessment: A Review

  2020cited by this paper
• Exploring Chinese Dietary Habits Using Recipes Extracted From Websites

  2019cited by this paper
• The development of food image detection and recognition model of Korean food for mobile dietary management

  2019cited by this paper
• DepthCalorieCam: A Mobile Application for Volume-Based FoodCalorie Estimation using Depth Cameras

  2019cited by this paper
• An End-to-End Image-Based Automatic Food Energy Estimation Technique Based on Learned Energy Distribution Images: Protocol and Methodology

  2019cited by this paper
• Mobilizing mHealth Data Collection in Older Adults: Challenges and Opportunities

  2019cited by this paper
• Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation

  2018cited by this paper
• Food Photo Recognition for Dietary Tracking: System and Experiment

  2018cited by this paper
• Assessment and management of nutrition in older people and its importance to health

  2010cited by this paper
• A Density-Based Algorithm for Discovering Clusters in Large Spatial Databases with Noise

  1996cited by this paper
• Number of days of food intake records required to estimate individual and group nutrient intakes with defined confidence.

  1987cited by this paper
• Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography

  1981cited by this paper
• Two algorithms for constructing a Delaunay triangulation

  1980cited by this paper

• No citing papers are available for this paper.