Finger-Counting-Based Gesture Recognition within Cars Using Impulse Radar with Convolutional Neural Network

The diversion of a driver’s attention from driving can be catastrophic. Given that conventional button- and touch-based interfaces may distract the driver, developing novel distraction-free interfaces for the various devices present in cars has becomes necessary. Hand gesture recognition may provide an alternative interface inside cars. Given that cars are the targeted application area, we determined the optimal location for the radar sensor, so that the signal reflected from the driver’s hand during gesturing is unaffected by interference from the motion of the driver’s body or other motions within the car. We implemented a Convolutional Neural Network-based technique to recognize the finger-counting-based hand gestures using an Impulse Radio (IR) radar sensor. The accuracy of the proposed method was sufficiently high for real-world applications.

• Publication year

  2019

• Venue

  Italian National Conference on Sensors

• Publication date

  2019-03-01

• Fields of study

  Medicine, Computer Science, Engineering

• Identifiers
  DOI 10.3390/s19061429PMID 30909552PMCID 6470780
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar, PubMed

• No claims are published for this paper.

• No concepts are published for this paper.

• TS-I3D Based Hand Gesture Recognition Method With Radar Sensor

  2019cited by this paper
• Feature-Based Hand Gesture Recognition Using an FMCW Radar and its Temporal Feature Analysis

  2018cited by this paper
• A Review of Meta-Reinforcement Learning for Deep Neural Networks Architecture Search

  2018cited by this paper
• IR-UWB radar-based near-field head rotation movement sensing under fixed body motions

  2018cited by this paper
• Bi-Directional Passing People Counting System Based on IR-UWB Radar Sensors

  2018cited by this paper
• Applying singular value decomposition for clutter reduction in heartbeat estimation using M-sequence UWB Radar

  2018cited by this paper
• An Improved Algorithm for Through-Wall Target Detection Using Ultra-Wideband Impulse Radar

  2017cited by this paper
• A Detailed Algorithm for Vital Sign Monitoring of a Stationary/Non-Stationary Human through IR-UWB Radar

  2017cited by this paper
• RIO: A Pervasive RFID-based Touch Gesture Interface

  2017cited by this paper
• 3D positioning algorithm based on multiple quasi-monostatic IR-UWB radar sensors

  2017cited by this paper
• A Finger Counting Method for Gesture Recognition

  2016cited by this paper
• Comparison of deep neural networks to spatio-temporal cortical dynamics of human visual object recognition reveals hierarchical correspondence

  2016cited by this paper
• Algorithm for Gesture Recognition Using an IR-UWB Radar Sensor

  2016cited by this paper
• Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift

  2015cited by this paper
• Superpixel-Based Hand Gesture Recognition With Kinect Depth Camera

  2015cited by this paper
• Location Detection and Tracking of Moving Targets by a 2D IR-UWB Radar System

  2015cited by this paper
• Going deeper with convolutions

  2014cited by this paper
• Techniques for Clutter Suppression in the Presence of Body Movements during the Detection of Respiratory Activity through UWB Radars

  2014cited by this paper
• Robust Part-Based Hand Gesture Recognition Using Kinect Sensor

  2013cited by this paper
• Vision based hand gesture recognition for human computer interaction: a survey

  2012cited by this paper
• Examining the relationship between driver distraction and driving errors: a discussion of theory, studies and methods

  2012cited by this paper
• ImageNet classification with deep convolutional neural networks

  2012cited by this paper
• Performance of laser and radar ranging devices in adverse environmental conditions

  2009cited by this paper
• Design space for driver-based automotive user interfaces

  2009cited by this paper
• A user study of auditory versus visual interfaces for use while driving

  2008cited by this paper
• Analysis of the Implementation and Impact of Speech-Recognition Technology in the Healthcare Sector

  2004cited by this paper
• Background subtraction techniques: a review

  2004cited by this paper
• The ultra-wide bandwidth indoor channel: from statistical model to simulations

  2002cited by this paper
• Concurrent mobile (cellular) phone use and driving performance: task demand characteristics and compensatory processes

  2000cited by this paper
• Impulse radio: how it works

  1998cited by this paper
• Ultra-wideband radar using Fourier synthesized waveforms

  1997influential reference
• A survey of glove-based input

  1994cited by this paper

• Static gesture recognition based on thermal imaging sensors

  2025cites this paper
• In-Vehicle Wireless Gesture Recognition System-Based Attention-Enhanced Lightweight Model

  2025cites this paper
• FMCW Radar-Based In-Air Alphanumeric Gesture Recognition With Machine Learning

  2025cites this paper
• Radar-Based Hand Gesture Recognition With Feature Fusion Using Robust CNN-LSTM and Attention Architecture

  2025cites this paper
• A Low-Complexity Air-Digit-Writing Recognition Method Based on Adaptive Trajectory Learning Using MIMO Radar

  2024cites this paper
• TinyssimoRadar: In-Ear Hand Gesture Recognition with Ultra-Low Power mmWave Radars

  2024cites this paper
• A Comprehensive Overview on UWB Radar: Applications, Standards, Signal Processing Techniques, Datasets, Radio Chips, Trends and Future Research Directions

  2024cites this paper
• Gesture Recognition Based on Wireless Technology: Present and Future

  2024cites this paper
• Intelligent Troubleshooting of Vertical Bandsaws, Leveraging Ensemble Learning on Low-Level Data

  2024cites this paper
• Hand gesture recognition based on micro‐Doppler radar using graph neural network

  2024cites this paper
• Temporal signed gestures segmentation in an image sequence using deep reinforcement learning

  2024cites this paper
• Hand Gesture Recognition Using FSK Radar Sensors

  2024cites this paper
• An Ultra-Efficient Approach for High-Resolution MIMO Radar Imaging of Human Hand Poses

  2023cites this paper
• RadarSense: Accurate Recognition of Mid-air Hand Gestures with Radar Sensing and Few Training Examples

  2023cites this paper
• FORTE: Few Samples for Recognizing Hand Gestures with a Smartphone-attached Radar

  2023influential citation
• A 3D U-Net Based on a Vision Transformer for Radar Semantic Segmentation

  2023cites this paper
• Unobtrusive hand gesture recognition using ultra-wide band radar and deep learning

  2023cites this paper
• Pengenalan Gestur Jari Tangan Sebagai Media Pembelajaran Berhitung Bagi PAUD Berbasis Visi Komputer Dan Deep Learning

  2023cites this paper
• Improving Dynamic Hand Gesture Recognition based IR-UWB using Offline Data Augmentation and Deep Learning

  2022cites this paper
• Preclinical trial of noncontact anthropometric measurement using IR-UWB radar

  2022cites this paper
• A Trajectory-Based Gesture Recognition in Smart Homes Based on the Ultrawideband Communication System

  2022cites this paper
• A Novel Deep Learning-Based Mitosis Recognition Approach and Dataset for Uterine Leiomyosarcoma Histopathology

  2022cites this paper
• IR-UWB Radar-Based Robust Heart Rate Detection Using a Deep Learning Technique Intended for Vehicular Applications

  2022cites this paper
• Radar Semantic Segmentation based on U-Net using Vision Transformer

  2022cites this paper
• Radar-Based Gesture Recognition Using a Variational Autoencoder With Deep Statistical Metric Learning

  2022cites this paper
• Microwave and Millimeter-Wave Radar Circuits for the Next Generation Contact-Less In-Cabin Detection

  2022cites this paper
• UWB-gestures, a public dataset of dynamic hand gestures acquired using impulse radar sensors

  2021cites this paper
• Hand Gestures Recognition Using Radar Sensors for Human-Computer-Interaction: A Review

  2021influential citation
• A Trajectory-based Gesture Recognition in Smart Homes based on Ultra-Wideband System

  2021cites this paper
• Command Recognition Using Binarized Convolutional Neural Network with Voice and Radar Sensors for Human-Vehicle Interaction

  2021cites this paper
• Hand gesture classification using a novel CNN-crow search algorithm

  2021cites this paper
• Efficient High Cross-User Recognition Rate Ultrasonic Hand Gesture Recognition System

  2020cites this paper
• In-Air Continuous Writing Using UWB Impulse Radar Sensors

  2020cites this paper
• An Overview of Signal Processing Techniques for Remote Health Monitoring Using Impulse Radio UWB Transceiver

  2020cites this paper
• A New Thresholding Method for IR-UWB Radar-Based Detection Applications †

  2020cites this paper
• Device free human gesture recognition using Wi-Fi CSI: A survey

  2020cites this paper
• Multiple Sensor Linear Multi-Target Integrated Probabilistic Data Association for Ultra-Wide Band Radar

  2020cites this paper
• Localization of a person moving with an unknown character of motion

  2020cites this paper
• Deep Learning for Radio-Based Human Sensing: Recent Advances and Future Directions

  2020cites this paper
• IR-UWB Sensor Based Fall Detection Method Using CNN Algorithm

  2020cites this paper
• Hand Gesture Recognition Using an IR-UWB Radar with an Inception Module-Based Classifier

  2020cites this paper
• Modelling of Hand Gestures and Motions

  2019cites this paper
• WiFi-Based Gesture Recognition for Vehicular Infotainment System—An Integrated Approach

  2019cites this paper
• Hand Gesture Recognition using Radar Sensor: A Review

  year unknowncites this paper