SemiHD: Semi-Supervised Learning Using Hyperdimensional Computing

In the Internet of Things (IoT), the large volume of data generated by sensors poses significant computational challenges in resource-constrained environments. Most existing machine learning algorithms are unable to train a proper model using a significantly small amount of labeled data available in practice. In this paper, we propose SemiHD, a novel semi-supervised algorithm based on brain-inspired HyperDimensional (HD) computing. SemiHD performs the cognitive task by emulating neuron's activity in high-dimensional space. SemiHD maps data points into high-dimensional space and trains a model based on the available labeled data. To improve the quality of the model, SemiHD iteratively expands the training data by labeling data points which can be classified by the current model with high confidence. We also proposed a framework which enables users to trade accuracy for efficiency and select the desired reliability of the model in detecting out of scope data. We have evaluated SemiHD's accuracy and efficiency on a wide range of classification applications and two types of embedded devices: Raspberry Pi 3 and Kintex-7 FPGA. Our evaluation shows that SemiHD can improve the classification accuracy of supervised HD by 10.2% on average (up to 27.3%). In addition, we observe that SemiHD FPGA implementation achieves 7.11× faster and 12.6× energy efficiency as compared to the CPU implementation.

• Publication year

  2019

• Venue

  2019 IEEE/ACM International Conference on Computer-Aided Design (ICCAD)

• Publication date

  2019-11-01

• Fields of study

  Computer Science, Engineering

• Identifiers
  DOI 10.1109/iccad45719.2019.8942165
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• SparseHD: Algorithm-Hardware Co-optimization for Efficient High-Dimensional Computing

  2019cited by this paper
• CompHD: Efficient Hyperdimensional Computing Using Model Compression

  2019cited by this paper
• A Framework for Collaborative Learning in Secure High-Dimensional Space

  2019cited by this paper
• FACH: FPGA-based acceleration of hyperdimensional computing by reducing computational complexity

  2019cited by this paper
• F5-HD: Fast Flexible FPGA-based Framework for Refreshing Hyperdimensional Computing

  2019cited by this paper
• HDCluster: An Accurate Clustering Using Brain-Inspired High-Dimensional Computing

  2019cited by this paper
• A Binary Learning Framework for Hyperdimensional Computing

  2019cited by this paper
• BRIC: Locality-based Encoding for Energy-Efficient Brain-Inspired Hyperdimensional Computing

  2019cited by this paper
• FloatPIM: In-Memory Acceleration of Deep Neural Network Training with High Precision

  2019cited by this paper
• Efficient human activity recognition using hyperdimensional computing

  2018cited by this paper
• Hierarchical Hyperdimensional Computing for Energy Efficient Classification

  2018cited by this paper
• FELIX: Fast and Energy-Efficient Logic in Memory

  2018cited by this paper
• HDNA: Energy-efficient DNA sequencing using hyperdimensional computing

  2018cited by this paper
• Low-Power Sparse Hyperdimensional Encoder for Language Recognition

  2017cited by this paper
• Hyperdimensional Computing for Blind and One-Shot Classification of EEG Error-Related Potentials

  2017cited by this paper
• VoiceHD: Hyperdimensional Computing for Efficient Speech Recognition

  2017cited by this paper
• Exploring Hyperdimensional Associative Memory

  2017cited by this paper
• Challenges and Opportunities in Edge Computing

  2016cited by this paper
• Federated Learning: Strategies for Improving Communication Efficiency

  2016cited by this paper
• A Robust and Energy-Efficient Classifier Using Brain-Inspired Hyperdimensional Computing

  2016cited by this paper
• Self-labeled techniques for semi-supervised learning: taxonomy, software and empirical study

  2015cited by this paper
• The Internet of Things (IoT): Applications, investments, and challenges for enterprises

  2015cited by this paper
• Semi-supervised Learning with Deep Generative Models

  2014cited by this paper
• Internet of Things (IoT): A vision, architectural elements, and future directions

  2012cited by this paper
• The Digital Universe in 2020: Big Data, Bigger Digital Shadows, and Biggest Growth in the Far East

  2012cited by this paper
• Vivado Design Suite

  2012cited by this paper
• Scikit-learn: Machine Learning in Python

  2011cited by this paper
• From the Internet of Things to the Web of Things: Resource-oriented Architecture and Best Practices

  2011cited by this paper
• Hyperdimensional Computing: An Introduction to Computing in Distributed Representation with High-Dimensional Random Vectors

  2009cited by this paper
• Graph-Based Semi-Supervised Learning

  2005cited by this paper
• Semi-Supervised Self-Training of Object Detection Models

  2005cited by this paper
• Active + Semi-supervised Learning = Robust Multi-View Learning

  2002cited by this paper
• Semi-Supervised Support Vector Machines

  1998cited by this paper

• Parametrization of sparse distributed representations for vector data classification

  2026cites this paper
• Hyper-Dimensional Computing Architectures for AI Applications: A Comprehensive Survey of Principles, Performance, and Future Prospects

  2026cites this paper
• Classification Performance of Confidence-Driven Centroids

  2025cites this paper
• Hyperdimensional Uncertainty Quantification for Multimodal Uncertainty Fusion in Autonomous Vehicles Perception

  2025cites this paper
• Classification using hyperdimensional computing: a review with comparative analysis

  2025influential citation
• BiHDTrans: binary hyperdimensional transformer for efficient multivariate time series classification

  2025cites this paper
• Prediction of Clinical Response of Transcranial Magnetic Stimulation Treatment for Major Depressive Disorder Using Hyperdimensional Computing

  2025cites this paper
• Hyperdimensional computing: A fast, robust, and interpretable paradigm for biological data

  2024cites this paper
• PSPU: Enhanced Positive and Unlabeled Learning by Leveraging Pseudo Supervision

  2024cites this paper
• EcoFlex-HDP: High-Speed and Low-Power and Programmable Hyperdimensional-Computing Platform with CPU Co-Processing

  2024cites this paper
• Scheduled Knowledge Acquisition on Lightweight Vector Symbolic Architectures for Brain-Computer Interfaces

  2024cites this paper
• Intelligence Beyond the Edge using Hyperdimensional Computing

  2024influential citation
• KalmanHD: Robust On-Device Time Series Forecasting with Hyperdimensional Computing

  2024cites this paper
• uHD: Unary Processing for Lightweight and Dynamic Hyperdimensional Computing

  2023cites this paper
• Recent Progress and Development of Hyperdimensional Computing (HDC) for Edge Intelligence

  2023cites this paper
• Combining General and Personalized Models for Epilepsy Detection with Hyperdimensional Computing

  2023cites this paper
• Learning from Hypervectors: A Survey on Hypervector Encoding

  2023cites this paper
• Towards Efficient Hyperdimensional Computing Using Photonics

  2023cites this paper
• Federated Hyperdimensional Computing

  2023cites this paper
• A Review on Hyperdimensional Computing

  2023cites this paper
• Semi-Supervised Learning Using Sparsely Labelled Sip Events for Online Hydration Tracking Systems

  2023cites this paper
• Exploration of Hyperdimensional Computing Strategies for Enhanced Learning on Epileptic Seizure Detection

  2022influential citation
• Hyperdimensional Computing Encoding Schemes for Improved Image Classification

  2022cites this paper
• HDTorch: Accelerating Hyperdimensional Computing with GP-GPUs for Design Space Exploration

  2022cites this paper
• Hyperdimensional computing encoding for feature selection on the use case of epileptic seizure detection

  2022cites this paper
• EventHD: Robust and efficient hyperdimensional learning with neuromorphic sensor

  2022cites this paper
• Scalable Edge-Based Hyperdimensional Learning System with Brain-Like Neural Adaptation

  2021cites this paper
• Multi-Centroid Hyperdimensional Computing Approach for Epileptic Seizure Detection

  2021cites this paper
• Hyperseed: Unsupervised Learning With Vector Symbolic Architectures

  2021cites this paper
• tiny-HD: Ultra-Efficient Hyperdimensional Computing Engine for IoT Applications

  2021cites this paper
• Hyper-Dimensional Computing Challenges and Opportunities for AI Applications

  2021cites this paper
• DUAL: Acceleration of Clustering Algorithms using Digital-based Processing In-Memory

  2020cites this paper
• Adversarial Attacks on Brain-Inspired Hyperdimensional Computing-Based Classifiers

  2020cites this paper
• QuantHD: A Quantization Framework for Hyperdimensional Computing

  2020cites this paper
• Classification Using Hyperdimensional Computing: A Review

  2020influential citation
• QubitHD: A Stochastic Acceleration Method for HD Computing-Based Machine Learning

  2019cites this paper