Action2Activity: Recognizing Complex Activities from Sensor Data

As compared to simple actions, activities are much more complex, but semantically consistent with a human's real life. Techniques for action recognition from sensor generated data are mature. However, there has been relatively little work on bridging the gap between actions and activities. To this end, this paper presents a novel approach for complex activity recognition comprising of two components. The first component is temporal pattern mining, which provides a mid-level feature representation for activities, encodes temporal relatedness among actions, and captures the intrinsic properties of activities. The second component is adaptive Multi-Task Learning, which captures relatedness among activities and selects discriminant features. Extensive experiments on a real-world dataset demonstrate the effectiveness of our work.

• Publication year

  2015

• Venue

  International Joint Conference on Artificial Intelligence

• Publication date

  2015-07-25

• Fields of study

  Computer Science

• Identifiers
  arXiv 1611.01872
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Towards unsupervised physical activity recognition using smartphone accelerometers

  2016cited by this paper
• From action to activity: Sensor-based activity recognition

  2016cited by this paper
• Bridging the Vocabulary Gap between Health Seekers and Healthcare Knowledge

  2015cited by this paper
• Modeling Temporal Interactions with Interval Temporal Bayesian Networks for Complex Activity Recognition

  2013cited by this paper
• Learning High-Order Task Relationships in Multi-Task Learning

  2013cited by this paper
• Tracking Generic Human Motion via Fusion of Low- and High-Dimensional Approaches

  2013cited by this paper
• The Opportunity challenge: A benchmark database for on-body sensor-based activity recognition

  2013cited by this paper
• Context-aware mobile music recommendation for daily activities

  2012influential reference
• Fusion of low-and high-dimensional approaches by trackers sampling for generic human motion tracking

  2012cited by this paper
• Clustered Multi-Task Learning Via Alternating Structure Optimization

  2011cited by this paper
• A multi-task learning formulation for predicting disease progression

  2011cited by this paper
• Visual analysis of child-adult interactive behaviors in video sequences

  2010cited by this paper
• A Convex Formulation for Learning Task Relationships in Multi-Task Learning

  2010cited by this paper
• Learning HTN Method Preconditions and Action Models from Partial Observations

  2009cited by this paper
• Quantifying information and contradiction in propositional logic through test actions

  2009cited by this paper
• epSICAR: An Emerging Patterns based approach to sequential, interleaved and Concurrent Activity Recognition

  2009cited by this paper
• Mining relationships among interval-based events for classification

  2008cited by this paper
• Multi-Task Learning via Conic Programming

  2007cited by this paper
• Ambient and Wearable Sensor Fusion for Activity Recognition in Healthcare Monitoring Systems

  2007cited by this paper
• Mining Nonambiguous Temporal Patterns for Interval-Based Events

  2007cited by this paper
• Model selection and estimation in regression with grouped variables

  2006cited by this paper
• Recognition of Composite Human Activities through Context-Free Grammar Based Representation

  2006cited by this paper
• Activity Recognition from Accelerometer Data

  2005influential reference
• Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data

  2001cited by this paper
• Discovery of Temporal Patterns. Learning Rules about the Qualitative Behaviour of Time Series

  2001cited by this paper
• Regression Shrinkage and Selection via the Lasso

  1996influential reference
• Fast Algorithms for Mining Association Rules in Large Databases

  1994cited by this paper
• A tutorial on hidden Markov models and selected applications in speech recognition

  1989cited by this paper
• Maintaining knowledge about temporal intervals

  1983cited by this paper

• System Design for Sensing in Manufacturing to Apply AI through Hierarchical Abstraction Levels

  2024cites this paper
• Causality-Aware Pattern Mining Scheme for Group Activity Recognition

  2024cites this paper
• Evaluation of Video-Assisted Annotation of Human IMU Data Across Expertise, Datasets, and Tools

  2024cites this paper
• Smartwatch-Based Human Staff Activity Classification: A Use-Case Study in Internal Logistics Systems Utilizing AGVs

  2024cites this paper
• Resource-Limited Automated Ki67 Index Estimation in Breast Cancer

  2023cites this paper
• Guided Learning of Human Sensor Models with Low-Level Grounding

  2023cites this paper
• A Causality-Aware Pattern Mining Scheme for Group Activity Recognition in a Pervasive Sensor Space

  2023cites this paper
• Visual-motor control methods for interactive real-time MRI-cardiac imaging

  2022cites this paper
• CHARM: A Hierarchical Deep Learning Model for Classification of Complex Human Activities Using Motion Sensors

  2022cites this paper
• Context-Aware Complex Human Activity Recognition Using Hybrid Deep Learning Models

  2022cites this paper
• CZU-MHAD: A Multimodal Dataset for Human Action Recognition Utilizing a Depth Camera and 10 Wearable Inertial Sensors

  2022cites this paper
• Time Series Similarity Search Methods for Sensor Data

  2022cites this paper
• Hybrid Optimized GRU-ECNN Models for Gait Recognition with Wearable IOT Devices

  2022cites this paper
• View-Invariant Human Action Recognition Via View Transformation Network (VTN)

  2022cites this paper
• Efficient human motion prediction using temporal convolutional generative adversarial network

  2021cites this paper
• A deep genetic algorithm for human activity recognition leveraging fog computing frameworks

  2021cites this paper
• On integration of multiple features for human activity recognition in video sequences

  2021cites this paper
• Long-term rate control for concurrent multipath real-time video transmission in heterogeneous wireless networks

  2021cites this paper
• Symmetric Sub-graph Spatio-Temporal Graph Convolution and its application in Complex Activity Recognition

  2021cites this paper
• Human Activity Recognition with Deep Learning: Overview, Challenges & Possibilities

  2021cites this paper
• Optimal feature selection and hybrid deep learning for direct marketing campaigns in banking applications

  2021cites this paper
• Proposed Approaches for Cooperative Cognitive Radio

  2021cites this paper
• Towards a Clustering Guided Hierarchical Framework for Sensor-Based Activity Recognition

  2021cites this paper
• Hierarchical Dual Attention-Based Recurrent Neural Networks for Individual and Group Activity Recognition in Games

  2021cites this paper
• RETRACTED ARTICLE: Human activity recognition with deep learning: overview, challenges and possibilities

  2021cites this paper
• New Sensor Data Structuring for Deeper Feature Extraction in Human Activity Recognition †

  2021cites this paper
• Transfer learning with fine tuning for human action recognition from still images

  2021cites this paper
• Deep Discriminative Domain Adaptation

  2021cites this paper
• Human Activity Recognition with Deep Learning: Methods, Progress & Possibilities

  2021cites this paper
• Hybrid Detection for Cooperative Cognitive Radio Using AWT and HDWT

  2021cites this paper
• OPLS-SR: A novel face super-resolution learning method using orthonormalized coherent features

  2021cites this paper
• Learning multiple concepts in description logic through three perspectives

  2021cites this paper
• Learning alternative ways of performing a task

  2020cites this paper
• Towards A Personal Mobile Cloud via Generic Device Interconnections

  2020cites this paper
• Energy-Efficient Pattern Recognition Hardware With Elementary Cellular Automata

  2020cites this paper
• Human Activity Recognition Using Inertial, Physiological and Environmental Sensors: A Comprehensive Survey

  2020influential citation
• Mobile intelligent terminal speaker identification for real-time monitoring system of sports training

  2020cites this paper
• A dataset for complex activity recognition withmicro and macro activities in a cooking scenario

  2020cites this paper
• Overlapping Community Detection using Local Seed Expansion

  2020cites this paper
• Survey on wearable sensor modality centred human activity recognition in health care

  2020cites this paper
• Selective

  2020cites this paper
• Using Latent Knowledge to Improve Real-Time Activity Recognition for Smart IoT

  2020cites this paper
• Rapid and Nondestructive On-Site Classification Method for Consumer-Grade Plastics Based on Portable NIR Spectrometer and Machine Learning

  2020cites this paper
• Medical Image Segmentation Based on Combination Method

  2020cites this paper
• CAPHAR: context-aware personalized human activity recognition using associative learning in smart environments

  2020cites this paper
• Green intelligent financial system construction paradigm based on deep learning and concurrency models

  2020cites this paper
• Predicting the popularity of micro-videos via a feature-discrimination transductive model

  2020cites this paper
• Design of multimedia blockchain privacy protection system based on distributed trusted communication

  2020cites this paper
• Finding Characteristics of Users in Sensory Information: From Activities to Personality Traits

  2020cites this paper
• Position-aware hierarchical transfer model for aspect-level sentiment classification

  2020cites this paper
• Athlete’s respiratory frequency and physical energy consumption model based on speech recognition technology

  2020cites this paper
• Video event classification based on two-stage neural network

  2020cites this paper
• An effective method using clustering-based adaptive decomposition and editing-based diversified oversamping for multi-class imbalanced datasets

  2020cites this paper
• Towards Multi-resident Activity Monitoring with Smarter Safer Home Platform

  2019cites this paper
• An adaptable active contour model for medical image segmentation based on region and edge information

  2019cites this paper
• Recent evolution of modern datasets for human activity recognition: a deep survey

  2019cites this paper
• Robust Classification with Sparse Representation Fusion on Diverse Data Subsets

  2019cites this paper
• Detection of breast abnormalities in digital mammograms using the electromagnetism-like algorithm

  2019cites this paper
• Adaptive enhancement of underwater images using multi-objective PSO

  2019cites this paper
• Optimized self-adapting contrast enhancement algorithm for wafer contour extraction

  2019cites this paper
• Method evaluation, parameterization, and result validation in unsupervised data mining: A critical survey

  2019cites this paper
• Throughput maximization for multimedia communication with cooperative cognitive radio using adaptively controlled sensing time

  2019cites this paper
• An improved vehicle panoramic image generation algorithm

  2019cites this paper
• An experimental study for the effects of noise on face recognition algorithms under varying illumination

  2019cites this paper
• Deep learning face representation by fixed erasing in facial landmarks

  2019cites this paper
• A weighting scheme for mining key skeletal joints for human action recognition

  2019cites this paper
• Corner detection based on tangent-to-point distance accumulation technique

  2019cites this paper
• Minimal vision system for linear camera self-calibration and 3D reconstruction using translation platform

  2019cites this paper
• Gait identification by convolutional neural networks and optical flow

  2019cites this paper
• A zero-watermarking scheme for three-dimensional mesh models based on multi-features

  2019cites this paper
• Deep feature representation and multiple metric ensembles for person re-identification in security surveillance system

  2019cites this paper
• Video superpixels generation through integration of curvelet transform and simple linear iterative clustering

  2019influential citation
• Human action recognition using bag of global and local Zernike moment features

  2019cites this paper
• Disparity-augmented trajectories for human activity recognition

  2019cites this paper
• Illumination-Adaptive Person Re-identification

  2019cites this paper
• Action prediction via deep residual feature learning and weighted loss

  2019cites this paper
• DermoDeep-A classification of melanoma-nevus skin lesions using multi-feature fusion of visual features and deep neural network

  2019cites this paper
• Discriminative low-rank representation with Schatten-p norm for image recognition

  2019cites this paper
• A parallel beamforming system with real-time implementation

  2019cites this paper
• Augmenting data with GANs to segment melanoma skin lesions

  2019cites this paper
• An optimal wavelet-based multi-modality medical image fusion approach based on modified central force optimization and histogram matching

  2019cites this paper
• Sensor-based human activity recognition via zero-shot learning

  2019cites this paper
• Generating Behavior Features for Cold-Start Spam Review Detection

  2019cites this paper
• Accelerating binary biclustering on platforms with CUDA-enabled GPUs

  2019cites this paper
• Multi-stream CNN for facial expression recognition in limited training data

  2019cites this paper
• An adaptive fuzzy K-nearest neighbor approach for MR brain tumor image classification using parameter free bat optimization algorithm

  2019cites this paper
• Local region partition for person re-identification

  2019cites this paper
• Detection of breast cancer via deep convolution neural networks using MRI images

  2019cites this paper
• A general framework for complex network-based image segmentation

  2019cites this paper
• A cancelable fingerprint biometric based session key establishment protocol

  2019cites this paper
• Mobile edge computing based QoS optimization in medical healthcare applications

  2019cites this paper
• Activity Recognition Using Temporal Optical Flow Convolutional Features and Multilayer LSTM

  2019cites this paper
• Fast image encryption algorithm based on parallel computing system

  2019cites this paper
• Multimedia retrieval by deep hashing with multilevel similarity learning

  2019cites this paper
• Illumination and scale invariant relevant visual features with hypergraph-based learning for multi-shot person re-identification

  2019cites this paper
• Monocular relative depth reordering by propagating confidence of local and global cues

  2019cites this paper
• Krill herd algorithm based on cuckoo search for solving engineering optimization problems

  2019cites this paper
• A novel maximum and minimum response-based Gabor (MMRG) feature extraction method for facial expression recognition

  2019cites this paper
• A survey on wearable sensor modality centred human activity recognition in health care

  2019cites this paper
• Network Flow Labeling for Extended Target Tracking PHD Filters

  2019cites this paper