Exploring Cutout and Mixup for Robust Human Activity Recognition on Sensor and Skeleton Data †

Hiskias Dingeto, Juntae Kim

Research output: Contribution to journalArticlepeer-review

Abstract

Human Activity Recognition (HAR) is an essential area of research in Artificial Intelligence and Machine Learning, with numerous applications in healthcare, sports science, and smart environments. While several advancements in the field, such as attention-based models and Graph Neural Networks, have made great strides, this work focuses on data augmentation methods that tackle issues like data scarcity and task variability in HAR. In this work, we investigate and expand the use of mixup and cutout data augmentation methods to sensor-based and skeleton-based HAR datasets. These methods were first widely used in Computer Vision and Natural Language Processing. We use both augmentation techniques, customized for time-series and skeletal data, to improve the robustness and performance of HAR models by diversifying the data and overcoming the drawbacks of having limited training data. Specifically, we customize mixup data augmentation for sensor-based datasets and cutout data augmentation for skeleton-based datasets with the goal of improving model accuracy without adding more data. Our results show that using mixup and cutout techniques improves the accuracy and generalization of activity recognition models on both sensor-based and skeleton-based human activity datasets. This work showcases the potential of data augmentation techniques on transformers and Graph Neural Networks by offering a novel method for enhancing time series and skeletal HAR tasks.

Original languageEnglish
Article number10286
JournalApplied Sciences (Switzerland)
Volume14
Issue number22
DOIs
StatePublished - Nov 2024

Keywords

  • cutout
  • data augmentation
  • human activity recognition
  • human skeleton data
  • mixup
  • time-series data
  • transformers

Fingerprint

Dive into the research topics of 'Exploring Cutout and Mixup for Robust Human Activity Recognition on Sensor and Skeleton Data †'. Together they form a unique fingerprint.

Cite this