S3D: Squeeze and Excitation 3D Convolutional Neural Networks for a Fall Detection System

Seung Baek Hong, Yu Hwan Kim, Se Hyun Nam, Kang Ryoung Park

Research output: Contribution to journalArticlepeer-review

4 Scopus citations

Abstract

Because of the limitations of previous studies on a fall detection system (FDS) based on wearable and ambient devices and visible light and depth cameras, the research using thermal cameras has recently been conducted. However, they also have the problem of deteriorating the accuracy of FDS depending on various environmental changes. Given these facts, in this study, we newly propose an FDS method based on the squeeze and excitation (SE) 3D convolutional neural networks (S3D). In our method, keyframes are extracted from input thermal videos using the optical flow vectors, and the fall detection is carried out based on the output of the proposed S3D, using the extracted keyframes as input. Comparative experiments were carried out on three open databases of thermal videos with different image resolutions, and our proposed method obtained F1 scores of 97.14%, 95.30%, and 98.89% in the Thermal Simulated Fall, Telerobotics and Control Lab fall detection, and eHomeSeniors datasets, respectively (the F1 score is a harmonic mean of recall and precision; it was confirmed that these are superior results to those obtained using the state-of-the-art methods of a thermal camera-based FDS.

Original languageEnglish
Article number328
JournalMathematics
Volume10
Issue number3
DOIs
StatePublished - 1 Feb 2022

Keywords

  • 3D CNN
  • Deep learning
  • Fall detection system
  • Squeeze and excitation
  • Thermal video

Fingerprint

Dive into the research topics of 'S3D: Squeeze and Excitation 3D Convolutional Neural Networks for a Fall Detection System'. Together they form a unique fingerprint.

Cite this