Online eigenvector transformation reflecting concept drift for improving network intrusion detection

Seongchul Park, Sanghyun Seo, Changhoon Jeong, Juntae Kim

Research output: Contribution to journalArticlepeer-review

8 Scopus citations

Abstract

Currently, large data streams are constantly being generated in diverse environments, and continuous storage of the data and periodic batch-type principal component analysis (PCA) are becoming increasingly difficult. Various online PCA algorithms have been proposed to solve this problem. In this study, we propose an online PCA methodology based on online eigenvector transformation with the moving average of the data stream that can reflect concept drift. We compared the network intrusion detection performance based on online transformation of eigenvectors with that of offline methods by applying three machine learning algorithms. Both online and offline methods demonstrated excellent performance in terms of precision. However, in terms of the recall ratio, the performance of the proposed methodology with integrated online eigenvector transformation was better; thus, the F1-measure also indicated better performance. The visualization of the principal component score shows the effectiveness of our method.

Original languageEnglish
Article numbere12477
JournalExpert Systems
Volume37
Issue number5
DOIs
StatePublished - 1 Oct 2020

Keywords

  • concept drift
  • eigenvalue
  • eigenvector
  • online transformation
  • principle component analysis

Fingerprint

Dive into the research topics of 'Online eigenvector transformation reflecting concept drift for improving network intrusion detection'. Together they form a unique fingerprint.

Cite this