Burst-Aware Horizontal Autoscaling Based on Deep Learning for Stable Microservices

Jin Park, Byeonghui Jeong, Jueun Jeon, Young Sik Jeong

Research output: Contribution to journalArticlepeer-review

1 Scopus citations

Abstract

In the cloud computing environment, container autoscaling is a key resource-management method that provides continuity and scalability for microservices. However, the autoscaling method based on a reactive mechanism is unable to respond instantly to workload changes, leading to resource wastage. Moreover, this method struggles to identify irregular burst states accurately in the workload, resulting in service disruptions. Accordingly, this study proposes a burst-aware horizontal autoscaling (BHAS) method that operates using a proactive mechanism to enhance the stability and resource efficiency of microservices under burst workloads. BHAS uses a time-series forecasting model that combines the reversible instance normalization method with the decomposition linear to predict future resource usage. Then, BHAS flexibly detects local and global bursts in the predicted future workload comprising heterogeneous resource usage. Finally, it performs scaling by calculating the number of efficient containers at each time point for the detected burst and nonburst states. The performance evaluation of BHAS in a cloud-native computing environment revealed that the average number of resource overload instances was reduced by up to 96.74% compared to the existing autoscaling techniques applying the actual container workload trace. In addition, resource utilization improved by approximately 3.3% compared with the reactive mechanismbased autoscaling method.

Original languageEnglish
Article number67
JournalHuman-centric Computing and Information Sciences
Volume14
DOIs
StatePublished - 2024

Keywords

  • Burst Detection
  • Cloud Computing
  • Container Autoscaling
  • Resource Management
  • Time-Series Forecasting

Fingerprint

Dive into the research topics of 'Burst-Aware Horizontal Autoscaling Based on Deep Learning for Stable Microservices'. Together they form a unique fingerprint.

Cite this