Prediction-based autoscaling for container-based PaaS system

Abstract

As cloud computing becomes popular, Platform as a Service (PaaS) plays an important role in a modern cloud system. The orchestration and efficiency attract more attention and demand a more intelligent solution. In this paper, we present Next Generation PaaS (NG-PaaS) which provides resource management, application management and performance monitoring. The NG-PaaS is built on docker to enable fine-grained rapid management. There is also an intelligent scheduling system to improve the resource allocation and reduce response latency. A pre-allocation mechanism is designed to analyze and predict the application behavior to guide the specific deployment. The experiments show there are around 50% and 33% reduction in average response latency and CPU utilization respectively.