Elastic Resource Provisioning Using Data Clustering in Cloud Service Platform

Abstract

Currently, cloud computing has received great attention in commerce and scientific research due to its flexibility and strong data processing capability. However, in view of the fact that the types of tasks display an upward trend as the growth of service demands, and the different types of tasks arrive at the system without regularity. Moreover, the resources deployed in cloud are insufficiency to be flexibly provisioned in the face of obvious workload fluctuations. In this article, we present a method of elastic resource provisioning using date clustering in cloud service platform. The framework of proposed method consists of three core components: tasks clustering, the amount of tasks prediction in cluster, dynamic resource provisioning and scheduling. In workload classification, we propose a clustering ensemble method, which utilizes a novel distance decision-making method to obtain the final results. Our method can effectively partition the arriving tasks into several clusters based on similarity among tasks. For each cluster, we forecast the amount of tasks arriving at next moment by prediction model based on time-series to provide reference for the follow-up resource provisioning. Afterwards, an energy-saving resource provisioning method is designed to dynamically provide resources for tasks in each cluster to meet their performance requirements. We implement the experiments in Google cloud traces dataset and the results show that our method achieves 92.3, 91.2 percent, and 3679.2 kW$ \cdot$·h respectively in terms of guarantee ratio, resource utilization and total energy consumption, which demonstrates the effectiveness of proposed method for dynamic resource provisioning.