Practical Efficient Microservice Autoscaling

Abstract

Motivation. In recent years, the adoption of microservices in production systems has been steadily growing. With their loosely-coupled and lightweight components, microservices are easier to manage than traditional monolithic applications. However, microservices introduce new challenges towards efficient resource management because their high number of individually manageable components creates a large configuration space. Moreover, microservices have complex inter-dependencies, making identifying "good" configurations harder. Even the same amount of resources can result in different response latencies based on how the resource is distributed among different microservices. Meanwhile, existing cloud management approaches are designed for monolithic deployments and cannot capture the complex interactions between microservices.