BACKGROUND

Service provider networks have enabled businesses and other organizations to more easily develop, deploy, and scale virtually any type of computing workload using various types of computing resources. Service provider networks generally provide users with the ability to use, for example, compute resources (for example, by hosting virtual machine (VM) instances or containers, executing batch jobs, executing code without provisioning servers, and so forth), data/storage resources (for example, object storage, block-level storage, data archival storage, databases and database tables, and so forth), network-related resources (for example, configuring virtual networks including groups of compute resources, content delivery networks (CDNs), Domain Name Service (DNS)), application resources (for example, databases, application build/deployment services), and the like.

Modern businesses and other organizations that use such computing resources provided by service provider networks often use the resources to support a few or many separate workloads and development teams that use compute resources for different purposes. A workload generally represents any type of processing to be carried out by one or more computing systems including, for example, an application, batch job, script, or the like. As an example, a business operating a video streaming service might rely on a first workload that implements a website or other type of front-end interface, a second workload used to encode videos into various formats for use by different types of client devices, and further rely on the periodic execution of various other workloads used to generate financial reports, analyze user statistics, and the like.

