The Kubernetes Scaling Problem: People vs. Tools

10 September 2021 by Joel Parks

Kubernetes is a rapidly growing, emerging technology within most industries, with significant levels of adoption already. According to the CNCF the use of containers in production has increased to 92%, which is up from 84% last year, and up 300% from their first survey in 2016.

Similarly, Kubernetes use in production has increased to 83%, which is up from 78% last year. It provides an operating model that is far more scalable than traditional infrastructure-based approaches and can provide a very elastic runtime for business-critical applications.

During the COVID19 pandemic, 68% of IT professionals have increased their use of Kubernetes.
Source: 2021 Kubernetes Adoption Report

The promise of scalability is a massive contributor to the rapid adoption of Kubernetes. There are still challenges to realizing this value though. Historically, organizations have scaled their use of technologies through a combination of adding additional tools to support automation, but primarily through expanding the headcount of the teams tasked with the systems management and usage. 

This is the fundamental problem when put in the context of Kubernetes.

Kubernetes is complex and relatively new

Because of that, the number of highly-qualified engineers available in the market is small.  Engineers are often motivated to work on ‘prestige' projects and when they possess an advanced skill that is in high demand, they're unlikely to join organizations that don't provide projects that match their expectations. This presents a challenge for the majority of organizations in hiring and retaining these people.

Kubernetes experts command LARGE salaries and are attracted to cutting edge organizations with disruptive products. This scarcity of resources has created a large problem for the average, established enterprise: Even if these resources can be attracted and hired, they are an inherent flight risk. If they aren't presented with sufficiently "interesting" problems and a commensurate salary, they will simply leave when a better offer is made.

Over 40% of organizations that have begun the process say that the inherent complexity and shortage of skills is preventing them from advancing.

So if scaling Kubernetes isn't practical by scaling the team, what can organizations that desire to use it do?

Seeing Kubernetes success with tooling

The answer is tooling and automation.

When implemented effectively, containers and Kubernetes hold the key to unlocking the value of cloud, but the inherent complexity of the technologies (and the required changes) present barriers to operationalization that are not easily overcome. 

Appvia Wayfinder was designed to address these challenges so organisations can fully utilize Kubernetes and scale their business. Our experience with Kubernetes in the context of high-growth, high-scale and highly regulated environments has been captured in the construction of the products, which come out-of-the-box with highly automated functions that encapsulate the skills and expertise that highly qualified engineers would possess.

Wayfinder is an abstraction layer that sits on top of the cloud providers, which simplifies the creation and maintenance of your Kubernetes clusters. It was created to make Kubernetes simple, and self-service for organisations who don't have the time or capabilities to fully harness Kubernetes in-house. We have the Kubernetes expertise, so you don't have to.

Share this article

About the author

Picture of Joel Parks

Joel Parks

Chief Technology Officer

Joel underpins our engineering teams, supporting their cross-functional efforts around overarching business goals.

Related articles