The Kubernetes Scaling Problem: People vs. Tools

Table of Contents

Kubernetes is a rapidly growing, emerging technology within most industries, with significant levels of adoption already. According to the CNCF the use of containers in production has increased to 92%, which is up from 84% last year, and up 300% from their first survey in 2016.

Similarly, Kubernetes use in production has increased to 83%, which is up from 78% last year. It provides an operating model that is far more scalable than traditional infrastructure-based approaches and can provide a very elastic runtime for business-critical applications.

During the COVID19 pandemic, 68% of IT professionals have increased their use of Kubernetes.

Source: 2021 Kubernetes Adoption Report

The promise of scalability is a massive contributor to the rapid adoption of Kubernetes. There are still challenges to realizing this value though. Historically, organizations have scaled their use of technologies through a combination of adding additional tools to support automation, but primarily through expanding the headcount of the teams tasked with the systems management and usage. 

This is the fundamental problem when put in the context of Kubernetes.

Kubernetes is complex and relatively new

Because of that, the number of highly-qualified engineers available in the market is small.  Engineers are often motivated to work on ‘prestige’ projects and when they possess an advanced skill that is in high demand, they’re unlikely to join organizations that don’t provide projects that match their expectations. This presents a challenge for the majority of organizations in hiring and retaining these people.

Kubernetes experts command LARGE salaries and are attracted to cutting edge organizations with disruptive products. This scarcity of resources has created a large problem for the average, established enterprise: Even if these resources can be attracted and hired, they are an inherent flight risk. If they aren’t presented with sufficiently “interesting” problems and a commensurate salary, they will simply leave when a better offer is made.

Over 40% of organizations that have begun the process say that the inherent complexity and shortage of skills is preventing them from advancing.

Kubernetes adoption trajectory

The Kubernetes experience follows a common trajectory across most organizations, which is littered with pitfalls for inexperienced engineers. 

screenshot 2021 11 09 at 3.08.00 pm

The organization starts off with no containers and no orchestration. Developers will try a POV/POC application and discover that it works relatively well. Then they will try containerizing existing applications, where they’ll quickly find that major refactoring is needed and organizational behaviors will have to change to accommodate it. 

Around this time, engineers may grow disillusioned with Kubernetes and ask if the conversion is really worth the effort.

So if scaling Kubernetes isn’t practical by scaling the team, what can organizations that desire to use it do?

Seeing Kubernetes success with tooling

The answer is tooling and automation. When implemented effectively, containers and Kubernetes hold the key to unlocking the value of cloud, but the inherent complexity of the technologies (and the required changes) present barriers to operationalization that are not easily overcome. 

The Kubernetes technical capability comes ahead of usability, so users have a hard time fully leveraging the true potential of Kubernetes. This is true even for managed versions like AKS, EKS and GKE. 

Appvia Wayfinder was designed to address these challenges so organisations can fully utilize Kubernetes and scale their business – like a Kubernetes team in a box. Our experience with Kubernetes in the context of high-growth, high-scale and highly regulated environments has been captured in the construction of the products, which come out-of-the-box with highly automated functions that encapsulate the skills and expertise that highly qualified engineers would possess.

screenshot 2021 11 09 at 3.09.09 pm

Wayfinder is an abstraction layer that sits on top of the cloud providers, which simplifies the creation and maintenance of your Kubernetes clusters.

Over 40% of organizations that have started the process of Kubernetes adoption say that the inherent complexity and shortage of skills is preventing them from advancing. We’re here to make sure that doesn’t happen, helping organizations reach operationalized Kubernetes and make the promise of cloud a reality.  

About Appvia

Appvia enables businesses to solve complex cloud challenges with products and services that make Kubernetes secure, cost-effective and scalable.

Our founders have worked with Kubernetes in highly regulated, highly secure environments since 2016, contributing heavily to innovative projects such as Kops and fully utilizing Kubernetes ahead of the curve. We’ve mastered Kubernetes, and experienced its complexities, so our customers don’t have to. 

Share this article
profile-112x112-crop-1 (7)
Joel Parks
Joel underpins our engineering teams, supporting their cross-functional efforts around overarching business goals.

The podcast that takes a lighthearted look at the who, what, when, where, why, how and OMGs of cloud computing

Related insights

Managing Kubernetes Secrets with HashiCorp Vault vs. Azure Key Vault Keeping secrets secure...
Namespaces are a vital feature of Kubernetes. They allow you to separate uniquely named...
DevOps teams have rapidly adopted Kubernetes as the standard way to deploy and...
Once you start working with Kubernetes, it’s natural to think about how you...
Self-service of cloud resources Kubernetes has been brilliant at delivering an ecosystem for...
Pods, deployments, and services are just some of the concepts that you need to understand in...
Last week I published a blog, “How to spot gaps in your Public Cloud...
Breaking down the core areas that you should be aware of when considering...
5 tips to help you manage more with less Not every manager of...
Public cloud has provided huge benefits in getting infrastructure and services to people...
This is the story of how three Appvia Engineers contributed so much to...
Overview The UK Home Office is a large government organisation, whose projects and...